May 21 01:52:36.482868 np0000001127 systemd[1]: Started devstack@n-cpu.service - Devstack devstack@n-cpu.service.
May 21 01:52:38.374017 np0000001127 nova-compute[98206]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=98206) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:44}}
May 21 01:52:38.374504 np0000001127 nova-compute[98206]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=98206) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:44}}
May 21 01:52:38.374504 np0000001127 nova-compute[98206]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=98206) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:44}}
May 21 01:52:38.374811 np0000001127 nova-compute[98206]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
May 21 01:52:38.496915 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:52:38.507497 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.011s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:52:38.675920 np0000001127 nova-compute[98206]: INFO oslo_service.periodic_task [-] Skipping periodic task _heal_instance_info_cache because its interval is negative
May 21 01:52:39.454141 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] In native threading mode the number of concurrent builds, and snapshots should be limited to the same number. The current configuration has differing limits: max_concurrent_builds: 10, max_concurrent_snapshots: 5. Nova will use a single, overall limit of 10 for these tasks.
May 21 01:52:39.454565 np0000001127 nova-compute[98206]: INFO nova.utils [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] The long task thread pool MainProcess.long_task is initialized
May 21 01:52:39.454665 np0000001127 nova-compute[98206]: INFO nova.virt.driver [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Loading compute driver 'libvirt.LibvirtDriver'
May 21 01:52:39.543061 np0000001127 nova-compute[98206]: INFO nova.compute.provider_config [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
May 21 01:52:40.045884 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Acquiring lock "singleton_lock" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:52:40.045884 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Acquired lock "singleton_lock" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:52:40.045884 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Releasing lock "singleton_lock" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:52:40.045884 np0000001127 nova-compute[98206]: WARNING oslo_service.backend._threading.service [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] no_fork=True: running service in main process
May 21 01:52:40.046067 np0000001127 nova-compute[98206]: INFO nova.service [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Starting compute node (version 33.1.0)
May 21 01:52:40.548917 np0000001127 nova-compute[98206]: INFO nova.utils [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] The default thread pool MainProcess.default is initialized
May 21 01:52:40.549647 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:52:40.550022 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Starting event thread {{(pid=98206) start /opt/stack/nova/nova/virt/libvirt/host.py:252}}
May 21 01:52:40.550478 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Starting connection event dispatch thread {{(pid=98206) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:553}}
May 21 01:52:40.551272 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Connecting to libvirt: qemu:///system {{(pid=98206) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:558}}
May 21 01:52:41.480649 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x71c09b930620> {{(pid=98206) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:564}}
May 21 01:52:41.483053 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x71c09b930620> {{(pid=98206) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:585}}
May 21 01:52:41.483675 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Connection event '1' reason 'None'
May 21 01:52:41.986831 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Cannot update service status on host "np0000001127" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000001127 could not be found.
May 21 01:52:41.987268 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.mount [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Initialising _HostMountState generation 0 {{(pid=98206) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
May 21 01:52:51.923585 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Libvirt host capabilities <capabilities>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:   <host>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:     <uuid>d5d06cba-b6e7-4050-84eb-2f6bf37e7716</uuid>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:     <cpu>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <arch>x86_64</arch>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <model>EPYC-Milan</model>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <vendor>AMD</vendor>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <microcode version='16777317'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <signature family='25' model='1' stepping='1'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <topology sockets='12' dies='1' cores='1' threads='1'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <maxphysaddr mode='emulate' bits='40'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <feature name='x2apic'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <feature name='tsc-deadline'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <feature name='osxsave'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <feature name='hypervisor'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <feature name='tsc_adjust'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <feature name='ospke'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <feature name='vaes'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <feature name='vpclmulqdq'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <feature name='spec-ctrl'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <feature name='stibp'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <feature name='arch-capabilities'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <feature name='ssbd'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <feature name='cmp_legacy'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <feature name='topoext'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <feature name='stibp-always-on'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <feature name='virt-ssbd'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <feature name='amd-psfd'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <feature name='lbrv'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <feature name='tsc-scale'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <feature name='vmcb-clean'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <feature name='flushbyasid'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <feature name='pause-filter'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <feature name='pfthreshold'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <feature name='v-vmsave-vmload'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <feature name='vgif'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <feature name='no-nested-data-bp'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <feature name='lfence-always-serializing'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <feature name='null-sel-clr-base'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <feature name='rdctl-no'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <feature name='skip-l1dfl-vmentry'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <feature name='mds-no'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <feature name='pschange-mc-no'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <feature name='gds-no'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <pages unit='KiB' size='4'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <pages unit='KiB' size='2048'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <pages unit='KiB' size='1048576'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:     </cpu>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:     <power_management/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:     <iommu support='no'/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:     <migration_features>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <live/>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       <uri_transports>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:         <uri_transport>tcp</uri_transport>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:         <uri_transport>rdma</uri_transport>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:       </uri_transports>
May 21 01:52:51.923585 np0000001127 nova-compute[98206]:     </migration_features>
May 21 01:52:51.924854 np0000001127 nova-compute[98206]:     <topology>
May 21 01:52:51.924854 np0000001127 nova-compute[98206]:       <cells num='1'>
May 21 01:52:51.924854 np0000001127 nova-compute[98206]:         <cell id='0'>
May 21 01:52:51.924854 np0000001127 nova-compute[98206]:           <memory unit='KiB'>24607192</memory>
May 21 01:52:51.924854 np0000001127 nova-compute[98206]:           <pages unit='KiB' size='4'>6151798</pages>
May 21 01:52:51.924854 np0000001127 nova-compute[98206]:           <pages unit='KiB' size='2048'>0</pages>
May 21 01:52:51.924854 np0000001127 nova-compute[98206]:           <pages unit='KiB' size='1048576'>0</pages>
May 21 01:52:51.924854 np0000001127 nova-compute[98206]:           <distances>
May 21 01:52:51.924854 np0000001127 nova-compute[98206]:             <sibling id='0' value='10'/>
May 21 01:52:51.924854 np0000001127 nova-compute[98206]:           </distances>
May 21 01:52:51.924854 np0000001127 nova-compute[98206]:           <cpus num='12'>
May 21 01:52:51.924854 np0000001127 nova-compute[98206]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
May 21 01:52:51.924854 np0000001127 nova-compute[98206]:             <cpu id='1' socket_id='1' die_id='1' core_id='0' siblings='1'/>
May 21 01:52:51.924854 np0000001127 nova-compute[98206]:             <cpu id='2' socket_id='2' die_id='2' core_id='0' siblings='2'/>
May 21 01:52:51.924854 np0000001127 nova-compute[98206]:             <cpu id='3' socket_id='3' die_id='3' core_id='0' siblings='3'/>
May 21 01:52:51.924854 np0000001127 nova-compute[98206]:             <cpu id='4' socket_id='4' die_id='4' core_id='0' siblings='4'/>
May 21 01:52:51.924854 np0000001127 nova-compute[98206]:             <cpu id='5' socket_id='5' die_id='5' core_id='0' siblings='5'/>
May 21 01:52:51.924854 np0000001127 nova-compute[98206]:             <cpu id='6' socket_id='6' die_id='6' core_id='0' siblings='6'/>
May 21 01:52:51.924854 np0000001127 nova-compute[98206]:             <cpu id='7' socket_id='7' die_id='7' core_id='0' siblings='7'/>
May 21 01:52:51.924854 np0000001127 nova-compute[98206]:             <cpu id='8' socket_id='8' die_id='8' core_id='0' siblings='8'/>
May 21 01:52:51.924854 np0000001127 nova-compute[98206]:             <cpu id='9' socket_id='9' die_id='9' core_id='0' siblings='9'/>
May 21 01:52:51.924854 np0000001127 nova-compute[98206]:             <cpu id='10' socket_id='10' die_id='10' core_id='0' siblings='10'/>
May 21 01:52:51.924854 np0000001127 nova-compute[98206]:             <cpu id='11' socket_id='11' die_id='11' core_id='0' siblings='11'/>
May 21 01:52:51.924854 np0000001127 nova-compute[98206]:           </cpus>
May 21 01:52:51.924854 np0000001127 nova-compute[98206]:         </cell>
May 21 01:52:51.924854 np0000001127 nova-compute[98206]:       </cells>
May 21 01:52:51.924854 np0000001127 nova-compute[98206]:     </topology>
May 21 01:52:51.924854 np0000001127 nova-compute[98206]:     <cache>
May 21 01:52:51.924854 np0000001127 nova-compute[98206]:       <bank id='0' level='3' type='both' size='32' unit='MiB' cpus='0'/>
May 21 01:52:51.924854 np0000001127 nova-compute[98206]:       <bank id='1' level='3' type='both' size='32' unit='MiB' cpus='1'/>
May 21 01:52:51.924854 np0000001127 nova-compute[98206]:       <bank id='2' level='3' type='both' size='32' unit='MiB' cpus='2'/>
May 21 01:52:51.924854 np0000001127 nova-compute[98206]:       <bank id='3' level='3' type='both' size='32' unit='MiB' cpus='3'/>
May 21 01:52:51.924854 np0000001127 nova-compute[98206]:       <bank id='4' level='3' type='both' size='32' unit='MiB' cpus='4'/>
May 21 01:52:51.924854 np0000001127 nova-compute[98206]:       <bank id='5' level='3' type='both' size='32' unit='MiB' cpus='5'/>
May 21 01:52:51.924854 np0000001127 nova-compute[98206]:       <bank id='6' level='3' type='both' size='32' unit='MiB' cpus='6'/>
May 21 01:52:51.924854 np0000001127 nova-compute[98206]:       <bank id='7' level='3' type='both' size='32' unit='MiB' cpus='7'/>
May 21 01:52:51.924854 np0000001127 nova-compute[98206]:       <bank id='8' level='3' type='both' size='32' unit='MiB' cpus='8'/>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:       <bank id='9' level='3' type='both' size='32' unit='MiB' cpus='9'/>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:       <bank id='10' level='3' type='both' size='32' unit='MiB' cpus='10'/>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:       <bank id='11' level='3' type='both' size='32' unit='MiB' cpus='11'/>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:     </cache>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:     <secmodel>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:       <model>apparmor</model>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:       <doi>0</doi>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:     </secmodel>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:     <secmodel>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:       <model>dac</model>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:       <doi>0</doi>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:       <baselabel type='kvm'>+64055:+993</baselabel>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:       <baselabel type='qemu'>+64055:+993</baselabel>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:     </secmodel>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:   </host>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:   <guest>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:     <os_type>hvm</os_type>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:     <arch name='alpha'>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:       <wordsize>64</wordsize>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:       <machine maxCpus='4'>clipper</machine>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:       <domain type='qemu'/>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:     </arch>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:     <features>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:       <cpuselection/>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:       <deviceboot/>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:       <disksnapshot default='on' toggle='no'/>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:       <externalSnapshot/>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:     </features>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:   </guest>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:   <guest>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:     <os_type>hvm</os_type>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:     <arch name='armv6l'>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:       <wordsize>32</wordsize>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:       <emulator>/usr/bin/qemu-system-arm</emulator>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-8.2</machine>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>mori-bmc</machine>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>ast2600-evb</machine>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>borzoi</machine>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>spitz</machine>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>virt-2.7</machine>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>nuri</machine>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>romulus-bmc</machine>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-3.0</machine>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-5.0</machine>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>npcm750-evb</machine>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>virt-2.10</machine>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>rainier-bmc</machine>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>mps3-an547</machine>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>musca-b1</machine>
May 21 01:52:51.925512 np0000001127 nova-compute[98206]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>versatileab</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>kzm</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>virt-2.8</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>fby35-bmc</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>musca-a</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-3.1</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-5.1</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>smdkc210</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>sx1</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>virt-2.11</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>imx25-pdk</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>virt-2.9</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='4'>orangepi-pc</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>z2</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-5.2</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>tosa</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>mps2-an500</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>virt-2.12</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>mps2-an521</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='4'>sabrelite</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>mps2-an511</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>canon-a1100</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>realview-eb</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-7.0</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-4.0</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>raspi1ap</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>sx1-v1</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>n810</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>g220a-bmc</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>n800</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-7.1</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 21 01:52:51.926397 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-4.1</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>quanta-gsj</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>versatilepb</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>terrier</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>mainstone</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>integratorcp</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-7.2</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-4.2</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>mps3-an524</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>kudo-bmc</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='4'>vexpress-a9</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='4'>midway</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>musicpal</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>lm3s811evb</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>microbit</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='3'>fby35</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>mps2-an505</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>mps2-an385</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-6.0</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-8.0</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>cubieboard</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>ast1030-evb</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>verdex</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='4'>bpim2u</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>netduino2</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>mps2-an386</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-6.1</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-8.1</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='4'>raspi2b</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='4'>vexpress-a15</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>fuji-bmc</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-6.2</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>cheetah</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>virt-2.6</machine>
May 21 01:52:51.929309 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>ast2500-evb</machine>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <machine maxCpus='4'>highbank</machine>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>akita</machine>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>connex</machine>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>netduinoplus2</machine>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>collie</machine>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>raspi0</machine>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <domain type='qemu'/>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:     </arch>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:     <features>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <cpuselection/>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <deviceboot/>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <disksnapshot default='on' toggle='no'/>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <externalSnapshot/>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:     </features>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:   </guest>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:   <guest>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:     <os_type>hvm</os_type>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:     <arch name='armv7l'>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <wordsize>32</wordsize>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <emulator>/usr/bin/qemu-system-arm</emulator>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-8.2</machine>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>mori-bmc</machine>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>ast2600-evb</machine>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>borzoi</machine>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>spitz</machine>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>virt-2.7</machine>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>nuri</machine>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>romulus-bmc</machine>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-3.0</machine>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-5.0</machine>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>npcm750-evb</machine>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>virt-2.10</machine>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>rainier-bmc</machine>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>mps3-an547</machine>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>musca-b1</machine>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>versatileab</machine>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>kzm</machine>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>virt-2.8</machine>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>fby35-bmc</machine>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>musca-a</machine>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-3.1</machine>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 21 01:52:51.930032 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-5.1</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>smdkc210</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>sx1</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>virt-2.11</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>imx25-pdk</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>virt-2.9</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='4'>orangepi-pc</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>z2</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-5.2</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>tosa</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>mps2-an500</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>virt-2.12</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>mps2-an521</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='4'>sabrelite</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>mps2-an511</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>canon-a1100</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>realview-eb</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-7.0</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-4.0</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>raspi1ap</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>sx1-v1</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>n810</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>g220a-bmc</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>n800</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-7.1</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-4.1</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>quanta-gsj</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>versatilepb</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>terrier</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>mainstone</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>integratorcp</machine>
May 21 01:52:51.930732 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-7.2</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-4.2</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>mps3-an524</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>kudo-bmc</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='4'>vexpress-a9</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='4'>midway</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>musicpal</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>lm3s811evb</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>microbit</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='3'>fby35</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>mps2-an505</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>mps2-an385</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-6.0</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-8.0</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>cubieboard</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>ast1030-evb</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>verdex</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='4'>bpim2u</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>netduino2</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>mps2-an386</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-6.1</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-8.1</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='4'>raspi2b</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='4'>vexpress-a15</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>fuji-bmc</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-6.2</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>cheetah</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>virt-2.6</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>ast2500-evb</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='4'>highbank</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>akita</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>connex</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>netduinoplus2</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>collie</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>raspi0</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 21 01:52:51.931314 np0000001127 nova-compute[98206]:       <domain type='qemu'/>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:     </arch>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:     <features>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <cpuselection/>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <deviceboot/>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <disksnapshot default='on' toggle='no'/>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <externalSnapshot/>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:     </features>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:   </guest>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:   <guest>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:     <os_type>hvm</os_type>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:     <arch name='aarch64'>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <wordsize>64</wordsize>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-8.2</machine>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>mori-bmc</machine>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>ast2600-evb</machine>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>borzoi</machine>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>spitz</machine>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>virt-2.7</machine>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>nuri</machine>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>romulus-bmc</machine>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-3.0</machine>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-5.0</machine>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>npcm750-evb</machine>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>virt-2.10</machine>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>rainier-bmc</machine>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>mps3-an547</machine>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>virt-2.8</machine>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>musca-b1</machine>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>versatileab</machine>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>kzm</machine>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>fby35-bmc</machine>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>musca-a</machine>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-3.1</machine>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-5.1</machine>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>smdkc210</machine>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>sx1</machine>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>virt-2.11</machine>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>imx25-pdk</machine>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>virt-2.9</machine>
May 21 01:52:51.933261 np0000001127 nova-compute[98206]:       <machine maxCpus='4'>orangepi-pc</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>z2</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-5.2</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='6'>xlnx-zcu102</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>tosa</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>mps2-an500</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>virt-2.12</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>mps2-an521</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='4'>sabrelite</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>mps2-an511</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>canon-a1100</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>realview-eb</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>sbsa-ref</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-7.0</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-4.0</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>raspi1ap</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>sx1-v1</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>n810</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>g220a-bmc</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>n800</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-7.1</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-4.1</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>quanta-gsj</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>versatilepb</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>terrier</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>mainstone</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>integratorcp</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-7.2</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-4.2</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 21 01:52:51.933945 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>mps3-an524</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>kudo-bmc</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <machine maxCpus='4'>vexpress-a9</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <machine maxCpus='4'>midway</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>musicpal</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>lm3s811evb</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>microbit</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <machine maxCpus='3'>fby35</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>mps2-an505</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>mps2-an385</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-6.0</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-8.0</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <machine maxCpus='4'>raspi3ap</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>cubieboard</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>ast1030-evb</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>verdex</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <machine maxCpus='4'>bpim2u</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>netduino2</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <machine maxCpus='4'>xlnx-versal-virt</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>mps2-an386</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-6.1</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-8.1</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <machine maxCpus='4'>raspi3b</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <machine maxCpus='4'>raspi2b</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <machine maxCpus='4'>vexpress-a15</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <machine maxCpus='2'>fuji-bmc</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt-6.2</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>cheetah</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>virt-2.6</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>ast2500-evb</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <machine maxCpus='4'>highbank</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>akita</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>connex</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>netduinoplus2</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>collie</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>raspi0</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <domain type='qemu'/>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:     </arch>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:     <features>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <acpi default='on' toggle='yes'/>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <cpuselection/>
May 21 01:52:51.934595 np0000001127 nova-compute[98206]:       <deviceboot/>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:       <disksnapshot default='on' toggle='no'/>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:       <externalSnapshot/>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:     </features>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:   </guest>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:   <guest>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:     <os_type>hvm</os_type>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:     <arch name='cris'>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:       <wordsize>32</wordsize>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:       <emulator>/usr/bin/qemu-system-cris</emulator>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>axis-dev88</machine>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:       <domain type='qemu'/>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:     </arch>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:     <features>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:       <cpuselection/>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:       <deviceboot/>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:       <disksnapshot default='on' toggle='no'/>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:       <externalSnapshot/>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:     </features>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:   </guest>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:   <guest>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:     <os_type>hvm</os_type>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:     <arch name='i686'>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:       <wordsize>32</wordsize>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:       <emulator>/usr/bin/qemu-system-i386</emulator>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-noble-v2</machine>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:       <machine canonical='pc-i440fx-noble-v2' maxCpus='255'>ubuntu</machine>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-mantic</machine>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-5.2</machine>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-lunar-hpb</machine>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-mantic</machine>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.0</machine>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-kinetic</machine>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-4.2</machine>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-mantic-maxcpus</machine>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-q35-xenial</machine>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-q35-2.7</machine>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
May 21 01:52:51.935257 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-groovy</machine>
May 21 01:52:51.938597 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
May 21 01:52:51.938597 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-lunar</machine>
May 21 01:52:51.938597 np0000001127 nova-compute[98206]:       <machine maxCpus='1024'>pc-q35-mantic-hpb-maxcpus</machine>
May 21 01:52:51.938597 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
May 21 01:52:51.938597 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-7.1</machine>
May 21 01:52:51.938597 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-artful</machine>
May 21 01:52:51.938597 np0000001127 nova-compute[98206]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-trusty</machine>
May 21 01:52:51.938597 np0000001127 nova-compute[98206]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.2</machine>
May 21 01:52:51.938597 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
May 21 01:52:51.938597 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
May 21 01:52:51.938597 np0000001127 nova-compute[98206]:       <machine maxCpus='1024'>pc-q35-8.1</machine>
May 21 01:52:51.938597 np0000001127 nova-compute[98206]:       <machine maxCpus='1024'>pc-q35-jammy-maxcpus</machine>
May 21 01:52:51.938597 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
May 21 01:52:51.938597 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-mantic-hpb</machine>
May 21 01:52:51.938597 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
May 21 01:52:51.938597 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-8.1</machine>
May 21 01:52:51.938597 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
May 21 01:52:51.938597 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-6.1</machine>
May 21 01:52:51.938597 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-kinetic</machine>
May 21 01:52:51.938597 np0000001127 nova-compute[98206]:       <machine maxCpus='1024'>pc-i440fx-jammy-maxcpus</machine>
May 21 01:52:51.938597 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
May 21 01:52:51.938597 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-q35-2.4</machine>
May 21 01:52:51.938597 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
May 21 01:52:51.938597 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-7.1</machine>
May 21 01:52:51.938597 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-2.10</machine>
May 21 01:52:51.938597 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>x-remote</machine>
May 21 01:52:51.938597 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-5.1</machine>
May 21 01:52:51.938597 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-2.9</machine>
May 21 01:52:51.938597 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
May 21 01:52:51.938597 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb-maxcpus</machine>
May 21 01:52:51.938597 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-3.1</machine>
May 21 01:52:51.938597 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
May 21 01:52:51.938597 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-4.1</machine>
May 21 01:52:51.938597 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-jammy</machine>
May 21 01:52:51.938597 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
May 21 01:52:51.938597 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
May 21 01:52:51.938597 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-eoan</machine>
May 21 01:52:51.939930 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
May 21 01:52:51.939930 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
May 21 01:52:51.939930 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
May 21 01:52:51.939930 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
May 21 01:52:51.939930 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-lunar</machine>
May 21 01:52:51.939930 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>isapc</machine>
May 21 01:52:51.939930 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb</machine>
May 21 01:52:51.939930 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
May 21 01:52:51.939930 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-q35-2.6</machine>
May 21 01:52:51.939930 np0000001127 nova-compute[98206]:       <machine maxCpus='1024'>pc-q35-mantic-maxcpus</machine>
May 21 01:52:51.939930 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
May 21 01:52:51.939930 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-bionic</machine>
May 21 01:52:51.939930 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
May 21 01:52:51.939930 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
May 21 01:52:51.939930 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-2.12</machine>
May 21 01:52:51.939930 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
May 21 01:52:51.939930 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-kinetic-hpb</machine>
May 21 01:52:51.939930 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
May 21 01:52:51.939930 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-7.0</machine>
May 21 01:52:51.939930 np0000001127 nova-compute[98206]:       <machine maxCpus='1024'>pc-q35-noble-v2</machine>
May 21 01:52:51.939930 np0000001127 nova-compute[98206]:       <machine canonical='pc-q35-noble-v2' maxCpus='1024'>ubuntu-q35</machine>
May 21 01:52:51.939930 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-lunar-hpb</machine>
May 21 01:52:51.939930 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-disco</machine>
May 21 01:52:51.939930 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
May 21 01:52:51.939930 np0000001127 nova-compute[98206]:       <machine maxCpus='1024'>pc-q35-noble</machine>
May 21 01:52:51.939930 np0000001127 nova-compute[98206]:       <machine canonical='pc-q35-noble' maxCpus='1024'>q35</machine>
May 21 01:52:51.939930 np0000001127 nova-compute[98206]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.1</machine>
May 21 01:52:51.939930 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-8.0</machine>
May 21 01:52:51.939930 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-impish</machine>
May 21 01:52:51.939930 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
May 21 01:52:51.939930 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-8.0</machine>
May 21 01:52:51.939930 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
May 21 01:52:51.939930 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-6.0</machine>
May 21 01:52:51.939930 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
May 21 01:52:51.939930 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
May 21 01:52:51.939930 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
May 21 01:52:51.940579 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
May 21 01:52:51.940579 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
May 21 01:52:51.940579 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
May 21 01:52:51.940579 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-7.0</machine>
May 21 01:52:51.940579 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-5.0</machine>
May 21 01:52:51.940579 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-2.8</machine>
May 21 01:52:51.940579 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
May 21 01:52:51.940579 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-3.0</machine>
May 21 01:52:51.940579 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
May 21 01:52:51.940579 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-zesty</machine>
May 21 01:52:51.940579 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-7.2</machine>
May 21 01:52:51.940579 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-4.0</machine>
May 21 01:52:51.940579 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-focal</machine>
May 21 01:52:51.940579 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>microvm</machine>
May 21 01:52:51.940579 np0000001127 nova-compute[98206]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.3</machine>
May 21 01:52:51.940579 np0000001127 nova-compute[98206]:       <machine maxCpus='1024'>pc-q35-jammy-hpb-maxcpus</machine>
May 21 01:52:51.940579 np0000001127 nova-compute[98206]:       <machine maxCpus='1024'>pc-q35-8.2</machine>
May 21 01:52:51.940579 np0000001127 nova-compute[98206]:       <machine canonical='pc-q35-8.2' maxCpus='1024'>q35</machine>
May 21 01:52:51.940579 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-kinetic-hpb</machine>
May 21 01:52:51.940579 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
May 21 01:52:51.940579 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
May 21 01:52:51.940579 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-noble</machine>
May 21 01:52:51.940579 np0000001127 nova-compute[98206]:       <machine canonical='pc-i440fx-noble' maxCpus='255'>pc</machine>
May 21 01:52:51.940579 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
May 21 01:52:51.940579 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
May 21 01:52:51.940579 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-8.2</machine>
May 21 01:52:51.940579 np0000001127 nova-compute[98206]:       <machine canonical='pc-i440fx-8.2' maxCpus='255'>pc</machine>
May 21 01:52:51.940579 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
May 21 01:52:51.940579 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
May 21 01:52:51.940579 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-6.2</machine>
May 21 01:52:51.940579 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
May 21 01:52:51.940579 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
May 21 01:52:51.940579 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-q35-2.5</machine>
May 21 01:52:51.940579 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
May 21 01:52:51.940579 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
May 21 01:52:51.940579 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb-maxcpus</machine>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-7.2</machine>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-2.11</machine>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <domain type='qemu'/>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <domain type='kvm'/>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:     </arch>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:     <features>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <pae/>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <nonpae/>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <acpi default='on' toggle='yes'/>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <apic default='on' toggle='no'/>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <cpuselection/>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <deviceboot/>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <disksnapshot default='on' toggle='no'/>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <externalSnapshot/>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:     </features>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:   </guest>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:   <guest>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:     <os_type>hvm</os_type>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:     <arch name='m68k'>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <wordsize>32</wordsize>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>mcf5208evb</machine>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>virt-7.0</machine>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>an5206</machine>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>virt-6.0</machine>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>q800</machine>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>virt-8.1</machine>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>virt-7.2</machine>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>virt-6.2</machine>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>virt-8.0</machine>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>next-cube</machine>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>virt-7.1</machine>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>virt-6.1</machine>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>virt-8.2</machine>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <machine canonical='virt-8.2' maxCpus='1'>virt</machine>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <domain type='qemu'/>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:     </arch>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:     <features>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <cpuselection/>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <deviceboot/>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <disksnapshot default='on' toggle='no'/>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <externalSnapshot/>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:     </features>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:   </guest>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:   <guest>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:     <os_type>hvm</os_type>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:     <arch name='microblaze'>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <wordsize>32</wordsize>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>petalogix-ml605</machine>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <domain type='qemu'/>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:     </arch>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:     <features>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <cpuselection/>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <deviceboot/>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <disksnapshot default='on' toggle='no'/>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <externalSnapshot/>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:     </features>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:   </guest>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:   <guest>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:     <os_type>hvm</os_type>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:     <arch name='microblazeel'>
May 21 01:52:51.941149 np0000001127 nova-compute[98206]:       <wordsize>32</wordsize>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>petalogix-ml605</machine>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <domain type='qemu'/>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:     </arch>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:     <features>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <cpuselection/>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <deviceboot/>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <disksnapshot default='on' toggle='no'/>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <externalSnapshot/>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:     </features>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:   </guest>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:   <guest>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:     <os_type>hvm</os_type>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:     <arch name='mips'>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <wordsize>32</wordsize>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <emulator>/usr/bin/qemu-system-mips</emulator>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <machine maxCpus='16'>malta</machine>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>mipssim</machine>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <domain type='qemu'/>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:     </arch>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:     <features>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <cpuselection/>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <deviceboot/>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <disksnapshot default='on' toggle='no'/>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <externalSnapshot/>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:     </features>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:   </guest>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:   <guest>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:     <os_type>hvm</os_type>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:     <arch name='mipsel'>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <wordsize>32</wordsize>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <machine maxCpus='16'>malta</machine>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>mipssim</machine>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <domain type='qemu'/>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:     </arch>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:     <features>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <cpuselection/>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <deviceboot/>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <disksnapshot default='on' toggle='no'/>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <externalSnapshot/>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:     </features>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:   </guest>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:   <guest>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:     <os_type>hvm</os_type>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:     <arch name='mips64'>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <wordsize>64</wordsize>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <machine maxCpus='16'>malta</machine>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>mipssim</machine>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>pica61</machine>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>magnum</machine>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <domain type='qemu'/>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:     </arch>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:     <features>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <cpuselection/>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <deviceboot/>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <disksnapshot default='on' toggle='no'/>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <externalSnapshot/>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:     </features>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:   </guest>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:   <guest>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:     <os_type>hvm</os_type>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:     <arch name='mips64el'>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <wordsize>64</wordsize>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
May 21 01:52:51.942967 np0000001127 nova-compute[98206]:       <machine maxCpus='16'>malta</machine>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <machine maxCpus='16'>loongson3-virt</machine>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>mipssim</machine>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>pica61</machine>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>magnum</machine>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <machine maxCpus='16'>boston</machine>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>fuloong2e</machine>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <domain type='qemu'/>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:     </arch>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:     <features>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <cpuselection/>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <deviceboot/>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <disksnapshot default='on' toggle='no'/>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <externalSnapshot/>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:     </features>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:   </guest>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:   <guest>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:     <os_type>hvm</os_type>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:     <arch name='ppc'>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <wordsize>32</wordsize>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>g3beige</machine>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>amigaone</machine>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>virtex-ml507</machine>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>mac99</machine>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <machine maxCpus='32'>ppce500</machine>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>sam460ex</machine>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>pegasos2</machine>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>bamboo</machine>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>40p</machine>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>ref405ep</machine>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <machine maxCpus='15'>mpc8544ds</machine>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <domain type='qemu'/>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:     </arch>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:     <features>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <cpuselection/>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <deviceboot/>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <disksnapshot default='on' toggle='no'/>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <externalSnapshot/>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:     </features>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:   </guest>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:   <guest>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:     <os_type>hvm</os_type>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:     <arch name='ppc64'>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <wordsize>64</wordsize>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-noble</machine>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <machine canonical='pseries-noble' maxCpus='4096'>pseries</machine>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>amigaone</machine>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <machine maxCpus='2048'>powernv9</machine>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-4.1</machine>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <machine maxCpus='15'>mpc8544ds</machine>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-6.1</machine>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-2.5</machine>
May 21 01:52:51.944101 np0000001127 nova-compute[98206]:       <machine maxCpus='2048'>powernv10</machine>
May 21 01:52:51.945080 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-xenial</machine>
May 21 01:52:51.945080 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-4.2</machine>
May 21 01:52:51.945080 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-6.2</machine>
May 21 01:52:51.945080 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-yakkety</machine>
May 21 01:52:51.945080 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-2.6</machine>
May 21 01:52:51.945080 np0000001127 nova-compute[98206]:       <machine maxCpus='32'>ppce500</machine>
May 21 01:52:51.945080 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-bionic-sxxm</machine>
May 21 01:52:51.945080 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-2.7</machine>
May 21 01:52:51.945080 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-3.0</machine>
May 21 01:52:51.945080 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-8.0</machine>
May 21 01:52:51.945080 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-5.0</machine>
May 21 01:52:51.945080 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>40p</machine>
May 21 01:52:51.945080 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-lunar</machine>
May 21 01:52:51.945080 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-2.8</machine>
May 21 01:52:51.945080 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>pegasos2</machine>
May 21 01:52:51.945080 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-hirsute</machine>
May 21 01:52:51.945080 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-3.1</machine>
May 21 01:52:51.945080 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-8.1</machine>
May 21 01:52:51.945080 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-5.1</machine>
May 21 01:52:51.945080 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-eoan</machine>
May 21 01:52:51.945080 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-2.9</machine>
May 21 01:52:51.945080 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-zesty</machine>
May 21 01:52:51.945080 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>bamboo</machine>
May 21 01:52:51.945080 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-groovy</machine>
May 21 01:52:51.945080 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-focal</machine>
May 21 01:52:51.945080 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>g3beige</machine>
May 21 01:52:51.945080 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-8.2</machine>
May 21 01:52:51.945080 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-5.2</machine>
May 21 01:52:51.945080 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-disco</machine>
May 21 01:52:51.945080 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-2.12-sxxm</machine>
May 21 01:52:51.945080 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-mantic</machine>
May 21 01:52:51.945080 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-kinetic</machine>
May 21 01:52:51.945080 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-2.10</machine>
May 21 01:52:51.945080 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-7.0</machine>
May 21 01:52:51.945080 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>virtex-ml507</machine>
May 21 01:52:51.945080 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-2.11</machine>
May 21 01:52:51.945080 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-2.1</machine>
May 21 01:52:51.945080 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-7.1</machine>
May 21 01:52:51.945080 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-cosmic</machine>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-bionic</machine>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-2.12</machine>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-2.2</machine>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-7.2</machine>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>mac99</machine>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-impish</machine>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-jammy</machine>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-artful</machine>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>sam460ex</machine>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>ref405ep</machine>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-2.3</machine>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:       <machine maxCpus='2048'>powernv8</machine>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-4.0</machine>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-6.0</machine>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-2.4</machine>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:       <domain type='qemu'/>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:     </arch>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:     <features>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:       <cpuselection/>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:       <deviceboot/>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:       <disksnapshot default='on' toggle='no'/>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:       <externalSnapshot/>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:     </features>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:   </guest>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:   <guest>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:     <os_type>hvm</os_type>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:     <arch name='ppc64le'>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:       <wordsize>64</wordsize>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-noble</machine>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:       <machine canonical='pseries-noble' maxCpus='4096'>pseries</machine>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>amigaone</machine>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:       <machine maxCpus='2048'>powernv9</machine>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-4.1</machine>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:       <machine maxCpus='15'>mpc8544ds</machine>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-6.1</machine>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-2.5</machine>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:       <machine maxCpus='2048'>powernv10</machine>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-xenial</machine>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-4.2</machine>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-6.2</machine>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-yakkety</machine>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-2.6</machine>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:       <machine maxCpus='32'>ppce500</machine>
May 21 01:52:51.946975 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-bionic-sxxm</machine>
May 21 01:52:51.947709 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-2.7</machine>
May 21 01:52:51.947709 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-3.0</machine>
May 21 01:52:51.947709 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-8.0</machine>
May 21 01:52:51.947709 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-5.0</machine>
May 21 01:52:51.947709 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>40p</machine>
May 21 01:52:51.947709 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-lunar</machine>
May 21 01:52:51.947709 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-2.8</machine>
May 21 01:52:51.947709 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>pegasos2</machine>
May 21 01:52:51.947709 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-hirsute</machine>
May 21 01:52:51.947709 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-3.1</machine>
May 21 01:52:51.947709 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-8.1</machine>
May 21 01:52:51.947709 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-5.1</machine>
May 21 01:52:51.947709 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-eoan</machine>
May 21 01:52:51.947709 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-2.9</machine>
May 21 01:52:51.947709 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-zesty</machine>
May 21 01:52:51.947709 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>bamboo</machine>
May 21 01:52:51.947709 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-groovy</machine>
May 21 01:52:51.947709 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-focal</machine>
May 21 01:52:51.947709 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>g3beige</machine>
May 21 01:52:51.947709 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-8.2</machine>
May 21 01:52:51.947709 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-5.2</machine>
May 21 01:52:51.947709 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-disco</machine>
May 21 01:52:51.947709 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-2.12-sxxm</machine>
May 21 01:52:51.947709 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-mantic</machine>
May 21 01:52:51.947709 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-kinetic</machine>
May 21 01:52:51.947709 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-2.10</machine>
May 21 01:52:51.947709 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-7.0</machine>
May 21 01:52:51.947709 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>virtex-ml507</machine>
May 21 01:52:51.947709 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-2.11</machine>
May 21 01:52:51.947709 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-2.1</machine>
May 21 01:52:51.947709 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-7.1</machine>
May 21 01:52:51.947709 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-cosmic</machine>
May 21 01:52:51.947709 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-bionic</machine>
May 21 01:52:51.947709 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-2.12</machine>
May 21 01:52:51.947709 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-2.2</machine>
May 21 01:52:51.947709 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-7.2</machine>
May 21 01:52:51.947709 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>mac99</machine>
May 21 01:52:51.947709 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-impish</machine>
May 21 01:52:51.947709 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-jammy</machine>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-artful</machine>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>sam460ex</machine>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>ref405ep</machine>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-2.3</machine>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <machine maxCpus='2048'>powernv8</machine>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-4.0</machine>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-6.0</machine>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <machine maxCpus='4096'>pseries-2.4</machine>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <domain type='qemu'/>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:     </arch>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:     <features>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <cpuselection/>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <deviceboot/>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <disksnapshot default='on' toggle='no'/>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <externalSnapshot/>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:     </features>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:   </guest>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:   <guest>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:     <os_type>hvm</os_type>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:     <arch name='riscv32'>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <wordsize>32</wordsize>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt</machine>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <machine maxCpus='8'>spike</machine>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>opentitan</machine>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <machine maxCpus='5'>sifive_u</machine>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>sifive_e</machine>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <domain type='qemu'/>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:     </arch>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:     <features>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <cpuselection/>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <deviceboot/>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <disksnapshot default='on' toggle='no'/>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <externalSnapshot/>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:     </features>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:   </guest>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:   <guest>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:     <os_type>hvm</os_type>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:     <arch name='riscv64'>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <wordsize>64</wordsize>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <machine maxCpus='512'>virt</machine>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <machine maxCpus='8'>spike</machine>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <machine maxCpus='5'>sifive_u</machine>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>shakti_c</machine>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>sifive_e</machine>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <domain type='qemu'/>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:     </arch>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:     <features>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <cpuselection/>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <deviceboot/>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <disksnapshot default='on' toggle='no'/>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <externalSnapshot/>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:     </features>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:   </guest>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:   <guest>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:     <os_type>hvm</os_type>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:     <arch name='s390x'>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <wordsize>64</wordsize>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
May 21 01:52:51.948260 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-noble</machine>
May 21 01:52:51.949263 np0000001127 nova-compute[98206]:       <machine canonical='s390-ccw-virtio-noble' maxCpus='248'>s390-ccw-virtio</machine>
May 21 01:52:51.949263 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-8.0</machine>
May 21 01:52:51.949263 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
May 21 01:52:51.949263 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
May 21 01:52:51.949263 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
May 21 01:52:51.949263 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-7.0</machine>
May 21 01:52:51.949263 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-mantic</machine>
May 21 01:52:51.949263 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
May 21 01:52:51.949263 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
May 21 01:52:51.949263 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
May 21 01:52:51.949263 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
May 21 01:52:51.949263 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
May 21 01:52:51.949263 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
May 21 01:52:51.949263 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-8.2</machine>
May 21 01:52:51.949263 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
May 21 01:52:51.949263 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
May 21 01:52:51.949263 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
May 21 01:52:51.949263 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
May 21 01:52:51.949263 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-7.2</machine>
May 21 01:52:51.949263 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
May 21 01:52:51.949263 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
May 21 01:52:51.949263 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
May 21 01:52:51.949263 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
May 21 01:52:51.949263 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
May 21 01:52:51.949263 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
May 21 01:52:51.949263 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-lunar</machine>
May 21 01:52:51.949263 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
May 21 01:52:51.949263 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-kinetic</machine>
May 21 01:52:51.949263 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-8.1</machine>
May 21 01:52:51.949263 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
May 21 01:52:51.949263 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
May 21 01:52:51.949263 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
May 21 01:52:51.949263 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-7.1</machine>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:       <domain type='qemu'/>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:     </arch>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:     <features>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:       <cpuselection/>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:       <deviceboot/>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:       <disksnapshot default='on' toggle='no'/>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:       <externalSnapshot/>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:     </features>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:   </guest>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:   <guest>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:     <os_type>hvm</os_type>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:     <arch name='sh4'>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:       <wordsize>32</wordsize>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>shix</machine>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>r2d</machine>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:       <domain type='qemu'/>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:     </arch>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:     <features>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:       <cpuselection/>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:       <deviceboot/>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:       <disksnapshot default='on' toggle='no'/>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:       <externalSnapshot/>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:     </features>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:   </guest>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:   <guest>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:     <os_type>hvm</os_type>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:     <arch name='sh4eb'>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:       <wordsize>64</wordsize>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>shix</machine>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>r2d</machine>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:       <domain type='qemu'/>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:     </arch>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:     <features>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:       <cpuselection/>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:       <deviceboot/>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:       <disksnapshot default='on' toggle='no'/>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:       <externalSnapshot/>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:     </features>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:   </guest>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:   <guest>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:     <os_type>hvm</os_type>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:     <arch name='sparc'>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:       <wordsize>32</wordsize>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>SS-5</machine>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:       <machine maxCpus='4'>SS-20</machine>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>LX</machine>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>SPARCClassic</machine>
May 21 01:52:51.951343 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>leon3_generic</machine>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>SPARCbook</machine>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>SS-4</machine>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:       <machine maxCpus='4'>SS-600MP</machine>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:       <machine maxCpus='4'>SS-10</machine>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>Voyager</machine>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:       <domain type='qemu'/>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:     </arch>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:     <features>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:       <cpuselection/>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:       <deviceboot/>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:       <disksnapshot default='on' toggle='no'/>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:       <externalSnapshot/>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:     </features>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:   </guest>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:   <guest>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:     <os_type>hvm</os_type>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:     <arch name='sparc64'>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:       <wordsize>64</wordsize>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>sun4u</machine>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>niagara</machine>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>sun4v</machine>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:       <domain type='qemu'/>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:     </arch>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:     <features>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:       <cpuselection/>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:       <deviceboot/>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:       <disksnapshot default='on' toggle='no'/>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:       <externalSnapshot/>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:     </features>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:   </guest>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:   <guest>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:     <os_type>hvm</os_type>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:     <arch name='x86_64'>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:       <wordsize>64</wordsize>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-noble-v2</machine>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:       <machine canonical='pc-i440fx-noble-v2' maxCpus='255'>ubuntu</machine>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-mantic</machine>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-5.2</machine>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-lunar-hpb</machine>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-mantic</machine>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.0</machine>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-kinetic</machine>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-4.2</machine>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-mantic-maxcpus</machine>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
May 21 01:52:51.953600 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
May 21 01:52:51.954372 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
May 21 01:52:51.954372 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-q35-xenial</machine>
May 21 01:52:51.954372 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
May 21 01:52:51.954372 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
May 21 01:52:51.954372 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-q35-2.7</machine>
May 21 01:52:51.954372 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
May 21 01:52:51.954372 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
May 21 01:52:51.954372 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-groovy</machine>
May 21 01:52:51.954372 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
May 21 01:52:51.954372 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-lunar</machine>
May 21 01:52:51.954372 np0000001127 nova-compute[98206]:       <machine maxCpus='1024'>pc-q35-mantic-hpb-maxcpus</machine>
May 21 01:52:51.954372 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
May 21 01:52:51.954372 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-7.1</machine>
May 21 01:52:51.954372 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-artful</machine>
May 21 01:52:51.954372 np0000001127 nova-compute[98206]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-trusty</machine>
May 21 01:52:51.954372 np0000001127 nova-compute[98206]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.2</machine>
May 21 01:52:51.954372 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
May 21 01:52:51.954372 np0000001127 nova-compute[98206]:       <machine maxCpus='1024'>pc-q35-8.1</machine>
May 21 01:52:51.954372 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
May 21 01:52:51.954372 np0000001127 nova-compute[98206]:       <machine maxCpus='1024'>pc-q35-jammy-maxcpus</machine>
May 21 01:52:51.954372 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
May 21 01:52:51.954372 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-mantic-hpb</machine>
May 21 01:52:51.954372 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
May 21 01:52:51.954372 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-8.1</machine>
May 21 01:52:51.954372 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
May 21 01:52:51.954372 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-6.1</machine>
May 21 01:52:51.954372 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-kinetic</machine>
May 21 01:52:51.954372 np0000001127 nova-compute[98206]:       <machine maxCpus='1024'>pc-i440fx-jammy-maxcpus</machine>
May 21 01:52:51.954372 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
May 21 01:52:51.954372 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-q35-2.4</machine>
May 21 01:52:51.954372 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
May 21 01:52:51.954372 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-7.1</machine>
May 21 01:52:51.954372 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-2.10</machine>
May 21 01:52:51.954372 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>x-remote</machine>
May 21 01:52:51.954372 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-5.1</machine>
May 21 01:52:51.954372 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-2.9</machine>
May 21 01:52:51.954372 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
May 21 01:52:51.955940 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb-maxcpus</machine>
May 21 01:52:51.955940 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-3.1</machine>
May 21 01:52:51.955940 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
May 21 01:52:51.955940 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-4.1</machine>
May 21 01:52:51.955940 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-jammy</machine>
May 21 01:52:51.955940 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
May 21 01:52:51.955940 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
May 21 01:52:51.955940 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-eoan</machine>
May 21 01:52:51.955940 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
May 21 01:52:51.955940 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
May 21 01:52:51.955940 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
May 21 01:52:51.955940 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
May 21 01:52:51.955940 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-lunar</machine>
May 21 01:52:51.955940 np0000001127 nova-compute[98206]:       <machine maxCpus='1'>isapc</machine>
May 21 01:52:51.955940 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb</machine>
May 21 01:52:51.955940 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
May 21 01:52:51.955940 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-q35-2.6</machine>
May 21 01:52:51.955940 np0000001127 nova-compute[98206]:       <machine maxCpus='1024'>pc-q35-mantic-maxcpus</machine>
May 21 01:52:51.955940 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
May 21 01:52:51.955940 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-bionic</machine>
May 21 01:52:51.955940 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
May 21 01:52:51.955940 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
May 21 01:52:51.955940 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-2.12</machine>
May 21 01:52:51.955940 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
May 21 01:52:51.955940 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-kinetic-hpb</machine>
May 21 01:52:51.955940 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
May 21 01:52:51.955940 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-7.0</machine>
May 21 01:52:51.955940 np0000001127 nova-compute[98206]:       <machine maxCpus='1024'>pc-q35-noble-v2</machine>
May 21 01:52:51.955940 np0000001127 nova-compute[98206]:       <machine canonical='pc-q35-noble-v2' maxCpus='1024'>ubuntu-q35</machine>
May 21 01:52:51.955940 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-lunar-hpb</machine>
May 21 01:52:51.955940 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-disco</machine>
May 21 01:52:51.955940 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
May 21 01:52:51.955940 np0000001127 nova-compute[98206]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.1</machine>
May 21 01:52:51.955940 np0000001127 nova-compute[98206]:       <machine maxCpus='1024'>pc-q35-noble</machine>
May 21 01:52:51.955940 np0000001127 nova-compute[98206]:       <machine canonical='pc-q35-noble' maxCpus='1024'>q35</machine>
May 21 01:52:51.955940 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-8.0</machine>
May 21 01:52:51.956552 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
May 21 01:52:51.956552 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-impish</machine>
May 21 01:52:51.956552 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-8.0</machine>
May 21 01:52:51.956552 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
May 21 01:52:51.956552 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-6.0</machine>
May 21 01:52:51.956552 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
May 21 01:52:51.956552 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
May 21 01:52:51.956552 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
May 21 01:52:51.956552 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
May 21 01:52:51.956552 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
May 21 01:52:51.956552 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
May 21 01:52:51.956552 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-7.0</machine>
May 21 01:52:51.956552 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-5.0</machine>
May 21 01:52:51.956552 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-2.8</machine>
May 21 01:52:51.956552 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
May 21 01:52:51.956552 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-3.0</machine>
May 21 01:52:51.956552 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-zesty</machine>
May 21 01:52:51.956552 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-7.2</machine>
May 21 01:52:51.956552 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-4.0</machine>
May 21 01:52:51.956552 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
May 21 01:52:51.956552 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-focal</machine>
May 21 01:52:51.956552 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>microvm</machine>
May 21 01:52:51.956552 np0000001127 nova-compute[98206]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.3</machine>
May 21 01:52:51.956552 np0000001127 nova-compute[98206]:       <machine maxCpus='1024'>pc-q35-jammy-hpb-maxcpus</machine>
May 21 01:52:51.956552 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
May 21 01:52:51.956552 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-kinetic-hpb</machine>
May 21 01:52:51.956552 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
May 21 01:52:51.956552 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
May 21 01:52:51.956552 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-noble</machine>
May 21 01:52:51.956552 np0000001127 nova-compute[98206]:       <machine canonical='pc-i440fx-noble' maxCpus='255'>pc</machine>
May 21 01:52:51.956552 np0000001127 nova-compute[98206]:       <machine maxCpus='1024'>pc-q35-8.2</machine>
May 21 01:52:51.956552 np0000001127 nova-compute[98206]:       <machine canonical='pc-q35-8.2' maxCpus='1024'>q35</machine>
May 21 01:52:51.956552 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
May 21 01:52:51.956552 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
May 21 01:52:51.956552 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-8.2</machine>
May 21 01:52:51.956552 np0000001127 nova-compute[98206]:       <machine canonical='pc-i440fx-8.2' maxCpus='255'>pc</machine>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-6.2</machine>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-q35-2.5</machine>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb-maxcpus</machine>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <machine maxCpus='255'>pc-i440fx-7.2</machine>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <machine maxCpus='288'>pc-q35-2.11</machine>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <domain type='qemu'/>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <domain type='kvm'/>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:     </arch>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:     <features>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <acpi default='on' toggle='yes'/>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <apic default='on' toggle='no'/>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <cpuselection/>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <deviceboot/>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <disksnapshot default='on' toggle='no'/>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <externalSnapshot/>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:     </features>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:   </guest>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:   <guest>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:     <os_type>hvm</os_type>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:     <arch name='xtensa'>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <wordsize>32</wordsize>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <machine maxCpus='4'>sim</machine>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <machine maxCpus='32'>kc705</machine>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <machine maxCpus='32'>ml605</machine>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <machine maxCpus='32'>ml605-nommu</machine>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <machine maxCpus='32'>virt</machine>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <machine maxCpus='32'>lx60-nommu</machine>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <machine maxCpus='32'>lx200</machine>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <machine maxCpus='32'>lx200-nommu</machine>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <machine maxCpus='32'>lx60</machine>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <machine maxCpus='32'>kc705-nommu</machine>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <domain type='qemu'/>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:     </arch>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:     <features>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <cpuselection/>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <deviceboot/>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <disksnapshot default='on' toggle='no'/>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <externalSnapshot/>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:     </features>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:   </guest>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:   <guest>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:     <os_type>hvm</os_type>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:     <arch name='xtensaeb'>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <wordsize>32</wordsize>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <machine maxCpus='4'>sim</machine>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <machine maxCpus='32'>kc705</machine>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <machine maxCpus='32'>ml605</machine>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <machine maxCpus='32'>ml605-nommu</machine>
May 21 01:52:51.958229 np0000001127 nova-compute[98206]:       <machine maxCpus='32'>virt</machine>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:       <machine maxCpus='32'>lx60-nommu</machine>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:       <machine maxCpus='32'>lx200</machine>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:       <machine maxCpus='32'>lx200-nommu</machine>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:       <machine maxCpus='32'>lx60</machine>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:       <machine maxCpus='32'>kc705-nommu</machine>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:       <domain type='qemu'/>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:     </arch>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:     <features>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:       <cpuselection/>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:       <deviceboot/>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:       <disksnapshot default='on' toggle='no'/>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:       <externalSnapshot/>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:     </features>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:   </guest>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]: </capabilities>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]: 
May 21 01:52:51.959549 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=98206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 21 01:52:51.959549 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Libvirt host hypervisor capabilities for arch=alpha and machine_type=None:
May 21 01:52:51.959549 np0000001127 nova-compute[98206]: <domainCapabilities>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:   <path>/usr/bin/qemu-system-alpha</path>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:   <domain>qemu</domain>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:   <machine>clipper</machine>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:   <arch>alpha</arch>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:   <vcpu max='4'/>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:   <iothreads supported='yes'/>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:   <os supported='yes'>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:     <enum name='firmware'/>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:     <loader supported='yes'>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:         <value>rom</value>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:         <value>pflash</value>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:       <enum name='readonly'>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:         <value>yes</value>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:       <enum name='secure'>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:     </loader>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:   </os>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:   <cpu>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:     <mode name='host-passthrough' supported='no'/>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:     <mode name='maximum' supported='no'/>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:     <mode name='host-model' supported='no'/>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:     <mode name='custom' supported='no'/>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:   <memoryBacking supported='yes'>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:     <enum name='sourceType'>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:       <value>file</value>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:       <value>anonymous</value>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:       <value>memfd</value>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:   </memoryBacking>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:   <devices>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:     <disk supported='yes'>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:       <enum name='diskDevice'>
May 21 01:52:51.959549 np0000001127 nova-compute[98206]:         <value>disk</value>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:         <value>cdrom</value>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:         <value>floppy</value>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:         <value>lun</value>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:         <value>fdc</value>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:         <value>sata</value>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:     </disk>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:     <graphics supported='yes'>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:         <value>sdl</value>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:         <value>vnc</value>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:         <value>spice</value>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:         <value>egl-headless</value>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:         <value>dbus</value>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:     <video supported='yes'>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:       <enum name='modelType'>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:         <value>vga</value>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:         <value>cirrus</value>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:         <value>none</value>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:         <value>bochs</value>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:     </video>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:     <hostdev supported='yes'>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:       <enum name='mode'>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:         <value>subsystem</value>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:       <enum name='startupPolicy'>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:         <value>default</value>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:         <value>mandatory</value>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:         <value>requisite</value>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:         <value>optional</value>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:       <enum name='subsysType'>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:         <value>pci</value>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:       <enum name='capsType'/>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:       <enum name='pciBackend'/>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:     </hostdev>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:     <rng supported='yes'>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:         <value>random</value>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:         <value>egd</value>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:     </rng>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:     <filesystem supported='yes'>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:       <enum name='driverType'>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:         <value>path</value>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:         <value>handle</value>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:         <value>virtiofs</value>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:     </filesystem>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:     <tpm supported='no'/>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:     <redirdev supported='yes'>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.962634 np0000001127 nova-compute[98206]:     </redirdev>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:     <channel supported='yes'>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:         <value>pty</value>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:         <value>unix</value>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:         <value>spicevmc</value>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:     </channel>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:     <crypto supported='yes'>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:         <value>qemu</value>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:     </crypto>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:   </devices>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:   <features>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:     <gic supported='no'/>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:     <vmcoreinfo supported='no'/>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:     <genid supported='no'/>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:     <backingStoreInput supported='yes'/>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:     <backup supported='yes'/>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:     <async-teardown supported='yes'/>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:     <sev supported='no'/>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:     <sgx supported='no'/>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:   </features>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]: </domainCapabilities>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 21 01:52:51.965324 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=98206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 21 01:52:51.965324 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=None:
May 21 01:52:51.965324 np0000001127 nova-compute[98206]: <domainCapabilities>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:   <path>/usr/bin/qemu-system-arm</path>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:   <domain>qemu</domain>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:   <machine>virt-8.2</machine>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:   <arch>armv6l</arch>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:   <vcpu max='512'/>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:   <iothreads supported='yes'/>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:   <os supported='yes'>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:     <enum name='firmware'/>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:     <loader supported='yes'>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:         <value>rom</value>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:         <value>pflash</value>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:       <enum name='readonly'>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:         <value>yes</value>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:       <enum name='secure'>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:     </loader>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:   </os>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:   <cpu>
May 21 01:52:51.965324 np0000001127 nova-compute[98206]:     <mode name='host-passthrough' supported='no'/>
May 21 01:52:51.966401 np0000001127 nova-compute[98206]:     <mode name='maximum' supported='yes'>
May 21 01:52:51.966401 np0000001127 nova-compute[98206]:       <enum name='maximumMigratable'>
May 21 01:52:51.966401 np0000001127 nova-compute[98206]:         <value>on</value>
May 21 01:52:51.966401 np0000001127 nova-compute[98206]:         <value>off</value>
May 21 01:52:51.966401 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.966401 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:51.966401 np0000001127 nova-compute[98206]:     <mode name='host-model' supported='no'/>
May 21 01:52:51.966401 np0000001127 nova-compute[98206]:     <mode name='custom' supported='yes'>
May 21 01:52:51.966401 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 21 01:52:51.966401 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 21 01:52:51.966401 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 21 01:52:51.966401 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 21 01:52:51.966401 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 21 01:52:51.966401 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 21 01:52:51.966401 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 21 01:52:51.966401 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 21 01:52:51.966401 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 21 01:52:51.966401 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 21 01:52:51.966401 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 21 01:52:51.966401 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 21 01:52:51.966401 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 21 01:52:51.966401 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 21 01:52:51.966401 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 21 01:52:51.966401 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 21 01:52:51.966401 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 21 01:52:51.966401 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 21 01:52:51.966401 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 21 01:52:51.966401 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 21 01:52:51.966401 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 21 01:52:51.966401 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 21 01:52:51.966401 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 21 01:52:51.966401 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 21 01:52:51.966401 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 21 01:52:51.966401 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>max</model>
May 21 01:52:51.966401 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 21 01:52:51.966401 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:   <memoryBacking supported='yes'>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:     <enum name='sourceType'>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:       <value>file</value>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:       <value>anonymous</value>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:       <value>memfd</value>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:   </memoryBacking>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:   <devices>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:     <disk supported='yes'>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:       <enum name='diskDevice'>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:         <value>disk</value>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:         <value>cdrom</value>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:         <value>floppy</value>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:         <value>lun</value>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:         <value>fdc</value>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:         <value>sata</value>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:     </disk>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:     <graphics supported='yes'>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:         <value>sdl</value>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:         <value>vnc</value>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:         <value>spice</value>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:         <value>egl-headless</value>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:         <value>dbus</value>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:     <video supported='yes'>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:       <enum name='modelType'>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:         <value>vga</value>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:         <value>cirrus</value>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:         <value>none</value>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:         <value>bochs</value>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:         <value>ramfb</value>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:     </video>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:     <hostdev supported='yes'>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:       <enum name='mode'>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:         <value>subsystem</value>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:       <enum name='startupPolicy'>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:         <value>default</value>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:         <value>mandatory</value>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:         <value>requisite</value>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:         <value>optional</value>
May 21 01:52:51.967700 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:       <enum name='subsysType'>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:         <value>pci</value>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:       <enum name='capsType'/>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:       <enum name='pciBackend'/>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:     </hostdev>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:     <rng supported='yes'>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:         <value>random</value>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:         <value>egd</value>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:     </rng>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:     <filesystem supported='yes'>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:       <enum name='driverType'>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:         <value>path</value>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:         <value>handle</value>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:         <value>virtiofs</value>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:     </filesystem>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:     <tpm supported='yes'>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:         <value>tpm-tis</value>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:         <value>passthrough</value>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:         <value>emulator</value>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:         <value>external</value>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:       <enum name='backendVersion'>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:         <value>1.2</value>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:         <value>2.0</value>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:     </tpm>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:     <redirdev supported='yes'>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:     </redirdev>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:     <channel supported='yes'>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:         <value>pty</value>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:         <value>unix</value>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:         <value>spicevmc</value>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:     </channel>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:     <crypto supported='yes'>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:         <value>qemu</value>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:     </crypto>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:   </devices>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:   <features>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:     <gic supported='yes'>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:       <enum name='version'>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:         <value>2</value>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:         <value>3</value>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:     </gic>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:     <vmcoreinfo supported='yes'/>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:     <genid supported='no'/>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:     <backingStoreInput supported='yes'/>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:     <backup supported='yes'/>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:     <async-teardown supported='yes'/>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:     <sev supported='no'/>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:     <sgx supported='no'/>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]:   </features>
May 21 01:52:51.969730 np0000001127 nova-compute[98206]: </domainCapabilities>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 21 01:52:51.972273 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=virt:
May 21 01:52:51.972273 np0000001127 nova-compute[98206]: <domainCapabilities>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:   <path>/usr/bin/qemu-system-arm</path>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:   <domain>qemu</domain>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:   <machine>virt-8.2</machine>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:   <arch>armv6l</arch>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:   <vcpu max='512'/>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:   <iothreads supported='yes'/>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:   <os supported='yes'>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:     <enum name='firmware'/>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:     <loader supported='yes'>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:         <value>rom</value>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:         <value>pflash</value>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:       <enum name='readonly'>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:         <value>yes</value>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:       <enum name='secure'>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:     </loader>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:   </os>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:   <cpu>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:     <mode name='host-passthrough' supported='no'/>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:     <mode name='maximum' supported='yes'>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:       <enum name='maximumMigratable'>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:         <value>on</value>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:         <value>off</value>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:     <mode name='host-model' supported='no'/>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:     <mode name='custom' supported='yes'>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 21 01:52:51.972273 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>max</model>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:   <memoryBacking supported='yes'>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:     <enum name='sourceType'>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:       <value>file</value>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:       <value>anonymous</value>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:       <value>memfd</value>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:   </memoryBacking>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:   <devices>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:     <disk supported='yes'>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:       <enum name='diskDevice'>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:         <value>disk</value>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:         <value>cdrom</value>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:         <value>floppy</value>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:         <value>lun</value>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:         <value>fdc</value>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:51.973207 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:         <value>sata</value>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:     </disk>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:     <graphics supported='yes'>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:         <value>sdl</value>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:         <value>vnc</value>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:         <value>spice</value>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:         <value>egl-headless</value>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:         <value>dbus</value>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:     <video supported='yes'>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:       <enum name='modelType'>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:         <value>vga</value>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:         <value>cirrus</value>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:         <value>none</value>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:         <value>bochs</value>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:         <value>ramfb</value>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:     </video>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:     <hostdev supported='yes'>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:       <enum name='mode'>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:         <value>subsystem</value>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:       <enum name='startupPolicy'>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:         <value>default</value>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:         <value>mandatory</value>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:         <value>requisite</value>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:         <value>optional</value>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:       <enum name='subsysType'>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:         <value>pci</value>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:       <enum name='capsType'/>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:       <enum name='pciBackend'/>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:     </hostdev>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:     <rng supported='yes'>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:         <value>random</value>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:         <value>egd</value>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:     </rng>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:     <filesystem supported='yes'>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:       <enum name='driverType'>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:         <value>path</value>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:         <value>handle</value>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:         <value>virtiofs</value>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:     </filesystem>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:     <tpm supported='yes'>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:         <value>tpm-tis</value>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:         <value>passthrough</value>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:         <value>emulator</value>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:         <value>external</value>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:       <enum name='backendVersion'>
May 21 01:52:51.974030 np0000001127 nova-compute[98206]:         <value>1.2</value>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:         <value>2.0</value>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:     </tpm>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:     <redirdev supported='yes'>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:     </redirdev>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:     <channel supported='yes'>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:         <value>pty</value>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:         <value>unix</value>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:         <value>spicevmc</value>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:     </channel>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:     <crypto supported='yes'>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:         <value>qemu</value>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:     </crypto>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:   </devices>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:   <features>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:     <gic supported='yes'>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:       <enum name='version'>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:         <value>2</value>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:         <value>3</value>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:     </gic>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:     <vmcoreinfo supported='yes'/>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:     <genid supported='no'/>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:     <backingStoreInput supported='yes'/>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:     <backup supported='yes'/>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:     <async-teardown supported='yes'/>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:     <sev supported='no'/>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:     <sgx supported='no'/>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:   </features>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]: </domainCapabilities>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 21 01:52:51.975374 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=98206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 21 01:52:51.975374 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Libvirt host hypervisor capabilities for arch=armv7l and machine_type=virt:
May 21 01:52:51.975374 np0000001127 nova-compute[98206]: <domainCapabilities>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:   <path>/usr/bin/qemu-system-arm</path>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:   <domain>qemu</domain>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:   <machine>virt-8.2</machine>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:   <arch>armv7l</arch>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:   <vcpu max='512'/>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:   <iothreads supported='yes'/>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:   <os supported='yes'>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:     <enum name='firmware'>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:       <value>efi</value>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:     <loader supported='yes'>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:         <value>rom</value>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:         <value>pflash</value>
May 21 01:52:51.975374 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:       <enum name='readonly'>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:         <value>yes</value>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:       <enum name='secure'>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:     </loader>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:   </os>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:   <cpu>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:     <mode name='host-passthrough' supported='no'/>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:     <mode name='maximum' supported='yes'>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:       <enum name='maximumMigratable'>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:         <value>on</value>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:         <value>off</value>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:     <mode name='host-model' supported='no'/>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:     <mode name='custom' supported='yes'>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 21 01:52:51.977670 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>max</model>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:   <memoryBacking supported='yes'>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:     <enum name='sourceType'>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:       <value>file</value>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:       <value>anonymous</value>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:       <value>memfd</value>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:   </memoryBacking>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:   <devices>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:     <disk supported='yes'>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:       <enum name='diskDevice'>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:         <value>disk</value>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:         <value>cdrom</value>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:         <value>floppy</value>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:         <value>lun</value>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:         <value>fdc</value>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:         <value>sata</value>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:     </disk>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:     <graphics supported='yes'>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:         <value>sdl</value>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:         <value>vnc</value>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:         <value>spice</value>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:         <value>egl-headless</value>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:         <value>dbus</value>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:     <video supported='yes'>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:       <enum name='modelType'>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:         <value>vga</value>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:         <value>cirrus</value>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:         <value>none</value>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:         <value>bochs</value>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:         <value>ramfb</value>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:     </video>
May 21 01:52:51.978951 np0000001127 nova-compute[98206]:     <hostdev supported='yes'>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:       <enum name='mode'>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:         <value>subsystem</value>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:       <enum name='startupPolicy'>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:         <value>default</value>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:         <value>mandatory</value>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:         <value>requisite</value>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:         <value>optional</value>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:       <enum name='subsysType'>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:         <value>pci</value>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:       <enum name='capsType'/>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:       <enum name='pciBackend'/>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:     </hostdev>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:     <rng supported='yes'>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:         <value>random</value>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:         <value>egd</value>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:     </rng>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:     <filesystem supported='yes'>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:       <enum name='driverType'>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:         <value>path</value>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:         <value>handle</value>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:         <value>virtiofs</value>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:     </filesystem>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:     <tpm supported='yes'>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:         <value>tpm-tis</value>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:         <value>passthrough</value>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:         <value>emulator</value>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:         <value>external</value>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:       <enum name='backendVersion'>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:         <value>1.2</value>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:         <value>2.0</value>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:     </tpm>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:     <redirdev supported='yes'>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:     </redirdev>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:     <channel supported='yes'>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:         <value>pty</value>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:         <value>unix</value>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:         <value>spicevmc</value>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:     </channel>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:     <crypto supported='yes'>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:         <value>qemu</value>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:     </crypto>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:   </devices>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:   <features>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:     <gic supported='yes'>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:       <enum name='version'>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:         <value>2</value>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:         <value>3</value>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.981307 np0000001127 nova-compute[98206]:     </gic>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:     <vmcoreinfo supported='yes'/>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:     <genid supported='no'/>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:     <backingStoreInput supported='yes'/>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:     <backup supported='yes'/>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:     <async-teardown supported='yes'/>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:     <sev supported='no'/>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:     <sgx supported='no'/>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:   </features>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]: </domainCapabilities>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 21 01:52:51.983644 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=98206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 21 01:52:51.983644 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Libvirt host hypervisor capabilities for arch=aarch64 and machine_type=virt:
May 21 01:52:51.983644 np0000001127 nova-compute[98206]: <domainCapabilities>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:   <path>/usr/bin/qemu-system-aarch64</path>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:   <domain>qemu</domain>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:   <machine>virt-8.2</machine>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:   <arch>aarch64</arch>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:   <vcpu max='512'/>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:   <iothreads supported='yes'/>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:   <os supported='yes'>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:     <enum name='firmware'>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:       <value>efi</value>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:     <loader supported='yes'>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF_CODE.ms.fd</value>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF_CODE.secboot.fd</value>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF_CODE.no-secboot.fd</value>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:         <value>rom</value>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:         <value>pflash</value>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:       <enum name='readonly'>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:         <value>yes</value>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:       <enum name='secure'>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:     </loader>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:   </os>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:   <cpu>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:     <mode name='host-passthrough' supported='no'/>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:     <mode name='maximum' supported='yes'>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:       <enum name='maximumMigratable'>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:         <value>on</value>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:         <value>off</value>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:     <mode name='host-model' supported='no'/>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:     <mode name='custom' supported='yes'>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>neoverse-n2</model>
May 21 01:52:51.983644 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 21 01:52:51.985611 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 21 01:52:51.985611 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 21 01:52:51.985611 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-a57</model>
May 21 01:52:51.985611 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 21 01:52:51.985611 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 21 01:52:51.985611 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 21 01:52:51.985611 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 21 01:52:51.985611 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 21 01:52:51.985611 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 21 01:52:51.985611 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-a76</model>
May 21 01:52:51.985611 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>a64fx</model>
May 21 01:52:51.985611 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 21 01:52:51.985611 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>neoverse-v1</model>
May 21 01:52:51.985611 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 21 01:52:51.985611 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 21 01:52:51.985611 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 21 01:52:51.985611 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 21 01:52:51.985611 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 21 01:52:51.985611 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 21 01:52:51.985611 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 21 01:52:51.985611 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 21 01:52:51.985611 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 21 01:52:51.985611 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 21 01:52:51.985611 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 21 01:52:51.985611 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 21 01:52:51.985611 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-a710</model>
May 21 01:52:51.985611 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 21 01:52:51.985611 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 21 01:52:51.985611 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 21 01:52:51.985611 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>max</model>
May 21 01:52:51.985611 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-a53</model>
May 21 01:52:51.985611 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-a72</model>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-a55</model>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>neoverse-n1</model>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-a35</model>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:   <memoryBacking supported='yes'>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:     <enum name='sourceType'>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:       <value>file</value>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:       <value>anonymous</value>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:       <value>memfd</value>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:   </memoryBacking>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:   <devices>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:     <disk supported='yes'>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:       <enum name='diskDevice'>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:         <value>disk</value>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:         <value>cdrom</value>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:         <value>floppy</value>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:         <value>lun</value>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:         <value>fdc</value>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:         <value>sata</value>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:     </disk>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:     <graphics supported='yes'>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:         <value>sdl</value>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:         <value>vnc</value>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:         <value>spice</value>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:         <value>egl-headless</value>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:         <value>dbus</value>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:     <video supported='yes'>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:       <enum name='modelType'>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:         <value>vga</value>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:         <value>cirrus</value>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:         <value>none</value>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:         <value>bochs</value>
May 21 01:52:51.986577 np0000001127 nova-compute[98206]:         <value>ramfb</value>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:     </video>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:     <hostdev supported='yes'>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:       <enum name='mode'>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:         <value>subsystem</value>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:       <enum name='startupPolicy'>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:         <value>default</value>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:         <value>mandatory</value>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:         <value>requisite</value>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:         <value>optional</value>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:       <enum name='subsysType'>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:         <value>pci</value>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:       <enum name='capsType'/>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:       <enum name='pciBackend'/>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:     </hostdev>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:     <rng supported='yes'>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:         <value>random</value>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:         <value>egd</value>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:     </rng>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:     <filesystem supported='yes'>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:       <enum name='driverType'>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:         <value>path</value>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:         <value>handle</value>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:         <value>virtiofs</value>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:     </filesystem>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:     <tpm supported='yes'>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:         <value>tpm-tis</value>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:         <value>passthrough</value>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:         <value>emulator</value>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:         <value>external</value>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:       <enum name='backendVersion'>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:         <value>1.2</value>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:         <value>2.0</value>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:     </tpm>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:     <redirdev supported='yes'>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:     </redirdev>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:     <channel supported='yes'>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:         <value>pty</value>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:         <value>unix</value>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:         <value>spicevmc</value>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:     </channel>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:     <crypto supported='yes'>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:         <value>qemu</value>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:     </crypto>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:   </devices>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:   <features>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:     <gic supported='yes'>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:       <enum name='version'>
May 21 01:52:51.988692 np0000001127 nova-compute[98206]:         <value>2</value>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:         <value>3</value>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:     </gic>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:     <vmcoreinfo supported='yes'/>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:     <genid supported='no'/>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:     <backingStoreInput supported='yes'/>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:     <backup supported='yes'/>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:     <async-teardown supported='yes'/>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:     <sev supported='no'/>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:     <sgx supported='no'/>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:   </features>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]: </domainCapabilities>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 21 01:52:51.990486 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=98206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 21 01:52:51.990486 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Libvirt host hypervisor capabilities for arch=cris and machine_type=None:
May 21 01:52:51.990486 np0000001127 nova-compute[98206]: <domainCapabilities>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:   <path>/usr/bin/qemu-system-cris</path>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:   <domain>qemu</domain>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:   <machine>axis-dev88</machine>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:   <arch>cris</arch>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:   <vcpu max='1'/>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:   <iothreads supported='yes'/>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:   <os supported='yes'>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:     <enum name='firmware'/>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:     <loader supported='yes'>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:         <value>rom</value>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:         <value>pflash</value>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:       <enum name='readonly'>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:         <value>yes</value>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:       <enum name='secure'>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:     </loader>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:   </os>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:   <cpu>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:     <mode name='host-passthrough' supported='no'/>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:     <mode name='maximum' supported='no'/>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:     <mode name='host-model' supported='no'/>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:     <mode name='custom' supported='no'/>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:   <memoryBacking supported='yes'>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:     <enum name='sourceType'>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:       <value>file</value>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:       <value>anonymous</value>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:       <value>memfd</value>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:   </memoryBacking>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:   <devices>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:     <disk supported='yes'>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:       <enum name='diskDevice'>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:         <value>disk</value>
May 21 01:52:51.990486 np0000001127 nova-compute[98206]:         <value>cdrom</value>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:         <value>floppy</value>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:         <value>lun</value>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:         <value>fdc</value>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:     </disk>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:     <graphics supported='yes'>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:         <value>sdl</value>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:         <value>vnc</value>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:         <value>spice</value>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:         <value>egl-headless</value>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:         <value>dbus</value>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:     <video supported='yes'>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:       <enum name='modelType'>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:         <value>none</value>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:     </video>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:     <hostdev supported='yes'>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:       <enum name='mode'>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:         <value>subsystem</value>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:       <enum name='startupPolicy'>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:         <value>default</value>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:         <value>mandatory</value>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:         <value>requisite</value>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:         <value>optional</value>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:       <enum name='subsysType'>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:         <value>pci</value>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:       <enum name='capsType'/>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:       <enum name='pciBackend'/>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:     </hostdev>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:     <rng supported='yes'>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:       <enum name='model'/>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:         <value>random</value>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:         <value>egd</value>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:     </rng>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:     <filesystem supported='yes'>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:       <enum name='driverType'>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:         <value>path</value>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:         <value>handle</value>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:     </filesystem>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:     <tpm supported='no'/>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:     <redirdev supported='no'/>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:     <channel supported='yes'>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:         <value>pty</value>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:         <value>unix</value>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:         <value>spicevmc</value>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:     </channel>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:     <crypto supported='yes'>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:       <enum name='model'/>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:         <value>qemu</value>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:     </crypto>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:   </devices>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:   <features>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:     <gic supported='no'/>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:     <vmcoreinfo supported='no'/>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:     <genid supported='no'/>
May 21 01:52:51.991533 np0000001127 nova-compute[98206]:     <backingStoreInput supported='yes'/>
May 21 01:52:51.992798 np0000001127 nova-compute[98206]:     <backup supported='yes'/>
May 21 01:52:51.992798 np0000001127 nova-compute[98206]:     <async-teardown supported='yes'/>
May 21 01:52:51.992798 np0000001127 nova-compute[98206]:     <sev supported='no'/>
May 21 01:52:51.992798 np0000001127 nova-compute[98206]:     <sgx supported='no'/>
May 21 01:52:51.992798 np0000001127 nova-compute[98206]:   </features>
May 21 01:52:51.992798 np0000001127 nova-compute[98206]: </domainCapabilities>
May 21 01:52:51.992798 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 21 01:52:51.992798 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu-q35', 'q35', 'ubuntu'} {{(pid=98206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 21 01:52:52.059358 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
May 21 01:52:52.059358 np0000001127 nova-compute[98206]: <domainCapabilities>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:   <path>/usr/bin/qemu-system-i386</path>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:   <domain>qemu</domain>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:   <machine>pc-i440fx-noble</machine>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:   <arch>i686</arch>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:   <vcpu max='255'/>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:   <iothreads supported='yes'/>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:   <os supported='yes'>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:     <enum name='firmware'/>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:     <loader supported='yes'>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:         <value>rom</value>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:         <value>pflash</value>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:       <enum name='readonly'>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:         <value>yes</value>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:       <enum name='secure'>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:     </loader>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:   </os>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:   <cpu>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:     <mode name='host-passthrough' supported='no'/>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:     <mode name='maximum' supported='yes'>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:       <enum name='maximumMigratable'>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:         <value>on</value>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:         <value>off</value>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:     <mode name='host-model' supported='yes'>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:       <model fallback='forbid'>EPYC</model>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:       <vendor>AMD</vendor>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:       <feature policy='require' name='acpi'/>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:       <feature policy='require' name='ss'/>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:       <feature policy='require' name='monitor'/>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:       <feature policy='require' name='hypervisor'/>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:       <feature policy='require' name='erms'/>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:       <feature policy='require' name='mpx'/>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:       <feature policy='require' name='pcommit'/>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:       <feature policy='require' name='clwb'/>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:       <feature policy='require' name='umip'/>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:       <feature policy='require' name='pku'/>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:       <feature policy='require' name='vaes'/>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:       <feature policy='require' name='la57'/>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:       <feature policy='require' name='rdpid'/>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:       <feature policy='require' name='pks'/>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:       <feature policy='require' name='fsrm'/>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:       <feature policy='require' name='fzrm'/>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:       <feature policy='require' name='fsrs'/>
May 21 01:52:52.059358 np0000001127 nova-compute[98206]:       <feature policy='require' name='fsrc'/>
May 21 01:52:52.061063 np0000001127 nova-compute[98206]:       <feature policy='require' name='3dnowext'/>
May 21 01:52:52.061063 np0000001127 nova-compute[98206]:       <feature policy='require' name='3dnow'/>
May 21 01:52:52.061063 np0000001127 nova-compute[98206]:       <feature policy='require' name='xsaveerptr'/>
May 21 01:52:52.061063 np0000001127 nova-compute[98206]:       <feature policy='require' name='wbnoinvd'/>
May 21 01:52:52.061063 np0000001127 nova-compute[98206]:       <feature policy='require' name='npt'/>
May 21 01:52:52.061063 np0000001127 nova-compute[98206]:       <feature policy='require' name='vgif'/>
May 21 01:52:52.061063 np0000001127 nova-compute[98206]:       <feature policy='require' name='svme-addr-chk'/>
May 21 01:52:52.061063 np0000001127 nova-compute[98206]:       <feature policy='disable' name='vme'/>
May 21 01:52:52.061063 np0000001127 nova-compute[98206]:       <feature policy='disable' name='xsavec'/>
May 21 01:52:52.061063 np0000001127 nova-compute[98206]:       <feature policy='disable' name='fxsr_opt'/>
May 21 01:52:52.061063 np0000001127 nova-compute[98206]:       <feature policy='disable' name='lm'/>
May 21 01:52:52.061063 np0000001127 nova-compute[98206]:       <feature policy='disable' name='misalignsse'/>
May 21 01:52:52.061063 np0000001127 nova-compute[98206]:       <feature policy='disable' name='osvw'/>
May 21 01:52:52.061063 np0000001127 nova-compute[98206]:       <feature policy='disable' name='topoext'/>
May 21 01:52:52.061063 np0000001127 nova-compute[98206]:       <feature policy='disable' name='nrip-save'/>
May 21 01:52:52.061063 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:52.061063 np0000001127 nova-compute[98206]:     <mode name='custom' supported='yes'>
May 21 01:52:52.061063 np0000001127 nova-compute[98206]:       <model usable='no' vendor='unknown'>qemu64</model>
May 21 01:52:52.061063 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 21 01:52:52.061063 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>phenom</model>
May 21 01:52:52.061063 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 21 01:52:52.061063 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 21 01:52:52.061063 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>pentium</model>
May 21 01:52:52.061063 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='Intel'>n270</model>
May 21 01:52:52.061063 np0000001127 nova-compute[98206]:       <model usable='no' vendor='unknown'>kvm64</model>
May 21 01:52:52.061063 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 21 01:52:52.061063 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 21 01:52:52.061063 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>core2duo</model>
May 21 01:52:52.061063 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='AMD'>athlon</model>
May 21 01:52:52.061063 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 21 01:52:52.061063 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Westmere</model>
May 21 01:52:52.061063 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 21 01:52:52.061063 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 21 01:52:52.061063 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 21 01:52:52.061063 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 21 01:52:52.061063 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 21 01:52:52.061063 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 21 01:52:52.061063 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 21 01:52:52.062252 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 21 01:52:52.062252 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 21 01:52:52.062252 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 21 01:52:52.062252 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Penryn</model>
May 21 01:52:52.062252 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 21 01:52:52.062252 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 21 01:52:52.062252 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 21 01:52:52.062252 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 21 01:52:52.062252 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 21 01:52:52.062252 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 21 01:52:52.062252 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 21 01:52:52.062252 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 21 01:52:52.062252 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 21 01:52:52.062252 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 21 01:52:52.062252 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 21 01:52:52.062252 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 21 01:52:52.062252 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 21 01:52:52.062252 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 21 01:52:52.062252 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Haswell</model>
May 21 01:52:52.062252 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 21 01:52:52.062252 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 21 01:52:52.062252 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 21 01:52:52.062252 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 21 01:52:52.062252 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>EPYC</model>
May 21 01:52:52.062252 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 21 01:52:52.062252 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 21 01:52:52.062252 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Conroe</model>
May 21 01:52:52.062252 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 21 01:52:52.062252 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 21 01:52:52.062252 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 21 01:52:52.062252 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 21 01:52:52.062252 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 21 01:52:52.062252 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 21 01:52:52.062252 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>486</model>
May 21 01:52:52.062252 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:   <memoryBacking supported='yes'>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:     <enum name='sourceType'>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:       <value>file</value>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:       <value>anonymous</value>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:       <value>memfd</value>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:   </memoryBacking>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:   <devices>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:     <disk supported='yes'>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:       <enum name='diskDevice'>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:         <value>disk</value>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:         <value>cdrom</value>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:         <value>floppy</value>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:         <value>lun</value>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:         <value>ide</value>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:         <value>fdc</value>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:         <value>sata</value>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:     </disk>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:     <graphics supported='yes'>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:         <value>sdl</value>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:         <value>vnc</value>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:         <value>spice</value>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:         <value>egl-headless</value>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:         <value>dbus</value>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:     <video supported='yes'>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:       <enum name='modelType'>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:         <value>vga</value>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:         <value>cirrus</value>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:         <value>vmvga</value>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:         <value>qxl</value>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:         <value>none</value>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:         <value>bochs</value>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:         <value>ramfb</value>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:     </video>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:     <hostdev supported='yes'>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:       <enum name='mode'>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:         <value>subsystem</value>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:       <enum name='startupPolicy'>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:         <value>default</value>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:         <value>mandatory</value>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:         <value>requisite</value>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:         <value>optional</value>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:       <enum name='subsysType'>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:         <value>pci</value>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:       <enum name='capsType'/>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:       <enum name='pciBackend'/>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:     </hostdev>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:     <rng supported='yes'>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.063485 np0000001127 nova-compute[98206]:         <value>random</value>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:         <value>egd</value>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:     </rng>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:     <filesystem supported='yes'>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:       <enum name='driverType'>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:         <value>path</value>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:         <value>handle</value>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:         <value>virtiofs</value>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:     </filesystem>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:     <tpm supported='yes'>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:         <value>tpm-tis</value>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:         <value>tpm-crb</value>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:         <value>passthrough</value>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:         <value>emulator</value>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:         <value>external</value>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:       <enum name='backendVersion'>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:         <value>1.2</value>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:         <value>2.0</value>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:     </tpm>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:     <redirdev supported='yes'>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:     </redirdev>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:     <channel supported='yes'>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:         <value>pty</value>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:         <value>unix</value>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:         <value>spicevmc</value>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:     </channel>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:     <crypto supported='yes'>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:         <value>qemu</value>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:     </crypto>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:   </devices>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:   <features>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:     <gic supported='no'/>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:     <vmcoreinfo supported='yes'/>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:     <genid supported='yes'/>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:     <backingStoreInput supported='yes'/>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:     <backup supported='yes'/>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:     <async-teardown supported='yes'/>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:     <sev supported='no'/>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:     <sgx supported='no'/>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:     <hyperv supported='yes'>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:       <enum name='features'>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:         <value>relaxed</value>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:         <value>vapic</value>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:         <value>spinlocks</value>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:         <value>vpindex</value>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:         <value>runtime</value>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:         <value>synic</value>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:         <value>stimer</value>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:         <value>reset</value>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:         <value>vendor_id</value>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:         <value>frequencies</value>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:         <value>reenlightenment</value>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:         <value>tlbflush</value>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:         <value>ipi</value>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:         <value>avic</value>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:     </hyperv>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]:   </features>
May 21 01:52:52.065608 np0000001127 nova-compute[98206]: </domainCapabilities>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 21 01:52:52.067927 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
May 21 01:52:52.067927 np0000001127 nova-compute[98206]: <domainCapabilities>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:   <path>/usr/bin/qemu-system-i386</path>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:   <domain>qemu</domain>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:   <machine>pc-q35-noble-v2</machine>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:   <arch>i686</arch>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:   <vcpu max='1024'/>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:   <iothreads supported='yes'/>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:   <os supported='yes'>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:     <enum name='firmware'/>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:     <loader supported='yes'>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:         <value>rom</value>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:         <value>pflash</value>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:       <enum name='readonly'>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:         <value>yes</value>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:       <enum name='secure'>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:     </loader>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:   </os>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:   <cpu>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:     <mode name='host-passthrough' supported='no'/>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:     <mode name='maximum' supported='yes'>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:       <enum name='maximumMigratable'>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:         <value>on</value>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:         <value>off</value>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:     <mode name='host-model' supported='yes'>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:       <model fallback='forbid'>EPYC</model>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:       <vendor>AMD</vendor>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:       <feature policy='require' name='acpi'/>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:       <feature policy='require' name='ss'/>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:       <feature policy='require' name='monitor'/>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:       <feature policy='require' name='hypervisor'/>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:       <feature policy='require' name='erms'/>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:       <feature policy='require' name='mpx'/>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:       <feature policy='require' name='pcommit'/>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:       <feature policy='require' name='clwb'/>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:       <feature policy='require' name='umip'/>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:       <feature policy='require' name='pku'/>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:       <feature policy='require' name='vaes'/>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:       <feature policy='require' name='la57'/>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:       <feature policy='require' name='rdpid'/>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:       <feature policy='require' name='pks'/>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:       <feature policy='require' name='fsrm'/>
May 21 01:52:52.067927 np0000001127 nova-compute[98206]:       <feature policy='require' name='fzrm'/>
May 21 01:52:52.069655 np0000001127 nova-compute[98206]:       <feature policy='require' name='fsrs'/>
May 21 01:52:52.069655 np0000001127 nova-compute[98206]:       <feature policy='require' name='fsrc'/>
May 21 01:52:52.069655 np0000001127 nova-compute[98206]:       <feature policy='require' name='3dnowext'/>
May 21 01:52:52.069655 np0000001127 nova-compute[98206]:       <feature policy='require' name='3dnow'/>
May 21 01:52:52.069655 np0000001127 nova-compute[98206]:       <feature policy='require' name='xsaveerptr'/>
May 21 01:52:52.069655 np0000001127 nova-compute[98206]:       <feature policy='require' name='wbnoinvd'/>
May 21 01:52:52.069655 np0000001127 nova-compute[98206]:       <feature policy='require' name='npt'/>
May 21 01:52:52.069655 np0000001127 nova-compute[98206]:       <feature policy='require' name='vgif'/>
May 21 01:52:52.069655 np0000001127 nova-compute[98206]:       <feature policy='require' name='svme-addr-chk'/>
May 21 01:52:52.069655 np0000001127 nova-compute[98206]:       <feature policy='disable' name='vme'/>
May 21 01:52:52.069655 np0000001127 nova-compute[98206]:       <feature policy='disable' name='xsavec'/>
May 21 01:52:52.069655 np0000001127 nova-compute[98206]:       <feature policy='disable' name='fxsr_opt'/>
May 21 01:52:52.069655 np0000001127 nova-compute[98206]:       <feature policy='disable' name='lm'/>
May 21 01:52:52.069655 np0000001127 nova-compute[98206]:       <feature policy='disable' name='misalignsse'/>
May 21 01:52:52.069655 np0000001127 nova-compute[98206]:       <feature policy='disable' name='osvw'/>
May 21 01:52:52.069655 np0000001127 nova-compute[98206]:       <feature policy='disable' name='topoext'/>
May 21 01:52:52.069655 np0000001127 nova-compute[98206]:       <feature policy='disable' name='nrip-save'/>
May 21 01:52:52.069655 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:52.069655 np0000001127 nova-compute[98206]:     <mode name='custom' supported='yes'>
May 21 01:52:52.069655 np0000001127 nova-compute[98206]:       <model usable='no' vendor='unknown'>qemu64</model>
May 21 01:52:52.069655 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 21 01:52:52.069655 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>phenom</model>
May 21 01:52:52.069655 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 21 01:52:52.069655 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 21 01:52:52.069655 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>pentium</model>
May 21 01:52:52.069655 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='Intel'>n270</model>
May 21 01:52:52.069655 np0000001127 nova-compute[98206]:       <model usable='no' vendor='unknown'>kvm64</model>
May 21 01:52:52.069655 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 21 01:52:52.069655 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 21 01:52:52.069655 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>core2duo</model>
May 21 01:52:52.069655 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='AMD'>athlon</model>
May 21 01:52:52.069655 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 21 01:52:52.069655 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Westmere</model>
May 21 01:52:52.069655 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 21 01:52:52.069655 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 21 01:52:52.069655 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 21 01:52:52.069655 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 21 01:52:52.069655 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 21 01:52:52.070620 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 21 01:52:52.070620 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 21 01:52:52.070620 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 21 01:52:52.070620 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 21 01:52:52.070620 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 21 01:52:52.070620 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Penryn</model>
May 21 01:52:52.070620 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 21 01:52:52.070620 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 21 01:52:52.070620 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 21 01:52:52.070620 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 21 01:52:52.070620 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 21 01:52:52.070620 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 21 01:52:52.070620 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 21 01:52:52.070620 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 21 01:52:52.070620 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 21 01:52:52.070620 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 21 01:52:52.070620 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 21 01:52:52.070620 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 21 01:52:52.070620 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 21 01:52:52.070620 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 21 01:52:52.070620 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Haswell</model>
May 21 01:52:52.070620 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 21 01:52:52.070620 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 21 01:52:52.070620 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 21 01:52:52.070620 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 21 01:52:52.070620 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>EPYC</model>
May 21 01:52:52.070620 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 21 01:52:52.070620 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 21 01:52:52.070620 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Conroe</model>
May 21 01:52:52.070620 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 21 01:52:52.070620 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 21 01:52:52.070620 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 21 01:52:52.070620 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>486</model>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:   <memoryBacking supported='yes'>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:     <enum name='sourceType'>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:       <value>file</value>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:       <value>anonymous</value>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:       <value>memfd</value>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:   </memoryBacking>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:   <devices>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:     <disk supported='yes'>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:       <enum name='diskDevice'>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:         <value>disk</value>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:         <value>cdrom</value>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:         <value>floppy</value>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:         <value>lun</value>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:         <value>fdc</value>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:         <value>sata</value>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:     </disk>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:     <graphics supported='yes'>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:         <value>sdl</value>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:         <value>vnc</value>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:         <value>spice</value>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:         <value>egl-headless</value>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:         <value>dbus</value>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:     <video supported='yes'>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:       <enum name='modelType'>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:         <value>vga</value>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:         <value>cirrus</value>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:         <value>vmvga</value>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:         <value>qxl</value>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:         <value>none</value>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:         <value>bochs</value>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:         <value>ramfb</value>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:     </video>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:     <hostdev supported='yes'>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:       <enum name='mode'>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:         <value>subsystem</value>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:       <enum name='startupPolicy'>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:         <value>default</value>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:         <value>mandatory</value>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:         <value>requisite</value>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:         <value>optional</value>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:       <enum name='subsysType'>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:         <value>pci</value>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:       <enum name='capsType'/>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:       <enum name='pciBackend'/>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:     </hostdev>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:     <rng supported='yes'>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.071384 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:         <value>random</value>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:         <value>egd</value>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:     </rng>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:     <filesystem supported='yes'>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:       <enum name='driverType'>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:         <value>path</value>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:         <value>handle</value>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:         <value>virtiofs</value>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:     </filesystem>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:     <tpm supported='yes'>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:         <value>tpm-tis</value>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:         <value>tpm-crb</value>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:         <value>passthrough</value>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:         <value>emulator</value>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:         <value>external</value>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:       <enum name='backendVersion'>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:         <value>1.2</value>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:         <value>2.0</value>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:     </tpm>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:     <redirdev supported='yes'>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:     </redirdev>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:     <channel supported='yes'>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:         <value>pty</value>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:         <value>unix</value>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:         <value>spicevmc</value>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:     </channel>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:     <crypto supported='yes'>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:         <value>qemu</value>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:     </crypto>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:   </devices>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:   <features>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:     <gic supported='no'/>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:     <vmcoreinfo supported='yes'/>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:     <genid supported='yes'/>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:     <backingStoreInput supported='yes'/>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:     <backup supported='yes'/>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:     <async-teardown supported='yes'/>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:     <sev supported='no'/>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:     <sgx supported='no'/>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:     <hyperv supported='yes'>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:       <enum name='features'>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:         <value>relaxed</value>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:         <value>vapic</value>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:         <value>spinlocks</value>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:         <value>vpindex</value>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:         <value>runtime</value>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:         <value>synic</value>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:         <value>stimer</value>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:         <value>reset</value>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:         <value>vendor_id</value>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:         <value>frequencies</value>
May 21 01:52:52.073518 np0000001127 nova-compute[98206]:         <value>reenlightenment</value>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:         <value>tlbflush</value>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:         <value>ipi</value>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:         <value>avic</value>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:     </hyperv>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:   </features>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]: </domainCapabilities>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 21 01:52:52.075745 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
May 21 01:52:52.075745 np0000001127 nova-compute[98206]: <domainCapabilities>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:   <path>/usr/bin/qemu-system-i386</path>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:   <domain>qemu</domain>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:   <machine>pc-q35-noble</machine>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:   <arch>i686</arch>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:   <vcpu max='1024'/>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:   <iothreads supported='yes'/>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:   <os supported='yes'>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:     <enum name='firmware'/>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:     <loader supported='yes'>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:         <value>rom</value>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:         <value>pflash</value>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:       <enum name='readonly'>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:         <value>yes</value>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:       <enum name='secure'>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:     </loader>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:   </os>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:   <cpu>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:     <mode name='host-passthrough' supported='no'/>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:     <mode name='maximum' supported='yes'>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:       <enum name='maximumMigratable'>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:         <value>on</value>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:         <value>off</value>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:     <mode name='host-model' supported='yes'>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:       <model fallback='forbid'>EPYC</model>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:       <vendor>AMD</vendor>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:       <feature policy='require' name='acpi'/>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:       <feature policy='require' name='ss'/>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:       <feature policy='require' name='monitor'/>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:       <feature policy='require' name='hypervisor'/>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:       <feature policy='require' name='erms'/>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:       <feature policy='require' name='mpx'/>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:       <feature policy='require' name='pcommit'/>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:       <feature policy='require' name='clwb'/>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:       <feature policy='require' name='umip'/>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:       <feature policy='require' name='pku'/>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:       <feature policy='require' name='vaes'/>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:       <feature policy='require' name='la57'/>
May 21 01:52:52.075745 np0000001127 nova-compute[98206]:       <feature policy='require' name='rdpid'/>
May 21 01:52:52.077507 np0000001127 nova-compute[98206]:       <feature policy='require' name='pks'/>
May 21 01:52:52.077507 np0000001127 nova-compute[98206]:       <feature policy='require' name='fsrm'/>
May 21 01:52:52.077507 np0000001127 nova-compute[98206]:       <feature policy='require' name='fzrm'/>
May 21 01:52:52.077507 np0000001127 nova-compute[98206]:       <feature policy='require' name='fsrs'/>
May 21 01:52:52.077507 np0000001127 nova-compute[98206]:       <feature policy='require' name='fsrc'/>
May 21 01:52:52.077507 np0000001127 nova-compute[98206]:       <feature policy='require' name='3dnowext'/>
May 21 01:52:52.077507 np0000001127 nova-compute[98206]:       <feature policy='require' name='3dnow'/>
May 21 01:52:52.077507 np0000001127 nova-compute[98206]:       <feature policy='require' name='xsaveerptr'/>
May 21 01:52:52.077507 np0000001127 nova-compute[98206]:       <feature policy='require' name='wbnoinvd'/>
May 21 01:52:52.077507 np0000001127 nova-compute[98206]:       <feature policy='require' name='npt'/>
May 21 01:52:52.077507 np0000001127 nova-compute[98206]:       <feature policy='require' name='vgif'/>
May 21 01:52:52.077507 np0000001127 nova-compute[98206]:       <feature policy='require' name='svme-addr-chk'/>
May 21 01:52:52.077507 np0000001127 nova-compute[98206]:       <feature policy='disable' name='vme'/>
May 21 01:52:52.077507 np0000001127 nova-compute[98206]:       <feature policy='disable' name='xsavec'/>
May 21 01:52:52.077507 np0000001127 nova-compute[98206]:       <feature policy='disable' name='fxsr_opt'/>
May 21 01:52:52.077507 np0000001127 nova-compute[98206]:       <feature policy='disable' name='lm'/>
May 21 01:52:52.077507 np0000001127 nova-compute[98206]:       <feature policy='disable' name='misalignsse'/>
May 21 01:52:52.077507 np0000001127 nova-compute[98206]:       <feature policy='disable' name='osvw'/>
May 21 01:52:52.077507 np0000001127 nova-compute[98206]:       <feature policy='disable' name='topoext'/>
May 21 01:52:52.077507 np0000001127 nova-compute[98206]:       <feature policy='disable' name='nrip-save'/>
May 21 01:52:52.077507 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:52.077507 np0000001127 nova-compute[98206]:     <mode name='custom' supported='yes'>
May 21 01:52:52.077507 np0000001127 nova-compute[98206]:       <model usable='no' vendor='unknown'>qemu64</model>
May 21 01:52:52.077507 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 21 01:52:52.077507 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>phenom</model>
May 21 01:52:52.077507 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 21 01:52:52.077507 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 21 01:52:52.077507 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>pentium</model>
May 21 01:52:52.077507 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='Intel'>n270</model>
May 21 01:52:52.077507 np0000001127 nova-compute[98206]:       <model usable='no' vendor='unknown'>kvm64</model>
May 21 01:52:52.077507 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 21 01:52:52.077507 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 21 01:52:52.077507 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>core2duo</model>
May 21 01:52:52.077507 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='AMD'>athlon</model>
May 21 01:52:52.077507 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 21 01:52:52.077507 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Westmere</model>
May 21 01:52:52.077507 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 21 01:52:52.077507 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 21 01:52:52.077507 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 21 01:52:52.078494 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 21 01:52:52.078494 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 21 01:52:52.078494 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 21 01:52:52.078494 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 21 01:52:52.078494 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 21 01:52:52.078494 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 21 01:52:52.078494 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 21 01:52:52.078494 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Penryn</model>
May 21 01:52:52.078494 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 21 01:52:52.078494 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 21 01:52:52.078494 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 21 01:52:52.078494 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 21 01:52:52.078494 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 21 01:52:52.078494 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 21 01:52:52.078494 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 21 01:52:52.078494 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 21 01:52:52.078494 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 21 01:52:52.078494 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 21 01:52:52.078494 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 21 01:52:52.078494 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 21 01:52:52.078494 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 21 01:52:52.078494 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 21 01:52:52.078494 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Haswell</model>
May 21 01:52:52.078494 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 21 01:52:52.078494 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 21 01:52:52.078494 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 21 01:52:52.078494 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 21 01:52:52.078494 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>EPYC</model>
May 21 01:52:52.078494 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 21 01:52:52.078494 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 21 01:52:52.078494 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Conroe</model>
May 21 01:52:52.078494 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 21 01:52:52.078494 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>486</model>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:   <memoryBacking supported='yes'>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:     <enum name='sourceType'>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:       <value>file</value>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:       <value>anonymous</value>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:       <value>memfd</value>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:   </memoryBacking>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:   <devices>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:     <disk supported='yes'>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:       <enum name='diskDevice'>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:         <value>disk</value>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:         <value>cdrom</value>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:         <value>floppy</value>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:         <value>lun</value>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:         <value>fdc</value>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:         <value>sata</value>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:     </disk>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:     <graphics supported='yes'>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:         <value>sdl</value>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:         <value>vnc</value>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:         <value>spice</value>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:         <value>egl-headless</value>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:         <value>dbus</value>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:     <video supported='yes'>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:       <enum name='modelType'>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:         <value>vga</value>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:         <value>cirrus</value>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:         <value>vmvga</value>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:         <value>qxl</value>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:         <value>none</value>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:         <value>bochs</value>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:         <value>ramfb</value>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:     </video>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:     <hostdev supported='yes'>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:       <enum name='mode'>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:         <value>subsystem</value>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:       <enum name='startupPolicy'>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:         <value>default</value>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:         <value>mandatory</value>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:         <value>requisite</value>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:         <value>optional</value>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:       <enum name='subsysType'>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:         <value>pci</value>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.079542 np0000001127 nova-compute[98206]:       <enum name='capsType'/>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:       <enum name='pciBackend'/>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:     </hostdev>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:     <rng supported='yes'>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:         <value>random</value>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:         <value>egd</value>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:     </rng>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:     <filesystem supported='yes'>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:       <enum name='driverType'>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:         <value>path</value>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:         <value>handle</value>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:         <value>virtiofs</value>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:     </filesystem>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:     <tpm supported='yes'>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:         <value>tpm-tis</value>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:         <value>tpm-crb</value>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:         <value>passthrough</value>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:         <value>emulator</value>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:         <value>external</value>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:       <enum name='backendVersion'>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:         <value>1.2</value>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:         <value>2.0</value>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:     </tpm>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:     <redirdev supported='yes'>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:     </redirdev>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:     <channel supported='yes'>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:         <value>pty</value>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:         <value>unix</value>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:         <value>spicevmc</value>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:     </channel>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:     <crypto supported='yes'>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:         <value>qemu</value>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:     </crypto>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:   </devices>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:   <features>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:     <gic supported='no'/>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:     <vmcoreinfo supported='yes'/>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:     <genid supported='yes'/>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:     <backingStoreInput supported='yes'/>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:     <backup supported='yes'/>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:     <async-teardown supported='yes'/>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:     <sev supported='no'/>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:     <sgx supported='no'/>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:     <hyperv supported='yes'>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:       <enum name='features'>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:         <value>relaxed</value>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:         <value>vapic</value>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:         <value>spinlocks</value>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:         <value>vpindex</value>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:         <value>runtime</value>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:         <value>synic</value>
May 21 01:52:52.081407 np0000001127 nova-compute[98206]:         <value>stimer</value>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:         <value>reset</value>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:         <value>vendor_id</value>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:         <value>frequencies</value>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:         <value>reenlightenment</value>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:         <value>tlbflush</value>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:         <value>ipi</value>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:         <value>avic</value>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:     </hyperv>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:   </features>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]: </domainCapabilities>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 21 01:52:52.083555 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
May 21 01:52:52.083555 np0000001127 nova-compute[98206]: <domainCapabilities>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:   <path>/usr/bin/qemu-system-i386</path>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:   <domain>qemu</domain>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:   <machine>pc-i440fx-noble-v2</machine>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:   <arch>i686</arch>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:   <vcpu max='255'/>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:   <iothreads supported='yes'/>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:   <os supported='yes'>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:     <enum name='firmware'/>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:     <loader supported='yes'>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:         <value>rom</value>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:         <value>pflash</value>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:       <enum name='readonly'>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:         <value>yes</value>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:       <enum name='secure'>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:     </loader>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:   </os>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:   <cpu>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:     <mode name='host-passthrough' supported='no'/>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:     <mode name='maximum' supported='yes'>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:       <enum name='maximumMigratable'>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:         <value>on</value>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:         <value>off</value>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:     <mode name='host-model' supported='yes'>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:       <model fallback='forbid'>EPYC</model>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:       <vendor>AMD</vendor>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:       <feature policy='require' name='acpi'/>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:       <feature policy='require' name='ss'/>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:       <feature policy='require' name='monitor'/>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:       <feature policy='require' name='hypervisor'/>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:       <feature policy='require' name='erms'/>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:       <feature policy='require' name='mpx'/>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:       <feature policy='require' name='pcommit'/>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:       <feature policy='require' name='clwb'/>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:       <feature policy='require' name='umip'/>
May 21 01:52:52.083555 np0000001127 nova-compute[98206]:       <feature policy='require' name='pku'/>
May 21 01:52:52.085243 np0000001127 nova-compute[98206]:       <feature policy='require' name='vaes'/>
May 21 01:52:52.085243 np0000001127 nova-compute[98206]:       <feature policy='require' name='la57'/>
May 21 01:52:52.085243 np0000001127 nova-compute[98206]:       <feature policy='require' name='rdpid'/>
May 21 01:52:52.085243 np0000001127 nova-compute[98206]:       <feature policy='require' name='pks'/>
May 21 01:52:52.085243 np0000001127 nova-compute[98206]:       <feature policy='require' name='fsrm'/>
May 21 01:52:52.085243 np0000001127 nova-compute[98206]:       <feature policy='require' name='fzrm'/>
May 21 01:52:52.085243 np0000001127 nova-compute[98206]:       <feature policy='require' name='fsrs'/>
May 21 01:52:52.085243 np0000001127 nova-compute[98206]:       <feature policy='require' name='fsrc'/>
May 21 01:52:52.085243 np0000001127 nova-compute[98206]:       <feature policy='require' name='3dnowext'/>
May 21 01:52:52.085243 np0000001127 nova-compute[98206]:       <feature policy='require' name='3dnow'/>
May 21 01:52:52.085243 np0000001127 nova-compute[98206]:       <feature policy='require' name='xsaveerptr'/>
May 21 01:52:52.085243 np0000001127 nova-compute[98206]:       <feature policy='require' name='wbnoinvd'/>
May 21 01:52:52.085243 np0000001127 nova-compute[98206]:       <feature policy='require' name='npt'/>
May 21 01:52:52.085243 np0000001127 nova-compute[98206]:       <feature policy='require' name='vgif'/>
May 21 01:52:52.085243 np0000001127 nova-compute[98206]:       <feature policy='require' name='svme-addr-chk'/>
May 21 01:52:52.085243 np0000001127 nova-compute[98206]:       <feature policy='disable' name='vme'/>
May 21 01:52:52.085243 np0000001127 nova-compute[98206]:       <feature policy='disable' name='xsavec'/>
May 21 01:52:52.085243 np0000001127 nova-compute[98206]:       <feature policy='disable' name='fxsr_opt'/>
May 21 01:52:52.085243 np0000001127 nova-compute[98206]:       <feature policy='disable' name='lm'/>
May 21 01:52:52.085243 np0000001127 nova-compute[98206]:       <feature policy='disable' name='misalignsse'/>
May 21 01:52:52.085243 np0000001127 nova-compute[98206]:       <feature policy='disable' name='osvw'/>
May 21 01:52:52.085243 np0000001127 nova-compute[98206]:       <feature policy='disable' name='topoext'/>
May 21 01:52:52.085243 np0000001127 nova-compute[98206]:       <feature policy='disable' name='nrip-save'/>
May 21 01:52:52.085243 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:52.085243 np0000001127 nova-compute[98206]:     <mode name='custom' supported='yes'>
May 21 01:52:52.085243 np0000001127 nova-compute[98206]:       <model usable='no' vendor='unknown'>qemu64</model>
May 21 01:52:52.085243 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 21 01:52:52.085243 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>phenom</model>
May 21 01:52:52.085243 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 21 01:52:52.085243 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 21 01:52:52.085243 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>pentium</model>
May 21 01:52:52.085243 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='Intel'>n270</model>
May 21 01:52:52.085243 np0000001127 nova-compute[98206]:       <model usable='no' vendor='unknown'>kvm64</model>
May 21 01:52:52.085243 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 21 01:52:52.085243 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 21 01:52:52.085243 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>core2duo</model>
May 21 01:52:52.085243 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='AMD'>athlon</model>
May 21 01:52:52.085243 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 21 01:52:52.085243 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Westmere</model>
May 21 01:52:52.085243 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 21 01:52:52.086356 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 21 01:52:52.086356 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 21 01:52:52.086356 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 21 01:52:52.086356 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 21 01:52:52.086356 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 21 01:52:52.086356 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 21 01:52:52.086356 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 21 01:52:52.086356 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 21 01:52:52.086356 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 21 01:52:52.086356 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Penryn</model>
May 21 01:52:52.086356 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 21 01:52:52.086356 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 21 01:52:52.086356 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 21 01:52:52.086356 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 21 01:52:52.086356 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 21 01:52:52.086356 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 21 01:52:52.086356 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 21 01:52:52.086356 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 21 01:52:52.086356 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 21 01:52:52.086356 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 21 01:52:52.086356 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 21 01:52:52.086356 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 21 01:52:52.086356 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 21 01:52:52.086356 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 21 01:52:52.086356 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Haswell</model>
May 21 01:52:52.086356 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 21 01:52:52.086356 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 21 01:52:52.086356 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 21 01:52:52.086356 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 21 01:52:52.086356 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>EPYC</model>
May 21 01:52:52.086356 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 21 01:52:52.086356 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 21 01:52:52.086356 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Conroe</model>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>486</model>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:   <memoryBacking supported='yes'>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:     <enum name='sourceType'>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:       <value>file</value>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:       <value>anonymous</value>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:       <value>memfd</value>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:   </memoryBacking>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:   <devices>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:     <disk supported='yes'>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:       <enum name='diskDevice'>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:         <value>disk</value>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:         <value>cdrom</value>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:         <value>floppy</value>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:         <value>lun</value>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:         <value>ide</value>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:         <value>fdc</value>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:         <value>sata</value>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:     </disk>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:     <graphics supported='yes'>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:         <value>sdl</value>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:         <value>vnc</value>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:         <value>spice</value>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:         <value>egl-headless</value>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:         <value>dbus</value>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:     <video supported='yes'>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:       <enum name='modelType'>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:         <value>vga</value>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:         <value>cirrus</value>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:         <value>vmvga</value>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:         <value>qxl</value>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:         <value>none</value>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:         <value>bochs</value>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:         <value>ramfb</value>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:     </video>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:     <hostdev supported='yes'>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:       <enum name='mode'>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:         <value>subsystem</value>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:       <enum name='startupPolicy'>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:         <value>default</value>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:         <value>mandatory</value>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:         <value>requisite</value>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:         <value>optional</value>
May 21 01:52:52.087314 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:       <enum name='subsysType'>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:         <value>pci</value>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:       <enum name='capsType'/>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:       <enum name='pciBackend'/>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:     </hostdev>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:     <rng supported='yes'>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:         <value>random</value>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:         <value>egd</value>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:     </rng>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:     <filesystem supported='yes'>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:       <enum name='driverType'>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:         <value>path</value>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:         <value>handle</value>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:         <value>virtiofs</value>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:     </filesystem>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:     <tpm supported='yes'>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:         <value>tpm-tis</value>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:         <value>tpm-crb</value>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:         <value>passthrough</value>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:         <value>emulator</value>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:         <value>external</value>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:       <enum name='backendVersion'>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:         <value>1.2</value>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:         <value>2.0</value>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:     </tpm>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:     <redirdev supported='yes'>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:     </redirdev>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:     <channel supported='yes'>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:         <value>pty</value>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:         <value>unix</value>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:         <value>spicevmc</value>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:     </channel>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:     <crypto supported='yes'>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:         <value>qemu</value>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:     </crypto>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:   </devices>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:   <features>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:     <gic supported='no'/>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:     <vmcoreinfo supported='yes'/>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:     <genid supported='yes'/>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:     <backingStoreInput supported='yes'/>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:     <backup supported='yes'/>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:     <async-teardown supported='yes'/>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:     <sev supported='no'/>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:     <sgx supported='no'/>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:     <hyperv supported='yes'>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:       <enum name='features'>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:         <value>relaxed</value>
May 21 01:52:52.089337 np0000001127 nova-compute[98206]:         <value>vapic</value>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:         <value>spinlocks</value>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:         <value>vpindex</value>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:         <value>runtime</value>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:         <value>synic</value>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:         <value>stimer</value>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:         <value>reset</value>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:         <value>vendor_id</value>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:         <value>frequencies</value>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:         <value>reenlightenment</value>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:         <value>tlbflush</value>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:         <value>ipi</value>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:         <value>avic</value>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:     </hyperv>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:   </features>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]: </domainCapabilities>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 21 01:52:52.091314 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=98206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 21 01:52:52.091314 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=None:
May 21 01:52:52.091314 np0000001127 nova-compute[98206]: <domainCapabilities>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:   <path>/usr/bin/qemu-system-m68k</path>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:   <domain>qemu</domain>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:   <machine>mcf5208evb</machine>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:   <arch>m68k</arch>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:   <vcpu max='1'/>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:   <iothreads supported='yes'/>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:   <os supported='yes'>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:     <enum name='firmware'/>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:     <loader supported='yes'>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:         <value>rom</value>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:         <value>pflash</value>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:       <enum name='readonly'>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:         <value>yes</value>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:       <enum name='secure'>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:     </loader>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:   </os>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:   <cpu>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:     <mode name='host-passthrough' supported='no'/>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:     <mode name='maximum' supported='no'/>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:     <mode name='host-model' supported='no'/>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:     <mode name='custom' supported='no'/>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:   <memoryBacking supported='yes'>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:     <enum name='sourceType'>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:       <value>file</value>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:       <value>anonymous</value>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:       <value>memfd</value>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:   </memoryBacking>
May 21 01:52:52.091314 np0000001127 nova-compute[98206]:   <devices>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:     <disk supported='yes'>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:       <enum name='diskDevice'>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:         <value>disk</value>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:         <value>cdrom</value>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:         <value>floppy</value>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:         <value>lun</value>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:         <value>fdc</value>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:     </disk>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:     <graphics supported='yes'>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:         <value>sdl</value>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:         <value>vnc</value>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:         <value>spice</value>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:         <value>egl-headless</value>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:         <value>dbus</value>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:     <video supported='yes'>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:       <enum name='modelType'>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:         <value>none</value>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:     </video>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:     <hostdev supported='yes'>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:       <enum name='mode'>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:         <value>subsystem</value>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:       <enum name='startupPolicy'>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:         <value>default</value>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:         <value>mandatory</value>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:         <value>requisite</value>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:         <value>optional</value>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:       <enum name='subsysType'>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:         <value>pci</value>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:       <enum name='capsType'/>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:       <enum name='pciBackend'/>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:     </hostdev>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:     <rng supported='yes'>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:         <value>random</value>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:         <value>egd</value>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:     </rng>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:     <filesystem supported='yes'>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:       <enum name='driverType'>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:         <value>path</value>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:         <value>handle</value>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:         <value>virtiofs</value>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:     </filesystem>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:     <tpm supported='no'/>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:     <redirdev supported='no'/>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:     <channel supported='yes'>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:         <value>pty</value>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:         <value>unix</value>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:         <value>spicevmc</value>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:     </channel>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:     <crypto supported='yes'>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:         <value>qemu</value>
May 21 01:52:52.092720 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:     </crypto>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:   </devices>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:   <features>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:     <gic supported='no'/>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:     <vmcoreinfo supported='no'/>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:     <genid supported='no'/>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:     <backingStoreInput supported='yes'/>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:     <backup supported='yes'/>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:     <async-teardown supported='yes'/>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:     <sev supported='no'/>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:     <sgx supported='no'/>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:   </features>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]: </domainCapabilities>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 21 01:52:52.094885 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=virt:
May 21 01:52:52.094885 np0000001127 nova-compute[98206]: <domainCapabilities>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:   <path>/usr/bin/qemu-system-m68k</path>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:   <domain>qemu</domain>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:   <machine>virt-8.2</machine>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:   <arch>m68k</arch>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:   <vcpu max='1'/>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:   <iothreads supported='yes'/>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:   <os supported='yes'>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:     <enum name='firmware'/>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:     <loader supported='yes'>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:         <value>rom</value>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:         <value>pflash</value>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:       <enum name='readonly'>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:         <value>yes</value>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:       <enum name='secure'>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:     </loader>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:   </os>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:   <cpu>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:     <mode name='host-passthrough' supported='no'/>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:     <mode name='maximum' supported='no'/>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:     <mode name='host-model' supported='no'/>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:     <mode name='custom' supported='no'/>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:   <memoryBacking supported='yes'>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:     <enum name='sourceType'>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:       <value>file</value>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:       <value>anonymous</value>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:       <value>memfd</value>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:   </memoryBacking>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:   <devices>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:     <disk supported='yes'>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:       <enum name='diskDevice'>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:         <value>disk</value>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:         <value>cdrom</value>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:         <value>floppy</value>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:         <value>lun</value>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:         <value>fdc</value>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.094885 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:     </disk>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:     <graphics supported='yes'>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:         <value>sdl</value>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:         <value>vnc</value>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:         <value>spice</value>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:         <value>egl-headless</value>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:         <value>dbus</value>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:     <video supported='yes'>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:       <enum name='modelType'>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:         <value>none</value>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:     </video>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:     <hostdev supported='yes'>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:       <enum name='mode'>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:         <value>subsystem</value>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:       <enum name='startupPolicy'>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:         <value>default</value>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:         <value>mandatory</value>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:         <value>requisite</value>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:         <value>optional</value>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:       <enum name='subsysType'>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:         <value>pci</value>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:       <enum name='capsType'/>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:       <enum name='pciBackend'/>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:     </hostdev>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:     <rng supported='yes'>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:         <value>random</value>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:         <value>egd</value>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:     </rng>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:     <filesystem supported='yes'>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:       <enum name='driverType'>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:         <value>path</value>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:         <value>handle</value>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:         <value>virtiofs</value>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:     </filesystem>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:     <tpm supported='no'/>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:     <redirdev supported='no'/>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:     <channel supported='yes'>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:         <value>pty</value>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:         <value>unix</value>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:         <value>spicevmc</value>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:     </channel>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:     <crypto supported='yes'>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:         <value>qemu</value>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:     </crypto>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:   </devices>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:   <features>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:     <gic supported='no'/>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:     <vmcoreinfo supported='no'/>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:     <genid supported='no'/>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:     <backingStoreInput supported='yes'/>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:     <backup supported='yes'/>
May 21 01:52:52.096799 np0000001127 nova-compute[98206]:     <async-teardown supported='yes'/>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:     <sev supported='no'/>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:     <sgx supported='no'/>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:   </features>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]: </domainCapabilities>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 21 01:52:52.099028 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=98206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 21 01:52:52.099028 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Libvirt host hypervisor capabilities for arch=microblaze and machine_type=None:
May 21 01:52:52.099028 np0000001127 nova-compute[98206]: <domainCapabilities>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:   <path>/usr/bin/qemu-system-microblaze</path>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:   <domain>qemu</domain>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:   <machine>petalogix-s3adsp1800</machine>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:   <arch>microblaze</arch>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:   <vcpu max='1'/>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:   <iothreads supported='yes'/>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:   <os supported='yes'>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:     <enum name='firmware'/>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:     <loader supported='yes'>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:         <value>rom</value>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:         <value>pflash</value>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:       <enum name='readonly'>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:         <value>yes</value>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:       <enum name='secure'>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:     </loader>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:   </os>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:   <cpu>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:     <mode name='host-passthrough' supported='no'/>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:     <mode name='maximum' supported='no'/>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:     <mode name='host-model' supported='no'/>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:     <mode name='custom' supported='no'/>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:   <memoryBacking supported='yes'>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:     <enum name='sourceType'>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:       <value>file</value>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:       <value>anonymous</value>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:       <value>memfd</value>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:   </memoryBacking>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:   <devices>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:     <disk supported='yes'>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:       <enum name='diskDevice'>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:         <value>disk</value>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:         <value>cdrom</value>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:         <value>floppy</value>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:         <value>lun</value>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:         <value>fdc</value>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.099028 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:     </disk>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:     <graphics supported='yes'>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:         <value>sdl</value>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:         <value>vnc</value>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:         <value>spice</value>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:         <value>egl-headless</value>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:         <value>dbus</value>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:     <video supported='yes'>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:       <enum name='modelType'>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:         <value>none</value>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:     </video>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:     <hostdev supported='yes'>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:       <enum name='mode'>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:         <value>subsystem</value>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:       <enum name='startupPolicy'>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:         <value>default</value>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:         <value>mandatory</value>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:         <value>requisite</value>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:         <value>optional</value>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:       <enum name='subsysType'>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:         <value>pci</value>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:       <enum name='capsType'/>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:       <enum name='pciBackend'/>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:     </hostdev>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:     <rng supported='yes'>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:       <enum name='model'/>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:         <value>random</value>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:         <value>egd</value>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:     </rng>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:     <filesystem supported='yes'>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:       <enum name='driverType'>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:         <value>path</value>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:         <value>handle</value>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:     </filesystem>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:     <tpm supported='no'/>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:     <redirdev supported='no'/>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:     <channel supported='yes'>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:         <value>pty</value>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:         <value>unix</value>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:         <value>spicevmc</value>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:     </channel>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:     <crypto supported='yes'>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:       <enum name='model'/>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:         <value>qemu</value>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:     </crypto>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:   </devices>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:   <features>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:     <gic supported='no'/>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:     <vmcoreinfo supported='no'/>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:     <genid supported='no'/>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:     <backingStoreInput supported='yes'/>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:     <backup supported='yes'/>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:     <async-teardown supported='yes'/>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:     <sev supported='no'/>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:     <sgx supported='no'/>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]:   </features>
May 21 01:52:52.100678 np0000001127 nova-compute[98206]: </domainCapabilities>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 21 01:52:52.102606 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=98206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 21 01:52:52.102606 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Libvirt host hypervisor capabilities for arch=microblazeel and machine_type=None:
May 21 01:52:52.102606 np0000001127 nova-compute[98206]: <domainCapabilities>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:   <path>/usr/bin/qemu-system-microblazeel</path>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:   <domain>qemu</domain>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:   <machine>petalogix-s3adsp1800</machine>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:   <arch>microblazeel</arch>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:   <vcpu max='1'/>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:   <iothreads supported='yes'/>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:   <os supported='yes'>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:     <enum name='firmware'/>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:     <loader supported='yes'>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:         <value>rom</value>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:         <value>pflash</value>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:       <enum name='readonly'>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:         <value>yes</value>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:       <enum name='secure'>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:     </loader>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:   </os>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:   <cpu>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:     <mode name='host-passthrough' supported='no'/>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:     <mode name='maximum' supported='no'/>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:     <mode name='host-model' supported='no'/>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:     <mode name='custom' supported='no'/>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:   <memoryBacking supported='yes'>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:     <enum name='sourceType'>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:       <value>file</value>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:       <value>anonymous</value>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:       <value>memfd</value>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:   </memoryBacking>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:   <devices>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:     <disk supported='yes'>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:       <enum name='diskDevice'>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:         <value>disk</value>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:         <value>cdrom</value>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:         <value>floppy</value>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:         <value>lun</value>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:         <value>fdc</value>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.102606 np0000001127 nova-compute[98206]:     </disk>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:     <graphics supported='yes'>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:         <value>sdl</value>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:         <value>vnc</value>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:         <value>spice</value>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:         <value>egl-headless</value>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:         <value>dbus</value>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:     <video supported='yes'>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:       <enum name='modelType'>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:         <value>none</value>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:     </video>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:     <hostdev supported='yes'>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:       <enum name='mode'>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:         <value>subsystem</value>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:       <enum name='startupPolicy'>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:         <value>default</value>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:         <value>mandatory</value>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:         <value>requisite</value>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:         <value>optional</value>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:       <enum name='subsysType'>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:         <value>pci</value>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:       <enum name='capsType'/>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:       <enum name='pciBackend'/>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:     </hostdev>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:     <rng supported='yes'>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:       <enum name='model'/>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:         <value>random</value>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:         <value>egd</value>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:     </rng>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:     <filesystem supported='yes'>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:       <enum name='driverType'>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:         <value>path</value>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:         <value>handle</value>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:     </filesystem>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:     <tpm supported='no'/>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:     <redirdev supported='no'/>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:     <channel supported='yes'>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:         <value>pty</value>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:         <value>unix</value>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:         <value>spicevmc</value>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:     </channel>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:     <crypto supported='yes'>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:       <enum name='model'/>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:         <value>qemu</value>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:     </crypto>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:   </devices>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:   <features>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:     <gic supported='no'/>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:     <vmcoreinfo supported='no'/>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:     <genid supported='no'/>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:     <backingStoreInput supported='yes'/>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:     <backup supported='yes'/>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:     <async-teardown supported='yes'/>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:     <sev supported='no'/>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:     <sgx supported='no'/>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:   </features>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]: </domainCapabilities>
May 21 01:52:52.104084 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 21 01:52:52.106406 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=98206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 21 01:52:52.106406 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Libvirt host hypervisor capabilities for arch=mips and machine_type=None:
May 21 01:52:52.106406 np0000001127 nova-compute[98206]: <domainCapabilities>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:   <path>/usr/bin/qemu-system-mips</path>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:   <domain>qemu</domain>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:   <machine>malta</machine>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:   <arch>mips</arch>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:   <vcpu max='16'/>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:   <iothreads supported='yes'/>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:   <os supported='yes'>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:     <enum name='firmware'/>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:     <loader supported='yes'>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:         <value>rom</value>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:         <value>pflash</value>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:       <enum name='readonly'>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:         <value>yes</value>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:       <enum name='secure'>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:     </loader>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:   </os>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:   <cpu>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:     <mode name='host-passthrough' supported='no'/>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:     <mode name='maximum' supported='no'/>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:     <mode name='host-model' supported='no'/>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:     <mode name='custom' supported='no'/>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:   <memoryBacking supported='yes'>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:     <enum name='sourceType'>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:       <value>file</value>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:       <value>anonymous</value>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:       <value>memfd</value>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:   </memoryBacking>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:   <devices>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:     <disk supported='yes'>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:       <enum name='diskDevice'>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:         <value>disk</value>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:         <value>cdrom</value>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:         <value>floppy</value>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:         <value>lun</value>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:         <value>ide</value>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:         <value>fdc</value>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:         <value>sata</value>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.106406 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:     </disk>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:     <graphics supported='yes'>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:         <value>sdl</value>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:         <value>vnc</value>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:         <value>spice</value>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:         <value>egl-headless</value>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:         <value>dbus</value>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:     <video supported='yes'>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:       <enum name='modelType'>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:         <value>vga</value>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:         <value>cirrus</value>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:         <value>vmvga</value>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:         <value>none</value>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:         <value>bochs</value>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:     </video>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:     <hostdev supported='yes'>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:       <enum name='mode'>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:         <value>subsystem</value>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:       <enum name='startupPolicy'>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:         <value>default</value>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:         <value>mandatory</value>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:         <value>requisite</value>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:         <value>optional</value>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:       <enum name='subsysType'>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:         <value>pci</value>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:       <enum name='capsType'/>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:       <enum name='pciBackend'/>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:     </hostdev>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:     <rng supported='yes'>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:         <value>random</value>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:         <value>egd</value>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:     </rng>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:     <filesystem supported='yes'>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:       <enum name='driverType'>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:         <value>path</value>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:         <value>handle</value>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:         <value>virtiofs</value>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:     </filesystem>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:     <tpm supported='no'/>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:     <redirdev supported='yes'>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:     </redirdev>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:     <channel supported='yes'>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:         <value>pty</value>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:         <value>unix</value>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:         <value>spicevmc</value>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:     </channel>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:     <crypto supported='yes'>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:         <value>qemu</value>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.108203 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:     </crypto>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:   </devices>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:   <features>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:     <gic supported='no'/>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:     <vmcoreinfo supported='no'/>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:     <genid supported='no'/>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:     <backingStoreInput supported='yes'/>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:     <backup supported='yes'/>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:     <async-teardown supported='yes'/>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:     <sev supported='no'/>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:     <sgx supported='no'/>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:   </features>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]: </domainCapabilities>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 21 01:52:52.110595 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=98206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 21 01:52:52.110595 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Libvirt host hypervisor capabilities for arch=mipsel and machine_type=None:
May 21 01:52:52.110595 np0000001127 nova-compute[98206]: <domainCapabilities>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:   <path>/usr/bin/qemu-system-mipsel</path>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:   <domain>qemu</domain>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:   <machine>malta</machine>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:   <arch>mipsel</arch>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:   <vcpu max='16'/>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:   <iothreads supported='yes'/>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:   <os supported='yes'>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:     <enum name='firmware'/>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:     <loader supported='yes'>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:         <value>rom</value>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:         <value>pflash</value>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:       <enum name='readonly'>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:         <value>yes</value>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:       <enum name='secure'>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:     </loader>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:   </os>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:   <cpu>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:     <mode name='host-passthrough' supported='no'/>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:     <mode name='maximum' supported='no'/>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:     <mode name='host-model' supported='no'/>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:     <mode name='custom' supported='no'/>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:   <memoryBacking supported='yes'>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:     <enum name='sourceType'>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:       <value>file</value>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:       <value>anonymous</value>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:       <value>memfd</value>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:   </memoryBacking>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:   <devices>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:     <disk supported='yes'>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:       <enum name='diskDevice'>
May 21 01:52:52.110595 np0000001127 nova-compute[98206]:         <value>disk</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:         <value>cdrom</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:         <value>floppy</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:         <value>lun</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:         <value>ide</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:         <value>fdc</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:         <value>sata</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:     </disk>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:     <graphics supported='yes'>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:         <value>sdl</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:         <value>vnc</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:         <value>spice</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:         <value>egl-headless</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:         <value>dbus</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:     <video supported='yes'>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:       <enum name='modelType'>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:         <value>vga</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:         <value>cirrus</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:         <value>vmvga</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:         <value>none</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:         <value>bochs</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:     </video>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:     <hostdev supported='yes'>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:       <enum name='mode'>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:         <value>subsystem</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:       <enum name='startupPolicy'>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:         <value>default</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:         <value>mandatory</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:         <value>requisite</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:         <value>optional</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:       <enum name='subsysType'>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:         <value>pci</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:       <enum name='capsType'/>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:       <enum name='pciBackend'/>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:     </hostdev>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:     <rng supported='yes'>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:         <value>random</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:         <value>egd</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:     </rng>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:     <filesystem supported='yes'>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:       <enum name='driverType'>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:         <value>path</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:         <value>handle</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:         <value>virtiofs</value>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:     </filesystem>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:     <tpm supported='no'/>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:     <redirdev supported='yes'>
May 21 01:52:52.112266 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:     </redirdev>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:     <channel supported='yes'>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:         <value>pty</value>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:         <value>unix</value>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:         <value>spicevmc</value>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:     </channel>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:     <crypto supported='yes'>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:         <value>qemu</value>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:     </crypto>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:   </devices>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:   <features>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:     <gic supported='no'/>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:     <vmcoreinfo supported='no'/>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:     <genid supported='no'/>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:     <backingStoreInput supported='yes'/>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:     <backup supported='yes'/>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:     <async-teardown supported='yes'/>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:     <sev supported='no'/>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:     <sgx supported='no'/>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:   </features>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]: </domainCapabilities>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 21 01:52:52.114490 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=98206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 21 01:52:52.114490 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Libvirt host hypervisor capabilities for arch=mips64 and machine_type=None:
May 21 01:52:52.114490 np0000001127 nova-compute[98206]: <domainCapabilities>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:   <path>/usr/bin/qemu-system-mips64</path>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:   <domain>qemu</domain>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:   <machine>malta</machine>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:   <arch>mips64</arch>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:   <vcpu max='16'/>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:   <iothreads supported='yes'/>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:   <os supported='yes'>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:     <enum name='firmware'/>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:     <loader supported='yes'>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:         <value>rom</value>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:         <value>pflash</value>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:       <enum name='readonly'>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:         <value>yes</value>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:       <enum name='secure'>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:     </loader>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:   </os>
May 21 01:52:52.114490 np0000001127 nova-compute[98206]:   <cpu>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:     <mode name='host-passthrough' supported='no'/>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:     <mode name='maximum' supported='no'/>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:     <mode name='host-model' supported='no'/>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:     <mode name='custom' supported='no'/>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:   <memoryBacking supported='yes'>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:     <enum name='sourceType'>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:       <value>file</value>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:       <value>anonymous</value>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:       <value>memfd</value>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:   </memoryBacking>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:   <devices>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:     <disk supported='yes'>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:       <enum name='diskDevice'>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:         <value>disk</value>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:         <value>cdrom</value>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:         <value>floppy</value>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:         <value>lun</value>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:         <value>ide</value>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:         <value>fdc</value>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:         <value>sata</value>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:     </disk>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:     <graphics supported='yes'>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:         <value>sdl</value>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:         <value>vnc</value>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:         <value>spice</value>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:         <value>egl-headless</value>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:         <value>dbus</value>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:     <video supported='yes'>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:       <enum name='modelType'>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:         <value>vga</value>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:         <value>cirrus</value>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:         <value>vmvga</value>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:         <value>none</value>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:         <value>bochs</value>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:     </video>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:     <hostdev supported='yes'>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:       <enum name='mode'>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:         <value>subsystem</value>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:       <enum name='startupPolicy'>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:         <value>default</value>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:         <value>mandatory</value>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:         <value>requisite</value>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:         <value>optional</value>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:       <enum name='subsysType'>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:         <value>pci</value>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:       <enum name='capsType'/>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:       <enum name='pciBackend'/>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:     </hostdev>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:     <rng supported='yes'>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.116289 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:         <value>random</value>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:         <value>egd</value>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:     </rng>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:     <filesystem supported='yes'>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:       <enum name='driverType'>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:         <value>path</value>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:         <value>handle</value>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:         <value>virtiofs</value>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:     </filesystem>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:     <tpm supported='no'/>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:     <redirdev supported='yes'>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:     </redirdev>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:     <channel supported='yes'>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:         <value>pty</value>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:         <value>unix</value>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:         <value>spicevmc</value>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:     </channel>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:     <crypto supported='yes'>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:         <value>qemu</value>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:     </crypto>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:   </devices>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:   <features>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:     <gic supported='no'/>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:     <vmcoreinfo supported='no'/>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:     <genid supported='no'/>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:     <backingStoreInput supported='yes'/>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:     <backup supported='yes'/>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:     <async-teardown supported='yes'/>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:     <sev supported='no'/>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:     <sgx supported='no'/>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:   </features>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]: </domainCapabilities>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 21 01:52:52.118323 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=98206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 21 01:52:52.118323 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Libvirt host hypervisor capabilities for arch=mips64el and machine_type=None:
May 21 01:52:52.118323 np0000001127 nova-compute[98206]: <domainCapabilities>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:   <path>/usr/bin/qemu-system-mips64el</path>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:   <domain>qemu</domain>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:   <machine>malta</machine>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:   <arch>mips64el</arch>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:   <vcpu max='16'/>
May 21 01:52:52.118323 np0000001127 nova-compute[98206]:   <iothreads supported='yes'/>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:   <os supported='yes'>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:     <enum name='firmware'/>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:     <loader supported='yes'>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:         <value>rom</value>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:         <value>pflash</value>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:       <enum name='readonly'>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:         <value>yes</value>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:       <enum name='secure'>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:     </loader>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:   </os>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:   <cpu>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:     <mode name='host-passthrough' supported='no'/>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:     <mode name='maximum' supported='no'/>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:     <mode name='host-model' supported='no'/>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:     <mode name='custom' supported='no'/>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:   <memoryBacking supported='yes'>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:     <enum name='sourceType'>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:       <value>file</value>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:       <value>anonymous</value>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:       <value>memfd</value>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:   </memoryBacking>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:   <devices>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:     <disk supported='yes'>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:       <enum name='diskDevice'>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:         <value>disk</value>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:         <value>cdrom</value>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:         <value>floppy</value>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:         <value>lun</value>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:         <value>ide</value>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:         <value>fdc</value>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:         <value>sata</value>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:     </disk>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:     <graphics supported='yes'>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:         <value>sdl</value>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:         <value>vnc</value>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:         <value>spice</value>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:         <value>egl-headless</value>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:         <value>dbus</value>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:     <video supported='yes'>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:       <enum name='modelType'>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:         <value>vga</value>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:         <value>cirrus</value>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:         <value>vmvga</value>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:         <value>none</value>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:         <value>bochs</value>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:     </video>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:     <hostdev supported='yes'>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:       <enum name='mode'>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:         <value>subsystem</value>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.120113 np0000001127 nova-compute[98206]:       <enum name='startupPolicy'>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:         <value>default</value>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:         <value>mandatory</value>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:         <value>requisite</value>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:         <value>optional</value>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:       <enum name='subsysType'>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:         <value>pci</value>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:       <enum name='capsType'/>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:       <enum name='pciBackend'/>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:     </hostdev>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:     <rng supported='yes'>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:         <value>random</value>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:         <value>egd</value>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:     </rng>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:     <filesystem supported='yes'>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:       <enum name='driverType'>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:         <value>path</value>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:         <value>handle</value>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:         <value>virtiofs</value>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:     </filesystem>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:     <tpm supported='no'/>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:     <redirdev supported='yes'>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:     </redirdev>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:     <channel supported='yes'>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:         <value>pty</value>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:         <value>unix</value>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:         <value>spicevmc</value>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:     </channel>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:     <crypto supported='yes'>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:         <value>qemu</value>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:     </crypto>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:   </devices>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:   <features>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:     <gic supported='no'/>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:     <vmcoreinfo supported='no'/>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:     <genid supported='no'/>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:     <backingStoreInput supported='yes'/>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:     <backup supported='yes'/>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:     <async-teardown supported='yes'/>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:     <sev supported='no'/>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:     <sgx supported='no'/>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:   </features>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]: </domainCapabilities>
May 21 01:52:52.122252 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 21 01:52:52.124284 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=98206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 21 01:52:52.124284 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Libvirt host hypervisor capabilities for arch=ppc and machine_type=None:
May 21 01:52:52.124284 np0000001127 nova-compute[98206]: <domainCapabilities>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:   <path>/usr/bin/qemu-system-ppc</path>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:   <domain>qemu</domain>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:   <machine>g3beige</machine>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:   <arch>ppc</arch>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:   <vcpu max='1'/>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:   <iothreads supported='yes'/>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:   <os supported='yes'>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:     <enum name='firmware'/>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:     <loader supported='yes'>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:         <value>rom</value>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:         <value>pflash</value>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:       <enum name='readonly'>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:         <value>yes</value>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:       <enum name='secure'>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:     </loader>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:   </os>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:   <cpu>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:     <mode name='host-passthrough' supported='no'/>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:     <mode name='maximum' supported='no'/>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:     <mode name='host-model' supported='no'/>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:     <mode name='custom' supported='no'/>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:   <memoryBacking supported='yes'>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:     <enum name='sourceType'>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:       <value>file</value>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:       <value>anonymous</value>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:       <value>memfd</value>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:   </memoryBacking>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:   <devices>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:     <disk supported='yes'>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:       <enum name='diskDevice'>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:         <value>disk</value>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:         <value>cdrom</value>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:         <value>floppy</value>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:         <value>lun</value>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:         <value>ide</value>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:         <value>fdc</value>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:         <value>sata</value>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.124284 np0000001127 nova-compute[98206]:     </disk>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:     <graphics supported='yes'>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:         <value>sdl</value>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:         <value>vnc</value>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:         <value>spice</value>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:         <value>egl-headless</value>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:         <value>dbus</value>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:     <video supported='yes'>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:       <enum name='modelType'>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:         <value>vga</value>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:         <value>cirrus</value>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:         <value>none</value>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:         <value>bochs</value>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:     </video>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:     <hostdev supported='yes'>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:       <enum name='mode'>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:         <value>subsystem</value>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:       <enum name='startupPolicy'>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:         <value>default</value>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:         <value>mandatory</value>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:         <value>requisite</value>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:         <value>optional</value>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:       <enum name='subsysType'>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:         <value>pci</value>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:       <enum name='capsType'/>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:       <enum name='pciBackend'/>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:     </hostdev>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:     <rng supported='yes'>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:         <value>random</value>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:         <value>egd</value>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:     </rng>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:     <filesystem supported='yes'>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:       <enum name='driverType'>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:         <value>path</value>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:         <value>handle</value>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:         <value>virtiofs</value>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:     </filesystem>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:     <tpm supported='no'/>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:     <redirdev supported='yes'>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:     </redirdev>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:     <channel supported='yes'>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:         <value>pty</value>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:         <value>unix</value>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:         <value>spicevmc</value>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:     </channel>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:     <crypto supported='yes'>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:         <value>qemu</value>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:     </crypto>
May 21 01:52:52.126055 np0000001127 nova-compute[98206]:   </devices>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:   <features>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:     <gic supported='no'/>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:     <vmcoreinfo supported='no'/>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:     <genid supported='no'/>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:     <backingStoreInput supported='yes'/>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:     <backup supported='yes'/>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:     <async-teardown supported='yes'/>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:     <sev supported='no'/>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:     <sgx supported='no'/>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:   </features>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]: </domainCapabilities>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 21 01:52:52.128215 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Getting domain capabilities for ppc64 via machine types: {None, 'pseries', 'powernv'} {{(pid=98206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 21 01:52:52.128215 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=None:
May 21 01:52:52.128215 np0000001127 nova-compute[98206]: <domainCapabilities>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:   <path>/usr/bin/qemu-system-ppc64</path>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:   <domain>qemu</domain>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:   <machine>pseries-noble</machine>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:   <arch>ppc64</arch>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:   <vcpu max='4096'/>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:   <iothreads supported='yes'/>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:   <os supported='yes'>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:     <enum name='firmware'/>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:     <loader supported='yes'>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:         <value>rom</value>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:         <value>pflash</value>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:       <enum name='readonly'>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:         <value>yes</value>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:       <enum name='secure'>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:     </loader>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:   </os>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:   <cpu>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:     <mode name='host-passthrough' supported='no'/>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:     <mode name='maximum' supported='no'/>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:     <mode name='host-model' supported='no'/>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:     <mode name='custom' supported='yes'>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:   <memoryBacking supported='yes'>
May 21 01:52:52.128215 np0000001127 nova-compute[98206]:     <enum name='sourceType'>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:       <value>file</value>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:       <value>anonymous</value>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:       <value>memfd</value>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:   </memoryBacking>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:   <devices>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:     <disk supported='yes'>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:       <enum name='diskDevice'>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:         <value>disk</value>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:         <value>cdrom</value>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:         <value>lun</value>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:         <value>sata</value>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:     </disk>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:     <graphics supported='yes'>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:         <value>sdl</value>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:         <value>vnc</value>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:         <value>spice</value>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:         <value>egl-headless</value>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:         <value>dbus</value>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:     <video supported='yes'>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:       <enum name='modelType'>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:         <value>vga</value>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:         <value>cirrus</value>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:         <value>none</value>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:         <value>bochs</value>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:     </video>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:     <hostdev supported='yes'>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:       <enum name='mode'>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:         <value>subsystem</value>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:       <enum name='startupPolicy'>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:         <value>default</value>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:         <value>mandatory</value>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:         <value>requisite</value>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:         <value>optional</value>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:       <enum name='subsysType'>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:         <value>pci</value>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:       <enum name='capsType'/>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:       <enum name='pciBackend'/>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:     </hostdev>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:     <rng supported='yes'>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:         <value>random</value>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:         <value>egd</value>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:     </rng>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:     <filesystem supported='yes'>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:       <enum name='driverType'>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:         <value>path</value>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:         <value>handle</value>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:         <value>virtiofs</value>
May 21 01:52:52.129872 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:     </filesystem>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:     <tpm supported='yes'>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:         <value>tpm-spapr</value>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:         <value>spapr-tpm-proxy</value>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:         <value>passthrough</value>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:         <value>emulator</value>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:         <value>external</value>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:       <enum name='backendVersion'>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:         <value>1.2</value>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:         <value>2.0</value>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:     </tpm>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:     <redirdev supported='yes'>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:     </redirdev>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:     <channel supported='yes'>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:         <value>pty</value>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:         <value>unix</value>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:         <value>spicevmc</value>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:     </channel>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:     <crypto supported='yes'>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:         <value>qemu</value>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:     </crypto>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:   </devices>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:   <features>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:     <gic supported='no'/>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:     <vmcoreinfo supported='no'/>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:     <genid supported='no'/>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:     <backingStoreInput supported='yes'/>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:     <backup supported='yes'/>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:     <async-teardown supported='yes'/>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:     <sev supported='no'/>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:     <sgx supported='no'/>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:   </features>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]: </domainCapabilities>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 21 01:52:52.132063 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=pseries:
May 21 01:52:52.132063 np0000001127 nova-compute[98206]: <domainCapabilities>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:   <path>/usr/bin/qemu-system-ppc64</path>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:   <domain>qemu</domain>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:   <machine>pseries-noble</machine>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:   <arch>ppc64</arch>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:   <vcpu max='4096'/>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:   <iothreads supported='yes'/>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:   <os supported='yes'>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:     <enum name='firmware'/>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:     <loader supported='yes'>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:         <value>rom</value>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:         <value>pflash</value>
May 21 01:52:52.132063 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:       <enum name='readonly'>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:         <value>yes</value>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:       <enum name='secure'>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:     </loader>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:   </os>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:   <cpu>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:     <mode name='host-passthrough' supported='no'/>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:     <mode name='maximum' supported='no'/>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:     <mode name='host-model' supported='no'/>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:     <mode name='custom' supported='yes'>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:   <memoryBacking supported='yes'>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:     <enum name='sourceType'>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:       <value>file</value>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:       <value>anonymous</value>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:       <value>memfd</value>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:   </memoryBacking>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:   <devices>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:     <disk supported='yes'>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:       <enum name='diskDevice'>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:         <value>disk</value>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:         <value>cdrom</value>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:         <value>lun</value>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:         <value>sata</value>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:     </disk>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:     <graphics supported='yes'>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:         <value>sdl</value>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:         <value>vnc</value>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:         <value>spice</value>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:         <value>egl-headless</value>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:         <value>dbus</value>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:     <video supported='yes'>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:       <enum name='modelType'>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:         <value>vga</value>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:         <value>cirrus</value>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:         <value>none</value>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:         <value>bochs</value>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:     </video>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:     <hostdev supported='yes'>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:       <enum name='mode'>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:         <value>subsystem</value>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:       <enum name='startupPolicy'>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:         <value>default</value>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:         <value>mandatory</value>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:         <value>requisite</value>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:         <value>optional</value>
May 21 01:52:52.134169 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:       <enum name='subsysType'>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:         <value>pci</value>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:       <enum name='capsType'/>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:       <enum name='pciBackend'/>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:     </hostdev>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:     <rng supported='yes'>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:         <value>random</value>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:         <value>egd</value>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:     </rng>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:     <filesystem supported='yes'>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:       <enum name='driverType'>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:         <value>path</value>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:         <value>handle</value>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:         <value>virtiofs</value>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:     </filesystem>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:     <tpm supported='yes'>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:         <value>tpm-spapr</value>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:         <value>spapr-tpm-proxy</value>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:         <value>passthrough</value>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:         <value>emulator</value>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:         <value>external</value>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:       <enum name='backendVersion'>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:         <value>1.2</value>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:         <value>2.0</value>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:     </tpm>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:     <redirdev supported='yes'>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:     </redirdev>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:     <channel supported='yes'>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:         <value>pty</value>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:         <value>unix</value>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:         <value>spicevmc</value>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:     </channel>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:     <crypto supported='yes'>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:         <value>qemu</value>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:     </crypto>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:   </devices>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:   <features>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:     <gic supported='no'/>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:     <vmcoreinfo supported='no'/>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:     <genid supported='no'/>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:     <backingStoreInput supported='yes'/>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:     <backup supported='yes'/>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:     <async-teardown supported='yes'/>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:     <sev supported='no'/>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:     <sgx supported='no'/>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]:   </features>
May 21 01:52:52.136226 np0000001127 nova-compute[98206]: </domainCapabilities>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 21 01:52:52.138343 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=powernv:
May 21 01:52:52.138343 np0000001127 nova-compute[98206]: <domainCapabilities>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:   <path>/usr/bin/qemu-system-ppc64</path>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:   <domain>qemu</domain>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:   <machine>powernv9</machine>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:   <arch>ppc64</arch>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:   <vcpu max='2048'/>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:   <iothreads supported='yes'/>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:   <os supported='yes'>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:     <enum name='firmware'/>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:     <loader supported='yes'>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:         <value>rom</value>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:         <value>pflash</value>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:       <enum name='readonly'>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:         <value>yes</value>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:       <enum name='secure'>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:     </loader>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:   </os>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:   <cpu>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:     <mode name='host-passthrough' supported='no'/>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:     <mode name='maximum' supported='no'/>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:     <mode name='host-model' supported='no'/>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:     <mode name='custom' supported='yes'>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:   <memoryBacking supported='yes'>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:     <enum name='sourceType'>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:       <value>file</value>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:       <value>anonymous</value>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:       <value>memfd</value>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:   </memoryBacking>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:   <devices>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:     <disk supported='yes'>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:       <enum name='diskDevice'>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:         <value>disk</value>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:         <value>cdrom</value>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:         <value>floppy</value>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:         <value>lun</value>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:         <value>fdc</value>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:         <value>sata</value>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.138343 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:     </disk>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:     <graphics supported='yes'>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:         <value>sdl</value>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:         <value>vnc</value>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:         <value>spice</value>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:         <value>egl-headless</value>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:         <value>dbus</value>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:     <video supported='yes'>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:       <enum name='modelType'>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:         <value>vga</value>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:         <value>cirrus</value>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:         <value>none</value>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:         <value>bochs</value>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:     </video>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:     <hostdev supported='yes'>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:       <enum name='mode'>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:         <value>subsystem</value>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:       <enum name='startupPolicy'>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:         <value>default</value>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:         <value>mandatory</value>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:         <value>requisite</value>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:         <value>optional</value>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:       <enum name='subsysType'>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:         <value>pci</value>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:       <enum name='capsType'/>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:       <enum name='pciBackend'/>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:     </hostdev>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:     <rng supported='yes'>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:         <value>random</value>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:         <value>egd</value>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:     </rng>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:     <filesystem supported='yes'>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:       <enum name='driverType'>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:         <value>path</value>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:         <value>handle</value>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:         <value>virtiofs</value>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:     </filesystem>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:     <tpm supported='yes'>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:         <value>tpm-spapr</value>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:         <value>spapr-tpm-proxy</value>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:         <value>passthrough</value>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:         <value>emulator</value>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:         <value>external</value>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:       <enum name='backendVersion'>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:         <value>1.2</value>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:         <value>2.0</value>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:     </tpm>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:     <redirdev supported='yes'>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.140286 np0000001127 nova-compute[98206]:     </redirdev>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:     <channel supported='yes'>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:         <value>pty</value>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:         <value>unix</value>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:         <value>spicevmc</value>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:     </channel>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:     <crypto supported='yes'>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:         <value>qemu</value>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:     </crypto>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:   </devices>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:   <features>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:     <gic supported='no'/>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:     <vmcoreinfo supported='no'/>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:     <genid supported='no'/>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:     <backingStoreInput supported='yes'/>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:     <backup supported='yes'/>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:     <async-teardown supported='yes'/>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:     <sev supported='no'/>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:     <sgx supported='no'/>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:   </features>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]: </domainCapabilities>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 21 01:52:52.142408 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=98206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 21 01:52:52.142408 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=pseries:
May 21 01:52:52.142408 np0000001127 nova-compute[98206]: <domainCapabilities>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:   <path>/usr/bin/qemu-system-ppc64le</path>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:   <domain>qemu</domain>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:   <machine>pseries-noble</machine>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:   <arch>ppc64le</arch>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:   <vcpu max='4096'/>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:   <iothreads supported='yes'/>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:   <os supported='yes'>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:     <enum name='firmware'/>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:     <loader supported='yes'>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:         <value>rom</value>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:         <value>pflash</value>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:       <enum name='readonly'>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:         <value>yes</value>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:       <enum name='secure'>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:     </loader>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:   </os>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:   <cpu>
May 21 01:52:52.142408 np0000001127 nova-compute[98206]:     <mode name='host-passthrough' supported='no'/>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:     <mode name='maximum' supported='no'/>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:     <mode name='host-model' supported='no'/>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:     <mode name='custom' supported='yes'>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:   <memoryBacking supported='yes'>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:     <enum name='sourceType'>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:       <value>file</value>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:       <value>anonymous</value>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:       <value>memfd</value>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:   </memoryBacking>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:   <devices>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:     <disk supported='yes'>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:       <enum name='diskDevice'>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:         <value>disk</value>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:         <value>cdrom</value>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:         <value>lun</value>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:         <value>sata</value>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:     </disk>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:     <graphics supported='yes'>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:         <value>sdl</value>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:         <value>vnc</value>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:         <value>spice</value>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:         <value>egl-headless</value>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:         <value>dbus</value>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:     <video supported='yes'>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:       <enum name='modelType'>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:         <value>vga</value>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:         <value>cirrus</value>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:         <value>none</value>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:         <value>bochs</value>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:     </video>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:     <hostdev supported='yes'>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:       <enum name='mode'>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:         <value>subsystem</value>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:       <enum name='startupPolicy'>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:         <value>default</value>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:         <value>mandatory</value>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:         <value>requisite</value>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:         <value>optional</value>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:       <enum name='subsysType'>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:         <value>pci</value>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:       <enum name='capsType'/>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:       <enum name='pciBackend'/>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:     </hostdev>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:     <rng supported='yes'>
May 21 01:52:52.144110 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:         <value>random</value>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:         <value>egd</value>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:     </rng>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:     <filesystem supported='yes'>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:       <enum name='driverType'>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:         <value>path</value>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:         <value>handle</value>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:         <value>virtiofs</value>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:     </filesystem>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:     <tpm supported='yes'>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:         <value>tpm-spapr</value>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:         <value>spapr-tpm-proxy</value>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:         <value>passthrough</value>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:         <value>emulator</value>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:         <value>external</value>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:       <enum name='backendVersion'>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:         <value>1.2</value>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:         <value>2.0</value>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:     </tpm>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:     <redirdev supported='yes'>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:     </redirdev>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:     <channel supported='yes'>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:         <value>pty</value>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:         <value>unix</value>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:         <value>spicevmc</value>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:     </channel>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:     <crypto supported='yes'>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:         <value>qemu</value>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:     </crypto>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:   </devices>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:   <features>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:     <gic supported='no'/>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:     <vmcoreinfo supported='no'/>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:     <genid supported='no'/>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:     <backingStoreInput supported='yes'/>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:     <backup supported='yes'/>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:     <async-teardown supported='yes'/>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:     <sev supported='no'/>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:     <sgx supported='no'/>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:   </features>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]: </domainCapabilities>
May 21 01:52:52.146099 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 21 01:52:52.146099 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=powernv:
May 21 01:52:52.146099 np0000001127 nova-compute[98206]: <domainCapabilities>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:   <path>/usr/bin/qemu-system-ppc64le</path>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:   <domain>qemu</domain>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:   <machine>powernv9</machine>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:   <arch>ppc64le</arch>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:   <vcpu max='2048'/>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:   <iothreads supported='yes'/>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:   <os supported='yes'>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:     <enum name='firmware'/>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:     <loader supported='yes'>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:         <value>rom</value>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:         <value>pflash</value>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:       <enum name='readonly'>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:         <value>yes</value>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:       <enum name='secure'>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:     </loader>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:   </os>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:   <cpu>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:     <mode name='host-passthrough' supported='no'/>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:     <mode name='maximum' supported='no'/>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:     <mode name='host-model' supported='no'/>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:     <mode name='custom' supported='yes'>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:   <memoryBacking supported='yes'>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:     <enum name='sourceType'>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:       <value>file</value>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:       <value>anonymous</value>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:       <value>memfd</value>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:   </memoryBacking>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:   <devices>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:     <disk supported='yes'>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:       <enum name='diskDevice'>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:         <value>disk</value>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:         <value>cdrom</value>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:         <value>floppy</value>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:         <value>lun</value>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:         <value>fdc</value>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:         <value>sata</value>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:     </disk>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:     <graphics supported='yes'>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:         <value>sdl</value>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:         <value>vnc</value>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:         <value>spice</value>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:         <value>egl-headless</value>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:         <value>dbus</value>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.148020 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:     <video supported='yes'>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:       <enum name='modelType'>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:         <value>vga</value>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:         <value>cirrus</value>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:         <value>none</value>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:         <value>bochs</value>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:     </video>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:     <hostdev supported='yes'>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:       <enum name='mode'>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:         <value>subsystem</value>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:       <enum name='startupPolicy'>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:         <value>default</value>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:         <value>mandatory</value>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:         <value>requisite</value>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:         <value>optional</value>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:       <enum name='subsysType'>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:         <value>pci</value>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:       <enum name='capsType'/>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:       <enum name='pciBackend'/>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:     </hostdev>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:     <rng supported='yes'>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:         <value>random</value>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:         <value>egd</value>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:     </rng>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:     <filesystem supported='yes'>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:       <enum name='driverType'>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:         <value>path</value>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:         <value>handle</value>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:         <value>virtiofs</value>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:     </filesystem>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:     <tpm supported='yes'>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:         <value>tpm-spapr</value>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:         <value>spapr-tpm-proxy</value>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:         <value>passthrough</value>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:         <value>emulator</value>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:         <value>external</value>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:       <enum name='backendVersion'>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:         <value>1.2</value>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:         <value>2.0</value>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:     </tpm>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:     <redirdev supported='yes'>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:     </redirdev>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:     <channel supported='yes'>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:         <value>pty</value>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:         <value>unix</value>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:         <value>spicevmc</value>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:     </channel>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:     <crypto supported='yes'>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.150058 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:         <value>qemu</value>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:     </crypto>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:   </devices>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:   <features>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:     <gic supported='no'/>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:     <vmcoreinfo supported='no'/>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:     <genid supported='no'/>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:     <backingStoreInput supported='yes'/>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:     <backup supported='yes'/>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:     <async-teardown supported='yes'/>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:     <sev supported='no'/>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:     <sgx supported='no'/>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:   </features>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]: </domainCapabilities>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 21 01:52:52.152162 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=98206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 21 01:52:52.152162 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Libvirt host hypervisor capabilities for arch=riscv32 and machine_type=None:
May 21 01:52:52.152162 np0000001127 nova-compute[98206]: <domainCapabilities>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:   <path>/usr/bin/qemu-system-riscv32</path>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:   <domain>qemu</domain>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:   <machine>virt</machine>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:   <arch>riscv32</arch>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:   <vcpu max='512'/>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:   <iothreads supported='yes'/>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:   <os supported='yes'>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:     <enum name='firmware'/>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:     <loader supported='yes'>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:         <value>rom</value>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:         <value>pflash</value>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:       <enum name='readonly'>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:         <value>yes</value>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:       <enum name='secure'>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:     </loader>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:   </os>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:   <cpu>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:     <mode name='host-passthrough' supported='no'/>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:     <mode name='maximum' supported='yes'>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:       <enum name='maximumMigratable'>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:         <value>on</value>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:         <value>off</value>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:     <mode name='host-model' supported='no'/>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:     <mode name='custom' supported='no'/>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:   <memoryBacking supported='yes'>
May 21 01:52:52.152162 np0000001127 nova-compute[98206]:     <enum name='sourceType'>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:       <value>file</value>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:       <value>anonymous</value>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:       <value>memfd</value>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:   </memoryBacking>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:   <devices>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:     <disk supported='yes'>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:       <enum name='diskDevice'>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:         <value>disk</value>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:         <value>cdrom</value>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:         <value>floppy</value>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:         <value>lun</value>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:         <value>fdc</value>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:         <value>sata</value>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:     </disk>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:     <graphics supported='yes'>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:         <value>sdl</value>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:         <value>vnc</value>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:         <value>spice</value>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:         <value>egl-headless</value>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:         <value>dbus</value>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:     <video supported='yes'>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:       <enum name='modelType'>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:         <value>vga</value>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:         <value>cirrus</value>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:         <value>none</value>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:         <value>bochs</value>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:         <value>ramfb</value>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:     </video>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:     <hostdev supported='yes'>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:       <enum name='mode'>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:         <value>subsystem</value>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:       <enum name='startupPolicy'>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:         <value>default</value>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:         <value>mandatory</value>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:         <value>requisite</value>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:         <value>optional</value>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:       <enum name='subsysType'>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:         <value>pci</value>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:       <enum name='capsType'/>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:       <enum name='pciBackend'/>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:     </hostdev>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:     <rng supported='yes'>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:         <value>random</value>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:         <value>egd</value>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:     </rng>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:     <filesystem supported='yes'>
May 21 01:52:52.153823 np0000001127 nova-compute[98206]:       <enum name='driverType'>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:         <value>path</value>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:         <value>handle</value>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:         <value>virtiofs</value>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:     </filesystem>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:     <tpm supported='yes'>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:         <value>tpm-tis</value>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:         <value>passthrough</value>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:         <value>emulator</value>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:         <value>external</value>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:       <enum name='backendVersion'>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:         <value>1.2</value>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:         <value>2.0</value>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:     </tpm>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:     <redirdev supported='yes'>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:     </redirdev>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:     <channel supported='yes'>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:         <value>pty</value>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:         <value>unix</value>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:         <value>spicevmc</value>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:     </channel>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:     <crypto supported='yes'>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:         <value>qemu</value>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:     </crypto>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:   </devices>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:   <features>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:     <gic supported='no'/>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:     <vmcoreinfo supported='yes'/>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:     <genid supported='no'/>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:     <backingStoreInput supported='yes'/>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:     <backup supported='yes'/>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:     <async-teardown supported='yes'/>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:     <sev supported='no'/>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:     <sgx supported='no'/>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:   </features>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]: </domainCapabilities>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 21 01:52:52.155914 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=98206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 21 01:52:52.155914 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Libvirt host hypervisor capabilities for arch=riscv64 and machine_type=None:
May 21 01:52:52.155914 np0000001127 nova-compute[98206]: <domainCapabilities>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:   <path>/usr/bin/qemu-system-riscv64</path>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:   <domain>qemu</domain>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:   <machine>virt</machine>
May 21 01:52:52.155914 np0000001127 nova-compute[98206]:   <arch>riscv64</arch>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:   <vcpu max='512'/>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:   <iothreads supported='yes'/>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:   <os supported='yes'>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:     <enum name='firmware'/>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:     <loader supported='yes'>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:         <value>rom</value>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:         <value>pflash</value>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:       <enum name='readonly'>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:         <value>yes</value>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:       <enum name='secure'>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:     </loader>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:   </os>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:   <cpu>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:     <mode name='host-passthrough' supported='no'/>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:     <mode name='maximum' supported='yes'>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:       <enum name='maximumMigratable'>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:         <value>on</value>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:         <value>off</value>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:     <mode name='host-model' supported='no'/>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:     <mode name='custom' supported='yes'>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>rv64</model>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>sifive-e51</model>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>any</model>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>x-rv128</model>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>shakti-c</model>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>max</model>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>thead-c906</model>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>sifive-u54</model>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:       <model usable='unknown' vendor='unknown'>veyron-v1</model>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:   <memoryBacking supported='yes'>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:     <enum name='sourceType'>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:       <value>file</value>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:       <value>anonymous</value>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:       <value>memfd</value>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:   </memoryBacking>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:   <devices>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:     <disk supported='yes'>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:       <enum name='diskDevice'>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:         <value>disk</value>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:         <value>cdrom</value>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:         <value>floppy</value>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:         <value>lun</value>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:         <value>fdc</value>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:         <value>sata</value>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.157658 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:     </disk>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:     <graphics supported='yes'>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:         <value>sdl</value>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:         <value>vnc</value>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:         <value>spice</value>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:         <value>egl-headless</value>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:         <value>dbus</value>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:     <video supported='yes'>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:       <enum name='modelType'>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:         <value>vga</value>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:         <value>cirrus</value>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:         <value>none</value>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:         <value>bochs</value>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:         <value>ramfb</value>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:     </video>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:     <hostdev supported='yes'>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:       <enum name='mode'>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:         <value>subsystem</value>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:       <enum name='startupPolicy'>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:         <value>default</value>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:         <value>mandatory</value>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:         <value>requisite</value>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:         <value>optional</value>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:       <enum name='subsysType'>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:         <value>pci</value>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:       <enum name='capsType'/>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:       <enum name='pciBackend'/>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:     </hostdev>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:     <rng supported='yes'>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:         <value>random</value>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:         <value>egd</value>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:     </rng>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:     <filesystem supported='yes'>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:       <enum name='driverType'>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:         <value>path</value>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:         <value>handle</value>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:         <value>virtiofs</value>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:     </filesystem>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:     <tpm supported='yes'>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:         <value>tpm-tis</value>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:         <value>passthrough</value>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:         <value>emulator</value>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:         <value>external</value>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:       <enum name='backendVersion'>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:         <value>1.2</value>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:         <value>2.0</value>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:     </tpm>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:     <redirdev supported='yes'>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.159534 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:     </redirdev>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:     <channel supported='yes'>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:         <value>pty</value>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:         <value>unix</value>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:         <value>spicevmc</value>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:     </channel>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:     <crypto supported='yes'>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:         <value>qemu</value>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:     </crypto>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:   </devices>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:   <features>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:     <gic supported='no'/>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:     <vmcoreinfo supported='yes'/>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:     <genid supported='no'/>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:     <backingStoreInput supported='yes'/>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:     <backup supported='yes'/>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:     <async-teardown supported='yes'/>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:     <sev supported='no'/>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:     <sgx supported='no'/>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:   </features>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]: </domainCapabilities>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 21 01:52:52.161731 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=98206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 21 01:52:52.161731 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Libvirt host hypervisor capabilities for arch=s390x and machine_type=s390-ccw-virtio:
May 21 01:52:52.161731 np0000001127 nova-compute[98206]: <domainCapabilities>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:   <path>/usr/bin/qemu-system-s390x</path>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:   <domain>qemu</domain>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:   <machine>s390-ccw-virtio-noble</machine>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:   <arch>s390x</arch>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:   <vcpu max='248'/>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:   <iothreads supported='yes'/>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:   <os supported='yes'>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:     <enum name='firmware'/>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:     <loader supported='yes'>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:         <value>rom</value>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:         <value>pflash</value>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:       <enum name='readonly'>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:         <value>yes</value>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:       <enum name='secure'>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:     </loader>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:   </os>
May 21 01:52:52.161731 np0000001127 nova-compute[98206]:   <cpu>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:     <mode name='host-passthrough' supported='no'/>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:     <mode name='maximum' supported='yes'>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:       <enum name='maximumMigratable'>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:         <value>on</value>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:         <value>off</value>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:     <mode name='host-model' supported='no'/>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:     <mode name='custom' supported='yes'>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z13</model>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z990.3</model>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z13-base</model>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z990.2</model>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z196.2-base</model>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z14</model>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z14.2-base</model>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z990.4</model>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z196</model>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z10BC.2-base</model>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z114-base</model>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>gen16b</model>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z890.3-base</model>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>gen16a</model>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z990.5</model>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z196.2</model>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>zEC12</model>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>zEC12.2</model>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z9EC.2</model>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z9BC</model>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z9EC.3-base</model>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='IBM'>z800-base</model>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z14ZR1-base</model>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z890</model>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z990.4-base</model>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z9EC.3</model>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z13.2</model>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z10BC.2</model>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>gen15a-base</model>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z14.2</model>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>zBC12-base</model>
May 21 01:52:52.163451 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>gen16a-base</model>
May 21 01:52:52.164712 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='IBM'>z900.3</model>
May 21 01:52:52.164712 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z196-base</model>
May 21 01:52:52.164712 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z990</model>
May 21 01:52:52.164712 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z14-base</model>
May 21 01:52:52.164712 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='IBM'>z900.2</model>
May 21 01:52:52.164712 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='IBM'>z800</model>
May 21 01:52:52.164712 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z10EC</model>
May 21 01:52:52.164712 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z14ZR1</model>
May 21 01:52:52.164712 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='IBM'>z900</model>
May 21 01:52:52.164712 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z10EC.2</model>
May 21 01:52:52.164712 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z10EC.2-base</model>
May 21 01:52:52.164712 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='IBM'>z900.2-base</model>
May 21 01:52:52.164712 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='IBM'>z900-base</model>
May 21 01:52:52.164712 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z10EC.3</model>
May 21 01:52:52.164712 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z990.5-base</model>
May 21 01:52:52.164712 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>max</model>
May 21 01:52:52.164712 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>gen15b</model>
May 21 01:52:52.164712 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z9BC.2-base</model>
May 21 01:52:52.164712 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>gen15a</model>
May 21 01:52:52.164712 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z990.2-base</model>
May 21 01:52:52.164712 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z10EC-base</model>
May 21 01:52:52.164712 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>gen16b-base</model>
May 21 01:52:52.164712 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z114</model>
May 21 01:52:52.164712 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z9EC-base</model>
May 21 01:52:52.164712 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z13s</model>
May 21 01:52:52.164712 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>qemu</model>
May 21 01:52:52.164712 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>gen15b-base</model>
May 21 01:52:52.164712 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>zEC12-base</model>
May 21 01:52:52.164712 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z890.3</model>
May 21 01:52:52.164712 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z10EC.3-base</model>
May 21 01:52:52.164712 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z890.2-base</model>
May 21 01:52:52.164712 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z890.2</model>
May 21 01:52:52.164712 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z10BC-base</model>
May 21 01:52:52.164712 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>zEC12.2-base</model>
May 21 01:52:52.164712 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z890-base</model>
May 21 01:52:52.164712 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z9BC-base</model>
May 21 01:52:52.164712 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z10BC</model>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z9EC</model>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z9EC.2-base</model>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z13.2-base</model>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='IBM'>z900.3-base</model>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z990.3-base</model>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z13s-base</model>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>zBC12</model>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z990-base</model>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:       <model usable='no' vendor='IBM'>z9BC.2</model>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:   <memoryBacking supported='yes'>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:     <enum name='sourceType'>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:       <value>file</value>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:       <value>anonymous</value>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:       <value>memfd</value>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:   </memoryBacking>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:   <devices>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:     <disk supported='yes'>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:       <enum name='diskDevice'>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:         <value>disk</value>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:         <value>cdrom</value>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:         <value>floppy</value>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:         <value>lun</value>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:         <value>fdc</value>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:     </disk>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:     <graphics supported='yes'>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:         <value>sdl</value>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:         <value>vnc</value>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:         <value>spice</value>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:         <value>egl-headless</value>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:         <value>dbus</value>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:     <video supported='yes'>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:       <enum name='modelType'>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:         <value>none</value>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:     </video>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:     <hostdev supported='yes'>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:       <enum name='mode'>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:         <value>subsystem</value>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:       <enum name='startupPolicy'>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:         <value>default</value>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:         <value>mandatory</value>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:         <value>requisite</value>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:         <value>optional</value>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:       <enum name='subsysType'>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:         <value>pci</value>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.165888 np0000001127 nova-compute[98206]:       <enum name='capsType'/>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:       <enum name='pciBackend'/>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:     </hostdev>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:     <rng supported='yes'>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:         <value>random</value>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:         <value>egd</value>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:     </rng>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:     <filesystem supported='yes'>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:       <enum name='driverType'>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:         <value>path</value>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:         <value>handle</value>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:         <value>virtiofs</value>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:     </filesystem>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:     <tpm supported='no'/>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:     <redirdev supported='yes'>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:     </redirdev>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:     <channel supported='yes'>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:         <value>pty</value>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:         <value>unix</value>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:         <value>spicevmc</value>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:     </channel>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:     <crypto supported='yes'>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:         <value>qemu</value>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:     </crypto>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:   </devices>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:   <features>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:     <gic supported='no'/>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:     <vmcoreinfo supported='no'/>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:     <genid supported='no'/>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:     <backingStoreInput supported='yes'/>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:     <backup supported='yes'/>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:     <async-teardown supported='yes'/>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:     <s390-pv supported='no'/>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:     <sev supported='no'/>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:     <sgx supported='no'/>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:   </features>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]: </domainCapabilities>
May 21 01:52:52.168672 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 21 01:52:52.168672 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=98206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 21 01:52:52.168672 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Libvirt host hypervisor capabilities for arch=sh4 and machine_type=None:
May 21 01:52:52.170367 np0000001127 nova-compute[98206]: <domainCapabilities>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:   <path>/usr/bin/qemu-system-sh4</path>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:   <domain>qemu</domain>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:   <machine>shix</machine>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:   <arch>sh4</arch>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:   <vcpu max='1'/>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:   <iothreads supported='yes'/>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:   <os supported='yes'>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:     <enum name='firmware'/>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:     <loader supported='yes'>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:         <value>rom</value>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:         <value>pflash</value>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:       <enum name='readonly'>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:         <value>yes</value>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:       <enum name='secure'>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:     </loader>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:   </os>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:   <cpu>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:     <mode name='host-passthrough' supported='no'/>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:     <mode name='maximum' supported='no'/>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:     <mode name='host-model' supported='no'/>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:     <mode name='custom' supported='no'/>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:   <memoryBacking supported='yes'>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:     <enum name='sourceType'>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:       <value>file</value>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:       <value>anonymous</value>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:       <value>memfd</value>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:   </memoryBacking>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:   <devices>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:     <disk supported='yes'>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:       <enum name='diskDevice'>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:         <value>disk</value>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:         <value>cdrom</value>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:         <value>floppy</value>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:         <value>lun</value>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:         <value>fdc</value>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:         <value>sata</value>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:     </disk>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:     <graphics supported='yes'>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:         <value>sdl</value>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:         <value>vnc</value>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:         <value>spice</value>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:         <value>egl-headless</value>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:         <value>dbus</value>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:     <video supported='yes'>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:       <enum name='modelType'>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:         <value>vga</value>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:         <value>cirrus</value>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:         <value>none</value>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:         <value>bochs</value>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.170367 np0000001127 nova-compute[98206]:     </video>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:     <hostdev supported='yes'>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:       <enum name='mode'>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:         <value>subsystem</value>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:       <enum name='startupPolicy'>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:         <value>default</value>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:         <value>mandatory</value>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:         <value>requisite</value>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:         <value>optional</value>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:       <enum name='subsysType'>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:         <value>pci</value>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:       <enum name='capsType'/>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:       <enum name='pciBackend'/>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:     </hostdev>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:     <rng supported='yes'>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:         <value>random</value>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:         <value>egd</value>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:     </rng>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:     <filesystem supported='yes'>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:       <enum name='driverType'>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:         <value>path</value>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:         <value>handle</value>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:         <value>virtiofs</value>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:     </filesystem>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:     <tpm supported='no'/>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:     <redirdev supported='yes'>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:     </redirdev>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:     <channel supported='yes'>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:         <value>pty</value>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:         <value>unix</value>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:         <value>spicevmc</value>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:     </channel>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:     <crypto supported='yes'>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:         <value>qemu</value>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:     </crypto>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:   </devices>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:   <features>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:     <gic supported='no'/>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:     <vmcoreinfo supported='no'/>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:     <genid supported='no'/>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:     <backingStoreInput supported='yes'/>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:     <backup supported='yes'/>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:     <async-teardown supported='yes'/>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:     <sev supported='no'/>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:     <sgx supported='no'/>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:   </features>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]: </domainCapabilities>
May 21 01:52:52.172484 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 21 01:52:52.174506 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=98206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 21 01:52:52.174506 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Libvirt host hypervisor capabilities for arch=sh4eb and machine_type=None:
May 21 01:52:52.174506 np0000001127 nova-compute[98206]: <domainCapabilities>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:   <path>/usr/bin/qemu-system-sh4eb</path>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:   <domain>qemu</domain>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:   <machine>shix</machine>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:   <arch>sh4eb</arch>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:   <vcpu max='1'/>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:   <iothreads supported='yes'/>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:   <os supported='yes'>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:     <enum name='firmware'/>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:     <loader supported='yes'>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:         <value>rom</value>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:         <value>pflash</value>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:       <enum name='readonly'>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:         <value>yes</value>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:       <enum name='secure'>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:     </loader>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:   </os>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:   <cpu>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:     <mode name='host-passthrough' supported='no'/>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:     <mode name='maximum' supported='no'/>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:     <mode name='host-model' supported='no'/>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:     <mode name='custom' supported='no'/>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:   <memoryBacking supported='yes'>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:     <enum name='sourceType'>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:       <value>file</value>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:       <value>anonymous</value>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:       <value>memfd</value>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:   </memoryBacking>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:   <devices>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:     <disk supported='yes'>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:       <enum name='diskDevice'>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:         <value>disk</value>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:         <value>cdrom</value>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:         <value>floppy</value>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:         <value>lun</value>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:         <value>fdc</value>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:         <value>sata</value>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.174506 np0000001127 nova-compute[98206]:     </disk>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:     <graphics supported='yes'>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:         <value>sdl</value>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:         <value>vnc</value>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:         <value>spice</value>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:         <value>egl-headless</value>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:         <value>dbus</value>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:     <video supported='yes'>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:       <enum name='modelType'>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:         <value>vga</value>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:         <value>cirrus</value>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:         <value>none</value>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:         <value>bochs</value>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:     </video>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:     <hostdev supported='yes'>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:       <enum name='mode'>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:         <value>subsystem</value>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:       <enum name='startupPolicy'>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:         <value>default</value>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:         <value>mandatory</value>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:         <value>requisite</value>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:         <value>optional</value>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:       <enum name='subsysType'>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:         <value>pci</value>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:       <enum name='capsType'/>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:       <enum name='pciBackend'/>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:     </hostdev>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:     <rng supported='yes'>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:         <value>random</value>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:         <value>egd</value>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:     </rng>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:     <filesystem supported='yes'>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:       <enum name='driverType'>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:         <value>path</value>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:         <value>handle</value>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:         <value>virtiofs</value>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:     </filesystem>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:     <tpm supported='no'/>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:     <redirdev supported='yes'>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:     </redirdev>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:     <channel supported='yes'>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:         <value>pty</value>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:         <value>unix</value>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:         <value>spicevmc</value>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:     </channel>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:     <crypto supported='yes'>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:         <value>qemu</value>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:     </crypto>
May 21 01:52:52.176182 np0000001127 nova-compute[98206]:   </devices>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:   <features>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:     <gic supported='no'/>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:     <vmcoreinfo supported='no'/>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:     <genid supported='no'/>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:     <backingStoreInput supported='yes'/>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:     <backup supported='yes'/>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:     <async-teardown supported='yes'/>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:     <sev supported='no'/>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:     <sgx supported='no'/>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:   </features>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]: </domainCapabilities>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 21 01:52:52.178422 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=98206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 21 01:52:52.178422 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Libvirt host hypervisor capabilities for arch=sparc and machine_type=None:
May 21 01:52:52.178422 np0000001127 nova-compute[98206]: <domainCapabilities>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:   <path>/usr/bin/qemu-system-sparc</path>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:   <domain>qemu</domain>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:   <machine>SS-5</machine>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:   <arch>sparc</arch>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:   <vcpu max='1'/>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:   <iothreads supported='yes'/>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:   <os supported='yes'>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:     <enum name='firmware'/>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:     <loader supported='yes'>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:         <value>rom</value>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:         <value>pflash</value>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:       <enum name='readonly'>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:         <value>yes</value>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:       <enum name='secure'>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:     </loader>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:   </os>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:   <cpu>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:     <mode name='host-passthrough' supported='no'/>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:     <mode name='maximum' supported='no'/>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:     <mode name='host-model' supported='no'/>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:     <mode name='custom' supported='no'/>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:   <memoryBacking supported='yes'>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:     <enum name='sourceType'>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:       <value>file</value>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:       <value>anonymous</value>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:       <value>memfd</value>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:   </memoryBacking>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:   <devices>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:     <disk supported='yes'>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:       <enum name='diskDevice'>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:         <value>disk</value>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:         <value>cdrom</value>
May 21 01:52:52.178422 np0000001127 nova-compute[98206]:         <value>floppy</value>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:         <value>lun</value>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:         <value>fdc</value>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:     </disk>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:     <graphics supported='yes'>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:         <value>sdl</value>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:         <value>vnc</value>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:         <value>spice</value>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:         <value>egl-headless</value>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:         <value>dbus</value>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:     <video supported='yes'>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:       <enum name='modelType'>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:         <value>none</value>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:     </video>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:     <hostdev supported='yes'>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:       <enum name='mode'>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:         <value>subsystem</value>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:       <enum name='startupPolicy'>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:         <value>default</value>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:         <value>mandatory</value>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:         <value>requisite</value>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:         <value>optional</value>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:       <enum name='subsysType'>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:         <value>pci</value>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:       <enum name='capsType'/>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:       <enum name='pciBackend'/>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:     </hostdev>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:     <rng supported='yes'>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:       <enum name='model'/>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:         <value>random</value>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:         <value>egd</value>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:     </rng>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:     <filesystem supported='yes'>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:       <enum name='driverType'>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:         <value>path</value>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:         <value>handle</value>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:     </filesystem>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:     <tpm supported='no'/>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:     <redirdev supported='no'/>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:     <channel supported='yes'>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:         <value>pty</value>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:         <value>unix</value>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:         <value>spicevmc</value>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:     </channel>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:     <crypto supported='yes'>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:       <enum name='model'/>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:         <value>qemu</value>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:     </crypto>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:   </devices>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:   <features>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:     <gic supported='no'/>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:     <vmcoreinfo supported='no'/>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:     <genid supported='no'/>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:     <backingStoreInput supported='yes'/>
May 21 01:52:52.180038 np0000001127 nova-compute[98206]:     <backup supported='yes'/>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:     <async-teardown supported='yes'/>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:     <sev supported='no'/>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:     <sgx supported='no'/>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:   </features>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]: </domainCapabilities>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 21 01:52:52.182219 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=98206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 21 01:52:52.182219 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Libvirt host hypervisor capabilities for arch=sparc64 and machine_type=None:
May 21 01:52:52.182219 np0000001127 nova-compute[98206]: <domainCapabilities>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:   <path>/usr/bin/qemu-system-sparc64</path>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:   <domain>qemu</domain>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:   <machine>sun4u</machine>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:   <arch>sparc64</arch>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:   <vcpu max='1'/>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:   <iothreads supported='yes'/>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:   <os supported='yes'>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:     <enum name='firmware'/>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:     <loader supported='yes'>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:         <value>rom</value>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:         <value>pflash</value>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:       <enum name='readonly'>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:         <value>yes</value>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:       <enum name='secure'>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:     </loader>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:   </os>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:   <cpu>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:     <mode name='host-passthrough' supported='no'/>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:     <mode name='maximum' supported='no'/>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:     <mode name='host-model' supported='no'/>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:     <mode name='custom' supported='no'/>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:   <memoryBacking supported='yes'>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:     <enum name='sourceType'>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:       <value>file</value>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:       <value>anonymous</value>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:       <value>memfd</value>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:   </memoryBacking>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:   <devices>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:     <disk supported='yes'>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:       <enum name='diskDevice'>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:         <value>disk</value>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:         <value>cdrom</value>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:         <value>floppy</value>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:         <value>lun</value>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:         <value>ide</value>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:         <value>fdc</value>
May 21 01:52:52.182219 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:         <value>sata</value>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:     </disk>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:     <graphics supported='yes'>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:         <value>sdl</value>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:         <value>vnc</value>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:         <value>spice</value>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:         <value>egl-headless</value>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:         <value>dbus</value>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:     <video supported='yes'>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:       <enum name='modelType'>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:         <value>vga</value>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:         <value>cirrus</value>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:         <value>none</value>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:         <value>bochs</value>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:     </video>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:     <hostdev supported='yes'>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:       <enum name='mode'>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:         <value>subsystem</value>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:       <enum name='startupPolicy'>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:         <value>default</value>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:         <value>mandatory</value>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:         <value>requisite</value>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:         <value>optional</value>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:       <enum name='subsysType'>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:         <value>pci</value>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:       <enum name='capsType'/>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:       <enum name='pciBackend'/>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:     </hostdev>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:     <rng supported='yes'>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:         <value>random</value>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:         <value>egd</value>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:     </rng>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:     <filesystem supported='yes'>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:       <enum name='driverType'>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:         <value>path</value>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:         <value>handle</value>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:         <value>virtiofs</value>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:     </filesystem>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:     <tpm supported='no'/>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:     <redirdev supported='yes'>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:     </redirdev>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:     <channel supported='yes'>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:         <value>pty</value>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:         <value>unix</value>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:         <value>spicevmc</value>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.183899 np0000001127 nova-compute[98206]:     </channel>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:     <crypto supported='yes'>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:         <value>qemu</value>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:     </crypto>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:   </devices>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:   <features>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:     <gic supported='no'/>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:     <vmcoreinfo supported='no'/>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:     <genid supported='no'/>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:     <backingStoreInput supported='yes'/>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:     <backup supported='yes'/>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:     <async-teardown supported='yes'/>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:     <sev supported='no'/>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:     <sgx supported='no'/>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:   </features>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]: </domainCapabilities>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 21 01:52:52.186133 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu-q35', 'q35', 'ubuntu'} {{(pid=98206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 21 01:52:52.186133 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
May 21 01:52:52.186133 np0000001127 nova-compute[98206]: <domainCapabilities>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:   <path>/usr/bin/qemu-system-x86_64</path>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:   <domain>qemu</domain>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:   <machine>pc-i440fx-noble</machine>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:   <arch>x86_64</arch>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:   <vcpu max='255'/>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:   <iothreads supported='yes'/>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:   <os supported='yes'>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:     <enum name='firmware'>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:       <value>efi</value>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:     <loader supported='yes'>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:         <value>rom</value>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:         <value>pflash</value>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:       <enum name='readonly'>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:         <value>yes</value>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:       <enum name='secure'>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:     </loader>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:   </os>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:   <cpu>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:     <mode name='host-passthrough' supported='no'/>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:     <mode name='maximum' supported='yes'>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:       <enum name='maximumMigratable'>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:         <value>on</value>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:         <value>off</value>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.186133 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:     <mode name='host-model' supported='yes'>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:       <model fallback='forbid'>EPYC</model>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:       <vendor>AMD</vendor>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:       <feature policy='require' name='acpi'/>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:       <feature policy='require' name='ss'/>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:       <feature policy='require' name='monitor'/>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:       <feature policy='require' name='hypervisor'/>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:       <feature policy='require' name='erms'/>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:       <feature policy='require' name='mpx'/>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:       <feature policy='require' name='pcommit'/>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:       <feature policy='require' name='clwb'/>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:       <feature policy='require' name='umip'/>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:       <feature policy='require' name='pku'/>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:       <feature policy='require' name='vaes'/>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:       <feature policy='require' name='la57'/>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:       <feature policy='require' name='rdpid'/>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:       <feature policy='require' name='pks'/>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:       <feature policy='require' name='fsrm'/>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:       <feature policy='require' name='fzrm'/>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:       <feature policy='require' name='fsrs'/>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:       <feature policy='require' name='fsrc'/>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:       <feature policy='require' name='3dnowext'/>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:       <feature policy='require' name='3dnow'/>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:       <feature policy='require' name='xsaveerptr'/>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:       <feature policy='require' name='wbnoinvd'/>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:       <feature policy='require' name='npt'/>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:       <feature policy='require' name='vgif'/>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:       <feature policy='require' name='svme-addr-chk'/>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:       <feature policy='disable' name='vme'/>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:       <feature policy='disable' name='xsavec'/>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:       <feature policy='disable' name='fxsr_opt'/>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:       <feature policy='disable' name='misalignsse'/>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:       <feature policy='disable' name='osvw'/>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:       <feature policy='disable' name='topoext'/>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:       <feature policy='disable' name='nrip-save'/>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:     <mode name='custom' supported='yes'>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>phenom</model>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 21 01:52:52.187775 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>pentium</model>
May 21 01:52:52.189046 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='Intel'>n270</model>
May 21 01:52:52.189046 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 21 01:52:52.189046 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 21 01:52:52.189046 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 21 01:52:52.189046 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 21 01:52:52.189046 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='AMD'>athlon</model>
May 21 01:52:52.189046 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 21 01:52:52.189046 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 21 01:52:52.189046 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 21 01:52:52.189046 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 21 01:52:52.189046 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 21 01:52:52.189046 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 21 01:52:52.189046 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 21 01:52:52.189046 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 21 01:52:52.189046 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 21 01:52:52.189046 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 21 01:52:52.189046 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 21 01:52:52.189046 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 21 01:52:52.189046 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 21 01:52:52.189046 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 21 01:52:52.189046 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 21 01:52:52.189046 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 21 01:52:52.189046 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 21 01:52:52.189046 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 21 01:52:52.189046 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 21 01:52:52.189046 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 21 01:52:52.189046 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 21 01:52:52.189046 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 21 01:52:52.189046 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 21 01:52:52.189046 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 21 01:52:52.189046 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 21 01:52:52.189046 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 21 01:52:52.189046 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Haswell</model>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>EPYC</model>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>486</model>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:   <memoryBacking supported='yes'>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:     <enum name='sourceType'>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:       <value>file</value>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:       <value>anonymous</value>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:       <value>memfd</value>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:   </memoryBacking>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:   <devices>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:     <disk supported='yes'>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:       <enum name='diskDevice'>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:         <value>disk</value>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:         <value>cdrom</value>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:         <value>floppy</value>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:         <value>lun</value>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:         <value>ide</value>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:         <value>fdc</value>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:         <value>sata</value>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:     </disk>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:     <graphics supported='yes'>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:         <value>sdl</value>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:         <value>vnc</value>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:         <value>spice</value>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:         <value>egl-headless</value>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:         <value>dbus</value>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:     <video supported='yes'>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:       <enum name='modelType'>
May 21 01:52:52.190029 np0000001127 nova-compute[98206]:         <value>vga</value>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:         <value>cirrus</value>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:         <value>vmvga</value>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:         <value>qxl</value>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:         <value>none</value>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:         <value>bochs</value>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:         <value>ramfb</value>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:     </video>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:     <hostdev supported='yes'>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:       <enum name='mode'>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:         <value>subsystem</value>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:       <enum name='startupPolicy'>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:         <value>default</value>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:         <value>mandatory</value>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:         <value>requisite</value>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:         <value>optional</value>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:       <enum name='subsysType'>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:         <value>pci</value>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:       <enum name='capsType'/>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:       <enum name='pciBackend'/>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:     </hostdev>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:     <rng supported='yes'>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:         <value>random</value>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:         <value>egd</value>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:     </rng>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:     <filesystem supported='yes'>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:       <enum name='driverType'>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:         <value>path</value>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:         <value>handle</value>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:         <value>virtiofs</value>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:     </filesystem>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:     <tpm supported='yes'>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:         <value>tpm-tis</value>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:         <value>tpm-crb</value>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:         <value>passthrough</value>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:         <value>emulator</value>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:         <value>external</value>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:       <enum name='backendVersion'>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:         <value>1.2</value>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:         <value>2.0</value>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:     </tpm>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:     <redirdev supported='yes'>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:     </redirdev>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:     <channel supported='yes'>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:         <value>pty</value>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:         <value>unix</value>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:         <value>spicevmc</value>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:     </channel>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:     <crypto supported='yes'>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.191661 np0000001127 nova-compute[98206]:         <value>qemu</value>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:     </crypto>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:   </devices>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:   <features>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:     <gic supported='no'/>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:     <vmcoreinfo supported='yes'/>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:     <genid supported='yes'/>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:     <backingStoreInput supported='yes'/>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:     <backup supported='yes'/>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:     <async-teardown supported='yes'/>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:     <sev supported='no'/>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:     <sgx supported='no'/>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:     <hyperv supported='yes'>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:       <enum name='features'>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:         <value>relaxed</value>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:         <value>vapic</value>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:         <value>spinlocks</value>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:         <value>vpindex</value>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:         <value>runtime</value>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:         <value>synic</value>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:         <value>stimer</value>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:         <value>reset</value>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:         <value>vendor_id</value>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:         <value>frequencies</value>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:         <value>reenlightenment</value>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:         <value>tlbflush</value>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:         <value>ipi</value>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:         <value>avic</value>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:     </hyperv>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:   </features>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]: </domainCapabilities>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 21 01:52:52.193825 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
May 21 01:52:52.193825 np0000001127 nova-compute[98206]: <domainCapabilities>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:   <path>/usr/bin/qemu-system-x86_64</path>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:   <domain>qemu</domain>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:   <machine>pc-q35-noble-v2</machine>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:   <arch>x86_64</arch>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:   <vcpu max='1024'/>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:   <iothreads supported='yes'/>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:   <os supported='yes'>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:     <enum name='firmware'>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:       <value>efi</value>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:     <loader supported='yes'>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:       <value>/usr/share/ovmf/OVMF.amdsev.fd</value>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:         <value>rom</value>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:         <value>pflash</value>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:       <enum name='readonly'>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:         <value>yes</value>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:       <enum name='secure'>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:         <value>yes</value>
May 21 01:52:52.193825 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:     </loader>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:   </os>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:   <cpu>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:     <mode name='host-passthrough' supported='no'/>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:     <mode name='maximum' supported='yes'>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:       <enum name='maximumMigratable'>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:         <value>on</value>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:         <value>off</value>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:     <mode name='host-model' supported='yes'>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:       <model fallback='forbid'>EPYC</model>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:       <vendor>AMD</vendor>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:       <feature policy='require' name='acpi'/>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:       <feature policy='require' name='ss'/>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:       <feature policy='require' name='monitor'/>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:       <feature policy='require' name='hypervisor'/>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:       <feature policy='require' name='erms'/>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:       <feature policy='require' name='mpx'/>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:       <feature policy='require' name='pcommit'/>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:       <feature policy='require' name='clwb'/>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:       <feature policy='require' name='umip'/>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:       <feature policy='require' name='pku'/>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:       <feature policy='require' name='vaes'/>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:       <feature policy='require' name='la57'/>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:       <feature policy='require' name='rdpid'/>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:       <feature policy='require' name='pks'/>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:       <feature policy='require' name='fsrm'/>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:       <feature policy='require' name='fzrm'/>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:       <feature policy='require' name='fsrs'/>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:       <feature policy='require' name='fsrc'/>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:       <feature policy='require' name='3dnowext'/>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:       <feature policy='require' name='3dnow'/>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:       <feature policy='require' name='xsaveerptr'/>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:       <feature policy='require' name='wbnoinvd'/>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:       <feature policy='require' name='npt'/>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:       <feature policy='require' name='vgif'/>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:       <feature policy='require' name='svme-addr-chk'/>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:       <feature policy='disable' name='vme'/>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:       <feature policy='disable' name='xsavec'/>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:       <feature policy='disable' name='fxsr_opt'/>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:       <feature policy='disable' name='misalignsse'/>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:       <feature policy='disable' name='osvw'/>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:       <feature policy='disable' name='topoext'/>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:       <feature policy='disable' name='nrip-save'/>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:     <mode name='custom' supported='yes'>
May 21 01:52:52.195616 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 21 01:52:52.196996 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 21 01:52:52.196996 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>phenom</model>
May 21 01:52:52.196996 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 21 01:52:52.196996 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 21 01:52:52.196996 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>pentium</model>
May 21 01:52:52.196996 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='Intel'>n270</model>
May 21 01:52:52.196996 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 21 01:52:52.196996 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 21 01:52:52.196996 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 21 01:52:52.196996 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 21 01:52:52.196996 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='AMD'>athlon</model>
May 21 01:52:52.196996 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 21 01:52:52.196996 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 21 01:52:52.196996 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 21 01:52:52.196996 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 21 01:52:52.196996 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 21 01:52:52.196996 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 21 01:52:52.196996 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 21 01:52:52.196996 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 21 01:52:52.196996 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 21 01:52:52.196996 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 21 01:52:52.196996 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 21 01:52:52.196996 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 21 01:52:52.196996 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 21 01:52:52.196996 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 21 01:52:52.196996 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 21 01:52:52.196996 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 21 01:52:52.196996 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 21 01:52:52.196996 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 21 01:52:52.196996 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 21 01:52:52.196996 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 21 01:52:52.196996 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 21 01:52:52.196996 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 21 01:52:52.196996 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Haswell</model>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>EPYC</model>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>486</model>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:   <memoryBacking supported='yes'>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:     <enum name='sourceType'>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:       <value>file</value>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:       <value>anonymous</value>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:       <value>memfd</value>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:   </memoryBacking>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:   <devices>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:     <disk supported='yes'>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:       <enum name='diskDevice'>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:         <value>disk</value>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:         <value>cdrom</value>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:         <value>floppy</value>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:         <value>lun</value>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:         <value>fdc</value>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:         <value>sata</value>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:     </disk>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:     <graphics supported='yes'>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.197947 np0000001127 nova-compute[98206]:         <value>sdl</value>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:         <value>vnc</value>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:         <value>spice</value>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:         <value>egl-headless</value>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:         <value>dbus</value>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:     <video supported='yes'>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:       <enum name='modelType'>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:         <value>vga</value>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:         <value>cirrus</value>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:         <value>vmvga</value>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:         <value>qxl</value>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:         <value>none</value>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:         <value>bochs</value>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:         <value>ramfb</value>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:     </video>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:     <hostdev supported='yes'>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:       <enum name='mode'>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:         <value>subsystem</value>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:       <enum name='startupPolicy'>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:         <value>default</value>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:         <value>mandatory</value>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:         <value>requisite</value>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:         <value>optional</value>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:       <enum name='subsysType'>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:         <value>pci</value>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:       <enum name='capsType'/>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:       <enum name='pciBackend'/>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:     </hostdev>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:     <rng supported='yes'>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:         <value>random</value>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:         <value>egd</value>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:     </rng>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:     <filesystem supported='yes'>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:       <enum name='driverType'>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:         <value>path</value>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:         <value>handle</value>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:         <value>virtiofs</value>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:     </filesystem>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:     <tpm supported='yes'>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:         <value>tpm-tis</value>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:         <value>tpm-crb</value>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:         <value>passthrough</value>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:         <value>emulator</value>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:         <value>external</value>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:       <enum name='backendVersion'>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:         <value>1.2</value>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:         <value>2.0</value>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:     </tpm>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:     <redirdev supported='yes'>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:     </redirdev>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:     <channel supported='yes'>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.199461 np0000001127 nova-compute[98206]:         <value>pty</value>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:         <value>unix</value>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:         <value>spicevmc</value>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:     </channel>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:     <crypto supported='yes'>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:         <value>qemu</value>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:     </crypto>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:   </devices>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:   <features>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:     <gic supported='no'/>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:     <vmcoreinfo supported='yes'/>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:     <genid supported='yes'/>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:     <backingStoreInput supported='yes'/>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:     <backup supported='yes'/>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:     <async-teardown supported='yes'/>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:     <sev supported='no'/>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:     <sgx supported='no'/>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:     <hyperv supported='yes'>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:       <enum name='features'>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:         <value>relaxed</value>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:         <value>vapic</value>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:         <value>spinlocks</value>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:         <value>vpindex</value>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:         <value>runtime</value>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:         <value>synic</value>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:         <value>stimer</value>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:         <value>reset</value>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:         <value>vendor_id</value>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:         <value>frequencies</value>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:         <value>reenlightenment</value>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:         <value>tlbflush</value>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:         <value>ipi</value>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:         <value>avic</value>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:     </hyperv>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:   </features>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]: </domainCapabilities>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 21 01:52:52.201554 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
May 21 01:52:52.201554 np0000001127 nova-compute[98206]: <domainCapabilities>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:   <path>/usr/bin/qemu-system-x86_64</path>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:   <domain>qemu</domain>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:   <machine>pc-q35-noble</machine>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:   <arch>x86_64</arch>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:   <vcpu max='1024'/>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:   <iothreads supported='yes'/>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:   <os supported='yes'>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:     <enum name='firmware'>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:       <value>efi</value>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:     <loader supported='yes'>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:       <value>/usr/share/ovmf/OVMF.amdsev.fd</value>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 21 01:52:52.201554 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:         <value>rom</value>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:         <value>pflash</value>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:       <enum name='readonly'>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:         <value>yes</value>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:       <enum name='secure'>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:         <value>yes</value>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:     </loader>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:   </os>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:   <cpu>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:     <mode name='host-passthrough' supported='no'/>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:     <mode name='maximum' supported='yes'>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:       <enum name='maximumMigratable'>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:         <value>on</value>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:         <value>off</value>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:     <mode name='host-model' supported='yes'>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:       <model fallback='forbid'>EPYC</model>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:       <vendor>AMD</vendor>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:       <feature policy='require' name='acpi'/>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:       <feature policy='require' name='ss'/>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:       <feature policy='require' name='monitor'/>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:       <feature policy='require' name='hypervisor'/>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:       <feature policy='require' name='erms'/>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:       <feature policy='require' name='mpx'/>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:       <feature policy='require' name='pcommit'/>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:       <feature policy='require' name='clwb'/>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:       <feature policy='require' name='umip'/>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:       <feature policy='require' name='pku'/>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:       <feature policy='require' name='vaes'/>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:       <feature policy='require' name='la57'/>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:       <feature policy='require' name='rdpid'/>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:       <feature policy='require' name='pks'/>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:       <feature policy='require' name='fsrm'/>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:       <feature policy='require' name='fzrm'/>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:       <feature policy='require' name='fsrs'/>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:       <feature policy='require' name='fsrc'/>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:       <feature policy='require' name='3dnowext'/>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:       <feature policy='require' name='3dnow'/>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:       <feature policy='require' name='xsaveerptr'/>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:       <feature policy='require' name='wbnoinvd'/>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:       <feature policy='require' name='npt'/>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:       <feature policy='require' name='vgif'/>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:       <feature policy='require' name='svme-addr-chk'/>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:       <feature policy='disable' name='vme'/>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:       <feature policy='disable' name='xsavec'/>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:       <feature policy='disable' name='fxsr_opt'/>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:       <feature policy='disable' name='misalignsse'/>
May 21 01:52:52.203350 np0000001127 nova-compute[98206]:       <feature policy='disable' name='osvw'/>
May 21 01:52:52.204824 np0000001127 nova-compute[98206]:       <feature policy='disable' name='topoext'/>
May 21 01:52:52.204824 np0000001127 nova-compute[98206]:       <feature policy='disable' name='nrip-save'/>
May 21 01:52:52.204824 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:52.204824 np0000001127 nova-compute[98206]:     <mode name='custom' supported='yes'>
May 21 01:52:52.204824 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 21 01:52:52.204824 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 21 01:52:52.204824 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>phenom</model>
May 21 01:52:52.204824 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 21 01:52:52.204824 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 21 01:52:52.204824 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>pentium</model>
May 21 01:52:52.204824 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='Intel'>n270</model>
May 21 01:52:52.204824 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 21 01:52:52.204824 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 21 01:52:52.204824 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 21 01:52:52.204824 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 21 01:52:52.204824 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='AMD'>athlon</model>
May 21 01:52:52.204824 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 21 01:52:52.204824 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 21 01:52:52.204824 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 21 01:52:52.204824 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 21 01:52:52.204824 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 21 01:52:52.204824 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 21 01:52:52.204824 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 21 01:52:52.204824 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 21 01:52:52.204824 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 21 01:52:52.204824 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 21 01:52:52.204824 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 21 01:52:52.204824 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 21 01:52:52.204824 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 21 01:52:52.204824 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 21 01:52:52.204824 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 21 01:52:52.204824 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 21 01:52:52.204824 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 21 01:52:52.204824 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 21 01:52:52.204824 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Haswell</model>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>EPYC</model>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>486</model>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:   <memoryBacking supported='yes'>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:     <enum name='sourceType'>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:       <value>file</value>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:       <value>anonymous</value>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:       <value>memfd</value>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:   </memoryBacking>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:   <devices>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:     <disk supported='yes'>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:       <enum name='diskDevice'>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:         <value>disk</value>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:         <value>cdrom</value>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:         <value>floppy</value>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:         <value>lun</value>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:         <value>fdc</value>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:         <value>sata</value>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.205855 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:     </disk>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:     <graphics supported='yes'>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:         <value>sdl</value>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:         <value>vnc</value>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:         <value>spice</value>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:         <value>egl-headless</value>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:         <value>dbus</value>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:     <video supported='yes'>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:       <enum name='modelType'>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:         <value>vga</value>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:         <value>cirrus</value>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:         <value>vmvga</value>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:         <value>qxl</value>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:         <value>none</value>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:         <value>bochs</value>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:         <value>ramfb</value>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:     </video>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:     <hostdev supported='yes'>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:       <enum name='mode'>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:         <value>subsystem</value>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:       <enum name='startupPolicy'>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:         <value>default</value>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:         <value>mandatory</value>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:         <value>requisite</value>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:         <value>optional</value>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:       <enum name='subsysType'>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:         <value>pci</value>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:       <enum name='capsType'/>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:       <enum name='pciBackend'/>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:     </hostdev>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:     <rng supported='yes'>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:         <value>random</value>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:         <value>egd</value>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:     </rng>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:     <filesystem supported='yes'>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:       <enum name='driverType'>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:         <value>path</value>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:         <value>handle</value>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:         <value>virtiofs</value>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:     </filesystem>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:     <tpm supported='yes'>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:         <value>tpm-tis</value>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:         <value>tpm-crb</value>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:         <value>passthrough</value>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:         <value>emulator</value>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:         <value>external</value>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:       <enum name='backendVersion'>
May 21 01:52:52.207142 np0000001127 nova-compute[98206]:         <value>1.2</value>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:         <value>2.0</value>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:     </tpm>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:     <redirdev supported='yes'>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:     </redirdev>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:     <channel supported='yes'>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:         <value>pty</value>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:         <value>unix</value>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:         <value>spicevmc</value>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:     </channel>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:     <crypto supported='yes'>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:         <value>qemu</value>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:     </crypto>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:   </devices>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:   <features>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:     <gic supported='no'/>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:     <vmcoreinfo supported='yes'/>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:     <genid supported='yes'/>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:     <backingStoreInput supported='yes'/>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:     <backup supported='yes'/>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:     <async-teardown supported='yes'/>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:     <sev supported='no'/>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:     <sgx supported='no'/>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:     <hyperv supported='yes'>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:       <enum name='features'>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:         <value>relaxed</value>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:         <value>vapic</value>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:         <value>spinlocks</value>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:         <value>vpindex</value>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:         <value>runtime</value>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:         <value>synic</value>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:         <value>stimer</value>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:         <value>reset</value>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:         <value>vendor_id</value>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:         <value>frequencies</value>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:         <value>reenlightenment</value>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:         <value>tlbflush</value>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:         <value>ipi</value>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:         <value>avic</value>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:     </hyperv>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:   </features>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]: </domainCapabilities>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 21 01:52:52.209203 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
May 21 01:52:52.209203 np0000001127 nova-compute[98206]: <domainCapabilities>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:   <path>/usr/bin/qemu-system-x86_64</path>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:   <domain>qemu</domain>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:   <machine>pc-i440fx-noble-v2</machine>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:   <arch>x86_64</arch>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:   <vcpu max='255'/>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:   <iothreads supported='yes'/>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:   <os supported='yes'>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:     <enum name='firmware'>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:       <value>efi</value>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:52.209203 np0000001127 nova-compute[98206]:     <loader supported='yes'>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:         <value>rom</value>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:         <value>pflash</value>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:       <enum name='readonly'>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:         <value>yes</value>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:       <enum name='secure'>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:     </loader>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:   </os>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:   <cpu>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:     <mode name='host-passthrough' supported='no'/>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:     <mode name='maximum' supported='yes'>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:       <enum name='maximumMigratable'>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:         <value>on</value>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:         <value>off</value>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:     <mode name='host-model' supported='yes'>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:       <model fallback='forbid'>EPYC</model>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:       <vendor>AMD</vendor>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:       <feature policy='require' name='acpi'/>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:       <feature policy='require' name='ss'/>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:       <feature policy='require' name='monitor'/>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:       <feature policy='require' name='hypervisor'/>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:       <feature policy='require' name='erms'/>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:       <feature policy='require' name='mpx'/>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:       <feature policy='require' name='pcommit'/>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:       <feature policy='require' name='clwb'/>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:       <feature policy='require' name='umip'/>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:       <feature policy='require' name='pku'/>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:       <feature policy='require' name='vaes'/>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:       <feature policy='require' name='la57'/>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:       <feature policy='require' name='rdpid'/>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:       <feature policy='require' name='pks'/>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:       <feature policy='require' name='fsrm'/>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:       <feature policy='require' name='fzrm'/>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:       <feature policy='require' name='fsrs'/>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:       <feature policy='require' name='fsrc'/>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:       <feature policy='require' name='3dnowext'/>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:       <feature policy='require' name='3dnow'/>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:       <feature policy='require' name='xsaveerptr'/>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:       <feature policy='require' name='wbnoinvd'/>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:       <feature policy='require' name='npt'/>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:       <feature policy='require' name='vgif'/>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:       <feature policy='require' name='svme-addr-chk'/>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:       <feature policy='disable' name='vme'/>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:       <feature policy='disable' name='xsavec'/>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:       <feature policy='disable' name='fxsr_opt'/>
May 21 01:52:52.211128 np0000001127 nova-compute[98206]:       <feature policy='disable' name='misalignsse'/>
May 21 01:52:52.212615 np0000001127 nova-compute[98206]:       <feature policy='disable' name='osvw'/>
May 21 01:52:52.212615 np0000001127 nova-compute[98206]:       <feature policy='disable' name='topoext'/>
May 21 01:52:52.212615 np0000001127 nova-compute[98206]:       <feature policy='disable' name='nrip-save'/>
May 21 01:52:52.212615 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:52.212615 np0000001127 nova-compute[98206]:     <mode name='custom' supported='yes'>
May 21 01:52:52.212615 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 21 01:52:52.212615 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 21 01:52:52.212615 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>phenom</model>
May 21 01:52:52.212615 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 21 01:52:52.212615 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 21 01:52:52.212615 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>pentium</model>
May 21 01:52:52.212615 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='Intel'>n270</model>
May 21 01:52:52.212615 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 21 01:52:52.212615 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 21 01:52:52.212615 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 21 01:52:52.212615 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 21 01:52:52.212615 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='AMD'>athlon</model>
May 21 01:52:52.212615 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 21 01:52:52.212615 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 21 01:52:52.212615 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 21 01:52:52.212615 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 21 01:52:52.212615 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 21 01:52:52.212615 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 21 01:52:52.212615 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 21 01:52:52.212615 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 21 01:52:52.212615 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 21 01:52:52.212615 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 21 01:52:52.212615 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 21 01:52:52.212615 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 21 01:52:52.212615 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 21 01:52:52.212615 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 21 01:52:52.212615 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 21 01:52:52.212615 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 21 01:52:52.212615 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 21 01:52:52.212615 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Haswell</model>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:       <model usable='no' vendor='AMD'>EPYC</model>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:       <model usable='yes' vendor='unknown'>486</model>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:     </mode>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:   <memoryBacking supported='yes'>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:     <enum name='sourceType'>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:       <value>file</value>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:       <value>anonymous</value>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:       <value>memfd</value>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:   </memoryBacking>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:   <devices>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:     <disk supported='yes'>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:       <enum name='diskDevice'>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:         <value>disk</value>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:         <value>cdrom</value>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:         <value>floppy</value>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:         <value>lun</value>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:         <value>ide</value>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:         <value>fdc</value>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.213648 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:         <value>sata</value>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:     </disk>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:     <graphics supported='yes'>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:         <value>sdl</value>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:         <value>vnc</value>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:         <value>spice</value>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:         <value>egl-headless</value>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:         <value>dbus</value>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:     <video supported='yes'>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:       <enum name='modelType'>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:         <value>vga</value>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:         <value>cirrus</value>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:         <value>vmvga</value>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:         <value>qxl</value>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:         <value>none</value>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:         <value>bochs</value>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:         <value>ramfb</value>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:     </video>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:     <hostdev supported='yes'>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:       <enum name='mode'>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:         <value>subsystem</value>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:       <enum name='startupPolicy'>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:         <value>default</value>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:         <value>mandatory</value>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:         <value>requisite</value>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:         <value>optional</value>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:       <enum name='subsysType'>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:         <value>pci</value>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:       <enum name='capsType'/>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:       <enum name='pciBackend'/>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:     </hostdev>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:     <rng supported='yes'>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:         <value>random</value>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:         <value>egd</value>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:     </rng>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:     <filesystem supported='yes'>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:       <enum name='driverType'>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:         <value>path</value>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:         <value>handle</value>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:         <value>virtiofs</value>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:     </filesystem>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:     <tpm supported='yes'>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:         <value>tpm-tis</value>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:         <value>tpm-crb</value>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:         <value>passthrough</value>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:         <value>emulator</value>
May 21 01:52:52.214918 np0000001127 nova-compute[98206]:         <value>external</value>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:       <enum name='backendVersion'>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:         <value>1.2</value>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:         <value>2.0</value>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:     </tpm>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:     <redirdev supported='yes'>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:     </redirdev>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:     <channel supported='yes'>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:         <value>pty</value>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:         <value>unix</value>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:         <value>spicevmc</value>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:     </channel>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:     <crypto supported='yes'>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:         <value>qemu</value>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:     </crypto>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:   </devices>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:   <features>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:     <gic supported='no'/>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:     <vmcoreinfo supported='yes'/>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:     <genid supported='yes'/>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:     <backingStoreInput supported='yes'/>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:     <backup supported='yes'/>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:     <async-teardown supported='yes'/>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:     <sev supported='no'/>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:     <sgx supported='no'/>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:     <hyperv supported='yes'>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:       <enum name='features'>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:         <value>relaxed</value>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:         <value>vapic</value>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:         <value>spinlocks</value>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:         <value>vpindex</value>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:         <value>runtime</value>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:         <value>synic</value>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:         <value>stimer</value>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:         <value>reset</value>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:         <value>vendor_id</value>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:         <value>frequencies</value>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:         <value>reenlightenment</value>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:         <value>tlbflush</value>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:         <value>ipi</value>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:         <value>avic</value>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:     </hyperv>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:   </features>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]: </domainCapabilities>
May 21 01:52:52.217058 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 21 01:52:52.217058 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=98206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 21 01:52:52.218807 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Libvirt host hypervisor capabilities for arch=xtensa and machine_type=None:
May 21 01:52:52.218807 np0000001127 nova-compute[98206]: <domainCapabilities>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:   <path>/usr/bin/qemu-system-xtensa</path>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:   <domain>qemu</domain>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:   <machine>sim</machine>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:   <arch>xtensa</arch>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:   <vcpu max='4'/>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:   <iothreads supported='yes'/>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:   <os supported='yes'>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:     <enum name='firmware'/>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:     <loader supported='yes'>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:         <value>rom</value>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:         <value>pflash</value>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:       <enum name='readonly'>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:         <value>yes</value>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:       <enum name='secure'>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:     </loader>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:   </os>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:   <cpu>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:     <mode name='host-passthrough' supported='no'/>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:     <mode name='maximum' supported='no'/>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:     <mode name='host-model' supported='no'/>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:     <mode name='custom' supported='no'/>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:   <memoryBacking supported='yes'>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:     <enum name='sourceType'>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:       <value>file</value>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:       <value>anonymous</value>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:       <value>memfd</value>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:   </memoryBacking>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:   <devices>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:     <disk supported='yes'>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:       <enum name='diskDevice'>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:         <value>disk</value>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:         <value>cdrom</value>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:         <value>floppy</value>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:         <value>lun</value>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:         <value>fdc</value>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:         <value>sata</value>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:     </disk>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:     <graphics supported='yes'>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:         <value>sdl</value>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:         <value>vnc</value>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:         <value>spice</value>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:         <value>egl-headless</value>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:         <value>dbus</value>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:     <video supported='yes'>
May 21 01:52:52.218807 np0000001127 nova-compute[98206]:       <enum name='modelType'>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:         <value>vga</value>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:         <value>cirrus</value>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:         <value>none</value>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:         <value>bochs</value>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:     </video>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:     <hostdev supported='yes'>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:       <enum name='mode'>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:         <value>subsystem</value>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:       <enum name='startupPolicy'>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:         <value>default</value>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:         <value>mandatory</value>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:         <value>requisite</value>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:         <value>optional</value>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:       <enum name='subsysType'>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:         <value>pci</value>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:       <enum name='capsType'/>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:       <enum name='pciBackend'/>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:     </hostdev>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:     <rng supported='yes'>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:         <value>random</value>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:         <value>egd</value>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:     </rng>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:     <filesystem supported='yes'>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:       <enum name='driverType'>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:         <value>path</value>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:         <value>handle</value>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:         <value>virtiofs</value>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:     </filesystem>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:     <tpm supported='no'/>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:     <redirdev supported='yes'>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:     </redirdev>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:     <channel supported='yes'>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:         <value>pty</value>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:         <value>unix</value>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:         <value>spicevmc</value>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:     </channel>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:     <crypto supported='yes'>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:         <value>qemu</value>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:     </crypto>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:   </devices>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:   <features>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:     <gic supported='no'/>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:     <vmcoreinfo supported='no'/>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:     <genid supported='no'/>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:     <backingStoreInput supported='yes'/>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:     <backup supported='yes'/>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:     <async-teardown supported='yes'/>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:     <sev supported='no'/>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:     <sgx supported='no'/>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]:   </features>
May 21 01:52:52.220765 np0000001127 nova-compute[98206]: </domainCapabilities>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 21 01:52:52.222924 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=98206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 21 01:52:52.222924 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Libvirt host hypervisor capabilities for arch=xtensaeb and machine_type=None:
May 21 01:52:52.222924 np0000001127 nova-compute[98206]: <domainCapabilities>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:   <path>/usr/bin/qemu-system-xtensaeb</path>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:   <domain>qemu</domain>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:   <machine>sim</machine>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:   <arch>xtensaeb</arch>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:   <vcpu max='4'/>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:   <iothreads supported='yes'/>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:   <os supported='yes'>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:     <enum name='firmware'/>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:     <loader supported='yes'>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:         <value>rom</value>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:         <value>pflash</value>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:       <enum name='readonly'>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:         <value>yes</value>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:       <enum name='secure'>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:         <value>no</value>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:     </loader>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:   </os>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:   <cpu>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:     <mode name='host-passthrough' supported='no'/>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:     <mode name='maximum' supported='no'/>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:     <mode name='host-model' supported='no'/>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:     <mode name='custom' supported='no'/>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:   <memoryBacking supported='yes'>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:     <enum name='sourceType'>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:       <value>file</value>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:       <value>anonymous</value>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:       <value>memfd</value>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:     </enum>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:   </memoryBacking>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:   <devices>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:     <disk supported='yes'>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:       <enum name='diskDevice'>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:         <value>disk</value>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:         <value>cdrom</value>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:         <value>floppy</value>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:         <value>lun</value>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:         <value>fdc</value>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:         <value>sata</value>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.222924 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:     </disk>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:     <graphics supported='yes'>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:         <value>sdl</value>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:         <value>vnc</value>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:         <value>spice</value>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:         <value>egl-headless</value>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:         <value>dbus</value>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:     <video supported='yes'>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:       <enum name='modelType'>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:         <value>vga</value>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:         <value>cirrus</value>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:         <value>none</value>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:         <value>bochs</value>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:     </video>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:     <hostdev supported='yes'>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:       <enum name='mode'>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:         <value>subsystem</value>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:       <enum name='startupPolicy'>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:         <value>default</value>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:         <value>mandatory</value>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:         <value>requisite</value>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:         <value>optional</value>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:       <enum name='subsysType'>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:         <value>pci</value>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:         <value>scsi</value>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:       <enum name='capsType'/>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:       <enum name='pciBackend'/>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:     </hostdev>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:     <rng supported='yes'>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:         <value>virtio-transitional</value>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:         <value>virtio-non-transitional</value>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:         <value>random</value>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:         <value>egd</value>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:     </rng>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:     <filesystem supported='yes'>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:       <enum name='driverType'>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:         <value>path</value>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:         <value>handle</value>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:         <value>virtiofs</value>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:     </filesystem>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:     <tpm supported='no'/>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:     <redirdev supported='yes'>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:       <enum name='bus'>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:         <value>usb</value>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:     </redirdev>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:     <channel supported='yes'>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:         <value>pty</value>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:         <value>unix</value>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:         <value>spicevmc</value>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:     </channel>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:     <crypto supported='yes'>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:       <enum name='model'>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:         <value>virtio</value>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:       <enum name='type'>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:         <value>qemu</value>
May 21 01:52:52.224287 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.225601 np0000001127 nova-compute[98206]:       <enum name='backendModel'>
May 21 01:52:52.225601 np0000001127 nova-compute[98206]:         <value>builtin</value>
May 21 01:52:52.225601 np0000001127 nova-compute[98206]:       </enum>
May 21 01:52:52.225601 np0000001127 nova-compute[98206]:     </crypto>
May 21 01:52:52.225601 np0000001127 nova-compute[98206]:   </devices>
May 21 01:52:52.225601 np0000001127 nova-compute[98206]:   <features>
May 21 01:52:52.225601 np0000001127 nova-compute[98206]:     <gic supported='no'/>
May 21 01:52:52.225601 np0000001127 nova-compute[98206]:     <vmcoreinfo supported='no'/>
May 21 01:52:52.225601 np0000001127 nova-compute[98206]:     <genid supported='no'/>
May 21 01:52:52.225601 np0000001127 nova-compute[98206]:     <backingStoreInput supported='yes'/>
May 21 01:52:52.225601 np0000001127 nova-compute[98206]:     <backup supported='yes'/>
May 21 01:52:52.225601 np0000001127 nova-compute[98206]:     <async-teardown supported='yes'/>
May 21 01:52:52.225601 np0000001127 nova-compute[98206]:     <sev supported='no'/>
May 21 01:52:52.225601 np0000001127 nova-compute[98206]:     <sgx supported='no'/>
May 21 01:52:52.225601 np0000001127 nova-compute[98206]:   </features>
May 21 01:52:52.225601 np0000001127 nova-compute[98206]: </domainCapabilities>
May 21 01:52:52.225601 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 21 01:52:52.225601 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Checking secure boot support for host arch (x86_64) {{(pid=98206) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1962}}
May 21 01:52:52.225601 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Checking secure boot support for host arch (x86_64) {{(pid=98206) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1962}}
May 21 01:52:52.225601 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Checking secure boot support for host arch (x86_64) {{(pid=98206) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1962}}
May 21 01:52:52.225601 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Secure Boot support detected
May 21 01:52:52.649717 np0000001127 nova-compute[98206]: INFO nova.virt.node [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Generated node identity a0b7bd56-5a70-4557-8cfd-9f933f412754
May 21 01:52:52.649880 np0000001127 nova-compute[98206]: INFO nova.virt.node [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Wrote node identity a0b7bd56-5a70-4557-8cfd-9f933f412754 to /opt/stack/data/nova/compute_id
May 21 01:52:53.154810 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Compute nodes ['a0b7bd56-5a70-4557-8cfd-9f933f412754'] for host np0000001127 were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
May 21 01:52:54.160397 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
May 21 01:52:55.165680 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] No compute node record found for host np0000001127. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000001127 could not be found.
May 21 01:52:55.165680 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:52:55.165680 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:52:55.166391 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:52:55.166391 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Auditing locally available compute resources for np0000001127 (node: np0000001127) {{(pid=98206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 21 01:52:55.236519 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 01:52:55.237278 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:52:55.253274 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] CMD "env LANG=C uptime" returned: 0 in 0.015s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:52:55.253749 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Hypervisor/Node resource view: name=np0000001127 free_ram=16812MB free_disk=75.26946258544922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 21 01:52:55.254007 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:52:55.254369 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:52:55.758003 np0000001127 nova-compute[98206]: WARNING nova.compute.resource_tracker [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] No compute node record for np0000001127:a0b7bd56-5a70-4557-8cfd-9f933f412754: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host a0b7bd56-5a70-4557-8cfd-9f933f412754 could not be found.
May 21 01:52:56.262446 np0000001127 nova-compute[98206]: INFO nova.compute.resource_tracker [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Compute node record created for np0000001127:np0000001127 with uuid: a0b7bd56-5a70-4557-8cfd-9f933f412754
May 21 01:52:57.769545 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 21 01:52:57.769545 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Final resource view: name=np0000001127 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:52:55 up 23 min,  2 users,  load average: 2.22, 1.58, 0.84\n'} {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 21 01:52:58.281436 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] [req-767ec47e-71d9-429f-871a-0ed0b48942f6] Created resource provider record via placement API for resource provider with UUID a0b7bd56-5a70-4557-8cfd-9f933f412754 and name np0000001127.
May 21 01:52:58.354842 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] /sys/module/kvm_amd/parameters/sev contains [N
May 21 01:52:58.354842 np0000001127 nova-compute[98206]: ] {{(pid=98206) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:2038}}
May 21 01:52:58.355089 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.host [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] kernel doesn't support AMD SEV
May 21 01:52:58.355314 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:52:58.355482 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Updating inventory in ProviderTree for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 with inventory: {'MEMORY_MB': {'total': 24030, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 21 01:52:58.355757 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 01:52:58.363603 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Libvirt baseline CPU <cpu>
May 21 01:52:58.363603 np0000001127 nova-compute[98206]:   <arch>x86_64</arch>
May 21 01:52:58.363603 np0000001127 nova-compute[98206]:   <model>Nehalem</model>
May 21 01:52:58.363603 np0000001127 nova-compute[98206]:   <vendor>AMD</vendor>
May 21 01:52:58.363603 np0000001127 nova-compute[98206]:   <topology sockets="12" cores="1" threads="1"/>
May 21 01:52:58.363603 np0000001127 nova-compute[98206]:   <maxphysaddr mode="emulate" bits="40"/>
May 21 01:52:58.363603 np0000001127 nova-compute[98206]: </cpu>
May 21 01:52:58.363603 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:13740}}
May 21 01:52:58.943831 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Updated inventory for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 24030, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:975}}
May 21 01:52:58.944350 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Updating resource provider a0b7bd56-5a70-4557-8cfd-9f933f412754 generation from 0 to 1 during operation: update_inventory {{(pid=98206) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
May 21 01:52:58.944350 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Updating inventory in ProviderTree for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 with inventory: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 21 01:52:59.114156 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Updating resource provider a0b7bd56-5a70-4557-8cfd-9f933f412754 generation from 1 to 2 during operation: update_traits {{(pid=98206) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
May 21 01:52:59.621233 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Compute_service record updated for np0000001127:np0000001127 {{(pid=98206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 21 01:52:59.621742 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 4.367s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:52:59.621742 np0000001127 nova-compute[98206]: DEBUG nova.service [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Creating RPC server for service: nova-compute on topic: compute {{(pid=98206) start /opt/stack/nova/nova/service.py:195}}
May 21 01:52:59.637753 np0000001127 nova-compute[98206]: DEBUG nova.service [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Creating 2nd RPC server for service: nova-compute on topic: compute-alt {{(pid=98206) start /opt/stack/nova/nova/service.py:211}}
May 21 01:52:59.654449 np0000001127 nova-compute[98206]: DEBUG nova.service [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] Join ServiceGroup membership for this service compute {{(pid=98206) start /opt/stack/nova/nova/service.py:221}}
May 21 01:52:59.654590 np0000001127 nova-compute[98206]: DEBUG nova.servicegroup.drivers.db [None req-902f514f-dbce-44d7-9667-4daf1b461dc0 None None] DB_Driver: join new ServiceGroup member np0000001127 to the compute group, service = <Service: host=np0000001127, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=98206) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
May 21 01:53:05.158284 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 01:53:57.656784 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:53:57.657506 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:53:57.657988 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:53:57.657988 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:53:57.658213 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:53:57.658574 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:53:57.658772 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:53:58.161933 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:53:58.161933 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 21 01:53:58.162328 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:53:58.666491 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:53:58.666491 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:53:58.666491 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:53:58.666491 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Auditing locally available compute resources for np0000001127 (node: np0000001127) {{(pid=98206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 21 01:53:58.674354 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 01:53:58.675201 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:53:58.690007 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "env LANG=C uptime" returned: 0 in 0.015s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:53:58.690540 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Hypervisor/Node resource view: name=np0000001127 free_ram=16580MB free_disk=75.1292953491211GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 21 01:53:58.690721 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:53:58.690980 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:53:59.759458 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 21 01:53:59.759981 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Final resource view: name=np0000001127 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:53:58 up 24 min,  2 users,  load average: 1.52, 1.50, 0.86\n'} {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 21 01:53:59.803538 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:53:59.803782 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:54:00.306940 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:54:00.816430 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Compute_service record updated for np0000001127:np0000001127 {{(pid=98206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 21 01:54:00.817125 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.126s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:54:00.817125 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:54:00.818149 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 40.89 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 01:54:41.711498 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:54:41.712442 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:54:41.712717 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:54:41.712938 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:54:41.713179 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:54:41.713379 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:54:41.713677 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:54:41.713976 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:54:41.713976 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 21 01:54:41.714184 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:54:42.217667 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:54:42.218598 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:54:42.218598 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:54:42.218598 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Auditing locally available compute resources for np0000001127 (node: np0000001127) {{(pid=98206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 21 01:54:42.228488 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 01:54:42.228488 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:54:42.241462 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "env LANG=C uptime" returned: 0 in 0.015s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:54:42.242445 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Hypervisor/Node resource view: name=np0000001127 free_ram=16700MB free_disk=74.9355583190918GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 21 01:54:42.242822 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:54:42.243143 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:54:43.291478 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 21 01:54:43.291820 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Final resource view: name=np0000001127 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:54:42 up 25 min,  2 users,  load average: 1.42, 1.48, 0.89\n'} {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 21 01:54:43.332981 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:54:43.333211 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:54:43.835699 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:54:44.341380 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Compute_service record updated for np0000001127:np0000001127 {{(pid=98206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 21 01:54:44.341851 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.098s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:54:44.341851 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 01:55:05.160687 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 01:55:36.181270 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "0059a43c-1d34-40a9-af63-b5eca8c30f53" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:55:36.181721 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "0059a43c-1d34-40a9-af63-b5eca8c30f53" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:55:36.683595 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 01:55:37.263797 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:55:37.264210 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:55:37.266870 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 01:55:37.267060 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Claim successful on node np0000001127
May 21 01:55:38.365009 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:55:38.365654 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:55:38.870491 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:55:39.379910 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.116s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:55:39.380495 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 01:55:39.887303 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 01:55:39.887407 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 01:55:39.888573 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:55:39.889665 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:55:40.391721 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 01:55:40.744591 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd91dda570ffb45489f81bd0c87e7fda6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e41dd931ff049868a61f52a251d1122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 01:55:40.895652 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 01:55:41.909973 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 01:55:41.911064 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 01:55:41.911291 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Creating image(s)
May 21 01:55:41.911837 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "/opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:55:41.911980 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "/opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:55:41.915676 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "/opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:55:41.916799 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:55:41.918622 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:55:42.329050 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Acquiring lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:55:42.329050 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:55:42.632138 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Successfully created port: 839e91da-5ffe-451b-bd9d-dfc1cf83ab19 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 01:55:42.831662 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 01:55:42.872250 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:55:42.875524 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:55:42.875931 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d.part --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:55:42.962714 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d.part --force-share --output=json" returned: 0 in 0.086s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:55:42.963432 np0000001127 nova-compute[98206]: DEBUG nova.virt.images [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] 1545019a-a9af-4414-b299-e8f325be0886 was qcow2, converting to raw {{(pid=98206) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 21 01:55:42.968494 np0000001127 nova-compute[98206]: DEBUG nova.privsep.utils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 21 01:55:42.969041 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d.part /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d.converted {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:55:43.323087 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d.part /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d.converted" returned: 0 in 0.354s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:55:43.330141 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d.converted --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:55:43.404798 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d.converted --force-share --output=json" returned: 0 in 0.075s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:55:43.405727 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.487s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:55:43.406147 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:55:43.409670 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:55:43.411486 np0000001127 nova-compute[98206]: INFO oslo.privsep.daemon [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmptxh17ev6/privsep.sock']
May 21 01:55:43.416208 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:55:43.416439 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:55:43.418727 np0000001127 sudo[109580]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmptxh17ev6/privsep.sock
May 21 01:55:43.419342 np0000001127 sudo[109580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 21 01:55:43.420012 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 01:55:43.420213 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Claim successful on node np0000001127
May 21 01:55:43.692487 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 21 01:55:43.692617 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 21 01:55:43.692664 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 21 01:55:43.692712 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: 
May 21 01:55:43.692750 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 21 01:55:43.692787 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 21 01:55:43.692938 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 21 01:55:43.692938 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: 
May 21 01:55:43.692938 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 21 01:55:43.848192 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Successfully updated port: 839e91da-5ffe-451b-bd9d-dfc1cf83ab19 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 01:55:44.059787 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 21 01:55:44.060641 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 21 01:55:44.060641 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 21 01:55:44.060641 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: 
May 21 01:55:44.060641 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 21 01:55:44.060641 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 21 01:55:44.060641 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 21 01:55:44.060641 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: 
May 21 01:55:44.060641 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 21 01:55:44.343882 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:55:44.344037 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:55:44.344355 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:55:44.344682 np0000001127 sudo[109580]: pam_unix(sudo:session): session closed for user root
May 21 01:55:44.346046 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:55:44.346046 np0000001127 nova-compute[98206]: INFO oslo.privsep.daemon [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Spawned new privsep daemon via rootwrap
May 21 01:55:44.346316 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:55:44.346575 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:55:44.347187 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:55:44.347816 np0000001127 nova-compute[98206]: INFO oslo.privsep.daemon [-] privsep daemon starting
May 21 01:55:44.347957 np0000001127 nova-compute[98206]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
May 21 01:55:44.348524 np0000001127 nova-compute[98206]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
May 21 01:55:44.348524 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 21 01:55:44.348524 np0000001127 nova-compute[98206]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 109589
May 21 01:55:44.348524 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:55:44.350146 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "refresh_cache-0059a43c-1d34-40a9-af63-b5eca8c30f53" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:55:44.350281 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquired lock "refresh_cache-0059a43c-1d34-40a9-af63-b5eca8c30f53" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:55:44.351491 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 01:55:44.424137 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:55:44.445755 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8c2b3ff9-be01-4a3b-8f53-0bdbe3c1f511 req-87999741-5559-4a92-8eed-937212e2a42e service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Received event network-changed-839e91da-5ffe-451b-bd9d-dfc1cf83ab19 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:55:44.447314 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8c2b3ff9-be01-4a3b-8f53-0bdbe3c1f511 req-87999741-5559-4a92-8eed-937212e2a42e service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Refreshing instance network info cache due to event network-changed-839e91da-5ffe-451b-bd9d-dfc1cf83ab19. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:55:44.449595 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8c2b3ff9-be01-4a3b-8f53-0bdbe3c1f511 req-87999741-5559-4a92-8eed-937212e2a42e service nova] Acquiring lock "refresh_cache-0059a43c-1d34-40a9-af63-b5eca8c30f53" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:55:44.500741 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.077s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:55:44.500933 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:55:44.501348 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:55:44.501781 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:55:44.506560 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:55:44.507222 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:55:44.574496 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.067s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:55:44.575571 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:55:44.619029 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53/disk 1073741824" returned: 0 in 0.043s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:55:44.620520 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.119s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:55:44.622449 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:55:44.638828 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:55:44.640054 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:55:44.695830 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.075s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:55:44.696226 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 01:55:44.696476 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:55:44.767761 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53/disk --force-share --output=json" returned: 0 in 0.071s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:55:44.768274 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Cannot resize image /opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 01:55:44.769150 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 01:55:44.769394 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Ensure instance console log exists: /opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 01:55:44.772532 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:55:44.772532 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:55:44.772532 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:55:44.828384 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Acquiring lock "0ff0511e-6af4-400b-ac42-5ebd3b37d2b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:55:44.828602 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Lock "0ff0511e-6af4-400b-ac42-5ebd3b37d2b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:55:44.856225 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:55:44.959338 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:55:45.130960 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Acquiring lock "ecf25bc4-b32d-4627-9571-f98869b227f9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:55:45.131432 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "ecf25bc4-b32d-4627-9571-f98869b227f9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:55:45.143677 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:55:45.170613 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Acquiring lock "98ace73f-7d4b-4aed-9355-a39c58f9b024" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:55:45.170905 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "98ace73f-7d4b-4aed-9355-a39c58f9b024" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:55:45.181177 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:55:45.332502 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Updating instance_info_cache with network_info: [{"id": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "address": "fa:16:3e:00:d8:d3", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap839e91da-5f", "ovs_interfaceid": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:55:45.333929 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 01:55:45.551130 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Acquiring lock "cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:55:45.551351 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Lock "cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:55:45.632996 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 01:55:45.650657 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.234s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:55:45.651145 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 01:55:45.653269 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.797s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:55:45.653496 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:55:45.653662 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Auditing locally available compute resources for np0000001127 (node: np0000001127) {{(pid=98206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 21 01:55:45.666087 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 01:55:45.666709 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:55:45.679986 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 01:55:45.694263 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "env LANG=C uptime" returned: 0 in 0.027s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:55:45.694527 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Hypervisor/Node resource view: name=np0000001127 free_ram=15535MB free_disk=74.8958625793457GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 21 01:55:45.695170 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:55:45.695170 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:55:45.837634 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Releasing lock "refresh_cache-0059a43c-1d34-40a9-af63-b5eca8c30f53" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:55:45.838314 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Instance network_info: |[{"id": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "address": "fa:16:3e:00:d8:d3", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap839e91da-5f", "ovs_interfaceid": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 01:55:45.838720 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8c2b3ff9-be01-4a3b-8f53-0bdbe3c1f511 req-87999741-5559-4a92-8eed-937212e2a42e service nova] Acquired lock "refresh_cache-0059a43c-1d34-40a9-af63-b5eca8c30f53" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:55:45.841054 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Start _get_guest_xml network_info=[{"id": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "address": "fa:16:3e:00:d8:d3", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap839e91da-5f", "ovs_interfaceid": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 01:55:45.841483 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-8c2b3ff9-be01-4a3b-8f53-0bdbe3c1f511 req-87999741-5559-4a92-8eed-937212e2a42e service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Refreshing network info cache for port 839e91da-5ffe-451b-bd9d-dfc1cf83ab19 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:55:45.843484 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 01:55:45.845802 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-1719541415', uuid='0059a43c-1d34-40a9-af63-b5eca8c30f53'), owner=OwnerMeta(userid='d91dda570ffb45489f81bd0c87e7fda6', username='tempest-AttachVolumeShelveTestJSON-826866539-project-member', projectid='2e41dd931ff049868a61f52a251d1122', projectname='tempest-AttachVolumeShelveTestJSON-826866539'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "address": "fa:16:3e:00:d8:d3", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap839e91da-5f", "ovs_interfaceid": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328545.844627) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 01:55:45.849491 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 01:55:45.852360 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 01:55:45.854465 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 01:55:45.854705 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 01:55:45.856098 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 01:55:45.856520 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 01:55:45.856658 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 01:55:45.856989 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 01:55:45.857145 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 01:55:45.857259 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 01:55:45.857375 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 01:55:45.857577 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 01:55:45.857698 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 01:55:45.858091 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 01:55:45.858221 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 01:55:45.858358 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 01:55:45.873927 np0000001127 nova-compute[98206]: DEBUG nova.privsep.utils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 21 01:55:45.875105 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T01:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1719541415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumeshelvetestjson-server-1719541415',id=1,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2zmFe4sQuXWXUjhz16/AauWIZ+ngdfS4R0mqQiLGq9SjV71VzozhRC8Z3F1F+0764niXRdGZVFgH+pUevCihuQEDmwwISw1j+rj6qnUSw4ecZaPwrSQfd2Xm4Jics0Vw==',key_name='tempest-keypair-1216999249',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e41dd931ff049868a61f52a251d1122',ramdisk_id='',reservation_id='r-2une16cp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-826866539',owner_user_name='tempest-AttachVolumeShelveTestJSON-826866539-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:55:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d91dda570ffb45489f81bd0c87e7fda6',uuid=0059a43c-1d34-40a9-af63-b5eca8c30f53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "address": "fa:16:3e:00:d8:d3", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap839e91da-5f", "ovs_interfaceid": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 01:55:45.875303 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Converting VIF {"id": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "address": "fa:16:3e:00:d8:d3", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap839e91da-5f", "ovs_interfaceid": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:55:45.876317 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:d8:d3,bridge_name='br-int',has_traffic_filtering=True,id=839e91da-5ffe-451b-bd9d-dfc1cf83ab19,network=Network(084a1218-5c9f-4f1e-855b-53d284a5202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839e91da-5f') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:55:45.877655 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lazy-loading 'pci_devices' on Instance uuid 0059a43c-1d34-40a9-af63-b5eca8c30f53 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:55:45.902152 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:55:46.054529 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 01:55:46.158941 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 01:55:46.159580 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 01:55:46.159631 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:55:46.159890 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:55:46.185870 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:55:46.250954 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0fd36d5cf62b4dc49bd53ebc09db2a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffcb955f57a438d998dbdf9bfee0868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 01:55:46.258245 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:55:46.343791 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-8c2b3ff9-be01-4a3b-8f53-0bdbe3c1f511 req-87999741-5559-4a92-8eed-937212e2a42e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:55:46.381110 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] End _get_guest_xml xml=<domain type="qemu">
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:   <uuid>0059a43c-1d34-40a9-af63-b5eca8c30f53</uuid>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:   <name>instance-00000001</name>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:   <metadata>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1719541415</nova:name>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 01:55:45</nova:creationTime>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:       </nova:image>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:         <nova:user uuid="d91dda570ffb45489f81bd0c87e7fda6">tempest-AttachVolumeShelveTestJSON-826866539-project-member</nova:user>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:         <nova:project uuid="2e41dd931ff049868a61f52a251d1122">tempest-AttachVolumeShelveTestJSON-826866539</nova:project>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:         <nova:port uuid="839e91da-5ffe-451b-bd9d-dfc1cf83ab19">
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:         </nova:port>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:   </metadata>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:     <system>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:       <entry name="serial">0059a43c-1d34-40a9-af63-b5eca8c30f53</entry>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:       <entry name="uuid">0059a43c-1d34-40a9-af63-b5eca8c30f53</entry>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:     </system>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:   <os>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:   </os>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:   <features>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:     <acpi/>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:     <tcg>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:     </tcg>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:   </features>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:   <devices>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53/disk"/>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:     </disk>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53/disk.config"/>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:     </disk>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:00:d8:d3"/>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:       <target dev="tap839e91da-5f"/>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:     </interface>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53/console.log" append="off"/>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:     </serial>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:     <video>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:     </video>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:     </rng>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:     </memballoon>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:   </devices>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]: </domain>
May 21 01:55:46.381110 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 01:55:46.384451 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Preparing to wait for external event network-vif-plugged-839e91da-5ffe-451b-bd9d-dfc1cf83ab19 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 01:55:46.384451 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "0059a43c-1d34-40a9-af63-b5eca8c30f53-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:55:46.384451 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "0059a43c-1d34-40a9-af63-b5eca8c30f53-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:55:46.384451 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "0059a43c-1d34-40a9-af63-b5eca8c30f53-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:55:46.384451 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T01:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1719541415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumeshelvetestjson-server-1719541415',id=1,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2zmFe4sQuXWXUjhz16/AauWIZ+ngdfS4R0mqQiLGq9SjV71VzozhRC8Z3F1F+0764niXRdGZVFgH+pUevCihuQEDmwwISw1j+rj6qnUSw4ecZaPwrSQfd2Xm4Jics0Vw==',key_name='tempest-keypair-1216999249',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e41dd931ff049868a61f52a251d1122',ramdisk_id='',reservation_id='r-2une16cp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-826866539',owner_user_name='tempest-AttachVolumeShelveTestJSON-826866539-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:55:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d91dda570ffb45489f81bd0c87e7fda6',uuid=0059a43c-1d34-40a9-af63-b5eca8c30f53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "address": "fa:16:3e:00:d8:d3", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap839e91da-5f", "ovs_interfaceid": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 01:55:46.385322 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Converting VIF {"id": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "address": "fa:16:3e:00:d8:d3", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap839e91da-5f", "ovs_interfaceid": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:55:46.385322 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:d8:d3,bridge_name='br-int',has_traffic_filtering=True,id=839e91da-5ffe-451b-bd9d-dfc1cf83ab19,network=Network(084a1218-5c9f-4f1e-855b-53d284a5202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839e91da-5f') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:55:46.385322 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:d8:d3,bridge_name='br-int',has_traffic_filtering=True,id=839e91da-5ffe-451b-bd9d-dfc1cf83ab19,network=Network(084a1218-5c9f-4f1e-855b-53d284a5202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839e91da-5f') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 01:55:46.425119 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Created schema index Interface.name {{(pid=98206) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 21 01:55:46.425287 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Created schema index Port.name {{(pid=98206) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 21 01:55:46.425425 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Created schema index Bridge.name {{(pid=98206) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 21 01:55:46.425794 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=98206) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 21 01:55:46.425983 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [POLLOUT] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:46.426109 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98206) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 21 01:55:46.426561 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:46.428722 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:46.447373 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:46.463959 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:46.464217 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:55:46.464507 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 01:55:46.465261 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:46.465426 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9a07c05c-9833-50a3-bc04-f1d8c5680230', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:55:46.466316 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:46.467158 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:55:46.468074 np0000001127 nova-compute[98206]: INFO oslo.privsep.daemon [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpgdin1kjr/privsep.sock']
May 21 01:55:46.477737 np0000001127 sudo[109680]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpgdin1kjr/privsep.sock
May 21 01:55:46.478357 np0000001127 sudo[109680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 21 01:55:46.649130 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:55:46.662566 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 01:55:46.766061 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 21 01:55:46.766143 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 21 01:55:46.766246 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 21 01:55:46.766321 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: 
May 21 01:55:46.766416 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 21 01:55:46.766514 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 21 01:55:46.766701 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 21 01:55:46.766701 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: 
May 21 01:55:46.766765 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 21 01:55:46.813339 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-8c2b3ff9-be01-4a3b-8f53-0bdbe3c1f511 req-87999741-5559-4a92-8eed-937212e2a42e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:55:47.007056 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Successfully created port: 67b86a71-40ec-405f-8d46-56744e34174f {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 01:55:47.015556 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-8c2b3ff9-be01-4a3b-8f53-0bdbe3c1f511 req-87999741-5559-4a92-8eed-937212e2a42e service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Updated VIF entry in instance network info cache for port 839e91da-5ffe-451b-bd9d-dfc1cf83ab19. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 01:55:47.015556 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-8c2b3ff9-be01-4a3b-8f53-0bdbe3c1f511 req-87999741-5559-4a92-8eed-937212e2a42e service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Updating instance_info_cache with network_info: [{"id": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "address": "fa:16:3e:00:d8:d3", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap839e91da-5f", "ovs_interfaceid": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:55:47.544426 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 21 01:55:47.544426 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 21 01:55:47.544426 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 21 01:55:47.544426 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: 
May 21 01:55:47.544426 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 21 01:55:47.544426 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 21 01:55:47.544426 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 21 01:55:47.544426 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: 
May 21 01:55:47.544426 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 21 01:55:47.544426 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 01:55:47.544426 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 21 01:55:47.544426 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 01:55:47.544426 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 0059a43c-1d34-40a9-af63-b5eca8c30f53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 01:55:47.544426 np0000001127 nova-compute[98206]: INFO oslo.privsep.daemon [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Spawned new privsep daemon via rootwrap
May 21 01:55:47.544426 np0000001127 nova-compute[98206]: INFO oslo.privsep.daemon [-] privsep daemon starting
May 21 01:55:47.544426 np0000001127 nova-compute[98206]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
May 21 01:55:47.544426 np0000001127 nova-compute[98206]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
May 21 01:55:47.544426 np0000001127 nova-compute[98206]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 109688
May 21 01:55:47.544426 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8c2b3ff9-be01-4a3b-8f53-0bdbe3c1f511 req-87999741-5559-4a92-8eed-937212e2a42e service nova] Releasing lock "refresh_cache-0059a43c-1d34-40a9-af63-b5eca8c30f53" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:55:47.393392 np0000001127 sudo[109680]: pam_unix(sudo:session): session closed for user root
May 21 01:55:47.650001 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:47.650001 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap839e91da-5f, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:55:47.650356 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap839e91da-5f, col_values=(('qos', UUID('ccbdadca-00d0-4b12-94e7-b65fc2323464')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:55:47.651048 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap839e91da-5f, col_values=(('external_ids', {'iface-id': '839e91da-5ffe-451b-bd9d-dfc1cf83ab19', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:d8:d3', 'vm-uuid': '0059a43c-1d34-40a9-af63-b5eca8c30f53'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:55:47.651914 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:47.653074 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:55:47.661744 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:47.663216 np0000001127 nova-compute[98206]: INFO os_vif [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:d8:d3,bridge_name='br-int',has_traffic_filtering=True,id=839e91da-5ffe-451b-bd9d-dfc1cf83ab19,network=Network(084a1218-5c9f-4f1e-855b-53d284a5202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839e91da-5f')
May 21 01:55:47.690508 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Successfully updated port: 67b86a71-40ec-405f-8d46-56744e34174f {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 01:55:47.788360 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 21 01:55:47.798078 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f0fed9c0-e374-47bc-8712-ebc7283dcfc8 req-7dae6ae4-167b-4625-92f1-e76b59319683 service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Received event network-changed-67b86a71-40ec-405f-8d46-56744e34174f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:55:47.798532 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f0fed9c0-e374-47bc-8712-ebc7283dcfc8 req-7dae6ae4-167b-4625-92f1-e76b59319683 service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Refreshing instance network info cache due to event network-changed-67b86a71-40ec-405f-8d46-56744e34174f. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:55:47.798909 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f0fed9c0-e374-47bc-8712-ebc7283dcfc8 req-7dae6ae4-167b-4625-92f1-e76b59319683 service nova] Acquiring lock "refresh_cache-6307081b-dd75-4ea3-aad6-d01f2b2b1c9b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:55:47.799005 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f0fed9c0-e374-47bc-8712-ebc7283dcfc8 req-7dae6ae4-167b-4625-92f1-e76b59319683 service nova] Acquired lock "refresh_cache-6307081b-dd75-4ea3-aad6-d01f2b2b1c9b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:55:47.799138 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-f0fed9c0-e374-47bc-8712-ebc7283dcfc8 req-7dae6ae4-167b-4625-92f1-e76b59319683 service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Refreshing network info cache for port 67b86a71-40ec-405f-8d46-56744e34174f {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:55:48.176934 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 01:55:48.179142 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 01:55:48.179787 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Creating image(s)
May 21 01:55:48.180567 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Acquiring lock "/opt/stack/data/nova/instances/6307081b-dd75-4ea3-aad6-d01f2b2b1c9b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:55:48.180748 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lock "/opt/stack/data/nova/instances/6307081b-dd75-4ea3-aad6-d01f2b2b1c9b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:55:48.181169 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lock "/opt/stack/data/nova/instances/6307081b-dd75-4ea3-aad6-d01f2b2b1c9b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:55:48.181856 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:55:48.184689 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:55:48.185649 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:55:48.196491 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Acquiring lock "refresh_cache-6307081b-dd75-4ea3-aad6-d01f2b2b1c9b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:55:48.255196 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.069s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:55:48.255894 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:55:48.257084 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:55:48.257994 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:55:48.262008 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:55:48.262811 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:55:48.293039 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 98ace73f-7d4b-4aed-9355-a39c58f9b024 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 21 01:55:48.302024 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-f0fed9c0-e374-47bc-8712-ebc7283dcfc8 req-7dae6ae4-167b-4625-92f1-e76b59319683 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:55:48.341826 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.079s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:55:48.342301 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/6307081b-dd75-4ea3-aad6-d01f2b2b1c9b/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:55:48.378571 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/6307081b-dd75-4ea3-aad6-d01f2b2b1c9b/disk 1073741824" returned: 0 in 0.036s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:55:48.379946 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.123s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:55:48.380399 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:55:48.443763 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-f0fed9c0-e374-47bc-8712-ebc7283dcfc8 req-7dae6ae4-167b-4625-92f1-e76b59319683 service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:55:48.457077 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.077s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:55:48.457719 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6307081b-dd75-4ea3-aad6-d01f2b2b1c9b/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 01:55:48.458003 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6307081b-dd75-4ea3-aad6-d01f2b2b1c9b/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:55:48.532668 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6307081b-dd75-4ea3-aad6-d01f2b2b1c9b/disk --force-share --output=json" returned: 0 in 0.074s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:55:48.533143 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Cannot resize image /opt/stack/data/nova/instances/6307081b-dd75-4ea3-aad6-d01f2b2b1c9b/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 01:55:48.533558 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 01:55:48.533785 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Ensure instance console log exists: /opt/stack/data/nova/instances/6307081b-dd75-4ea3-aad6-d01f2b2b1c9b/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 01:55:48.534083 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:55:48.534293 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:55:48.534437 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:55:48.695458 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-f0fed9c0-e374-47bc-8712-ebc7283dcfc8 req-7dae6ae4-167b-4625-92f1-e76b59319683 service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:55:48.796993 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance ecf25bc4-b32d-4627-9571-f98869b227f9 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 21 01:55:48.797232 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 21 01:55:48.797363 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Final resource view: name=np0000001127 phys_ram=24030MB used_ram=896MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:55:45 up 26 min,  2 users,  load average: 4.43, 2.27, 1.20\n', 'num_instances': '2', 'num_vm_building': '2', 'num_task_spawning': '1', 'num_os_type_None': '2', 'num_proj_2e41dd931ff049868a61f52a251d1122': '1', 'io_workload': '2', 'num_task_networking': '1', 'num_proj_1ffcb955f57a438d998dbdf9bfee0868': '1'} {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 21 01:55:49.156056 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:55:49.156504 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:55:49.187064 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:55:49.187166 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:55:49.187406 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] No VIF found with MAC fa:16:3e:00:d8:d3, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 01:55:49.187904 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Using config drive
May 21 01:55:49.198148 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f0fed9c0-e374-47bc-8712-ebc7283dcfc8 req-7dae6ae4-167b-4625-92f1-e76b59319683 service nova] Releasing lock "refresh_cache-6307081b-dd75-4ea3-aad6-d01f2b2b1c9b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:55:49.199534 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Acquired lock "refresh_cache-6307081b-dd75-4ea3-aad6-d01f2b2b1c9b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:55:49.199720 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 01:55:49.658999 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:55:49.693439 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:55:50.127296 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:55:50.166621 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Compute_service record updated for np0000001127:np0000001127 {{(pid=98206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 21 01:55:50.166621 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 4.471s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:55:50.168447 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 55.21 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 01:55:50.168822 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 4.265s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:55:50.178110 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 01:55:50.178593 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Claim successful on node np0000001127
May 21 01:55:50.673719 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Creating config drive at /opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53/disk.config
May 21 01:55:50.679755 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpeqjwczj9 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:55:50.718009 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpeqjwczj9" returned: 0 in 0.038s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:55:50.754565 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:55:50.925400 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Updating instance_info_cache with network_info: [{"id": "67b86a71-40ec-405f-8d46-56744e34174f", "address": "fa:16:3e:ba:84:92", "network": {"id": "84a294f6-e79d-44ac-90f4-cfa96e67e367", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1771731810-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ffcb955f57a438d998dbdf9bfee0868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b86a71-40", "ovs_interfaceid": "67b86a71-40ec-405f-8d46-56744e34174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:55:50.983161 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:51.170431 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:51.184866 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:51.303323 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:51.306516 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:51.427740 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Releasing lock "refresh_cache-6307081b-dd75-4ea3-aad6-d01f2b2b1c9b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:55:51.427964 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Instance network_info: |[{"id": "67b86a71-40ec-405f-8d46-56744e34174f", "address": "fa:16:3e:ba:84:92", "network": {"id": "84a294f6-e79d-44ac-90f4-cfa96e67e367", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1771731810-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ffcb955f57a438d998dbdf9bfee0868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b86a71-40", "ovs_interfaceid": "67b86a71-40ec-405f-8d46-56744e34174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 01:55:51.430629 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Start _get_guest_xml network_info=[{"id": "67b86a71-40ec-405f-8d46-56744e34174f", "address": "fa:16:3e:ba:84:92", "network": {"id": "84a294f6-e79d-44ac-90f4-cfa96e67e367", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1771731810-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ffcb955f57a438d998dbdf9bfee0868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b86a71-40", "ovs_interfaceid": "67b86a71-40ec-405f-8d46-56744e34174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 01:55:51.441310 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 01:55:51.442649 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1663470333', uuid='6307081b-dd75-4ea3-aad6-d01f2b2b1c9b'), owner=OwnerMeta(userid='0fd36d5cf62b4dc49bd53ebc09db2a2d', username='tempest-TaggedAttachmentsTest-1169987238-project-member', projectid='1ffcb955f57a438d998dbdf9bfee0868', projectname='tempest-TaggedAttachmentsTest-1169987238'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "67b86a71-40ec-405f-8d46-56744e34174f", "address": "fa:16:3e:ba:84:92", "network": {"id": "84a294f6-e79d-44ac-90f4-cfa96e67e367", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1771731810-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ffcb955f57a438d998dbdf9bfee0868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b86a71-40", "ovs_interfaceid": "67b86a71-40ec-405f-8d46-56744e34174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328551.44225) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 01:55:51.445347 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 01:55:51.445737 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 01:55:51.448203 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 01:55:51.448363 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 01:55:51.449699 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 01:55:51.449843 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 01:55:51.450003 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 01:55:51.450109 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 01:55:51.450254 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 01:55:51.450347 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 01:55:51.450462 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 01:55:51.450680 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 01:55:51.454500 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 01:55:51.454500 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 01:55:51.454500 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 01:55:51.454500 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 01:55:51.468196 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:55:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1663470333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-1663470333',id=2,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXMK1mbiHi5+o6ufBchj3Bb4+HeC3f5IcR98ZEhanB9o7Q5vVQrjHwCh1Z6wl+J1XeMlcfvzOJWsJzB17pBNOXZgD+WEZqVbkZl5Lc12KudDK67GOxtwwklvUeZ02pjPA==',key_name='tempest-keypair-1942385655',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ffcb955f57a438d998dbdf9bfee0868',ramdisk_id='',reservation_id='r-aopg08rx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1169987238',owner_user_name='tempest-TaggedAttachmentsTest-1169987238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:55:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd36d5cf62b4dc49bd53ebc09db2a2d',uuid=6307081b-dd75-4ea3-aad6-d01f2b2b1c9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67b86a71-40ec-405f-8d46-56744e34174f", "address": "fa:16:3e:ba:84:92", "network": {"id": "84a294f6-e79d-44ac-90f4-cfa96e67e367", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1771731810-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ffcb955f57a438d998dbdf9bfee0868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b86a71-40", "ovs_interfaceid": "67b86a71-40ec-405f-8d46-56744e34174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 01:55:51.468196 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Converting VIF {"id": "67b86a71-40ec-405f-8d46-56744e34174f", "address": "fa:16:3e:ba:84:92", "network": {"id": "84a294f6-e79d-44ac-90f4-cfa96e67e367", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1771731810-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ffcb955f57a438d998dbdf9bfee0868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b86a71-40", "ovs_interfaceid": "67b86a71-40ec-405f-8d46-56744e34174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:55:51.468196 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:84:92,bridge_name='br-int',has_traffic_filtering=True,id=67b86a71-40ec-405f-8d46-56744e34174f,network=Network(84a294f6-e79d-44ac-90f4-cfa96e67e367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67b86a71-40') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:55:51.470027 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lazy-loading 'pci_devices' on Instance uuid 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:55:51.615039 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:55:51.615039 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:55:51.972719 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] End _get_guest_xml xml=<domain type="qemu">
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:   <uuid>6307081b-dd75-4ea3-aad6-d01f2b2b1c9b</uuid>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:   <name>instance-00000002</name>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:   <metadata>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:       <nova:name>tempest-device-tagging-server-1663470333</nova:name>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 01:55:51</nova:creationTime>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:       </nova:image>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:         <nova:user uuid="0fd36d5cf62b4dc49bd53ebc09db2a2d">tempest-TaggedAttachmentsTest-1169987238-project-member</nova:user>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:         <nova:project uuid="1ffcb955f57a438d998dbdf9bfee0868">tempest-TaggedAttachmentsTest-1169987238</nova:project>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:         <nova:port uuid="67b86a71-40ec-405f-8d46-56744e34174f">
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:         </nova:port>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:   </metadata>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:     <system>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:       <entry name="serial">6307081b-dd75-4ea3-aad6-d01f2b2b1c9b</entry>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:       <entry name="uuid">6307081b-dd75-4ea3-aad6-d01f2b2b1c9b</entry>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:     </system>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:   <os>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:   </os>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:   <features>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:     <acpi/>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:     <tcg>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:     </tcg>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:   </features>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:   <devices>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/6307081b-dd75-4ea3-aad6-d01f2b2b1c9b/disk"/>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:     </disk>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/6307081b-dd75-4ea3-aad6-d01f2b2b1c9b/disk.config"/>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:     </disk>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:ba:84:92"/>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:       <target dev="tap67b86a71-40"/>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:     </interface>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/6307081b-dd75-4ea3-aad6-d01f2b2b1c9b/console.log" append="off"/>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:     </serial>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:     <video>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:     </video>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:     </rng>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:     </memballoon>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:   </devices>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]: </domain>
May 21 01:55:51.972719 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 01:55:51.974838 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Preparing to wait for external event network-vif-plugged-67b86a71-40ec-405f-8d46-56744e34174f {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 01:55:51.974838 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Acquiring lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:55:51.974838 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:55:51.974838 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:55:51.974838 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:55:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1663470333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-1663470333',id=2,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXMK1mbiHi5+o6ufBchj3Bb4+HeC3f5IcR98ZEhanB9o7Q5vVQrjHwCh1Z6wl+J1XeMlcfvzOJWsJzB17pBNOXZgD+WEZqVbkZl5Lc12KudDK67GOxtwwklvUeZ02pjPA==',key_name='tempest-keypair-1942385655',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ffcb955f57a438d998dbdf9bfee0868',ramdisk_id='',reservation_id='r-aopg08rx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1169987238',owner_user_name='tempest-TaggedAttachmentsTest-1169987238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:55:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd36d5cf62b4dc49bd53ebc09db2a2d',uuid=6307081b-dd75-4ea3-aad6-d01f2b2b1c9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67b86a71-40ec-405f-8d46-56744e34174f", "address": "fa:16:3e:ba:84:92", "network": {"id": "84a294f6-e79d-44ac-90f4-cfa96e67e367", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1771731810-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ffcb955f57a438d998dbdf9bfee0868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b86a71-40", "ovs_interfaceid": "67b86a71-40ec-405f-8d46-56744e34174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 01:55:51.975017 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Converting VIF {"id": "67b86a71-40ec-405f-8d46-56744e34174f", "address": "fa:16:3e:ba:84:92", "network": {"id": "84a294f6-e79d-44ac-90f4-cfa96e67e367", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1771731810-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ffcb955f57a438d998dbdf9bfee0868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b86a71-40", "ovs_interfaceid": "67b86a71-40ec-405f-8d46-56744e34174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:55:51.976860 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:84:92,bridge_name='br-int',has_traffic_filtering=True,id=67b86a71-40ec-405f-8d46-56744e34174f,network=Network(84a294f6-e79d-44ac-90f4-cfa96e67e367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67b86a71-40') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:55:51.978499 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:84:92,bridge_name='br-int',has_traffic_filtering=True,id=67b86a71-40ec-405f-8d46-56744e34174f,network=Network(84a294f6-e79d-44ac-90f4-cfa96e67e367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67b86a71-40') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 01:55:51.979554 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:51.979554 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:55:51.979554 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 01:55:51.981251 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:51.981251 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2bce03ff-435f-55cf-889c-6e227953785e', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:55:51.982287 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:51.982891 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:55:51.984553 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:51.988924 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:51.988924 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67b86a71-40, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:55:51.988924 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap67b86a71-40, col_values=(('qos', UUID('42665b22-099c-4108-89f3-02c69fdbc4e3')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:55:51.988924 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap67b86a71-40, col_values=(('external_ids', {'iface-id': '67b86a71-40ec-405f-8d46-56744e34174f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:84:92', 'vm-uuid': '6307081b-dd75-4ea3-aad6-d01f2b2b1c9b'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:55:51.989605 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:51.991485 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:55:51.997094 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:51.999281 np0000001127 nova-compute[98206]: INFO os_vif [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:84:92,bridge_name='br-int',has_traffic_filtering=True,id=67b86a71-40ec-405f-8d46-56744e34174f,network=Network(84a294f6-e79d-44ac-90f4-cfa96e67e367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67b86a71-40')
May 21 01:55:52.119648 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:55:52.190617 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1779328552.1902928, 0059a43c-1d34-40a9-af63-b5eca8c30f53 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:55:52.192987 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] VM Started (Lifecycle Event)
May 21 01:55:52.323446 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:52.630426 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.463s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:55:52.631202 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 6.445s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:55:52.631369 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 01:55:52.636388 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 01:55:52.636581 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Claim successful on node np0000001127
May 21 01:55:52.697718 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:55:52.698933 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328552.6986933, 0059a43c-1d34-40a9-af63-b5eca8c30f53 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:55:52.699066 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] VM Paused (Lifecycle Event)
May 21 01:55:53.137882 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 01:55:53.139415 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 01:55:53.139813 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:55:53.140549 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:55:53.203540 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:55:53.208529 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:55:53.287950 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '38854e6e21c441928be21d3355213aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb3fa62c3cb4fe08b4a71f7f855e28d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 01:55:53.516393 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:55:53.517357 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:55:53.517357 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] No VIF found with MAC fa:16:3e:ba:84:92, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 01:55:53.517455 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Using config drive
May 21 01:55:53.641499 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 01:55:53.711051 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 01:55:54.024079 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:55:54.044691 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:55:54.045205 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:55:54.057693 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Successfully created port: db141707-155b-4d59-b771-0ff876e50cc4 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 01:55:54.086693 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:54.094124 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:54.097763 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:54.116556 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:54.123838 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:54.143951 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 01:55:54.236050 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:54.346518 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:54.487739 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Creating config drive at /opt/stack/data/nova/instances/6307081b-dd75-4ea3-aad6-d01f2b2b1c9b/disk.config
May 21 01:55:54.492442 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6307081b-dd75-4ea3-aad6-d01f2b2b1c9b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvcdpbuqx {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:55:54.532287 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6307081b-dd75-4ea3-aad6-d01f2b2b1c9b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvcdpbuqx" returned: 0 in 0.039s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:55:54.549963 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:55:55.063831 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.432s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:55:55.064443 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 01:55:55.068723 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 8.811s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:55:55.069393 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:55.079022 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 01:55:55.079022 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Claim successful on node np0000001127
May 21 01:55:55.084037 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:55.155509 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 01:55:55.156822 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 01:55:55.157317 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Creating image(s)
May 21 01:55:55.158031 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ff0511e-6af4-400b-ac42-5ebd3b37d2b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:55:55.158254 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Lock "/opt/stack/data/nova/instances/0ff0511e-6af4-400b-ac42-5ebd3b37d2b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:55:55.159597 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Lock "/opt/stack/data/nova/instances/0ff0511e-6af4-400b-ac42-5ebd3b37d2b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:55:55.159700 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:55:55.165017 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:55:55.167432 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:55:55.228452 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:55.259201 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.092s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:55:55.263539 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:55:55.263539 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:55:55.264100 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:55:55.267782 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:55:55.268286 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:55:55.362281 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.094s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:55:55.365391 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/0ff0511e-6af4-400b-ac42-5ebd3b37d2b9/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:55:55.420664 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/0ff0511e-6af4-400b-ac42-5ebd3b37d2b9/disk 1073741824" returned: 0 in 0.055s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:55:55.422592 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.159s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:55:55.423032 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:55:55.511581 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.088s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:55:55.512356 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ff0511e-6af4-400b-ac42-5ebd3b37d2b9/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 01:55:55.513192 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ff0511e-6af4-400b-ac42-5ebd3b37d2b9/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:55:55.541440 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:55.543542 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:55.549859 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:55.551928 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:55.568542 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:55.580423 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 01:55:55.581580 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 01:55:55.581580 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:55:55.581580 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:55:55.637659 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ff0511e-6af4-400b-ac42-5ebd3b37d2b9/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:55:55.637659 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Cannot resize image /opt/stack/data/nova/instances/0ff0511e-6af4-400b-ac42-5ebd3b37d2b9/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 01:55:55.637659 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 01:55:55.637659 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Ensure instance console log exists: /opt/stack/data/nova/instances/0ff0511e-6af4-400b-ac42-5ebd3b37d2b9/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 01:55:55.638190 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:55:55.638190 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:55:55.638190 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:55:55.712759 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Successfully updated port: db141707-155b-4d59-b771-0ff876e50cc4 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 01:55:55.789226 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c56a0e645a214e379f2c5ad75804fadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35d2fe45bb24d2b9f7b547352683fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 01:55:55.793483 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f9c58a5a-f328-4afa-9283-095579586631 req-96aa69cc-d770-4867-8d3c-6f565a8e503a service nova] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Received event network-changed-db141707-155b-4d59-b771-0ff876e50cc4 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:55:55.794038 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f9c58a5a-f328-4afa-9283-095579586631 req-96aa69cc-d770-4867-8d3c-6f565a8e503a service nova] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Refreshing instance network info cache due to event network-changed-db141707-155b-4d59-b771-0ff876e50cc4. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:55:55.794316 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f9c58a5a-f328-4afa-9283-095579586631 req-96aa69cc-d770-4867-8d3c-6f565a8e503a service nova] Acquiring lock "refresh_cache-0ff0511e-6af4-400b-ac42-5ebd3b37d2b9" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:55:55.794392 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f9c58a5a-f328-4afa-9283-095579586631 req-96aa69cc-d770-4867-8d3c-6f565a8e503a service nova] Acquired lock "refresh_cache-0ff0511e-6af4-400b-ac42-5ebd3b37d2b9" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:55:55.795658 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-f9c58a5a-f328-4afa-9283-095579586631 req-96aa69cc-d770-4867-8d3c-6f565a8e503a service nova] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Refreshing network info cache for port db141707-155b-4d59-b771-0ff876e50cc4 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:55:55.986707 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:56.094919 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 01:55:56.189896 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328556.1891494, 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:55:56.189896 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] VM Started (Lifecycle Event)
May 21 01:55:56.216069 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Acquiring lock "refresh_cache-0ff0511e-6af4-400b-ac42-5ebd3b37d2b9" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:55:56.297867 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-f9c58a5a-f328-4afa-9283-095579586631 req-96aa69cc-d770-4867-8d3c-6f565a8e503a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:55:56.473587 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:55:56.473587 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:55:56.551139 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Successfully created port: 30254ddf-7ff6-4428-817c-93ea13bd4dcd {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 01:55:56.582462 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-f9c58a5a-f328-4afa-9283-095579586631 req-96aa69cc-d770-4867-8d3c-6f565a8e503a service nova] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:55:56.600440 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 01:55:56.693341 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:55:56.694970 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328556.6947007, 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:55:56.695126 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] VM Paused (Lifecycle Event)
May 21 01:55:56.976952 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:55:56.991100 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:57.197823 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:55:57.201267 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:55:57.270110 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Successfully updated port: 30254ddf-7ff6-4428-817c-93ea13bd4dcd {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 01:55:57.345289 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-f9c58a5a-f328-4afa-9283-095579586631 req-96aa69cc-d770-4867-8d3c-6f565a8e503a service nova] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:55:57.485376 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.417s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:55:57.486060 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 10.837s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:55:57.486216 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 01:55:57.492532 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 01:55:57.492532 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Claim successful on node np0000001127
May 21 01:55:57.612740 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 01:55:57.613713 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 01:55:57.614188 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Creating image(s)
May 21 01:55:57.614833 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Acquiring lock "/opt/stack/data/nova/instances/ecf25bc4-b32d-4627-9571-f98869b227f9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:55:57.615504 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "/opt/stack/data/nova/instances/ecf25bc4-b32d-4627-9571-f98869b227f9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:55:57.616536 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "/opt/stack/data/nova/instances/ecf25bc4-b32d-4627-9571-f98869b227f9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:55:57.617527 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:55:57.620703 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:55:57.622189 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:55:57.698617 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.076s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:55:57.699252 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:55:57.699812 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:55:57.700363 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:55:57.704929 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:55:57.705381 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:55:57.714315 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 01:55:57.772669 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Acquiring lock "refresh_cache-ecf25bc4-b32d-4627-9571-f98869b227f9" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:55:57.772822 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Acquired lock "refresh_cache-ecf25bc4-b32d-4627-9571-f98869b227f9" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:55:57.772977 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 01:55:57.781669 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.076s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:55:57.782123 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/ecf25bc4-b32d-4627-9571-f98869b227f9/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:55:57.816452 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/ecf25bc4-b32d-4627-9571-f98869b227f9/disk 1073741824" returned: 0 in 0.034s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:55:57.816995 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.117s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:55:57.817389 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:55:57.849181 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f9c58a5a-f328-4afa-9283-095579586631 req-96aa69cc-d770-4867-8d3c-6f565a8e503a service nova] Releasing lock "refresh_cache-0ff0511e-6af4-400b-ac42-5ebd3b37d2b9" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:55:57.849864 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Acquired lock "refresh_cache-0ff0511e-6af4-400b-ac42-5ebd3b37d2b9" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:55:57.850132 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 01:55:57.886852 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-56234df2-5f56-4d19-ac54-3ee0697508ff req-97c69904-7cd9-431e-b51b-0d0f23bd9178 service nova] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Received event network-changed-30254ddf-7ff6-4428-817c-93ea13bd4dcd {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:55:57.887557 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-56234df2-5f56-4d19-ac54-3ee0697508ff req-97c69904-7cd9-431e-b51b-0d0f23bd9178 service nova] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Refreshing instance network info cache due to event network-changed-30254ddf-7ff6-4428-817c-93ea13bd4dcd. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:55:57.887847 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-56234df2-5f56-4d19-ac54-3ee0697508ff req-97c69904-7cd9-431e-b51b-0d0f23bd9178 service nova] Acquiring lock "refresh_cache-ecf25bc4-b32d-4627-9571-f98869b227f9" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:55:57.888734 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.071s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:55:57.889566 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ecf25bc4-b32d-4627-9571-f98869b227f9/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 01:55:57.889566 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf25bc4-b32d-4627-9571-f98869b227f9/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:55:57.956391 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf25bc4-b32d-4627-9571-f98869b227f9/disk --force-share --output=json" returned: 0 in 0.067s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:55:57.956809 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Cannot resize image /opt/stack/data/nova/instances/ecf25bc4-b32d-4627-9571-f98869b227f9/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 01:55:57.957130 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 01:55:57.957272 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Ensure instance console log exists: /opt/stack/data/nova/instances/ecf25bc4-b32d-4627-9571-f98869b227f9/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 01:55:57.957653 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:55:57.957898 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:55:57.958022 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:55:57.993370 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 01:55:57.998441 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 01:55:57.999077 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:55:57.999253 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:55:58.084703 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c56a0e645a214e379f2c5ad75804fadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35d2fe45bb24d2b9f7b547352683fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 01:55:58.505179 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 01:55:58.628774 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:58.816213 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:58.858387 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:55:58.858627 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:55:59.009235 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 01:55:59.041498 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:55:59.068137 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:55:59.075593 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Successfully created port: a36c9ce2-1986-45f2-b2bd-e0bbf396d67a {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 01:55:59.186802 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:55:59.362606 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:55:59.748878 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Successfully updated port: a36c9ce2-1986-45f2-b2bd-e0bbf396d67a {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 01:55:59.797725 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-fbbb797a-a20a-4201-b60b-10a30f058be6 req-451b35d0-dc00-4d86-a545-2e241159f3db service nova] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Received event network-changed-a36c9ce2-1986-45f2-b2bd-e0bbf396d67a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:55:59.797912 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-fbbb797a-a20a-4201-b60b-10a30f058be6 req-451b35d0-dc00-4d86-a545-2e241159f3db service nova] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Refreshing instance network info cache due to event network-changed-a36c9ce2-1986-45f2-b2bd-e0bbf396d67a. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:55:59.798138 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fbbb797a-a20a-4201-b60b-10a30f058be6 req-451b35d0-dc00-4d86-a545-2e241159f3db service nova] Acquiring lock "refresh_cache-98ace73f-7d4b-4aed-9355-a39c58f9b024" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:55:59.798263 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fbbb797a-a20a-4201-b60b-10a30f058be6 req-451b35d0-dc00-4d86-a545-2e241159f3db service nova] Acquired lock "refresh_cache-98ace73f-7d4b-4aed-9355-a39c58f9b024" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:55:59.798413 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-fbbb797a-a20a-4201-b60b-10a30f058be6 req-451b35d0-dc00-4d86-a545-2e241159f3db service nova] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Refreshing network info cache for port a36c9ce2-1986-45f2-b2bd-e0bbf396d67a {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:55:59.820512 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:55:59.843376 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:55:59.868680 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.383s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:55:59.869180 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 01:56:00.017516 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 01:56:00.018707 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 01:56:00.019030 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Creating image(s)
May 21 01:56:00.019780 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Acquiring lock "/opt/stack/data/nova/instances/98ace73f-7d4b-4aed-9355-a39c58f9b024/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:00.019937 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "/opt/stack/data/nova/instances/98ace73f-7d4b-4aed-9355-a39c58f9b024/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:00.020508 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "/opt/stack/data/nova/instances/98ace73f-7d4b-4aed-9355-a39c58f9b024/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:00.021163 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:56:00.024700 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:56:00.025929 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:56:00.063170 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Updating instance_info_cache with network_info: [{"id": "30254ddf-7ff6-4428-817c-93ea13bd4dcd", "address": "fa:16:3e:4a:37:e3", "network": {"id": "97eda448-6d12-4aa9-b1f2-150d371463f1", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-343348586-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e35d2fe45bb24d2b9f7b547352683fd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30254ddf-7f", "ovs_interfaceid": "30254ddf-7ff6-4428-817c-93ea13bd4dcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:56:00.072628 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Updating instance_info_cache with network_info: [{"id": "db141707-155b-4d59-b771-0ff876e50cc4", "address": "fa:16:3e:8c:8d:e7", "network": {"id": "ba4b0dc1-74ba-4a6e-9e71-c06004d67f0e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-606810084-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eb3fa62c3cb4fe08b4a71f7f855e28d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb141707-15", "ovs_interfaceid": "db141707-155b-4d59-b771-0ff876e50cc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:56:00.097839 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.072s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:56:00.098366 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:00.098906 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:00.099513 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:56:00.103984 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:56:00.104516 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:56:00.169691 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.065s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:56:00.170561 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/98ace73f-7d4b-4aed-9355-a39c58f9b024/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:56:00.205999 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/98ace73f-7d4b-4aed-9355-a39c58f9b024/disk 1073741824" returned: 0 in 0.035s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:56:00.206790 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.108s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:00.209483 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:56:00.253073 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Acquiring lock "refresh_cache-98ace73f-7d4b-4aed-9355-a39c58f9b024" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:56:00.285786 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.078s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:56:00.286174 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Checking if we can resize image /opt/stack/data/nova/instances/98ace73f-7d4b-4aed-9355-a39c58f9b024/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 01:56:00.286408 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98ace73f-7d4b-4aed-9355-a39c58f9b024/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:56:00.303346 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-fbbb797a-a20a-4201-b60b-10a30f058be6 req-451b35d0-dc00-4d86-a545-2e241159f3db service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:00.362167 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98ace73f-7d4b-4aed-9355-a39c58f9b024/disk --force-share --output=json" returned: 0 in 0.076s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:56:00.362498 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Cannot resize image /opt/stack/data/nova/instances/98ace73f-7d4b-4aed-9355-a39c58f9b024/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 01:56:00.362847 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 01:56:00.363011 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Ensure instance console log exists: /opt/stack/data/nova/instances/98ace73f-7d4b-4aed-9355-a39c58f9b024/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 01:56:00.363289 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:00.363501 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:00.363704 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:00.383790 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 01:56:00.383790 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 01:56:00.383790 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:00.383790 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:00.529773 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-fbbb797a-a20a-4201-b60b-10a30f058be6 req-451b35d0-dc00-4d86-a545-2e241159f3db service nova] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:56:00.566200 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Releasing lock "refresh_cache-ecf25bc4-b32d-4627-9571-f98869b227f9" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:56:00.566667 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Instance network_info: |[{"id": "30254ddf-7ff6-4428-817c-93ea13bd4dcd", "address": "fa:16:3e:4a:37:e3", "network": {"id": "97eda448-6d12-4aa9-b1f2-150d371463f1", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-343348586-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e35d2fe45bb24d2b9f7b547352683fd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30254ddf-7f", "ovs_interfaceid": "30254ddf-7ff6-4428-817c-93ea13bd4dcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 01:56:00.567302 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-56234df2-5f56-4d19-ac54-3ee0697508ff req-97c69904-7cd9-431e-b51b-0d0f23bd9178 service nova] Acquired lock "refresh_cache-ecf25bc4-b32d-4627-9571-f98869b227f9" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:56:00.568375 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-56234df2-5f56-4d19-ac54-3ee0697508ff req-97c69904-7cd9-431e-b51b-0d0f23bd9178 service nova] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Refreshing network info cache for port 30254ddf-7ff6-4428-817c-93ea13bd4dcd {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:56:00.570682 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Start _get_guest_xml network_info=[{"id": "30254ddf-7ff6-4428-817c-93ea13bd4dcd", "address": "fa:16:3e:4a:37:e3", "network": {"id": "97eda448-6d12-4aa9-b1f2-150d371463f1", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-343348586-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e35d2fe45bb24d2b9f7b547352683fd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30254ddf-7f", "ovs_interfaceid": "30254ddf-7ff6-4428-817c-93ea13bd4dcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 01:56:00.572657 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 01:56:00.574137 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-606274888-1', uuid='ecf25bc4-b32d-4627-9571-f98869b227f9'), owner=OwnerMeta(userid='c56a0e645a214e379f2c5ad75804fadc', username='tempest-TestMultiAttachVolumeSwap-1388661881-project-member', projectid='e35d2fe45bb24d2b9f7b547352683fd4', projectname='tempest-TestMultiAttachVolumeSwap-1388661881'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "30254ddf-7ff6-4428-817c-93ea13bd4dcd", "address": "fa:16:3e:4a:37:e3", "network": {"id": "97eda448-6d12-4aa9-b1f2-150d371463f1", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-343348586-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e35d2fe45bb24d2b9f7b547352683fd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30254ddf-7f", "ovs_interfaceid": "30254ddf-7ff6-4428-817c-93ea13bd4dcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328560.5736926) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 01:56:00.575308 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 01:56:00.575872 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 01:56:00.577372 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Releasing lock "refresh_cache-0ff0511e-6af4-400b-ac42-5ebd3b37d2b9" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:56:00.577935 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Instance network_info: |[{"id": "db141707-155b-4d59-b771-0ff876e50cc4", "address": "fa:16:3e:8c:8d:e7", "network": {"id": "ba4b0dc1-74ba-4a6e-9e71-c06004d67f0e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-606810084-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eb3fa62c3cb4fe08b4a71f7f855e28d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb141707-15", "ovs_interfaceid": "db141707-155b-4d59-b771-0ff876e50cc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 01:56:00.579783 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Start _get_guest_xml network_info=[{"id": "db141707-155b-4d59-b771-0ff876e50cc4", "address": "fa:16:3e:8c:8d:e7", "network": {"id": "ba4b0dc1-74ba-4a6e-9e71-c06004d67f0e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-606810084-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eb3fa62c3cb4fe08b4a71f7f855e28d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb141707-15", "ovs_interfaceid": "db141707-155b-4d59-b771-0ff876e50cc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 01:56:00.581303 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 01:56:00.581741 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 01:56:00.583066 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 01:56:00.584015 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 01:56:00.585247 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 01:56:00.585681 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 01:56:00.586206 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 01:56:00.587361 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 01:56:00.587890 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-VolumesAdminNegativeTest-server-1374653048', uuid='0ff0511e-6af4-400b-ac42-5ebd3b37d2b9'), owner=OwnerMeta(userid='38854e6e21c441928be21d3355213aaa', username='tempest-VolumesAdminNegativeTest-2137466894-project-member', projectid='0eb3fa62c3cb4fe08b4a71f7f855e28d', projectname='tempest-VolumesAdminNegativeTest-2137466894'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "db141707-155b-4d59-b771-0ff876e50cc4", "address": "fa:16:3e:8c:8d:e7", "network": {"id": "ba4b0dc1-74ba-4a6e-9e71-c06004d67f0e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-606810084-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eb3fa62c3cb4fe08b4a71f7f855e28d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb141707-15", "ovs_interfaceid": "db141707-155b-4d59-b771-0ff876e50cc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328560.586962) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 01:56:00.588081 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 01:56:00.588234 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 01:56:00.588546 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 01:56:00.588835 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 01:56:00.589183 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 01:56:00.589738 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 01:56:00.590098 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 01:56:00.590487 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 01:56:00.596718 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 01:56:00.607181 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e8c7a79a5dd43789d70c36281b15410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad39cb6391143989b2404dc66ddfe0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 01:56:00.610388 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 01:56:00.611229 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 01:56:00.614499 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 01:56:00.614499 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 01:56:00.614499 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 01:56:00.614499 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 01:56:00.614499 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 01:56:00.614499 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 01:56:00.614499 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 01:56:00.614499 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 01:56:00.614499 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 01:56:00.614499 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 01:56:00.614499 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 01:56:00.614499 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 01:56:00.633983 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T01:55:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-606274888-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testmultiattachvolumeswap-server-606274888-1',id=4,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkI1t/5EzMBU18+t/tHR5dUD+OlbYBlLLvWS5mSolnmuGBIj1zOYGzSPX9mbsUvKL1pRiKCgiPAHoaJG8nciLhkFrHXBDpgmLFyWuKaphBcmlHNhzmWEzLHykc5SM0UfA==',key_name='tempest-keypair-142556595',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e35d2fe45bb24d2b9f7b547352683fd4',ramdisk_id='',reservation_id='r-8tc20l86',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-1388661881',owner_user_name='tempest-TestMultiAttachVolumeSwap-1388661881-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:55:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c56a0e645a214e379f2c5ad75804fadc',uuid=ecf25bc4-b32d-4627-9571-f98869b227f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30254ddf-7ff6-4428-817c-93ea13bd4dcd", "address": "fa:16:3e:4a:37:e3", "network": {"id": "97eda448-6d12-4aa9-b1f2-150d371463f1", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-343348586-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e35d2fe45bb24d2b9f7b547352683fd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30254ddf-7f", "ovs_interfaceid": "30254ddf-7ff6-4428-817c-93ea13bd4dcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 01:56:00.634255 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Converting VIF {"id": "30254ddf-7ff6-4428-817c-93ea13bd4dcd", "address": "fa:16:3e:4a:37:e3", "network": {"id": "97eda448-6d12-4aa9-b1f2-150d371463f1", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-343348586-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e35d2fe45bb24d2b9f7b547352683fd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30254ddf-7f", "ovs_interfaceid": "30254ddf-7ff6-4428-817c-93ea13bd4dcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:56:00.635088 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:37:e3,bridge_name='br-int',has_traffic_filtering=True,id=30254ddf-7ff6-4428-817c-93ea13bd4dcd,network=Network(97eda448-6d12-4aa9-b1f2-150d371463f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30254ddf-7f') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:56:00.636626 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lazy-loading 'pci_devices' on Instance uuid ecf25bc4-b32d-4627-9571-f98869b227f9 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:56:00.642502 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T01:55:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1374653048',display_name='tempest-VolumesAdminNegativeTest-server-1374653048',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumesadminnegativetest-server-1374653048',id=3,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0eb3fa62c3cb4fe08b4a71f7f855e28d',ramdisk_id='',reservation_id='r-zrd31wvw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2137466894',owner_user_name='tempest-VolumesAdminNegativeTest-2137466894-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:55:54Z,user_data=None,user_id='38854e6e21c441928be21d3355213aaa',uuid=0ff0511e-6af4-400b-ac42-5ebd3b37d2b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db141707-155b-4d59-b771-0ff876e50cc4", "address": "fa:16:3e:8c:8d:e7", "network": {"id": "ba4b0dc1-74ba-4a6e-9e71-c06004d67f0e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-606810084-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eb3fa62c3cb4fe08b4a71f7f855e28d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb141707-15", "ovs_interfaceid": "db141707-155b-4d59-b771-0ff876e50cc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 01:56:00.642502 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Converting VIF {"id": "db141707-155b-4d59-b771-0ff876e50cc4", "address": "fa:16:3e:8c:8d:e7", "network": {"id": "ba4b0dc1-74ba-4a6e-9e71-c06004d67f0e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-606810084-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eb3fa62c3cb4fe08b4a71f7f855e28d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb141707-15", "ovs_interfaceid": "db141707-155b-4d59-b771-0ff876e50cc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:56:00.642502 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:8d:e7,bridge_name='br-int',has_traffic_filtering=True,id=db141707-155b-4d59-b771-0ff876e50cc4,network=Network(ba4b0dc1-74ba-4a6e-9e71-c06004d67f0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb141707-15') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:56:00.642502 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:56:00.884694 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 01:56:00.961490 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-fbbb797a-a20a-4201-b60b-10a30f058be6 req-451b35d0-dc00-4d86-a545-2e241159f3db service nova] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:56:00.987444 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:01.069231 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:01.072176 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-56234df2-5f56-4d19-ac54-3ee0697508ff req-97c69904-7cd9-431e-b51b-0d0f23bd9178 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:01.105772 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-72052ab9-9358-4791-8e06-a4a299514746 req-ec26e08a-5014-48be-afdb-4ad1cb8b43ec service nova] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Received event network-vif-unplugged-db141707-155b-4d59-b771-0ff876e50cc4 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:56:01.106007 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-72052ab9-9358-4791-8e06-a4a299514746 req-ec26e08a-5014-48be-afdb-4ad1cb8b43ec service nova] Acquiring lock "0ff0511e-6af4-400b-ac42-5ebd3b37d2b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:01.106412 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-72052ab9-9358-4791-8e06-a4a299514746 req-ec26e08a-5014-48be-afdb-4ad1cb8b43ec service nova] Lock "0ff0511e-6af4-400b-ac42-5ebd3b37d2b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:01.106762 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-72052ab9-9358-4791-8e06-a4a299514746 req-ec26e08a-5014-48be-afdb-4ad1cb8b43ec service nova] Lock "0ff0511e-6af4-400b-ac42-5ebd3b37d2b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:01.107025 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-72052ab9-9358-4791-8e06-a4a299514746 req-ec26e08a-5014-48be-afdb-4ad1cb8b43ec service nova] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] No waiting events found dispatching network-vif-unplugged-db141707-155b-4d59-b771-0ff876e50cc4 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:56:01.107025 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-72052ab9-9358-4791-8e06-a4a299514746 req-ec26e08a-5014-48be-afdb-4ad1cb8b43ec service nova] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Received unexpected event network-vif-unplugged-db141707-155b-4d59-b771-0ff876e50cc4 for instance with vm_state building and task_state spawning.
May 21 01:56:01.143289 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] End _get_guest_xml xml=<domain type="qemu">
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:   <uuid>ecf25bc4-b32d-4627-9571-f98869b227f9</uuid>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:   <name>instance-00000004</name>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:   <metadata>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:       <nova:name>tempest-TestMultiAttachVolumeSwap-server-606274888-1</nova:name>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 01:56:00</nova:creationTime>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:       </nova:image>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:         <nova:user uuid="c56a0e645a214e379f2c5ad75804fadc">tempest-TestMultiAttachVolumeSwap-1388661881-project-member</nova:user>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:         <nova:project uuid="e35d2fe45bb24d2b9f7b547352683fd4">tempest-TestMultiAttachVolumeSwap-1388661881</nova:project>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:         <nova:port uuid="30254ddf-7ff6-4428-817c-93ea13bd4dcd">
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:         </nova:port>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:   </metadata>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:     <system>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:       <entry name="serial">ecf25bc4-b32d-4627-9571-f98869b227f9</entry>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:       <entry name="uuid">ecf25bc4-b32d-4627-9571-f98869b227f9</entry>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:     </system>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:   <os>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:   </os>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:   <features>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:     <acpi/>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:     <tcg>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:     </tcg>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:   </features>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:   <devices>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/ecf25bc4-b32d-4627-9571-f98869b227f9/disk"/>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:     </disk>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/ecf25bc4-b32d-4627-9571-f98869b227f9/disk.config"/>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:     </disk>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:4a:37:e3"/>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:       <target dev="tap30254ddf-7f"/>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:     </interface>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/ecf25bc4-b32d-4627-9571-f98869b227f9/console.log" append="off"/>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:     </serial>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:     <video>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:     </video>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:     </rng>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:     </memballoon>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:   </devices>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]: </domain>
May 21 01:56:01.143289 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 01:56:01.143289 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Preparing to wait for external event network-vif-plugged-30254ddf-7ff6-4428-817c-93ea13bd4dcd {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 01:56:01.143289 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Acquiring lock "ecf25bc4-b32d-4627-9571-f98869b227f9-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:01.146403 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "ecf25bc4-b32d-4627-9571-f98869b227f9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:01.146403 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "ecf25bc4-b32d-4627-9571-f98869b227f9-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:01.146403 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T01:55:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-606274888-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testmultiattachvolumeswap-server-606274888-1',id=4,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkI1t/5EzMBU18+t/tHR5dUD+OlbYBlLLvWS5mSolnmuGBIj1zOYGzSPX9mbsUvKL1pRiKCgiPAHoaJG8nciLhkFrHXBDpgmLFyWuKaphBcmlHNhzmWEzLHykc5SM0UfA==',key_name='tempest-keypair-142556595',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e35d2fe45bb24d2b9f7b547352683fd4',ramdisk_id='',reservation_id='r-8tc20l86',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-1388661881',owner_user_name='tempest-TestMultiAttachVolumeSwap-1388661881-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:55:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c56a0e645a214e379f2c5ad75804fadc',uuid=ecf25bc4-b32d-4627-9571-f98869b227f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30254ddf-7ff6-4428-817c-93ea13bd4dcd", "address": "fa:16:3e:4a:37:e3", "network": {"id": "97eda448-6d12-4aa9-b1f2-150d371463f1", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-343348586-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e35d2fe45bb24d2b9f7b547352683fd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30254ddf-7f", "ovs_interfaceid": "30254ddf-7ff6-4428-817c-93ea13bd4dcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 01:56:01.146679 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Converting VIF {"id": "30254ddf-7ff6-4428-817c-93ea13bd4dcd", "address": "fa:16:3e:4a:37:e3", "network": {"id": "97eda448-6d12-4aa9-b1f2-150d371463f1", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-343348586-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e35d2fe45bb24d2b9f7b547352683fd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30254ddf-7f", "ovs_interfaceid": "30254ddf-7ff6-4428-817c-93ea13bd4dcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:56:01.146679 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:37:e3,bridge_name='br-int',has_traffic_filtering=True,id=30254ddf-7ff6-4428-817c-93ea13bd4dcd,network=Network(97eda448-6d12-4aa9-b1f2-150d371463f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30254ddf-7f') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:56:01.146679 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:37:e3,bridge_name='br-int',has_traffic_filtering=True,id=30254ddf-7ff6-4428-817c-93ea13bd4dcd,network=Network(97eda448-6d12-4aa9-b1f2-150d371463f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30254ddf-7f') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 01:56:01.146679 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:01.147357 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] End _get_guest_xml xml=<domain type="qemu">
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:   <uuid>0ff0511e-6af4-400b-ac42-5ebd3b37d2b9</uuid>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:   <name>instance-00000003</name>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:   <metadata>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1374653048</nova:name>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 01:56:00</nova:creationTime>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:       </nova:image>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:         <nova:user uuid="38854e6e21c441928be21d3355213aaa">tempest-VolumesAdminNegativeTest-2137466894-project-member</nova:user>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:         <nova:project uuid="0eb3fa62c3cb4fe08b4a71f7f855e28d">tempest-VolumesAdminNegativeTest-2137466894</nova:project>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:         <nova:port uuid="db141707-155b-4d59-b771-0ff876e50cc4">
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:         </nova:port>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:   </metadata>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:     <system>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:       <entry name="serial">0ff0511e-6af4-400b-ac42-5ebd3b37d2b9</entry>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:       <entry name="uuid">0ff0511e-6af4-400b-ac42-5ebd3b37d2b9</entry>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:     </system>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:   <os>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:   </os>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:   <features>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:     <acpi/>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:     <tcg>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:     </tcg>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:   </features>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:   <devices>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/0ff0511e-6af4-400b-ac42-5ebd3b37d2b9/disk"/>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:     </disk>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/0ff0511e-6af4-400b-ac42-5ebd3b37d2b9/disk.config"/>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:     </disk>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:8c:8d:e7"/>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:       <target dev="tapdb141707-15"/>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:     </interface>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/0ff0511e-6af4-400b-ac42-5ebd3b37d2b9/console.log" append="off"/>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:     </serial>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:     <video>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:     </video>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:     </rng>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:     </memballoon>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:   </devices>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]: </domain>
May 21 01:56:01.147357 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 01:56:01.150618 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:56:01.150618 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 01:56:01.150618 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Preparing to wait for external event network-vif-plugged-db141707-155b-4d59-b771-0ff876e50cc4 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 01:56:01.150618 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Acquiring lock "0ff0511e-6af4-400b-ac42-5ebd3b37d2b9-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:01.150618 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Lock "0ff0511e-6af4-400b-ac42-5ebd3b37d2b9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:01.150618 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Lock "0ff0511e-6af4-400b-ac42-5ebd3b37d2b9-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:01.150618 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T01:55:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1374653048',display_name='tempest-VolumesAdminNegativeTest-server-1374653048',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumesadminnegativetest-server-1374653048',id=3,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0eb3fa62c3cb4fe08b4a71f7f855e28d',ramdisk_id='',reservation_id='r-zrd31wvw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2137466894',owner_user_name='tempest-VolumesAdminNegativeTest-2137466894-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:55:54Z,user_data=None,user_id='38854e6e21c441928be21d3355213aaa',uuid=0ff0511e-6af4-400b-ac42-5ebd3b37d2b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db141707-155b-4d59-b771-0ff876e50cc4", "address": "fa:16:3e:8c:8d:e7", "network": {"id": "ba4b0dc1-74ba-4a6e-9e71-c06004d67f0e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-606810084-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eb3fa62c3cb4fe08b4a71f7f855e28d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb141707-15", "ovs_interfaceid": "db141707-155b-4d59-b771-0ff876e50cc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 01:56:01.150989 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Converting VIF {"id": "db141707-155b-4d59-b771-0ff876e50cc4", "address": "fa:16:3e:8c:8d:e7", "network": {"id": "ba4b0dc1-74ba-4a6e-9e71-c06004d67f0e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-606810084-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eb3fa62c3cb4fe08b4a71f7f855e28d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb141707-15", "ovs_interfaceid": "db141707-155b-4d59-b771-0ff876e50cc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:56:01.151040 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:8d:e7,bridge_name='br-int',has_traffic_filtering=True,id=db141707-155b-4d59-b771-0ff876e50cc4,network=Network(ba4b0dc1-74ba-4a6e-9e71-c06004d67f0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb141707-15') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:56:01.151245 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:8d:e7,bridge_name='br-int',has_traffic_filtering=True,id=db141707-155b-4d59-b771-0ff876e50cc4,network=Network(ba4b0dc1-74ba-4a6e-9e71-c06004d67f0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb141707-15') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 01:56:01.151865 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:01.151865 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e077cf23-2ec5-5248-a407-afadb6a615dd', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:56:01.156264 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:01.156264 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:56:01.157215 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:01.158950 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:01.158950 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:56:01.158950 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 01:56:01.160250 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:01.160429 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9353d409-b18f-5d9a-aedd-13a15796c0e6', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:56:01.161529 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:01.162735 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:56:01.163631 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:01.163631 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:01.163631 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30254ddf-7f, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:56:01.164242 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap30254ddf-7f, col_values=(('qos', UUID('1dd06015-548e-4e90-b5c6-ddd15e5ace22')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:56:01.164545 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap30254ddf-7f, col_values=(('external_ids', {'iface-id': '30254ddf-7ff6-4428-817c-93ea13bd4dcd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:37:e3', 'vm-uuid': 'ecf25bc4-b32d-4627-9571-f98869b227f9'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:56:01.167556 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:01.168695 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:56:01.174993 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:01.176280 np0000001127 nova-compute[98206]: INFO os_vif [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:37:e3,bridge_name='br-int',has_traffic_filtering=True,id=30254ddf-7ff6-4428-817c-93ea13bd4dcd,network=Network(97eda448-6d12-4aa9-b1f2-150d371463f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30254ddf-7f')
May 21 01:56:01.181175 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:01.181392 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb141707-15, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:56:01.182161 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdb141707-15, col_values=(('qos', UUID('2d0bfd24-2131-4d16-b3b1-6512c8d151bb')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:56:01.182161 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdb141707-15, col_values=(('external_ids', {'iface-id': 'db141707-155b-4d59-b771-0ff876e50cc4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:8d:e7', 'vm-uuid': '0ff0511e-6af4-400b-ac42-5ebd3b37d2b9'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:56:01.182965 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:01.184136 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:56:01.195076 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:01.196130 np0000001127 nova-compute[98206]: INFO os_vif [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:8d:e7,bridge_name='br-int',has_traffic_filtering=True,id=db141707-155b-4d59-b771-0ff876e50cc4,network=Network(ba4b0dc1-74ba-4a6e-9e71-c06004d67f0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb141707-15')
May 21 01:56:01.367020 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Successfully created port: 8899a68b-fb77-4ac9-a9f0-ca811560c63a {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 01:56:01.389981 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 01:56:01.463861 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fbbb797a-a20a-4201-b60b-10a30f058be6 req-451b35d0-dc00-4d86-a545-2e241159f3db service nova] Releasing lock "refresh_cache-98ace73f-7d4b-4aed-9355-a39c58f9b024" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:56:01.464381 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Acquired lock "refresh_cache-98ace73f-7d4b-4aed-9355-a39c58f9b024" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:56:01.464701 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 01:56:01.575124 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-56234df2-5f56-4d19-ac54-3ee0697508ff req-97c69904-7cd9-431e-b51b-0d0f23bd9178 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:01.711656 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-56234df2-5f56-4d19-ac54-3ee0697508ff req-97c69904-7cd9-431e-b51b-0d0f23bd9178 service nova] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Updated VIF entry in instance network info cache for port 30254ddf-7ff6-4428-817c-93ea13bd4dcd. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 01:56:01.712331 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-56234df2-5f56-4d19-ac54-3ee0697508ff req-97c69904-7cd9-431e-b51b-0d0f23bd9178 service nova] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Updating instance_info_cache with network_info: [{"id": "30254ddf-7ff6-4428-817c-93ea13bd4dcd", "address": "fa:16:3e:4a:37:e3", "network": {"id": "97eda448-6d12-4aa9-b1f2-150d371463f1", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-343348586-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e35d2fe45bb24d2b9f7b547352683fd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30254ddf-7f", "ovs_interfaceid": "30254ddf-7ff6-4428-817c-93ea13bd4dcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:56:01.938809 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Successfully updated port: 8899a68b-fb77-4ac9-a9f0-ca811560c63a {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 01:56:02.034089 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:56:02.069138 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-85b2a617-58f8-473c-8100-4cea13cff1fd req-3997533b-a3cd-41a1-a496-ce58b3f4841b service nova] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Received event network-changed-8899a68b-fb77-4ac9-a9f0-ca811560c63a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:56:02.069138 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-85b2a617-58f8-473c-8100-4cea13cff1fd req-3997533b-a3cd-41a1-a496-ce58b3f4841b service nova] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Refreshing instance network info cache due to event network-changed-8899a68b-fb77-4ac9-a9f0-ca811560c63a. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:56:02.069274 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-85b2a617-58f8-473c-8100-4cea13cff1fd req-3997533b-a3cd-41a1-a496-ce58b3f4841b service nova] Acquiring lock "refresh_cache-cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:56:02.069437 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-85b2a617-58f8-473c-8100-4cea13cff1fd req-3997533b-a3cd-41a1-a496-ce58b3f4841b service nova] Acquired lock "refresh_cache-cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:56:02.069614 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-85b2a617-58f8-473c-8100-4cea13cff1fd req-3997533b-a3cd-41a1-a496-ce58b3f4841b service nova] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Refreshing network info cache for port 8899a68b-fb77-4ac9-a9f0-ca811560c63a {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:56:02.214778 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-56234df2-5f56-4d19-ac54-3ee0697508ff req-97c69904-7cd9-431e-b51b-0d0f23bd9178 service nova] Releasing lock "refresh_cache-ecf25bc4-b32d-4627-9571-f98869b227f9" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:56:02.268533 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:02.402295 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 01:56:02.403242 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 01:56:02.403524 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Creating image(s)
May 21 01:56:02.404215 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Acquiring lock "/opt/stack/data/nova/instances/cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:02.406035 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Lock "/opt/stack/data/nova/instances/cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:02.406281 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Lock "/opt/stack/data/nova/instances/cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:02.406922 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:56:02.412257 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:56:02.414152 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:56:02.442063 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Acquiring lock "refresh_cache-cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:56:02.455961 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Updating instance_info_cache with network_info: [{"id": "a36c9ce2-1986-45f2-b2bd-e0bbf396d67a", "address": "fa:16:3e:ee:ec:8e", "network": {"id": "97eda448-6d12-4aa9-b1f2-150d371463f1", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-343348586-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e35d2fe45bb24d2b9f7b547352683fd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36c9ce2-19", "ovs_interfaceid": "a36c9ce2-1986-45f2-b2bd-e0bbf396d67a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:56:02.483513 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.069s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:56:02.483940 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:02.484392 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:02.484884 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:56:02.487979 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:56:02.488328 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:56:02.562209 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.073s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:56:02.562827 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:56:02.573671 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-85b2a617-58f8-473c-8100-4cea13cff1fd req-3997533b-a3cd-41a1-a496-ce58b3f4841b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:02.596854 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6/disk 1073741824" returned: 0 in 0.034s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:56:02.597959 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.113s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:02.597959 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:56:02.663863 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-85b2a617-58f8-473c-8100-4cea13cff1fd req-3997533b-a3cd-41a1-a496-ce58b3f4841b service nova] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:56:02.692126 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.094s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:56:02.692754 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 01:56:02.693031 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:56:02.710094 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:56:02.710349 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:56:02.710883 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] No VIF found with MAC fa:16:3e:4a:37:e3, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 01:56:02.712902 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Using config drive
May 21 01:56:02.721552 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:56:02.721689 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:56:02.721841 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] No VIF found with MAC fa:16:3e:8c:8d:e7, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 01:56:02.723326 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Using config drive
May 21 01:56:02.781099 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:56:02.781957 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Cannot resize image /opt/stack/data/nova/instances/cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 01:56:02.781957 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 01:56:02.782092 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Ensure instance console log exists: /opt/stack/data/nova/instances/cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 01:56:02.782334 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:02.783014 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:02.783014 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:02.829223 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-85b2a617-58f8-473c-8100-4cea13cff1fd req-3997533b-a3cd-41a1-a496-ce58b3f4841b service nova] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:56:02.958674 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Releasing lock "refresh_cache-98ace73f-7d4b-4aed-9355-a39c58f9b024" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:56:02.959180 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Instance network_info: |[{"id": "a36c9ce2-1986-45f2-b2bd-e0bbf396d67a", "address": "fa:16:3e:ee:ec:8e", "network": {"id": "97eda448-6d12-4aa9-b1f2-150d371463f1", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-343348586-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e35d2fe45bb24d2b9f7b547352683fd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36c9ce2-19", "ovs_interfaceid": "a36c9ce2-1986-45f2-b2bd-e0bbf396d67a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 01:56:02.961235 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Start _get_guest_xml network_info=[{"id": "a36c9ce2-1986-45f2-b2bd-e0bbf396d67a", "address": "fa:16:3e:ee:ec:8e", "network": {"id": "97eda448-6d12-4aa9-b1f2-150d371463f1", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-343348586-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e35d2fe45bb24d2b9f7b547352683fd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36c9ce2-19", "ovs_interfaceid": "a36c9ce2-1986-45f2-b2bd-e0bbf396d67a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 01:56:02.962915 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 01:56:02.964284 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-606274888-2', uuid='98ace73f-7d4b-4aed-9355-a39c58f9b024'), owner=OwnerMeta(userid='c56a0e645a214e379f2c5ad75804fadc', username='tempest-TestMultiAttachVolumeSwap-1388661881-project-member', projectid='e35d2fe45bb24d2b9f7b547352683fd4', projectname='tempest-TestMultiAttachVolumeSwap-1388661881'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a36c9ce2-1986-45f2-b2bd-e0bbf396d67a", "address": "fa:16:3e:ee:ec:8e", "network": {"id": "97eda448-6d12-4aa9-b1f2-150d371463f1", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-343348586-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e35d2fe45bb24d2b9f7b547352683fd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36c9ce2-19", "ovs_interfaceid": "a36c9ce2-1986-45f2-b2bd-e0bbf396d67a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328562.9638255) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 01:56:02.965213 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 01:56:02.965631 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 01:56:02.966647 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 01:56:02.966931 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 01:56:02.968080 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 01:56:02.968389 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 01:56:02.968533 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 01:56:02.968613 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 01:56:02.968762 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 01:56:02.968817 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 01:56:02.968957 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 01:56:02.969682 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 01:56:02.969978 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 01:56:02.970091 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 01:56:02.970252 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 01:56:02.970434 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 01:56:02.981757 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T01:55:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-606274888-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testmultiattachvolumeswap-server-606274888-2',id=5,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkI1t/5EzMBU18+t/tHR5dUD+OlbYBlLLvWS5mSolnmuGBIj1zOYGzSPX9mbsUvKL1pRiKCgiPAHoaJG8nciLhkFrHXBDpgmLFyWuKaphBcmlHNhzmWEzLHykc5SM0UfA==',key_name='tempest-keypair-142556595',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e35d2fe45bb24d2b9f7b547352683fd4',ramdisk_id='',reservation_id='r-8tc20l86',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-1388661881',owner_user_name='tempest-TestMultiAttachVolumeSwap-1388661881-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:55:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c56a0e645a214e379f2c5ad75804fadc',uuid=98ace73f-7d4b-4aed-9355-a39c58f9b024,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a36c9ce2-1986-45f2-b2bd-e0bbf396d67a", "address": "fa:16:3e:ee:ec:8e", "network": {"id": "97eda448-6d12-4aa9-b1f2-150d371463f1", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-343348586-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e35d2fe45bb24d2b9f7b547352683fd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36c9ce2-19", "ovs_interfaceid": "a36c9ce2-1986-45f2-b2bd-e0bbf396d67a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 01:56:02.981955 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Converting VIF {"id": "a36c9ce2-1986-45f2-b2bd-e0bbf396d67a", "address": "fa:16:3e:ee:ec:8e", "network": {"id": "97eda448-6d12-4aa9-b1f2-150d371463f1", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-343348586-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e35d2fe45bb24d2b9f7b547352683fd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36c9ce2-19", "ovs_interfaceid": "a36c9ce2-1986-45f2-b2bd-e0bbf396d67a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:56:02.982660 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:ec:8e,bridge_name='br-int',has_traffic_filtering=True,id=a36c9ce2-1986-45f2-b2bd-e0bbf396d67a,network=Network(97eda448-6d12-4aa9-b1f2-150d371463f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa36c9ce2-19') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:56:02.983336 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lazy-loading 'pci_devices' on Instance uuid 98ace73f-7d4b-4aed-9355-a39c58f9b024 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:56:03.176577 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e539bbbb-da8b-4414-83af-4642170c6f87 req-e6a0cd66-c36a-475b-a43e-cefed6d19c94 service nova] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Received event network-vif-unplugged-30254ddf-7ff6-4428-817c-93ea13bd4dcd {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:56:03.176990 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e539bbbb-da8b-4414-83af-4642170c6f87 req-e6a0cd66-c36a-475b-a43e-cefed6d19c94 service nova] Acquiring lock "ecf25bc4-b32d-4627-9571-f98869b227f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:03.178588 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e539bbbb-da8b-4414-83af-4642170c6f87 req-e6a0cd66-c36a-475b-a43e-cefed6d19c94 service nova] Lock "ecf25bc4-b32d-4627-9571-f98869b227f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:03.178588 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e539bbbb-da8b-4414-83af-4642170c6f87 req-e6a0cd66-c36a-475b-a43e-cefed6d19c94 service nova] Lock "ecf25bc4-b32d-4627-9571-f98869b227f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:03.178588 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e539bbbb-da8b-4414-83af-4642170c6f87 req-e6a0cd66-c36a-475b-a43e-cefed6d19c94 service nova] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] No event matching network-vif-unplugged-30254ddf-7ff6-4428-817c-93ea13bd4dcd in dict_keys([('network-vif-plugged', '30254ddf-7ff6-4428-817c-93ea13bd4dcd')]) {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 21 01:56:03.178588 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-e539bbbb-da8b-4414-83af-4642170c6f87 req-e6a0cd66-c36a-475b-a43e-cefed6d19c94 service nova] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Received unexpected event network-vif-unplugged-30254ddf-7ff6-4428-817c-93ea13bd4dcd for instance with vm_state building and task_state spawning.
May 21 01:56:03.222821 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:03.229323 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:03.318841 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "29a124ee-2b8c-4f44-8f91-8dd11ac78b52" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:03.318841 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "29a124ee-2b8c-4f44-8f91-8dd11ac78b52" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:03.331277 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-85b2a617-58f8-473c-8100-4cea13cff1fd req-3997533b-a3cd-41a1-a496-ce58b3f4841b service nova] Releasing lock "refresh_cache-cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:56:03.331773 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Acquired lock "refresh_cache-cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:56:03.331989 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 01:56:03.375514 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Creating config drive at /opt/stack/data/nova/instances/ecf25bc4-b32d-4627-9571-f98869b227f9/disk.config
May 21 01:56:03.379911 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Creating config drive at /opt/stack/data/nova/instances/0ff0511e-6af4-400b-ac42-5ebd3b37d2b9/disk.config
May 21 01:56:03.386050 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ecf25bc4-b32d-4627-9571-f98869b227f9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4i9xbamb {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:56:03.396742 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0ff0511e-6af4-400b-ac42-5ebd3b37d2b9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzkuq_b3z {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:56:03.423164 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ecf25bc4-b32d-4627-9571-f98869b227f9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4i9xbamb" returned: 0 in 0.037s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:56:03.430409 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0ff0511e-6af4-400b-ac42-5ebd3b37d2b9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzkuq_b3z" returned: 0 in 0.034s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:56:03.486819 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] End _get_guest_xml xml=<domain type="qemu">
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:   <uuid>98ace73f-7d4b-4aed-9355-a39c58f9b024</uuid>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:   <name>instance-00000005</name>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:   <metadata>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:       <nova:name>tempest-TestMultiAttachVolumeSwap-server-606274888-2</nova:name>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 01:56:02</nova:creationTime>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:       </nova:image>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:         <nova:user uuid="c56a0e645a214e379f2c5ad75804fadc">tempest-TestMultiAttachVolumeSwap-1388661881-project-member</nova:user>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:         <nova:project uuid="e35d2fe45bb24d2b9f7b547352683fd4">tempest-TestMultiAttachVolumeSwap-1388661881</nova:project>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:         <nova:port uuid="a36c9ce2-1986-45f2-b2bd-e0bbf396d67a">
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:         </nova:port>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:   </metadata>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:     <system>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:       <entry name="serial">98ace73f-7d4b-4aed-9355-a39c58f9b024</entry>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:       <entry name="uuid">98ace73f-7d4b-4aed-9355-a39c58f9b024</entry>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:     </system>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:   <os>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:   </os>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:   <features>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:     <acpi/>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:     <tcg>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:     </tcg>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:   </features>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:   <devices>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/98ace73f-7d4b-4aed-9355-a39c58f9b024/disk"/>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:     </disk>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/98ace73f-7d4b-4aed-9355-a39c58f9b024/disk.config"/>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:     </disk>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:ee:ec:8e"/>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:       <target dev="tapa36c9ce2-19"/>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:     </interface>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/98ace73f-7d4b-4aed-9355-a39c58f9b024/console.log" append="off"/>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:     </serial>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:     <video>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:     </video>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:     </rng>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:     </memballoon>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:   </devices>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]: </domain>
May 21 01:56:03.486819 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 01:56:03.488922 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Preparing to wait for external event network-vif-plugged-a36c9ce2-1986-45f2-b2bd-e0bbf396d67a {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 01:56:03.488922 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Acquiring lock "98ace73f-7d4b-4aed-9355-a39c58f9b024-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:03.488922 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "98ace73f-7d4b-4aed-9355-a39c58f9b024-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:03.488922 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "98ace73f-7d4b-4aed-9355-a39c58f9b024-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:03.489397 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T01:55:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-606274888-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testmultiattachvolumeswap-server-606274888-2',id=5,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkI1t/5EzMBU18+t/tHR5dUD+OlbYBlLLvWS5mSolnmuGBIj1zOYGzSPX9mbsUvKL1pRiKCgiPAHoaJG8nciLhkFrHXBDpgmLFyWuKaphBcmlHNhzmWEzLHykc5SM0UfA==',key_name='tempest-keypair-142556595',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e35d2fe45bb24d2b9f7b547352683fd4',ramdisk_id='',reservation_id='r-8tc20l86',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-1388661881',owner_user_name='tempest-TestMultiAttachVolumeSwap-1388661881-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:55:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c56a0e645a214e379f2c5ad75804fadc',uuid=98ace73f-7d4b-4aed-9355-a39c58f9b024,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a36c9ce2-1986-45f2-b2bd-e0bbf396d67a", "address": "fa:16:3e:ee:ec:8e", "network": {"id": "97eda448-6d12-4aa9-b1f2-150d371463f1", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-343348586-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e35d2fe45bb24d2b9f7b547352683fd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36c9ce2-19", "ovs_interfaceid": "a36c9ce2-1986-45f2-b2bd-e0bbf396d67a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 01:56:03.489634 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Converting VIF {"id": "a36c9ce2-1986-45f2-b2bd-e0bbf396d67a", "address": "fa:16:3e:ee:ec:8e", "network": {"id": "97eda448-6d12-4aa9-b1f2-150d371463f1", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-343348586-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e35d2fe45bb24d2b9f7b547352683fd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36c9ce2-19", "ovs_interfaceid": "a36c9ce2-1986-45f2-b2bd-e0bbf396d67a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:56:03.490328 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:ec:8e,bridge_name='br-int',has_traffic_filtering=True,id=a36c9ce2-1986-45f2-b2bd-e0bbf396d67a,network=Network(97eda448-6d12-4aa9-b1f2-150d371463f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa36c9ce2-19') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:56:03.490609 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:ec:8e,bridge_name='br-int',has_traffic_filtering=True,id=a36c9ce2-1986-45f2-b2bd-e0bbf396d67a,network=Network(97eda448-6d12-4aa9-b1f2-150d371463f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa36c9ce2-19') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 01:56:03.491315 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:03.491750 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:56:03.491961 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 01:56:03.493773 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:03.493981 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2b64faf7-dc93-5bb8-ad15-8527dddd58ed', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:56:03.495544 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:03.497362 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:56:03.505041 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:03.507738 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:03.507897 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa36c9ce2-19, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:56:03.508316 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa36c9ce2-19, col_values=(('qos', UUID('e97d6105-5dd7-4586-9e96-dc600aaef1a2')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:56:03.508523 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa36c9ce2-19, col_values=(('external_ids', {'iface-id': 'a36c9ce2-1986-45f2-b2bd-e0bbf396d67a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:ec:8e', 'vm-uuid': '98ace73f-7d4b-4aed-9355-a39c58f9b024'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:56:03.509342 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:03.510897 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:56:03.525403 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:03.527557 np0000001127 nova-compute[98206]: INFO os_vif [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:ec:8e,bridge_name='br-int',has_traffic_filtering=True,id=a36c9ce2-1986-45f2-b2bd-e0bbf396d67a,network=Network(97eda448-6d12-4aa9-b1f2-150d371463f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa36c9ce2-19')
May 21 01:56:03.818965 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 01:56:03.916601 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:56:04.061532 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:04.194158 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:04.221898 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:04.225324 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:04.286496 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Updating instance_info_cache with network_info: [{"id": "8899a68b-fb77-4ac9-a9f0-ca811560c63a", "address": "fa:16:3e:a0:e8:cd", "network": {"id": "238a16b8-acf2-4255-ae1c-da1966d4d253", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2105742351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cad39cb6391143989b2404dc66ddfe0f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8899a68b-fb", "ovs_interfaceid": "8899a68b-fb77-4ac9-a9f0-ca811560c63a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:56:04.311243 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:04.340851 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:04.420789 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:04.430568 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:04.430568 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:04.435639 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 01:56:04.435837 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Claim successful on node np0000001127
May 21 01:56:04.562967 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:04.612606 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:04.623796 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:04.649995 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:04.661146 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:04.787591 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Releasing lock "refresh_cache-cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:56:04.788043 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Instance network_info: |[{"id": "8899a68b-fb77-4ac9-a9f0-ca811560c63a", "address": "fa:16:3e:a0:e8:cd", "network": {"id": "238a16b8-acf2-4255-ae1c-da1966d4d253", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2105742351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cad39cb6391143989b2404dc66ddfe0f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8899a68b-fb", "ovs_interfaceid": "8899a68b-fb77-4ac9-a9f0-ca811560c63a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 01:56:04.790827 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Start _get_guest_xml network_info=[{"id": "8899a68b-fb77-4ac9-a9f0-ca811560c63a", "address": "fa:16:3e:a0:e8:cd", "network": {"id": "238a16b8-acf2-4255-ae1c-da1966d4d253", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2105742351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cad39cb6391143989b2404dc66ddfe0f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8899a68b-fb", "ovs_interfaceid": "8899a68b-fb77-4ac9-a9f0-ca811560c63a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 01:56:04.795825 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 01:56:04.798118 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-VolumesAssistedSnapshotsTest-server-486234569', uuid='cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6'), owner=OwnerMeta(userid='7e8c7a79a5dd43789d70c36281b15410', username='tempest-VolumesAssistedSnapshotsTest-721813794-project-member', projectid='cad39cb6391143989b2404dc66ddfe0f', projectname='tempest-VolumesAssistedSnapshotsTest-721813794'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8899a68b-fb77-4ac9-a9f0-ca811560c63a", "address": "fa:16:3e:a0:e8:cd", "network": {"id": "238a16b8-acf2-4255-ae1c-da1966d4d253", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2105742351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cad39cb6391143989b2404dc66ddfe0f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8899a68b-fb", "ovs_interfaceid": "8899a68b-fb77-4ac9-a9f0-ca811560c63a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328564.7973914) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 01:56:04.801130 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 01:56:04.801130 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 01:56:04.804529 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 01:56:04.804529 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 01:56:04.804529 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 01:56:04.804529 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 01:56:04.804833 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 01:56:04.804833 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 01:56:04.804904 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 01:56:04.805006 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 01:56:04.805219 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 01:56:04.805391 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 01:56:04.805608 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 01:56:04.805773 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 01:56:04.805946 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 01:56:04.806026 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 01:56:04.818581 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T01:55:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-486234569',display_name='tempest-VolumesAssistedSnapshotsTest-server-486234569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumesassistedsnapshotstest-server-486234569',id=6,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMtmJlkhzofbSXWsEHNxPuvNdANVXCTOB5PF9eDpfc0ruM8X0Wm/lEsWnhE+8tHid0hepS7VXnnTdMkhsH8RrJqUGyNDzNytnLvhZ2ORogdCCYGCcCRU2TIXemM3kDSrQ==',key_name='tempest-keypair-509839513',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cad39cb6391143989b2404dc66ddfe0f',ramdisk_id='',reservation_id='r-re8topj0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-721813794',owner_user_name='tempest-VolumesAssistedSnapshotsTest-721813794-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:56:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e8c7a79a5dd43789d70c36281b15410',uuid=cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8899a68b-fb77-4ac9-a9f0-ca811560c63a", "address": "fa:16:3e:a0:e8:cd", "network": {"id": "238a16b8-acf2-4255-ae1c-da1966d4d253", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2105742351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cad39cb6391143989b2404dc66ddfe0f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8899a68b-fb", "ovs_interfaceid": "8899a68b-fb77-4ac9-a9f0-ca811560c63a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 01:56:04.818776 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Converting VIF {"id": "8899a68b-fb77-4ac9-a9f0-ca811560c63a", "address": "fa:16:3e:a0:e8:cd", "network": {"id": "238a16b8-acf2-4255-ae1c-da1966d4d253", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2105742351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cad39cb6391143989b2404dc66ddfe0f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8899a68b-fb", "ovs_interfaceid": "8899a68b-fb77-4ac9-a9f0-ca811560c63a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:56:04.819284 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:e8:cd,bridge_name='br-int',has_traffic_filtering=True,id=8899a68b-fb77-4ac9-a9f0-ca811560c63a,network=Network(238a16b8-acf2-4255-ae1c-da1966d4d253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8899a68b-fb') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:56:04.819953 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Lazy-loading 'pci_devices' on Instance uuid cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:56:05.030257 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-aac6a874-25ab-4bb4-a007-d22766f941c1 req-ca3f69ab-7445-4488-8319-e9119db4adcd service nova] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Received event network-vif-unplugged-a36c9ce2-1986-45f2-b2bd-e0bbf396d67a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:56:05.030507 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-aac6a874-25ab-4bb4-a007-d22766f941c1 req-ca3f69ab-7445-4488-8319-e9119db4adcd service nova] Acquiring lock "98ace73f-7d4b-4aed-9355-a39c58f9b024-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:05.030825 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-aac6a874-25ab-4bb4-a007-d22766f941c1 req-ca3f69ab-7445-4488-8319-e9119db4adcd service nova] Lock "98ace73f-7d4b-4aed-9355-a39c58f9b024-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:05.030913 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-aac6a874-25ab-4bb4-a007-d22766f941c1 req-ca3f69ab-7445-4488-8319-e9119db4adcd service nova] Lock "98ace73f-7d4b-4aed-9355-a39c58f9b024-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:05.031213 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-aac6a874-25ab-4bb4-a007-d22766f941c1 req-ca3f69ab-7445-4488-8319-e9119db4adcd service nova] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] No event matching network-vif-unplugged-a36c9ce2-1986-45f2-b2bd-e0bbf396d67a in dict_keys([('network-vif-plugged', 'a36c9ce2-1986-45f2-b2bd-e0bbf396d67a')]) {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 21 01:56:05.031213 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-aac6a874-25ab-4bb4-a007-d22766f941c1 req-ca3f69ab-7445-4488-8319-e9119db4adcd service nova] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Received unexpected event network-vif-unplugged-a36c9ce2-1986-45f2-b2bd-e0bbf396d67a for instance with vm_state building and task_state spawning.
May 21 01:56:05.055726 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:56:05.055726 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:56:05.055726 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] No VIF found with MAC fa:16:3e:ee:ec:8e, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 01:56:05.055726 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Using config drive
May 21 01:56:05.137396 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:05.144088 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:05.148616 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:05.167957 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:05.176038 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:05.256448 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2cb197dd-2bf7-4239-b4ff-377d2af794f2 req-5aabd6c6-966d-4ab6-902e-9887a7822b08 service nova] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Received event network-vif-plugged-30254ddf-7ff6-4428-817c-93ea13bd4dcd {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:56:05.256632 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2cb197dd-2bf7-4239-b4ff-377d2af794f2 req-5aabd6c6-966d-4ab6-902e-9887a7822b08 service nova] Acquiring lock "ecf25bc4-b32d-4627-9571-f98869b227f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:05.256800 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2cb197dd-2bf7-4239-b4ff-377d2af794f2 req-5aabd6c6-966d-4ab6-902e-9887a7822b08 service nova] Lock "ecf25bc4-b32d-4627-9571-f98869b227f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:05.256908 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2cb197dd-2bf7-4239-b4ff-377d2af794f2 req-5aabd6c6-966d-4ab6-902e-9887a7822b08 service nova] Lock "ecf25bc4-b32d-4627-9571-f98869b227f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:05.257023 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2cb197dd-2bf7-4239-b4ff-377d2af794f2 req-5aabd6c6-966d-4ab6-902e-9887a7822b08 service nova] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Processing event network-vif-plugged-30254ddf-7ff6-4428-817c-93ea13bd4dcd {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 01:56:05.257144 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2cb197dd-2bf7-4239-b4ff-377d2af794f2 req-5aabd6c6-966d-4ab6-902e-9887a7822b08 service nova] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Received event network-vif-plugged-30254ddf-7ff6-4428-817c-93ea13bd4dcd {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:56:05.257270 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2cb197dd-2bf7-4239-b4ff-377d2af794f2 req-5aabd6c6-966d-4ab6-902e-9887a7822b08 service nova] Acquiring lock "ecf25bc4-b32d-4627-9571-f98869b227f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:05.257364 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2cb197dd-2bf7-4239-b4ff-377d2af794f2 req-5aabd6c6-966d-4ab6-902e-9887a7822b08 service nova] Lock "ecf25bc4-b32d-4627-9571-f98869b227f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:05.257537 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2cb197dd-2bf7-4239-b4ff-377d2af794f2 req-5aabd6c6-966d-4ab6-902e-9887a7822b08 service nova] Lock "ecf25bc4-b32d-4627-9571-f98869b227f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:05.257645 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2cb197dd-2bf7-4239-b4ff-377d2af794f2 req-5aabd6c6-966d-4ab6-902e-9887a7822b08 service nova] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] No waiting events found dispatching network-vif-plugged-30254ddf-7ff6-4428-817c-93ea13bd4dcd {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:56:05.257689 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-2cb197dd-2bf7-4239-b4ff-377d2af794f2 req-5aabd6c6-966d-4ab6-902e-9887a7822b08 service nova] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Received unexpected event network-vif-plugged-30254ddf-7ff6-4428-817c-93ea13bd4dcd for instance with vm_state building and task_state spawning.
May 21 01:56:05.258934 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2cb197dd-2bf7-4239-b4ff-377d2af794f2 req-5aabd6c6-966d-4ab6-902e-9887a7822b08 service nova] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Received event network-vif-plugged-db141707-155b-4d59-b771-0ff876e50cc4 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:56:05.258934 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2cb197dd-2bf7-4239-b4ff-377d2af794f2 req-5aabd6c6-966d-4ab6-902e-9887a7822b08 service nova] Acquiring lock "0ff0511e-6af4-400b-ac42-5ebd3b37d2b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:05.258934 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2cb197dd-2bf7-4239-b4ff-377d2af794f2 req-5aabd6c6-966d-4ab6-902e-9887a7822b08 service nova] Lock "0ff0511e-6af4-400b-ac42-5ebd3b37d2b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:05.258934 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2cb197dd-2bf7-4239-b4ff-377d2af794f2 req-5aabd6c6-966d-4ab6-902e-9887a7822b08 service nova] Lock "0ff0511e-6af4-400b-ac42-5ebd3b37d2b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:05.258934 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2cb197dd-2bf7-4239-b4ff-377d2af794f2 req-5aabd6c6-966d-4ab6-902e-9887a7822b08 service nova] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Processing event network-vif-plugged-db141707-155b-4d59-b771-0ff876e50cc4 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 01:56:05.258934 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2cb197dd-2bf7-4239-b4ff-377d2af794f2 req-5aabd6c6-966d-4ab6-902e-9887a7822b08 service nova] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Received event network-vif-plugged-db141707-155b-4d59-b771-0ff876e50cc4 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:56:05.258934 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2cb197dd-2bf7-4239-b4ff-377d2af794f2 req-5aabd6c6-966d-4ab6-902e-9887a7822b08 service nova] Acquiring lock "0ff0511e-6af4-400b-ac42-5ebd3b37d2b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:05.259348 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2cb197dd-2bf7-4239-b4ff-377d2af794f2 req-5aabd6c6-966d-4ab6-902e-9887a7822b08 service nova] Lock "0ff0511e-6af4-400b-ac42-5ebd3b37d2b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:05.259501 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2cb197dd-2bf7-4239-b4ff-377d2af794f2 req-5aabd6c6-966d-4ab6-902e-9887a7822b08 service nova] Lock "0ff0511e-6af4-400b-ac42-5ebd3b37d2b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:05.259619 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2cb197dd-2bf7-4239-b4ff-377d2af794f2 req-5aabd6c6-966d-4ab6-902e-9887a7822b08 service nova] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] No waiting events found dispatching network-vif-plugged-db141707-155b-4d59-b771-0ff876e50cc4 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:56:05.259738 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-2cb197dd-2bf7-4239-b4ff-377d2af794f2 req-5aabd6c6-966d-4ab6-902e-9887a7822b08 service nova] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Received unexpected event network-vif-plugged-db141707-155b-4d59-b771-0ff876e50cc4 for instance with vm_state building and task_state spawning.
May 21 01:56:05.323687 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] End _get_guest_xml xml=<domain type="qemu">
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:   <uuid>cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6</uuid>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:   <name>instance-00000006</name>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:   <metadata>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-486234569</nova:name>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 01:56:04</nova:creationTime>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:       </nova:image>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:         <nova:user uuid="7e8c7a79a5dd43789d70c36281b15410">tempest-VolumesAssistedSnapshotsTest-721813794-project-member</nova:user>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:         <nova:project uuid="cad39cb6391143989b2404dc66ddfe0f">tempest-VolumesAssistedSnapshotsTest-721813794</nova:project>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:         <nova:port uuid="8899a68b-fb77-4ac9-a9f0-ca811560c63a">
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:         </nova:port>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:   </metadata>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:     <system>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:       <entry name="serial">cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6</entry>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:       <entry name="uuid">cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6</entry>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:     </system>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:   <os>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:   </os>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:   <features>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:     <acpi/>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:     <tcg>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:     </tcg>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:   </features>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:   <devices>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6/disk"/>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:     </disk>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6/disk.config"/>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:     </disk>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:a0:e8:cd"/>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:       <target dev="tap8899a68b-fb"/>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:     </interface>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6/console.log" append="off"/>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:     </serial>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:     <video>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:     </video>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:     </rng>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:     </memballoon>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:   </devices>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]: </domain>
May 21 01:56:05.323687 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 01:56:05.326736 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Preparing to wait for external event network-vif-plugged-8899a68b-fb77-4ac9-a9f0-ca811560c63a {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 01:56:05.326736 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Acquiring lock "cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:05.326736 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Lock "cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:05.326736 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Lock "cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:05.326736 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T01:55:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-486234569',display_name='tempest-VolumesAssistedSnapshotsTest-server-486234569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumesassistedsnapshotstest-server-486234569',id=6,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMtmJlkhzofbSXWsEHNxPuvNdANVXCTOB5PF9eDpfc0ruM8X0Wm/lEsWnhE+8tHid0hepS7VXnnTdMkhsH8RrJqUGyNDzNytnLvhZ2ORogdCCYGCcCRU2TIXemM3kDSrQ==',key_name='tempest-keypair-509839513',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cad39cb6391143989b2404dc66ddfe0f',ramdisk_id='',reservation_id='r-re8topj0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-721813794',owner_user_name='tempest-VolumesAssistedSnapshotsTest-721813794-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:56:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e8c7a79a5dd43789d70c36281b15410',uuid=cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8899a68b-fb77-4ac9-a9f0-ca811560c63a", "address": "fa:16:3e:a0:e8:cd", "network": {"id": "238a16b8-acf2-4255-ae1c-da1966d4d253", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2105742351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cad39cb6391143989b2404dc66ddfe0f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8899a68b-fb", "ovs_interfaceid": "8899a68b-fb77-4ac9-a9f0-ca811560c63a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 01:56:05.327050 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Converting VIF {"id": "8899a68b-fb77-4ac9-a9f0-ca811560c63a", "address": "fa:16:3e:a0:e8:cd", "network": {"id": "238a16b8-acf2-4255-ae1c-da1966d4d253", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2105742351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cad39cb6391143989b2404dc66ddfe0f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8899a68b-fb", "ovs_interfaceid": "8899a68b-fb77-4ac9-a9f0-ca811560c63a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:56:05.327050 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:e8:cd,bridge_name='br-int',has_traffic_filtering=True,id=8899a68b-fb77-4ac9-a9f0-ca811560c63a,network=Network(238a16b8-acf2-4255-ae1c-da1966d4d253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8899a68b-fb') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:56:05.327050 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:e8:cd,bridge_name='br-int',has_traffic_filtering=True,id=8899a68b-fb77-4ac9-a9f0-ca811560c63a,network=Network(238a16b8-acf2-4255-ae1c-da1966d4d253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8899a68b-fb') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 01:56:05.327351 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:05.327562 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:56:05.327900 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 01:56:05.328558 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:05.328835 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'df3865aa-ea98-549e-a16d-6ad52510d0f8', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:56:05.329354 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:05.330271 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:56:05.336065 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:05.340521 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:05.340750 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8899a68b-fb, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:56:05.340933 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8899a68b-fb, col_values=(('qos', UUID('fa8e8803-d0ef-4838-b1ff-5e949750984e')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:56:05.341139 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8899a68b-fb, col_values=(('external_ids', {'iface-id': '8899a68b-fb77-4ac9-a9f0-ca811560c63a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:e8:cd', 'vm-uuid': 'cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:56:05.341900 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:05.344589 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:56:05.354512 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:05.356256 np0000001127 nova-compute[98206]: INFO os_vif [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:e8:cd,bridge_name='br-int',has_traffic_filtering=True,id=8899a68b-fb77-4ac9-a9f0-ca811560c63a,network=Network(238a16b8-acf2-4255-ae1c-da1966d4d253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8899a68b-fb')
May 21 01:56:05.457088 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328565.4564292, 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:56:05.457088 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] VM Started (Lifecycle Event)
May 21 01:56:05.459095 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 01:56:05.462196 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 01:56:05.462538 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 01:56:05.464790 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 01:56:05.466561 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Instance spawned successfully.
May 21 01:56:05.467193 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Instance spawned successfully.
May 21 01:56:05.468860 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 01:56:05.469985 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 01:56:05.562990 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:05.808646 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Creating config drive at /opt/stack/data/nova/instances/98ace73f-7d4b-4aed-9355-a39c58f9b024/disk.config
May 21 01:56:05.818530 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/98ace73f-7d4b-4aed-9355-a39c58f9b024/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1g9s6ldo {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:56:05.865277 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/98ace73f-7d4b-4aed-9355-a39c58f9b024/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1g9s6ldo" returned: 0 in 0.046s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:56:05.960932 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:56:05.969023 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:56:05.986438 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:05.986438 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:05.986438 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:05.986808 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:05.986877 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:05.987131 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:06.006004 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:06.012538 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:06.012538 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:06.012538 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:06.012538 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:06.012782 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:06.013354 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:06.030969 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:56:06.033226 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:56:06.396422 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:06.427980 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:06.480194 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 01:56:06.480462 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328566.4802325, 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:56:06.480669 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] VM Paused (Lifecycle Event)
May 21 01:56:06.524505 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Took 11.37 seconds to spawn the instance on the hypervisor.
May 21 01:56:06.528633 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Took 8.92 seconds to spawn the instance on the hypervisor.
May 21 01:56:06.528633 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:56:06.529437 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:56:06.531562 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:06.535943 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:56:06.575128 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:06.581571 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:06.888131 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:56:06.888131 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:56:06.888278 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] No VIF found with MAC fa:16:3e:a0:e8:cd, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 01:56:06.888658 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Using config drive
May 21 01:56:06.984587 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:56:06.990108 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328566.9898002, ecf25bc4-b32d-4627-9571-f98869b227f9 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:56:06.990323 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] VM Started (Lifecycle Event)
May 21 01:56:07.056552 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.628s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:07.057384 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 01:56:07.061562 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Took 20.92 seconds to build instance.
May 21 01:56:07.068093 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Took 21.22 seconds to build instance.
May 21 01:56:07.122810 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c6474c2b-17e9-4108-8433-21ee26445509 req-b710dfb6-d6b1-469a-9c0d-1fd56b28f34d service nova] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Received event network-vif-plugged-a36c9ce2-1986-45f2-b2bd-e0bbf396d67a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:56:07.123569 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c6474c2b-17e9-4108-8433-21ee26445509 req-b710dfb6-d6b1-469a-9c0d-1fd56b28f34d service nova] Acquiring lock "98ace73f-7d4b-4aed-9355-a39c58f9b024-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:07.126497 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c6474c2b-17e9-4108-8433-21ee26445509 req-b710dfb6-d6b1-469a-9c0d-1fd56b28f34d service nova] Lock "98ace73f-7d4b-4aed-9355-a39c58f9b024-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:07.126497 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c6474c2b-17e9-4108-8433-21ee26445509 req-b710dfb6-d6b1-469a-9c0d-1fd56b28f34d service nova] Lock "98ace73f-7d4b-4aed-9355-a39c58f9b024-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:07.126497 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c6474c2b-17e9-4108-8433-21ee26445509 req-b710dfb6-d6b1-469a-9c0d-1fd56b28f34d service nova] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Processing event network-vif-plugged-a36c9ce2-1986-45f2-b2bd-e0bbf396d67a {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 01:56:07.126497 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c6474c2b-17e9-4108-8433-21ee26445509 req-b710dfb6-d6b1-469a-9c0d-1fd56b28f34d service nova] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Received event network-vif-plugged-a36c9ce2-1986-45f2-b2bd-e0bbf396d67a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:56:07.126497 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c6474c2b-17e9-4108-8433-21ee26445509 req-b710dfb6-d6b1-469a-9c0d-1fd56b28f34d service nova] Acquiring lock "98ace73f-7d4b-4aed-9355-a39c58f9b024-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:07.126497 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c6474c2b-17e9-4108-8433-21ee26445509 req-b710dfb6-d6b1-469a-9c0d-1fd56b28f34d service nova] Lock "98ace73f-7d4b-4aed-9355-a39c58f9b024-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:07.126497 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c6474c2b-17e9-4108-8433-21ee26445509 req-b710dfb6-d6b1-469a-9c0d-1fd56b28f34d service nova] Lock "98ace73f-7d4b-4aed-9355-a39c58f9b024-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:07.126497 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c6474c2b-17e9-4108-8433-21ee26445509 req-b710dfb6-d6b1-469a-9c0d-1fd56b28f34d service nova] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] No waiting events found dispatching network-vif-plugged-a36c9ce2-1986-45f2-b2bd-e0bbf396d67a {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:56:07.126497 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-c6474c2b-17e9-4108-8433-21ee26445509 req-b710dfb6-d6b1-469a-9c0d-1fd56b28f34d service nova] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Received unexpected event network-vif-plugged-a36c9ce2-1986-45f2-b2bd-e0bbf396d67a for instance with vm_state building and task_state spawning.
May 21 01:56:07.388770 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 01:56:07.391455 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 01:56:07.401801 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:07.412586 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Instance spawned successfully.
May 21 01:56:07.412586 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 01:56:07.493169 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:56:07.495439 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:56:07.567455 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 01:56:07.568277 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 01:56:07.568532 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:07.568786 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:07.571795 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "ecf25bc4-b32d-4627-9571-f98869b227f9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.440s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:07.573725 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Lock "0ff0511e-6af4-400b-ac42-5ebd3b37d2b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.745s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:07.597555 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Creating config drive at /opt/stack/data/nova/instances/cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6/disk.config
May 21 01:56:07.603515 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3bo4siso {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:56:07.653242 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3bo4siso" returned: 0 in 0.049s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:56:07.684161 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bbcd1a81252344dd804a4080571f8751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15fe7a70464159a778cffa4a36c36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 01:56:07.922548 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:07.922781 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:07.923306 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:07.924028 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:07.924451 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:07.924989 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:07.998563 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328567.9981086, ecf25bc4-b32d-4627-9571-f98869b227f9 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:56:08.000283 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] VM Paused (Lifecycle Event)
May 21 01:56:08.071933 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 01:56:08.189213 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:08.208090 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:08.321556 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:08.333843 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Successfully created port: 8b22719a-06e5-4d47-9e5c-66aa0c497f52 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 01:56:08.432288 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Took 8.41 seconds to spawn the instance on the hypervisor.
May 21 01:56:08.432785 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:56:08.504998 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:56:08.509035 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328568.5087428, 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:56:08.509209 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] VM Resumed (Lifecycle Event)
May 21 01:56:08.575787 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 01:56:08.594444 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:08.601280 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:08.606299 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:08.611753 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:08.630328 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:08.953807 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Took 22.77 seconds to build instance.
May 21 01:56:08.968800 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e31ba064-789e-4b4f-ab17-e05393dde039 req-acbfa021-7544-4a0f-aa67-c40bcf700f10 service nova] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Received event network-vif-plugged-8899a68b-fb77-4ac9-a9f0-ca811560c63a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:56:08.969180 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e31ba064-789e-4b4f-ab17-e05393dde039 req-acbfa021-7544-4a0f-aa67-c40bcf700f10 service nova] Acquiring lock "cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:08.969356 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e31ba064-789e-4b4f-ab17-e05393dde039 req-acbfa021-7544-4a0f-aa67-c40bcf700f10 service nova] Lock "cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:08.969565 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e31ba064-789e-4b4f-ab17-e05393dde039 req-acbfa021-7544-4a0f-aa67-c40bcf700f10 service nova] Lock "cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:08.969748 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e31ba064-789e-4b4f-ab17-e05393dde039 req-acbfa021-7544-4a0f-aa67-c40bcf700f10 service nova] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Processing event network-vif-plugged-8899a68b-fb77-4ac9-a9f0-ca811560c63a {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 01:56:09.014217 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:56:09.018407 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:56:09.048663 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Successfully updated port: 8b22719a-06e5-4d47-9e5c-66aa0c497f52 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 01:56:09.286260 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b0dcf088-fa8f-4eba-8b74-8a624b30a79e req-30d1c81f-4624-4508-967c-5e45c5f1941a service nova] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Received event network-changed-8b22719a-06e5-4d47-9e5c-66aa0c497f52 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:56:09.286260 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b0dcf088-fa8f-4eba-8b74-8a624b30a79e req-30d1c81f-4624-4508-967c-5e45c5f1941a service nova] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Refreshing instance network info cache due to event network-changed-8b22719a-06e5-4d47-9e5c-66aa0c497f52. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:56:09.286355 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b0dcf088-fa8f-4eba-8b74-8a624b30a79e req-30d1c81f-4624-4508-967c-5e45c5f1941a service nova] Acquiring lock "refresh_cache-29a124ee-2b8c-4f44-8f91-8dd11ac78b52" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:56:09.286548 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b0dcf088-fa8f-4eba-8b74-8a624b30a79e req-30d1c81f-4624-4508-967c-5e45c5f1941a service nova] Acquired lock "refresh_cache-29a124ee-2b8c-4f44-8f91-8dd11ac78b52" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:56:09.286689 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-b0dcf088-fa8f-4eba-8b74-8a624b30a79e req-30d1c81f-4624-4508-967c-5e45c5f1941a service nova] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Refreshing network info cache for port 8b22719a-06e5-4d47-9e5c-66aa0c497f52 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:56:09.307004 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:09.359509 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 01:56:09.363770 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 01:56:09.369501 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Instance spawned successfully.
May 21 01:56:09.369501 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 01:56:09.461628 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aac4993d-0dd1-4e32-b222-5ca11f546286 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "98ace73f-7d4b-4aed-9355-a39c58f9b024" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.290s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:09.520943 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328569.5205324, ecf25bc4-b32d-4627-9571-f98869b227f9 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:56:09.521075 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] VM Resumed (Lifecycle Event)
May 21 01:56:09.551742 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "refresh_cache-29a124ee-2b8c-4f44-8f91-8dd11ac78b52" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:56:09.584837 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 01:56:09.586118 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 01:56:09.586455 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Creating image(s)
May 21 01:56:09.587207 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "/opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:09.587535 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "/opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:09.588264 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "/opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:09.589047 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:56:09.592539 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:56:09.594849 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:56:09.688764 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.093s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:56:09.689323 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:09.690027 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:09.695009 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:56:09.701601 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:56:09.702756 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:56:09.790145 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-b0dcf088-fa8f-4eba-8b74-8a624b30a79e req-30d1c81f-4624-4508-967c-5e45c5f1941a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:09.797723 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.095s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:56:09.798028 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:56:09.840491 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk 1073741824" returned: 0 in 0.042s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:56:09.841757 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.152s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:09.842425 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:56:09.883082 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:09.883320 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:09.883848 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:09.884124 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:09.884387 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:09.886829 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:09.939408 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.097s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:56:09.941058 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Checking if we can resize image /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 01:56:09.941489 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:56:09.974698 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-b0dcf088-fa8f-4eba-8b74-8a624b30a79e req-30d1c81f-4624-4508-967c-5e45c5f1941a service nova] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:56:10.026725 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:56:10.030306 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:56:10.069237 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:56:10.069690 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Cannot resize image /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 01:56:10.069992 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 01:56:10.070175 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Ensure instance console log exists: /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 01:56:10.070460 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:10.070646 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:10.070729 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:10.248519 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-b0dcf088-fa8f-4eba-8b74-8a624b30a79e req-30d1c81f-4624-4508-967c-5e45c5f1941a service nova] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:56:10.342711 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:10.400960 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Took 7.99 seconds to spawn the instance on the hypervisor.
May 21 01:56:10.400960 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:56:10.438003 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-940753c4-aae2-455d-8853-65cdd36ec31b tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Acquiring lock "0ff0511e-6af4-400b-ac42-5ebd3b37d2b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:10.438389 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-940753c4-aae2-455d-8853-65cdd36ec31b tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Lock "0ff0511e-6af4-400b-ac42-5ebd3b37d2b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:10.441917 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-940753c4-aae2-455d-8853-65cdd36ec31b tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Acquiring lock "0ff0511e-6af4-400b-ac42-5ebd3b37d2b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:10.441917 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-940753c4-aae2-455d-8853-65cdd36ec31b tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Lock "0ff0511e-6af4-400b-ac42-5ebd3b37d2b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:10.441917 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-940753c4-aae2-455d-8853-65cdd36ec31b tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Lock "0ff0511e-6af4-400b-ac42-5ebd3b37d2b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:10.442785 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-940753c4-aae2-455d-8853-65cdd36ec31b tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Terminating instance
May 21 01:56:10.540366 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328570.5399015, 98ace73f-7d4b-4aed-9355-a39c58f9b024 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:56:10.540835 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] VM Started (Lifecycle Event)
May 21 01:56:10.751976 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b0dcf088-fa8f-4eba-8b74-8a624b30a79e req-30d1c81f-4624-4508-967c-5e45c5f1941a service nova] Releasing lock "refresh_cache-29a124ee-2b8c-4f44-8f91-8dd11ac78b52" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:56:10.752322 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquired lock "refresh_cache-29a124ee-2b8c-4f44-8f91-8dd11ac78b52" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:56:10.752482 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 01:56:10.916499 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Took 24.35 seconds to build instance.
May 21 01:56:10.954015 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-940753c4-aae2-455d-8853-65cdd36ec31b tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 01:56:10.969757 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:10.976666 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:10.993205 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:11.001956 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:11.006046 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:11.033528 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:11.044343 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:56:11.051886 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:56:11.101081 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2031bdf4-819b-4429-b0e7-940e3df7fd28 req-a4eb328b-bd60-4302-a6f0-45e0065dab5b service nova] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Received event network-vif-plugged-8899a68b-fb77-4ac9-a9f0-ca811560c63a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:56:11.101081 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2031bdf4-819b-4429-b0e7-940e3df7fd28 req-a4eb328b-bd60-4302-a6f0-45e0065dab5b service nova] Acquiring lock "cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:11.101081 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2031bdf4-819b-4429-b0e7-940e3df7fd28 req-a4eb328b-bd60-4302-a6f0-45e0065dab5b service nova] Lock "cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:11.102058 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2031bdf4-819b-4429-b0e7-940e3df7fd28 req-a4eb328b-bd60-4302-a6f0-45e0065dab5b service nova] Lock "cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:11.102058 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2031bdf4-819b-4429-b0e7-940e3df7fd28 req-a4eb328b-bd60-4302-a6f0-45e0065dab5b service nova] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] No waiting events found dispatching network-vif-plugged-8899a68b-fb77-4ac9-a9f0-ca811560c63a {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:56:11.103518 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-2031bdf4-819b-4429-b0e7-940e3df7fd28 req-a4eb328b-bd60-4302-a6f0-45e0065dab5b service nova] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Received unexpected event network-vif-plugged-8899a68b-fb77-4ac9-a9f0-ca811560c63a for instance with vm_state active and task_state None.
May 21 01:56:11.271729 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:11.272238 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:11.294318 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Instance destroyed successfully.
May 21 01:56:11.294791 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-940753c4-aae2-455d-8853-65cdd36ec31b tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Lazy-loading 'resources' on Instance uuid 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:56:11.364719 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:56:11.425920 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Lock "cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.870s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:11.485109 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:11.556743 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328571.5561628, 98ace73f-7d4b-4aed-9355-a39c58f9b024 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:56:11.557180 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] VM Paused (Lifecycle Event)
May 21 01:56:11.675199 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:11.797804 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-940753c4-aae2-455d-8853-65cdd36ec31b tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:55:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1374653048',display_name='tempest-VolumesAdminNegativeTest-server-1374653048',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumesadminnegativetest-server-1374653048',id=3,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:56:06Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0eb3fa62c3cb4fe08b4a71f7f855e28d',ramdisk_id='',reservation_id='r-zrd31wvw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2137466894',owner_user_name='tempest-VolumesAdminNegativeTest-2137466894-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:56:07Z,user_data=None,user_id='38854e6e21c441928be21d3355213aaa',uuid=0ff0511e-6af4-400b-ac42-5ebd3b37d2b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db141707-155b-4d59-b771-0ff876e50cc4", "address": "fa:16:3e:8c:8d:e7", "network": {"id": "ba4b0dc1-74ba-4a6e-9e71-c06004d67f0e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-606810084-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eb3fa62c3cb4fe08b4a71f7f855e28d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb141707-15", "ovs_interfaceid": "db141707-155b-4d59-b771-0ff876e50cc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 01:56:11.797999 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-940753c4-aae2-455d-8853-65cdd36ec31b tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Converting VIF {"id": "db141707-155b-4d59-b771-0ff876e50cc4", "address": "fa:16:3e:8c:8d:e7", "network": {"id": "ba4b0dc1-74ba-4a6e-9e71-c06004d67f0e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-606810084-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eb3fa62c3cb4fe08b4a71f7f855e28d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb141707-15", "ovs_interfaceid": "db141707-155b-4d59-b771-0ff876e50cc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:56:11.799565 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-940753c4-aae2-455d-8853-65cdd36ec31b tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:8d:e7,bridge_name='br-int',has_traffic_filtering=True,id=db141707-155b-4d59-b771-0ff876e50cc4,network=Network(ba4b0dc1-74ba-4a6e-9e71-c06004d67f0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb141707-15') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:56:11.799565 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-940753c4-aae2-455d-8853-65cdd36ec31b tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:8d:e7,bridge_name='br-int',has_traffic_filtering=True,id=db141707-155b-4d59-b771-0ff876e50cc4,network=Network(ba4b0dc1-74ba-4a6e-9e71-c06004d67f0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb141707-15') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 01:56:11.803370 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:11.803606 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb141707-15, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:56:11.804869 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:11.805939 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:56:11.806850 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:11.807733 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:11.807940 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2d0bfd24-2131-4d16-b3b1-6512c8d151bb) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:56:11.809789 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:11.809789 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:56:11.810576 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:11.818520 np0000001127 nova-compute[98206]: INFO os_vif [None req-940753c4-aae2-455d-8853-65cdd36ec31b tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:8d:e7,bridge_name='br-int',has_traffic_filtering=True,id=db141707-155b-4d59-b771-0ff876e50cc4,network=Network(ba4b0dc1-74ba-4a6e-9e71-c06004d67f0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb141707-15')
May 21 01:56:11.818520 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-940753c4-aae2-455d-8853-65cdd36ec31b tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Deleting instance files /opt/stack/data/nova/instances/0ff0511e-6af4-400b-ac42-5ebd3b37d2b9_del
May 21 01:56:11.818520 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-940753c4-aae2-455d-8853-65cdd36ec31b tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Deletion of /opt/stack/data/nova/instances/0ff0511e-6af4-400b-ac42-5ebd3b37d2b9_del complete
May 21 01:56:11.925541 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Updating instance_info_cache with network_info: [{"id": "8b22719a-06e5-4d47-9e5c-66aa0c497f52", "address": "fa:16:3e:9e:02:16", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b22719a-06", "ovs_interfaceid": "8b22719a-06e5-4d47-9e5c-66aa0c497f52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:56:12.062950 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:56:12.070608 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328572.0702665, 98ace73f-7d4b-4aed-9355-a39c58f9b024 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:56:12.071100 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] VM Resumed (Lifecycle Event)
May 21 01:56:12.326321 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-940753c4-aae2-455d-8853-65cdd36ec31b tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Took 1.37 seconds to destroy the instance on the hypervisor.
May 21 01:56:12.328692 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-940753c4-aae2-455d-8853-65cdd36ec31b tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 01:56:12.328917 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 01:56:12.329189 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 01:56:12.329447 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:12.431543 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Releasing lock "refresh_cache-29a124ee-2b8c-4f44-8f91-8dd11ac78b52" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:56:12.431543 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Instance network_info: |[{"id": "8b22719a-06e5-4d47-9e5c-66aa0c497f52", "address": "fa:16:3e:9e:02:16", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b22719a-06", "ovs_interfaceid": "8b22719a-06e5-4d47-9e5c-66aa0c497f52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 01:56:12.433800 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Start _get_guest_xml network_info=[{"id": "8b22719a-06e5-4d47-9e5c-66aa0c497f52", "address": "fa:16:3e:9e:02:16", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b22719a-06", "ovs_interfaceid": "8b22719a-06e5-4d47-9e5c-66aa0c497f52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 01:56:12.439028 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 01:56:12.440349 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-1997816396', uuid='29a124ee-2b8c-4f44-8f91-8dd11ac78b52'), owner=OwnerMeta(userid='bbcd1a81252344dd804a4080571f8751', username='tempest-ServerActionsTestOtherA-1975191698-project-member', projectid='6a15fe7a70464159a778cffa4a36c36f', projectname='tempest-ServerActionsTestOtherA-1975191698'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8b22719a-06e5-4d47-9e5c-66aa0c497f52", "address": "fa:16:3e:9e:02:16", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b22719a-06", "ovs_interfaceid": "8b22719a-06e5-4d47-9e5c-66aa0c497f52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328572.4399326) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 01:56:12.441328 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 01:56:12.441728 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 01:56:12.443744 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 01:56:12.443932 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 01:56:12.444885 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 01:56:12.451587 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 01:56:12.451587 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 01:56:12.451587 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 01:56:12.451587 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 01:56:12.451587 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 01:56:12.451587 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 01:56:12.451587 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 01:56:12.451587 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 01:56:12.451587 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 01:56:12.451587 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 01:56:12.451587 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 01:56:12.460291 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:12.467984 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T01:56:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1997816396',display_name='tempest-ServerActionsTestOtherA-server-1997816396',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serveractionstestothera-server-1997816396',id=7,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxRidCAMyb/mDvqucBNL6o1pu4ohR9TfsTnx1DGEBK8Hs9Bxy4viDAtOuJAjHZZuWNRGwi0rwlQFKlYKc+oTj/M3U8o3nzcuoUHvHlwyO9ufXio2O1Y8v01hvWMmUCFbg==',key_name='tempest-keypair-631476445',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a15fe7a70464159a778cffa4a36c36f',ramdisk_id='',reservation_id='r-vdyv1106',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1975191698',owner_user_name='tempest-ServerActionsTestOtherA-1975191698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbcd1a81252344dd804a4080571f8751',uuid=29a124ee-2b8c-4f44-8f91-8dd11ac78b52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b22719a-06e5-4d47-9e5c-66aa0c497f52", "address": "fa:16:3e:9e:02:16", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b22719a-06", "ovs_interfaceid": "8b22719a-06e5-4d47-9e5c-66aa0c497f52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 01:56:12.468499 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Converting VIF {"id": "8b22719a-06e5-4d47-9e5c-66aa0c497f52", "address": "fa:16:3e:9e:02:16", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b22719a-06", "ovs_interfaceid": "8b22719a-06e5-4d47-9e5c-66aa0c497f52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:56:12.469192 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:02:16,bridge_name='br-int',has_traffic_filtering=True,id=8b22719a-06e5-4d47-9e5c-66aa0c497f52,network=Network(6d660724-85bf-45e3-895a-b9ce67043c30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b22719a-06') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:56:12.470488 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lazy-loading 'pci_devices' on Instance uuid 29a124ee-2b8c-4f44-8f91-8dd11ac78b52 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:56:12.578219 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:56:12.582137 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:56:12.741815 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f4cec939-b89e-406a-848a-9d3630372471 req-8cd7e900-d671-42b0-9fa7-b84c465e0dfb service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Received event network-vif-unplugged-839e91da-5ffe-451b-bd9d-dfc1cf83ab19 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:56:12.742082 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f4cec939-b89e-406a-848a-9d3630372471 req-8cd7e900-d671-42b0-9fa7-b84c465e0dfb service nova] Acquiring lock "0059a43c-1d34-40a9-af63-b5eca8c30f53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:12.742268 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f4cec939-b89e-406a-848a-9d3630372471 req-8cd7e900-d671-42b0-9fa7-b84c465e0dfb service nova] Lock "0059a43c-1d34-40a9-af63-b5eca8c30f53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:12.742422 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f4cec939-b89e-406a-848a-9d3630372471 req-8cd7e900-d671-42b0-9fa7-b84c465e0dfb service nova] Lock "0059a43c-1d34-40a9-af63-b5eca8c30f53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:12.742719 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f4cec939-b89e-406a-848a-9d3630372471 req-8cd7e900-d671-42b0-9fa7-b84c465e0dfb service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] No event matching network-vif-unplugged-839e91da-5ffe-451b-bd9d-dfc1cf83ab19 in dict_keys([('network-vif-plugged', '839e91da-5ffe-451b-bd9d-dfc1cf83ab19')]) {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 21 01:56:12.742912 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-f4cec939-b89e-406a-848a-9d3630372471 req-8cd7e900-d671-42b0-9fa7-b84c465e0dfb service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Received unexpected event network-vif-unplugged-839e91da-5ffe-451b-bd9d-dfc1cf83ab19 for instance with vm_state building and task_state spawning.
May 21 01:56:12.975220 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] End _get_guest_xml xml=<domain type="qemu">
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:   <uuid>29a124ee-2b8c-4f44-8f91-8dd11ac78b52</uuid>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:   <name>instance-00000007</name>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:   <metadata>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:       <nova:name>tempest-ServerActionsTestOtherA-server-1997816396</nova:name>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 01:56:12</nova:creationTime>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:       </nova:image>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:         <nova:user uuid="bbcd1a81252344dd804a4080571f8751">tempest-ServerActionsTestOtherA-1975191698-project-member</nova:user>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:         <nova:project uuid="6a15fe7a70464159a778cffa4a36c36f">tempest-ServerActionsTestOtherA-1975191698</nova:project>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:         <nova:port uuid="8b22719a-06e5-4d47-9e5c-66aa0c497f52">
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:         </nova:port>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:   </metadata>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:     <system>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:       <entry name="serial">29a124ee-2b8c-4f44-8f91-8dd11ac78b52</entry>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:       <entry name="uuid">29a124ee-2b8c-4f44-8f91-8dd11ac78b52</entry>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:     </system>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:   <os>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:   </os>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:   <features>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:     <acpi/>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:     <tcg>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:     </tcg>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:   </features>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:   <devices>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk"/>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:     </disk>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk.config"/>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:     </disk>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:9e:02:16"/>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:       <target dev="tap8b22719a-06"/>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:     </interface>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/console.log" append="off"/>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:     </serial>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:     <video>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:     </video>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:     </rng>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:     </memballoon>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:   </devices>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]: </domain>
May 21 01:56:12.975220 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 01:56:12.975220 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Preparing to wait for external event network-vif-plugged-8b22719a-06e5-4d47-9e5c-66aa0c497f52 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 01:56:12.975220 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "29a124ee-2b8c-4f44-8f91-8dd11ac78b52-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:12.975220 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "29a124ee-2b8c-4f44-8f91-8dd11ac78b52-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:12.975220 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "29a124ee-2b8c-4f44-8f91-8dd11ac78b52-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:12.980431 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T01:56:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1997816396',display_name='tempest-ServerActionsTestOtherA-server-1997816396',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serveractionstestothera-server-1997816396',id=7,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxRidCAMyb/mDvqucBNL6o1pu4ohR9TfsTnx1DGEBK8Hs9Bxy4viDAtOuJAjHZZuWNRGwi0rwlQFKlYKc+oTj/M3U8o3nzcuoUHvHlwyO9ufXio2O1Y8v01hvWMmUCFbg==',key_name='tempest-keypair-631476445',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a15fe7a70464159a778cffa4a36c36f',ramdisk_id='',reservation_id='r-vdyv1106',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1975191698',owner_user_name='tempest-ServerActionsTestOtherA-1975191698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbcd1a81252344dd804a4080571f8751',uuid=29a124ee-2b8c-4f44-8f91-8dd11ac78b52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b22719a-06e5-4d47-9e5c-66aa0c497f52", "address": "fa:16:3e:9e:02:16", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b22719a-06", "ovs_interfaceid": "8b22719a-06e5-4d47-9e5c-66aa0c497f52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 01:56:12.981998 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Converting VIF {"id": "8b22719a-06e5-4d47-9e5c-66aa0c497f52", "address": "fa:16:3e:9e:02:16", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b22719a-06", "ovs_interfaceid": "8b22719a-06e5-4d47-9e5c-66aa0c497f52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:56:12.981998 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:02:16,bridge_name='br-int',has_traffic_filtering=True,id=8b22719a-06e5-4d47-9e5c-66aa0c497f52,network=Network(6d660724-85bf-45e3-895a-b9ce67043c30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b22719a-06') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:56:12.981998 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:02:16,bridge_name='br-int',has_traffic_filtering=True,id=8b22719a-06e5-4d47-9e5c-66aa0c497f52,network=Network(6d660724-85bf-45e3-895a-b9ce67043c30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b22719a-06') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 01:56:12.982347 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:12.982347 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:56:12.983567 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 01:56:12.985038 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:12.985291 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8d6b140f-4af6-57b7-b8e0-f741c3995526', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:56:12.985990 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:12.986734 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:56:12.988422 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:12.993442 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:12.993709 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b22719a-06, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:56:12.994182 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b22719a-06, col_values=(('qos', UUID('f85508f5-8c0e-4c97-b332-64828896cd80')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:56:12.994373 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b22719a-06, col_values=(('external_ids', {'iface-id': '8b22719a-06e5-4d47-9e5c-66aa0c497f52', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:02:16', 'vm-uuid': '29a124ee-2b8c-4f44-8f91-8dd11ac78b52'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:56:12.996020 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:12.996787 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:56:13.002230 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:13.003781 np0000001127 nova-compute[98206]: INFO os_vif [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:02:16,bridge_name='br-int',has_traffic_filtering=True,id=8b22719a-06e5-4d47-9e5c-66aa0c497f52,network=Network(6d660724-85bf-45e3-895a-b9ce67043c30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b22719a-06')
May 21 01:56:13.087810 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328573.0874553, cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:56:13.087963 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] VM Started (Lifecycle Event)
May 21 01:56:13.198396 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-161b494a-2f11-40cb-9dcb-52dae367b042 req-28146b63-3af3-470e-b2cf-2165c9f7f64d service nova] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Received event network-vif-unplugged-db141707-155b-4d59-b771-0ff876e50cc4 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:56:13.198726 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-161b494a-2f11-40cb-9dcb-52dae367b042 req-28146b63-3af3-470e-b2cf-2165c9f7f64d service nova] Acquiring lock "0ff0511e-6af4-400b-ac42-5ebd3b37d2b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:13.198892 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-161b494a-2f11-40cb-9dcb-52dae367b042 req-28146b63-3af3-470e-b2cf-2165c9f7f64d service nova] Lock "0ff0511e-6af4-400b-ac42-5ebd3b37d2b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:13.199992 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-161b494a-2f11-40cb-9dcb-52dae367b042 req-28146b63-3af3-470e-b2cf-2165c9f7f64d service nova] Lock "0ff0511e-6af4-400b-ac42-5ebd3b37d2b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:13.199992 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-161b494a-2f11-40cb-9dcb-52dae367b042 req-28146b63-3af3-470e-b2cf-2165c9f7f64d service nova] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] No waiting events found dispatching network-vif-unplugged-db141707-155b-4d59-b771-0ff876e50cc4 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:56:13.199992 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-161b494a-2f11-40cb-9dcb-52dae367b042 req-28146b63-3af3-470e-b2cf-2165c9f7f64d service nova] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Received event network-vif-unplugged-db141707-155b-4d59-b771-0ff876e50cc4 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 01:56:13.199992 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-161b494a-2f11-40cb-9dcb-52dae367b042 req-28146b63-3af3-470e-b2cf-2165c9f7f64d service nova] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Received event network-vif-unplugged-db141707-155b-4d59-b771-0ff876e50cc4 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:56:13.199992 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-161b494a-2f11-40cb-9dcb-52dae367b042 req-28146b63-3af3-470e-b2cf-2165c9f7f64d service nova] Acquiring lock "0ff0511e-6af4-400b-ac42-5ebd3b37d2b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:13.199992 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-161b494a-2f11-40cb-9dcb-52dae367b042 req-28146b63-3af3-470e-b2cf-2165c9f7f64d service nova] Lock "0ff0511e-6af4-400b-ac42-5ebd3b37d2b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:13.199992 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-161b494a-2f11-40cb-9dcb-52dae367b042 req-28146b63-3af3-470e-b2cf-2165c9f7f64d service nova] Lock "0ff0511e-6af4-400b-ac42-5ebd3b37d2b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:13.200300 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-161b494a-2f11-40cb-9dcb-52dae367b042 req-28146b63-3af3-470e-b2cf-2165c9f7f64d service nova] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] No waiting events found dispatching network-vif-unplugged-db141707-155b-4d59-b771-0ff876e50cc4 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:56:13.200300 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-161b494a-2f11-40cb-9dcb-52dae367b042 req-28146b63-3af3-470e-b2cf-2165c9f7f64d service nova] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Received event network-vif-unplugged-db141707-155b-4d59-b771-0ff876e50cc4 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 01:56:13.200526 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-161b494a-2f11-40cb-9dcb-52dae367b042 req-28146b63-3af3-470e-b2cf-2165c9f7f64d service nova] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Received event network-vif-deleted-db141707-155b-4d59-b771-0ff876e50cc4 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:56:13.200526 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-161b494a-2f11-40cb-9dcb-52dae367b042 req-28146b63-3af3-470e-b2cf-2165c9f7f64d service nova] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Neutron deleted interface db141707-155b-4d59-b771-0ff876e50cc4; detaching it from the instance and deleting it from the info cache
May 21 01:56:13.202478 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-161b494a-2f11-40cb-9dcb-52dae367b042 req-28146b63-3af3-470e-b2cf-2165c9f7f64d service nova] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:56:13.279403 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:56:13.283513 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-9fba6072-e3c3-43ef-aa47-91d520f7d801 req-d39dd6d8-726d-42bf-89d7-c33733e1b38f service nova] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Received event network-changed-8899a68b-fb77-4ac9-a9f0-ca811560c63a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:56:13.284277 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-9fba6072-e3c3-43ef-aa47-91d520f7d801 req-d39dd6d8-726d-42bf-89d7-c33733e1b38f service nova] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Refreshing instance network info cache due to event network-changed-8899a68b-fb77-4ac9-a9f0-ca811560c63a. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:56:13.284277 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-9fba6072-e3c3-43ef-aa47-91d520f7d801 req-d39dd6d8-726d-42bf-89d7-c33733e1b38f service nova] Acquiring lock "refresh_cache-cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:56:13.284277 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-9fba6072-e3c3-43ef-aa47-91d520f7d801 req-d39dd6d8-726d-42bf-89d7-c33733e1b38f service nova] Acquired lock "refresh_cache-cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:56:13.284277 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-9fba6072-e3c3-43ef-aa47-91d520f7d801 req-d39dd6d8-726d-42bf-89d7-c33733e1b38f service nova] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Refreshing network info cache for port 8899a68b-fb77-4ac9-a9f0-ca811560c63a {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:56:13.595915 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:56:13.597768 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:56:13.715817 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-161b494a-2f11-40cb-9dcb-52dae367b042 req-28146b63-3af3-470e-b2cf-2165c9f7f64d service nova] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Detach interface failed, port_id=db141707-155b-4d59-b771-0ff876e50cc4, reason: Instance 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 01:56:13.792997 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Took 1.46 seconds to deallocate network for instance.
May 21 01:56:13.792997 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-9fba6072-e3c3-43ef-aa47-91d520f7d801 req-d39dd6d8-726d-42bf-89d7-c33733e1b38f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:14.102090 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328574.101766, cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:56:14.102410 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] VM Paused (Lifecycle Event)
May 21 01:56:14.296434 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-940753c4-aae2-455d-8853-65cdd36ec31b tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:14.296599 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-940753c4-aae2-455d-8853-65cdd36ec31b tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:14.304824 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-9fba6072-e3c3-43ef-aa47-91d520f7d801 req-d39dd6d8-726d-42bf-89d7-c33733e1b38f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:14.509437 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-9fba6072-e3c3-43ef-aa47-91d520f7d801 req-d39dd6d8-726d-42bf-89d7-c33733e1b38f service nova] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Updated VIF entry in instance network info cache for port 8899a68b-fb77-4ac9-a9f0-ca811560c63a. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 01:56:14.509772 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-9fba6072-e3c3-43ef-aa47-91d520f7d801 req-d39dd6d8-726d-42bf-89d7-c33733e1b38f service nova] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Updating instance_info_cache with network_info: [{"id": "8899a68b-fb77-4ac9-a9f0-ca811560c63a", "address": "fa:16:3e:a0:e8:cd", "network": {"id": "238a16b8-acf2-4255-ae1c-da1966d4d253", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2105742351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cad39cb6391143989b2404dc66ddfe0f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8899a68b-fb", "ovs_interfaceid": "8899a68b-fb77-4ac9-a9f0-ca811560c63a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:56:14.530785 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:56:14.531553 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:56:14.533579 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] No VIF found with MAC fa:16:3e:9e:02:16, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 01:56:14.533579 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Using config drive
May 21 01:56:14.606286 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:56:14.611910 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328574.611542, cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:56:14.612112 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] VM Resumed (Lifecycle Event)
May 21 01:56:14.802897 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-940753c4-aae2-455d-8853-65cdd36ec31b tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:56:14.803847 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-940753c4-aae2-455d-8853-65cdd36ec31b tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:56:14.858047 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d2e57ec3-fafd-472f-b34f-af86ae8e6bff req-2a286c4f-ddd6-4d39-ac61-e0bc94a670fb service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Received event network-vif-unplugged-67b86a71-40ec-405f-8d46-56744e34174f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:56:14.858813 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d2e57ec3-fafd-472f-b34f-af86ae8e6bff req-2a286c4f-ddd6-4d39-ac61-e0bc94a670fb service nova] Acquiring lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:14.858990 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d2e57ec3-fafd-472f-b34f-af86ae8e6bff req-2a286c4f-ddd6-4d39-ac61-e0bc94a670fb service nova] Lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:14.859178 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d2e57ec3-fafd-472f-b34f-af86ae8e6bff req-2a286c4f-ddd6-4d39-ac61-e0bc94a670fb service nova] Lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:14.859249 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d2e57ec3-fafd-472f-b34f-af86ae8e6bff req-2a286c4f-ddd6-4d39-ac61-e0bc94a670fb service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] No event matching network-vif-unplugged-67b86a71-40ec-405f-8d46-56744e34174f in dict_keys([('network-vif-plugged', '67b86a71-40ec-405f-8d46-56744e34174f')]) {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 21 01:56:14.859390 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-d2e57ec3-fafd-472f-b34f-af86ae8e6bff req-2a286c4f-ddd6-4d39-ac61-e0bc94a670fb service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Received unexpected event network-vif-unplugged-67b86a71-40ec-405f-8d46-56744e34174f for instance with vm_state building and task_state spawning.
May 21 01:56:14.859483 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d2e57ec3-fafd-472f-b34f-af86ae8e6bff req-2a286c4f-ddd6-4d39-ac61-e0bc94a670fb service nova] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Received event network-changed-a36c9ce2-1986-45f2-b2bd-e0bbf396d67a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:56:14.859608 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d2e57ec3-fafd-472f-b34f-af86ae8e6bff req-2a286c4f-ddd6-4d39-ac61-e0bc94a670fb service nova] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Refreshing instance network info cache due to event network-changed-a36c9ce2-1986-45f2-b2bd-e0bbf396d67a. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:56:14.859796 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d2e57ec3-fafd-472f-b34f-af86ae8e6bff req-2a286c4f-ddd6-4d39-ac61-e0bc94a670fb service nova] Acquiring lock "refresh_cache-98ace73f-7d4b-4aed-9355-a39c58f9b024" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:56:14.859796 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d2e57ec3-fafd-472f-b34f-af86ae8e6bff req-2a286c4f-ddd6-4d39-ac61-e0bc94a670fb service nova] Acquired lock "refresh_cache-98ace73f-7d4b-4aed-9355-a39c58f9b024" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:56:14.859919 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-d2e57ec3-fafd-472f-b34f-af86ae8e6bff req-2a286c4f-ddd6-4d39-ac61-e0bc94a670fb service nova] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Refreshing network info cache for port a36c9ce2-1986-45f2-b2bd-e0bbf396d67a {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:56:15.012154 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-9fba6072-e3c3-43ef-aa47-91d520f7d801 req-d39dd6d8-726d-42bf-89d7-c33733e1b38f service nova] Releasing lock "refresh_cache-cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:56:15.043598 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:15.115994 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:56:15.120419 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:56:15.177670 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Creating config drive at /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk.config
May 21 01:56:15.181868 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpyspcrl22 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:56:15.223943 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpyspcrl22" returned: 0 in 0.042s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:56:15.307435 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-940753c4-aae2-455d-8853-65cdd36ec31b tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:56:15.364278 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-d2e57ec3-fafd-472f-b34f-af86ae8e6bff req-2a286c4f-ddd6-4d39-ac61-e0bc94a670fb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:15.624678 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.998956775000124 future=<Future at 0x71c07c786150 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:56:15.625848 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.99738951900008 future=<Future at 0x71c07c786150 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:56:15.625848 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.997196650999967 future=<Future at 0x71c07c786150 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:56:15.778876 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:15.808222 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:15.820750 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-940753c4-aae2-455d-8853-65cdd36ec31b tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.524s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:15.883803 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-d2e57ec3-fafd-472f-b34f-af86ae8e6bff req-2a286c4f-ddd6-4d39-ac61-e0bc94a670fb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:15.926951 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-940753c4-aae2-455d-8853-65cdd36ec31b tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Deleted allocations for instance 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9
May 21 01:56:15.932812 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:16.002890 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:16.035853 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c7982c1d-3656-4d19-a971-5d17f6be08ea req-4aba4a04-1aa2-47d7-868b-044f968a3b8d service nova] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Received event network-vif-plugged-8b22719a-06e5-4d47-9e5c-66aa0c497f52 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:56:16.037136 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c7982c1d-3656-4d19-a971-5d17f6be08ea req-4aba4a04-1aa2-47d7-868b-044f968a3b8d service nova] Acquiring lock "29a124ee-2b8c-4f44-8f91-8dd11ac78b52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:16.037504 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c7982c1d-3656-4d19-a971-5d17f6be08ea req-4aba4a04-1aa2-47d7-868b-044f968a3b8d service nova] Lock "29a124ee-2b8c-4f44-8f91-8dd11ac78b52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:16.038678 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c7982c1d-3656-4d19-a971-5d17f6be08ea req-4aba4a04-1aa2-47d7-868b-044f968a3b8d service nova] Lock "29a124ee-2b8c-4f44-8f91-8dd11ac78b52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:16.038678 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c7982c1d-3656-4d19-a971-5d17f6be08ea req-4aba4a04-1aa2-47d7-868b-044f968a3b8d service nova] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Processing event network-vif-plugged-8b22719a-06e5-4d47-9e5c-66aa0c497f52 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 01:56:16.196961 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:16.212745 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-d2e57ec3-fafd-472f-b34f-af86ae8e6bff req-2a286c4f-ddd6-4d39-ac61-e0bc94a670fb service nova] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Updated VIF entry in instance network info cache for port a36c9ce2-1986-45f2-b2bd-e0bbf396d67a. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 01:56:16.213027 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-d2e57ec3-fafd-472f-b34f-af86ae8e6bff req-2a286c4f-ddd6-4d39-ac61-e0bc94a670fb service nova] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Updating instance_info_cache with network_info: [{"id": "a36c9ce2-1986-45f2-b2bd-e0bbf396d67a", "address": "fa:16:3e:ee:ec:8e", "network": {"id": "97eda448-6d12-4aa9-b1f2-150d371463f1", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-343348586-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e35d2fe45bb24d2b9f7b547352683fd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36c9ce2-19", "ovs_interfaceid": "a36c9ce2-1986-45f2-b2bd-e0bbf396d67a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:56:16.224908 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:16.225868 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:16.716739 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d2e57ec3-fafd-472f-b34f-af86ae8e6bff req-2a286c4f-ddd6-4d39-ac61-e0bc94a670fb service nova] Releasing lock "refresh_cache-98ace73f-7d4b-4aed-9355-a39c58f9b024" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:56:16.716739 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d2e57ec3-fafd-472f-b34f-af86ae8e6bff req-2a286c4f-ddd6-4d39-ac61-e0bc94a670fb service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Received event network-vif-plugged-839e91da-5ffe-451b-bd9d-dfc1cf83ab19 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:56:16.716739 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d2e57ec3-fafd-472f-b34f-af86ae8e6bff req-2a286c4f-ddd6-4d39-ac61-e0bc94a670fb service nova] Acquiring lock "0059a43c-1d34-40a9-af63-b5eca8c30f53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:16.716739 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d2e57ec3-fafd-472f-b34f-af86ae8e6bff req-2a286c4f-ddd6-4d39-ac61-e0bc94a670fb service nova] Lock "0059a43c-1d34-40a9-af63-b5eca8c30f53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:16.716739 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d2e57ec3-fafd-472f-b34f-af86ae8e6bff req-2a286c4f-ddd6-4d39-ac61-e0bc94a670fb service nova] Lock "0059a43c-1d34-40a9-af63-b5eca8c30f53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:16.716739 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d2e57ec3-fafd-472f-b34f-af86ae8e6bff req-2a286c4f-ddd6-4d39-ac61-e0bc94a670fb service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Processing event network-vif-plugged-839e91da-5ffe-451b-bd9d-dfc1cf83ab19 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 01:56:16.717322 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d2e57ec3-fafd-472f-b34f-af86ae8e6bff req-2a286c4f-ddd6-4d39-ac61-e0bc94a670fb service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Received event network-vif-plugged-839e91da-5ffe-451b-bd9d-dfc1cf83ab19 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:56:16.717322 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d2e57ec3-fafd-472f-b34f-af86ae8e6bff req-2a286c4f-ddd6-4d39-ac61-e0bc94a670fb service nova] Acquiring lock "0059a43c-1d34-40a9-af63-b5eca8c30f53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:16.717322 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d2e57ec3-fafd-472f-b34f-af86ae8e6bff req-2a286c4f-ddd6-4d39-ac61-e0bc94a670fb service nova] Lock "0059a43c-1d34-40a9-af63-b5eca8c30f53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:16.717322 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d2e57ec3-fafd-472f-b34f-af86ae8e6bff req-2a286c4f-ddd6-4d39-ac61-e0bc94a670fb service nova] Lock "0059a43c-1d34-40a9-af63-b5eca8c30f53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:16.717454 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d2e57ec3-fafd-472f-b34f-af86ae8e6bff req-2a286c4f-ddd6-4d39-ac61-e0bc94a670fb service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] No waiting events found dispatching network-vif-plugged-839e91da-5ffe-451b-bd9d-dfc1cf83ab19 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:56:16.717986 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-d2e57ec3-fafd-472f-b34f-af86ae8e6bff req-2a286c4f-ddd6-4d39-ac61-e0bc94a670fb service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Received unexpected event network-vif-plugged-839e91da-5ffe-451b-bd9d-dfc1cf83ab19 for instance with vm_state building and task_state spawning.
May 21 01:56:16.717986 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d2e57ec3-fafd-472f-b34f-af86ae8e6bff req-2a286c4f-ddd6-4d39-ac61-e0bc94a670fb service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Received event network-vif-plugged-67b86a71-40ec-405f-8d46-56744e34174f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:56:16.718861 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Instance event wait completed in 24 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 01:56:16.718861 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d2e57ec3-fafd-472f-b34f-af86ae8e6bff req-2a286c4f-ddd6-4d39-ac61-e0bc94a670fb service nova] Acquiring lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:16.718861 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d2e57ec3-fafd-472f-b34f-af86ae8e6bff req-2a286c4f-ddd6-4d39-ac61-e0bc94a670fb service nova] Lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:16.718861 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d2e57ec3-fafd-472f-b34f-af86ae8e6bff req-2a286c4f-ddd6-4d39-ac61-e0bc94a670fb service nova] Lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:16.718861 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d2e57ec3-fafd-472f-b34f-af86ae8e6bff req-2a286c4f-ddd6-4d39-ac61-e0bc94a670fb service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Processing event network-vif-plugged-67b86a71-40ec-405f-8d46-56744e34174f {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 01:56:16.719047 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d2e57ec3-fafd-472f-b34f-af86ae8e6bff req-2a286c4f-ddd6-4d39-ac61-e0bc94a670fb service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Received event network-vif-plugged-67b86a71-40ec-405f-8d46-56744e34174f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:56:16.719262 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d2e57ec3-fafd-472f-b34f-af86ae8e6bff req-2a286c4f-ddd6-4d39-ac61-e0bc94a670fb service nova] Acquiring lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:16.719539 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Instance event wait completed in 20 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 01:56:16.719721 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d2e57ec3-fafd-472f-b34f-af86ae8e6bff req-2a286c4f-ddd6-4d39-ac61-e0bc94a670fb service nova] Lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:16.719842 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d2e57ec3-fafd-472f-b34f-af86ae8e6bff req-2a286c4f-ddd6-4d39-ac61-e0bc94a670fb service nova] Lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:16.719972 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d2e57ec3-fafd-472f-b34f-af86ae8e6bff req-2a286c4f-ddd6-4d39-ac61-e0bc94a670fb service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] No waiting events found dispatching network-vif-plugged-67b86a71-40ec-405f-8d46-56744e34174f {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:56:16.720104 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-d2e57ec3-fafd-472f-b34f-af86ae8e6bff req-2a286c4f-ddd6-4d39-ac61-e0bc94a670fb service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Received unexpected event network-vif-plugged-67b86a71-40ec-405f-8d46-56744e34174f for instance with vm_state building and task_state spawning.
May 21 01:56:16.721853 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328576.7213721, 0059a43c-1d34-40a9-af63-b5eca8c30f53 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:56:16.722268 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] VM Resumed (Lifecycle Event)
May 21 01:56:16.723774 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 01:56:16.732070 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 01:56:16.735669 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Instance spawned successfully.
May 21 01:56:16.735753 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Instance spawned successfully.
May 21 01:56:16.736036 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 01:56:16.738205 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 01:56:16.903443 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 01:56:16.908547 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 01:56:16.910109 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Instance spawned successfully.
May 21 01:56:16.910531 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 01:56:16.937536 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-940753c4-aae2-455d-8853-65cdd36ec31b tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Lock "0ff0511e-6af4-400b-ac42-5ebd3b37d2b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.499s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:17.226005 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:56:17.227700 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:56:17.246019 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:17.246184 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:17.246364 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:17.246602 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:17.246863 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:17.247081 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:17.250946 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:17.251142 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:17.252488 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:17.252754 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:17.252993 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:17.253205 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:17.416569 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:17.416755 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:17.417124 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:17.417432 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:17.418239 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:17.418239 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:56:17.730147 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 01:56:17.730651 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328577.7302253, 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:56:17.730651 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] VM Resumed (Lifecycle Event)
May 21 01:56:17.758128 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Took 35.85 seconds to spawn the instance on the hypervisor.
May 21 01:56:17.761710 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Took 29.58 seconds to spawn the instance on the hypervisor.
May 21 01:56:17.761853 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:56:17.762154 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:56:17.924061 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Took 8.34 seconds to spawn the instance on the hypervisor.
May 21 01:56:17.924185 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:56:17.996584 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:18.129285 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7438c026-1bdd-4eca-92aa-cc716cccff17 req-08b4102e-4bfe-4a13-b97d-8db2a10fb764 service nova] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Received event network-vif-plugged-8b22719a-06e5-4d47-9e5c-66aa0c497f52 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:56:18.129348 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7438c026-1bdd-4eca-92aa-cc716cccff17 req-08b4102e-4bfe-4a13-b97d-8db2a10fb764 service nova] Acquiring lock "29a124ee-2b8c-4f44-8f91-8dd11ac78b52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:18.129560 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7438c026-1bdd-4eca-92aa-cc716cccff17 req-08b4102e-4bfe-4a13-b97d-8db2a10fb764 service nova] Lock "29a124ee-2b8c-4f44-8f91-8dd11ac78b52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:18.129678 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7438c026-1bdd-4eca-92aa-cc716cccff17 req-08b4102e-4bfe-4a13-b97d-8db2a10fb764 service nova] Lock "29a124ee-2b8c-4f44-8f91-8dd11ac78b52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:18.129855 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7438c026-1bdd-4eca-92aa-cc716cccff17 req-08b4102e-4bfe-4a13-b97d-8db2a10fb764 service nova] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] No waiting events found dispatching network-vif-plugged-8b22719a-06e5-4d47-9e5c-66aa0c497f52 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:56:18.129969 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-7438c026-1bdd-4eca-92aa-cc716cccff17 req-08b4102e-4bfe-4a13-b97d-8db2a10fb764 service nova] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Received unexpected event network-vif-plugged-8b22719a-06e5-4d47-9e5c-66aa0c497f52 for instance with vm_state active and task_state None.
May 21 01:56:18.234158 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:56:18.235693 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:56:18.276859 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Took 34.94 seconds to build instance.
May 21 01:56:18.282881 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Took 41.09 seconds to build instance.
May 21 01:56:18.440196 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Took 14.12 seconds to build instance.
May 21 01:56:18.738923 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328578.7385402, 29a124ee-2b8c-4f44-8f91-8dd11ac78b52 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:56:18.739346 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] VM Started (Lifecycle Event)
May 21 01:56:18.779082 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-47b90555-8dde-4e6b-8f63-a73145b1688a tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 36.450s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:18.785760 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fb787097-a9ed-4a66-a56d-de6a9e1caffc tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "0059a43c-1d34-40a9-af63-b5eca8c30f53" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.603s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:18.942338 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-06061ef5-1c37-4803-9fe5-b3ee3e74649e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "29a124ee-2b8c-4f44-8f91-8dd11ac78b52" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.625s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:19.244686 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:56:19.257743 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:56:19.613955 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-93b4f4d9-ed6e-4897-934e-131351a1d6e7 req-0529ff72-1fdc-41e4-b03f-6bfbd2c70d25 service nova] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Received event network-changed-8b22719a-06e5-4d47-9e5c-66aa0c497f52 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:56:19.614183 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-93b4f4d9-ed6e-4897-934e-131351a1d6e7 req-0529ff72-1fdc-41e4-b03f-6bfbd2c70d25 service nova] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Refreshing instance network info cache due to event network-changed-8b22719a-06e5-4d47-9e5c-66aa0c497f52. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:56:19.614308 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-93b4f4d9-ed6e-4897-934e-131351a1d6e7 req-0529ff72-1fdc-41e4-b03f-6bfbd2c70d25 service nova] Acquiring lock "refresh_cache-29a124ee-2b8c-4f44-8f91-8dd11ac78b52" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:56:19.614405 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-93b4f4d9-ed6e-4897-934e-131351a1d6e7 req-0529ff72-1fdc-41e4-b03f-6bfbd2c70d25 service nova] Acquired lock "refresh_cache-29a124ee-2b8c-4f44-8f91-8dd11ac78b52" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:56:19.614568 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-93b4f4d9-ed6e-4897-934e-131351a1d6e7 req-0529ff72-1fdc-41e4-b03f-6bfbd2c70d25 service nova] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Refreshing network info cache for port 8b22719a-06e5-4d47-9e5c-66aa0c497f52 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:56:19.761569 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328579.7608612, 29a124ee-2b8c-4f44-8f91-8dd11ac78b52 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:56:19.761569 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] VM Paused (Lifecycle Event)
May 21 01:56:19.870417 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:20.120553 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-93b4f4d9-ed6e-4897-934e-131351a1d6e7 req-0529ff72-1fdc-41e4-b03f-6bfbd2c70d25 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:20.266964 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:56:20.270411 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328580.2701027, 29a124ee-2b8c-4f44-8f91-8dd11ac78b52 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:56:20.270864 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] VM Resumed (Lifecycle Event)
May 21 01:56:20.775792 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:56:20.778124 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:56:21.003603 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:21.464293 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-87206afa-8255-4a1b-b26c-bf571849ef99 req-73d0ba8b-3e2a-4a71-b8c4-7c616390df5e service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Received event network-changed-67b86a71-40ec-405f-8d46-56744e34174f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:56:21.465830 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-87206afa-8255-4a1b-b26c-bf571849ef99 req-73d0ba8b-3e2a-4a71-b8c4-7c616390df5e service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Refreshing instance network info cache due to event network-changed-67b86a71-40ec-405f-8d46-56744e34174f. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:56:21.466090 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-87206afa-8255-4a1b-b26c-bf571849ef99 req-73d0ba8b-3e2a-4a71-b8c4-7c616390df5e service nova] Acquiring lock "refresh_cache-6307081b-dd75-4ea3-aad6-d01f2b2b1c9b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:56:21.466256 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-87206afa-8255-4a1b-b26c-bf571849ef99 req-73d0ba8b-3e2a-4a71-b8c4-7c616390df5e service nova] Acquired lock "refresh_cache-6307081b-dd75-4ea3-aad6-d01f2b2b1c9b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:56:21.466426 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-87206afa-8255-4a1b-b26c-bf571849ef99 req-73d0ba8b-3e2a-4a71-b8c4-7c616390df5e service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Refreshing network info cache for port 67b86a71-40ec-405f-8d46-56744e34174f {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:56:21.974114 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-87206afa-8255-4a1b-b26c-bf571849ef99 req-73d0ba8b-3e2a-4a71-b8c4-7c616390df5e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:22.442445 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-53673637-c035-455e-a3bb-c7469205746f req-8a7bd8a5-86a0-4667-a07f-a6f312d026d6 service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Received event network-changed-839e91da-5ffe-451b-bd9d-dfc1cf83ab19 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:56:22.443511 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-53673637-c035-455e-a3bb-c7469205746f req-8a7bd8a5-86a0-4667-a07f-a6f312d026d6 service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Refreshing instance network info cache due to event network-changed-839e91da-5ffe-451b-bd9d-dfc1cf83ab19. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:56:22.443781 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-53673637-c035-455e-a3bb-c7469205746f req-8a7bd8a5-86a0-4667-a07f-a6f312d026d6 service nova] Acquiring lock "refresh_cache-0059a43c-1d34-40a9-af63-b5eca8c30f53" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:56:22.443941 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-53673637-c035-455e-a3bb-c7469205746f req-8a7bd8a5-86a0-4667-a07f-a6f312d026d6 service nova] Acquired lock "refresh_cache-0059a43c-1d34-40a9-af63-b5eca8c30f53" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:56:22.444139 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-53673637-c035-455e-a3bb-c7469205746f req-8a7bd8a5-86a0-4667-a07f-a6f312d026d6 service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Refreshing network info cache for port 839e91da-5ffe-451b-bd9d-dfc1cf83ab19 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:56:22.664741 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-93b4f4d9-ed6e-4897-934e-131351a1d6e7 req-0529ff72-1fdc-41e4-b03f-6bfbd2c70d25 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:22.949251 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-53673637-c035-455e-a3bb-c7469205746f req-8a7bd8a5-86a0-4667-a07f-a6f312d026d6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:22.975262 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-93b4f4d9-ed6e-4897-934e-131351a1d6e7 req-0529ff72-1fdc-41e4-b03f-6bfbd2c70d25 service nova] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Updated VIF entry in instance network info cache for port 8b22719a-06e5-4d47-9e5c-66aa0c497f52. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 01:56:22.975926 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-93b4f4d9-ed6e-4897-934e-131351a1d6e7 req-0529ff72-1fdc-41e4-b03f-6bfbd2c70d25 service nova] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Updating instance_info_cache with network_info: [{"id": "8b22719a-06e5-4d47-9e5c-66aa0c497f52", "address": "fa:16:3e:9e:02:16", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b22719a-06", "ovs_interfaceid": "8b22719a-06e5-4d47-9e5c-66aa0c497f52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:56:22.997561 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:23.134083 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-87206afa-8255-4a1b-b26c-bf571849ef99 req-73d0ba8b-3e2a-4a71-b8c4-7c616390df5e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:23.211644 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:23.446795 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-87206afa-8255-4a1b-b26c-bf571849ef99 req-73d0ba8b-3e2a-4a71-b8c4-7c616390df5e service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Updated VIF entry in instance network info cache for port 67b86a71-40ec-405f-8d46-56744e34174f. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 01:56:23.448037 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-87206afa-8255-4a1b-b26c-bf571849ef99 req-73d0ba8b-3e2a-4a71-b8c4-7c616390df5e service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Updating instance_info_cache with network_info: [{"id": "67b86a71-40ec-405f-8d46-56744e34174f", "address": "fa:16:3e:ba:84:92", "network": {"id": "84a294f6-e79d-44ac-90f4-cfa96e67e367", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1771731810-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ffcb955f57a438d998dbdf9bfee0868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b86a71-40", "ovs_interfaceid": "67b86a71-40ec-405f-8d46-56744e34174f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:56:23.481653 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-93b4f4d9-ed6e-4897-934e-131351a1d6e7 req-0529ff72-1fdc-41e4-b03f-6bfbd2c70d25 service nova] Releasing lock "refresh_cache-29a124ee-2b8c-4f44-8f91-8dd11ac78b52" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:56:23.572639 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-53673637-c035-455e-a3bb-c7469205746f req-8a7bd8a5-86a0-4667-a07f-a6f312d026d6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:23.815628 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-53673637-c035-455e-a3bb-c7469205746f req-8a7bd8a5-86a0-4667-a07f-a6f312d026d6 service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Updated VIF entry in instance network info cache for port 839e91da-5ffe-451b-bd9d-dfc1cf83ab19. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 01:56:23.815901 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-53673637-c035-455e-a3bb-c7469205746f req-8a7bd8a5-86a0-4667-a07f-a6f312d026d6 service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Updating instance_info_cache with network_info: [{"id": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "address": "fa:16:3e:00:d8:d3", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap839e91da-5f", "ovs_interfaceid": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:56:23.952419 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-87206afa-8255-4a1b-b26c-bf571849ef99 req-73d0ba8b-3e2a-4a71-b8c4-7c616390df5e service nova] Releasing lock "refresh_cache-6307081b-dd75-4ea3-aad6-d01f2b2b1c9b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:56:24.321370 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-53673637-c035-455e-a3bb-c7469205746f req-8a7bd8a5-86a0-4667-a07f-a6f312d026d6 service nova] Releasing lock "refresh_cache-0059a43c-1d34-40a9-af63-b5eca8c30f53" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:56:26.051511 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:27.998455 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:30.623996 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0009040169998115744 future=<Future at 0x71c07c786150 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:56:30.625578 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:56:30.625578 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Emitting event <LifecycleEvent: 1779328575.6229496, 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:56:30.625578 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] VM Stopped (Lifecycle Event)
May 21 01:56:31.053369 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:31.129550 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: 0ff0511e-6af4-400b-ac42-5ebd3b37d2b9] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:56:31.440828 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:31.441082 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:31.944788 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 01:56:32.511639 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:32.512029 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:32.514809 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 01:56:32.514809 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Claim successful on node np0000001127
May 21 01:56:32.999745 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:33.996354 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:56:33.996589 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:56:34.499488 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:56:35.007092 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.495s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:35.007661 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 01:56:35.514663 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 01:56:35.515223 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 01:56:35.515223 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:35.515393 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:35.730525 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '06d28d9bc06a4a27bcba288eb5a07e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c5939e8b346a8a2da89fb19b2a812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 01:56:36.018327 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 01:56:36.056772 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:36.406089 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Successfully created port: ebf91ac5-9634-4897-a1bb-7336846be7cb {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 01:56:37.001285 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Successfully created port: d807c564-314d-4f8e-8984-8068d59d3538 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 01:56:37.529910 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 01:56:37.543011 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Successfully created port: d03a47d5-bec7-4099-96e0-c102edfe9e8e {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 01:56:38.000573 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:38.039504 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Booting with volume f5d11385-1cda-4417-8269-f34d36246e88 at /dev/vda
May 21 01:56:38.119836 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:56:38.122920 np0000001127 nova-compute[98206]: INFO oslo.privsep.daemon [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp264_v1we/privsep.sock']
May 21 01:56:38.132272 np0000001127 sudo[111494]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp264_v1we/privsep.sock
May 21 01:56:38.133403 np0000001127 sudo[111494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 21 01:56:38.186293 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Successfully created port: 14e48bfc-fab0-433c-b291-0e75e2da496c {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 01:56:38.443282 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 21 01:56:38.443530 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 21 01:56:38.443560 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 21 01:56:38.443646 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: 
May 21 01:56:38.443708 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 21 01:56:38.443807 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 21 01:56:38.443952 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 21 01:56:38.444011 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: 
May 21 01:56:38.444072 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 21 01:56:38.789952 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 21 01:56:38.790077 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 21 01:56:38.790187 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 21 01:56:38.790268 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: 
May 21 01:56:38.790345 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 21 01:56:38.790424 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 21 01:56:38.790535 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 21 01:56:38.790610 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log: 
May 21 01:56:38.790698 np0000001127 nova-compute[98206]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 21 01:56:38.878332 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Successfully created port: 93b6a994-3c94-45b3-be4c-d63ce41a8557 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 01:56:39.135360 np0000001127 sudo[111494]: pam_unix(sudo:session): session closed for user root
May 21 01:56:39.136882 np0000001127 nova-compute[98206]: INFO oslo.privsep.daemon [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Spawned new privsep daemon via rootwrap
May 21 01:56:39.237681 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 01:56:39.238125 np0000001127 nova-compute[98206]: WARNING os_brick.initiator.connectors.nvmeof [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
May 21 01:56:39.270392 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:56:39.297869 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 01:56:39.298095 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 01:56:39.307630 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 01:56:39.308975 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe00:d8d3', 'fe80::c062:49ff:fe28:b40d', 'fe80::fc16:3eff:feba:8492', 'fe80::405e:62ff:fe28:f67b', 'fe80::fc16:3eff:fe4a:37e3', 'fe80::4822:65ff:fe37:7fac', 'fe80::fc16:3eff:feee:ec8e', 'fe80::fc16:3eff:fea0:e8cd', 'fe80::ca2:24ff:fe18:e91d', 'fe80::fc16:3eff:fe9e:216', 'fe80::14d9:7bff:fe3b:f0dc'] 
May 21 01:56:39.309128 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 01:56:39.309315 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 01:56:39.309821 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] <== get_connector_properties: return (1189ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:56:39.310126 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Updating existing volume attachment record: a548858e-dee2-4c35-88ee-c44efe148969 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 01:56:39.589029 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Successfully updated port: ebf91ac5-9634-4897-a1bb-7336846be7cb {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 01:56:39.657115 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-3630eb99-0177-4953-8157-ae3df0a668fa req-d2083754-bc16-4246-87af-c65ae852ed73 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-changed-ebf91ac5-9634-4897-a1bb-7336846be7cb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:56:39.657296 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-3630eb99-0177-4953-8157-ae3df0a668fa req-d2083754-bc16-4246-87af-c65ae852ed73 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Refreshing instance network info cache due to event network-changed-ebf91ac5-9634-4897-a1bb-7336846be7cb. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:56:39.657555 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-3630eb99-0177-4953-8157-ae3df0a668fa req-d2083754-bc16-4246-87af-c65ae852ed73 service nova] Acquiring lock "refresh_cache-58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:56:39.657698 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-3630eb99-0177-4953-8157-ae3df0a668fa req-d2083754-bc16-4246-87af-c65ae852ed73 service nova] Acquired lock "refresh_cache-58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:56:39.657818 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-3630eb99-0177-4953-8157-ae3df0a668fa req-d2083754-bc16-4246-87af-c65ae852ed73 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Refreshing network info cache for port ebf91ac5-9634-4897-a1bb-7336846be7cb {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:56:40.164185 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-3630eb99-0177-4953-8157-ae3df0a668fa req-d2083754-bc16-4246-87af-c65ae852ed73 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:40.286607 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-3630eb99-0177-4953-8157-ae3df0a668fa req-d2083754-bc16-4246-87af-c65ae852ed73 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:56:40.504235 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-3630eb99-0177-4953-8157-ae3df0a668fa req-d2083754-bc16-4246-87af-c65ae852ed73 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:56:40.801767 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Successfully updated port: 319abe1b-caf8-4fa7-bc6c-caa7e755860b {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 01:56:40.891759 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d230abd5-1883-4bd9-9fd9-cb46847e2f5e req-8d39a7a6-5ef7-4fd9-aef7-78ea54bce4de service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-changed-319abe1b-caf8-4fa7-bc6c-caa7e755860b {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:56:40.891943 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d230abd5-1883-4bd9-9fd9-cb46847e2f5e req-8d39a7a6-5ef7-4fd9-aef7-78ea54bce4de service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Refreshing instance network info cache due to event network-changed-319abe1b-caf8-4fa7-bc6c-caa7e755860b. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:56:40.892110 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d230abd5-1883-4bd9-9fd9-cb46847e2f5e req-8d39a7a6-5ef7-4fd9-aef7-78ea54bce4de service nova] Acquiring lock "refresh_cache-58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:56:40.960189 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Booting with volume de377f05-4bd5-4c5b-bf60-f92093972e57 at /dev/vdb
May 21 01:56:41.007606 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-3630eb99-0177-4953-8157-ae3df0a668fa req-d2083754-bc16-4246-87af-c65ae852ed73 service nova] Releasing lock "refresh_cache-58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:56:41.008312 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d230abd5-1883-4bd9-9fd9-cb46847e2f5e req-8d39a7a6-5ef7-4fd9-aef7-78ea54bce4de service nova] Acquired lock "refresh_cache-58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:56:41.008545 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-d230abd5-1883-4bd9-9fd9-cb46847e2f5e req-8d39a7a6-5ef7-4fd9-aef7-78ea54bce4de service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Refreshing network info cache for port 319abe1b-caf8-4fa7-bc6c-caa7e755860b {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:56:41.015620 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:56:41.032371 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 01:56:41.058942 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:41.065743 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:56:41.094865 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 01:56:41.095764 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 01:56:41.104452 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 01:56:41.106378 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe00:d8d3', 'fe80::c062:49ff:fe28:b40d', 'fe80::fc16:3eff:feba:8492', 'fe80::405e:62ff:fe28:f67b', 'fe80::fc16:3eff:fe4a:37e3', 'fe80::4822:65ff:fe37:7fac', 'fe80::fc16:3eff:feee:ec8e', 'fe80::fc16:3eff:fea0:e8cd', 'fe80::ca2:24ff:fe18:e91d', 'fe80::fc16:3eff:fe9e:216', 'fe80::14d9:7bff:fe3b:f0dc'] 
May 21 01:56:41.106753 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 01:56:41.107237 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 01:56:41.107237 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] <== get_connector_properties: return (91ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:56:41.108099 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Updating existing volume attachment record: be9fc64e-b1dc-427c-90a8-547975f920f0 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 01:56:41.512641 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-d230abd5-1883-4bd9-9fd9-cb46847e2f5e req-8d39a7a6-5ef7-4fd9-aef7-78ea54bce4de service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:41.628322 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-d230abd5-1883-4bd9-9fd9-cb46847e2f5e req-8d39a7a6-5ef7-4fd9-aef7-78ea54bce4de service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:56:41.831014 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-d230abd5-1883-4bd9-9fd9-cb46847e2f5e req-8d39a7a6-5ef7-4fd9-aef7-78ea54bce4de service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:56:41.990341 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Successfully updated port: db10c43a-9d2b-4250-83b6-0ca8ced88657 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 01:56:42.333813 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d230abd5-1883-4bd9-9fd9-cb46847e2f5e req-8d39a7a6-5ef7-4fd9-aef7-78ea54bce4de service nova] Releasing lock "refresh_cache-58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:56:42.758157 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Booting with volume 728d4669-c172-4f18-ae34-53ce485326e7 at /dev/vdc
May 21 01:56:42.817316 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:56:42.828985 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 01:56:42.851877 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:56:42.878147 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 01:56:42.879350 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 01:56:42.888125 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 01:56:42.890802 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe00:d8d3', 'fe80::c062:49ff:fe28:b40d', 'fe80::fc16:3eff:feba:8492', 'fe80::405e:62ff:fe28:f67b', 'fe80::fc16:3eff:fe4a:37e3', 'fe80::4822:65ff:fe37:7fac', 'fe80::fc16:3eff:feee:ec8e', 'fe80::fc16:3eff:fea0:e8cd', 'fe80::ca2:24ff:fe18:e91d', 'fe80::fc16:3eff:fe9e:216', 'fe80::14d9:7bff:fe3b:f0dc'] 
May 21 01:56:42.891168 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 01:56:42.891323 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 01:56:42.891643 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] <== get_connector_properties: return (75ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:56:42.891908 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Updating existing volume attachment record: 05fc8d33-69fe-4ced-8394-aac3a6401015 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 01:56:43.002595 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cb760125-4e10-4f60-83af-e041a2fef08f req-c8af7c8e-1c08-4c6e-9e9c-c11bf7a3c4e0 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-changed-db10c43a-9d2b-4250-83b6-0ca8ced88657 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:56:43.002694 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cb760125-4e10-4f60-83af-e041a2fef08f req-c8af7c8e-1c08-4c6e-9e9c-c11bf7a3c4e0 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Refreshing instance network info cache due to event network-changed-db10c43a-9d2b-4250-83b6-0ca8ced88657. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:56:43.002963 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cb760125-4e10-4f60-83af-e041a2fef08f req-c8af7c8e-1c08-4c6e-9e9c-c11bf7a3c4e0 service nova] Acquiring lock "refresh_cache-58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:56:43.003121 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cb760125-4e10-4f60-83af-e041a2fef08f req-c8af7c8e-1c08-4c6e-9e9c-c11bf7a3c4e0 service nova] Acquired lock "refresh_cache-58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:56:43.003269 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-cb760125-4e10-4f60-83af-e041a2fef08f req-c8af7c8e-1c08-4c6e-9e9c-c11bf7a3c4e0 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Refreshing network info cache for port db10c43a-9d2b-4250-83b6-0ca8ced88657 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:56:43.006375 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:43.131133 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Successfully updated port: d807c564-314d-4f8e-8984-8068d59d3538 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 01:56:43.509839 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-cb760125-4e10-4f60-83af-e041a2fef08f req-c8af7c8e-1c08-4c6e-9e9c-c11bf7a3c4e0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:43.621768 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-cb760125-4e10-4f60-83af-e041a2fef08f req-c8af7c8e-1c08-4c6e-9e9c-c11bf7a3c4e0 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:56:43.808359 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-cb760125-4e10-4f60-83af-e041a2fef08f req-c8af7c8e-1c08-4c6e-9e9c-c11bf7a3c4e0 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:56:44.214668 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Successfully updated port: d03a47d5-bec7-4099-96e0-c102edfe9e8e {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 01:56:44.273268 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-ee2a762c-bb6a-45d2-b548-d44340ce8f5f req-5c14c0b5-7ec1-4aeb-b402-e02bb5eccebf service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-changed-d03a47d5-bec7-4099-96e0-c102edfe9e8e {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:56:44.273268 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-ee2a762c-bb6a-45d2-b548-d44340ce8f5f req-5c14c0b5-7ec1-4aeb-b402-e02bb5eccebf service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Refreshing instance network info cache due to event network-changed-d03a47d5-bec7-4099-96e0-c102edfe9e8e. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:56:44.273268 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ee2a762c-bb6a-45d2-b548-d44340ce8f5f req-5c14c0b5-7ec1-4aeb-b402-e02bb5eccebf service nova] Acquiring lock "refresh_cache-58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:56:44.312079 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cb760125-4e10-4f60-83af-e041a2fef08f req-c8af7c8e-1c08-4c6e-9e9c-c11bf7a3c4e0 service nova] Releasing lock "refresh_cache-58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:56:44.312624 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ee2a762c-bb6a-45d2-b548-d44340ce8f5f req-5c14c0b5-7ec1-4aeb-b402-e02bb5eccebf service nova] Acquired lock "refresh_cache-58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:56:44.312753 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-ee2a762c-bb6a-45d2-b548-d44340ce8f5f req-5c14c0b5-7ec1-4aeb-b402-e02bb5eccebf service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Refreshing network info cache for port d03a47d5-bec7-4099-96e0-c102edfe9e8e {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:56:44.814702 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-ee2a762c-bb6a-45d2-b548-d44340ce8f5f req-5c14c0b5-7ec1-4aeb-b402-e02bb5eccebf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:44.909338 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-ee2a762c-bb6a-45d2-b548-d44340ce8f5f req-5c14c0b5-7ec1-4aeb-b402-e02bb5eccebf service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:56:45.053698 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 01:56:45.054897 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 01:56:45.055165 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Creating image(s)
May 21 01:56:45.056624 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Did not create local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 21 01:56:45.057481 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Ensure instance console log exists: /opt/stack/data/nova/instances/58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 01:56:45.058835 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:45.059111 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:45.059447 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:45.088345 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bac77756-dd03-44b7-ab92-5290d43decec req-99801766-8f9c-4bbf-83a7-693c7d8263f6 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-changed-d807c564-314d-4f8e-8984-8068d59d3538 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:56:45.090788 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bac77756-dd03-44b7-ab92-5290d43decec req-99801766-8f9c-4bbf-83a7-693c7d8263f6 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Refreshing instance network info cache due to event network-changed-d807c564-314d-4f8e-8984-8068d59d3538. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:56:45.091157 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bac77756-dd03-44b7-ab92-5290d43decec req-99801766-8f9c-4bbf-83a7-693c7d8263f6 service nova] Acquiring lock "refresh_cache-58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:56:45.107547 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-ee2a762c-bb6a-45d2-b548-d44340ce8f5f req-5c14c0b5-7ec1-4aeb-b402-e02bb5eccebf service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:56:45.320050 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Successfully updated port: 14e48bfc-fab0-433c-b291-0e75e2da496c {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 01:56:45.375172 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:56:45.376121 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:56:45.377661 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7aaf6119-5665-42db-a289-a138b6643308 req-1c6ba294-1feb-41cd-8ebf-14ee5d1f81c1 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-changed-14e48bfc-fab0-433c-b291-0e75e2da496c {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:56:45.377984 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:56:45.378229 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7aaf6119-5665-42db-a289-a138b6643308 req-1c6ba294-1feb-41cd-8ebf-14ee5d1f81c1 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Refreshing instance network info cache due to event network-changed-14e48bfc-fab0-433c-b291-0e75e2da496c. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:56:45.378885 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:56:45.378885 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7aaf6119-5665-42db-a289-a138b6643308 req-1c6ba294-1feb-41cd-8ebf-14ee5d1f81c1 service nova] Acquiring lock "refresh_cache-58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:56:45.379732 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:56:45.380082 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:56:45.380308 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:56:45.380560 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:56:45.380982 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 21 01:56:45.381193 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:56:45.609761 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ee2a762c-bb6a-45d2-b548-d44340ce8f5f req-5c14c0b5-7ec1-4aeb-b402-e02bb5eccebf service nova] Releasing lock "refresh_cache-58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:56:45.610237 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bac77756-dd03-44b7-ab92-5290d43decec req-99801766-8f9c-4bbf-83a7-693c7d8263f6 service nova] Acquired lock "refresh_cache-58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:56:45.610432 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-bac77756-dd03-44b7-ab92-5290d43decec req-99801766-8f9c-4bbf-83a7-693c7d8263f6 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Refreshing network info cache for port d807c564-314d-4f8e-8984-8068d59d3538 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:56:45.886201 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:45.886640 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:45.886640 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:45.888782 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Auditing locally available compute resources for np0000001127 (node: np0000001127) {{(pid=98206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 21 01:56:46.062036 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:46.113149 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-bac77756-dd03-44b7-ab92-5290d43decec req-99801766-8f9c-4bbf-83a7-693c7d8263f6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:46.258944 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-bac77756-dd03-44b7-ab92-5290d43decec req-99801766-8f9c-4bbf-83a7-693c7d8263f6 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:56:46.459678 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-bac77756-dd03-44b7-ab92-5290d43decec req-99801766-8f9c-4bbf-83a7-693c7d8263f6 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:56:46.487530 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Successfully updated port: 93b6a994-3c94-45b3-be4c-d63ce41a8557 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 01:56:46.541197 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-baf33584-e40d-4875-8550-2c4b4271faf6 req-9d15be8a-4e99-4ae5-9b7f-ad09b2b2f9ff service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-changed-93b6a994-3c94-45b3-be4c-d63ce41a8557 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:56:46.541657 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-baf33584-e40d-4875-8550-2c4b4271faf6 req-9d15be8a-4e99-4ae5-9b7f-ad09b2b2f9ff service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Refreshing instance network info cache due to event network-changed-93b6a994-3c94-45b3-be4c-d63ce41a8557. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:56:46.541918 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-baf33584-e40d-4875-8550-2c4b4271faf6 req-9d15be8a-4e99-4ae5-9b7f-ad09b2b2f9ff service nova] Acquiring lock "refresh_cache-58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:56:46.917975 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:56:46.968494 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bac77756-dd03-44b7-ab92-5290d43decec req-99801766-8f9c-4bbf-83a7-693c7d8263f6 service nova] Releasing lock "refresh_cache-58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:56:46.968494 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7aaf6119-5665-42db-a289-a138b6643308 req-1c6ba294-1feb-41cd-8ebf-14ee5d1f81c1 service nova] Acquired lock "refresh_cache-58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:56:46.968494 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-7aaf6119-5665-42db-a289-a138b6643308 req-1c6ba294-1feb-41cd-8ebf-14ee5d1f81c1 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Refreshing network info cache for port 14e48bfc-fab0-433c-b291-0e75e2da496c {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:56:46.989880 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Acquiring lock "refresh_cache-58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:56:47.003928 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:56:47.004425 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:56:47.083885 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:56:47.088244 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:56:47.173618 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:56:47.174341 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:56:47.266484 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:56:47.269819 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6307081b-dd75-4ea3-aad6-d01f2b2b1c9b/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:56:47.339222 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6307081b-dd75-4ea3-aad6-d01f2b2b1c9b/disk --force-share --output=json" returned: 0 in 0.070s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:56:47.339915 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6307081b-dd75-4ea3-aad6-d01f2b2b1c9b/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:56:47.415829 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6307081b-dd75-4ea3-aad6-d01f2b2b1c9b/disk --force-share --output=json" returned: 0 in 0.075s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:56:47.419591 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf25bc4-b32d-4627-9571-f98869b227f9/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:56:47.475808 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-7aaf6119-5665-42db-a289-a138b6643308 req-1c6ba294-1feb-41cd-8ebf-14ee5d1f81c1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:47.496033 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf25bc4-b32d-4627-9571-f98869b227f9/disk --force-share --output=json" returned: 0 in 0.077s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:56:47.496856 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf25bc4-b32d-4627-9571-f98869b227f9/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:56:47.598870 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf25bc4-b32d-4627-9571-f98869b227f9/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:56:47.602037 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:56:47.618169 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-7aaf6119-5665-42db-a289-a138b6643308 req-1c6ba294-1feb-41cd-8ebf-14ee5d1f81c1 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:56:47.699217 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:56:47.699677 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:56:47.785571 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-7aaf6119-5665-42db-a289-a138b6643308 req-1c6ba294-1feb-41cd-8ebf-14ee5d1f81c1 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:56:47.795210 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:56:47.799169 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98ace73f-7d4b-4aed-9355-a39c58f9b024/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:56:47.884740 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98ace73f-7d4b-4aed-9355-a39c58f9b024/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:56:47.885433 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98ace73f-7d4b-4aed-9355-a39c58f9b024/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:56:47.965029 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98ace73f-7d4b-4aed-9355-a39c58f9b024/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:56:47.966957 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 01:56:47.967985 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:56:47.992324 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "env LANG=C uptime" returned: 0 in 0.024s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:56:47.992953 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Hypervisor/Node resource view: name=np0000001127 free_ram=12976MB free_disk=74.64965057373047GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 21 01:56:47.993131 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:47.993310 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:48.007645 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:48.293453 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7aaf6119-5665-42db-a289-a138b6643308 req-1c6ba294-1feb-41cd-8ebf-14ee5d1f81c1 service nova] Releasing lock "refresh_cache-58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:56:48.294104 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-baf33584-e40d-4875-8550-2c4b4271faf6 req-9d15be8a-4e99-4ae5-9b7f-ad09b2b2f9ff service nova] Acquired lock "refresh_cache-58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:56:48.294290 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-baf33584-e40d-4875-8550-2c4b4271faf6 req-9d15be8a-4e99-4ae5-9b7f-ad09b2b2f9ff service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Refreshing network info cache for port 93b6a994-3c94-45b3-be4c-d63ce41a8557 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:56:48.796497 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-baf33584-e40d-4875-8550-2c4b4271faf6 req-9d15be8a-4e99-4ae5-9b7f-ad09b2b2f9ff service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:48.894861 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-baf33584-e40d-4875-8550-2c4b4271faf6 req-9d15be8a-4e99-4ae5-9b7f-ad09b2b2f9ff service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:56:49.072718 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 0059a43c-1d34-40a9-af63-b5eca8c30f53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 01:56:49.072718 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 01:56:49.072718 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance ecf25bc4-b32d-4627-9571-f98869b227f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 01:56:49.073172 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 98ace73f-7d4b-4aed-9355-a39c58f9b024 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 01:56:49.073172 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 01:56:49.073172 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 29a124ee-2b8c-4f44-8f91-8dd11ac78b52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 01:56:49.073172 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 01:56:49.073276 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 21 01:56:49.073428 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Final resource view: name=np0000001127 phys_ram=24030MB used_ram=1856MB phys_disk=95GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:56:47 up 27 min,  2 users,  load average: 7.88, 3.70, 1.76\n', 'num_instances': '7', 'num_vm_active': '6', 'num_task_None': '6', 'num_os_type_None': '7', 'num_proj_2e41dd931ff049868a61f52a251d1122': '1', 'io_workload': '1', 'num_proj_1ffcb955f57a438d998dbdf9bfee0868': '1', 'num_proj_e35d2fe45bb24d2b9f7b547352683fd4': '2', 'num_proj_cad39cb6391143989b2404dc66ddfe0f': '1', 'num_proj_6a15fe7a70464159a778cffa4a36c36f': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_d16c5939e8b346a8a2da89fb19b2a812': '1'} {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 21 01:56:49.109980 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-baf33584-e40d-4875-8550-2c4b4271faf6 req-9d15be8a-4e99-4ae5-9b7f-ad09b2b2f9ff service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:56:49.467777 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6988244c-27f2-4646-9ac3-3d3b5b05a900 req-deb1aaaa-aa02-4a28-8c0c-50649d0042ae service nova] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Received event network-changed-a36c9ce2-1986-45f2-b2bd-e0bbf396d67a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:56:49.467926 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6988244c-27f2-4646-9ac3-3d3b5b05a900 req-deb1aaaa-aa02-4a28-8c0c-50649d0042ae service nova] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Refreshing instance network info cache due to event network-changed-a36c9ce2-1986-45f2-b2bd-e0bbf396d67a. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:56:49.468085 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6988244c-27f2-4646-9ac3-3d3b5b05a900 req-deb1aaaa-aa02-4a28-8c0c-50649d0042ae service nova] Acquiring lock "refresh_cache-98ace73f-7d4b-4aed-9355-a39c58f9b024" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:56:49.468169 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6988244c-27f2-4646-9ac3-3d3b5b05a900 req-deb1aaaa-aa02-4a28-8c0c-50649d0042ae service nova] Acquired lock "refresh_cache-98ace73f-7d4b-4aed-9355-a39c58f9b024" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:56:49.468293 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-6988244c-27f2-4646-9ac3-3d3b5b05a900 req-deb1aaaa-aa02-4a28-8c0c-50649d0042ae service nova] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Refreshing network info cache for port a36c9ce2-1986-45f2-b2bd-e0bbf396d67a {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:56:49.579508 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:56:49.579508 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:56:49.618549 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-baf33584-e40d-4875-8550-2c4b4271faf6 req-9d15be8a-4e99-4ae5-9b7f-ad09b2b2f9ff service nova] Releasing lock "refresh_cache-58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:56:49.618549 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Acquired lock "refresh_cache-58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:56:49.618549 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 01:56:49.695750 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Acquiring lock "cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:49.696264 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Lock "cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:49.972254 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-6988244c-27f2-4646-9ac3-3d3b5b05a900 req-deb1aaaa-aa02-4a28-8c0c-50649d0042ae service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:50.084506 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:56:50.201683 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Lazy-loading 'flavor' on Instance uuid cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:56:50.258520 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:56:50.375041 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-6988244c-27f2-4646-9ac3-3d3b5b05a900 req-deb1aaaa-aa02-4a28-8c0c-50649d0042ae service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:50.466746 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Acquiring lock "98ace73f-7d4b-4aed-9355-a39c58f9b024" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:50.466949 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "98ace73f-7d4b-4aed-9355-a39c58f9b024" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:50.510494 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:50.580588 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-6988244c-27f2-4646-9ac3-3d3b5b05a900 req-deb1aaaa-aa02-4a28-8c0c-50649d0042ae service nova] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Updated VIF entry in instance network info cache for port a36c9ce2-1986-45f2-b2bd-e0bbf396d67a. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 01:56:50.580887 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-6988244c-27f2-4646-9ac3-3d3b5b05a900 req-deb1aaaa-aa02-4a28-8c0c-50649d0042ae service nova] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Updating instance_info_cache with network_info: [{"id": "a36c9ce2-1986-45f2-b2bd-e0bbf396d67a", "address": "fa:16:3e:ee:ec:8e", "network": {"id": "97eda448-6d12-4aa9-b1f2-150d371463f1", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-343348586-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e35d2fe45bb24d2b9f7b547352683fd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36c9ce2-19", "ovs_interfaceid": "a36c9ce2-1986-45f2-b2bd-e0bbf396d67a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:56:50.592164 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Compute_service record updated for np0000001127:np0000001127 {{(pid=98206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 21 01:56:50.592494 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.599s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:50.592965 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 48.08 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 01:56:50.867769 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:50.970608 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lazy-loading 'flavor' on Instance uuid 98ace73f-7d4b-4aed-9355-a39c58f9b024 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:56:51.064726 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:51.083360 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6988244c-27f2-4646-9ac3-3d3b5b05a900 req-deb1aaaa-aa02-4a28-8c0c-50649d0042ae service nova] Releasing lock "refresh_cache-98ace73f-7d4b-4aed-9355-a39c58f9b024" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:56:51.195087 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:51.218457 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Lock "cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.522s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:51.528109 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:51.817211 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-fc5a0833-2e59-4103-929a-4fbd388427f8 req-c39914e3-f320-4ab7-9d35-77e5ccfbe122 service nova] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Received event network-changed-30254ddf-7ff6-4428-817c-93ea13bd4dcd {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:56:51.817937 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-fc5a0833-2e59-4103-929a-4fbd388427f8 req-c39914e3-f320-4ab7-9d35-77e5ccfbe122 service nova] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Refreshing instance network info cache due to event network-changed-30254ddf-7ff6-4428-817c-93ea13bd4dcd. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:56:51.818148 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fc5a0833-2e59-4103-929a-4fbd388427f8 req-c39914e3-f320-4ab7-9d35-77e5ccfbe122 service nova] Acquiring lock "refresh_cache-ecf25bc4-b32d-4627-9571-f98869b227f9" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:56:51.818195 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fc5a0833-2e59-4103-929a-4fbd388427f8 req-c39914e3-f320-4ab7-9d35-77e5ccfbe122 service nova] Acquired lock "refresh_cache-ecf25bc4-b32d-4627-9571-f98869b227f9" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:56:51.818294 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-fc5a0833-2e59-4103-929a-4fbd388427f8 req-c39914e3-f320-4ab7-9d35-77e5ccfbe122 service nova] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Refreshing network info cache for port 30254ddf-7ff6-4428-817c-93ea13bd4dcd {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:56:51.925454 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:51.981064 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "98ace73f-7d4b-4aed-9355-a39c58f9b024" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.514s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:52.321059 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-fc5a0833-2e59-4103-929a-4fbd388427f8 req-c39914e3-f320-4ab7-9d35-77e5ccfbe122 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:52.381236 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:52.718505 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-fc5a0833-2e59-4103-929a-4fbd388427f8 req-c39914e3-f320-4ab7-9d35-77e5ccfbe122 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:52.840185 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:52.926014 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-fc5a0833-2e59-4103-929a-4fbd388427f8 req-c39914e3-f320-4ab7-9d35-77e5ccfbe122 service nova] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Updated VIF entry in instance network info cache for port 30254ddf-7ff6-4428-817c-93ea13bd4dcd. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 01:56:52.926014 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-fc5a0833-2e59-4103-929a-4fbd388427f8 req-c39914e3-f320-4ab7-9d35-77e5ccfbe122 service nova] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Updating instance_info_cache with network_info: [{"id": "30254ddf-7ff6-4428-817c-93ea13bd4dcd", "address": "fa:16:3e:4a:37:e3", "network": {"id": "97eda448-6d12-4aa9-b1f2-150d371463f1", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-343348586-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e35d2fe45bb24d2b9f7b547352683fd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30254ddf-7f", "ovs_interfaceid": "30254ddf-7ff6-4428-817c-93ea13bd4dcd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:56:52.929701 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Acquiring lock "cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:52.930133 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Lock "cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:52.935453 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Attaching volume 2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 to /dev/vdb
May 21 01:56:53.008999 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:53.014249 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:56:53.031718 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 01:56:53.066831 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Updating instance_info_cache with network_info: [{"id": "ebf91ac5-9634-4897-a1bb-7336846be7cb", "address": "fa:16:3e:fd:1e:9d", "network": {"id": "724d3b04-8f64-44ab-8f94-c1119b9a5b83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1321933524-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf91ac5-96", "ovs_interfaceid": "ebf91ac5-9634-4897-a1bb-7336846be7cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "319abe1b-caf8-4fa7-bc6c-caa7e755860b", "address": "fa:16:3e:10:bc:3b", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap319abe1b-ca", "ovs_interfaceid": "319abe1b-caf8-4fa7-bc6c-caa7e755860b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "db10c43a-9d2b-4250-83b6-0ca8ced88657", "address": "fa:16:3e:05:02:b1", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb10c43a-9d", "ovs_interfaceid": "db10c43a-9d2b-4250-83b6-0ca8ced88657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d807c564-314d-4f8e-8984-8068d59d3538", "address": "fa:16:3e:df:4a:48", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd807c564-31", "ovs_interfaceid": "d807c564-314d-4f8e-8984-8068d59d3538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d03a47d5-bec7-4099-96e0-c102edfe9e8e", "address": "fa:16:3e:70:5b:80", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03a47d5-be", "ovs_interfaceid": "d03a47d5-bec7-4099-96e0-c102edfe9e8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "14e48bfc-fab0-433c-b291-0e75e2da496c", "address": "fa:16:3e:e5:ea:60", "network": {"id": "7b5c3ed1-837f-404f-9062-8babcc21dfd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-715008204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e48bfc-fa", "ovs_interfaceid": "14e48bfc-fab0-433c-b291-0e75e2da496c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "93b6a994-3c94-45b3-be4c-d63ce41a8557", "address": "fa:16:3e:56:b9:59", "network": {"id": "7b5c3ed1-837f-404f-9062-8babcc21dfd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-715008204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93b6a994-3c", "ovs_interfaceid": "93b6a994-3c94-45b3-be4c-d63ce41a8557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:56:53.068834 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:56:53.092115 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 01:56:53.092490 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 01:56:53.103622 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 01:56:53.104406 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe00:d8d3', 'fe80::c062:49ff:fe28:b40d', 'fe80::fc16:3eff:feba:8492', 'fe80::405e:62ff:fe28:f67b', 'fe80::fc16:3eff:fe4a:37e3', 'fe80::4822:65ff:fe37:7fac', 'fe80::fc16:3eff:feee:ec8e', 'fe80::fc16:3eff:fea0:e8cd', 'fe80::ca2:24ff:fe18:e91d', 'fe80::fc16:3eff:fe9e:216', 'fe80::14d9:7bff:fe3b:f0dc'] 
May 21 01:56:53.121840 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 01:56:53.121840 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 01:56:53.121840 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] <== get_connector_properties: return (90ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:56:53.121840 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Updating existing volume attachment record: 34831bef-027c-4563-8d6c-5b84795430da {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 01:56:53.424297 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fc5a0833-2e59-4103-929a-4fbd388427f8 req-c39914e3-f320-4ab7-9d35-77e5ccfbe122 service nova] Releasing lock "refresh_cache-ecf25bc4-b32d-4627-9571-f98869b227f9" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:56:53.580188 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Releasing lock "refresh_cache-58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:56:53.580989 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Instance network_info: |[{"id": "ebf91ac5-9634-4897-a1bb-7336846be7cb", "address": "fa:16:3e:fd:1e:9d", "network": {"id": "724d3b04-8f64-44ab-8f94-c1119b9a5b83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1321933524-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf91ac5-96", "ovs_interfaceid": "ebf91ac5-9634-4897-a1bb-7336846be7cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "319abe1b-caf8-4fa7-bc6c-caa7e755860b", "address": "fa:16:3e:10:bc:3b", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap319abe1b-ca", "ovs_interfaceid": "319abe1b-caf8-4fa7-bc6c-caa7e755860b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "db10c43a-9d2b-4250-83b6-0ca8ced88657", "address": "fa:16:3e:05:02:b1", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb10c43a-9d", "ovs_interfaceid": "db10c43a-9d2b-4250-83b6-0ca8ced88657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d807c564-314d-4f8e-8984-8068d59d3538", "address": "fa:16:3e:df:4a:48", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd807c564-31", "ovs_interfaceid": "d807c564-314d-4f8e-8984-8068d59d3538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d03a47d5-bec7-4099-96e0-c102edfe9e8e", "address": "fa:16:3e:70:5b:80", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03a47d5-be", "ovs_interfaceid": "d03a47d5-bec7-4099-96e0-c102edfe9e8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "14e48bfc-fab0-433c-b291-0e75e2da496c", "address": "fa:16:3e:e5:ea:60", "network": {"id": "7b5c3ed1-837f-404f-9062-8babcc21dfd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-715008204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e48bfc-fa", "ovs_interfaceid": "14e48bfc-fab0-433c-b291-0e75e2da496c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "93b6a994-3c94-45b3-be4c-d63ce41a8557", "address": "fa:16:3e:56:b9:59", "network": {"id": "7b5c3ed1-837f-404f-9062-8babcc21dfd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-715008204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93b6a994-3c", "ovs_interfaceid": "93b6a994-3c94-45b3-be4c-d63ce41a8557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 01:56:53.583060 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Start _get_guest_xml network_info=[{"id": "ebf91ac5-9634-4897-a1bb-7336846be7cb", "address": "fa:16:3e:fd:1e:9d", "network": {"id": "724d3b04-8f64-44ab-8f94-c1119b9a5b83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1321933524-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf91ac5-96", "ovs_interfaceid": "ebf91ac5-9634-4897-a1bb-7336846be7cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "319abe1b-caf8-4fa7-bc6c-caa7e755860b", "address": "fa:16:3e:10:bc:3b", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap319abe1b-ca", "ovs_interfaceid": "319abe1b-caf8-4fa7-bc6c-caa7e755860b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "db10c43a-9d2b-4250-83b6-0ca8ced88657", "address": "fa:16:3e:05:02:b1", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb10c43a-9d", "ovs_interfaceid": "db10c43a-9d2b-4250-83b6-0ca8ced88657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d807c564-314d-4f8e-8984-8068d59d3538", "address": "fa:16:3e:df:4a:48", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd807c564-31", "ovs_interfaceid": "d807c564-314d-4f8e-8984-8068d59d3538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d03a47d5-bec7-4099-96e0-c102edfe9e8e", "address": "fa:16:3e:70:5b:80", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03a47d5-be", "ovs_interfaceid": "d03a47d5-bec7-4099-96e0-c102edfe9e8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "14e48bfc-fab0-433c-b291-0e75e2da496c", "address": "fa:16:3e:e5:ea:60", "network": {"id": "7b5c3ed1-837f-404f-9062-8babcc21dfd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-715008204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e48bfc-fa", "ovs_interfaceid": "14e48bfc-fab0-433c-b291-0e75e2da496c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "93b6a994-3c94-45b3-be4c-d63ce41a8557", "address": "fa:16:3e:56:b9:59", "network": {"id": "7b5c3ed1-837f-404f-9062-8babcc21dfd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-715008204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93b6a994-3c", "ovs_interfaceid": "93b6a994-3c94-45b3-be4c-d63ce41a8557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88', 'iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5d11385-1cda-4417-8269-f34d36246e88', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8', 'attached_at': '', 'detached_at': '', 'volume_id': 'f5d11385-1cda-4417-8269-f34d36246e88', 'serial': 'f5d11385-1cda-4417-8269-f34d36246e88'}, 'delete_on_termination': False, 'attachment_id': 'a548858e-dee2-4c35-88ee-c44efe148969', 'volume_type': None}, {'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': 1, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57', 'iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'de377f05-4bd5-4c5b-bf60-f92093972e57', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8', 'attached_at': '', 'detached_at': '', 'volume_id': 'de377f05-4bd5-4c5b-bf60-f92093972e57', 'serial': 'de377f05-4bd5-4c5b-bf60-f92093972e57'}, 'delete_on_termination': False, 'attachment_id': 'be9fc64e-b1dc-427c-90a8-547975f920f0', 'volume_type': None}, {'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'boot_index': 2, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7', 'iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '728d4669-c172-4f18-ae34-53ce485326e7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8', 'attached_at': '', 'detached_at': '', 'volume_id': '728d4669-c172-4f18-ae34-53ce485326e7', 'serial': '728d4669-c172-4f18-ae34-53ce485326e7'}, 'delete_on_termination': False, 'attachment_id': '05fc8d33-69fe-4ced-8394-aac3a6401015', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 01:56:53.589768 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 01:56:53.589768 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1881553016', uuid='58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8'), owner=OwnerMeta(userid='06d28d9bc06a4a27bcba288eb5a07e0c', username='tempest-TaggedBootDevicesTest-1353067880-project-member', projectid='d16c5939e8b346a8a2da89fb19b2a812', projectname='tempest-TaggedBootDevicesTest-1353067880'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ebf91ac5-9634-4897-a1bb-7336846be7cb", "address": "fa:16:3e:fd:1e:9d", "network": {"id": "724d3b04-8f64-44ab-8f94-c1119b9a5b83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1321933524-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf91ac5-96", "ovs_interfaceid": "ebf91ac5-9634-4897-a1bb-7336846be7cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "319abe1b-caf8-4fa7-bc6c-caa7e755860b", "address": "fa:16:3e:10:bc:3b", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap319abe1b-ca", "ovs_interfaceid": "319abe1b-caf8-4fa7-bc6c-caa7e755860b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "db10c43a-9d2b-4250-83b6-0ca8ced88657", "address": "fa:16:3e:05:02:b1", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb10c43a-9d", "ovs_interfaceid": "db10c43a-9d2b-4250-83b6-0ca8ced88657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d807c564-314d-4f8e-8984-8068d59d3538", "address": "fa:16:3e:df:4a:48", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd807c564-31", "ovs_interfaceid": "d807c564-314d-4f8e-8984-8068d59d3538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d03a47d5-bec7-4099-96e0-c102edfe9e8e", "address": "fa:16:3e:70:5b:80", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03a47d5-be", "ovs_interfaceid": "d03a47d5-bec7-4099-96e0-c102edfe9e8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "14e48bfc-fab0-433c-b291-0e75e2da496c", "address": "fa:16:3e:e5:ea:60", "network": {"id": "7b5c3ed1-837f-404f-9062-8babcc21dfd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-715008204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e48bfc-fa", "ovs_interfaceid": "14e48bfc-fab0-433c-b291-0e75e2da496c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "93b6a994-3c94-45b3-be4c-d63ce41a8557", "address": "fa:16:3e:56:b9:59", "network": {"id": "7b5c3ed1-837f-404f-9062-8babcc21dfd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-715008204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93b6a994-3c", "ovs_interfaceid": "93b6a994-3c94-45b3-be4c-d63ce41a8557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328613.5889857) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 01:56:53.590763 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 01:56:53.591272 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 01:56:53.598454 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 01:56:53.600538 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 01:56:53.601993 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 01:56:53.602433 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 01:56:53.605193 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 01:56:53.610404 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 01:56:53.610404 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 01:56:53.610404 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 01:56:53.610404 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 01:56:53.610404 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 01:56:53.610404 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 01:56:53.610404 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 01:56:53.610404 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 01:56:53.610404 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 01:56:53.628068 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:53.628068 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:53.631992 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connector [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Factory for ISCSI on None {{(pid=98206) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}}
May 21 01:56:53.632586 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:53.632921 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 01:56:53.633324 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88', 'iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5d11385-1cda-4417-8269-f34d36246e88', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:56:53.634274 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:56:53.635369 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:56:53.635625 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88', 'iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5d11385-1cda-4417-8269-f34d36246e88', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 01:56:53.652570 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:56:53.653604 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:56:53.654592 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:56:53.655432 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:56:53.655831 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:56:53.656224 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:56:53.670431 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 01:56:53.670431 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:56:53.679044 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 01:56:53.679044 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:56:53.686433 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88] added
May 21 01:56:53.686433 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 01:56:53.686433 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:56:53.686433 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:56:53.686433 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:56:53.686433 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:56:53.686433 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:56:53.686776 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 01:56:53.686967 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0317(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 01:56:53.687240 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 01:56:53.693953 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88] added
May 21 01:56:53.693953 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 01:56:53.693953 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:56:53.693953 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:56:53.693953 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:56:53.693953 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:56:53.693953 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:56:53.693953 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 01:56:53.693953 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0383(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 01:56:53.693953 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 01:56:53.703377 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 01:56:53.704035 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7', 'iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a1783c2-cd34-4cfa-8569-d5f41d2a98f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:56:53.704035 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:56:53.772497 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Acquiring lock "98ace73f-7d4b-4aed-9355-a39c58f9b024" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:53.772497 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "98ace73f-7d4b-4aed-9355-a39c58f9b024" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:53.772497 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Attaching volume b72d4732-cbb9-491f-8683-d0155023a91f to /dev/vdb
May 21 01:56:53.833373 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:56:53.847955 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 01:56:53.877496 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:56:53.901596 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 01:56:53.903170 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 01:56:53.913688 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 01:56:53.918271 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe00:d8d3', 'fe80::c062:49ff:fe28:b40d', 'fe80::fc16:3eff:feba:8492', 'fe80::405e:62ff:fe28:f67b', 'fe80::fc16:3eff:fe4a:37e3', 'fe80::4822:65ff:fe37:7fac', 'fe80::fc16:3eff:feee:ec8e', 'fe80::fc16:3eff:fea0:e8cd', 'fe80::ca2:24ff:fe18:e91d', 'fe80::fc16:3eff:fe9e:216', 'fe80::14d9:7bff:fe3b:f0dc'] 
May 21 01:56:53.918271 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 01:56:53.918271 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 01:56:53.921509 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:56:53.921509 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Updating existing volume attachment record: 8cbe72a5-446a-4465-8358-e52bc528b2a6 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 01:56:54.508517 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 01:56:54.508517 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f', 'iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b72d4732-cbb9-491f-8683-d0155023a91f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:56:54.508517 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:56:54.688030 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:56:54.694602 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.startup = manual
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:56:54.722143 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:56:54.722143 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.startup = manual
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:56:54.735526 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:56:54.735526 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:56:54.742245 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:56:54.754673 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:56:54.764506 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 21 01:56:54.764506 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:56:54.764506 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 21 01:56:54.764506 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:56:54.766171 np0000001127 nova-compute[98206]: WARNING os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 21 01:56:54.766171 np0000001127 nova-compute[98206]: 
May 21 01:56:54.777794 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 21 01:56:54.777794 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:56:54.777794 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 21 01:56:54.777794 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:56:54.778689 np0000001127 nova-compute[98206]: WARNING os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 21 01:56:54.778689 np0000001127 nova-compute[98206]: 
May 21 01:56:54.803891 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88, portal: 192.168.40.100,3260]
May 21 01:56:54.803891 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88, portal: 192.168.40.100,3260] successful.
May 21 01:56:54.803891 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:56:54.819616 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Acquiring lock "e9664d16-b539-4ccc-abd4-47a8fa944520" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:54.819950 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "e9664d16-b539-4ccc-abd4-47a8fa944520" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:54.826437 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:56:54.840778 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:56:54.840778 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,0 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:56:54.840778 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:56:54.840778 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsi session list stdout=tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:56:54.840778 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,0 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:56:54.840778 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:56:54.840778 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.186s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:56:54.842864 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:56:54.842864 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] HCTL ('7', '-', '-', 0) found on session 6 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:56:54.842864 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:56:54.864419 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Searching for a device in session 6 and hctl ['7', '*', '*', 0] yield: None {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:56:55.323175 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 01:56:55.820242 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88, portal: 192.168.50.100,3260]
May 21 01:56:55.820242 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88, portal: 192.168.50.100,3260] successful.
May 21 01:56:55.820242 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:56:55.834192 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:56:55.850505 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:56:55.850505 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:56:55.850505 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:56:55.850505 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsi session list stdout=tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:56:55.850505 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:56:55.850505 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:56:55.850505 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.194s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:56:55.850505 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:56:55.850505 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] HCTL ('8', '-', '-', 0) found on session 7 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:56:55.850505 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:56:55.869408 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Searching for a device in session 7 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:56:55.869408 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Searching for a device in session 6 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:56:55.869408 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f5d11385-1cda-4417-8269-f34d36246e88', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:56:55.869408 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5d11385-1cda-4417-8269-f34d36246e88', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:56:55.903140 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:55.903491 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:55.908461 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 01:56:55.908734 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Claim successful on node np0000001127
May 21 01:56:56.068489 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:56.655574 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 01:56:57.362716 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:56:57.363159 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:56:57.674612 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Found WWN 1StorPooliSCSI_DISK_1034578903445798920 for multipath device dm-0 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 01:56:57.674767 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.040s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:56:57.674949 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] <== connect_volume: return (4041ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445798920', 'path': '/dev/dm-0', 'multipath_id': '1StorPooliSCSI_DISK_1034578903445798920'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:56:57.675057 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445798920', 'path': '/dev/dm-0', 'multipath_id': '1StorPooliSCSI_DISK_1034578903445798920'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 01:56:57.675825 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.972s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:56:57.676379 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7', 'iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a1783c2-cd34-4cfa-8569-d5f41d2a98f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 01:56:57.689210 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:56:57.690020 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:56:57.690491 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:56:57.690713 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:56:57.691518 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:56:57.691518 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:56:57.703816 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 01:56:57.703816 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:56:57.709331 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 01:56:57.709331 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:56:57.717775 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7] added
May 21 01:56:57.717775 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 01:56:57.717775 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:56:57.717775 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:56:57.717775 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:56:57.717775 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:56:57.717775 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:56:57.718040 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 01:56:57.718290 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0275(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 01:56:57.718449 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 01:56:57.722406 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7] added
May 21 01:56:57.722406 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 01:56:57.722406 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:56:57.722406 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:56:57.722406 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:56:57.722406 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:56:57.722406 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:56:57.722773 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 01:56:57.722773 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0312(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 01:56:57.722871 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 01:56:57.867758 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:56:58.012412 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:58.181022 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 01:56:58.181506 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57', 'iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'de377f05-4bd5-4c5b-bf60-f92093972e57', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:56:58.181669 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:56:58.374784 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.471s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:56:58.375195 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 01:56:58.456996 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-945dec38-4384-455f-9e1b-43d1c797c367 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Acquiring lock "interface-6307081b-dd75-4ea3-aad6-d01f2b2b1c9b-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:58.457256 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-945dec38-4384-455f-9e1b-43d1c797c367 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lock "interface-6307081b-dd75-4ea3-aad6-d01f2b2b1c9b-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:58.457646 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-945dec38-4384-455f-9e1b-43d1c797c367 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lazy-loading 'flavor' on Instance uuid 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:56:58.718965 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:56:58.723267 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.startup = manual
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:56:58.730334 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:56:58.730334 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.startup = manual
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:56:58.736969 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:56:58.736969 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:56:58.742528 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:56:58.750435 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:56:58.757335 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:56:58.757335 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:56:58.757335 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:56:58.757610 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] iscsi session list stdout=tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:56:58.757610 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:56:58.757610 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:56:58.764243 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:56:58.764243 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:56:58.764243 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:56:58.764419 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] iscsi session list stdout=tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:56:58.764419 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:56:58.764419 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:56:58.790147 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7, portal: 192.168.40.100,3260]
May 21 01:56:58.790147 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7, portal: 192.168.40.100,3260] successful.
May 21 01:56:58.790147 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:56:58.801330 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:56:58.802177 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7, portal: 192.168.50.100,3260]
May 21 01:56:58.802177 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7, portal: 192.168.50.100,3260] successful.
May 21 01:56:58.802177 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:56:58.814592 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:56:58.814592 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:56:58.814592 np0000001127 nova-compute[98206]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:56:58.814592 np0000001127 nova-compute[98206]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:56:58.814592 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:56:58.814834 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] iscsi session list stdout=tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:56:58.814834 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:56:58.814834 np0000001127 nova-compute[98206]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:56:58.814834 np0000001127 nova-compute[98206]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:56:58.814834 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:56:58.815027 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.125s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:56:58.815027 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:56:58.815564 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] HCTL ('9', '-', '-', 0) found on session 8 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:56:58.815720 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Scanning host 9 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:56:58.818986 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:56:58.820359 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:56:58.834784 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:56:58.834784 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:56:58.834784 np0000001127 nova-compute[98206]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:56:58.834784 np0000001127 nova-compute[98206]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:56:58.834784 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:56:58.836065 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Searching for a device in session 8 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:56:58.836399 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] iscsi session list stdout=tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:56:58.836399 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:56:58.836399 np0000001127 nova-compute[98206]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:56:58.836399 np0000001127 nova-compute[98206]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:56:58.836399 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:56:58.836846 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a1783c2-cd34-4cfa-8569-d5f41d2a98f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:56:58.837036 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.146s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:56:58.837209 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:56:58.837911 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] HCTL ('10', '-', '-', 0) found on session 9 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:56:58.837988 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Scanning host 10 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:56:58.851806 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Searching for a device in session 9 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:56:58.851927 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2a1783c2-cd34-4cfa-8569-d5f41d2a98f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:56:58.881324 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 01:56:58.881655 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 01:56:58.882160 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:58.884382 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:58.961430 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-945dec38-4384-455f-9e1b-43d1c797c367 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:58.966962 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '457854a2cf2844b8b693d835d2c9b699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a80dd2c84334f79afe5cb079c50c555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 01:56:58.974983 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "6f68556b-0b18-452a-b307-da2dad4ee6ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:56:58.974983 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "6f68556b-0b18-452a-b307-da2dad4ee6ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:56:59.142832 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-945dec38-4384-455f-9e1b-43d1c797c367 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lazy-loading 'pci_requests' on Instance uuid 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:56:59.388053 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 01:56:59.477454 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 01:56:59.512679 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Successfully created port: 1f478597-015e-4c42-b8d5-af05bb7c8f8e {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 01:56:59.645158 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-945dec38-4384-455f-9e1b-43d1c797c367 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Object Instance<6307081b-dd75-4ea3-aad6-d01f2b2b1c9b> lazy-loaded attributes: flavor,pci_requests {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 01:56:59.645316 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-945dec38-4384-455f-9e1b-43d1c797c367 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 01:56:59.645611 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-945dec38-4384-455f-9e1b-43d1c797c367 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:59.645859 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-945dec38-4384-455f-9e1b-43d1c797c367 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:56:59.690724 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 01:56:59.716333 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-945dec38-4384-455f-9e1b-43d1c797c367 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0fd36d5cf62b4dc49bd53ebc09db2a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffcb955f57a438d998dbdf9bfee0868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 01:56:59.890874 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 01:57:00.052384 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:00.053081 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:00.057142 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 01:57:00.057414 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Claim successful on node np0000001127
May 21 01:57:00.066091 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Successfully updated port: 1f478597-015e-4c42-b8d5-af05bb7c8f8e {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 01:57:00.134865 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-16181034-0379-42ef-ba24-8ec323ffd805 req-42a459fb-7ab8-4d0a-a696-a3aff07ec2db service nova] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Received event network-changed-1f478597-015e-4c42-b8d5-af05bb7c8f8e {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:00.135244 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-16181034-0379-42ef-ba24-8ec323ffd805 req-42a459fb-7ab8-4d0a-a696-a3aff07ec2db service nova] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Refreshing instance network info cache due to event network-changed-1f478597-015e-4c42-b8d5-af05bb7c8f8e. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:57:00.135581 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-16181034-0379-42ef-ba24-8ec323ffd805 req-42a459fb-7ab8-4d0a-a696-a3aff07ec2db service nova] Acquiring lock "refresh_cache-e9664d16-b539-4ccc-abd4-47a8fa944520" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:57:00.136746 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-16181034-0379-42ef-ba24-8ec323ffd805 req-42a459fb-7ab8-4d0a-a696-a3aff07ec2db service nova] Acquired lock "refresh_cache-e9664d16-b539-4ccc-abd4-47a8fa944520" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:57:00.136746 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-16181034-0379-42ef-ba24-8ec323ffd805 req-42a459fb-7ab8-4d0a-a696-a3aff07ec2db service nova] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Refreshing network info cache for port 1f478597-015e-4c42-b8d5-af05bb7c8f8e {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:57:00.289851 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-945dec38-4384-455f-9e1b-43d1c797c367 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Successfully created port: bcbb3f8b-362a-4634-8baa-f09e0134e596 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 01:57:00.568622 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Acquiring lock "refresh_cache-e9664d16-b539-4ccc-abd4-47a8fa944520" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:57:00.643035 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-16181034-0379-42ef-ba24-8ec323ffd805 req-42a459fb-7ab8-4d0a-a696-a3aff07ec2db service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:00.712849 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Found WWN 330000000939e189e for multipath device dm-3 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 01:57:00.713210 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:57:00.713442 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] <== connect_volume: return (7009ms) {'type': 'block', 'scsi_wwn': '330000000939e189e', 'path': '/dev/dm-3', 'multipath_id': '330000000939e189e'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:57:00.713779 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000939e189e', 'path': '/dev/dm-3', 'multipath_id': '330000000939e189e'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 01:57:00.716209 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-16181034-0379-42ef-ba24-8ec323ffd805 req-42a459fb-7ab8-4d0a-a696-a3aff07ec2db service nova] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:57:00.719323 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 6.208s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:57:00.719827 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f', 'iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b72d4732-cbb9-491f-8683-d0155023a91f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 01:57:00.721815 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Lazy-loading 'flavor' on Instance uuid cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:57:00.732900 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:57:00.733392 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:57:00.733634 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:57:00.734524 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:57:00.735483 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:57:00.735483 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:57:00.746376 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 01:57:00.746376 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:00.751382 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 01:57:00.751382 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:00.760645 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f] added
May 21 01:57:00.760645 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 01:57:00.760645 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:57:00.760645 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:57:00.760645 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:57:00.760645 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:57:00.760645 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:00.760973 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 01:57:00.761217 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0274(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 01:57:00.761405 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 01:57:00.768293 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f] added
May 21 01:57:00.768293 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 01:57:00.768293 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:57:00.768293 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:57:00.768293 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:57:00.768293 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:57:00.768293 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:00.768768 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 01:57:00.768918 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0334(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 01:57:00.769083 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 01:57:00.856495 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-945dec38-4384-455f-9e1b-43d1c797c367 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Successfully updated port: bcbb3f8b-362a-4634-8baa-f09e0134e596 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 01:57:00.893603 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-16181034-0379-42ef-ba24-8ec323ffd805 req-42a459fb-7ab8-4d0a-a696-a3aff07ec2db service nova] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:57:00.901362 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 01:57:00.902611 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 01:57:00.904078 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Creating image(s)
May 21 01:57:00.904078 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Acquiring lock "/opt/stack/data/nova/instances/e9664d16-b539-4ccc-abd4-47a8fa944520/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:00.904078 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "/opt/stack/data/nova/instances/e9664d16-b539-4ccc-abd4-47a8fa944520/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:00.904078 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "/opt/stack/data/nova/instances/e9664d16-b539-4ccc-abd4-47a8fa944520/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:00.904956 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:57:00.909707 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:57:00.911381 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:00.931353 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-5a31164f-5797-42c8-b984-c6e3fededd26 req-a8ad3d8f-8bc1-4027-a08f-158e2e9d6a50 service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Received event network-changed-bcbb3f8b-362a-4634-8baa-f09e0134e596 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:00.931525 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-5a31164f-5797-42c8-b984-c6e3fededd26 req-a8ad3d8f-8bc1-4027-a08f-158e2e9d6a50 service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Refreshing instance network info cache due to event network-changed-bcbb3f8b-362a-4634-8baa-f09e0134e596. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:57:00.931799 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5a31164f-5797-42c8-b984-c6e3fededd26 req-a8ad3d8f-8bc1-4027-a08f-158e2e9d6a50 service nova] Acquiring lock "refresh_cache-6307081b-dd75-4ea3-aad6-d01f2b2b1c9b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:57:00.931895 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5a31164f-5797-42c8-b984-c6e3fededd26 req-a8ad3d8f-8bc1-4027-a08f-158e2e9d6a50 service nova] Acquired lock "refresh_cache-6307081b-dd75-4ea3-aad6-d01f2b2b1c9b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:57:00.932794 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-5a31164f-5797-42c8-b984-c6e3fededd26 req-a8ad3d8f-8bc1-4027-a08f-158e2e9d6a50 service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Refreshing network info cache for port bcbb3f8b-362a-4634-8baa-f09e0134e596 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:57:00.999336 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.088s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:01.000363 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:01.000363 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:01.000677 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:57:01.003381 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:57:01.003780 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:01.069818 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:01.076066 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.072s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:01.077227 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/e9664d16-b539-4ccc-abd4-47a8fa944520/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:01.115216 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/e9664d16-b539-4ccc-abd4-47a8fa944520/disk 1073741824" returned: 0 in 0.037s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:01.115961 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.115s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:01.116608 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:01.184354 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.068s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:01.184906 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e9664d16-b539-4ccc-abd4-47a8fa944520/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 01:57:01.185236 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9664d16-b539-4ccc-abd4-47a8fa944520/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:01.227582 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Attempting to attach volume 2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 01:57:01.229077 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] attach device xml: <disk type="block" device="disk">
May 21 01:57:01.229077 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:57:01.229077 np0000001127 nova-compute[98206]:   <alias name="ua-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7"/>
May 21 01:57:01.229077 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-3"/>
May 21 01:57:01.229077 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 01:57:01.229077 np0000001127 nova-compute[98206]:   <serial>2a1783c2-cd34-4cfa-8569-d5f41d2a98f7</serial>
May 21 01:57:01.229077 np0000001127 nova-compute[98206]: </disk>
May 21 01:57:01.229077 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 01:57:01.255743 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9664d16-b539-4ccc-abd4-47a8fa944520/disk --force-share --output=json" returned: 0 in 0.070s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:01.256159 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Cannot resize image /opt/stack/data/nova/instances/e9664d16-b539-4ccc-abd4-47a8fa944520/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 01:57:01.256449 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 01:57:01.256626 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Ensure instance console log exists: /opt/stack/data/nova/instances/e9664d16-b539-4ccc-abd4-47a8fa944520/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 01:57:01.257175 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:01.257175 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:01.257175 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:01.359840 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-945dec38-4384-455f-9e1b-43d1c797c367 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Acquiring lock "refresh_cache-6307081b-dd75-4ea3-aad6-d01f2b2b1c9b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:57:01.395296 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-879acd0b-9e41-48ff-bb90-4e52daf9ed44 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "0059a43c-1d34-40a9-af63-b5eca8c30f53" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:01.396091 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-879acd0b-9e41-48ff-bb90-4e52daf9ed44 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "0059a43c-1d34-40a9-af63-b5eca8c30f53" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:01.396091 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-879acd0b-9e41-48ff-bb90-4e52daf9ed44 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Shelving
May 21 01:57:01.399724 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-16181034-0379-42ef-ba24-8ec323ffd805 req-42a459fb-7ab8-4d0a-a696-a3aff07ec2db service nova] Releasing lock "refresh_cache-e9664d16-b539-4ccc-abd4-47a8fa944520" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:57:01.400702 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Acquired lock "refresh_cache-e9664d16-b539-4ccc-abd4-47a8fa944520" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:57:01.401114 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 01:57:01.442367 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-5a31164f-5797-42c8-b984-c6e3fededd26 req-a8ad3d8f-8bc1-4027-a08f-158e2e9d6a50 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:01.629897 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:57:01.630525 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:57:01.761890 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:57:01.770665 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.startup = manual
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:57:01.772773 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:57:01.772773 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.startup = manual
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:57:01.786899 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:57:01.786899 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:01.794045 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:01.803146 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:01.809782 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:01.809782 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:01.809782 np0000001127 nova-compute[98206]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:57:01.809782 np0000001127 nova-compute[98206]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:57:01.809782 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:57:01.810114 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] iscsi session list stdout=tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:01.810114 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:01.810114 np0000001127 nova-compute[98206]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:57:01.810114 np0000001127 nova-compute[98206]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:57:01.810114 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:57:01.818980 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:01.818980 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:01.818980 np0000001127 nova-compute[98206]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:57:01.818980 np0000001127 nova-compute[98206]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:57:01.818980 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:57:01.818980 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] iscsi session list stdout=tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:01.818980 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:01.818980 np0000001127 nova-compute[98206]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:57:01.818980 np0000001127 nova-compute[98206]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:57:01.818980 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:57:01.834559 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-5a31164f-5797-42c8-b984-c6e3fededd26 req-a8ad3d8f-8bc1-4027-a08f-158e2e9d6a50 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:01.850239 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f, portal: 192.168.40.100,3260]
May 21 01:57:01.850239 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f, portal: 192.168.40.100,3260] successful.
May 21 01:57:01.850239 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:01.859136 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f, portal: 192.168.50.100,3260]
May 21 01:57:01.859136 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f, portal: 192.168.50.100,3260] successful.
May 21 01:57:01.859136 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:01.863875 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:01.871462 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:01.882788 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:01.882788 np0000001127 nova-compute[98206]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:01.882788 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:01.882788 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:01.882788 np0000001127 nova-compute[98206]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:57:01.882788 np0000001127 nova-compute[98206]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:57:01.882788 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:57:01.882788 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:01.882788 np0000001127 nova-compute[98206]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:01.882788 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:01.882788 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:01.882788 np0000001127 nova-compute[98206]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:57:01.882788 np0000001127 nova-compute[98206]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:57:01.882788 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:57:01.882788 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.148s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:57:01.882788 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:57:01.882788 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] HCTL ('11', '-', '-', 0) found on session 10 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:57:01.883492 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:57:01.889631 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:01.889631 np0000001127 nova-compute[98206]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:01.889631 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:01.889631 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:01.889631 np0000001127 nova-compute[98206]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:57:01.889631 np0000001127 nova-compute[98206]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:57:01.889631 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:57:01.889916 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:01.889916 np0000001127 nova-compute[98206]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:01.889916 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:01.889916 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:01.889916 np0000001127 nova-compute[98206]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:57:01.889916 np0000001127 nova-compute[98206]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:57:01.889916 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:57:01.890261 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:57:01.890344 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:57:01.891315 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] HCTL ('12', '-', '-', 0) found on session 11 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:57:01.891528 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:57:01.915963 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Searching for a device in session 10 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:57:01.916709 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b72d4732-cbb9-491f-8683-d0155023a91f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:57:01.918581 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Searching for a device in session 11 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:57:01.919124 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b72d4732-cbb9-491f-8683-d0155023a91f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:57:02.001851 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:57:02.040950 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-5a31164f-5797-42c8-b984-c6e3fededd26 req-a8ad3d8f-8bc1-4027-a08f-158e2e9d6a50 service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Added VIF to instance network info cache for port bcbb3f8b-362a-4634-8baa-f09e0134e596. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3531}}
May 21 01:57:02.041641 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-5a31164f-5797-42c8-b984-c6e3fededd26 req-a8ad3d8f-8bc1-4027-a08f-158e2e9d6a50 service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Updating instance_info_cache with network_info: [{"id": "67b86a71-40ec-405f-8d46-56744e34174f", "address": "fa:16:3e:ba:84:92", "network": {"id": "84a294f6-e79d-44ac-90f4-cfa96e67e367", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1771731810-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ffcb955f57a438d998dbdf9bfee0868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b86a71-40", "ovs_interfaceid": "67b86a71-40ec-405f-8d46-56744e34174f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcbb3f8b-362a-4634-8baa-f09e0134e596", "address": "fa:16:3e:9e:2a:c6", "network": {"id": "1506c578-ffa9-48da-b8bb-2c0ea4a41146", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1947915502", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ffcb955f57a438d998dbdf9bfee0868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcbb3f8b-36", "ovs_interfaceid": "bcbb3f8b-362a-4634-8baa-f09e0134e596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:57:02.133030 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:57:02.322851 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:02.437394 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:02.440186 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:02.458824 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:02.460022 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:02.466942 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Updating instance_info_cache with network_info: [{"id": "1f478597-015e-4c42-b8d5-af05bb7c8f8e", "address": "fa:16:3e:f6:c7:e3", "network": {"id": "aba610ba-f311-41c2-b94d-2495441912e4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-360728390-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a80dd2c84334f79afe5cb079c50c555", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f478597-01", "ovs_interfaceid": "1f478597-015e-4c42-b8d5-af05bb7c8f8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:57:02.485176 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:02.486303 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:02.544385 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5a31164f-5797-42c8-b984-c6e3fededd26 req-a8ad3d8f-8bc1-4027-a08f-158e2e9d6a50 service nova] Releasing lock "refresh_cache-6307081b-dd75-4ea3-aad6-d01f2b2b1c9b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:57:02.544929 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-945dec38-4384-455f-9e1b-43d1c797c367 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Acquired lock "refresh_cache-6307081b-dd75-4ea3-aad6-d01f2b2b1c9b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:57:02.545045 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-945dec38-4384-455f-9e1b-43d1c797c367 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 01:57:02.736738 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 01:57:02.739456 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999699642999985 future=<Future at 0x71c07c5d4dd0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:57:02.739991 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.99913540700004 future=<Future at 0x71c07c5d4dd0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:57:02.740119 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.998955854000087 future=<Future at 0x71c07c5d4dd0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:57:02.740922 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Instance destroyed successfully.
May 21 01:57:02.741281 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-879acd0b-9e41-48ff-bb90-4e52daf9ed44 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lazy-loading 'numa_topology' on Instance uuid 0059a43c-1d34-40a9-af63-b5eca8c30f53 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:57:02.802622 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.750s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:02.802760 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 01:57:02.892261 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:57:02.892399 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:57:02.892399 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:57:02.892525 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] No VIF found with MAC fa:16:3e:a0:e8:cd, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 01:57:02.970596 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Releasing lock "refresh_cache-e9664d16-b539-4ccc-abd4-47a8fa944520" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:57:02.970909 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Instance network_info: |[{"id": "1f478597-015e-4c42-b8d5-af05bb7c8f8e", "address": "fa:16:3e:f6:c7:e3", "network": {"id": "aba610ba-f311-41c2-b94d-2495441912e4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-360728390-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a80dd2c84334f79afe5cb079c50c555", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f478597-01", "ovs_interfaceid": "1f478597-015e-4c42-b8d5-af05bb7c8f8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 01:57:02.972979 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Start _get_guest_xml network_info=[{"id": "1f478597-015e-4c42-b8d5-af05bb7c8f8e", "address": "fa:16:3e:f6:c7:e3", "network": {"id": "aba610ba-f311-41c2-b94d-2495441912e4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-360728390-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a80dd2c84334f79afe5cb079c50c555", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f478597-01", "ovs_interfaceid": "1f478597-015e-4c42-b8d5-af05bb7c8f8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 01:57:02.976727 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f94ba5bf-962d-493b-b94e-52da2a7b8e97 req-ed6acb20-76a3-42e0-b089-dd902c9d67fa service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Received event network-vif-unplugged-839e91da-5ffe-451b-bd9d-dfc1cf83ab19 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:02.976955 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f94ba5bf-962d-493b-b94e-52da2a7b8e97 req-ed6acb20-76a3-42e0-b089-dd902c9d67fa service nova] Acquiring lock "0059a43c-1d34-40a9-af63-b5eca8c30f53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:02.977095 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f94ba5bf-962d-493b-b94e-52da2a7b8e97 req-ed6acb20-76a3-42e0-b089-dd902c9d67fa service nova] Lock "0059a43c-1d34-40a9-af63-b5eca8c30f53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:02.977291 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f94ba5bf-962d-493b-b94e-52da2a7b8e97 req-ed6acb20-76a3-42e0-b089-dd902c9d67fa service nova] Lock "0059a43c-1d34-40a9-af63-b5eca8c30f53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:02.977725 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f94ba5bf-962d-493b-b94e-52da2a7b8e97 req-ed6acb20-76a3-42e0-b089-dd902c9d67fa service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] No waiting events found dispatching network-vif-unplugged-839e91da-5ffe-451b-bd9d-dfc1cf83ab19 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:57:02.978098 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 01:57:02.979700 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-f94ba5bf-962d-493b-b94e-52da2a7b8e97 req-ed6acb20-76a3-42e0-b089-dd902c9d67fa service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Received unexpected event network-vif-unplugged-839e91da-5ffe-451b-bd9d-dfc1cf83ab19 for instance with vm_state active and task_state shelving.
May 21 01:57:02.980212 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f94ba5bf-962d-493b-b94e-52da2a7b8e97 req-ed6acb20-76a3-42e0-b089-dd902c9d67fa service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Received event network-vif-unplugged-839e91da-5ffe-451b-bd9d-dfc1cf83ab19 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:02.980212 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f94ba5bf-962d-493b-b94e-52da2a7b8e97 req-ed6acb20-76a3-42e0-b089-dd902c9d67fa service nova] Acquiring lock "0059a43c-1d34-40a9-af63-b5eca8c30f53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:02.980212 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f94ba5bf-962d-493b-b94e-52da2a7b8e97 req-ed6acb20-76a3-42e0-b089-dd902c9d67fa service nova] Lock "0059a43c-1d34-40a9-af63-b5eca8c30f53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:02.980212 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f94ba5bf-962d-493b-b94e-52da2a7b8e97 req-ed6acb20-76a3-42e0-b089-dd902c9d67fa service nova] Lock "0059a43c-1d34-40a9-af63-b5eca8c30f53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:02.980878 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-VolumesSnapshotTestJSON-instance-702854126', uuid='e9664d16-b539-4ccc-abd4-47a8fa944520'), owner=OwnerMeta(userid='457854a2cf2844b8b693d835d2c9b699', username='tempest-VolumesSnapshotTestJSON-315332802-project-member', projectid='9a80dd2c84334f79afe5cb079c50c555', projectname='tempest-VolumesSnapshotTestJSON-315332802'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1f478597-015e-4c42-b8d5-af05bb7c8f8e", "address": "fa:16:3e:f6:c7:e3", "network": {"id": "aba610ba-f311-41c2-b94d-2495441912e4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-360728390-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a80dd2c84334f79afe5cb079c50c555", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f478597-01", "ovs_interfaceid": "1f478597-015e-4c42-b8d5-af05bb7c8f8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328622.9794233) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 01:57:02.981108 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f94ba5bf-962d-493b-b94e-52da2a7b8e97 req-ed6acb20-76a3-42e0-b089-dd902c9d67fa service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] No waiting events found dispatching network-vif-unplugged-839e91da-5ffe-451b-bd9d-dfc1cf83ab19 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:57:02.981372 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-f94ba5bf-962d-493b-b94e-52da2a7b8e97 req-ed6acb20-76a3-42e0-b089-dd902c9d67fa service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Received unexpected event network-vif-unplugged-839e91da-5ffe-451b-bd9d-dfc1cf83ab19 for instance with vm_state active and task_state shelving.
May 21 01:57:02.982311 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 01:57:02.982659 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 01:57:02.983616 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 01:57:02.983815 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 01:57:02.984787 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 01:57:02.985118 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 01:57:02.985308 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 01:57:02.985441 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 01:57:02.985625 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 01:57:02.985758 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 01:57:02.985910 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 01:57:02.986139 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 01:57:02.986288 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 01:57:02.986393 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 01:57:02.986522 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 01:57:02.986646 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 01:57:02.998355 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T01:56:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-702854126',display_name='tempest-VolumesSnapshotTestJSON-instance-702854126',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumessnapshottestjson-instance-702854126',id=9,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMcBj8Yxk1lhi1gpm4+248B3FfxYWxY0/YeGb+59b8Aa0wCxnoRMbWzsgRV2kNYWfX7BEJmbnmMjOgRBTCcP/Cmj9rN0eQ4E1vBTRsFRc8nwc1z0oo2pnfXW4AhBNCIKg==',key_name='tempest-keypair-29798417',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a80dd2c84334f79afe5cb079c50c555',ramdisk_id='',reservation_id='r-votukee3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-315332802',owner_user_name='tempest-VolumesSnapshotTestJSON-315332802-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:57:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='457854a2cf2844b8b693d835d2c9b699',uuid=e9664d16-b539-4ccc-abd4-47a8fa944520,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f478597-015e-4c42-b8d5-af05bb7c8f8e", "address": "fa:16:3e:f6:c7:e3", "network": {"id": "aba610ba-f311-41c2-b94d-2495441912e4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-360728390-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a80dd2c84334f79afe5cb079c50c555", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f478597-01", "ovs_interfaceid": "1f478597-015e-4c42-b8d5-af05bb7c8f8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 01:57:02.998791 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Converting VIF {"id": "1f478597-015e-4c42-b8d5-af05bb7c8f8e", "address": "fa:16:3e:f6:c7:e3", "network": {"id": "aba610ba-f311-41c2-b94d-2495441912e4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-360728390-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a80dd2c84334f79afe5cb079c50c555", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f478597-01", "ovs_interfaceid": "1f478597-015e-4c42-b8d5-af05bb7c8f8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:57:02.999197 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:c7:e3,bridge_name='br-int',has_traffic_filtering=True,id=1f478597-015e-4c42-b8d5-af05bb7c8f8e,network=Network(aba610ba-f311-41c2-b94d-2495441912e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f478597-01') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:57:02.999659 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lazy-loading 'pci_devices' on Instance uuid e9664d16-b539-4ccc-abd4-47a8fa944520 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:57:03.014241 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:03.115931 np0000001127 nova-compute[98206]: WARNING nova.network.neutron [None req-945dec38-4384-455f-9e1b-43d1c797c367 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] 1506c578-ffa9-48da-b8bb-2c0ea4a41146 already exists in list: networks containing: ['1506c578-ffa9-48da-b8bb-2c0ea4a41146']. ignoring it
May 21 01:57:03.116094 np0000001127 nova-compute[98206]: WARNING nova.network.neutron [None req-945dec38-4384-455f-9e1b-43d1c797c367 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] bcbb3f8b-362a-4634-8baa-f09e0134e596 already exists in list: port_ids containing: ['bcbb3f8b-362a-4634-8baa-f09e0134e596']. ignoring it
May 21 01:57:03.307819 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 01:57:03.308997 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 01:57:03.310970 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:03.311220 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:03.319180 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-945dec38-4384-455f-9e1b-43d1c797c367 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:03.418593 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-879acd0b-9e41-48ff-bb90-4e52daf9ed44 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Beginning cold snapshot process
May 21 01:57:03.443967 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bbcd1a81252344dd804a4080571f8751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15fe7a70464159a778cffa4a36c36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 01:57:03.502811 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] End _get_guest_xml xml=<domain type="qemu">
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:   <uuid>e9664d16-b539-4ccc-abd4-47a8fa944520</uuid>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:   <name>instance-00000009</name>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:   <metadata>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-702854126</nova:name>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 01:57:02</nova:creationTime>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:       </nova:image>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:         <nova:user uuid="457854a2cf2844b8b693d835d2c9b699">tempest-VolumesSnapshotTestJSON-315332802-project-member</nova:user>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:         <nova:project uuid="9a80dd2c84334f79afe5cb079c50c555">tempest-VolumesSnapshotTestJSON-315332802</nova:project>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:         <nova:port uuid="1f478597-015e-4c42-b8d5-af05bb7c8f8e">
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:         </nova:port>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:   </metadata>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:     <system>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:       <entry name="serial">e9664d16-b539-4ccc-abd4-47a8fa944520</entry>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:       <entry name="uuid">e9664d16-b539-4ccc-abd4-47a8fa944520</entry>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:     </system>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:   <os>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:   </os>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:   <features>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:     <acpi/>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:     <tcg>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:     </tcg>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:   </features>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:   <devices>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/e9664d16-b539-4ccc-abd4-47a8fa944520/disk"/>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:     </disk>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/e9664d16-b539-4ccc-abd4-47a8fa944520/disk.config"/>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:     </disk>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:f6:c7:e3"/>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:       <target dev="tap1f478597-01"/>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:     </interface>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/e9664d16-b539-4ccc-abd4-47a8fa944520/console.log" append="off"/>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:     </serial>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:     <video>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:     </video>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:     </rng>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:     </memballoon>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:   </devices>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]: </domain>
May 21 01:57:03.502811 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 01:57:03.505585 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Preparing to wait for external event network-vif-plugged-1f478597-015e-4c42-b8d5-af05bb7c8f8e {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 01:57:03.505585 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Acquiring lock "e9664d16-b539-4ccc-abd4-47a8fa944520-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:03.505585 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "e9664d16-b539-4ccc-abd4-47a8fa944520-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:03.505585 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "e9664d16-b539-4ccc-abd4-47a8fa944520-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:03.505585 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T01:56:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-702854126',display_name='tempest-VolumesSnapshotTestJSON-instance-702854126',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumessnapshottestjson-instance-702854126',id=9,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMcBj8Yxk1lhi1gpm4+248B3FfxYWxY0/YeGb+59b8Aa0wCxnoRMbWzsgRV2kNYWfX7BEJmbnmMjOgRBTCcP/Cmj9rN0eQ4E1vBTRsFRc8nwc1z0oo2pnfXW4AhBNCIKg==',key_name='tempest-keypair-29798417',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a80dd2c84334f79afe5cb079c50c555',ramdisk_id='',reservation_id='r-votukee3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-315332802',owner_user_name='tempest-VolumesSnapshotTestJSON-315332802-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:57:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='457854a2cf2844b8b693d835d2c9b699',uuid=e9664d16-b539-4ccc-abd4-47a8fa944520,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f478597-015e-4c42-b8d5-af05bb7c8f8e", "address": "fa:16:3e:f6:c7:e3", "network": {"id": "aba610ba-f311-41c2-b94d-2495441912e4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-360728390-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a80dd2c84334f79afe5cb079c50c555", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f478597-01", "ovs_interfaceid": "1f478597-015e-4c42-b8d5-af05bb7c8f8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 01:57:03.505585 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Converting VIF {"id": "1f478597-015e-4c42-b8d5-af05bb7c8f8e", "address": "fa:16:3e:f6:c7:e3", "network": {"id": "aba610ba-f311-41c2-b94d-2495441912e4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-360728390-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a80dd2c84334f79afe5cb079c50c555", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f478597-01", "ovs_interfaceid": "1f478597-015e-4c42-b8d5-af05bb7c8f8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:57:03.505585 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:c7:e3,bridge_name='br-int',has_traffic_filtering=True,id=1f478597-015e-4c42-b8d5-af05bb7c8f8e,network=Network(aba610ba-f311-41c2-b94d-2495441912e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f478597-01') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:57:03.505970 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:c7:e3,bridge_name='br-int',has_traffic_filtering=True,id=1f478597-015e-4c42-b8d5-af05bb7c8f8e,network=Network(aba610ba-f311-41c2-b94d-2495441912e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f478597-01') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 01:57:03.505970 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:03.506164 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:03.506363 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 01:57:03.507798 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:03.507979 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '456f8e9b-ca7d-50ba-b5f4-adf99eec020a', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:03.508739 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:03.509559 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:57:03.515190 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:03.517438 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:03.517686 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f478597-01, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:03.518023 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f478597-01, col_values=(('qos', UUID('e1a60412-d1f2-4a23-9a77-53d41323dabb')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:03.518189 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f478597-01, col_values=(('external_ids', {'iface-id': '1f478597-015e-4c42-b8d5-af05bb7c8f8e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:c7:e3', 'vm-uuid': 'e9664d16-b539-4ccc-abd4-47a8fa944520'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:03.519155 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:03.520387 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:57:03.533939 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:03.536018 np0000001127 nova-compute[98206]: INFO os_vif [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:c7:e3,bridge_name='br-int',has_traffic_filtering=True,id=1f478597-015e-4c42-b8d5-af05bb7c8f8e,network=Network(aba610ba-f311-41c2-b94d-2495441912e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f478597-01')
May 21 01:57:03.734428 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-945dec38-4384-455f-9e1b-43d1c797c367 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:03.751832 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Found WWN 330000000040cf936 for multipath device dm-4 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 01:57:03.752348 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:57:03.752348 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] <== connect_volume: return (9243ms) {'type': 'block', 'scsi_wwn': '330000000040cf936', 'path': '/dev/dm-4', 'multipath_id': '330000000040cf936'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:57:03.753057 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 5.571s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:57:03.753323 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000040cf936', 'path': '/dev/dm-4', 'multipath_id': '330000000040cf936'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 01:57:03.753650 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57', 'iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'de377f05-4bd5-4c5b-bf60-f92093972e57', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 01:57:03.757151 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lazy-loading 'flavor' on Instance uuid 98ace73f-7d4b-4aed-9355-a39c58f9b024 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:57:03.767045 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:57:03.768030 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:57:03.768422 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:57:03.768604 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:57:03.769595 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:57:03.769783 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:57:03.781808 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 01:57:03.781808 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:03.786860 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 01:57:03.786860 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:03.794041 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57] added
May 21 01:57:03.794041 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 01:57:03.794041 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:57:03.794041 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:57:03.794041 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:57:03.794041 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:57:03.794041 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:03.794353 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 01:57:03.795423 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0258(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 01:57:03.795423 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 01:57:03.799712 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57] added
May 21 01:57:03.799712 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 01:57:03.799712 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:57:03.799712 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:57:03.799712 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:57:03.799712 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:57:03.799712 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:03.799913 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 01:57:03.800220 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0303(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 01:57:03.800431 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 01:57:03.811433 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 01:57:03.887654 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-945dec38-4384-455f-9e1b-43d1c797c367 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Updating instance_info_cache with network_info: [{"id": "67b86a71-40ec-405f-8d46-56744e34174f", "address": "fa:16:3e:ba:84:92", "network": {"id": "84a294f6-e79d-44ac-90f4-cfa96e67e367", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1771731810-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ffcb955f57a438d998dbdf9bfee0868", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b86a71-40", "ovs_interfaceid": "67b86a71-40ec-405f-8d46-56744e34174f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcbb3f8b-362a-4634-8baa-f09e0134e596", "address": "fa:16:3e:9e:2a:c6", "network": {"id": "1506c578-ffa9-48da-b8bb-2c0ea4a41146", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1947915502", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ffcb955f57a438d998dbdf9bfee0868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcbb3f8b-36", "ovs_interfaceid": "bcbb3f8b-362a-4634-8baa-f09e0134e596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:57:03.991362 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Successfully created port: 069db2b1-36ac-43ce-b643-fcdc9ff52141 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 01:57:04.261697 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Attempting to attach volume b72d4732-cbb9-491f-8683-d0155023a91f with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 01:57:04.262632 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] attach device xml: <disk type="block" device="disk">
May 21 01:57:04.262632 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:57:04.262632 np0000001127 nova-compute[98206]:   <alias name="ua-b72d4732-cbb9-491f-8683-d0155023a91f"/>
May 21 01:57:04.262632 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-4"/>
May 21 01:57:04.262632 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 01:57:04.262632 np0000001127 nova-compute[98206]:   <serial>b72d4732-cbb9-491f-8683-d0155023a91f</serial>
May 21 01:57:04.262632 np0000001127 nova-compute[98206]:   <shareable/>
May 21 01:57:04.262632 np0000001127 nova-compute[98206]: </disk>
May 21 01:57:04.262632 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 01:57:04.315856 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 01:57:04.389898 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-945dec38-4384-455f-9e1b-43d1c797c367 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Releasing lock "refresh_cache-6307081b-dd75-4ea3-aad6-d01f2b2b1c9b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:57:04.393255 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-945dec38-4384-455f-9e1b-43d1c797c367 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:55:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1663470333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-1663470333',id=2,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXMK1mbiHi5+o6ufBchj3Bb4+HeC3f5IcR98ZEhanB9o7Q5vVQrjHwCh1Z6wl+J1XeMlcfvzOJWsJzB17pBNOXZgD+WEZqVbkZl5Lc12KudDK67GOxtwwklvUeZ02pjPA==',key_name='tempest-keypair-1942385655',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:56:17Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1ffcb955f57a438d998dbdf9bfee0868',ramdisk_id='',reservation_id='r-aopg08rx',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1169987238',owner_user_name='tempest-TaggedAttachmentsTest-1169987238-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:56:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd36d5cf62b4dc49bd53ebc09db2a2d',uuid=6307081b-dd75-4ea3-aad6-d01f2b2b1c9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bcbb3f8b-362a-4634-8baa-f09e0134e596", "address": "fa:16:3e:9e:2a:c6", "network": {"id": "1506c578-ffa9-48da-b8bb-2c0ea4a41146", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1947915502", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ffcb955f57a438d998dbdf9bfee0868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcbb3f8b-36", "ovs_interfaceid": "bcbb3f8b-362a-4634-8baa-f09e0134e596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 01:57:04.393498 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-945dec38-4384-455f-9e1b-43d1c797c367 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Converting VIF {"id": "bcbb3f8b-362a-4634-8baa-f09e0134e596", "address": "fa:16:3e:9e:2a:c6", "network": {"id": "1506c578-ffa9-48da-b8bb-2c0ea4a41146", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1947915502", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ffcb955f57a438d998dbdf9bfee0868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcbb3f8b-36", "ovs_interfaceid": "bcbb3f8b-362a-4634-8baa-f09e0134e596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:57:04.394975 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-945dec38-4384-455f-9e1b-43d1c797c367 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:2a:c6,bridge_name='br-int',has_traffic_filtering=True,id=bcbb3f8b-362a-4634-8baa-f09e0134e596,network=Network(1506c578-ffa9-48da-b8bb-2c0ea4a41146),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcbb3f8b-36') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:57:04.395358 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-945dec38-4384-455f-9e1b-43d1c797c367 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:2a:c6,bridge_name='br-int',has_traffic_filtering=True,id=bcbb3f8b-362a-4634-8baa-f09e0134e596,network=Network(1506c578-ffa9-48da-b8bb-2c0ea4a41146),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcbb3f8b-36') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 01:57:04.395780 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:04.396078 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:04.396324 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 01:57:04.397132 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:04.397368 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6d3f7bf2-776c-5f07-b840-f6401a753640', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:04.398554 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:04.399260 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:57:04.411271 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:04.414015 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:04.414383 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbcbb3f8b-36, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:04.415181 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbcbb3f8b-36, col_values=(('qos', UUID('1cc61ecb-b75f-4571-b088-291bc750b74e')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:04.415181 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbcbb3f8b-36, col_values=(('external_ids', {'iface-id': 'bcbb3f8b-362a-4634-8baa-f09e0134e596', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:2a:c6', 'vm-uuid': '6307081b-dd75-4ea3-aad6-d01f2b2b1c9b'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:04.416308 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:04.417761 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:57:04.435535 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:04.436918 np0000001127 nova-compute[98206]: INFO os_vif [None req-945dec38-4384-455f-9e1b-43d1c797c367 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:2a:c6,bridge_name='br-int',has_traffic_filtering=True,id=bcbb3f8b-362a-4634-8baa-f09e0134e596,network=Network(1506c578-ffa9-48da-b8bb-2c0ea4a41146),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcbb3f8b-36')
May 21 01:57:04.437733 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-945dec38-4384-455f-9e1b-43d1c797c367 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:55:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1663470333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-1663470333',id=2,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXMK1mbiHi5+o6ufBchj3Bb4+HeC3f5IcR98ZEhanB9o7Q5vVQrjHwCh1Z6wl+J1XeMlcfvzOJWsJzB17pBNOXZgD+WEZqVbkZl5Lc12KudDK67GOxtwwklvUeZ02pjPA==',key_name='tempest-keypair-1942385655',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:56:17Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1ffcb955f57a438d998dbdf9bfee0868',ramdisk_id='',reservation_id='r-aopg08rx',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1169987238',owner_user_name='tempest-TaggedAttachmentsTest-1169987238-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:56:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd36d5cf62b4dc49bd53ebc09db2a2d',uuid=6307081b-dd75-4ea3-aad6-d01f2b2b1c9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bcbb3f8b-362a-4634-8baa-f09e0134e596", "address": "fa:16:3e:9e:2a:c6", "network": {"id": "1506c578-ffa9-48da-b8bb-2c0ea4a41146", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1947915502", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ffcb955f57a438d998dbdf9bfee0868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcbb3f8b-36", "ovs_interfaceid": "bcbb3f8b-362a-4634-8baa-f09e0134e596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 01:57:04.437940 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-945dec38-4384-455f-9e1b-43d1c797c367 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Converting VIF {"id": "bcbb3f8b-362a-4634-8baa-f09e0134e596", "address": "fa:16:3e:9e:2a:c6", "network": {"id": "1506c578-ffa9-48da-b8bb-2c0ea4a41146", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1947915502", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ffcb955f57a438d998dbdf9bfee0868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcbb3f8b-36", "ovs_interfaceid": "bcbb3f8b-362a-4634-8baa-f09e0134e596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:57:04.438405 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-945dec38-4384-455f-9e1b-43d1c797c367 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:2a:c6,bridge_name='br-int',has_traffic_filtering=True,id=bcbb3f8b-362a-4634-8baa-f09e0134e596,network=Network(1506c578-ffa9-48da-b8bb-2c0ea4a41146),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcbb3f8b-36') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:57:04.439402 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-945dec38-4384-455f-9e1b-43d1c797c367 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] attach device xml: <interface type="ethernet">
May 21 01:57:04.439402 np0000001127 nova-compute[98206]:   <mac address="fa:16:3e:9e:2a:c6"/>
May 21 01:57:04.439402 np0000001127 nova-compute[98206]:   <model type="virtio"/>
May 21 01:57:04.439402 np0000001127 nova-compute[98206]:   <driver name="qemu"/>
May 21 01:57:04.439402 np0000001127 nova-compute[98206]:   <mtu size="1372"/>
May 21 01:57:04.439402 np0000001127 nova-compute[98206]:   <target dev="tapbcbb3f8b-36"/>
May 21 01:57:04.439402 np0000001127 nova-compute[98206]: </interface>
May 21 01:57:04.439402 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 01:57:04.456160 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9b6408b0-cd89-485f-9235-b9d2b986f20c tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Lock "cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.525s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:04.462133 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:04.528417 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:04.531174 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:04.534729 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:04.580567 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:04.587742 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Successfully updated port: 069db2b1-36ac-43ce-b643-fcdc9ff52141 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 01:57:04.769928 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e7cdf34c-17fa-4a08-86cb-e33436897c67 tempest-VolumesAssistedSnapshotsTest-190446848 tempest-VolumesAssistedSnapshotsTest-190446848-project] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] volume_snapshot_create: create_info: {'snapshot_id': 'eeea88fa-ce66-4c4f-a5d5-51f0005a1634', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=98206) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3769}}
May 21 01:57:04.776350 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e7cdf34c-17fa-4a08-86cb-e33436897c67 tempest-VolumesAssistedSnapshotsTest-190446848 tempest-VolumesAssistedSnapshotsTest-190446848-project] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] snap xml: <domainsnapshot>
May 21 01:57:04.776350 np0000001127 nova-compute[98206]:   <disks>
May 21 01:57:04.776350 np0000001127 nova-compute[98206]:     <disk name="/dev/dm-3" snapshot="external" type="file">
May 21 01:57:04.776350 np0000001127 nova-compute[98206]:       <source file="/dev/new_file"/>
May 21 01:57:04.776350 np0000001127 nova-compute[98206]:     </disk>
May 21 01:57:04.776350 np0000001127 nova-compute[98206]:     <disk name="vda" snapshot="no"/>
May 21 01:57:04.776350 np0000001127 nova-compute[98206]:     <disk name="hda" snapshot="no"/>
May 21 01:57:04.776350 np0000001127 nova-compute[98206]:   </disks>
May 21 01:57:04.776350 np0000001127 nova-compute[98206]: </domainsnapshot>
May 21 01:57:04.776350 np0000001127 nova-compute[98206]:  {{(pid=98206) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3710}}
May 21 01:57:04.776712 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-e7cdf34c-17fa-4a08-86cb-e33436897c67 tempest-VolumesAssistedSnapshotsTest-190446848 tempest-VolumesAssistedSnapshotsTest-190446848-project] Lazy-loading 'system_metadata' on Instance uuid cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:57:04.795898 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:57:04.800842 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.startup = manual
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:57:04.813637 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:57:04.813637 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.startup = manual
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:57:04.829131 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:57:04.829131 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:04.838493 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:04.848326 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:04.861685 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:04.861685 np0000001127 nova-compute[98206]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:04.861685 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:04.861685 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:04.861685 np0000001127 nova-compute[98206]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:57:04.861685 np0000001127 nova-compute[98206]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:57:04.861685 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:57:04.861898 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:04.861898 np0000001127 nova-compute[98206]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:04.861898 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:04.861898 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:04.861898 np0000001127 nova-compute[98206]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:57:04.861898 np0000001127 nova-compute[98206]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:57:04.861898 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:57:04.872202 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:04.872202 np0000001127 nova-compute[98206]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:04.872202 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:04.872202 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:04.872202 np0000001127 nova-compute[98206]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:57:04.872202 np0000001127 nova-compute[98206]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:57:04.872202 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:57:04.872562 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:04.872562 np0000001127 nova-compute[98206]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:04.872562 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:04.872562 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:04.872562 np0000001127 nova-compute[98206]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:57:04.872562 np0000001127 nova-compute[98206]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:57:04.872562 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:57:04.909142 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:04.912258 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57, portal: 192.168.50.100,3260]
May 21 01:57:04.912258 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57, portal: 192.168.50.100,3260] successful.
May 21 01:57:04.912258 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:04.918798 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57, portal: 192.168.40.100,3260]
May 21 01:57:04.918798 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57, portal: 192.168.40.100,3260] successful.
May 21 01:57:04.918798 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:04.929507 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:04.936497 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:04.941737 np0000001127 nova-compute[98206]: DEBUG nova.privsep.utils [None req-879acd0b-9e41-48ff-bb90-4e52daf9ed44 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 21 01:57:04.942577 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-879acd0b-9e41-48ff-bb90-4e52daf9ed44 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53/disk /opt/stack/data/nova/instances/snapshots/tmpjlxbld2y/7c83df67b25440e2acb37572b124ce11 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:04.942577 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:04.971800 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:04.985301 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:04.985301 np0000001127 nova-compute[98206]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:04.985301 np0000001127 nova-compute[98206]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:04.985301 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:04.985301 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:04.985301 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:04.985301 np0000001127 nova-compute[98206]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:57:04.985301 np0000001127 nova-compute[98206]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:57:04.985301 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:57:04.985727 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:04.985727 np0000001127 nova-compute[98206]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:04.985727 np0000001127 nova-compute[98206]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:04.985727 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:04.985727 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:04.985727 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:04.985727 np0000001127 nova-compute[98206]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:57:04.985727 np0000001127 nova-compute[98206]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:57:04.985727 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:57:04.986498 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.217s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:57:04.994668 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:04.996201 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:57:04.996902 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:04.996902 np0000001127 nova-compute[98206]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:04.996902 np0000001127 nova-compute[98206]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:04.996902 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:04.996902 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:04.996902 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:04.996902 np0000001127 nova-compute[98206]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:57:04.996902 np0000001127 nova-compute[98206]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:57:04.996902 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:57:04.997235 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:04.997235 np0000001127 nova-compute[98206]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:04.997235 np0000001127 nova-compute[98206]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:04.997235 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:04.997235 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:04.997235 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:04.997235 np0000001127 nova-compute[98206]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:57:04.997235 np0000001127 nova-compute[98206]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:57:04.997235 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:57:04.997508 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.229s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:57:04.997780 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:57:05.000061 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1a03cc2d-cfd3-445f-b76a-0e4ab1990160 req-410d7131-258b-4a51-806e-7f6719fb7a49 service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Received event network-vif-plugged-bcbb3f8b-362a-4634-8baa-f09e0134e596 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:05.000929 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1a03cc2d-cfd3-445f-b76a-0e4ab1990160 req-410d7131-258b-4a51-806e-7f6719fb7a49 service nova] Acquiring lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:05.000929 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1a03cc2d-cfd3-445f-b76a-0e4ab1990160 req-410d7131-258b-4a51-806e-7f6719fb7a49 service nova] Lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:05.001116 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1a03cc2d-cfd3-445f-b76a-0e4ab1990160 req-410d7131-258b-4a51-806e-7f6719fb7a49 service nova] Lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:05.001251 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1a03cc2d-cfd3-445f-b76a-0e4ab1990160 req-410d7131-258b-4a51-806e-7f6719fb7a49 service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] No waiting events found dispatching network-vif-plugged-bcbb3f8b-362a-4634-8baa-f09e0134e596 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:57:05.001408 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-1a03cc2d-cfd3-445f-b76a-0e4ab1990160 req-410d7131-258b-4a51-806e-7f6719fb7a49 service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Received unexpected event network-vif-plugged-bcbb3f8b-362a-4634-8baa-f09e0134e596 for instance with vm_state active and task_state None.
May 21 01:57:05.003955 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] HCTL ('14', '-', '-', 0) found on session 13 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:57:05.006068 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:57:05.006068 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] HCTL ('13', '-', '-', 0) found on session 12 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:57:05.006068 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:57:05.032405 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Searching for a device in session 13 and hctl ['14', '*', '*', 0] yield: sdh {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:57:05.032405 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'de377f05-4bd5-4c5b-bf60-f92093972e57', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:57:05.055933 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5a5b6bbf-8bd7-4155-a5f6-22e8b0accf35 tempest-VolumesAssistedSnapshotsTest-190446848 tempest-VolumesAssistedSnapshotsTest-190446848-project] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] volume_snapshot_delete: delete_info: {'volume_id': '2a1783c2-cd34-4cfa-8569-d5f41d2a98f7'} {{(pid=98206) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3877}}
May 21 01:57:05.059764 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver [None req-5a5b6bbf-8bd7-4155-a5f6-22e8b0accf35 tempest-VolumesAssistedSnapshotsTest-190446848 tempest-VolumesAssistedSnapshotsTest-190446848-project] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
May 21 01:57:05.059764 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Traceback (most recent call last):
May 21 01:57:05.059764 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 21 01:57:05.059764 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6]     self._volume_snapshot_delete(context, instance, volume_id,
May 21 01:57:05.059764 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 21 01:57:05.059764 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6]     if delete_info['type'] != 'qcow2':
May 21 01:57:05.059764 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6]        ~~~~~~~~~~~^^^^^^^^
May 21 01:57:05.059764 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] KeyError: 'type'
May 21 01:57:05.059764 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] 
May 21 01:57:05.065347 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Searching for a device in session 12 and hctl ['13', '*', '*', 0] yield: sdi {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:57:05.066256 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'de377f05-4bd5-4c5b-bf60-f92093972e57', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:57:05.069294 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:57:05.069294 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:57:05.070708 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] No VIF found with MAC fa:16:3e:f6:c7:e3, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 01:57:05.070708 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Using config drive
May 21 01:57:05.091410 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "refresh_cache-6f68556b-0b18-452a-b307-da2dad4ee6ab" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:57:05.091410 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquired lock "refresh_cache-6f68556b-0b18-452a-b307-da2dad4ee6ab" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:57:05.095749 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 01:57:05.113673 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a75e80b8-cbfb-4934-ab05-a4920322a9a3 req-89bbeb9b-35e4-42de-8b64-54f5b1c211ce service nova] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Received event network-changed-069db2b1-36ac-43ce-b643-fcdc9ff52141 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:05.114219 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a75e80b8-cbfb-4934-ab05-a4920322a9a3 req-89bbeb9b-35e4-42de-8b64-54f5b1c211ce service nova] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Refreshing instance network info cache due to event network-changed-069db2b1-36ac-43ce-b643-fcdc9ff52141. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:57:05.114426 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a75e80b8-cbfb-4934-ab05-a4920322a9a3 req-89bbeb9b-35e4-42de-8b64-54f5b1c211ce service nova] Acquiring lock "refresh_cache-6f68556b-0b18-452a-b307-da2dad4ee6ab" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver [None req-5a5b6bbf-8bd7-4155-a5f6-22e8b0accf35 tempest-VolumesAssistedSnapshotsTest-190446848 tempest-VolumesAssistedSnapshotsTest-190446848-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver        ~~~~~~~~~~~^^^^^^^^
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver KeyError: 'type'
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver 
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver 
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-c73c4219-89ad-4388-a94c-1efba0b7f888)
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver 
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver 
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3609, in _volume_snapshot_update_status
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
May 21 01:57:05.122566 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver 
May 21 01:57:05.140688 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server [None req-5a5b6bbf-8bd7-4155-a5f6-22e8b0accf35 tempest-VolumesAssistedSnapshotsTest-190446848 tempest-VolumesAssistedSnapshotsTest-190446848-project] Exception during message handling: KeyError: 'type'
May 21 01:57:05.140688 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
May 21 01:57:05.140688 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
May 21 01:57:05.140688 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
May 21 01:57:05.140688 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 21 01:57:05.140688 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
May 21 01:57:05.140688 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
May 21 01:57:05.140688 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 21 01:57:05.140688 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
May 21 01:57:05.140688 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
May 21 01:57:05.140688 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
May 21 01:57:05.140688 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner
May 21 01:57:05.140688 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
May 21 01:57:05.140688 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^
May 21 01:57:05.140688 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
May 21 01:57:05.140688 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 21 01:57:05.140688 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 21 01:57:05.140688 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 21 01:57:05.140688 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 21 01:57:05.140688 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server     raise self.value
May 21 01:57:05.140688 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
May 21 01:57:05.140688 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
May 21 01:57:05.140688 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 21 01:57:05.140688 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4829, in volume_snapshot_delete
May 21 01:57:05.140688 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
May 21 01:57:05.140688 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4053, in volume_snapshot_delete
May 21 01:57:05.140688 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 21 01:57:05.140688 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 21 01:57:05.140688 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 21 01:57:05.140688 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 21 01:57:05.140688 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server     raise self.value
May 21 01:57:05.140688 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 21 01:57:05.140688 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
May 21 01:57:05.140688 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 21 01:57:05.140688 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
May 21 01:57:05.140688 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server        ~~~~~~~~~~~^^^^^^^^
May 21 01:57:05.140688 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server KeyError: 'type'
May 21 01:57:05.140688 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server 
May 21 01:57:05.164509 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 01:57:05.282179 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-e7cdf34c-17fa-4a08-86cb-e33436897c67 tempest-VolumesAssistedSnapshotsTest-190446848 tempest-VolumesAssistedSnapshotsTest-190446848-project] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Skipping quiescing instance: QEMU guest agent is not enabled.
May 21 01:57:05.289435 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver [None req-e7cdf34c-17fa-4a08-86cb-e33436897c67 tempest-VolumesAssistedSnapshotsTest-190446848 tempest-VolumesAssistedSnapshotsTest-190446848-project] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 21 01:57:05.289435 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Traceback (most recent call last):
May 21 01:57:05.289435 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 21 01:57:05.289435 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 21 01:57:05.289435 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 21 01:57:05.289435 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6]     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 21 01:57:05.289435 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 21 01:57:05.289435 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6]     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 21 01:57:05.289435 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 21 01:57:05.289435 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] 
May 21 01:57:05.290037 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver [None req-e7cdf34c-17fa-4a08-86cb-e33436897c67 tempest-VolumesAssistedSnapshotsTest-190446848 tempest-VolumesAssistedSnapshotsTest-190446848-project] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 21 01:57:05.290037 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Traceback (most recent call last):
May 21 01:57:05.290037 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 21 01:57:05.290037 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6]     self._volume_snapshot_create(context, instance, guest,
May 21 01:57:05.290037 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 21 01:57:05.290037 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 21 01:57:05.290037 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 21 01:57:05.290037 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6]     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 21 01:57:05.290037 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 21 01:57:05.290037 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6]     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 21 01:57:05.290037 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 21 01:57:05.290037 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] 
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver [None req-e7cdf34c-17fa-4a08-86cb-e33436897c67 tempest-VolumesAssistedSnapshotsTest-190446848 tempest-VolumesAssistedSnapshotsTest-190446848-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot eeea88fa-ce66-4c4f-a5d5-51f0005a1634 could not be found.
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver 
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver 
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot eeea88fa-ce66-4c4f-a5d5-51f0005a1634 could not be found. (HTTP 404) (Request-ID: req-a76ec5f8-c822-46bb-a209-e15bb2c06f5d)
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver 
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver 
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3609, in _volume_snapshot_update_status
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot eeea88fa-ce66-4c4f-a5d5-51f0005a1634 could not be found.
May 21 01:57:05.324728 np0000001127 nova-compute[98206]: ERROR nova.virt.libvirt.driver 
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server [None req-e7cdf34c-17fa-4a08-86cb-e33436897c67 tempest-VolumesAssistedSnapshotsTest-190446848 tempest-VolumesAssistedSnapshotsTest-190446848-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server     raise self.value
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4817, in volume_snapshot_create
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3790, in volume_snapshot_create
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server     raise self.value
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 21 01:57:05.329218 np0000001127 nova-compute[98206]: ERROR oslo_messaging.rpc.server 
May 21 01:57:05.333435 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 01:57:05.333435 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 01:57:05.333435 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Creating image(s)
May 21 01:57:05.333435 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:05.333435 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "/opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:05.333435 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "/opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:05.333435 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:57:05.336757 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:57:05.338116 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:05.422814 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.084s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:05.423220 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:05.423663 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:05.424105 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:57:05.427137 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:57:05.427491 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:05.492524 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-879acd0b-9e41-48ff-bb90-4e52daf9ed44 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53/disk /opt/stack/data/nova/instances/snapshots/tmpjlxbld2y/7c83df67b25440e2acb37572b124ce11" returned: 0 in 0.550s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:05.492896 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-879acd0b-9e41-48ff-bb90-4e52daf9ed44 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Snapshot extracted, beginning image upload
May 21 01:57:05.508392 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.081s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:05.508773 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:05.550602 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab/disk 1073741824" returned: 0 in 0.041s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:05.551331 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.128s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:05.551736 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:05.583162 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:05.631533 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.080s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:05.631933 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 01:57:05.632196 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:05.699909 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:57:05.718930 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:05.719304 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Cannot resize image /opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 01:57:05.719676 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 01:57:05.719858 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Ensure instance console log exists: /opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 01:57:05.720164 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:05.720411 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:05.720601 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:05.770949 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 01:57:05.786553 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Creating config drive at /opt/stack/data/nova/instances/e9664d16-b539-4ccc-abd4-47a8fa944520/disk.config
May 21 01:57:05.791504 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e9664d16-b539-4ccc-abd4-47a8fa944520/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6evcrm44 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:05.833332 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e9664d16-b539-4ccc-abd4-47a8fa944520/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6evcrm44" returned: 0 in 0.042s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:05.867941 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Acquiring lock "cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:05.868190 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Lock "cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:05.896621 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:05.941324 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:57:05.941453 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:57:05.941453 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:57:05.941577 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] No VIF found with MAC fa:16:3e:ee:ec:8e, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 01:57:06.041264 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Updating instance_info_cache with network_info: [{"id": "069db2b1-36ac-43ce-b643-fcdc9ff52141", "address": "fa:16:3e:30:ad:e5", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap069db2b1-36", "ovs_interfaceid": "069db2b1-36ac-43ce-b643-fcdc9ff52141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:57:06.069930 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:06.116938 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-945dec38-4384-455f-9e1b-43d1c797c367 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:57:06.117182 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-945dec38-4384-455f-9e1b-43d1c797c367 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:57:06.117314 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-945dec38-4384-455f-9e1b-43d1c797c367 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] No VIF found with MAC fa:16:3e:ba:84:92, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 01:57:06.298778 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:06.329705 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:06.371555 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Detaching volume 2a1783c2-cd34-4cfa-8569-d5f41d2a98f7
May 21 01:57:06.418335 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:06.434400 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Attempting to driver detach volume 2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 from mountpoint /dev/vdb
May 21 01:57:06.447314 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Found disk vdb by alias ua-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 01:57:06.449380 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Found disk vdb by alias ua-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 01:57:06.450158 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Attempting to detach device vdb from instance cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6 from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 01:57:06.450158 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] detach device xml: <disk type="block" device="disk">
May 21 01:57:06.450158 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:57:06.450158 np0000001127 nova-compute[98206]:   <alias name="ua-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7"/>
May 21 01:57:06.450158 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-3"/>
May 21 01:57:06.450158 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 01:57:06.450158 np0000001127 nova-compute[98206]:   <serial>2a1783c2-cd34-4cfa-8569-d5f41d2a98f7</serial>
May 21 01:57:06.450158 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 01:57:06.450158 np0000001127 nova-compute[98206]: </disk>
May 21 01:57:06.450158 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 01:57:06.462517 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Successfully detached device vdb from instance cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6 from the persistent domain config.
May 21 01:57:06.462832 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] (1/8): Attempting to detach device vdb with device alias ua-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 from instance cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6 from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 01:57:06.463426 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] detach device xml: <disk type="block" device="disk">
May 21 01:57:06.463426 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:57:06.463426 np0000001127 nova-compute[98206]:   <alias name="ua-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7"/>
May 21 01:57:06.463426 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-3"/>
May 21 01:57:06.463426 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 01:57:06.463426 np0000001127 nova-compute[98206]:   <serial>2a1783c2-cd34-4cfa-8569-d5f41d2a98f7</serial>
May 21 01:57:06.463426 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 01:57:06.463426 np0000001127 nova-compute[98206]: </disk>
May 21 01:57:06.463426 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 01:57:06.546706 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Releasing lock "refresh_cache-6f68556b-0b18-452a-b307-da2dad4ee6ab" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:57:06.547142 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Instance network_info: |[{"id": "069db2b1-36ac-43ce-b643-fcdc9ff52141", "address": "fa:16:3e:30:ad:e5", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap069db2b1-36", "ovs_interfaceid": "069db2b1-36ac-43ce-b643-fcdc9ff52141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 01:57:06.547634 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a75e80b8-cbfb-4934-ab05-a4920322a9a3 req-89bbeb9b-35e4-42de-8b64-54f5b1c211ce service nova] Acquired lock "refresh_cache-6f68556b-0b18-452a-b307-da2dad4ee6ab" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:57:06.547889 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-a75e80b8-cbfb-4934-ab05-a4920322a9a3 req-89bbeb9b-35e4-42de-8b64-54f5b1c211ce service nova] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Refreshing network info cache for port 069db2b1-36ac-43ce-b643-fcdc9ff52141 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:57:06.551965 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Start _get_guest_xml network_info=[{"id": "069db2b1-36ac-43ce-b643-fcdc9ff52141", "address": "fa:16:3e:30:ad:e5", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap069db2b1-36", "ovs_interfaceid": "069db2b1-36ac-43ce-b643-fcdc9ff52141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 01:57:06.557348 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 01:57:06.559148 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-tempest.common.compute-instance-288227188', uuid='6f68556b-0b18-452a-b307-da2dad4ee6ab'), owner=OwnerMeta(userid='bbcd1a81252344dd804a4080571f8751', username='tempest-ServerActionsTestOtherA-1975191698-project-member', projectid='6a15fe7a70464159a778cffa4a36c36f', projectname='tempest-ServerActionsTestOtherA-1975191698'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "069db2b1-36ac-43ce-b643-fcdc9ff52141", "address": "fa:16:3e:30:ad:e5", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap069db2b1-36", "ovs_interfaceid": "069db2b1-36ac-43ce-b643-fcdc9ff52141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328626.5584419) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 01:57:06.561389 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 01:57:06.561982 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 01:57:06.564730 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 01:57:06.567083 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 01:57:06.568437 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 01:57:06.569252 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 01:57:06.569252 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 01:57:06.569252 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 01:57:06.569571 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 01:57:06.569571 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 01:57:06.569737 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 01:57:06.569949 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 01:57:06.570255 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 01:57:06.570428 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 01:57:06.571713 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 01:57:06.572018 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 01:57:06.590953 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T01:56:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-288227188',display_name='tempest-tempest.common.compute-instance-288227188',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-tempest-common-compute-instance-288227188',id=10,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFa4h1sACKVx0qMim6t3PkF47uhDyneTJkwL/xOqx10IdCIKzdMNwpXbxDopvRYuon+cm2g/xX3KdbSKB9yixqLXsKKYgUZSUERIMzzqqvllJnaPGuHQmel2EKS0sBdZzQ==',key_name='tempest-keypair-1484910746',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a15fe7a70464159a778cffa4a36c36f',ramdisk_id='',reservation_id='r-06kjjbvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1975191698',owner_user_name='tempest-ServerActionsTestOtherA-1975191698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:57:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbcd1a81252344dd804a4080571f8751',uuid=6f68556b-0b18-452a-b307-da2dad4ee6ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "069db2b1-36ac-43ce-b643-fcdc9ff52141", "address": "fa:16:3e:30:ad:e5", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap069db2b1-36", "ovs_interfaceid": "069db2b1-36ac-43ce-b643-fcdc9ff52141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 01:57:06.591222 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Converting VIF {"id": "069db2b1-36ac-43ce-b643-fcdc9ff52141", "address": "fa:16:3e:30:ad:e5", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap069db2b1-36", "ovs_interfaceid": "069db2b1-36ac-43ce-b643-fcdc9ff52141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:57:06.591868 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:ad:e5,bridge_name='br-int',has_traffic_filtering=True,id=069db2b1-36ac-43ce-b643-fcdc9ff52141,network=Network(6d660724-85bf-45e3-895a-b9ce67043c30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap069db2b1-36') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:57:06.592631 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f68556b-0b18-452a-b307-da2dad4ee6ab {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:57:06.626867 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-945dec38-4384-455f-9e1b-43d1c797c367 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1663470333', uuid='6307081b-dd75-4ea3-aad6-d01f2b2b1c9b'), owner=OwnerMeta(userid='0fd36d5cf62b4dc49bd53ebc09db2a2d', username='tempest-TaggedAttachmentsTest-1169987238-project-member', projectid='1ffcb955f57a438d998dbdf9bfee0868', projectname='tempest-TaggedAttachmentsTest-1169987238'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "67b86a71-40ec-405f-8d46-56744e34174f", "address": "fa:16:3e:ba:84:92", "network": {"id": "84a294f6-e79d-44ac-90f4-cfa96e67e367", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1771731810-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ffcb955f57a438d998dbdf9bfee0868", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b86a71-40", "ovs_interfaceid": "67b86a71-40ec-405f-8d46-56744e34174f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcbb3f8b-362a-4634-8baa-f09e0134e596", "address": "fa:16:3e:9e:2a:c6", "network": {"id": "1506c578-ffa9-48da-b8bb-2c0ea4a41146", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1947915502", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ffcb955f57a438d998dbdf9bfee0868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcbb3f8b-36", "ovs_interfaceid": "bcbb3f8b-362a-4634-8baa-f09e0134e596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328626.6263614) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 01:57:06.631793 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-945dec38-4384-455f-9e1b-43d1c797c367 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:   <nova:package version="33.1.0"/>
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:   <nova:name>tempest-device-tagging-server-1663470333</nova:name>
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:   <nova:creationTime>2026-05-21 01:57:06</nova:creationTime>
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:   <nova:flavor name="m1.nano" id="42">
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:     <nova:memory>192</nova:memory>
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:     <nova:disk>1</nova:disk>
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:     <nova:swap>0</nova:swap>
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:     <nova:ephemeral>0</nova:ephemeral>
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:     <nova:vcpus>1</nova:vcpus>
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:     <nova:extraSpecs>
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:     </nova:extraSpecs>
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:   </nova:flavor>
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:   <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:     <nova:containerFormat>bare</nova:containerFormat>
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:     <nova:minDisk>1</nova:minDisk>
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:     <nova:minRam>0</nova:minRam>
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:     <nova:properties>
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:       <nova:property name="hw_machine_type">pc</nova:property>
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:       <nova:property name="hw_video_model">virtio</nova:property>
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:     </nova:properties>
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:   </nova:image>
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:   <nova:owner>
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:     <nova:user uuid="0fd36d5cf62b4dc49bd53ebc09db2a2d">tempest-TaggedAttachmentsTest-1169987238-project-member</nova:user>
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:     <nova:project uuid="1ffcb955f57a438d998dbdf9bfee0868">tempest-TaggedAttachmentsTest-1169987238</nova:project>
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:   </nova:owner>
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:   <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:   <nova:ports>
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:     <nova:port uuid="67b86a71-40ec-405f-8d46-56744e34174f">
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:       <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:     </nova:port>
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:     <nova:port uuid="bcbb3f8b-362a-4634-8baa-f09e0134e596">
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:       <nova:ip type="fixed" address="10.10.10.187" ipVersion="4"/>
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:     </nova:port>
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:   </nova:ports>
May 21 01:57:06.631793 np0000001127 nova-compute[98206]: </nova:instance>
May 21 01:57:06.631793 np0000001127 nova-compute[98206]:  {{(pid=98206) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 21 01:57:06.676332 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:06.685514 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:06.687419 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:06.714651 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:06.716012 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:06.789623 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Found WWN 330000000a3360359 for multipath device dm-5 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 01:57:06.790194 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:57:06.790529 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] <== connect_volume: return (8608ms) {'type': 'block', 'scsi_wwn': '330000000a3360359', 'path': '/dev/dm-5', 'multipath_id': '330000000a3360359'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:57:06.790529 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a3360359', 'path': '/dev/dm-5', 'multipath_id': '330000000a3360359'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 01:57:06.968464 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779328626.9671881, cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6 => ua-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 01:57:06.969087 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias ua-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 for instance cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6 {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 01:57:06.971554 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Successfully detached device vdb from instance cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6 from the live domain config.
May 21 01:57:06.972366 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 01:57:06.973544 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7', 'iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a1783c2-cd34-4cfa-8569-d5f41d2a98f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:57:06.973544 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:57:06.973544 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:57:06.973830 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7', 'iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a1783c2-cd34-4cfa-8569-d5f41d2a98f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 01:57:06.973830 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 01:57:07.006347 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:07.006347 np0000001127 nova-compute[98206]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:07.006347 np0000001127 nova-compute[98206]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:07.006347 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:07.006347 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:07.006347 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:07.006347 np0000001127 nova-compute[98206]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:57:07.006347 np0000001127 nova-compute[98206]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:57:07.006347 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:57:07.006764 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:07.006764 np0000001127 nova-compute[98206]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:07.006764 np0000001127 nova-compute[98206]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:07.006764 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:07.006764 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:07.006764 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:07.006764 np0000001127 nova-compute[98206]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:57:07.006764 np0000001127 nova-compute[98206]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7 (non-flash)
May 21 01:57:07.006764 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:57:07.006764 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f', '10'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88', '6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88', '7'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7', '8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7', '9')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 01:57:07.006764 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7', '8')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 01:57:07.007880 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7', '9')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 01:57:07.008683 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c09820a8e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7'): ({'sde'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 01:57:07.008872 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Removing multipathed devices sdd, sde {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 01:57:07.009082 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Flush multipath device 330000000939e189e {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 01:57:07.039773 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 01:57:07.053173 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-a75e80b8-cbfb-4934-ab05-a4920322a9a3 req-89bbeb9b-35e4-42de-8b64-54f5b1c211ce service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:07.064015 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-525f74c1-6123-46bc-bee4-aa8807560d21 req-60305ebe-d22e-4cb3-b3a6-dc6f94dc39c5 service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Received event network-vif-plugged-bcbb3f8b-362a-4634-8baa-f09e0134e596 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:07.064113 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-525f74c1-6123-46bc-bee4-aa8807560d21 req-60305ebe-d22e-4cb3-b3a6-dc6f94dc39c5 service nova] Acquiring lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:07.064323 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-525f74c1-6123-46bc-bee4-aa8807560d21 req-60305ebe-d22e-4cb3-b3a6-dc6f94dc39c5 service nova] Lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:07.064407 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-525f74c1-6123-46bc-bee4-aa8807560d21 req-60305ebe-d22e-4cb3-b3a6-dc6f94dc39c5 service nova] Lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:07.064540 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-525f74c1-6123-46bc-bee4-aa8807560d21 req-60305ebe-d22e-4cb3-b3a6-dc6f94dc39c5 service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] No waiting events found dispatching network-vif-plugged-bcbb3f8b-362a-4634-8baa-f09e0134e596 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:57:07.064651 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-525f74c1-6123-46bc-bee4-aa8807560d21 req-60305ebe-d22e-4cb3-b3a6-dc6f94dc39c5 service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Received unexpected event network-vif-plugged-bcbb3f8b-362a-4634-8baa-f09e0134e596 for instance with vm_state active and task_state None.
May 21 01:57:07.064776 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-525f74c1-6123-46bc-bee4-aa8807560d21 req-60305ebe-d22e-4cb3-b3a6-dc6f94dc39c5 service nova] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Received event network-vif-plugged-1f478597-015e-4c42-b8d5-af05bb7c8f8e {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:07.065271 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-525f74c1-6123-46bc-bee4-aa8807560d21 req-60305ebe-d22e-4cb3-b3a6-dc6f94dc39c5 service nova] Acquiring lock "e9664d16-b539-4ccc-abd4-47a8fa944520-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:07.065403 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-525f74c1-6123-46bc-bee4-aa8807560d21 req-60305ebe-d22e-4cb3-b3a6-dc6f94dc39c5 service nova] Lock "e9664d16-b539-4ccc-abd4-47a8fa944520-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:07.065571 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-525f74c1-6123-46bc-bee4-aa8807560d21 req-60305ebe-d22e-4cb3-b3a6-dc6f94dc39c5 service nova] Lock "e9664d16-b539-4ccc-abd4-47a8fa944520-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:07.065714 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-525f74c1-6123-46bc-bee4-aa8807560d21 req-60305ebe-d22e-4cb3-b3a6-dc6f94dc39c5 service nova] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Processing event network-vif-plugged-1f478597-015e-4c42-b8d5-af05bb7c8f8e {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 01:57:07.065828 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-525f74c1-6123-46bc-bee4-aa8807560d21 req-60305ebe-d22e-4cb3-b3a6-dc6f94dc39c5 service nova] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Received event network-vif-plugged-1f478597-015e-4c42-b8d5-af05bb7c8f8e {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:07.065960 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-525f74c1-6123-46bc-bee4-aa8807560d21 req-60305ebe-d22e-4cb3-b3a6-dc6f94dc39c5 service nova] Acquiring lock "e9664d16-b539-4ccc-abd4-47a8fa944520-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:07.066114 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-525f74c1-6123-46bc-bee4-aa8807560d21 req-60305ebe-d22e-4cb3-b3a6-dc6f94dc39c5 service nova] Lock "e9664d16-b539-4ccc-abd4-47a8fa944520-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:07.066190 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-525f74c1-6123-46bc-bee4-aa8807560d21 req-60305ebe-d22e-4cb3-b3a6-dc6f94dc39c5 service nova] Lock "e9664d16-b539-4ccc-abd4-47a8fa944520-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:07.066299 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-525f74c1-6123-46bc-bee4-aa8807560d21 req-60305ebe-d22e-4cb3-b3a6-dc6f94dc39c5 service nova] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] No waiting events found dispatching network-vif-plugged-1f478597-015e-4c42-b8d5-af05bb7c8f8e {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:57:07.066414 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-525f74c1-6123-46bc-bee4-aa8807560d21 req-60305ebe-d22e-4cb3-b3a6-dc6f94dc39c5 service nova] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Received unexpected event network-vif-plugged-1f478597-015e-4c42-b8d5-af05bb7c8f8e for instance with vm_state building and task_state spawning.
May 21 01:57:07.097429 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] End _get_guest_xml xml=<domain type="qemu">
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:   <uuid>6f68556b-0b18-452a-b307-da2dad4ee6ab</uuid>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:   <name>instance-0000000a</name>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:   <metadata>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:       <nova:name>tempest-tempest.common.compute-instance-288227188</nova:name>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 01:57:06</nova:creationTime>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:       </nova:image>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:         <nova:user uuid="bbcd1a81252344dd804a4080571f8751">tempest-ServerActionsTestOtherA-1975191698-project-member</nova:user>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:         <nova:project uuid="6a15fe7a70464159a778cffa4a36c36f">tempest-ServerActionsTestOtherA-1975191698</nova:project>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:         <nova:port uuid="069db2b1-36ac-43ce-b643-fcdc9ff52141">
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:         </nova:port>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:   </metadata>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:     <system>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:       <entry name="serial">6f68556b-0b18-452a-b307-da2dad4ee6ab</entry>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:       <entry name="uuid">6f68556b-0b18-452a-b307-da2dad4ee6ab</entry>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:     </system>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:   <os>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:   </os>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:   <features>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:     <acpi/>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:     <tcg>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:     </tcg>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:   </features>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:   <devices>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab/disk"/>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:     </disk>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab/disk.config"/>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:     </disk>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:30:ad:e5"/>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:       <target dev="tap069db2b1-36"/>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:     </interface>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab/console.log" append="off"/>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:     </serial>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:     <video>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:     </video>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:     </rng>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:     </memballoon>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:   </devices>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]: </domain>
May 21 01:57:07.097429 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 01:57:07.100369 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Preparing to wait for external event network-vif-plugged-069db2b1-36ac-43ce-b643-fcdc9ff52141 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 01:57:07.100369 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "6f68556b-0b18-452a-b307-da2dad4ee6ab-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:07.100369 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "6f68556b-0b18-452a-b307-da2dad4ee6ab-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:07.100369 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "6f68556b-0b18-452a-b307-da2dad4ee6ab-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:07.100369 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T01:56:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-288227188',display_name='tempest-tempest.common.compute-instance-288227188',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-tempest-common-compute-instance-288227188',id=10,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFa4h1sACKVx0qMim6t3PkF47uhDyneTJkwL/xOqx10IdCIKzdMNwpXbxDopvRYuon+cm2g/xX3KdbSKB9yixqLXsKKYgUZSUERIMzzqqvllJnaPGuHQmel2EKS0sBdZzQ==',key_name='tempest-keypair-1484910746',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a15fe7a70464159a778cffa4a36c36f',ramdisk_id='',reservation_id='r-06kjjbvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1975191698',owner_user_name='tempest-ServerActionsTestOtherA-1975191698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:57:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbcd1a81252344dd804a4080571f8751',uuid=6f68556b-0b18-452a-b307-da2dad4ee6ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "069db2b1-36ac-43ce-b643-fcdc9ff52141", "address": "fa:16:3e:30:ad:e5", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap069db2b1-36", "ovs_interfaceid": "069db2b1-36ac-43ce-b643-fcdc9ff52141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 01:57:07.100369 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Converting VIF {"id": "069db2b1-36ac-43ce-b643-fcdc9ff52141", "address": "fa:16:3e:30:ad:e5", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap069db2b1-36", "ovs_interfaceid": "069db2b1-36ac-43ce-b643-fcdc9ff52141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:57:07.100369 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:ad:e5,bridge_name='br-int',has_traffic_filtering=True,id=069db2b1-36ac-43ce-b643-fcdc9ff52141,network=Network(6d660724-85bf-45e3-895a-b9ce67043c30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap069db2b1-36') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:57:07.100369 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:ad:e5,bridge_name='br-int',has_traffic_filtering=True,id=069db2b1-36ac-43ce-b643-fcdc9ff52141,network=Network(6d660724-85bf-45e3-895a-b9ce67043c30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap069db2b1-36') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 01:57:07.100811 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:07.100837 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:07.101057 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 01:57:07.102387 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 01:57:07.102828 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:07.103035 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '39ade087-6754-56ba-9b92-1372e45fd013', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:07.103864 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:07.104568 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:57:07.111296 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:07.113831 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:07.113831 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap069db2b1-36, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:07.113831 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap069db2b1-36, col_values=(('qos', UUID('6d8133ed-75c3-4231-9a56-096647e6b6d7')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:07.114006 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap069db2b1-36, col_values=(('external_ids', {'iface-id': '069db2b1-36ac-43ce-b643-fcdc9ff52141', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:ad:e5', 'vm-uuid': '6f68556b-0b18-452a-b307-da2dad4ee6ab'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:07.115904 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:07.116164 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:57:07.127160 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:07.127979 np0000001127 nova-compute[98206]: INFO os_vif [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:ad:e5,bridge_name='br-int',has_traffic_filtering=True,id=069db2b1-36ac-43ce-b643-fcdc9ff52141,network=Network(6d660724-85bf-45e3-895a-b9ce67043c30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap069db2b1-36')
May 21 01:57:07.146805 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-945dec38-4384-455f-9e1b-43d1c797c367 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lock "interface-6307081b-dd75-4ea3-aad6-d01f2b2b1c9b-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 8.689s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:07.149840 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 01:57:07.150278 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] SCSI volumes sdd, sde have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 01:57:07.153839 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 01:57:07.166102 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 01:57:07.166483 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 01:57:07.180056 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:07.223229 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7, portal: 192.168.40.100,3260]
May 21 01:57:07.223229 np0000001127 nova-compute[98206]: Logout of [sid: 8, target: iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7, portal: 192.168.40.100,3260] successful.
May 21 01:57:07.223229 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:07.236843 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Acquiring lock "ecf25bc4-b32d-4627-9571-f98869b227f9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:07.237370 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "ecf25bc4-b32d-4627-9571-f98869b227f9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:07.243424 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:07.255256 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:07.285627 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7, portal: 192.168.50.100,3260]
May 21 01:57:07.285627 np0000001127 nova-compute[98206]: Logout of [sid: 9, target: iqn.2023-03.storpool.com:os--volume-2a1783c2-cd34-4cfa-8569-d5f41d2a98f7, portal: 192.168.50.100,3260] successful.
May 21 01:57:07.285627 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:07.290082 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 01:57:07.290811 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328627.2901728, e9664d16-b539-4ccc-abd4-47a8fa944520 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:57:07.290811 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] VM Started (Lifecycle Event)
May 21 01:57:07.295400 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 01:57:07.296658 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 01:57:07.297270 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7', 'iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '728d4669-c172-4f18-ae34-53ce485326e7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:57:07.297394 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:57:07.299777 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Instance spawned successfully.
May 21 01:57:07.300060 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 01:57:07.303482 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:07.303482 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:57:07.303482 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] <== disconnect_volume: return (330ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:57:07.305386 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 01:57:07.310202 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.013s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:57:07.310570 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7', 'iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '728d4669-c172-4f18-ae34-53ce485326e7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 01:57:07.321799 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:57:07.323202 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:57:07.323892 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:57:07.324764 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:57:07.325339 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:57:07.325706 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:57:07.344716 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 01:57:07.344716 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:07.345106 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 01:57:07.345106 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:07.357945 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7] added
May 21 01:57:07.357945 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 01:57:07.357945 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:57:07.357945 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:57:07.357945 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:57:07.357945 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:57:07.357945 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:07.358249 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 01:57:07.358538 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0338(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 01:57:07.358730 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 01:57:07.361890 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7] added
May 21 01:57:07.361890 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 01:57:07.361890 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:57:07.361890 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:57:07.361890 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:57:07.361890 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:57:07.361890 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:07.362439 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 01:57:07.362439 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0367(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 01:57:07.362439 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 01:57:07.406366 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-a75e80b8-cbfb-4934-ab05-a4920322a9a3 req-89bbeb9b-35e4-42de-8b64-54f5b1c211ce service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:07.520246 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b81cb2c4-e9b0-4fcd-801a-3bdcc864a5a5 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "98ace73f-7d4b-4aed-9355-a39c58f9b024" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.750s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:07.538898 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-a75e80b8-cbfb-4934-ab05-a4920322a9a3 req-89bbeb9b-35e4-42de-8b64-54f5b1c211ce service nova] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Updated VIF entry in instance network info cache for port 069db2b1-36ac-43ce-b643-fcdc9ff52141. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 01:57:07.539047 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-a75e80b8-cbfb-4934-ab05-a4920322a9a3 req-89bbeb9b-35e4-42de-8b64-54f5b1c211ce service nova] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Updating instance_info_cache with network_info: [{"id": "069db2b1-36ac-43ce-b643-fcdc9ff52141", "address": "fa:16:3e:30:ad:e5", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap069db2b1-36", "ovs_interfaceid": "069db2b1-36ac-43ce-b643-fcdc9ff52141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:57:07.741917 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lazy-loading 'flavor' on Instance uuid ecf25bc4-b32d-4627-9571-f98869b227f9 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:57:07.793270 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:57:07.795506 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:57:07.804912 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:57:07.805087 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:57:07.805392 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:57:07.805871 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:57:07.806091 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:57:07.806392 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:57:07.889156 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Lazy-loading 'flavor' on Instance uuid cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:57:08.043213 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a75e80b8-cbfb-4934-ab05-a4920322a9a3 req-89bbeb9b-35e4-42de-8b64-54f5b1c211ce service nova] Releasing lock "refresh_cache-6f68556b-0b18-452a-b307-da2dad4ee6ab" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:57:08.262674 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Acquiring lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:08.262835 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:08.297682 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 01:57:08.297900 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328628.297754, e9664d16-b539-4ccc-abd4-47a8fa944520 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:57:08.297998 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] VM Paused (Lifecycle Event)
May 21 01:57:08.313481 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Took 7.41 seconds to spawn the instance on the hypervisor.
May 21 01:57:08.314124 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:57:08.360499 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:57:08.363095 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.startup = manual
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:57:08.377339 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:57:08.377339 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.startup = manual
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:57:08.382617 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:57:08.382617 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:08.394848 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:08.396675 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:08.414640 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:08.414640 np0000001127 nova-compute[98206]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:08.414640 np0000001127 nova-compute[98206]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:08.414640 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:08.414640 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:08.414640 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:08.414640 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:57:08.414931 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:08.414931 np0000001127 nova-compute[98206]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:08.414931 np0000001127 nova-compute[98206]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:08.414931 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:08.414931 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:08.414931 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:08.414931 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:57:08.422694 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:08.422694 np0000001127 nova-compute[98206]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:08.422694 np0000001127 nova-compute[98206]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:08.422694 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:08.422694 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:08.422694 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:08.422694 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:57:08.422928 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:08.422928 np0000001127 nova-compute[98206]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:08.422928 np0000001127 nova-compute[98206]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:08.422928 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:08.422928 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:08.422928 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:08.422928 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:57:08.455830 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7, portal: 192.168.50.100,3260]
May 21 01:57:08.455830 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7, portal: 192.168.50.100,3260] successful.
May 21 01:57:08.455830 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:08.471698 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:08.473049 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7, portal: 192.168.40.100,3260]
May 21 01:57:08.473049 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7, portal: 192.168.40.100,3260] successful.
May 21 01:57:08.473049 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:08.486544 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:08.486544 np0000001127 nova-compute[98206]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:08.486544 np0000001127 nova-compute[98206]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:08.486544 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:08.486544 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:08.486544 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:08.486544 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:08.486544 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:08.486544 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:57:08.486774 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:08.486774 np0000001127 nova-compute[98206]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:08.486774 np0000001127 nova-compute[98206]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:08.486774 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:08.486774 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:08.486774 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:08.486774 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:08.486774 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:08.486774 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:57:08.487017 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.162s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:57:08.487064 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:57:08.487851 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] HCTL ('9', '-', '-', 0) found on session 14 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:57:08.487955 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:57:08.491250 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:08.508515 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Searching for a device in session 14 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:57:08.508724 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '728d4669-c172-4f18-ae34-53ce485326e7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:57:08.513076 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:08.513076 np0000001127 nova-compute[98206]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:08.513076 np0000001127 nova-compute[98206]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:08.513076 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:08.513076 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:08.513076 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:08.513076 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:08.513076 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:08.513076 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:57:08.513453 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:08.513453 np0000001127 nova-compute[98206]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:08.513453 np0000001127 nova-compute[98206]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:08.513453 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:08.513453 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:08.513453 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:08.513453 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:08.513453 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:08.513453 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:57:08.513698 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.190s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:57:08.513768 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:57:08.514814 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] HCTL ('10', '-', '-', 0) found on session 15 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:57:08.514956 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:57:08.539068 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Searching for a device in session 15 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:57:08.539068 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '728d4669-c172-4f18-ae34-53ce485326e7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:57:08.646026 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:57:08.646295 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:57:08.646295 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] No VIF found with MAC fa:16:3e:30:ad:e5, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 01:57:08.650495 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Using config drive
May 21 01:57:08.749736 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "ecf25bc4-b32d-4627-9571-f98869b227f9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:08.767496 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lazy-loading 'flavor' on Instance uuid 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:57:08.800395 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:57:08.801808 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328628.8015614, e9664d16-b539-4ccc-abd4-47a8fa944520 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:57:08.801946 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] VM Resumed (Lifecycle Event)
May 21 01:57:08.829592 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Took 13.00 seconds to build instance.
May 21 01:57:08.904768 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5c3b01bc-03de-4f95-911d-53a59c161678 tempest-VolumesAssistedSnapshotsTest-1256253896 tempest-VolumesAssistedSnapshotsTest-1256253896-project-admin] Lock "cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.036s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:09.008573 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-879acd0b-9e41-48ff-bb90-4e52daf9ed44 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Snapshot image upload complete
May 21 01:57:09.008872 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-879acd0b-9e41-48ff-bb90-4e52daf9ed44 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:57:09.159577 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:09.305080 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:57:09.306658 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:57:09.328006 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 01:57:09.331099 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "e9664d16-b539-4ccc-abd4-47a8fa944520" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.511s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:09.336255 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Creating config drive at /opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab/disk.config
May 21 01:57:09.342314 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpobl7e34m {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:09.383345 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpobl7e34m" returned: 0 in 0.041s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:09.519498 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-879acd0b-9e41-48ff-bb90-4e52daf9ed44 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Shelve offloading
May 21 01:57:09.776360 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:09.797434 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-621880ed-945f-4686-acc4-23e3ba7a12e4 req-7c28bc6d-8daa-4c16-a2c4-1c68e50a51f2 service nova] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Received event network-changed-1f478597-015e-4c42-b8d5-af05bb7c8f8e {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:09.797630 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-621880ed-945f-4686-acc4-23e3ba7a12e4 req-7c28bc6d-8daa-4c16-a2c4-1c68e50a51f2 service nova] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Refreshing instance network info cache due to event network-changed-1f478597-015e-4c42-b8d5-af05bb7c8f8e. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:57:09.797858 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-621880ed-945f-4686-acc4-23e3ba7a12e4 req-7c28bc6d-8daa-4c16-a2c4-1c68e50a51f2 service nova] Acquiring lock "refresh_cache-e9664d16-b539-4ccc-abd4-47a8fa944520" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:57:09.797928 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-621880ed-945f-4686-acc4-23e3ba7a12e4 req-7c28bc6d-8daa-4c16-a2c4-1c68e50a51f2 service nova] Acquired lock "refresh_cache-e9664d16-b539-4ccc-abd4-47a8fa944520" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:57:09.798095 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-621880ed-945f-4686-acc4-23e3ba7a12e4 req-7c28bc6d-8daa-4c16-a2c4-1c68e50a51f2 service nova] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Refreshing network info cache for port 1f478597-015e-4c42-b8d5-af05bb7c8f8e {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:57:09.867395 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Acquiring lock "ecf25bc4-b32d-4627-9571-f98869b227f9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:09.869089 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "ecf25bc4-b32d-4627-9571-f98869b227f9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:09.869362 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Attaching volume b72d4732-cbb9-491f-8683-d0155023a91f to /dev/vdb
May 21 01:57:09.873428 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:09.897900 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:09.900582 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:09.924960 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:57:09.939760 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 01:57:09.964437 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:09.991654 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:09.998234 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 01:57:09.998234 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 01:57:10.005997 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 01:57:10.007478 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:feba:8492', 'fe80::405e:62ff:fe28:f67b', 'fe80::fc16:3eff:fe4a:37e3', 'fe80::4822:65ff:fe37:7fac', 'fe80::fc16:3eff:feee:ec8e', 'fe80::fc16:3eff:fea0:e8cd', 'fe80::ca2:24ff:fe18:e91d', 'fe80::fc16:3eff:fe9e:216', 'fe80::14d9:7bff:fe3b:f0dc', 'fe80::fc16:3eff:fe9e:2ac6', 'fe80::c8a3:fcff:fe54:10d6', 'fe80::fc16:3eff:fef6:c7e3', 'fe80::68db:c7ff:fe71:da32', 'fe80::fc16:3eff:fe30:ade5'] 
May 21 01:57:10.007815 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 01:57:10.007815 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 01:57:10.008512 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] <== get_connector_properties: return (83ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:57:10.008512 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Updating existing volume attachment record: a238d1e5-b160-41d4-8cf6-088be2f62046 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 01:57:10.039015 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:10.040878 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Instance destroyed successfully.
May 21 01:57:10.044184 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-879acd0b-9e41-48ff-bb90-4e52daf9ed44 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:57:10.046909 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-879acd0b-9e41-48ff-bb90-4e52daf9ed44 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "refresh_cache-0059a43c-1d34-40a9-af63-b5eca8c30f53" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:57:10.047053 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-879acd0b-9e41-48ff-bb90-4e52daf9ed44 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquired lock "refresh_cache-0059a43c-1d34-40a9-af63-b5eca8c30f53" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:57:10.047868 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-879acd0b-9e41-48ff-bb90-4e52daf9ed44 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 01:57:10.050339 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:10.305011 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-621880ed-945f-4686-acc4-23e3ba7a12e4 req-7c28bc6d-8daa-4c16-a2c4-1c68e50a51f2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:10.351902 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Found WWN 3300000004b97a869 for multipath device dm-3 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 01:57:10.352314 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:57:10.352524 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] <== connect_volume: return (3054ms) {'type': 'block', 'scsi_wwn': '3300000004b97a869', 'path': '/dev/dm-3', 'multipath_id': '3300000004b97a869'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:57:10.352638 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004b97a869', 'path': '/dev/dm-3', 'multipath_id': '3300000004b97a869'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 01:57:10.551163 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-879acd0b-9e41-48ff-bb90-4e52daf9ed44 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:10.579804 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 01:57:10.580089 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f', 'iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b72d4732-cbb9-491f-8683-d0155023a91f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:57:10.580259 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:57:10.580695 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:57:10.580938 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f', 'iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b72d4732-cbb9-491f-8683-d0155023a91f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 01:57:10.599872 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:57:10.600564 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:57:10.601033 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:57:10.601337 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:57:10.601532 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:57:10.601870 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.startup = automatic
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.session.scan = manual
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:57:10.613624 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:57:10.613624 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.startup = automatic
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.session.scan = manual
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:57:10.620264 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:57:10.620264 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:10.632152 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:10.645267 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:10.652039 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:10.652039 np0000001127 nova-compute[98206]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:10.652039 np0000001127 nova-compute[98206]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:10.652039 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:10.652039 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:10.652039 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:10.652039 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:10.652039 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:10.652039 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:57:10.652352 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:10.652352 np0000001127 nova-compute[98206]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:10.652352 np0000001127 nova-compute[98206]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:10.652352 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:10.652352 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:10.652352 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:10.652352 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:10.652352 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:10.652352 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:57:10.653024 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.052s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:57:10.653260 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:57:10.659236 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] HCTL ('11', '0', '0', 0) found on session 10 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:57:10.659362 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Scanning host 11 c: 0, t: 0, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:57:10.665266 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:10.665266 np0000001127 nova-compute[98206]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:10.665266 np0000001127 nova-compute[98206]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:10.665266 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:10.665266 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:10.665266 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:10.665266 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:10.665266 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:10.665266 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:57:10.665266 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:10.665266 np0000001127 nova-compute[98206]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:10.665266 np0000001127 nova-compute[98206]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:10.665266 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:10.665266 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:10.665266 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:10.665266 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:10.665266 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:10.665266 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:57:10.666500 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.065s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:57:10.666500 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:57:10.667053 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] HCTL ('12', '0', '0', 0) found on session 11 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:57:10.667249 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Scanning host 12 c: 0, t: 0, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:57:10.670606 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Searching for a device in session 10 and hctl ('11', '0', '0', 0) yield: sdf {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:57:10.670951 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b72d4732-cbb9-491f-8683-d0155023a91f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:57:10.680130 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Searching for a device in session 11 and hctl ('12', '0', '0', 0) yield: sdg {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:57:10.680130 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b72d4732-cbb9-491f-8683-d0155023a91f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:57:10.772023 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-621880ed-945f-4686-acc4-23e3ba7a12e4 req-7c28bc6d-8daa-4c16-a2c4-1c68e50a51f2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:10.775988 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7e305753-a759-41ae-9bdf-8c65f9d91f56 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Acquiring lock "cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:10.776378 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7e305753-a759-41ae-9bdf-8c65f9d91f56 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Lock "cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:10.776678 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7e305753-a759-41ae-9bdf-8c65f9d91f56 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Acquiring lock "cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:10.776885 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7e305753-a759-41ae-9bdf-8c65f9d91f56 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Lock "cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:10.777104 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7e305753-a759-41ae-9bdf-8c65f9d91f56 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Lock "cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:10.782036 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-7e305753-a759-41ae-9bdf-8c65f9d91f56 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Terminating instance
May 21 01:57:10.785266 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328630.7848804, 6f68556b-0b18-452a-b307-da2dad4ee6ab => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:57:10.785485 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] VM Started (Lifecycle Event)
May 21 01:57:10.861353 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1881553016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-1881553016',id=8,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBhaMEk9DiH2Bx5NNy3a3Zcjn51ZPUcBOQR2tG9r9zsoi7BbVdTpWoBYnD1pSE/ZUlPcBmm+IYQRAksBakKITqSdzVcswYCcllJKJ4mjJEDrm/7oZYVwTy+GTcc+FpFXw==',key_name='tempest-keypair-947972251',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d16c5939e8b346a8a2da89fb19b2a812',ramdisk_id='',reservation_id='r-kje4iw6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1353067880',owner_user_name='tempest-TaggedBootDevicesTest-1353067880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:56:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06d28d9bc06a4a27bcba288eb5a07e0c',uuid=58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebf91ac5-9634-4897-a1bb-7336846be7cb", "address": "fa:16:3e:fd:1e:9d", "network": {"id": "724d3b04-8f64-44ab-8f94-c1119b9a5b83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1321933524-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf91ac5-96", "ovs_interfaceid": "ebf91ac5-9634-4897-a1bb-7336846be7cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 01:57:10.861639 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converting VIF {"id": "ebf91ac5-9634-4897-a1bb-7336846be7cb", "address": "fa:16:3e:fd:1e:9d", "network": {"id": "724d3b04-8f64-44ab-8f94-c1119b9a5b83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1321933524-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf91ac5-96", "ovs_interfaceid": "ebf91ac5-9634-4897-a1bb-7336846be7cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:57:10.862249 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:1e:9d,bridge_name='br-int',has_traffic_filtering=True,id=ebf91ac5-9634-4897-a1bb-7336846be7cb,network=Network(724d3b04-8f64-44ab-8f94-c1119b9a5b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf91ac5-96') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:57:10.862976 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1881553016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-1881553016',id=8,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBhaMEk9DiH2Bx5NNy3a3Zcjn51ZPUcBOQR2tG9r9zsoi7BbVdTpWoBYnD1pSE/ZUlPcBmm+IYQRAksBakKITqSdzVcswYCcllJKJ4mjJEDrm/7oZYVwTy+GTcc+FpFXw==',key_name='tempest-keypair-947972251',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d16c5939e8b346a8a2da89fb19b2a812',ramdisk_id='',reservation_id='r-kje4iw6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1353067880',owner_user_name='tempest-TaggedBootDevicesTest-1353067880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:56:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06d28d9bc06a4a27bcba288eb5a07e0c',uuid=58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "319abe1b-caf8-4fa7-bc6c-caa7e755860b", "address": "fa:16:3e:10:bc:3b", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap319abe1b-ca", "ovs_interfaceid": "319abe1b-caf8-4fa7-bc6c-caa7e755860b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 01:57:10.863120 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converting VIF {"id": "319abe1b-caf8-4fa7-bc6c-caa7e755860b", "address": "fa:16:3e:10:bc:3b", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap319abe1b-ca", "ovs_interfaceid": "319abe1b-caf8-4fa7-bc6c-caa7e755860b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:57:10.863749 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:bc:3b,bridge_name='br-int',has_traffic_filtering=True,id=319abe1b-caf8-4fa7-bc6c-caa7e755860b,network=Network(dbb55b2c-d3ef-4540-90e5-c3bb021515d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap319abe1b-ca') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:57:10.864147 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1881553016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-1881553016',id=8,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBhaMEk9DiH2Bx5NNy3a3Zcjn51ZPUcBOQR2tG9r9zsoi7BbVdTpWoBYnD1pSE/ZUlPcBmm+IYQRAksBakKITqSdzVcswYCcllJKJ4mjJEDrm/7oZYVwTy+GTcc+FpFXw==',key_name='tempest-keypair-947972251',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d16c5939e8b346a8a2da89fb19b2a812',ramdisk_id='',reservation_id='r-kje4iw6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1353067880',owner_user_name='tempest-TaggedBootDevicesTest-1353067880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:56:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06d28d9bc06a4a27bcba288eb5a07e0c',uuid=58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db10c43a-9d2b-4250-83b6-0ca8ced88657", "address": "fa:16:3e:05:02:b1", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb10c43a-9d", "ovs_interfaceid": "db10c43a-9d2b-4250-83b6-0ca8ced88657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 01:57:10.864255 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converting VIF {"id": "db10c43a-9d2b-4250-83b6-0ca8ced88657", "address": "fa:16:3e:05:02:b1", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb10c43a-9d", "ovs_interfaceid": "db10c43a-9d2b-4250-83b6-0ca8ced88657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:57:10.864643 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:02:b1,bridge_name='br-int',has_traffic_filtering=True,id=db10c43a-9d2b-4250-83b6-0ca8ced88657,network=Network(dbb55b2c-d3ef-4540-90e5-c3bb021515d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdb10c43a-9d') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:57:10.865253 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1881553016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-1881553016',id=8,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBhaMEk9DiH2Bx5NNy3a3Zcjn51ZPUcBOQR2tG9r9zsoi7BbVdTpWoBYnD1pSE/ZUlPcBmm+IYQRAksBakKITqSdzVcswYCcllJKJ4mjJEDrm/7oZYVwTy+GTcc+FpFXw==',key_name='tempest-keypair-947972251',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d16c5939e8b346a8a2da89fb19b2a812',ramdisk_id='',reservation_id='r-kje4iw6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1353067880',owner_user_name='tempest-TaggedBootDevicesTest-1353067880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:56:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06d28d9bc06a4a27bcba288eb5a07e0c',uuid=58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d807c564-314d-4f8e-8984-8068d59d3538", "address": "fa:16:3e:df:4a:48", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd807c564-31", "ovs_interfaceid": "d807c564-314d-4f8e-8984-8068d59d3538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 01:57:10.865351 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converting VIF {"id": "d807c564-314d-4f8e-8984-8068d59d3538", "address": "fa:16:3e:df:4a:48", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd807c564-31", "ovs_interfaceid": "d807c564-314d-4f8e-8984-8068d59d3538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:57:10.865650 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:4a:48,bridge_name='br-int',has_traffic_filtering=True,id=d807c564-314d-4f8e-8984-8068d59d3538,network=Network(dbb55b2c-d3ef-4540-90e5-c3bb021515d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd807c564-31') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:57:10.866193 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1881553016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-1881553016',id=8,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBhaMEk9DiH2Bx5NNy3a3Zcjn51ZPUcBOQR2tG9r9zsoi7BbVdTpWoBYnD1pSE/ZUlPcBmm+IYQRAksBakKITqSdzVcswYCcllJKJ4mjJEDrm/7oZYVwTy+GTcc+FpFXw==',key_name='tempest-keypair-947972251',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d16c5939e8b346a8a2da89fb19b2a812',ramdisk_id='',reservation_id='r-kje4iw6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1353067880',owner_user_name='tempest-TaggedBootDevicesTest-1353067880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:56:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06d28d9bc06a4a27bcba288eb5a07e0c',uuid=58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d03a47d5-bec7-4099-96e0-c102edfe9e8e", "address": "fa:16:3e:70:5b:80", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03a47d5-be", "ovs_interfaceid": "d03a47d5-bec7-4099-96e0-c102edfe9e8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 01:57:10.866316 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converting VIF {"id": "d03a47d5-bec7-4099-96e0-c102edfe9e8e", "address": "fa:16:3e:70:5b:80", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03a47d5-be", "ovs_interfaceid": "d03a47d5-bec7-4099-96e0-c102edfe9e8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:57:10.866648 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:5b:80,bridge_name='br-int',has_traffic_filtering=True,id=d03a47d5-bec7-4099-96e0-c102edfe9e8e,network=Network(dbb55b2c-d3ef-4540-90e5-c3bb021515d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd03a47d5-be') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:57:10.867154 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1881553016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-1881553016',id=8,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBhaMEk9DiH2Bx5NNy3a3Zcjn51ZPUcBOQR2tG9r9zsoi7BbVdTpWoBYnD1pSE/ZUlPcBmm+IYQRAksBakKITqSdzVcswYCcllJKJ4mjJEDrm/7oZYVwTy+GTcc+FpFXw==',key_name='tempest-keypair-947972251',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d16c5939e8b346a8a2da89fb19b2a812',ramdisk_id='',reservation_id='r-kje4iw6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1353067880',owner_user_name='tempest-TaggedBootDevicesTest-1353067880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:56:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06d28d9bc06a4a27bcba288eb5a07e0c',uuid=58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14e48bfc-fab0-433c-b291-0e75e2da496c", "address": "fa:16:3e:e5:ea:60", "network": {"id": "7b5c3ed1-837f-404f-9062-8babcc21dfd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-715008204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e48bfc-fa", "ovs_interfaceid": "14e48bfc-fab0-433c-b291-0e75e2da496c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 01:57:10.867271 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converting VIF {"id": "14e48bfc-fab0-433c-b291-0e75e2da496c", "address": "fa:16:3e:e5:ea:60", "network": {"id": "7b5c3ed1-837f-404f-9062-8babcc21dfd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-715008204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e48bfc-fa", "ovs_interfaceid": "14e48bfc-fab0-433c-b291-0e75e2da496c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:57:10.868119 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:ea:60,bridge_name='br-int',has_traffic_filtering=True,id=14e48bfc-fab0-433c-b291-0e75e2da496c,network=Network(7b5c3ed1-837f-404f-9062-8babcc21dfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14e48bfc-fa') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:57:10.868673 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1881553016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-1881553016',id=8,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBhaMEk9DiH2Bx5NNy3a3Zcjn51ZPUcBOQR2tG9r9zsoi7BbVdTpWoBYnD1pSE/ZUlPcBmm+IYQRAksBakKITqSdzVcswYCcllJKJ4mjJEDrm/7oZYVwTy+GTcc+FpFXw==',key_name='tempest-keypair-947972251',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d16c5939e8b346a8a2da89fb19b2a812',ramdisk_id='',reservation_id='r-kje4iw6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1353067880',owner_user_name='tempest-TaggedBootDevicesTest-1353067880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:56:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06d28d9bc06a4a27bcba288eb5a07e0c',uuid=58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93b6a994-3c94-45b3-be4c-d63ce41a8557", "address": "fa:16:3e:56:b9:59", "network": {"id": "7b5c3ed1-837f-404f-9062-8babcc21dfd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-715008204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93b6a994-3c", "ovs_interfaceid": "93b6a994-3c94-45b3-be4c-d63ce41a8557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 01:57:10.868772 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converting VIF {"id": "93b6a994-3c94-45b3-be4c-d63ce41a8557", "address": "fa:16:3e:56:b9:59", "network": {"id": "7b5c3ed1-837f-404f-9062-8babcc21dfd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-715008204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93b6a994-3c", "ovs_interfaceid": "93b6a994-3c94-45b3-be4c-d63ce41a8557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:57:10.869139 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:b9:59,bridge_name='br-int',has_traffic_filtering=True,id=93b6a994-3c94-45b3-be4c-d63ce41a8557,network=Network(7b5c3ed1-837f-404f-9062-8babcc21dfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93b6a994-3c') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:57:10.869744 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lazy-loading 'pci_devices' on Instance uuid 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:57:10.936364 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-621880ed-945f-4686-acc4-23e3ba7a12e4 req-7c28bc6d-8daa-4c16-a2c4-1c68e50a51f2 service nova] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Updated VIF entry in instance network info cache for port 1f478597-015e-4c42-b8d5-af05bb7c8f8e. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 01:57:10.936655 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-621880ed-945f-4686-acc4-23e3ba7a12e4 req-7c28bc6d-8daa-4c16-a2c4-1c68e50a51f2 service nova] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Updating instance_info_cache with network_info: [{"id": "1f478597-015e-4c42-b8d5-af05bb7c8f8e", "address": "fa:16:3e:f6:c7:e3", "network": {"id": "aba610ba-f311-41c2-b94d-2495441912e4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-360728390-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a80dd2c84334f79afe5cb079c50c555", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f478597-01", "ovs_interfaceid": "1f478597-015e-4c42-b8d5-af05bb7c8f8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:57:10.956803 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-879acd0b-9e41-48ff-bb90-4e52daf9ed44 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:11.070887 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.082505 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-879acd0b-9e41-48ff-bb90-4e52daf9ed44 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Updating instance_info_cache with network_info: [{"id": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "address": "fa:16:3e:00:d8:d3", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap839e91da-5f", "ovs_interfaceid": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:57:11.247501 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Acquiring lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:11.247501 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:11.247501 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Attaching volume e48122c6-4868-472c-a26f-f9f9d0fe32db to /dev/vdb
May 21 01:57:11.289208 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7e305753-a759-41ae-9bdf-8c65f9d91f56 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 01:57:11.290357 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:57:11.295863 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328631.2955756, 6f68556b-0b18-452a-b307-da2dad4ee6ab => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:57:11.296006 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] VM Paused (Lifecycle Event)
May 21 01:57:11.308187 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:57:11.320048 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 01:57:11.322547 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.349061 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:11.349218 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.388357 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.391252 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 01:57:11.392799 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] End _get_guest_xml xml=<domain type="qemu">
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:   <uuid>58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8</uuid>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:   <name>instance-00000008</name>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:   <metadata>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <nova:name>tempest-device-tagging-server-1881553016</nova:name>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 01:56:53</nova:creationTime>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       </nova:image>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:         <nova:user uuid="06d28d9bc06a4a27bcba288eb5a07e0c">tempest-TaggedBootDevicesTest-1353067880-project-member</nova:user>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:         <nova:project uuid="d16c5939e8b346a8a2da89fb19b2a812">tempest-TaggedBootDevicesTest-1353067880</nova:project>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:         <nova:port uuid="ebf91ac5-9634-4897-a1bb-7336846be7cb">
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:         </nova:port>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:         <nova:port uuid="319abe1b-caf8-4fa7-bc6c-caa7e755860b">
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.1.80" ipVersion="4"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:         </nova:port>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:         <nova:port uuid="db10c43a-9d2b-4250-83b6-0ca8ced88657">
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.1.135" ipVersion="4"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:         </nova:port>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:         <nova:port uuid="d807c564-314d-4f8e-8984-8068d59d3538">
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.1.166" ipVersion="4"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:         </nova:port>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:         <nova:port uuid="d03a47d5-bec7-4099-96e0-c102edfe9e8e">
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.1.196" ipVersion="4"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:         </nova:port>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:         <nova:port uuid="14e48bfc-fab0-433c-b291-0e75e2da496c">
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:         </nova:port>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:         <nova:port uuid="93b6a994-3c94-45b3-be4c-d63ce41a8557">
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:         </nova:port>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:   </metadata>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     <system>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <entry name="serial">58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8</entry>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <entry name="uuid">58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8</entry>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     </system>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:   <os>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:   </os>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:   <features>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     <acpi/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     <tcg>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     </tcg>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:   </features>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:   <devices>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8/disk.config"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     </disk>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <alias name="ua-f5d11385-1cda-4417-8269-f34d36246e88"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-0"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <serial>f5d11385-1cda-4417-8269-f34d36246e88</serial>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     </disk>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <alias name="ua-de377f05-4bd5-4c5b-bf60-f92093972e57"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-5"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <target dev="vdb" bus="virtio"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <serial>de377f05-4bd5-4c5b-bf60-f92093972e57</serial>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     </disk>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <alias name="ua-728d4669-c172-4f18-ae34-53ce485326e7"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-3"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <target dev="vdc" bus="virtio"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <serial>728d4669-c172-4f18-ae34-53ce485326e7</serial>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     </disk>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:fd:1e:9d"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <target dev="tapebf91ac5-96"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     </interface>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:10:bc:3b"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <target dev="tap319abe1b-ca"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     </interface>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:05:02:b1"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <target dev="tapdb10c43a-9d"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     </interface>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:df:4a:48"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <target dev="tapd807c564-31"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     </interface>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:70:5b:80"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <target dev="tapd03a47d5-be"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     </interface>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:e5:ea:60"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <target dev="tap14e48bfc-fa"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     </interface>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:56:b9:59"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <target dev="tap93b6a994-3c"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     </interface>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8/console.log" append="off"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     </serial>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     <video>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     </video>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     </rng>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:     </memballoon>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:   </devices>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]: </domain>
May 21 01:57:11.392799 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 01:57:11.396664 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 01:57:11.396664 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Preparing to wait for external event network-vif-plugged-ebf91ac5-9634-4897-a1bb-7336846be7cb {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 01:57:11.396664 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:11.396664 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:11.396664 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:11.396664 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Preparing to wait for external event network-vif-plugged-319abe1b-caf8-4fa7-bc6c-caa7e755860b {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 01:57:11.396664 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:11.396664 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:11.396828 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:11.396993 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Preparing to wait for external event network-vif-plugged-db10c43a-9d2b-4250-83b6-0ca8ced88657 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 01:57:11.397138 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:11.397317 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:11.397438 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:11.398041 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Preparing to wait for external event network-vif-plugged-d807c564-314d-4f8e-8984-8068d59d3538 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 01:57:11.398199 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:11.398397 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:11.398554 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:11.398730 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Preparing to wait for external event network-vif-plugged-d03a47d5-bec7-4099-96e0-c102edfe9e8e {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 01:57:11.398852 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:11.399038 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:11.399218 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:11.399381 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Preparing to wait for external event network-vif-plugged-14e48bfc-fab0-433c-b291-0e75e2da496c {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 01:57:11.399906 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:11.400112 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:11.400284 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:11.400485 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Preparing to wait for external event network-vif-plugged-93b6a994-3c94-45b3-be4c-d63ce41a8557 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 01:57:11.400623 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:11.400765 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:11.400880 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:11.402076 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1881553016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-1881553016',id=8,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBhaMEk9DiH2Bx5NNy3a3Zcjn51ZPUcBOQR2tG9r9zsoi7BbVdTpWoBYnD1pSE/ZUlPcBmm+IYQRAksBakKITqSdzVcswYCcllJKJ4mjJEDrm/7oZYVwTy+GTcc+FpFXw==',key_name='tempest-keypair-947972251',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d16c5939e8b346a8a2da89fb19b2a812',ramdisk_id='',reservation_id='r-kje4iw6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1353067880',owner_user_name='tempest-TaggedBootDevicesTest-1353067880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:56:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06d28d9bc06a4a27bcba288eb5a07e0c',uuid=58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebf91ac5-9634-4897-a1bb-7336846be7cb", "address": "fa:16:3e:fd:1e:9d", "network": {"id": "724d3b04-8f64-44ab-8f94-c1119b9a5b83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1321933524-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf91ac5-96", "ovs_interfaceid": "ebf91ac5-9634-4897-a1bb-7336846be7cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 01:57:11.402322 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converting VIF {"id": "ebf91ac5-9634-4897-a1bb-7336846be7cb", "address": "fa:16:3e:fd:1e:9d", "network": {"id": "724d3b04-8f64-44ab-8f94-c1119b9a5b83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1321933524-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf91ac5-96", "ovs_interfaceid": "ebf91ac5-9634-4897-a1bb-7336846be7cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:57:11.403231 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:1e:9d,bridge_name='br-int',has_traffic_filtering=True,id=ebf91ac5-9634-4897-a1bb-7336846be7cb,network=Network(724d3b04-8f64-44ab-8f94-c1119b9a5b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf91ac5-96') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:57:11.403598 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:1e:9d,bridge_name='br-int',has_traffic_filtering=True,id=ebf91ac5-9634-4897-a1bb-7336846be7cb,network=Network(724d3b04-8f64-44ab-8f94-c1119b9a5b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf91ac5-96') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 01:57:11.404241 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.404440 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:11.404808 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 01:57:11.408604 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.408604 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b90fc02a-06af-581e-aa80-f7d628b47772', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:11.408891 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.409722 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:57:11.416995 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 01:57:11.419634 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:feba:8492', 'fe80::405e:62ff:fe28:f67b', 'fe80::fc16:3eff:fe4a:37e3', 'fe80::4822:65ff:fe37:7fac', 'fe80::fc16:3eff:feee:ec8e', 'fe80::fc16:3eff:fe9e:216', 'fe80::14d9:7bff:fe3b:f0dc', 'fe80::fc16:3eff:fe9e:2ac6', 'fe80::c8a3:fcff:fe54:10d6', 'fe80::fc16:3eff:fef6:c7e3', 'fe80::68db:c7ff:fe71:da32', 'fe80::fc16:3eff:fe30:ade5'] 
May 21 01:57:11.419634 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 01:57:11.419634 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 01:57:11.419634 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:57:11.419634 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Updating existing volume attachment record: 112751f0-6dbc-41d6-8856-7ba48791dd33 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 01:57:11.421760 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.426624 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.428129 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebf91ac5-96, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:11.428129 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapebf91ac5-96, col_values=(('qos', UUID('109b58ad-ad71-4191-bd6b-e39802903be8')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:11.428129 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapebf91ac5-96, col_values=(('external_ids', {'iface-id': 'ebf91ac5-9634-4897-a1bb-7336846be7cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:1e:9d', 'vm-uuid': '58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:11.430348 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.430348 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:57:11.441554 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-621880ed-945f-4686-acc4-23e3ba7a12e4 req-7c28bc6d-8daa-4c16-a2c4-1c68e50a51f2 service nova] Releasing lock "refresh_cache-e9664d16-b539-4ccc-abd4-47a8fa944520" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:57:11.448076 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.448574 np0000001127 nova-compute[98206]: INFO os_vif [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:1e:9d,bridge_name='br-int',has_traffic_filtering=True,id=ebf91ac5-9634-4897-a1bb-7336846be7cb,network=Network(724d3b04-8f64-44ab-8f94-c1119b9a5b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf91ac5-96')
May 21 01:57:11.449269 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1881553016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-1881553016',id=8,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBhaMEk9DiH2Bx5NNy3a3Zcjn51ZPUcBOQR2tG9r9zsoi7BbVdTpWoBYnD1pSE/ZUlPcBmm+IYQRAksBakKITqSdzVcswYCcllJKJ4mjJEDrm/7oZYVwTy+GTcc+FpFXw==',key_name='tempest-keypair-947972251',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d16c5939e8b346a8a2da89fb19b2a812',ramdisk_id='',reservation_id='r-kje4iw6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1353067880',owner_user_name='tempest-TaggedBootDevicesTest-1353067880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:56:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06d28d9bc06a4a27bcba288eb5a07e0c',uuid=58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "319abe1b-caf8-4fa7-bc6c-caa7e755860b", "address": "fa:16:3e:10:bc:3b", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap319abe1b-ca", "ovs_interfaceid": "319abe1b-caf8-4fa7-bc6c-caa7e755860b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 01:57:11.449422 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converting VIF {"id": "319abe1b-caf8-4fa7-bc6c-caa7e755860b", "address": "fa:16:3e:10:bc:3b", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap319abe1b-ca", "ovs_interfaceid": "319abe1b-caf8-4fa7-bc6c-caa7e755860b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:57:11.449901 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:bc:3b,bridge_name='br-int',has_traffic_filtering=True,id=319abe1b-caf8-4fa7-bc6c-caa7e755860b,network=Network(dbb55b2c-d3ef-4540-90e5-c3bb021515d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap319abe1b-ca') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:57:11.450125 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:bc:3b,bridge_name='br-int',has_traffic_filtering=True,id=319abe1b-caf8-4fa7-bc6c-caa7e755860b,network=Network(dbb55b2c-d3ef-4540-90e5-c3bb021515d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap319abe1b-ca') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 01:57:11.450441 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.450766 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:11.451035 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 01:57:11.454362 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.454545 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '29e081fa-59e5-58e9-962f-9a74aa9c8e57', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:11.456261 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.456600 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:57:11.477681 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.481331 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.481331 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap319abe1b-ca, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:11.481730 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap319abe1b-ca, col_values=(('qos', UUID('469b41ac-d038-4bd0-a636-95fcf4586f2d')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:11.482166 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap319abe1b-ca, col_values=(('external_ids', {'iface-id': '319abe1b-caf8-4fa7-bc6c-caa7e755860b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:bc:3b', 'vm-uuid': '58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:11.483547 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.484858 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:57:11.509658 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.509658 np0000001127 nova-compute[98206]: INFO os_vif [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:bc:3b,bridge_name='br-int',has_traffic_filtering=True,id=319abe1b-caf8-4fa7-bc6c-caa7e755860b,network=Network(dbb55b2c-d3ef-4540-90e5-c3bb021515d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap319abe1b-ca')
May 21 01:57:11.510547 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1881553016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-1881553016',id=8,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBhaMEk9DiH2Bx5NNy3a3Zcjn51ZPUcBOQR2tG9r9zsoi7BbVdTpWoBYnD1pSE/ZUlPcBmm+IYQRAksBakKITqSdzVcswYCcllJKJ4mjJEDrm/7oZYVwTy+GTcc+FpFXw==',key_name='tempest-keypair-947972251',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d16c5939e8b346a8a2da89fb19b2a812',ramdisk_id='',reservation_id='r-kje4iw6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1353067880',owner_user_name='tempest-TaggedBootDevicesTest-1353067880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:56:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06d28d9bc06a4a27bcba288eb5a07e0c',uuid=58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db10c43a-9d2b-4250-83b6-0ca8ced88657", "address": "fa:16:3e:05:02:b1", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb10c43a-9d", "ovs_interfaceid": "db10c43a-9d2b-4250-83b6-0ca8ced88657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 01:57:11.510791 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converting VIF {"id": "db10c43a-9d2b-4250-83b6-0ca8ced88657", "address": "fa:16:3e:05:02:b1", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb10c43a-9d", "ovs_interfaceid": "db10c43a-9d2b-4250-83b6-0ca8ced88657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:57:11.511296 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:02:b1,bridge_name='br-int',has_traffic_filtering=True,id=db10c43a-9d2b-4250-83b6-0ca8ced88657,network=Network(dbb55b2c-d3ef-4540-90e5-c3bb021515d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdb10c43a-9d') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:57:11.511510 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:02:b1,bridge_name='br-int',has_traffic_filtering=True,id=db10c43a-9d2b-4250-83b6-0ca8ced88657,network=Network(dbb55b2c-d3ef-4540-90e5-c3bb021515d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdb10c43a-9d') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 01:57:11.513226 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.513226 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:11.513226 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 01:57:11.514574 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.514791 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f09ab4c1-8d99-5c56-a189-d4e270cbdc04', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:11.516395 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.516564 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:57:11.527804 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a26945f0-fe93-45b0-a3ad-6d7d02b20801 req-8890d488-6273-4e78-bd08-80d2c1ef6dc3 service nova] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Received event network-vif-unplugged-8899a68b-fb77-4ac9-a9f0-ca811560c63a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:11.528047 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a26945f0-fe93-45b0-a3ad-6d7d02b20801 req-8890d488-6273-4e78-bd08-80d2c1ef6dc3 service nova] Acquiring lock "cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:11.528226 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a26945f0-fe93-45b0-a3ad-6d7d02b20801 req-8890d488-6273-4e78-bd08-80d2c1ef6dc3 service nova] Lock "cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:11.528380 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a26945f0-fe93-45b0-a3ad-6d7d02b20801 req-8890d488-6273-4e78-bd08-80d2c1ef6dc3 service nova] Lock "cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:11.528499 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a26945f0-fe93-45b0-a3ad-6d7d02b20801 req-8890d488-6273-4e78-bd08-80d2c1ef6dc3 service nova] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] No waiting events found dispatching network-vif-unplugged-8899a68b-fb77-4ac9-a9f0-ca811560c63a {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:57:11.528657 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a26945f0-fe93-45b0-a3ad-6d7d02b20801 req-8890d488-6273-4e78-bd08-80d2c1ef6dc3 service nova] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Received event network-vif-unplugged-8899a68b-fb77-4ac9-a9f0-ca811560c63a for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 01:57:11.542419 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.546053 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.546053 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb10c43a-9d, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:11.546053 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdb10c43a-9d, col_values=(('qos', UUID('351e33bc-ddfd-4ed4-8227-b90ff88131d9')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:11.546280 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdb10c43a-9d, col_values=(('external_ids', {'iface-id': 'db10c43a-9d2b-4250-83b6-0ca8ced88657', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:02:b1', 'vm-uuid': '58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:11.547151 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.549322 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:57:11.574322 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.575220 np0000001127 nova-compute[98206]: INFO os_vif [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:02:b1,bridge_name='br-int',has_traffic_filtering=True,id=db10c43a-9d2b-4250-83b6-0ca8ced88657,network=Network(dbb55b2c-d3ef-4540-90e5-c3bb021515d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdb10c43a-9d')
May 21 01:57:11.576094 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1881553016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-1881553016',id=8,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBhaMEk9DiH2Bx5NNy3a3Zcjn51ZPUcBOQR2tG9r9zsoi7BbVdTpWoBYnD1pSE/ZUlPcBmm+IYQRAksBakKITqSdzVcswYCcllJKJ4mjJEDrm/7oZYVwTy+GTcc+FpFXw==',key_name='tempest-keypair-947972251',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d16c5939e8b346a8a2da89fb19b2a812',ramdisk_id='',reservation_id='r-kje4iw6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1353067880',owner_user_name='tempest-TaggedBootDevicesTest-1353067880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:56:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06d28d9bc06a4a27bcba288eb5a07e0c',uuid=58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d807c564-314d-4f8e-8984-8068d59d3538", "address": "fa:16:3e:df:4a:48", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd807c564-31", "ovs_interfaceid": "d807c564-314d-4f8e-8984-8068d59d3538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 01:57:11.576450 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converting VIF {"id": "d807c564-314d-4f8e-8984-8068d59d3538", "address": "fa:16:3e:df:4a:48", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd807c564-31", "ovs_interfaceid": "d807c564-314d-4f8e-8984-8068d59d3538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:57:11.577031 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:4a:48,bridge_name='br-int',has_traffic_filtering=True,id=d807c564-314d-4f8e-8984-8068d59d3538,network=Network(dbb55b2c-d3ef-4540-90e5-c3bb021515d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd807c564-31') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:57:11.577322 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:4a:48,bridge_name='br-int',has_traffic_filtering=True,id=d807c564-314d-4f8e-8984-8068d59d3538,network=Network(dbb55b2c-d3ef-4540-90e5-c3bb021515d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd807c564-31') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 01:57:11.577560 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.577743 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:11.577880 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 01:57:11.579559 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.579724 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '37e902a8-c93a-58dc-8d86-4bec51c63371', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:11.580557 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.581194 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:57:11.584733 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-879acd0b-9e41-48ff-bb90-4e52daf9ed44 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Releasing lock "refresh_cache-0059a43c-1d34-40a9-af63-b5eca8c30f53" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:57:11.585651 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-879acd0b-9e41-48ff-bb90-4e52daf9ed44 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:11.585967 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-879acd0b-9e41-48ff-bb90-4e52daf9ed44 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:11.602092 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 01:57:11.614438 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.617506 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.617794 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd807c564-31, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:11.618244 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd807c564-31, col_values=(('qos', UUID('9120f104-1184-4396-932d-1ba4c84ebc68')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:11.618422 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd807c564-31, col_values=(('external_ids', {'iface-id': 'd807c564-314d-4f8e-8984-8068d59d3538', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:4a:48', 'vm-uuid': '58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:11.620524 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.622502 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:57:11.652160 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Instance destroyed successfully.
May 21 01:57:11.652606 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-7e305753-a759-41ae-9bdf-8c65f9d91f56 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Lazy-loading 'resources' on Instance uuid cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:57:11.675325 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.676337 np0000001127 nova-compute[98206]: INFO os_vif [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:4a:48,bridge_name='br-int',has_traffic_filtering=True,id=d807c564-314d-4f8e-8984-8068d59d3538,network=Network(dbb55b2c-d3ef-4540-90e5-c3bb021515d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd807c564-31')
May 21 01:57:11.676992 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1881553016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-1881553016',id=8,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBhaMEk9DiH2Bx5NNy3a3Zcjn51ZPUcBOQR2tG9r9zsoi7BbVdTpWoBYnD1pSE/ZUlPcBmm+IYQRAksBakKITqSdzVcswYCcllJKJ4mjJEDrm/7oZYVwTy+GTcc+FpFXw==',key_name='tempest-keypair-947972251',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d16c5939e8b346a8a2da89fb19b2a812',ramdisk_id='',reservation_id='r-kje4iw6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1353067880',owner_user_name='tempest-TaggedBootDevicesTest-1353067880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:56:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06d28d9bc06a4a27bcba288eb5a07e0c',uuid=58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d03a47d5-bec7-4099-96e0-c102edfe9e8e", "address": "fa:16:3e:70:5b:80", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03a47d5-be", "ovs_interfaceid": "d03a47d5-bec7-4099-96e0-c102edfe9e8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 01:57:11.677195 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converting VIF {"id": "d03a47d5-bec7-4099-96e0-c102edfe9e8e", "address": "fa:16:3e:70:5b:80", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03a47d5-be", "ovs_interfaceid": "d03a47d5-bec7-4099-96e0-c102edfe9e8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:57:11.677637 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:5b:80,bridge_name='br-int',has_traffic_filtering=True,id=d03a47d5-bec7-4099-96e0-c102edfe9e8e,network=Network(dbb55b2c-d3ef-4540-90e5-c3bb021515d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd03a47d5-be') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:57:11.677869 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:5b:80,bridge_name='br-int',has_traffic_filtering=True,id=d03a47d5-bec7-4099-96e0-c102edfe9e8e,network=Network(dbb55b2c-d3ef-4540-90e5-c3bb021515d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd03a47d5-be') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 01:57:11.678094 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.678277 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:11.678408 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 01:57:11.679217 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.679401 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e205d28d-2e8a-5bc8-a254-1303b2b7a4d8', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:11.680556 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.680818 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:57:11.717679 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.722174 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.722427 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd03a47d5-be, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:11.722960 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd03a47d5-be, col_values=(('qos', UUID('13140cd6-86d6-4195-9f05-517c622969bc')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:11.723151 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd03a47d5-be, col_values=(('external_ids', {'iface-id': 'd03a47d5-bec7-4099-96e0-c102edfe9e8e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:5b:80', 'vm-uuid': '58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:11.724131 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.725726 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:57:11.757252 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.758210 np0000001127 nova-compute[98206]: INFO os_vif [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:5b:80,bridge_name='br-int',has_traffic_filtering=True,id=d03a47d5-bec7-4099-96e0-c102edfe9e8e,network=Network(dbb55b2c-d3ef-4540-90e5-c3bb021515d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd03a47d5-be')
May 21 01:57:11.758750 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1881553016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-1881553016',id=8,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBhaMEk9DiH2Bx5NNy3a3Zcjn51ZPUcBOQR2tG9r9zsoi7BbVdTpWoBYnD1pSE/ZUlPcBmm+IYQRAksBakKITqSdzVcswYCcllJKJ4mjJEDrm/7oZYVwTy+GTcc+FpFXw==',key_name='tempest-keypair-947972251',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d16c5939e8b346a8a2da89fb19b2a812',ramdisk_id='',reservation_id='r-kje4iw6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1353067880',owner_user_name='tempest-TaggedBootDevicesTest-1353067880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:56:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06d28d9bc06a4a27bcba288eb5a07e0c',uuid=58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14e48bfc-fab0-433c-b291-0e75e2da496c", "address": "fa:16:3e:e5:ea:60", "network": {"id": "7b5c3ed1-837f-404f-9062-8babcc21dfd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-715008204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e48bfc-fa", "ovs_interfaceid": "14e48bfc-fab0-433c-b291-0e75e2da496c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 01:57:11.758913 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converting VIF {"id": "14e48bfc-fab0-433c-b291-0e75e2da496c", "address": "fa:16:3e:e5:ea:60", "network": {"id": "7b5c3ed1-837f-404f-9062-8babcc21dfd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-715008204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e48bfc-fa", "ovs_interfaceid": "14e48bfc-fab0-433c-b291-0e75e2da496c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:57:11.759352 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:ea:60,bridge_name='br-int',has_traffic_filtering=True,id=14e48bfc-fab0-433c-b291-0e75e2da496c,network=Network(7b5c3ed1-837f-404f-9062-8babcc21dfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14e48bfc-fa') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:57:11.759557 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:ea:60,bridge_name='br-int',has_traffic_filtering=True,id=14e48bfc-fab0-433c-b291-0e75e2da496c,network=Network(7b5c3ed1-837f-404f-9062-8babcc21dfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14e48bfc-fa') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 01:57:11.759767 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.759976 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:11.760189 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 01:57:11.762410 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.762583 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7cc6033a-3e1a-58fb-8569-150232b6d210', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:11.763243 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.763810 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:57:11.799013 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:57:11.800663 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.802084 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:57:11.808374 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.809437 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap14e48bfc-fa, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:11.809437 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap14e48bfc-fa, col_values=(('qos', UUID('5ba0c65f-b17c-41c3-81eb-2c81fe6ea7a8')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:11.809437 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap14e48bfc-fa, col_values=(('external_ids', {'iface-id': '14e48bfc-fab0-433c-b291-0e75e2da496c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:ea:60', 'vm-uuid': '58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:11.812136 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.812136 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:57:11.858077 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.862031 np0000001127 nova-compute[98206]: INFO os_vif [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:ea:60,bridge_name='br-int',has_traffic_filtering=True,id=14e48bfc-fab0-433c-b291-0e75e2da496c,network=Network(7b5c3ed1-837f-404f-9062-8babcc21dfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14e48bfc-fa')
May 21 01:57:11.862822 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1881553016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-1881553016',id=8,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBhaMEk9DiH2Bx5NNy3a3Zcjn51ZPUcBOQR2tG9r9zsoi7BbVdTpWoBYnD1pSE/ZUlPcBmm+IYQRAksBakKITqSdzVcswYCcllJKJ4mjJEDrm/7oZYVwTy+GTcc+FpFXw==',key_name='tempest-keypair-947972251',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d16c5939e8b346a8a2da89fb19b2a812',ramdisk_id='',reservation_id='r-kje4iw6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1353067880',owner_user_name='tempest-TaggedBootDevicesTest-1353067880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:56:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06d28d9bc06a4a27bcba288eb5a07e0c',uuid=58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93b6a994-3c94-45b3-be4c-d63ce41a8557", "address": "fa:16:3e:56:b9:59", "network": {"id": "7b5c3ed1-837f-404f-9062-8babcc21dfd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-715008204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93b6a994-3c", "ovs_interfaceid": "93b6a994-3c94-45b3-be4c-d63ce41a8557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 01:57:11.863226 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converting VIF {"id": "93b6a994-3c94-45b3-be4c-d63ce41a8557", "address": "fa:16:3e:56:b9:59", "network": {"id": "7b5c3ed1-837f-404f-9062-8babcc21dfd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-715008204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93b6a994-3c", "ovs_interfaceid": "93b6a994-3c94-45b3-be4c-d63ce41a8557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:57:11.863876 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:b9:59,bridge_name='br-int',has_traffic_filtering=True,id=93b6a994-3c94-45b3-be4c-d63ce41a8557,network=Network(7b5c3ed1-837f-404f-9062-8babcc21dfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93b6a994-3c') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:57:11.863876 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:b9:59,bridge_name='br-int',has_traffic_filtering=True,id=93b6a994-3c94-45b3-be4c-d63ce41a8557,network=Network(7b5c3ed1-837f-404f-9062-8babcc21dfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93b6a994-3c') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 01:57:11.864546 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.864775 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:11.865633 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 01:57:11.869929 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.870611 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '00716dd0-ad71-5278-b17b-3c28e27f2621', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:11.871327 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.872063 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:57:11.886876 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1ce3a974-b2f1-429d-9ddc-dba96e21f4d8 req-5a1467c0-8d02-4e31-b093-1fedc76c4781 service nova] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Received event network-vif-plugged-069db2b1-36ac-43ce-b643-fcdc9ff52141 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:11.891108 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1ce3a974-b2f1-429d-9ddc-dba96e21f4d8 req-5a1467c0-8d02-4e31-b093-1fedc76c4781 service nova] Acquiring lock "6f68556b-0b18-452a-b307-da2dad4ee6ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:11.892292 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1ce3a974-b2f1-429d-9ddc-dba96e21f4d8 req-5a1467c0-8d02-4e31-b093-1fedc76c4781 service nova] Lock "6f68556b-0b18-452a-b307-da2dad4ee6ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:11.892292 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1ce3a974-b2f1-429d-9ddc-dba96e21f4d8 req-5a1467c0-8d02-4e31-b093-1fedc76c4781 service nova] Lock "6f68556b-0b18-452a-b307-da2dad4ee6ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:11.892292 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1ce3a974-b2f1-429d-9ddc-dba96e21f4d8 req-5a1467c0-8d02-4e31-b093-1fedc76c4781 service nova] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Processing event network-vif-plugged-069db2b1-36ac-43ce-b643-fcdc9ff52141 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 01:57:11.892292 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1ce3a974-b2f1-429d-9ddc-dba96e21f4d8 req-5a1467c0-8d02-4e31-b093-1fedc76c4781 service nova] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Received event network-vif-plugged-069db2b1-36ac-43ce-b643-fcdc9ff52141 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:11.892292 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1ce3a974-b2f1-429d-9ddc-dba96e21f4d8 req-5a1467c0-8d02-4e31-b093-1fedc76c4781 service nova] Acquiring lock "6f68556b-0b18-452a-b307-da2dad4ee6ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:11.892595 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1ce3a974-b2f1-429d-9ddc-dba96e21f4d8 req-5a1467c0-8d02-4e31-b093-1fedc76c4781 service nova] Lock "6f68556b-0b18-452a-b307-da2dad4ee6ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:11.892595 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1ce3a974-b2f1-429d-9ddc-dba96e21f4d8 req-5a1467c0-8d02-4e31-b093-1fedc76c4781 service nova] Lock "6f68556b-0b18-452a-b307-da2dad4ee6ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:11.892747 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1ce3a974-b2f1-429d-9ddc-dba96e21f4d8 req-5a1467c0-8d02-4e31-b093-1fedc76c4781 service nova] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] No waiting events found dispatching network-vif-plugged-069db2b1-36ac-43ce-b643-fcdc9ff52141 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:57:11.892962 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-1ce3a974-b2f1-429d-9ddc-dba96e21f4d8 req-5a1467c0-8d02-4e31-b093-1fedc76c4781 service nova] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Received unexpected event network-vif-plugged-069db2b1-36ac-43ce-b643-fcdc9ff52141 for instance with vm_state building and task_state spawning.
May 21 01:57:11.893716 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 01:57:11.904262 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 01:57:11.909408 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Instance spawned successfully.
May 21 01:57:11.911138 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 01:57:11.920590 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.924760 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.925026 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93b6a994-3c, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:11.925456 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap93b6a994-3c, col_values=(('qos', UUID('6e9e5f9d-8d69-4b99-ac75-95f4a7334ae1')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:11.925673 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap93b6a994-3c, col_values=(('external_ids', {'iface-id': '93b6a994-3c94-45b3-be4c-d63ce41a8557', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:b9:59', 'vm-uuid': '58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:11.926617 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.928269 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:57:11.979740 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:11.982173 np0000001127 nova-compute[98206]: INFO os_vif [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:b9:59,bridge_name='br-int',has_traffic_filtering=True,id=93b6a994-3c94-45b3-be4c-d63ce41a8557,network=Network(7b5c3ed1-837f-404f-9062-8babcc21dfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93b6a994-3c')
May 21 01:57:11.991368 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 01:57:11.991819 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db', 'iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e48122c6-4868-472c-a26f-f9f9d0fe32db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:57:11.992043 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:57:12.155348 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-7e305753-a759-41ae-9bdf-8c65f9d91f56 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:55:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-486234569',display_name='tempest-VolumesAssistedSnapshotsTest-server-486234569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumesassistedsnapshotstest-server-486234569',id=6,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMtmJlkhzofbSXWsEHNxPuvNdANVXCTOB5PF9eDpfc0ruM8X0Wm/lEsWnhE+8tHid0hepS7VXnnTdMkhsH8RrJqUGyNDzNytnLvhZ2ORogdCCYGCcCRU2TIXemM3kDSrQ==',key_name='tempest-keypair-509839513',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:56:10Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cad39cb6391143989b2404dc66ddfe0f',ramdisk_id='',reservation_id='r-re8topj0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-721813794',owner_user_name='tempest-VolumesAssistedSnapshotsTest-721813794-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:56:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e8c7a79a5dd43789d70c36281b15410',uuid=cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8899a68b-fb77-4ac9-a9f0-ca811560c63a", "address": "fa:16:3e:a0:e8:cd", "network": {"id": "238a16b8-acf2-4255-ae1c-da1966d4d253", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2105742351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cad39cb6391143989b2404dc66ddfe0f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8899a68b-fb", "ovs_interfaceid": "8899a68b-fb77-4ac9-a9f0-ca811560c63a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 01:57:12.155612 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-7e305753-a759-41ae-9bdf-8c65f9d91f56 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Converting VIF {"id": "8899a68b-fb77-4ac9-a9f0-ca811560c63a", "address": "fa:16:3e:a0:e8:cd", "network": {"id": "238a16b8-acf2-4255-ae1c-da1966d4d253", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2105742351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cad39cb6391143989b2404dc66ddfe0f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8899a68b-fb", "ovs_interfaceid": "8899a68b-fb77-4ac9-a9f0-ca811560c63a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:57:12.156035 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-7e305753-a759-41ae-9bdf-8c65f9d91f56 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:e8:cd,bridge_name='br-int',has_traffic_filtering=True,id=8899a68b-fb77-4ac9-a9f0-ca811560c63a,network=Network(238a16b8-acf2-4255-ae1c-da1966d4d253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8899a68b-fb') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:57:12.156240 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-7e305753-a759-41ae-9bdf-8c65f9d91f56 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:e8:cd,bridge_name='br-int',has_traffic_filtering=True,id=8899a68b-fb77-4ac9-a9f0-ca811560c63a,network=Network(238a16b8-acf2-4255-ae1c-da1966d4d253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8899a68b-fb') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 01:57:12.158526 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:12.158526 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8899a68b-fb, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:12.159171 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:12.160641 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:57:12.203427 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:12.207296 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:12.207458 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fa8e8803-d0ef-4838-b1ff-5e949750984e) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:12.208023 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:12.208526 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:57:12.211188 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Instance destroyed successfully.
May 21 01:57:12.211719 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-879acd0b-9e41-48ff-bb90-4e52daf9ed44 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lazy-loading 'resources' on Instance uuid 0059a43c-1d34-40a9-af63-b5eca8c30f53 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:57:12.249200 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:12.251066 np0000001127 nova-compute[98206]: INFO os_vif [None req-7e305753-a759-41ae-9bdf-8c65f9d91f56 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:e8:cd,bridge_name='br-int',has_traffic_filtering=True,id=8899a68b-fb77-4ac9-a9f0-ca811560c63a,network=Network(238a16b8-acf2-4255-ae1c-da1966d4d253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8899a68b-fb')
May 21 01:57:12.251367 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-7e305753-a759-41ae-9bdf-8c65f9d91f56 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Deleting instance files /opt/stack/data/nova/instances/cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6_del
May 21 01:57:12.252279 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-7e305753-a759-41ae-9bdf-8c65f9d91f56 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Deletion of /opt/stack/data/nova/instances/cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6_del complete
May 21 01:57:12.305374 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 01:57:12.306133 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999720281999998 future=<Future at 0x71c07c5118e0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:57:12.306589 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328632.3063369, 6f68556b-0b18-452a-b307-da2dad4ee6ab => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:57:12.307256 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] VM Resumed (Lifecycle Event)
May 21 01:57:12.415925 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:57:12.416357 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:57:12.416953 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:57:12.418460 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:57:12.418460 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:57:12.418460 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:57:12.625192 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Found WWN 330000000040cf936 for multipath device dm-4 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 01:57:12.625192 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.044s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:57:12.625192 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] <== connect_volume: return (2044ms) {'type': 'block', 'scsi_wwn': '330000000040cf936', 'path': '/dev/dm-4', 'multipath_id': '330000000040cf936'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:57:12.625192 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000040cf936', 'path': '/dev/dm-4', 'multipath_id': '330000000040cf936'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 01:57:12.625623 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.633s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:57:12.625866 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db', 'iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e48122c6-4868-472c-a26f-f9f9d0fe32db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 01:57:12.630393 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lazy-loading 'flavor' on Instance uuid ecf25bc4-b32d-4627-9571-f98869b227f9 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:57:12.648424 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:57:12.648892 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:57:12.649165 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:57:12.652175 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:57:12.656919 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:57:12.656919 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:57:12.664800 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 01:57:12.664800 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:12.672510 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 01:57:12.672510 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:12.682174 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db] added
May 21 01:57:12.682174 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 01:57:12.682174 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:57:12.682174 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:57:12.682174 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:57:12.682174 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:57:12.682174 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:12.682515 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 01:57:12.682603 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0334(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 01:57:12.682817 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 01:57:12.692298 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db] added
May 21 01:57:12.692298 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 01:57:12.692298 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:57:12.692298 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:57:12.692298 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:57:12.692298 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:57:12.692298 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:12.692597 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 01:57:12.692691 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0371(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 01:57:12.692841 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 01:57:12.713679 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-879acd0b-9e41-48ff-bb90-4e52daf9ed44 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Object Instance<0059a43c-1d34-40a9-af63-b5eca8c30f53> lazy-loaded attributes: numa_topology,resources {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 01:57:12.715614 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-879acd0b-9e41-48ff-bb90-4e52daf9ed44 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1719541415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumeshelvetestjson-server-1719541415',id=1,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2zmFe4sQuXWXUjhz16/AauWIZ+ngdfS4R0mqQiLGq9SjV71VzozhRC8Z3F1F+0764niXRdGZVFgH+pUevCihuQEDmwwISw1j+rj6qnUSw4ecZaPwrSQfd2Xm4Jics0Vw==',key_name='tempest-keypair-1216999249',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:56:17Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2e41dd931ff049868a61f52a251d1122',ramdisk_id='',reservation_id='r-2une16cp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-826866539',owner_user_name='tempest-AttachVolumeShelveTestJSON-826866539-project-member',shelved_at='2026-05-21T01:57:09.008618',shelved_host='np0000001127',shelved_image_id='98434a6a-bf31-4073-8f3c-10081f1d1f22'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:57:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d91dda570ffb45489f81bd0c87e7fda6',uuid=0059a43c-1d34-40a9-af63-b5eca8c30f53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "address": "fa:16:3e:00:d8:d3", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap839e91da-5f", "ovs_interfaceid": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 01:57:12.717591 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-879acd0b-9e41-48ff-bb90-4e52daf9ed44 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Converting VIF {"id": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "address": "fa:16:3e:00:d8:d3", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap839e91da-5f", "ovs_interfaceid": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:57:12.717591 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-879acd0b-9e41-48ff-bb90-4e52daf9ed44 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:d8:d3,bridge_name='br-int',has_traffic_filtering=True,id=839e91da-5ffe-451b-bd9d-dfc1cf83ab19,network=Network(084a1218-5c9f-4f1e-855b-53d284a5202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839e91da-5f') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:57:12.717591 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-879acd0b-9e41-48ff-bb90-4e52daf9ed44 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:d8:d3,bridge_name='br-int',has_traffic_filtering=True,id=839e91da-5ffe-451b-bd9d-dfc1cf83ab19,network=Network(084a1218-5c9f-4f1e-855b-53d284a5202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839e91da-5f') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 01:57:12.717822 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:12.718008 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap839e91da-5f, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:12.719434 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:12.720530 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:57:12.754461 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:12.755876 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:12.756179 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ccbdadca-00d0-4b12-94e7-b65fc2323464) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:12.756817 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:12.757485 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:57:12.760541 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-7e305753-a759-41ae-9bdf-8c65f9d91f56 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Took 1.47 seconds to destroy the instance on the hypervisor.
May 21 01:57:12.761770 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-7e305753-a759-41ae-9bdf-8c65f9d91f56 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 01:57:12.761929 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 01:57:12.762059 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 01:57:12.762256 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:12.790278 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:12.794436 np0000001127 nova-compute[98206]: INFO os_vif [None req-879acd0b-9e41-48ff-bb90-4e52daf9ed44 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:d8:d3,bridge_name='br-int',has_traffic_filtering=True,id=839e91da-5ffe-451b-bd9d-dfc1cf83ab19,network=Network(084a1218-5c9f-4f1e-855b-53d284a5202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839e91da-5f')
May 21 01:57:12.794707 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-879acd0b-9e41-48ff-bb90-4e52daf9ed44 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Deleting instance files /opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53_del
May 21 01:57:12.799771 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-879acd0b-9e41-48ff-bb90-4e52daf9ed44 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Deletion of /opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53_del complete
May 21 01:57:12.809401 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:57:12.811169 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:57:12.882832 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:12.923452 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Took 7.59 seconds to spawn the instance on the hypervisor.
May 21 01:57:12.925410 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:57:13.132875 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Attempting to attach volume b72d4732-cbb9-491f-8683-d0155023a91f with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 01:57:13.133679 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] attach device xml: <disk type="block" device="disk">
May 21 01:57:13.133679 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:57:13.133679 np0000001127 nova-compute[98206]:   <alias name="ua-b72d4732-cbb9-491f-8683-d0155023a91f"/>
May 21 01:57:13.133679 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-4"/>
May 21 01:57:13.133679 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 01:57:13.133679 np0000001127 nova-compute[98206]:   <serial>b72d4732-cbb9-491f-8683-d0155023a91f</serial>
May 21 01:57:13.133679 np0000001127 nova-compute[98206]:   <shareable/>
May 21 01:57:13.133679 np0000001127 nova-compute[98206]: </disk>
May 21 01:57:13.133679 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 01:57:13.314419 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 01:57:13.408766 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-879acd0b-9e41-48ff-bb90-4e52daf9ed44 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Deleted allocations for instance 0059a43c-1d34-40a9-af63-b5eca8c30f53
May 21 01:57:13.438083 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Took 13.46 seconds to build instance.
May 21 01:57:13.509389 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:57:13.510185 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:57:13.510185 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] No VIF found with MAC fa:16:3e:fd:1e:9d, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 01:57:13.510773 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] No VIF found with MAC fa:16:3e:70:5b:80, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 01:57:13.511231 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Using config drive
May 21 01:57:13.582666 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a4f15c10-14c8-4e6c-bed2-f139d937f483 req-6a780789-1501-4eac-ac7c-44cc4194229c service nova] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Received event network-vif-deleted-8899a68b-fb77-4ac9-a9f0-ca811560c63a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:13.583569 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-a4f15c10-14c8-4e6c-bed2-f139d937f483 req-6a780789-1501-4eac-ac7c-44cc4194229c service nova] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Neutron deleted interface 8899a68b-fb77-4ac9-a9f0-ca811560c63a; detaching it from the instance and deleting it from the info cache
May 21 01:57:13.583905 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-a4f15c10-14c8-4e6c-bed2-f139d937f483 req-6a780789-1501-4eac-ac7c-44cc4194229c service nova] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:57:13.617352 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-777b8ae7-ec8c-4bfd-8459-420074b2b822 req-b17e0898-61a2-4baa-ade8-a1742902307a service nova] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Received event network-vif-unplugged-8899a68b-fb77-4ac9-a9f0-ca811560c63a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:13.618054 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-777b8ae7-ec8c-4bfd-8459-420074b2b822 req-b17e0898-61a2-4baa-ade8-a1742902307a service nova] Acquiring lock "cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:13.619002 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-777b8ae7-ec8c-4bfd-8459-420074b2b822 req-b17e0898-61a2-4baa-ade8-a1742902307a service nova] Lock "cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:13.619002 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-777b8ae7-ec8c-4bfd-8459-420074b2b822 req-b17e0898-61a2-4baa-ade8-a1742902307a service nova] Lock "cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:13.619102 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-777b8ae7-ec8c-4bfd-8459-420074b2b822 req-b17e0898-61a2-4baa-ade8-a1742902307a service nova] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] No waiting events found dispatching network-vif-unplugged-8899a68b-fb77-4ac9-a9f0-ca811560c63a {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:57:13.619497 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-777b8ae7-ec8c-4bfd-8459-420074b2b822 req-b17e0898-61a2-4baa-ade8-a1742902307a service nova] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Received event network-vif-unplugged-8899a68b-fb77-4ac9-a9f0-ca811560c63a for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 01:57:13.619688 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-777b8ae7-ec8c-4bfd-8459-420074b2b822 req-b17e0898-61a2-4baa-ade8-a1742902307a service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Received event network-changed-839e91da-5ffe-451b-bd9d-dfc1cf83ab19 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:13.619830 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-777b8ae7-ec8c-4bfd-8459-420074b2b822 req-b17e0898-61a2-4baa-ade8-a1742902307a service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Refreshing instance network info cache due to event network-changed-839e91da-5ffe-451b-bd9d-dfc1cf83ab19. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:57:13.620318 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-777b8ae7-ec8c-4bfd-8459-420074b2b822 req-b17e0898-61a2-4baa-ade8-a1742902307a service nova] Acquiring lock "refresh_cache-0059a43c-1d34-40a9-af63-b5eca8c30f53" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:57:13.620455 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-777b8ae7-ec8c-4bfd-8459-420074b2b822 req-b17e0898-61a2-4baa-ade8-a1742902307a service nova] Acquired lock "refresh_cache-0059a43c-1d34-40a9-af63-b5eca8c30f53" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:57:13.620680 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-777b8ae7-ec8c-4bfd-8459-420074b2b822 req-b17e0898-61a2-4baa-ade8-a1742902307a service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Refreshing network info cache for port 839e91da-5ffe-451b-bd9d-dfc1cf83ab19 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:57:13.683355 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:57:13.693321 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.startup = manual
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:57:13.700698 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:57:13.700698 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.startup = manual
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:57:13.712027 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:57:13.712027 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:13.719362 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:13.727901 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:13.741904 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:13.741904 np0000001127 nova-compute[98206]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:13.741904 np0000001127 nova-compute[98206]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:13.741904 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:13.741904 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:13.741904 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:13.741904 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:13.741904 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:13.741904 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:57:13.742290 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:13.742290 np0000001127 nova-compute[98206]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:13.742290 np0000001127 nova-compute[98206]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:13.742290 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:13.742290 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:13.742290 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:13.742290 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:13.742290 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:13.742290 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:57:13.750610 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:13.750610 np0000001127 nova-compute[98206]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:13.750610 np0000001127 nova-compute[98206]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:13.750610 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:13.750610 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:13.750610 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:13.750610 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:13.750610 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:13.750610 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:57:13.750957 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:13.750957 np0000001127 nova-compute[98206]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:13.750957 np0000001127 nova-compute[98206]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:13.750957 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:13.750957 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:13.750957 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:13.750957 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:13.750957 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:13.750957 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:57:13.793508 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db, portal: 192.168.40.100,3260]
May 21 01:57:13.793508 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db, portal: 192.168.40.100,3260] successful.
May 21 01:57:13.793508 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:13.805242 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db, portal: 192.168.50.100,3260]
May 21 01:57:13.805242 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db, portal: 192.168.50.100,3260] successful.
May 21 01:57:13.805242 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:13.808336 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:13.823458 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:13.839783 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:13.839783 np0000001127 nova-compute[98206]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:13.839783 np0000001127 nova-compute[98206]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:13.839783 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:13.839783 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:13.839783 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:13.839783 np0000001127 nova-compute[98206]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db (non-flash)
May 21 01:57:13.839783 np0000001127 nova-compute[98206]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db (non-flash)
May 21 01:57:13.839783 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:13.839783 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:13.839783 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:57:13.840362 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:13.840362 np0000001127 nova-compute[98206]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:13.840362 np0000001127 nova-compute[98206]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:13.840362 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:13.840362 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:13.840362 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:13.840362 np0000001127 nova-compute[98206]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db (non-flash)
May 21 01:57:13.840362 np0000001127 nova-compute[98206]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db (non-flash)
May 21 01:57:13.840362 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:13.840362 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:13.840362 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:57:13.840362 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.191s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:57:13.840362 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:57:13.841287 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] HCTL ('15', '-', '-', 0) found on session 16 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:57:13.841400 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:57:13.846752 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:13.846752 np0000001127 nova-compute[98206]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:13.846752 np0000001127 nova-compute[98206]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:13.846752 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:13.846752 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:13.846752 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:13.846752 np0000001127 nova-compute[98206]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db (non-flash)
May 21 01:57:13.846752 np0000001127 nova-compute[98206]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db (non-flash)
May 21 01:57:13.846752 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:13.846752 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:13.846752 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:57:13.846752 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:13.846752 np0000001127 nova-compute[98206]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:13.846752 np0000001127 nova-compute[98206]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:13.846752 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:13.846752 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:13.846752 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:13.846752 np0000001127 nova-compute[98206]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db (non-flash)
May 21 01:57:13.846752 np0000001127 nova-compute[98206]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db (non-flash)
May 21 01:57:13.846752 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:13.846752 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:13.846752 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:57:13.846752 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.191s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:57:13.847576 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:57:13.847979 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] HCTL ('16', '-', '-', 0) found on session 17 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:57:13.848109 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:57:13.859253 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Searching for a device in session 16 and hctl ['15', '*', '*', 0] yield: None {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:57:13.868268 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Searching for a device in session 17 and hctl ['16', '*', '*', 0] yield: None {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:57:13.918960 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-879acd0b-9e41-48ff-bb90-4e52daf9ed44 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:13.919495 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-879acd0b-9e41-48ff-bb90-4e52daf9ed44 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:13.945305 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "6f68556b-0b18-452a-b307-da2dad4ee6ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.970s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:14.002973 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:57:14.022013 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:14.087639 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a4f15c10-14c8-4e6c-bed2-f139d937f483 req-6a780789-1501-4eac-ac7c-44cc4194229c service nova] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Detach interface failed, port_id=8899a68b-fb77-4ac9-a9f0-ca811560c63a, reason: Instance cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 01:57:14.124912 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-777b8ae7-ec8c-4bfd-8459-420074b2b822 req-b17e0898-61a2-4baa-ade8-a1742902307a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:14.266760 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Creating config drive at /opt/stack/data/nova/instances/58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8/disk.config
May 21 01:57:14.272110 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8llg0v58 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:14.324547 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8llg0v58" returned: 0 in 0.052s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:14.505688 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Took 1.74 seconds to deallocate network for instance.
May 21 01:57:14.602298 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-879acd0b-9e41-48ff-bb90-4e52daf9ed44 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:57:14.602598 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-879acd0b-9e41-48ff-bb90-4e52daf9ed44 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:57:14.651926 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-777b8ae7-ec8c-4bfd-8459-420074b2b822 req-b17e0898-61a2-4baa-ade8-a1742902307a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:14.827439 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-777b8ae7-ec8c-4bfd-8459-420074b2b822 req-b17e0898-61a2-4baa-ade8-a1742902307a service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Updated VIF entry in instance network info cache for port 839e91da-5ffe-451b-bd9d-dfc1cf83ab19. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 01:57:14.828609 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-777b8ae7-ec8c-4bfd-8459-420074b2b822 req-b17e0898-61a2-4baa-ade8-a1742902307a service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Updating instance_info_cache with network_info: [{"id": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "address": "fa:16:3e:00:d8:d3", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap839e91da-5f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:57:14.831882 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:57:14.831882 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:57:14.831882 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:57:14.831882 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] No VIF found with MAC fa:16:3e:4a:37:e3, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 01:57:14.860600 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Searching for a device in session 16 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:57:14.860600 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e48122c6-4868-472c-a26f-f9f9d0fe32db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:57:14.870408 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Searching for a device in session 17 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:57:14.870408 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e48122c6-4868-472c-a26f-f9f9d0fe32db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:57:14.927026 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:14.997604 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:15.001360 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:15.021608 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7e305753-a759-41ae-9bdf-8c65f9d91f56 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:15.082376 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:15.083432 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:15.106588 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-879acd0b-9e41-48ff-bb90-4e52daf9ed44 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:57:15.197439 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:15.230994 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:15.235335 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:15.253035 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:15.257902 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:15.335115 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-777b8ae7-ec8c-4bfd-8459-420074b2b822 req-b17e0898-61a2-4baa-ade8-a1742902307a service nova] Releasing lock "refresh_cache-0059a43c-1d34-40a9-af63-b5eca8c30f53" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:57:15.347007 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:15.368352 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:15.386737 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:15.417964 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:15.438751 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:15.445327 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:15.480296 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:15.496981 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:15.534682 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:15.618679 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:15.622058 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-879acd0b-9e41-48ff-bb90-4e52daf9ed44 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.703s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:15.626511 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7e305753-a759-41ae-9bdf-8c65f9d91f56 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.604s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:15.658940 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 01:57:15.699613 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:15.708291 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6ecf32fc-325c-46b2-8844-ba661cc04a0d req-b5c5686b-a0ae-477e-a5b6-030517ccc980 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-plugged-319abe1b-caf8-4fa7-bc6c-caa7e755860b {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:15.708888 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6ecf32fc-325c-46b2-8844-ba661cc04a0d req-b5c5686b-a0ae-477e-a5b6-030517ccc980 service nova] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:15.709680 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6ecf32fc-325c-46b2-8844-ba661cc04a0d req-b5c5686b-a0ae-477e-a5b6-030517ccc980 service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:15.710132 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6ecf32fc-325c-46b2-8844-ba661cc04a0d req-b5c5686b-a0ae-477e-a5b6-030517ccc980 service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:15.710336 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6ecf32fc-325c-46b2-8844-ba661cc04a0d req-b5c5686b-a0ae-477e-a5b6-030517ccc980 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Processing event network-vif-plugged-319abe1b-caf8-4fa7-bc6c-caa7e755860b {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 01:57:15.819440 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c201d43a-78e5-4e11-9b23-cf4f43e5ae0c req-a369283d-c673-4780-ab78-f1bf9214ac28 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-plugged-ebf91ac5-9634-4897-a1bb-7336846be7cb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:15.821027 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c201d43a-78e5-4e11-9b23-cf4f43e5ae0c req-a369283d-c673-4780-ab78-f1bf9214ac28 service nova] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:15.821027 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c201d43a-78e5-4e11-9b23-cf4f43e5ae0c req-a369283d-c673-4780-ab78-f1bf9214ac28 service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:15.821595 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c201d43a-78e5-4e11-9b23-cf4f43e5ae0c req-a369283d-c673-4780-ab78-f1bf9214ac28 service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:15.821595 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c201d43a-78e5-4e11-9b23-cf4f43e5ae0c req-a369283d-c673-4780-ab78-f1bf9214ac28 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Processing event network-vif-plugged-ebf91ac5-9634-4897-a1bb-7336846be7cb {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 01:57:15.830897 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-dc92cfa0-884a-435f-a5ba-1e5220ec82e7 req-a04bb4d3-4aaa-4739-a008-cd96e5cbec8a service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-plugged-d807c564-314d-4f8e-8984-8068d59d3538 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:15.831090 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-dc92cfa0-884a-435f-a5ba-1e5220ec82e7 req-a04bb4d3-4aaa-4739-a008-cd96e5cbec8a service nova] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:15.831090 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-dc92cfa0-884a-435f-a5ba-1e5220ec82e7 req-a04bb4d3-4aaa-4739-a008-cd96e5cbec8a service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:15.831318 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-dc92cfa0-884a-435f-a5ba-1e5220ec82e7 req-a04bb4d3-4aaa-4739-a008-cd96e5cbec8a service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:15.831456 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-dc92cfa0-884a-435f-a5ba-1e5220ec82e7 req-a04bb4d3-4aaa-4739-a008-cd96e5cbec8a service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Processing event network-vif-plugged-d807c564-314d-4f8e-8984-8068d59d3538 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 01:57:15.864801 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:15.894984 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:16.003145 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:16.075493 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:16.133620 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-879acd0b-9e41-48ff-bb90-4e52daf9ed44 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "0059a43c-1d34-40a9-af63-b5eca8c30f53" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 14.738s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:16.138427 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:16.140911 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:16.172063 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:16.300232 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7e305753-a759-41ae-9bdf-8c65f9d91f56 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:57:16.300484 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-7e305753-a759-41ae-9bdf-8c65f9d91f56 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:57:16.457735 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-55e9a86a-12e4-4b76-bb9f-e5df77496f95 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "ecf25bc4-b32d-4627-9571-f98869b227f9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.590s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:16.473408 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:16.475065 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:16.654504 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:16.655777 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:16.689619 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Found WWN 3300000006ae84fda for multipath device dm-6 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 01:57:16.690076 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.065s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:57:16.690276 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] <== connect_volume: return (4698ms) {'type': 'block', 'scsi_wwn': '3300000006ae84fda', 'path': '/dev/dm-6', 'multipath_id': '3300000006ae84fda'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:57:16.690478 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006ae84fda', 'path': '/dev/dm-6', 'multipath_id': '3300000006ae84fda'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 01:57:16.697621 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lazy-loading 'flavor' on Instance uuid 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:57:16.803684 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-7e305753-a759-41ae-9bdf-8c65f9d91f56 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:57:16.822340 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:16.904852 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "0059a43c-1d34-40a9-af63-b5eca8c30f53" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:16.905222 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "0059a43c-1d34-40a9-af63-b5eca8c30f53" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:16.905222 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Unshelving
May 21 01:57:16.959622 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328636.959173, 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:57:16.959767 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] VM Started (Lifecycle Event)
May 21 01:57:17.155193 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:17.160095 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:17.164018 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:17.186068 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:17.202284 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Attempting to attach volume e48122c6-4868-472c-a26f-f9f9d0fe32db with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 01:57:17.206132 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] attach device xml: <disk type="block" device="disk">
May 21 01:57:17.206132 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:57:17.206132 np0000001127 nova-compute[98206]:   <alias name="ua-e48122c6-4868-472c-a26f-f9f9d0fe32db"/>
May 21 01:57:17.206132 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-6"/>
May 21 01:57:17.206132 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 01:57:17.206132 np0000001127 nova-compute[98206]:   <serial>e48122c6-4868-472c-a26f-f9f9d0fe32db</serial>
May 21 01:57:17.206132 np0000001127 nova-compute[98206]: </disk>
May 21 01:57:17.206132 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 01:57:17.314325 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7e305753-a759-41ae-9bdf-8c65f9d91f56 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.687s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:17.394418 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-7e305753-a759-41ae-9bdf-8c65f9d91f56 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Deleted allocations for instance cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6
May 21 01:57:17.444551 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:17.463668 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:57:17.465308 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328637.4650822, 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:57:17.465514 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] VM Paused (Lifecycle Event)
May 21 01:57:17.616299 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-91b40c89-f90e-44b5-83d4-496ef99e48cf tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Acquiring lock "ecf25bc4-b32d-4627-9571-f98869b227f9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:17.616299 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-91b40c89-f90e-44b5-83d4-496ef99e48cf tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "ecf25bc4-b32d-4627-9571-f98869b227f9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:17.739670 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0005549640000026557 future=<Future at 0x71c07c5d4dd0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:57:17.739815 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:57:17.739956 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=9.565884788000176 future=<Future at 0x71c07c5118e0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:57:17.740113 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=9.565761500000008 future=<Future at 0x71c07c5118e0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:57:17.740691 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Emitting event <LifecycleEvent: 1779328622.7389991, 0059a43c-1d34-40a9-af63-b5eca8c30f53 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:57:17.740881 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] VM Stopped (Lifecycle Event)
May 21 01:57:17.757441 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:17.790929 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1bc087e4-3ce4-4296-b96d-5dc0a410ac18 req-62275103-b367-4003-85b6-f960c74ede64 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-plugged-319abe1b-caf8-4fa7-bc6c-caa7e755860b {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:17.790929 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1bc087e4-3ce4-4296-b96d-5dc0a410ac18 req-62275103-b367-4003-85b6-f960c74ede64 service nova] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:17.790929 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1bc087e4-3ce4-4296-b96d-5dc0a410ac18 req-62275103-b367-4003-85b6-f960c74ede64 service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:17.790929 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1bc087e4-3ce4-4296-b96d-5dc0a410ac18 req-62275103-b367-4003-85b6-f960c74ede64 service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:17.790929 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1bc087e4-3ce4-4296-b96d-5dc0a410ac18 req-62275103-b367-4003-85b6-f960c74ede64 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] No event matching network-vif-plugged-319abe1b-caf8-4fa7-bc6c-caa7e755860b in dict_keys([('network-vif-plugged', 'db10c43a-9d2b-4250-83b6-0ca8ced88657'), ('network-vif-plugged', 'd03a47d5-bec7-4099-96e0-c102edfe9e8e'), ('network-vif-plugged', '14e48bfc-fab0-433c-b291-0e75e2da496c'), ('network-vif-plugged', '93b6a994-3c94-45b3-be4c-d63ce41a8557')]) {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 21 01:57:17.790929 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-1bc087e4-3ce4-4296-b96d-5dc0a410ac18 req-62275103-b367-4003-85b6-f960c74ede64 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received unexpected event network-vif-plugged-319abe1b-caf8-4fa7-bc6c-caa7e755860b for instance with vm_state building and task_state spawning.
May 21 01:57:17.790929 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1bc087e4-3ce4-4296-b96d-5dc0a410ac18 req-62275103-b367-4003-85b6-f960c74ede64 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-plugged-db10c43a-9d2b-4250-83b6-0ca8ced88657 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:17.791199 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1bc087e4-3ce4-4296-b96d-5dc0a410ac18 req-62275103-b367-4003-85b6-f960c74ede64 service nova] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:17.791386 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1bc087e4-3ce4-4296-b96d-5dc0a410ac18 req-62275103-b367-4003-85b6-f960c74ede64 service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:17.794184 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1bc087e4-3ce4-4296-b96d-5dc0a410ac18 req-62275103-b367-4003-85b6-f960c74ede64 service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:17.794597 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1bc087e4-3ce4-4296-b96d-5dc0a410ac18 req-62275103-b367-4003-85b6-f960c74ede64 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Processing event network-vif-plugged-db10c43a-9d2b-4250-83b6-0ca8ced88657 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 01:57:17.794759 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1bc087e4-3ce4-4296-b96d-5dc0a410ac18 req-62275103-b367-4003-85b6-f960c74ede64 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-plugged-db10c43a-9d2b-4250-83b6-0ca8ced88657 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:17.794922 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1bc087e4-3ce4-4296-b96d-5dc0a410ac18 req-62275103-b367-4003-85b6-f960c74ede64 service nova] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:17.795079 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1bc087e4-3ce4-4296-b96d-5dc0a410ac18 req-62275103-b367-4003-85b6-f960c74ede64 service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:17.795364 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1bc087e4-3ce4-4296-b96d-5dc0a410ac18 req-62275103-b367-4003-85b6-f960c74ede64 service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:17.795521 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1bc087e4-3ce4-4296-b96d-5dc0a410ac18 req-62275103-b367-4003-85b6-f960c74ede64 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] No event matching network-vif-plugged-db10c43a-9d2b-4250-83b6-0ca8ced88657 in dict_keys([('network-vif-plugged', 'd03a47d5-bec7-4099-96e0-c102edfe9e8e'), ('network-vif-plugged', '14e48bfc-fab0-433c-b291-0e75e2da496c'), ('network-vif-plugged', '93b6a994-3c94-45b3-be4c-d63ce41a8557')]) {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 21 01:57:17.795663 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-1bc087e4-3ce4-4296-b96d-5dc0a410ac18 req-62275103-b367-4003-85b6-f960c74ede64 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received unexpected event network-vif-plugged-db10c43a-9d2b-4250-83b6-0ca8ced88657 for instance with vm_state building and task_state spawning.
May 21 01:57:17.918052 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cc0c04ef-74c3-47db-8a5a-6d5ca46b74de req-f8137307-9fd7-40a2-8a3e-2cc10edfe8ef service nova] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Received event network-changed-069db2b1-36ac-43ce-b643-fcdc9ff52141 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:17.918219 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cc0c04ef-74c3-47db-8a5a-6d5ca46b74de req-f8137307-9fd7-40a2-8a3e-2cc10edfe8ef service nova] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Refreshing instance network info cache due to event network-changed-069db2b1-36ac-43ce-b643-fcdc9ff52141. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:57:17.918411 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cc0c04ef-74c3-47db-8a5a-6d5ca46b74de req-f8137307-9fd7-40a2-8a3e-2cc10edfe8ef service nova] Acquiring lock "refresh_cache-6f68556b-0b18-452a-b307-da2dad4ee6ab" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:57:17.919576 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cc0c04ef-74c3-47db-8a5a-6d5ca46b74de req-f8137307-9fd7-40a2-8a3e-2cc10edfe8ef service nova] Acquired lock "refresh_cache-6f68556b-0b18-452a-b307-da2dad4ee6ab" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:57:17.919744 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-cc0c04ef-74c3-47db-8a5a-6d5ca46b74de req-f8137307-9fd7-40a2-8a3e-2cc10edfe8ef service nova] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Refreshing network info cache for port 069db2b1-36ac-43ce-b643-fcdc9ff52141 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:57:17.931779 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-24c7b239-adda-48ba-a327-0f36b5f07dfe req-a243fc7a-7e50-4400-bfe4-0c73ecb27ca6 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-plugged-d807c564-314d-4f8e-8984-8068d59d3538 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:17.932026 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-24c7b239-adda-48ba-a327-0f36b5f07dfe req-a243fc7a-7e50-4400-bfe4-0c73ecb27ca6 service nova] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:17.932874 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-24c7b239-adda-48ba-a327-0f36b5f07dfe req-a243fc7a-7e50-4400-bfe4-0c73ecb27ca6 service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:17.933076 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-24c7b239-adda-48ba-a327-0f36b5f07dfe req-a243fc7a-7e50-4400-bfe4-0c73ecb27ca6 service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:17.933623 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-24c7b239-adda-48ba-a327-0f36b5f07dfe req-a243fc7a-7e50-4400-bfe4-0c73ecb27ca6 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] No event matching network-vif-plugged-d807c564-314d-4f8e-8984-8068d59d3538 in dict_keys([('network-vif-plugged', 'd03a47d5-bec7-4099-96e0-c102edfe9e8e'), ('network-vif-plugged', '14e48bfc-fab0-433c-b291-0e75e2da496c'), ('network-vif-plugged', '93b6a994-3c94-45b3-be4c-d63ce41a8557')]) {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 21 01:57:17.933771 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-24c7b239-adda-48ba-a327-0f36b5f07dfe req-a243fc7a-7e50-4400-bfe4-0c73ecb27ca6 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received unexpected event network-vif-plugged-d807c564-314d-4f8e-8984-8068d59d3538 for instance with vm_state building and task_state spawning.
May 21 01:57:17.933937 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-24c7b239-adda-48ba-a327-0f36b5f07dfe req-a243fc7a-7e50-4400-bfe4-0c73ecb27ca6 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-plugged-d03a47d5-bec7-4099-96e0-c102edfe9e8e {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:17.934104 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-24c7b239-adda-48ba-a327-0f36b5f07dfe req-a243fc7a-7e50-4400-bfe4-0c73ecb27ca6 service nova] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:17.934307 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-24c7b239-adda-48ba-a327-0f36b5f07dfe req-a243fc7a-7e50-4400-bfe4-0c73ecb27ca6 service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:17.934835 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-24c7b239-adda-48ba-a327-0f36b5f07dfe req-a243fc7a-7e50-4400-bfe4-0c73ecb27ca6 service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:17.934835 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-24c7b239-adda-48ba-a327-0f36b5f07dfe req-a243fc7a-7e50-4400-bfe4-0c73ecb27ca6 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Processing event network-vif-plugged-d03a47d5-bec7-4099-96e0-c102edfe9e8e {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 01:57:17.934835 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-24c7b239-adda-48ba-a327-0f36b5f07dfe req-a243fc7a-7e50-4400-bfe4-0c73ecb27ca6 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-plugged-d03a47d5-bec7-4099-96e0-c102edfe9e8e {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:17.935015 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-24c7b239-adda-48ba-a327-0f36b5f07dfe req-a243fc7a-7e50-4400-bfe4-0c73ecb27ca6 service nova] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:17.935958 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-24c7b239-adda-48ba-a327-0f36b5f07dfe req-a243fc7a-7e50-4400-bfe4-0c73ecb27ca6 service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:17.936310 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-24c7b239-adda-48ba-a327-0f36b5f07dfe req-a243fc7a-7e50-4400-bfe4-0c73ecb27ca6 service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:17.936451 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-24c7b239-adda-48ba-a327-0f36b5f07dfe req-a243fc7a-7e50-4400-bfe4-0c73ecb27ca6 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] No event matching network-vif-plugged-d03a47d5-bec7-4099-96e0-c102edfe9e8e in dict_keys([('network-vif-plugged', '14e48bfc-fab0-433c-b291-0e75e2da496c'), ('network-vif-plugged', '93b6a994-3c94-45b3-be4c-d63ce41a8557')]) {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 21 01:57:17.936640 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-24c7b239-adda-48ba-a327-0f36b5f07dfe req-a243fc7a-7e50-4400-bfe4-0c73ecb27ca6 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received unexpected event network-vif-plugged-d03a47d5-bec7-4099-96e0-c102edfe9e8e for instance with vm_state building and task_state spawning.
May 21 01:57:17.936762 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-24c7b239-adda-48ba-a327-0f36b5f07dfe req-a243fc7a-7e50-4400-bfe4-0c73ecb27ca6 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-plugged-93b6a994-3c94-45b3-be4c-d63ce41a8557 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:17.936946 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-24c7b239-adda-48ba-a327-0f36b5f07dfe req-a243fc7a-7e50-4400-bfe4-0c73ecb27ca6 service nova] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:17.937364 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-24c7b239-adda-48ba-a327-0f36b5f07dfe req-a243fc7a-7e50-4400-bfe4-0c73ecb27ca6 service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:17.937504 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-24c7b239-adda-48ba-a327-0f36b5f07dfe req-a243fc7a-7e50-4400-bfe4-0c73ecb27ca6 service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:17.937637 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-24c7b239-adda-48ba-a327-0f36b5f07dfe req-a243fc7a-7e50-4400-bfe4-0c73ecb27ca6 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Processing event network-vif-plugged-93b6a994-3c94-45b3-be4c-d63ce41a8557 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 01:57:17.938070 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-24c7b239-adda-48ba-a327-0f36b5f07dfe req-a243fc7a-7e50-4400-bfe4-0c73ecb27ca6 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-plugged-93b6a994-3c94-45b3-be4c-d63ce41a8557 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:17.938234 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-24c7b239-adda-48ba-a327-0f36b5f07dfe req-a243fc7a-7e50-4400-bfe4-0c73ecb27ca6 service nova] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:17.938379 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-24c7b239-adda-48ba-a327-0f36b5f07dfe req-a243fc7a-7e50-4400-bfe4-0c73ecb27ca6 service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:17.938518 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-24c7b239-adda-48ba-a327-0f36b5f07dfe req-a243fc7a-7e50-4400-bfe4-0c73ecb27ca6 service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:17.938676 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-24c7b239-adda-48ba-a327-0f36b5f07dfe req-a243fc7a-7e50-4400-bfe4-0c73ecb27ca6 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] No event matching network-vif-plugged-93b6a994-3c94-45b3-be4c-d63ce41a8557 in dict_keys([('network-vif-plugged', '14e48bfc-fab0-433c-b291-0e75e2da496c')]) {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 21 01:57:17.938969 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-24c7b239-adda-48ba-a327-0f36b5f07dfe req-a243fc7a-7e50-4400-bfe4-0c73ecb27ca6 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received unexpected event network-vif-plugged-93b6a994-3c94-45b3-be4c-d63ce41a8557 for instance with vm_state building and task_state spawning.
May 21 01:57:17.967660 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:57:17.969098 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:57:18.117983 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-91b40c89-f90e-44b5-83d4-496ef99e48cf tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Detaching volume b72d4732-cbb9-491f-8683-d0155023a91f
May 21 01:57:18.169011 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-91b40c89-f90e-44b5-83d4-496ef99e48cf tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Attempting to driver detach volume b72d4732-cbb9-491f-8683-d0155023a91f from mountpoint /dev/vdb
May 21 01:57:18.174389 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-91b40c89-f90e-44b5-83d4-496ef99e48cf tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Found disk vdb by alias ua-b72d4732-cbb9-491f-8683-d0155023a91f {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 01:57:18.175554 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-91b40c89-f90e-44b5-83d4-496ef99e48cf tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Found disk vdb by alias ua-b72d4732-cbb9-491f-8683-d0155023a91f {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 01:57:18.175684 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-91b40c89-f90e-44b5-83d4-496ef99e48cf tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Attempting to detach device vdb from instance ecf25bc4-b32d-4627-9571-f98869b227f9 from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 01:57:18.175888 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-91b40c89-f90e-44b5-83d4-496ef99e48cf tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] detach device xml: <disk type="block" device="disk">
May 21 01:57:18.175888 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:57:18.175888 np0000001127 nova-compute[98206]:   <alias name="ua-b72d4732-cbb9-491f-8683-d0155023a91f"/>
May 21 01:57:18.175888 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-4"/>
May 21 01:57:18.175888 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 01:57:18.175888 np0000001127 nova-compute[98206]:   <serial>b72d4732-cbb9-491f-8683-d0155023a91f</serial>
May 21 01:57:18.175888 np0000001127 nova-compute[98206]:   <shareable/>
May 21 01:57:18.175888 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 01:57:18.175888 np0000001127 nova-compute[98206]: </disk>
May 21 01:57:18.175888 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 01:57:18.184292 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-91b40c89-f90e-44b5-83d4-496ef99e48cf tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Successfully detached device vdb from instance ecf25bc4-b32d-4627-9571-f98869b227f9 from the persistent domain config.
May 21 01:57:18.185165 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-91b40c89-f90e-44b5-83d4-496ef99e48cf tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] (1/8): Attempting to detach device vdb with device alias ua-b72d4732-cbb9-491f-8683-d0155023a91f from instance ecf25bc4-b32d-4627-9571-f98869b227f9 from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 01:57:18.185165 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-91b40c89-f90e-44b5-83d4-496ef99e48cf tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] detach device xml: <disk type="block" device="disk">
May 21 01:57:18.185165 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:57:18.185165 np0000001127 nova-compute[98206]:   <alias name="ua-b72d4732-cbb9-491f-8683-d0155023a91f"/>
May 21 01:57:18.185165 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-4"/>
May 21 01:57:18.185165 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 01:57:18.185165 np0000001127 nova-compute[98206]:   <serial>b72d4732-cbb9-491f-8683-d0155023a91f</serial>
May 21 01:57:18.185165 np0000001127 nova-compute[98206]:   <shareable/>
May 21 01:57:18.185165 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 01:57:18.185165 np0000001127 nova-compute[98206]: </disk>
May 21 01:57:18.185165 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 01:57:18.243743 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:57:18.403116 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7e305753-a759-41ae-9bdf-8c65f9d91f56 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Lock "cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.627s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:18.426375 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-cc0c04ef-74c3-47db-8a5a-6d5ca46b74de req-f8137307-9fd7-40a2-8a3e-2cc10edfe8ef service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:18.428975 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Booting with volume ad40663d-967d-4ee3-8017-cb0686601c4d at /dev/vdc
May 21 01:57:18.471283 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 01:57:18.475377 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:57:18.487349 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 01:57:18.514064 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:18.550353 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 01:57:18.552007 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 01:57:18.562390 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 01:57:18.568017 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:feba:8492', 'fe80::405e:62ff:fe28:f67b', 'fe80::fc16:3eff:fe4a:37e3', 'fe80::4822:65ff:fe37:7fac', 'fe80::fc16:3eff:feee:ec8e', 'fe80::fc16:3eff:fe9e:216', 'fe80::14d9:7bff:fe3b:f0dc', 'fe80::fc16:3eff:fe9e:2ac6', 'fe80::c8a3:fcff:fe54:10d6', 'fe80::fc16:3eff:fef6:c7e3', 'fe80::68db:c7ff:fe71:da32', 'fe80::fc16:3eff:fe30:ade5', 'fe80::fc16:3eff:fefd:1e9d', 'fe80::3cf5:efff:fe9b:7732', 'fe80::fc16:3eff:fe10:bc3b', 'fe80::fc16:3eff:fe05:2b1', 'fe80::fc16:3eff:fedf:4a48', 'fe80::fc16:3eff:fe70:5b80', 'fe80::fc16:3eff:fee5:ea60', 'fe80::e477:a1ff:fe9c:52f7', 'fe80::fc16:3eff:fe56:b959', 'fe80::60e1:9aff:fec4:237f'] 
May 21 01:57:18.568157 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 01:57:18.568268 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 01:57:18.569366 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:57:18.570208 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Updating existing volume attachment record: 06557e93-ec04-4049-8332-366e3393b189 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 01:57:18.806073 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779328638.8046672, ecf25bc4-b32d-4627-9571-f98869b227f9 => ua-b72d4732-cbb9-491f-8683-d0155023a91f> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 01:57:18.811523 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-91b40c89-f90e-44b5-83d4-496ef99e48cf tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-b72d4732-cbb9-491f-8683-d0155023a91f for instance ecf25bc4-b32d-4627-9571-f98869b227f9 {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 01:57:18.814838 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-91b40c89-f90e-44b5-83d4-496ef99e48cf tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Successfully detached device vdb from instance ecf25bc4-b32d-4627-9571-f98869b227f9 from the live domain config.
May 21 01:57:18.824949 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-cc0c04ef-74c3-47db-8a5a-6d5ca46b74de req-f8137307-9fd7-40a2-8a3e-2cc10edfe8ef service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:18.869061 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:57:18.869323 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:57:18.869435 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] No VIF found with MAC fa:16:3e:ba:84:92, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 01:57:18.992063 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-cc0c04ef-74c3-47db-8a5a-6d5ca46b74de req-f8137307-9fd7-40a2-8a3e-2cc10edfe8ef service nova] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Updated VIF entry in instance network info cache for port 069db2b1-36ac-43ce-b643-fcdc9ff52141. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 01:57:18.992445 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-cc0c04ef-74c3-47db-8a5a-6d5ca46b74de req-f8137307-9fd7-40a2-8a3e-2cc10edfe8ef service nova] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Updating instance_info_cache with network_info: [{"id": "069db2b1-36ac-43ce-b643-fcdc9ff52141", "address": "fa:16:3e:30:ad:e5", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap069db2b1-36", "ovs_interfaceid": "069db2b1-36ac-43ce-b643-fcdc9ff52141", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:57:19.362919 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-91b40c89-f90e-44b5-83d4-496ef99e48cf tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Detected multiple connections on this host for volume: b72d4732-cbb9-491f-8683-d0155023a91f, skipping target disconnect.
May 21 01:57:19.494671 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cc0c04ef-74c3-47db-8a5a-6d5ca46b74de req-f8137307-9fd7-40a2-8a3e-2cc10edfe8ef service nova] Releasing lock "refresh_cache-6f68556b-0b18-452a-b307-da2dad4ee6ab" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:57:19.494826 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cc0c04ef-74c3-47db-8a5a-6d5ca46b74de req-f8137307-9fd7-40a2-8a3e-2cc10edfe8ef service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-plugged-ebf91ac5-9634-4897-a1bb-7336846be7cb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:19.495075 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cc0c04ef-74c3-47db-8a5a-6d5ca46b74de req-f8137307-9fd7-40a2-8a3e-2cc10edfe8ef service nova] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:19.495227 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cc0c04ef-74c3-47db-8a5a-6d5ca46b74de req-f8137307-9fd7-40a2-8a3e-2cc10edfe8ef service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:19.495227 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cc0c04ef-74c3-47db-8a5a-6d5ca46b74de req-f8137307-9fd7-40a2-8a3e-2cc10edfe8ef service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:19.495362 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cc0c04ef-74c3-47db-8a5a-6d5ca46b74de req-f8137307-9fd7-40a2-8a3e-2cc10edfe8ef service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] No event matching network-vif-plugged-ebf91ac5-9634-4897-a1bb-7336846be7cb in dict_keys([('network-vif-plugged', '14e48bfc-fab0-433c-b291-0e75e2da496c')]) {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 21 01:57:19.495496 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-cc0c04ef-74c3-47db-8a5a-6d5ca46b74de req-f8137307-9fd7-40a2-8a3e-2cc10edfe8ef service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received unexpected event network-vif-plugged-ebf91ac5-9634-4897-a1bb-7336846be7cb for instance with vm_state building and task_state spawning.
May 21 01:57:19.495581 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cc0c04ef-74c3-47db-8a5a-6d5ca46b74de req-f8137307-9fd7-40a2-8a3e-2cc10edfe8ef service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-plugged-14e48bfc-fab0-433c-b291-0e75e2da496c {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:19.495695 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cc0c04ef-74c3-47db-8a5a-6d5ca46b74de req-f8137307-9fd7-40a2-8a3e-2cc10edfe8ef service nova] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:19.495831 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cc0c04ef-74c3-47db-8a5a-6d5ca46b74de req-f8137307-9fd7-40a2-8a3e-2cc10edfe8ef service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:19.495926 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cc0c04ef-74c3-47db-8a5a-6d5ca46b74de req-f8137307-9fd7-40a2-8a3e-2cc10edfe8ef service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:19.496094 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cc0c04ef-74c3-47db-8a5a-6d5ca46b74de req-f8137307-9fd7-40a2-8a3e-2cc10edfe8ef service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Processing event network-vif-plugged-14e48bfc-fab0-433c-b291-0e75e2da496c {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 01:57:19.496169 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cc0c04ef-74c3-47db-8a5a-6d5ca46b74de req-f8137307-9fd7-40a2-8a3e-2cc10edfe8ef service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-plugged-14e48bfc-fab0-433c-b291-0e75e2da496c {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:19.496337 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cc0c04ef-74c3-47db-8a5a-6d5ca46b74de req-f8137307-9fd7-40a2-8a3e-2cc10edfe8ef service nova] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:19.496792 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Instance event wait completed in 2 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 01:57:19.497096 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cc0c04ef-74c3-47db-8a5a-6d5ca46b74de req-f8137307-9fd7-40a2-8a3e-2cc10edfe8ef service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:19.497205 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cc0c04ef-74c3-47db-8a5a-6d5ca46b74de req-f8137307-9fd7-40a2-8a3e-2cc10edfe8ef service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:19.497938 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cc0c04ef-74c3-47db-8a5a-6d5ca46b74de req-f8137307-9fd7-40a2-8a3e-2cc10edfe8ef service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] No waiting events found dispatching network-vif-plugged-14e48bfc-fab0-433c-b291-0e75e2da496c {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:57:19.497938 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-cc0c04ef-74c3-47db-8a5a-6d5ca46b74de req-f8137307-9fd7-40a2-8a3e-2cc10edfe8ef service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received unexpected event network-vif-plugged-14e48bfc-fab0-433c-b291-0e75e2da496c for instance with vm_state building and task_state spawning.
May 21 01:57:19.501305 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328639.500685, 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:57:19.501305 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] VM Resumed (Lifecycle Event)
May 21 01:57:19.502971 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 01:57:19.507994 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Instance spawned successfully.
May 21 01:57:19.507994 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 01:57:19.940637 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-91b40c89-f90e-44b5-83d4-496ef99e48cf tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lazy-loading 'flavor' on Instance uuid ecf25bc4-b32d-4627-9571-f98869b227f9 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:57:20.005672 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:57:20.007181 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:57:20.018965 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:57:20.019127 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:57:20.019446 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:57:20.019756 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:57:20.020045 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:57:20.020326 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:57:20.263397 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:20.263687 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:20.264762 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lazy-loading 'pci_requests' on Instance uuid 0059a43c-1d34-40a9-af63-b5eca8c30f53 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:57:20.448207 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-77fa3f77-07e0-42e0-b1f3-cf24149fe7c2 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.203s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:20.509820 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 01:57:20.531024 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Took 35.48 seconds to spawn the instance on the hypervisor.
May 21 01:57:20.531494 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:57:20.768101 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lazy-loading 'numa_topology' on Instance uuid 0059a43c-1d34-40a9-af63-b5eca8c30f53 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:57:20.966356 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-91b40c89-f90e-44b5-83d4-496ef99e48cf tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "ecf25bc4-b32d-4627-9571-f98869b227f9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.351s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:21.044435 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Took 48.60 seconds to build instance.
May 21 01:57:21.077798 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:21.271046 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 01:57:21.271145 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Claim successful on node np0000001127
May 21 01:57:21.489347 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:21.548133 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 50.107s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:22.136785 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Acquiring lock "98ace73f-7d4b-4aed-9355-a39c58f9b024" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:22.137025 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "98ace73f-7d4b-4aed-9355-a39c58f9b024" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:22.449246 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Acquiring lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:22.449246 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:22.640292 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Detaching volume b72d4732-cbb9-491f-8683-d0155023a91f
May 21 01:57:22.711401 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Attempting to driver detach volume b72d4732-cbb9-491f-8683-d0155023a91f from mountpoint /dev/vdb
May 21 01:57:22.715129 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Found disk vdb by alias ua-b72d4732-cbb9-491f-8683-d0155023a91f {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 01:57:22.716977 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Found disk vdb by alias ua-b72d4732-cbb9-491f-8683-d0155023a91f {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 01:57:22.717235 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Attempting to detach device vdb from instance 98ace73f-7d4b-4aed-9355-a39c58f9b024 from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 01:57:22.718301 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] detach device xml: <disk type="block" device="disk">
May 21 01:57:22.718301 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:57:22.718301 np0000001127 nova-compute[98206]:   <alias name="ua-b72d4732-cbb9-491f-8683-d0155023a91f"/>
May 21 01:57:22.718301 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-4"/>
May 21 01:57:22.718301 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 01:57:22.718301 np0000001127 nova-compute[98206]:   <serial>b72d4732-cbb9-491f-8683-d0155023a91f</serial>
May 21 01:57:22.718301 np0000001127 nova-compute[98206]:   <shareable/>
May 21 01:57:22.718301 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 01:57:22.718301 np0000001127 nova-compute[98206]: </disk>
May 21 01:57:22.718301 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 01:57:22.725884 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Successfully detached device vdb from instance 98ace73f-7d4b-4aed-9355-a39c58f9b024 from the persistent domain config.
May 21 01:57:22.726057 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] (1/8): Attempting to detach device vdb with device alias ua-b72d4732-cbb9-491f-8683-d0155023a91f from instance 98ace73f-7d4b-4aed-9355-a39c58f9b024 from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 01:57:22.726298 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] detach device xml: <disk type="block" device="disk">
May 21 01:57:22.726298 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:57:22.726298 np0000001127 nova-compute[98206]:   <alias name="ua-b72d4732-cbb9-491f-8683-d0155023a91f"/>
May 21 01:57:22.726298 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-4"/>
May 21 01:57:22.726298 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 01:57:22.726298 np0000001127 nova-compute[98206]:   <serial>b72d4732-cbb9-491f-8683-d0155023a91f</serial>
May 21 01:57:22.726298 np0000001127 nova-compute[98206]:   <shareable/>
May 21 01:57:22.726298 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 01:57:22.726298 np0000001127 nova-compute[98206]: </disk>
May 21 01:57:22.726298 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 01:57:22.759071 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:22.765546 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:57:22.765546 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:57:22.951930 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Detaching volume e48122c6-4868-472c-a26f-f9f9d0fe32db
May 21 01:57:23.007299 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-17732bec-fba1-436c-8b55-fdbae9935066 req-23711e2f-51d9-407b-b5cb-7bf5983e3349 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-changed-ebf91ac5-9634-4897-a1bb-7336846be7cb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:23.007847 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-17732bec-fba1-436c-8b55-fdbae9935066 req-23711e2f-51d9-407b-b5cb-7bf5983e3349 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Refreshing instance network info cache due to event network-changed-ebf91ac5-9634-4897-a1bb-7336846be7cb. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:57:23.008220 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-17732bec-fba1-436c-8b55-fdbae9935066 req-23711e2f-51d9-407b-b5cb-7bf5983e3349 service nova] Acquiring lock "refresh_cache-58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:57:23.009492 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-17732bec-fba1-436c-8b55-fdbae9935066 req-23711e2f-51d9-407b-b5cb-7bf5983e3349 service nova] Acquired lock "refresh_cache-58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:57:23.009492 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-17732bec-fba1-436c-8b55-fdbae9935066 req-23711e2f-51d9-407b-b5cb-7bf5983e3349 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Refreshing network info cache for port ebf91ac5-9634-4897-a1bb-7336846be7cb {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:57:23.020257 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Attempting to driver detach volume e48122c6-4868-472c-a26f-f9f9d0fe32db from mountpoint /dev/vdb
May 21 01:57:23.028423 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Found disk vdb by alias ua-e48122c6-4868-472c-a26f-f9f9d0fe32db {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 01:57:23.029623 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Found disk vdb by alias ua-e48122c6-4868-472c-a26f-f9f9d0fe32db {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 01:57:23.029746 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Attempting to detach device vdb from instance 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 01:57:23.030042 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] detach device xml: <disk type="block" device="disk">
May 21 01:57:23.030042 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:57:23.030042 np0000001127 nova-compute[98206]:   <alias name="ua-e48122c6-4868-472c-a26f-f9f9d0fe32db"/>
May 21 01:57:23.030042 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-6"/>
May 21 01:57:23.030042 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 01:57:23.030042 np0000001127 nova-compute[98206]:   <serial>e48122c6-4868-472c-a26f-f9f9d0fe32db</serial>
May 21 01:57:23.030042 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 21 01:57:23.030042 np0000001127 nova-compute[98206]: </disk>
May 21 01:57:23.030042 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 01:57:23.047087 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Successfully detached device vdb from instance 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b from the persistent domain config.
May 21 01:57:23.047327 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] (1/8): Attempting to detach device vdb with device alias ua-e48122c6-4868-472c-a26f-f9f9d0fe32db from instance 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 01:57:23.047968 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] detach device xml: <disk type="block" device="disk">
May 21 01:57:23.047968 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:57:23.047968 np0000001127 nova-compute[98206]:   <alias name="ua-e48122c6-4868-472c-a26f-f9f9d0fe32db"/>
May 21 01:57:23.047968 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-6"/>
May 21 01:57:23.047968 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 01:57:23.047968 np0000001127 nova-compute[98206]:   <serial>e48122c6-4868-472c-a26f-f9f9d0fe32db</serial>
May 21 01:57:23.047968 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 21 01:57:23.047968 np0000001127 nova-compute[98206]: </disk>
May 21 01:57:23.047968 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 01:57:23.270494 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:57:23.511194 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-17732bec-fba1-436c-8b55-fdbae9935066 req-23711e2f-51d9-407b-b5cb-7bf5983e3349 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:23.566730 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779328643.5660145, 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b => ua-e48122c6-4868-472c-a26f-f9f9d0fe32db> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 01:57:23.567837 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-e48122c6-4868-472c-a26f-f9f9d0fe32db for instance 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 01:57:23.569816 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Successfully detached device vdb from instance 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b from the live domain config.
May 21 01:57:23.571765 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 01:57:23.571765 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db', 'iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e48122c6-4868-472c-a26f-f9f9d0fe32db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:57:23.571765 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:57:23.571997 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:57:23.572440 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db', 'iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e48122c6-4868-472c-a26f-f9f9d0fe32db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 01:57:23.572440 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 01:57:23.607616 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:23.607616 np0000001127 nova-compute[98206]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:23.607616 np0000001127 nova-compute[98206]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:23.607616 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:23.607616 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:23.607616 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:23.607616 np0000001127 nova-compute[98206]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db (non-flash)
May 21 01:57:23.607616 np0000001127 nova-compute[98206]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db (non-flash)
May 21 01:57:23.607616 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:23.607616 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:23.607616 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:57:23.608419 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:23.608419 np0000001127 nova-compute[98206]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:23.608419 np0000001127 nova-compute[98206]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:23.608419 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:23.608419 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:23.608419 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:23.608419 np0000001127 nova-compute[98206]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db (non-flash)
May 21 01:57:23.608419 np0000001127 nova-compute[98206]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db (non-flash)
May 21 01:57:23.608419 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:23.608419 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:23.608419 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:57:23.608419 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f', '10'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7', '15'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db', '16'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88', '6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88', '7')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 01:57:23.608419 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db', '16')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 01:57:23.609248 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db', '17')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 01:57:23.610261 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c0a221ccc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db'): ({'sdk'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 01:57:23.610417 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Removing multipathed devices sdk, sdj {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 01:57:23.610657 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Flush multipath device 3300000006ae84fda {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 01:57:23.643979 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 01:57:23.687643 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 01:57:23.734976 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 01:57:23.734976 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 01:57:23.734976 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 01:57:23.753747 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 01:57:23.753747 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 01:57:23.776214 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:23.776632 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.513s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:23.777858 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:23.810608 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:23.814297 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db, portal: 192.168.40.100,3260]
May 21 01:57:23.814297 np0000001127 nova-compute[98206]: Logout of [sid: 16, target: iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db, portal: 192.168.40.100,3260] successful.
May 21 01:57:23.814297 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:23.847759 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:23.865082 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:23.904326 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db, portal: 192.168.50.100,3260]
May 21 01:57:23.904326 np0000001127 nova-compute[98206]: Logout of [sid: 17, target: iqn.2023-03.storpool.com:os--volume-e48122c6-4868-472c-a26f-f9f9d0fe32db, portal: 192.168.50.100,3260] successful.
May 21 01:57:23.904326 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:23.922382 np0000001127 nova-compute[98206]: INFO nova.network.neutron [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Updating port 839e91da-5ffe-451b-bd9d-dfc1cf83ab19 with attributes {'binding:host_id': 'np0000001127', 'device_owner': 'compute:nova'}
May 21 01:57:23.930151 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:23.930418 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:57:23.930609 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] <== disconnect_volume: return (358ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:57:23.930767 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 01:57:23.998443 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-17732bec-fba1-436c-8b55-fdbae9935066 req-23711e2f-51d9-407b-b5cb-7bf5983e3349 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:24.174026 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-17732bec-fba1-436c-8b55-fdbae9935066 req-23711e2f-51d9-407b-b5cb-7bf5983e3349 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Updated VIF entry in instance network info cache for port ebf91ac5-9634-4897-a1bb-7336846be7cb. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 01:57:24.174491 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-17732bec-fba1-436c-8b55-fdbae9935066 req-23711e2f-51d9-407b-b5cb-7bf5983e3349 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Updating instance_info_cache with network_info: [{"id": "ebf91ac5-9634-4897-a1bb-7336846be7cb", "address": "fa:16:3e:fd:1e:9d", "network": {"id": "724d3b04-8f64-44ab-8f94-c1119b9a5b83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1321933524-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf91ac5-96", "ovs_interfaceid": "ebf91ac5-9634-4897-a1bb-7336846be7cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "319abe1b-caf8-4fa7-bc6c-caa7e755860b", "address": "fa:16:3e:10:bc:3b", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap319abe1b-ca", "ovs_interfaceid": "319abe1b-caf8-4fa7-bc6c-caa7e755860b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "db10c43a-9d2b-4250-83b6-0ca8ced88657", "address": "fa:16:3e:05:02:b1", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb10c43a-9d", "ovs_interfaceid": "db10c43a-9d2b-4250-83b6-0ca8ced88657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d807c564-314d-4f8e-8984-8068d59d3538", "address": "fa:16:3e:df:4a:48", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd807c564-31", "ovs_interfaceid": "d807c564-314d-4f8e-8984-8068d59d3538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d03a47d5-bec7-4099-96e0-c102edfe9e8e", "address": "fa:16:3e:70:5b:80", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03a47d5-be", "ovs_interfaceid": "d03a47d5-bec7-4099-96e0-c102edfe9e8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "14e48bfc-fab0-433c-b291-0e75e2da496c", "address": "fa:16:3e:e5:ea:60", "network": {"id": "7b5c3ed1-837f-404f-9062-8babcc21dfd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-715008204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e48bfc-fa", "ovs_interfaceid": "14e48bfc-fab0-433c-b291-0e75e2da496c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "93b6a994-3c94-45b3-be4c-d63ce41a8557", "address": "fa:16:3e:56:b9:59", "network": {"id": "7b5c3ed1-837f-404f-9062-8babcc21dfd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-715008204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93b6a994-3c", "ovs_interfaceid": "93b6a994-3c94-45b3-be4c-d63ce41a8557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:57:24.509553 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lazy-loading 'flavor' on Instance uuid 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:57:24.607282 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "refresh_cache-0059a43c-1d34-40a9-af63-b5eca8c30f53" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:57:24.607794 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquired lock "refresh_cache-0059a43c-1d34-40a9-af63-b5eca8c30f53" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:57:24.607950 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 01:57:24.676944 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-17732bec-fba1-436c-8b55-fdbae9935066 req-23711e2f-51d9-407b-b5cb-7bf5983e3349 service nova] Releasing lock "refresh_cache-58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:57:24.804030 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779328644.8036737, 98ace73f-7d4b-4aed-9355-a39c58f9b024 => ua-b72d4732-cbb9-491f-8683-d0155023a91f> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 01:57:24.806825 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-b72d4732-cbb9-491f-8683-d0155023a91f for instance 98ace73f-7d4b-4aed-9355-a39c58f9b024 {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 01:57:24.809743 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Successfully detached device vdb from instance 98ace73f-7d4b-4aed-9355-a39c58f9b024 from the live domain config.
May 21 01:57:24.844760 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 01:57:24.845165 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f', 'iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b72d4732-cbb9-491f-8683-d0155023a91f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:57:24.845334 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:57:24.845748 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:57:24.846115 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f', 'iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b72d4732-cbb9-491f-8683-d0155023a91f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 01:57:24.846277 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 01:57:24.876720 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:24.876720 np0000001127 nova-compute[98206]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:24.876720 np0000001127 nova-compute[98206]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:24.876720 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:24.876720 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:24.876720 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:24.876720 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:24.876720 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:24.876720 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:57:24.877136 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:24.877136 np0000001127 nova-compute[98206]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f (non-flash)
May 21 01:57:24.877136 np0000001127 nova-compute[98206]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:24.877136 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:24.877136 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:24.877136 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:24.877136 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:24.877136 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:24.877136 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:57:24.877631 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f', '10'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7', '15'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88', '6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88', '7')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 01:57:24.877826 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f', '10')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 01:57:24.879443 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f', '11')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 01:57:24.880951 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c0587f1440>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f'): ({'sdg'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 01:57:24.882684 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Removing multipathed devices sdg, sdf {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 01:57:24.882684 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Flush multipath device 330000000040cf936 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 01:57:24.914608 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 01:57:24.966886 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 01:57:25.036140 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 01:57:25.036302 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 01:57:25.037784 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 01:57:25.053578 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 01:57:25.053578 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 01:57:25.066435 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:25.082830 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-15e09501-47c2-4125-9612-2ae13fe685b1 req-18e97a4c-edbe-45e0-8e73-fa547a684fc4 service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Received event network-changed-839e91da-5ffe-451b-bd9d-dfc1cf83ab19 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:25.083322 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-15e09501-47c2-4125-9612-2ae13fe685b1 req-18e97a4c-edbe-45e0-8e73-fa547a684fc4 service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Refreshing instance network info cache due to event network-changed-839e91da-5ffe-451b-bd9d-dfc1cf83ab19. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:57:25.083682 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-15e09501-47c2-4125-9612-2ae13fe685b1 req-18e97a4c-edbe-45e0-8e73-fa547a684fc4 service nova] Acquiring lock "refresh_cache-0059a43c-1d34-40a9-af63-b5eca8c30f53" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:57:25.099024 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f, portal: 192.168.40.100,3260]
May 21 01:57:25.099024 np0000001127 nova-compute[98206]: Logout of [sid: 10, target: iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f, portal: 192.168.40.100,3260] successful.
May 21 01:57:25.099024 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:25.112711 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:25.121163 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:25.137679 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:25.175423 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f, portal: 192.168.50.100,3260]
May 21 01:57:25.175423 np0000001127 nova-compute[98206]: Logout of [sid: 11, target: iqn.2023-03.storpool.com:os--volume-b72d4732-cbb9-491f-8683-d0155023a91f, portal: 192.168.50.100,3260] successful.
May 21 01:57:25.175423 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:25.194527 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:25.194849 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:57:25.195205 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] <== disconnect_volume: return (349ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:57:25.196575 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 01:57:25.497493 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:25.651464 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Updating instance_info_cache with network_info: [{"id": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "address": "fa:16:3e:00:d8:d3", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap839e91da-5f", "ovs_interfaceid": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:57:25.722545 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-32cfaad8-2403-42bb-8703-fc474f0bac26 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Acquiring lock "interface-6307081b-dd75-4ea3-aad6-d01f2b2b1c9b-bcbb3f8b-362a-4634-8baa-f09e0134e596" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:25.723002 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-32cfaad8-2403-42bb-8703-fc474f0bac26 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lock "interface-6307081b-dd75-4ea3-aad6-d01f2b2b1c9b-bcbb3f8b-362a-4634-8baa-f09e0134e596" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:25.761209 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lazy-loading 'flavor' on Instance uuid 98ace73f-7d4b-4aed-9355-a39c58f9b024 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:57:26.023882 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-67371cba-159e-4185-85c7-8a88188883c8 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.574s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:26.102460 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:26.154022 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Releasing lock "refresh_cache-0059a43c-1d34-40a9-af63-b5eca8c30f53" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:57:26.155426 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 01:57:26.155798 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-15e09501-47c2-4125-9612-2ae13fe685b1 req-18e97a4c-edbe-45e0-8e73-fa547a684fc4 service nova] Acquired lock "refresh_cache-0059a43c-1d34-40a9-af63-b5eca8c30f53" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:57:26.156004 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-15e09501-47c2-4125-9612-2ae13fe685b1 req-18e97a4c-edbe-45e0-8e73-fa547a684fc4 service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Refreshing network info cache for port 839e91da-5ffe-451b-bd9d-dfc1cf83ab19 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:57:26.156607 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Creating image(s)
May 21 01:57:26.158879 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "/opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:26.159272 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "/opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:26.160192 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "/opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:26.160530 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0059a43c-1d34-40a9-af63-b5eca8c30f53 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:57:26.228445 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-32cfaad8-2403-42bb-8703-fc474f0bac26 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lazy-loading 'flavor' on Instance uuid 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:57:26.660571 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-15e09501-47c2-4125-9612-2ae13fe685b1 req-18e97a4c-edbe-45e0-8e73-fa547a684fc4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:26.662903 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Object Instance<0059a43c-1d34-40a9-af63-b5eca8c30f53> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 01:57:26.663574 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "c9c5290c3ede2b72255fff500449a1f12a6f1343" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:26.663660 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "c9c5290c3ede2b72255fff500449a1f12a6f1343" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:26.733658 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-32cfaad8-2403-42bb-8703-fc474f0bac26 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:55:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1663470333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-1663470333',id=2,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXMK1mbiHi5+o6ufBchj3Bb4+HeC3f5IcR98ZEhanB9o7Q5vVQrjHwCh1Z6wl+J1XeMlcfvzOJWsJzB17pBNOXZgD+WEZqVbkZl5Lc12KudDK67GOxtwwklvUeZ02pjPA==',key_name='tempest-keypair-1942385655',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:56:17Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ffcb955f57a438d998dbdf9bfee0868',ramdisk_id='',reservation_id='r-aopg08rx',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1169987238',owner_user_name='tempest-TaggedAttachmentsTest-1169987238-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:56:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd36d5cf62b4dc49bd53ebc09db2a2d',uuid=6307081b-dd75-4ea3-aad6-d01f2b2b1c9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bcbb3f8b-362a-4634-8baa-f09e0134e596", "address": "fa:16:3e:9e:2a:c6", "network": {"id": "1506c578-ffa9-48da-b8bb-2c0ea4a41146", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1947915502", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ffcb955f57a438d998dbdf9bfee0868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcbb3f8b-36", "ovs_interfaceid": "bcbb3f8b-362a-4634-8baa-f09e0134e596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 01:57:26.734357 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-32cfaad8-2403-42bb-8703-fc474f0bac26 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Converting VIF {"id": "bcbb3f8b-362a-4634-8baa-f09e0134e596", "address": "fa:16:3e:9e:2a:c6", "network": {"id": "1506c578-ffa9-48da-b8bb-2c0ea4a41146", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1947915502", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ffcb955f57a438d998dbdf9bfee0868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcbb3f8b-36", "ovs_interfaceid": "bcbb3f8b-362a-4634-8baa-f09e0134e596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:57:26.735248 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-32cfaad8-2403-42bb-8703-fc474f0bac26 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:2a:c6,bridge_name='br-int',has_traffic_filtering=True,id=bcbb3f8b-362a-4634-8baa-f09e0134e596,network=Network(1506c578-ffa9-48da-b8bb-2c0ea4a41146),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcbb3f8b-36') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:57:26.737921 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-32cfaad8-2403-42bb-8703-fc474f0bac26 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9e:2a:c6"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tapbcbb3f8b-36"/></interface> {{(pid=98206) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 21 01:57:26.742395 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-32cfaad8-2403-42bb-8703-fc474f0bac26 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9e:2a:c6"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tapbcbb3f8b-36"/></interface> {{(pid=98206) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 21 01:57:26.743974 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-32cfaad8-2403-42bb-8703-fc474f0bac26 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Attempting to detach device tapbcbb3f8b-36 from instance 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 01:57:26.744383 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-32cfaad8-2403-42bb-8703-fc474f0bac26 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] detach device xml: <interface type="ethernet">
May 21 01:57:26.744383 np0000001127 nova-compute[98206]:   <mac address="fa:16:3e:9e:2a:c6"/>
May 21 01:57:26.744383 np0000001127 nova-compute[98206]:   <model type="virtio"/>
May 21 01:57:26.744383 np0000001127 nova-compute[98206]:   <driver name="qemu"/>
May 21 01:57:26.744383 np0000001127 nova-compute[98206]:   <mtu size="1372"/>
May 21 01:57:26.744383 np0000001127 nova-compute[98206]:   <target dev="tapbcbb3f8b-36"/>
May 21 01:57:26.744383 np0000001127 nova-compute[98206]: </interface>
May 21 01:57:26.744383 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 01:57:26.750535 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-32cfaad8-2403-42bb-8703-fc474f0bac26 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9e:2a:c6"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tapbcbb3f8b-36"/></interface> {{(pid=98206) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 21 01:57:26.752346 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-32cfaad8-2403-42bb-8703-fc474f0bac26 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9e:2a:c6"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tapbcbb3f8b-36"/></interface>not found in domain: <domain type='qemu' id='2'>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:   <name>instance-00000002</name>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:   <uuid>6307081b-dd75-4ea3-aad6-d01f2b2b1c9b</uuid>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:   <metadata>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:   <nova:package version="33.1.0"/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:   <nova:name>tempest-device-tagging-server-1663470333</nova:name>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:   <nova:creationTime>2026-05-21 01:57:06</nova:creationTime>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:   <nova:flavor name="m1.nano" id="42">
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <nova:memory>192</nova:memory>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <nova:disk>1</nova:disk>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <nova:swap>0</nova:swap>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <nova:ephemeral>0</nova:ephemeral>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <nova:vcpus>1</nova:vcpus>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <nova:extraSpecs>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     </nova:extraSpecs>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:   </nova:flavor>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:   <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <nova:containerFormat>bare</nova:containerFormat>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <nova:minDisk>1</nova:minDisk>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <nova:minRam>0</nova:minRam>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <nova:properties>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <nova:property name="hw_machine_type">pc</nova:property>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <nova:property name="hw_video_model">virtio</nova:property>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     </nova:properties>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:   </nova:image>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:   <nova:owner>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <nova:user uuid="0fd36d5cf62b4dc49bd53ebc09db2a2d">tempest-TaggedAttachmentsTest-1169987238-project-member</nova:user>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <nova:project uuid="1ffcb955f57a438d998dbdf9bfee0868">tempest-TaggedAttachmentsTest-1169987238</nova:project>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:   </nova:owner>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:   <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:   <nova:ports>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <nova:port uuid="67b86a71-40ec-405f-8d46-56744e34174f">
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     </nova:port>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <nova:port uuid="bcbb3f8b-362a-4634-8baa-f09e0134e596">
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <nova:ip type="fixed" address="10.10.10.187" ipVersion="4"/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     </nova:port>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:   </nova:ports>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]: </nova:instance>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:   </metadata>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:   <memory unit='KiB'>196608</memory>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:   <currentMemory unit='KiB'>196608</currentMemory>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:   <vcpu placement='static'>1</vcpu>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:   <resource>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <partition>/machine</partition>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:   </resource>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:   <sysinfo type='smbios'>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <system>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <entry name='product'>OpenStack Nova</entry>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <entry name='version'>33.1.0</entry>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <entry name='serial'>6307081b-dd75-4ea3-aad6-d01f2b2b1c9b</entry>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <entry name='uuid'>6307081b-dd75-4ea3-aad6-d01f2b2b1c9b</entry>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <entry name='family'>Virtual Machine</entry>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     </system>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:   <os>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <boot dev='hd'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <smbios mode='sysinfo'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:   </os>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:   <features>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <acpi/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <vmcoreinfo state='on'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <tcg>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <tb-cache unit='KiB'>131072</tb-cache>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     </tcg>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:   </features>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:   <cpu mode='custom' match='exact' check='full'>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <model fallback='forbid'>Nehalem</model>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <feature policy='require' name='hypervisor'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:   <clock offset='utc'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:   <on_poweroff>destroy</on_poweroff>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:   <on_reboot>restart</on_reboot>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:   <on_crash>destroy</on_crash>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:   <devices>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <disk type='file' device='disk'>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <driver name='qemu' type='qcow2' cache='none'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <source file='/opt/stack/data/nova/instances/6307081b-dd75-4ea3-aad6-d01f2b2b1c9b/disk' index='2'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <backingStore type='file' index='3'>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:         <format type='raw'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:         <source file='/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:         <backingStore/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       </backingStore>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <target dev='vda' bus='virtio'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <alias name='virtio-disk0'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     </disk>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <disk type='file' device='cdrom'>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <driver name='qemu' type='raw' cache='none'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <source file='/opt/stack/data/nova/instances/6307081b-dd75-4ea3-aad6-d01f2b2b1c9b/disk.config' index='1'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <backingStore/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <target dev='hda' bus='ide'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <readonly/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <alias name='ide0-0-0'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     </disk>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <controller type='usb' index='0' model='none'>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <alias name='usb'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     </controller>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <controller type='pci' index='0' model='pci-root'>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <alias name='pci.0'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     </controller>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <controller type='ide' index='0'>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <alias name='ide'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     </controller>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <interface type='ethernet'>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <mac address='fa:16:3e:ba:84:92'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <target dev='tap67b86a71-40'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <model type='virtio'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <driver name='qemu'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <mtu size='1372'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <alias name='net0'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     </interface>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <interface type='ethernet'>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <mac address='fa:16:3e:9e:2a:c6'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <target dev='tapbcbb3f8b-36'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <model type='virtio'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <driver name='qemu'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <mtu size='1372'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <alias name='net1'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     </interface>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <serial type='pty'>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <source path='/dev/pts/1'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <log file='/opt/stack/data/nova/instances/6307081b-dd75-4ea3-aad6-d01f2b2b1c9b/console.log' append='off'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <target type='isa-serial' port='0'>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:         <model name='isa-serial'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       </target>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <alias name='serial0'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     </serial>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <console type='pty' tty='/dev/pts/1'>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <source path='/dev/pts/1'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <log file='/opt/stack/data/nova/instances/6307081b-dd75-4ea3-aad6-d01f2b2b1c9b/console.log' append='off'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <target type='serial' port='0'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <alias name='serial0'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     </console>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <input type='mouse' bus='ps2'>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <alias name='input0'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     </input>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <input type='keyboard' bus='ps2'>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <alias name='input1'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     </input>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <graphics type='vnc' port='5901' autoport='yes' listen='0.0.0.0'>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <listen type='address' address='0.0.0.0'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <audio id='1' type='none'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <video>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <model type='virtio' heads='1' primary='yes'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <alias name='video0'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     </video>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <stats period='10'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <alias name='balloon0'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     </memballoon>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <rng model='virtio'>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <backend model='random'>/dev/urandom</backend>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <alias name='rng0'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     </rng>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:   </devices>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <label>libvirt-6307081b-dd75-4ea3-aad6-d01f2b2b1c9b</label>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <imagelabel>libvirt-6307081b-dd75-4ea3-aad6-d01f2b2b1c9b</imagelabel>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:   </seclabel>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <label>+64055:+993</label>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:     <imagelabel>+64055:+993</imagelabel>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:   </seclabel>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]: </domain>
May 21 01:57:26.752346 np0000001127 nova-compute[98206]:  {{(pid=98206) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 21 01:57:26.757223 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-32cfaad8-2403-42bb-8703-fc474f0bac26 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Successfully detached device tapbcbb3f8b-36 from instance 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b from the persistent domain config.
May 21 01:57:26.757223 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-32cfaad8-2403-42bb-8703-fc474f0bac26 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] (1/8): Attempting to detach device tapbcbb3f8b-36 with device alias net1 from instance 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 01:57:26.757223 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-32cfaad8-2403-42bb-8703-fc474f0bac26 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] detach device xml: <interface type="ethernet">
May 21 01:57:26.757223 np0000001127 nova-compute[98206]:   <mac address="fa:16:3e:9e:2a:c6"/>
May 21 01:57:26.757223 np0000001127 nova-compute[98206]:   <model type="virtio"/>
May 21 01:57:26.757223 np0000001127 nova-compute[98206]:   <driver name="qemu"/>
May 21 01:57:26.757223 np0000001127 nova-compute[98206]:   <mtu size="1372"/>
May 21 01:57:26.757223 np0000001127 nova-compute[98206]:   <target dev="tapbcbb3f8b-36"/>
May 21 01:57:26.757223 np0000001127 nova-compute[98206]: </interface>
May 21 01:57:26.757223 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 01:57:26.769003 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-65e24ccd-bfbd-4112-aa21-5ee7df5108e1 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "98ace73f-7d4b-4aed-9355-a39c58f9b024" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.632s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:27.098074 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-15e09501-47c2-4125-9612-2ae13fe685b1 req-18e97a4c-edbe-45e0-8e73-fa547a684fc4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:27.307246 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0011672040000121342 future=<Future at 0x71c07c5118e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:57:27.307668 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:57:27.310062 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Emitting event <LifecycleEvent: 1779328632.3057616, cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:57:27.310275 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] VM Stopped (Lifecycle Event)
May 21 01:57:27.365569 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-15e09501-47c2-4125-9612-2ae13fe685b1 req-18e97a4c-edbe-45e0-8e73-fa547a684fc4 service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Updated VIF entry in instance network info cache for port 839e91da-5ffe-451b-bd9d-dfc1cf83ab19. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 01:57:27.366851 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-15e09501-47c2-4125-9612-2ae13fe685b1 req-18e97a4c-edbe-45e0-8e73-fa547a684fc4 service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Updating instance_info_cache with network_info: [{"id": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "address": "fa:16:3e:00:d8:d3", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap839e91da-5f", "ovs_interfaceid": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:57:27.532686 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-6974ecac-4c0a-412e-b37e-589373ed1b74 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Acquiring lock "ecf25bc4-b32d-4627-9571-f98869b227f9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:27.532971 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-6974ecac-4c0a-412e-b37e-589373ed1b74 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "ecf25bc4-b32d-4627-9571-f98869b227f9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:27.534441 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-6974ecac-4c0a-412e-b37e-589373ed1b74 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Acquiring lock "ecf25bc4-b32d-4627-9571-f98869b227f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:27.534637 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-6974ecac-4c0a-412e-b37e-589373ed1b74 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "ecf25bc4-b32d-4627-9571-f98869b227f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:27.535104 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-6974ecac-4c0a-412e-b37e-589373ed1b74 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "ecf25bc4-b32d-4627-9571-f98869b227f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:27.539545 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-6974ecac-4c0a-412e-b37e-589373ed1b74 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Terminating instance
May 21 01:57:27.652662 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c5fa9183-23af-4f1e-a6f1-eea70704d233 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Acquiring lock "98ace73f-7d4b-4aed-9355-a39c58f9b024" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:27.652998 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c5fa9183-23af-4f1e-a6f1-eea70704d233 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "98ace73f-7d4b-4aed-9355-a39c58f9b024" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:27.653215 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c5fa9183-23af-4f1e-a6f1-eea70704d233 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Acquiring lock "98ace73f-7d4b-4aed-9355-a39c58f9b024-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:27.653428 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c5fa9183-23af-4f1e-a6f1-eea70704d233 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "98ace73f-7d4b-4aed-9355-a39c58f9b024-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:27.653623 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c5fa9183-23af-4f1e-a6f1-eea70704d233 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "98ace73f-7d4b-4aed-9355-a39c58f9b024-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:27.658639 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-c5fa9183-23af-4f1e-a6f1-eea70704d233 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Terminating instance
May 21 01:57:27.762321 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:27.813648 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: cb43d4a7-fa8d-48fb-b5a5-4b96000ec0c6] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:57:27.831811 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:27.837432 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779328647.8367503, 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 01:57:27.843202 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-32cfaad8-2403-42bb-8703-fc474f0bac26 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Start waiting for the detach event from libvirt for device tapbcbb3f8b-36 with device alias net1 for instance 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 01:57:27.843547 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-32cfaad8-2403-42bb-8703-fc474f0bac26 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9e:2a:c6"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tapbcbb3f8b-36"/></interface> {{(pid=98206) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 21 01:57:27.851097 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-32cfaad8-2403-42bb-8703-fc474f0bac26 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9e:2a:c6"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tapbcbb3f8b-36"/></interface>not found in domain: <domain type='qemu' id='2'>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:   <name>instance-00000002</name>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:   <uuid>6307081b-dd75-4ea3-aad6-d01f2b2b1c9b</uuid>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:   <metadata>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:   <nova:package version="33.1.0"/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:   <nova:name>tempest-device-tagging-server-1663470333</nova:name>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:   <nova:creationTime>2026-05-21 01:57:06</nova:creationTime>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:   <nova:flavor name="m1.nano" id="42">
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <nova:memory>192</nova:memory>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <nova:disk>1</nova:disk>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <nova:swap>0</nova:swap>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <nova:ephemeral>0</nova:ephemeral>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <nova:vcpus>1</nova:vcpus>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <nova:extraSpecs>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     </nova:extraSpecs>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:   </nova:flavor>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:   <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <nova:containerFormat>bare</nova:containerFormat>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <nova:minDisk>1</nova:minDisk>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <nova:minRam>0</nova:minRam>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <nova:properties>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <nova:property name="hw_machine_type">pc</nova:property>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <nova:property name="hw_video_model">virtio</nova:property>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     </nova:properties>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:   </nova:image>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:   <nova:owner>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <nova:user uuid="0fd36d5cf62b4dc49bd53ebc09db2a2d">tempest-TaggedAttachmentsTest-1169987238-project-member</nova:user>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <nova:project uuid="1ffcb955f57a438d998dbdf9bfee0868">tempest-TaggedAttachmentsTest-1169987238</nova:project>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:   </nova:owner>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:   <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:   <nova:ports>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <nova:port uuid="67b86a71-40ec-405f-8d46-56744e34174f">
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     </nova:port>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <nova:port uuid="bcbb3f8b-362a-4634-8baa-f09e0134e596">
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <nova:ip type="fixed" address="10.10.10.187" ipVersion="4"/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     </nova:port>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:   </nova:ports>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]: </nova:instance>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:   </metadata>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:   <memory unit='KiB'>196608</memory>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:   <currentMemory unit='KiB'>196608</currentMemory>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:   <vcpu placement='static'>1</vcpu>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:   <resource>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <partition>/machine</partition>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:   </resource>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:   <sysinfo type='smbios'>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <system>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <entry name='product'>OpenStack Nova</entry>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <entry name='version'>33.1.0</entry>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <entry name='serial'>6307081b-dd75-4ea3-aad6-d01f2b2b1c9b</entry>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <entry name='uuid'>6307081b-dd75-4ea3-aad6-d01f2b2b1c9b</entry>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <entry name='family'>Virtual Machine</entry>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     </system>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:   <os>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <boot dev='hd'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <smbios mode='sysinfo'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:   </os>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:   <features>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <acpi/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <vmcoreinfo state='on'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <tcg>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <tb-cache unit='KiB'>131072</tb-cache>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     </tcg>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:   </features>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:   <cpu mode='custom' match='exact' check='full'>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <model fallback='forbid'>Nehalem</model>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <feature policy='require' name='hypervisor'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:   <clock offset='utc'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:   <on_poweroff>destroy</on_poweroff>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:   <on_reboot>restart</on_reboot>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:   <on_crash>destroy</on_crash>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:   <devices>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <disk type='file' device='disk'>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <driver name='qemu' type='qcow2' cache='none'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <source file='/opt/stack/data/nova/instances/6307081b-dd75-4ea3-aad6-d01f2b2b1c9b/disk' index='2'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <backingStore type='file' index='3'>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:         <format type='raw'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:         <source file='/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:         <backingStore/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       </backingStore>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <target dev='vda' bus='virtio'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <alias name='virtio-disk0'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     </disk>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <disk type='file' device='cdrom'>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <driver name='qemu' type='raw' cache='none'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <source file='/opt/stack/data/nova/instances/6307081b-dd75-4ea3-aad6-d01f2b2b1c9b/disk.config' index='1'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <backingStore/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <target dev='hda' bus='ide'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <readonly/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <alias name='ide0-0-0'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     </disk>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <controller type='usb' index='0' model='none'>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <alias name='usb'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     </controller>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <controller type='pci' index='0' model='pci-root'>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <alias name='pci.0'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     </controller>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <controller type='ide' index='0'>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <alias name='ide'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     </controller>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <interface type='ethernet'>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <mac address='fa:16:3e:ba:84:92'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <target dev='tap67b86a71-40'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <model type='virtio'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <driver name='qemu'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <mtu size='1372'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <alias name='net0'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     </interface>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <serial type='pty'>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <source path='/dev/pts/1'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <log file='/opt/stack/data/nova/instances/6307081b-dd75-4ea3-aad6-d01f2b2b1c9b/console.log' append='off'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <target type='isa-serial' port='0'>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:         <model name='isa-serial'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       </target>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <alias name='serial0'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     </serial>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <console type='pty' tty='/dev/pts/1'>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <source path='/dev/pts/1'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <log file='/opt/stack/data/nova/instances/6307081b-dd75-4ea3-aad6-d01f2b2b1c9b/console.log' append='off'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <target type='serial' port='0'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <alias name='serial0'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     </console>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <input type='mouse' bus='ps2'>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <alias name='input0'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     </input>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <input type='keyboard' bus='ps2'>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <alias name='input1'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     </input>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <graphics type='vnc' port='5901' autoport='yes' listen='0.0.0.0'>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <listen type='address' address='0.0.0.0'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <audio id='1' type='none'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <video>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <model type='virtio' heads='1' primary='yes'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <alias name='video0'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     </video>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <stats period='10'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <alias name='balloon0'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     </memballoon>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <rng model='virtio'>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <backend model='random'>/dev/urandom</backend>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <alias name='rng0'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     </rng>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:   </devices>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <label>libvirt-6307081b-dd75-4ea3-aad6-d01f2b2b1c9b</label>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <imagelabel>libvirt-6307081b-dd75-4ea3-aad6-d01f2b2b1c9b</imagelabel>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:   </seclabel>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <label>+64055:+993</label>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:     <imagelabel>+64055:+993</imagelabel>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:   </seclabel>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]: </domain>
May 21 01:57:27.851097 np0000001127 nova-compute[98206]:  {{(pid=98206) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 21 01:57:27.857032 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-32cfaad8-2403-42bb-8703-fc474f0bac26 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Successfully detached device tapbcbb3f8b-36 from instance 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b from the live domain config.
May 21 01:57:27.857032 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-32cfaad8-2403-42bb-8703-fc474f0bac26 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:55:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1663470333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-1663470333',id=2,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXMK1mbiHi5+o6ufBchj3Bb4+HeC3f5IcR98ZEhanB9o7Q5vVQrjHwCh1Z6wl+J1XeMlcfvzOJWsJzB17pBNOXZgD+WEZqVbkZl5Lc12KudDK67GOxtwwklvUeZ02pjPA==',key_name='tempest-keypair-1942385655',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:56:17Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ffcb955f57a438d998dbdf9bfee0868',ramdisk_id='',reservation_id='r-aopg08rx',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1169987238',owner_user_name='tempest-TaggedAttachmentsTest-1169987238-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:56:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd36d5cf62b4dc49bd53ebc09db2a2d',uuid=6307081b-dd75-4ea3-aad6-d01f2b2b1c9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bcbb3f8b-362a-4634-8baa-f09e0134e596", "address": "fa:16:3e:9e:2a:c6", "network": {"id": "1506c578-ffa9-48da-b8bb-2c0ea4a41146", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1947915502", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ffcb955f57a438d998dbdf9bfee0868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcbb3f8b-36", "ovs_interfaceid": "bcbb3f8b-362a-4634-8baa-f09e0134e596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 01:57:27.857032 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-32cfaad8-2403-42bb-8703-fc474f0bac26 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Converting VIF {"id": "bcbb3f8b-362a-4634-8baa-f09e0134e596", "address": "fa:16:3e:9e:2a:c6", "network": {"id": "1506c578-ffa9-48da-b8bb-2c0ea4a41146", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1947915502", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ffcb955f57a438d998dbdf9bfee0868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcbb3f8b-36", "ovs_interfaceid": "bcbb3f8b-362a-4634-8baa-f09e0134e596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:57:27.857032 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-32cfaad8-2403-42bb-8703-fc474f0bac26 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:2a:c6,bridge_name='br-int',has_traffic_filtering=True,id=bcbb3f8b-362a-4634-8baa-f09e0134e596,network=Network(1506c578-ffa9-48da-b8bb-2c0ea4a41146),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcbb3f8b-36') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:57:27.857032 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-32cfaad8-2403-42bb-8703-fc474f0bac26 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:2a:c6,bridge_name='br-int',has_traffic_filtering=True,id=bcbb3f8b-362a-4634-8baa-f09e0134e596,network=Network(1506c578-ffa9-48da-b8bb-2c0ea4a41146),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcbb3f8b-36') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 01:57:27.858624 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:27.858624 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbcbb3f8b-36, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:27.858956 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:27.860501 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:57:27.863299 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:27.864529 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:27.864642 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1cc61ecb-b75f-4571-b088-291bc750b74e) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:27.869886 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:27.872796 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:57:27.879268 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-15e09501-47c2-4125-9612-2ae13fe685b1 req-18e97a4c-edbe-45e0-8e73-fa547a684fc4 service nova] Releasing lock "refresh_cache-0059a43c-1d34-40a9-af63-b5eca8c30f53" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:57:27.880442 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:27.889463 np0000001127 nova-compute[98206]: INFO os_vif [None req-32cfaad8-2403-42bb-8703-fc474f0bac26 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:2a:c6,bridge_name='br-int',has_traffic_filtering=True,id=bcbb3f8b-362a-4634-8baa-f09e0134e596,network=Network(1506c578-ffa9-48da-b8bb-2c0ea4a41146),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcbb3f8b-36')
May 21 01:57:27.889463 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-32cfaad8-2403-42bb-8703-fc474f0bac26 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1663470333', uuid='6307081b-dd75-4ea3-aad6-d01f2b2b1c9b'), owner=OwnerMeta(userid='0fd36d5cf62b4dc49bd53ebc09db2a2d', username='tempest-TaggedAttachmentsTest-1169987238-project-member', projectid='1ffcb955f57a438d998dbdf9bfee0868', projectname='tempest-TaggedAttachmentsTest-1169987238'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "67b86a71-40ec-405f-8d46-56744e34174f", "address": "fa:16:3e:ba:84:92", "network": {"id": "84a294f6-e79d-44ac-90f4-cfa96e67e367", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1771731810-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ffcb955f57a438d998dbdf9bfee0868", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b86a71-40", "ovs_interfaceid": "67b86a71-40ec-405f-8d46-56744e34174f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328647.8890426) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 01:57:27.892995 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-32cfaad8-2403-42bb-8703-fc474f0bac26 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 01:57:27.892995 np0000001127 nova-compute[98206]:   <nova:package version="33.1.0"/>
May 21 01:57:27.892995 np0000001127 nova-compute[98206]:   <nova:name>tempest-device-tagging-server-1663470333</nova:name>
May 21 01:57:27.892995 np0000001127 nova-compute[98206]:   <nova:creationTime>2026-05-21 01:57:27</nova:creationTime>
May 21 01:57:27.892995 np0000001127 nova-compute[98206]:   <nova:flavor name="m1.nano" id="42">
May 21 01:57:27.892995 np0000001127 nova-compute[98206]:     <nova:memory>192</nova:memory>
May 21 01:57:27.892995 np0000001127 nova-compute[98206]:     <nova:disk>1</nova:disk>
May 21 01:57:27.892995 np0000001127 nova-compute[98206]:     <nova:swap>0</nova:swap>
May 21 01:57:27.892995 np0000001127 nova-compute[98206]:     <nova:ephemeral>0</nova:ephemeral>
May 21 01:57:27.892995 np0000001127 nova-compute[98206]:     <nova:vcpus>1</nova:vcpus>
May 21 01:57:27.892995 np0000001127 nova-compute[98206]:     <nova:extraSpecs>
May 21 01:57:27.892995 np0000001127 nova-compute[98206]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 01:57:27.892995 np0000001127 nova-compute[98206]:     </nova:extraSpecs>
May 21 01:57:27.892995 np0000001127 nova-compute[98206]:   </nova:flavor>
May 21 01:57:27.892995 np0000001127 nova-compute[98206]:   <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 01:57:27.892995 np0000001127 nova-compute[98206]:     <nova:containerFormat>bare</nova:containerFormat>
May 21 01:57:27.892995 np0000001127 nova-compute[98206]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 21 01:57:27.892995 np0000001127 nova-compute[98206]:     <nova:minDisk>1</nova:minDisk>
May 21 01:57:27.892995 np0000001127 nova-compute[98206]:     <nova:minRam>0</nova:minRam>
May 21 01:57:27.892995 np0000001127 nova-compute[98206]:     <nova:properties>
May 21 01:57:27.892995 np0000001127 nova-compute[98206]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 21 01:57:27.892995 np0000001127 nova-compute[98206]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 21 01:57:27.892995 np0000001127 nova-compute[98206]:       <nova:property name="hw_machine_type">pc</nova:property>
May 21 01:57:27.892995 np0000001127 nova-compute[98206]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 21 01:57:27.892995 np0000001127 nova-compute[98206]:       <nova:property name="hw_video_model">virtio</nova:property>
May 21 01:57:27.892995 np0000001127 nova-compute[98206]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 21 01:57:27.892995 np0000001127 nova-compute[98206]:     </nova:properties>
May 21 01:57:27.892995 np0000001127 nova-compute[98206]:   </nova:image>
May 21 01:57:27.892995 np0000001127 nova-compute[98206]:   <nova:owner>
May 21 01:57:27.892995 np0000001127 nova-compute[98206]:     <nova:user uuid="0fd36d5cf62b4dc49bd53ebc09db2a2d">tempest-TaggedAttachmentsTest-1169987238-project-member</nova:user>
May 21 01:57:27.892995 np0000001127 nova-compute[98206]:     <nova:project uuid="1ffcb955f57a438d998dbdf9bfee0868">tempest-TaggedAttachmentsTest-1169987238</nova:project>
May 21 01:57:27.892995 np0000001127 nova-compute[98206]:   </nova:owner>
May 21 01:57:27.892995 np0000001127 nova-compute[98206]:   <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 01:57:27.892995 np0000001127 nova-compute[98206]:   <nova:ports>
May 21 01:57:27.892995 np0000001127 nova-compute[98206]:     <nova:port uuid="67b86a71-40ec-405f-8d46-56744e34174f">
May 21 01:57:27.892995 np0000001127 nova-compute[98206]:       <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 21 01:57:27.892995 np0000001127 nova-compute[98206]:     </nova:port>
May 21 01:57:27.892995 np0000001127 nova-compute[98206]:   </nova:ports>
May 21 01:57:27.892995 np0000001127 nova-compute[98206]: </nova:instance>
May 21 01:57:27.892995 np0000001127 nova-compute[98206]:  {{(pid=98206) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 21 01:57:27.895388 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-32cfaad8-2403-42bb-8703-fc474f0bac26 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:27.895807 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-32cfaad8-2403-42bb-8703-fc474f0bac26 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:27.899819 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:28.009879 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:57:28.015618 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:57:28.015618 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9c5290c3ede2b72255fff500449a1f12a6f1343.part --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:28.049805 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-6974ecac-4c0a-412e-b37e-589373ed1b74 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 01:57:28.079388 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:28.084982 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:28.105623 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:28.122364 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9c5290c3ede2b72255fff500449a1f12a6f1343.part --force-share --output=json" returned: 0 in 0.107s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:28.126633 np0000001127 nova-compute[98206]: DEBUG nova.virt.images [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] 98434a6a-bf31-4073-8f3c-10081f1d1f22 was qcow2, converting to raw {{(pid=98206) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 21 01:57:28.126677 np0000001127 nova-compute[98206]: DEBUG nova.privsep.utils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 21 01:57:28.128443 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c9c5290c3ede2b72255fff500449a1f12a6f1343.part /opt/stack/data/nova/instances/_base/c9c5290c3ede2b72255fff500449a1f12a6f1343.converted {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:28.153091 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-de709751-1aa9-4b53-bcbb-65b7381f2e27 req-0d68af04-8554-4391-b5a0-da38955ff5f1 service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Received event network-vif-unplugged-bcbb3f8b-362a-4634-8baa-f09e0134e596 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:28.153091 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-de709751-1aa9-4b53-bcbb-65b7381f2e27 req-0d68af04-8554-4391-b5a0-da38955ff5f1 service nova] Acquiring lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:28.153091 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-de709751-1aa9-4b53-bcbb-65b7381f2e27 req-0d68af04-8554-4391-b5a0-da38955ff5f1 service nova] Lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:28.153879 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-de709751-1aa9-4b53-bcbb-65b7381f2e27 req-0d68af04-8554-4391-b5a0-da38955ff5f1 service nova] Lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:28.153879 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-de709751-1aa9-4b53-bcbb-65b7381f2e27 req-0d68af04-8554-4391-b5a0-da38955ff5f1 service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] No waiting events found dispatching network-vif-unplugged-bcbb3f8b-362a-4634-8baa-f09e0134e596 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:57:28.154182 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-de709751-1aa9-4b53-bcbb-65b7381f2e27 req-0d68af04-8554-4391-b5a0-da38955ff5f1 service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Received unexpected event network-vif-unplugged-bcbb3f8b-362a-4634-8baa-f09e0134e596 for instance with vm_state active and task_state None.
May 21 01:57:28.170140 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-c5fa9183-23af-4f1e-a6f1-eea70704d233 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 01:57:28.205892 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:28.214048 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:28.239614 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:28.329396 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:28.340702 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:28.365147 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:28.406253 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:28.474911 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e8090559-4852-4ca9-a1c4-5bf51caaf460 req-75b33785-c965-4501-91dd-7305265e9443 service nova] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Received event network-vif-unplugged-30254ddf-7ff6-4428-817c-93ea13bd4dcd {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:28.475122 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e8090559-4852-4ca9-a1c4-5bf51caaf460 req-75b33785-c965-4501-91dd-7305265e9443 service nova] Acquiring lock "ecf25bc4-b32d-4627-9571-f98869b227f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:28.475337 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e8090559-4852-4ca9-a1c4-5bf51caaf460 req-75b33785-c965-4501-91dd-7305265e9443 service nova] Lock "ecf25bc4-b32d-4627-9571-f98869b227f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:28.475976 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e8090559-4852-4ca9-a1c4-5bf51caaf460 req-75b33785-c965-4501-91dd-7305265e9443 service nova] Lock "ecf25bc4-b32d-4627-9571-f98869b227f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:28.475976 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e8090559-4852-4ca9-a1c4-5bf51caaf460 req-75b33785-c965-4501-91dd-7305265e9443 service nova] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] No waiting events found dispatching network-vif-unplugged-30254ddf-7ff6-4428-817c-93ea13bd4dcd {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:57:28.475976 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e8090559-4852-4ca9-a1c4-5bf51caaf460 req-75b33785-c965-4501-91dd-7305265e9443 service nova] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Received event network-vif-unplugged-30254ddf-7ff6-4428-817c-93ea13bd4dcd for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 01:57:28.487780 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c9c5290c3ede2b72255fff500449a1f12a6f1343.part /opt/stack/data/nova/instances/_base/c9c5290c3ede2b72255fff500449a1f12a6f1343.converted" returned: 0 in 0.359s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:28.501583 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9c5290c3ede2b72255fff500449a1f12a6f1343.converted --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:28.552577 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999177916000008 future=<Future at 0x71c07c518dd0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:57:28.555057 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.996631032000096 future=<Future at 0x71c07c518dd0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:57:28.555209 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.99644630900002 future=<Future at 0x71c07c518dd0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:57:28.562335 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Instance destroyed successfully.
May 21 01:57:28.563315 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-6974ecac-4c0a-412e-b37e-589373ed1b74 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lazy-loading 'resources' on Instance uuid ecf25bc4-b32d-4627-9571-f98869b227f9 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:57:28.571191 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.99749281100003 future=<Future at 0x71c0981d5df0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:57:28.573237 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Instance destroyed successfully.
May 21 01:57:28.574034 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-c5fa9183-23af-4f1e-a6f1-eea70704d233 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lazy-loading 'resources' on Instance uuid 98ace73f-7d4b-4aed-9355-a39c58f9b024 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:57:28.600561 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9c5290c3ede2b72255fff500449a1f12a6f1343.converted --force-share --output=json" returned: 0 in 0.098s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:28.600561 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "c9c5290c3ede2b72255fff500449a1f12a6f1343" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.936s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:28.600561 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:57:28.604080 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:57:28.608049 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9c5290c3ede2b72255fff500449a1f12a6f1343 --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:28.704855 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9c5290c3ede2b72255fff500449a1f12a6f1343 --force-share --output=json" returned: 0 in 0.099s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:28.706233 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "c9c5290c3ede2b72255fff500449a1f12a6f1343" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:28.706876 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "c9c5290c3ede2b72255fff500449a1f12a6f1343" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:28.707516 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:57:28.715730 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:57:28.718001 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9c5290c3ede2b72255fff500449a1f12a6f1343 --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:28.816569 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9c5290c3ede2b72255fff500449a1f12a6f1343 --force-share --output=json" returned: 0 in 0.098s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:28.820496 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c9c5290c3ede2b72255fff500449a1f12a6f1343,backing_fmt=raw /opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:28.881165 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c9c5290c3ede2b72255fff500449a1f12a6f1343,backing_fmt=raw /opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53/disk 1073741824" returned: 0 in 0.063s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:28.884491 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "c9c5290c3ede2b72255fff500449a1f12a6f1343" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.175s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:28.884491 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9c5290c3ede2b72255fff500449a1f12a6f1343 --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:28.966042 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9c5290c3ede2b72255fff500449a1f12a6f1343 --force-share --output=json" returned: 0 in 0.083s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:28.966719 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lazy-loading 'migration_context' on Instance uuid 0059a43c-1d34-40a9-af63-b5eca8c30f53 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:57:29.074313 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-6974ecac-4c0a-412e-b37e-589373ed1b74 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:55:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-606274888-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testmultiattachvolumeswap-server-606274888-1',id=4,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkI1t/5EzMBU18+t/tHR5dUD+OlbYBlLLvWS5mSolnmuGBIj1zOYGzSPX9mbsUvKL1pRiKCgiPAHoaJG8nciLhkFrHXBDpgmLFyWuKaphBcmlHNhzmWEzLHykc5SM0UfA==',key_name='tempest-keypair-142556595',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:56:06Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e35d2fe45bb24d2b9f7b547352683fd4',ramdisk_id='',reservation_id='r-8tc20l86',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-1388661881',owner_user_name='tempest-TestMultiAttachVolumeSwap-1388661881-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:56:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c56a0e645a214e379f2c5ad75804fadc',uuid=ecf25bc4-b32d-4627-9571-f98869b227f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30254ddf-7ff6-4428-817c-93ea13bd4dcd", "address": "fa:16:3e:4a:37:e3", "network": {"id": "97eda448-6d12-4aa9-b1f2-150d371463f1", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-343348586-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e35d2fe45bb24d2b9f7b547352683fd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30254ddf-7f", "ovs_interfaceid": "30254ddf-7ff6-4428-817c-93ea13bd4dcd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 01:57:29.074553 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-6974ecac-4c0a-412e-b37e-589373ed1b74 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Converting VIF {"id": "30254ddf-7ff6-4428-817c-93ea13bd4dcd", "address": "fa:16:3e:4a:37:e3", "network": {"id": "97eda448-6d12-4aa9-b1f2-150d371463f1", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-343348586-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e35d2fe45bb24d2b9f7b547352683fd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30254ddf-7f", "ovs_interfaceid": "30254ddf-7ff6-4428-817c-93ea13bd4dcd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:57:29.075294 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-6974ecac-4c0a-412e-b37e-589373ed1b74 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:37:e3,bridge_name='br-int',has_traffic_filtering=True,id=30254ddf-7ff6-4428-817c-93ea13bd4dcd,network=Network(97eda448-6d12-4aa9-b1f2-150d371463f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30254ddf-7f') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:57:29.075583 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-6974ecac-4c0a-412e-b37e-589373ed1b74 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:37:e3,bridge_name='br-int',has_traffic_filtering=True,id=30254ddf-7ff6-4428-817c-93ea13bd4dcd,network=Network(97eda448-6d12-4aa9-b1f2-150d371463f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30254ddf-7f') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 01:57:29.078743 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-c5fa9183-23af-4f1e-a6f1-eea70704d233 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:55:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-606274888-2',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testmultiattachvolumeswap-server-606274888-2',id=5,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkI1t/5EzMBU18+t/tHR5dUD+OlbYBlLLvWS5mSolnmuGBIj1zOYGzSPX9mbsUvKL1pRiKCgiPAHoaJG8nciLhkFrHXBDpgmLFyWuKaphBcmlHNhzmWEzLHykc5SM0UfA==',key_name='tempest-keypair-142556595',keypairs=<?>,launch_index=1,launched_at=2026-05-21T01:56:08Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e35d2fe45bb24d2b9f7b547352683fd4',ramdisk_id='',reservation_id='r-8tc20l86',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-1388661881',owner_user_name='tempest-TestMultiAttachVolumeSwap-1388661881-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:56:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c56a0e645a214e379f2c5ad75804fadc',uuid=98ace73f-7d4b-4aed-9355-a39c58f9b024,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a36c9ce2-1986-45f2-b2bd-e0bbf396d67a", "address": "fa:16:3e:ee:ec:8e", "network": {"id": "97eda448-6d12-4aa9-b1f2-150d371463f1", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-343348586-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e35d2fe45bb24d2b9f7b547352683fd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36c9ce2-19", "ovs_interfaceid": "a36c9ce2-1986-45f2-b2bd-e0bbf396d67a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 01:57:29.079011 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-c5fa9183-23af-4f1e-a6f1-eea70704d233 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Converting VIF {"id": "a36c9ce2-1986-45f2-b2bd-e0bbf396d67a", "address": "fa:16:3e:ee:ec:8e", "network": {"id": "97eda448-6d12-4aa9-b1f2-150d371463f1", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-343348586-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e35d2fe45bb24d2b9f7b547352683fd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36c9ce2-19", "ovs_interfaceid": "a36c9ce2-1986-45f2-b2bd-e0bbf396d67a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:57:29.079538 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-c5fa9183-23af-4f1e-a6f1-eea70704d233 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:ec:8e,bridge_name='br-int',has_traffic_filtering=True,id=a36c9ce2-1986-45f2-b2bd-e0bbf396d67a,network=Network(97eda448-6d12-4aa9-b1f2-150d371463f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa36c9ce2-19') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:57:29.079783 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-c5fa9183-23af-4f1e-a6f1-eea70704d233 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:ec:8e,bridge_name='br-int',has_traffic_filtering=True,id=a36c9ce2-1986-45f2-b2bd-e0bbf396d67a,network=Network(97eda448-6d12-4aa9-b1f2-150d371463f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa36c9ce2-19') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 01:57:29.081602 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:29.081822 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa36c9ce2-19, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:29.083157 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:29.084009 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:57:29.090961 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:29.090961 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:29.091179 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30254ddf-7f, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:29.093746 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:29.093746 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:57:29.093746 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:29.094293 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:29.094768 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e97d6105-5dd7-4586-9e96-dc600aaef1a2) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:29.096727 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:29.096727 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:57:29.096727 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:29.096933 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:29.096970 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1dd06015-548e-4e90-b5c6-ddd15e5ace22) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:29.099534 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:29.099534 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:57:29.099534 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:29.099763 np0000001127 nova-compute[98206]: INFO os_vif [None req-c5fa9183-23af-4f1e-a6f1-eea70704d233 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:ec:8e,bridge_name='br-int',has_traffic_filtering=True,id=a36c9ce2-1986-45f2-b2bd-e0bbf396d67a,network=Network(97eda448-6d12-4aa9-b1f2-150d371463f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa36c9ce2-19')
May 21 01:57:29.100084 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-c5fa9183-23af-4f1e-a6f1-eea70704d233 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Deleting instance files /opt/stack/data/nova/instances/98ace73f-7d4b-4aed-9355-a39c58f9b024_del
May 21 01:57:29.101513 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-c5fa9183-23af-4f1e-a6f1-eea70704d233 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Deletion of /opt/stack/data/nova/instances/98ace73f-7d4b-4aed-9355-a39c58f9b024_del complete
May 21 01:57:29.105204 np0000001127 nova-compute[98206]: INFO os_vif [None req-6974ecac-4c0a-412e-b37e-589373ed1b74 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:37:e3,bridge_name='br-int',has_traffic_filtering=True,id=30254ddf-7ff6-4428-817c-93ea13bd4dcd,network=Network(97eda448-6d12-4aa9-b1f2-150d371463f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30254ddf-7f')
May 21 01:57:29.105204 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-6974ecac-4c0a-412e-b37e-589373ed1b74 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Deleting instance files /opt/stack/data/nova/instances/ecf25bc4-b32d-4627-9571-f98869b227f9_del
May 21 01:57:29.105781 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-6974ecac-4c0a-412e-b37e-589373ed1b74 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Deletion of /opt/stack/data/nova/instances/ecf25bc4-b32d-4627-9571-f98869b227f9_del complete
May 21 01:57:29.469846 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Object Instance<0059a43c-1d34-40a9-af63-b5eca8c30f53> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 01:57:29.470346 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Rebasing disk image.
May 21 01:57:29.470665 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:29.562982 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.092s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:29.563661 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d -F raw /opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53/disk {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:29.611901 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-c5fa9183-23af-4f1e-a6f1-eea70704d233 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Took 1.44 seconds to destroy the instance on the hypervisor.
May 21 01:57:29.613143 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-c5fa9183-23af-4f1e-a6f1-eea70704d233 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 01:57:29.615163 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 01:57:29.615696 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-6974ecac-4c0a-412e-b37e-589373ed1b74 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Took 1.57 seconds to destroy the instance on the hypervisor.
May 21 01:57:29.616206 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 01:57:29.617239 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-6974ecac-4c0a-412e-b37e-589373ed1b74 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 01:57:29.617514 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 01:57:29.617860 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:29.621180 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 01:57:29.621180 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:29.793607 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:29.833219 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:30.211673 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-17fd43ad-7fe5-4e58-b54c-f9f4b54bd2cf req-fbc38b6f-587f-4b1d-874d-ad741f9c60c9 service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Received event network-vif-unplugged-bcbb3f8b-362a-4634-8baa-f09e0134e596 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:30.211910 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-17fd43ad-7fe5-4e58-b54c-f9f4b54bd2cf req-fbc38b6f-587f-4b1d-874d-ad741f9c60c9 service nova] Acquiring lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:30.212483 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-17fd43ad-7fe5-4e58-b54c-f9f4b54bd2cf req-fbc38b6f-587f-4b1d-874d-ad741f9c60c9 service nova] Lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:30.212675 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-17fd43ad-7fe5-4e58-b54c-f9f4b54bd2cf req-fbc38b6f-587f-4b1d-874d-ad741f9c60c9 service nova] Lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:30.212901 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-17fd43ad-7fe5-4e58-b54c-f9f4b54bd2cf req-fbc38b6f-587f-4b1d-874d-ad741f9c60c9 service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] No waiting events found dispatching network-vif-unplugged-bcbb3f8b-362a-4634-8baa-f09e0134e596 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:57:30.212901 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-17fd43ad-7fe5-4e58-b54c-f9f4b54bd2cf req-fbc38b6f-587f-4b1d-874d-ad741f9c60c9 service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Received unexpected event network-vif-unplugged-bcbb3f8b-362a-4634-8baa-f09e0134e596 for instance with vm_state active and task_state None.
May 21 01:57:30.213017 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-17fd43ad-7fe5-4e58-b54c-f9f4b54bd2cf req-fbc38b6f-587f-4b1d-874d-ad741f9c60c9 service nova] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Received event network-vif-unplugged-a36c9ce2-1986-45f2-b2bd-e0bbf396d67a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:30.213176 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-17fd43ad-7fe5-4e58-b54c-f9f4b54bd2cf req-fbc38b6f-587f-4b1d-874d-ad741f9c60c9 service nova] Acquiring lock "98ace73f-7d4b-4aed-9355-a39c58f9b024-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:30.213281 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-17fd43ad-7fe5-4e58-b54c-f9f4b54bd2cf req-fbc38b6f-587f-4b1d-874d-ad741f9c60c9 service nova] Lock "98ace73f-7d4b-4aed-9355-a39c58f9b024-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:30.213376 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-17fd43ad-7fe5-4e58-b54c-f9f4b54bd2cf req-fbc38b6f-587f-4b1d-874d-ad741f9c60c9 service nova] Lock "98ace73f-7d4b-4aed-9355-a39c58f9b024-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:30.213455 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-17fd43ad-7fe5-4e58-b54c-f9f4b54bd2cf req-fbc38b6f-587f-4b1d-874d-ad741f9c60c9 service nova] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] No waiting events found dispatching network-vif-unplugged-a36c9ce2-1986-45f2-b2bd-e0bbf396d67a {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:57:30.213511 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-17fd43ad-7fe5-4e58-b54c-f9f4b54bd2cf req-fbc38b6f-587f-4b1d-874d-ad741f9c60c9 service nova] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Received event network-vif-unplugged-a36c9ce2-1986-45f2-b2bd-e0bbf396d67a for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 01:57:30.213616 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-17fd43ad-7fe5-4e58-b54c-f9f4b54bd2cf req-fbc38b6f-587f-4b1d-874d-ad741f9c60c9 service nova] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Received event network-vif-unplugged-a36c9ce2-1986-45f2-b2bd-e0bbf396d67a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:30.214139 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-17fd43ad-7fe5-4e58-b54c-f9f4b54bd2cf req-fbc38b6f-587f-4b1d-874d-ad741f9c60c9 service nova] Acquiring lock "98ace73f-7d4b-4aed-9355-a39c58f9b024-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:30.214139 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-17fd43ad-7fe5-4e58-b54c-f9f4b54bd2cf req-fbc38b6f-587f-4b1d-874d-ad741f9c60c9 service nova] Lock "98ace73f-7d4b-4aed-9355-a39c58f9b024-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:30.214139 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-17fd43ad-7fe5-4e58-b54c-f9f4b54bd2cf req-fbc38b6f-587f-4b1d-874d-ad741f9c60c9 service nova] Lock "98ace73f-7d4b-4aed-9355-a39c58f9b024-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:30.214290 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-17fd43ad-7fe5-4e58-b54c-f9f4b54bd2cf req-fbc38b6f-587f-4b1d-874d-ad741f9c60c9 service nova] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] No waiting events found dispatching network-vif-unplugged-a36c9ce2-1986-45f2-b2bd-e0bbf396d67a {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:57:30.214290 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-17fd43ad-7fe5-4e58-b54c-f9f4b54bd2cf req-fbc38b6f-587f-4b1d-874d-ad741f9c60c9 service nova] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Received event network-vif-unplugged-a36c9ce2-1986-45f2-b2bd-e0bbf396d67a for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 01:57:30.214493 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-17fd43ad-7fe5-4e58-b54c-f9f4b54bd2cf req-fbc38b6f-587f-4b1d-874d-ad741f9c60c9 service nova] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Received event network-vif-deleted-a36c9ce2-1986-45f2-b2bd-e0bbf396d67a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:30.214493 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-17fd43ad-7fe5-4e58-b54c-f9f4b54bd2cf req-fbc38b6f-587f-4b1d-874d-ad741f9c60c9 service nova] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Neutron deleted interface a36c9ce2-1986-45f2-b2bd-e0bbf396d67a; detaching it from the instance and deleting it from the info cache
May 21 01:57:30.214874 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-17fd43ad-7fe5-4e58-b54c-f9f4b54bd2cf req-fbc38b6f-587f-4b1d-874d-ad741f9c60c9 service nova] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:57:30.266641 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-32cfaad8-2403-42bb-8703-fc474f0bac26 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Acquiring lock "refresh_cache-6307081b-dd75-4ea3-aad6-d01f2b2b1c9b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:57:30.266641 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-32cfaad8-2403-42bb-8703-fc474f0bac26 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Acquired lock "refresh_cache-6307081b-dd75-4ea3-aad6-d01f2b2b1c9b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:57:30.266641 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-32cfaad8-2403-42bb-8703-fc474f0bac26 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 01:57:30.557093 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8d0a7465-1617-4824-91f1-b0ed4ba5d449 req-d571beab-053d-4b1b-b56f-5ed454a1e0c5 service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Received event network-vif-deleted-bcbb3f8b-362a-4634-8baa-f09e0134e596 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:30.557683 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-8d0a7465-1617-4824-91f1-b0ed4ba5d449 req-d571beab-053d-4b1b-b56f-5ed454a1e0c5 service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Neutron deleted interface bcbb3f8b-362a-4634-8baa-f09e0134e596; detaching it from the instance and deleting it from the info cache
May 21 01:57:30.559330 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-8d0a7465-1617-4824-91f1-b0ed4ba5d449 req-d571beab-053d-4b1b-b56f-5ed454a1e0c5 service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Updating instance_info_cache with network_info: [{"id": "67b86a71-40ec-405f-8d46-56744e34174f", "address": "fa:16:3e:ba:84:92", "network": {"id": "84a294f6-e79d-44ac-90f4-cfa96e67e367", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1771731810-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ffcb955f57a438d998dbdf9bfee0868", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b86a71-40", "ovs_interfaceid": "67b86a71-40ec-405f-8d46-56744e34174f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:57:30.566595 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1d77bebd-9b88-4bf6-9327-6c6726b8a4a8 req-66ecc567-f47f-4f0e-81a2-06d674d2de5b service nova] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Received event network-vif-deleted-30254ddf-7ff6-4428-817c-93ea13bd4dcd {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:30.566595 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-1d77bebd-9b88-4bf6-9327-6c6726b8a4a8 req-66ecc567-f47f-4f0e-81a2-06d674d2de5b service nova] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Neutron deleted interface 30254ddf-7ff6-4428-817c-93ea13bd4dcd; detaching it from the instance and deleting it from the info cache
May 21 01:57:30.566595 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-1d77bebd-9b88-4bf6-9327-6c6726b8a4a8 req-66ecc567-f47f-4f0e-81a2-06d674d2de5b service nova] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:57:30.578127 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:57:30.719213 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-17fd43ad-7fe5-4e58-b54c-f9f4b54bd2cf req-fbc38b6f-587f-4b1d-874d-ad741f9c60c9 service nova] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Detach interface failed, port_id=a36c9ce2-1986-45f2-b2bd-e0bbf396d67a, reason: Instance 98ace73f-7d4b-4aed-9355-a39c58f9b024 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 01:57:30.726979 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d -F raw /opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53/disk" returned: 0 in 1.163s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:30.728051 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 01:57:30.728337 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Ensure instance console log exists: /opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 01:57:30.728727 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:30.728985 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:30.729191 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:30.736546 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Start _get_guest_xml network_info=[{"id": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "address": "fa:16:3e:00:d8:d3", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap839e91da-5f", "ovs_interfaceid": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='fae805de0e373b14202b29651e67f005',container_format='bare',created_at=2026-05-21T01:57:01Z,direct_url=<?>,disk_format='qcow2',id=98434a6a-bf31-4073-8f3c-10081f1d1f22,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1719541415-shelved',owner='2e41dd931ff049868a61f52a251d1122',properties=ImageMetaProps,protected=<?>,size=53608448,status='active',tags=<?>,updated_at=2026-05-21T01:57:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'boot_index': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d', 'iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ad40663d-967d-4ee3-8017-cb0686601c4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attached', 'instance': '0059a43c-1d34-40a9-af63-b5eca8c30f53', 'attached_at': '', 'detached_at': '', 'volume_id': 'ad40663d-967d-4ee3-8017-cb0686601c4d', 'serial': 'ad40663d-967d-4ee3-8017-cb0686601c4d'}, 'delete_on_termination': False, 'attachment_id': '06557e93-ec04-4049-8332-366e3393b189', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 01:57:30.740287 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 01:57:30.745058 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-1719541415', uuid='0059a43c-1d34-40a9-af63-b5eca8c30f53'), owner=OwnerMeta(userid='d91dda570ffb45489f81bd0c87e7fda6', username='tempest-AttachVolumeShelveTestJSON-826866539-project-member', projectid='2e41dd931ff049868a61f52a251d1122', projectname='tempest-AttachVolumeShelveTestJSON-826866539'), image=ImageMeta(id='98434a6a-bf31-4073-8f3c-10081f1d1f22', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "address": "fa:16:3e:00:d8:d3", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap839e91da-5f", "ovs_interfaceid": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328650.7446165) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 01:57:30.749262 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 01:57:30.749262 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 01:57:30.750074 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 01:57:30.750282 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 01:57:30.751624 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 01:57:30.752031 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='fae805de0e373b14202b29651e67f005',container_format='bare',created_at=2026-05-21T01:57:01Z,direct_url=<?>,disk_format='qcow2',id=98434a6a-bf31-4073-8f3c-10081f1d1f22,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1719541415-shelved',owner='2e41dd931ff049868a61f52a251d1122',properties=ImageMetaProps,protected=<?>,size=53608448,status='active',tags=<?>,updated_at=2026-05-21T01:57:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 01:57:30.754138 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 01:57:30.754280 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 01:57:30.754443 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 01:57:30.757490 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 01:57:30.757490 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 01:57:30.757490 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 01:57:30.757490 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 01:57:30.757490 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 01:57:30.757490 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 01:57:30.757490 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 01:57:30.757490 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0059a43c-1d34-40a9-af63-b5eca8c30f53 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:57:30.769812 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-32cfaad8-2403-42bb-8703-fc474f0bac26 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:31.000645 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:57:31.061679 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [req-8d0a7465-1617-4824-91f1-b0ed4ba5d449 req-d571beab-053d-4b1b-b56f-5ed454a1e0c5 service nova] Lazy-loading 'system_metadata' on Instance uuid 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:57:31.073693 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1d77bebd-9b88-4bf6-9327-6c6726b8a4a8 req-66ecc567-f47f-4f0e-81a2-06d674d2de5b service nova] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Detach interface failed, port_id=30254ddf-7ff6-4428-817c-93ea13bd4dcd, reason: Instance ecf25bc4-b32d-4627-9571-f98869b227f9 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 01:57:31.080759 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Took 1.47 seconds to deallocate network for instance.
May 21 01:57:31.105035 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:31.146329 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-32cfaad8-2403-42bb-8703-fc474f0bac26 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:31.262298 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Object Instance<0059a43c-1d34-40a9-af63-b5eca8c30f53> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 01:57:31.274217 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 01:57:31.274597 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d', 'iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ad40663d-967d-4ee3-8017-cb0686601c4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:57:31.274734 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:57:31.275513 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:57:31.275707 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d', 'iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ad40663d-967d-4ee3-8017-cb0686601c4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 01:57:31.290481 np0000001127 nova-compute[98206]: INFO nova.network.neutron [None req-32cfaad8-2403-42bb-8703-fc474f0bac26 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Port bcbb3f8b-362a-4634-8baa-f09e0134e596 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
May 21 01:57:31.290750 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-32cfaad8-2403-42bb-8703-fc474f0bac26 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Updating instance_info_cache with network_info: [{"id": "67b86a71-40ec-405f-8d46-56744e34174f", "address": "fa:16:3e:ba:84:92", "network": {"id": "84a294f6-e79d-44ac-90f4-cfa96e67e367", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1771731810-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ffcb955f57a438d998dbdf9bfee0868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b86a71-40", "ovs_interfaceid": "67b86a71-40ec-405f-8d46-56744e34174f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:57:31.294213 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:57:31.295101 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:57:31.295770 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:57:31.295984 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:57:31.296497 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:57:31.296813 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:57:31.308812 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 01:57:31.308812 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:31.313373 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 01:57:31.313373 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:31.323446 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d] added
May 21 01:57:31.323446 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 01:57:31.323446 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:57:31.323446 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:57:31.323446 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:57:31.323446 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:57:31.323446 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:31.323916 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 01:57:31.323916 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0278(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 01:57:31.324185 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 01:57:31.325720 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d] added
May 21 01:57:31.325720 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 01:57:31.325720 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:57:31.325720 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:57:31.325720 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:57:31.325720 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:57:31.325720 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:31.325973 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 01:57:31.326020 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0293(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 01:57:31.326173 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 01:57:31.501768 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Took 1.88 seconds to deallocate network for instance.
May 21 01:57:31.566379 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [req-8d0a7465-1617-4824-91f1-b0ed4ba5d449 req-d571beab-053d-4b1b-b56f-5ed454a1e0c5 service nova] Lazy-loading 'flavor' on Instance uuid 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:57:31.597674 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c5fa9183-23af-4f1e-a6f1-eea70704d233 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:31.599373 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c5fa9183-23af-4f1e-a6f1-eea70704d233 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:31.798539 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-32cfaad8-2403-42bb-8703-fc474f0bac26 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Releasing lock "refresh_cache-6307081b-dd75-4ea3-aad6-d01f2b2b1c9b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:57:32.013065 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-6974ecac-4c0a-412e-b37e-589373ed1b74 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:32.070041 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [req-8d0a7465-1617-4824-91f1-b0ed4ba5d449 req-d571beab-053d-4b1b-b56f-5ed454a1e0c5 service nova] Object Instance<6307081b-dd75-4ea3-aad6-d01f2b2b1c9b> lazy-loaded attributes: system_metadata,flavor {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 01:57:32.070874 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [req-8d0a7465-1617-4824-91f1-b0ed4ba5d449 req-d571beab-053d-4b1b-b56f-5ed454a1e0c5 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:55:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1663470333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-1663470333',id=2,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXMK1mbiHi5+o6ufBchj3Bb4+HeC3f5IcR98ZEhanB9o7Q5vVQrjHwCh1Z6wl+J1XeMlcfvzOJWsJzB17pBNOXZgD+WEZqVbkZl5Lc12KudDK67GOxtwwklvUeZ02pjPA==',key_name='tempest-keypair-1942385655',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:56:17Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata=<?>,migration_context=None,new_flavor=None,node='np0000001127',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ffcb955f57a438d998dbdf9bfee0868',ramdisk_id='',reservation_id='r-aopg08rx',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1169987238',owner_user_name='tempest-TaggedAttachmentsTest-1169987238-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:56:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd36d5cf62b4dc49bd53ebc09db2a2d',uuid=6307081b-dd75-4ea3-aad6-d01f2b2b1c9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bcbb3f8b-362a-4634-8baa-f09e0134e596", "address": "fa:16:3e:9e:2a:c6", "network": {"id": "1506c578-ffa9-48da-b8bb-2c0ea4a41146", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1947915502", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ffcb955f57a438d998dbdf9bfee0868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcbb3f8b-36", "ovs_interfaceid": "bcbb3f8b-362a-4634-8baa-f09e0134e596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 01:57:32.071082 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [req-8d0a7465-1617-4824-91f1-b0ed4ba5d449 req-d571beab-053d-4b1b-b56f-5ed454a1e0c5 service nova] Converting VIF {"id": "bcbb3f8b-362a-4634-8baa-f09e0134e596", "address": "fa:16:3e:9e:2a:c6", "network": {"id": "1506c578-ffa9-48da-b8bb-2c0ea4a41146", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1947915502", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ffcb955f57a438d998dbdf9bfee0868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcbb3f8b-36", "ovs_interfaceid": "bcbb3f8b-362a-4634-8baa-f09e0134e596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:57:32.071991 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [req-8d0a7465-1617-4824-91f1-b0ed4ba5d449 req-d571beab-053d-4b1b-b56f-5ed454a1e0c5 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:2a:c6,bridge_name='br-int',has_traffic_filtering=True,id=bcbb3f8b-362a-4634-8baa-f09e0134e596,network=Network(1506c578-ffa9-48da-b8bb-2c0ea4a41146),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcbb3f8b-36') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:57:32.074293 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [req-8d0a7465-1617-4824-91f1-b0ed4ba5d449 req-d571beab-053d-4b1b-b56f-5ed454a1e0c5 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9e:2a:c6"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tapbcbb3f8b-36"/></interface> {{(pid=98206) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 21 01:57:32.076414 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [req-8d0a7465-1617-4824-91f1-b0ed4ba5d449 req-d571beab-053d-4b1b-b56f-5ed454a1e0c5 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9e:2a:c6"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tapbcbb3f8b-36"/></interface>not found in domain: <domain type='qemu' id='2'>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:   <name>instance-00000002</name>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:   <uuid>6307081b-dd75-4ea3-aad6-d01f2b2b1c9b</uuid>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:   <metadata>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:   <nova:package version="33.1.0"/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:   <nova:name>tempest-device-tagging-server-1663470333</nova:name>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:   <nova:creationTime>2026-05-21 01:57:27</nova:creationTime>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:   <nova:flavor name="m1.nano" id="42">
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <nova:memory>192</nova:memory>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <nova:disk>1</nova:disk>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <nova:swap>0</nova:swap>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <nova:ephemeral>0</nova:ephemeral>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <nova:vcpus>1</nova:vcpus>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <nova:extraSpecs>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     </nova:extraSpecs>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:   </nova:flavor>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:   <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <nova:containerFormat>bare</nova:containerFormat>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <nova:minDisk>1</nova:minDisk>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <nova:minRam>0</nova:minRam>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <nova:properties>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <nova:property name="hw_machine_type">pc</nova:property>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <nova:property name="hw_video_model">virtio</nova:property>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     </nova:properties>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:   </nova:image>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:   <nova:owner>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <nova:user uuid="0fd36d5cf62b4dc49bd53ebc09db2a2d">tempest-TaggedAttachmentsTest-1169987238-project-member</nova:user>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <nova:project uuid="1ffcb955f57a438d998dbdf9bfee0868">tempest-TaggedAttachmentsTest-1169987238</nova:project>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:   </nova:owner>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:   <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:   <nova:ports>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <nova:port uuid="67b86a71-40ec-405f-8d46-56744e34174f">
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     </nova:port>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:   </nova:ports>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]: </nova:instance>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:   </metadata>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:   <memory unit='KiB'>196608</memory>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:   <currentMemory unit='KiB'>196608</currentMemory>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:   <vcpu placement='static'>1</vcpu>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:   <resource>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <partition>/machine</partition>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:   </resource>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:   <sysinfo type='smbios'>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <system>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <entry name='product'>OpenStack Nova</entry>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <entry name='version'>33.1.0</entry>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <entry name='serial'>6307081b-dd75-4ea3-aad6-d01f2b2b1c9b</entry>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <entry name='uuid'>6307081b-dd75-4ea3-aad6-d01f2b2b1c9b</entry>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <entry name='family'>Virtual Machine</entry>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     </system>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:   <os>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <boot dev='hd'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <smbios mode='sysinfo'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:   </os>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:   <features>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <acpi/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <vmcoreinfo state='on'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <tcg>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <tb-cache unit='KiB'>131072</tb-cache>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     </tcg>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:   </features>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:   <cpu mode='custom' match='exact' check='full'>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <model fallback='forbid'>Nehalem</model>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <feature policy='require' name='hypervisor'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:   <clock offset='utc'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:   <on_poweroff>destroy</on_poweroff>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:   <on_reboot>restart</on_reboot>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:   <on_crash>destroy</on_crash>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:   <devices>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <disk type='file' device='disk'>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <driver name='qemu' type='qcow2' cache='none'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <source file='/opt/stack/data/nova/instances/6307081b-dd75-4ea3-aad6-d01f2b2b1c9b/disk' index='2'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <backingStore type='file' index='3'>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:         <format type='raw'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:         <source file='/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:         <backingStore/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       </backingStore>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <target dev='vda' bus='virtio'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <alias name='virtio-disk0'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     </disk>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <disk type='file' device='cdrom'>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <driver name='qemu' type='raw' cache='none'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <source file='/opt/stack/data/nova/instances/6307081b-dd75-4ea3-aad6-d01f2b2b1c9b/disk.config' index='1'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <backingStore/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <target dev='hda' bus='ide'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <readonly/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <alias name='ide0-0-0'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     </disk>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <controller type='usb' index='0' model='none'>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <alias name='usb'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     </controller>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <controller type='pci' index='0' model='pci-root'>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <alias name='pci.0'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     </controller>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <controller type='ide' index='0'>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <alias name='ide'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     </controller>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <interface type='ethernet'>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <mac address='fa:16:3e:ba:84:92'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <target dev='tap67b86a71-40'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <model type='virtio'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <driver name='qemu'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <mtu size='1372'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <alias name='net0'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     </interface>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <serial type='pty'>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <source path='/dev/pts/1'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <log file='/opt/stack/data/nova/instances/6307081b-dd75-4ea3-aad6-d01f2b2b1c9b/console.log' append='off'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <target type='isa-serial' port='0'>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:         <model name='isa-serial'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       </target>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <alias name='serial0'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     </serial>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <console type='pty' tty='/dev/pts/1'>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <source path='/dev/pts/1'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <log file='/opt/stack/data/nova/instances/6307081b-dd75-4ea3-aad6-d01f2b2b1c9b/console.log' append='off'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <target type='serial' port='0'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <alias name='serial0'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     </console>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <input type='mouse' bus='ps2'>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <alias name='input0'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     </input>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <input type='keyboard' bus='ps2'>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <alias name='input1'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     </input>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <graphics type='vnc' port='5901' autoport='yes' listen='0.0.0.0'>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <listen type='address' address='0.0.0.0'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <audio id='1' type='none'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <video>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <model type='virtio' heads='1' primary='yes'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <alias name='video0'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     </video>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <stats period='10'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <alias name='balloon0'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     </memballoon>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <rng model='virtio'>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <backend model='random'>/dev/urandom</backend>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <alias name='rng0'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     </rng>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:   </devices>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <label>libvirt-6307081b-dd75-4ea3-aad6-d01f2b2b1c9b</label>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <imagelabel>libvirt-6307081b-dd75-4ea3-aad6-d01f2b2b1c9b</imagelabel>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:   </seclabel>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <label>+64055:+993</label>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:     <imagelabel>+64055:+993</imagelabel>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:   </seclabel>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]: </domain>
May 21 01:57:32.076414 np0000001127 nova-compute[98206]:  {{(pid=98206) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 21 01:57:32.081410 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [req-8d0a7465-1617-4824-91f1-b0ed4ba5d449 req-d571beab-053d-4b1b-b56f-5ed454a1e0c5 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9e:2a:c6"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tapbcbb3f8b-36"/></interface> {{(pid=98206) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 21 01:57:32.081410 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [req-8d0a7465-1617-4824-91f1-b0ed4ba5d449 req-d571beab-053d-4b1b-b56f-5ed454a1e0c5 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9e:2a:c6"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tapbcbb3f8b-36"/></interface>not found in domain: <domain type='qemu' id='2'>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:   <name>instance-00000002</name>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:   <uuid>6307081b-dd75-4ea3-aad6-d01f2b2b1c9b</uuid>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:   <metadata>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:   <nova:package version="33.1.0"/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:   <nova:name>tempest-device-tagging-server-1663470333</nova:name>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:   <nova:creationTime>2026-05-21 01:57:27</nova:creationTime>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:   <nova:flavor name="m1.nano" id="42">
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <nova:memory>192</nova:memory>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <nova:disk>1</nova:disk>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <nova:swap>0</nova:swap>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <nova:ephemeral>0</nova:ephemeral>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <nova:vcpus>1</nova:vcpus>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <nova:extraSpecs>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     </nova:extraSpecs>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:   </nova:flavor>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:   <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <nova:containerFormat>bare</nova:containerFormat>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <nova:minDisk>1</nova:minDisk>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <nova:minRam>0</nova:minRam>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <nova:properties>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <nova:property name="hw_machine_type">pc</nova:property>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <nova:property name="hw_video_model">virtio</nova:property>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     </nova:properties>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:   </nova:image>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:   <nova:owner>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <nova:user uuid="0fd36d5cf62b4dc49bd53ebc09db2a2d">tempest-TaggedAttachmentsTest-1169987238-project-member</nova:user>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <nova:project uuid="1ffcb955f57a438d998dbdf9bfee0868">tempest-TaggedAttachmentsTest-1169987238</nova:project>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:   </nova:owner>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:   <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:   <nova:ports>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <nova:port uuid="67b86a71-40ec-405f-8d46-56744e34174f">
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     </nova:port>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:   </nova:ports>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]: </nova:instance>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:   </metadata>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:   <memory unit='KiB'>196608</memory>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:   <currentMemory unit='KiB'>196608</currentMemory>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:   <vcpu placement='static'>1</vcpu>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:   <resource>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <partition>/machine</partition>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:   </resource>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:   <sysinfo type='smbios'>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <system>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <entry name='product'>OpenStack Nova</entry>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <entry name='version'>33.1.0</entry>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <entry name='serial'>6307081b-dd75-4ea3-aad6-d01f2b2b1c9b</entry>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <entry name='uuid'>6307081b-dd75-4ea3-aad6-d01f2b2b1c9b</entry>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <entry name='family'>Virtual Machine</entry>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     </system>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:   <os>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <boot dev='hd'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <smbios mode='sysinfo'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:   </os>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:   <features>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <acpi/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <vmcoreinfo state='on'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <tcg>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <tb-cache unit='KiB'>131072</tb-cache>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     </tcg>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:   </features>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:   <cpu mode='custom' match='exact' check='full'>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <model fallback='forbid'>Nehalem</model>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <feature policy='require' name='hypervisor'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:   <clock offset='utc'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:   <on_poweroff>destroy</on_poweroff>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:   <on_reboot>restart</on_reboot>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:   <on_crash>destroy</on_crash>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:   <devices>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <disk type='file' device='disk'>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <driver name='qemu' type='qcow2' cache='none'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <source file='/opt/stack/data/nova/instances/6307081b-dd75-4ea3-aad6-d01f2b2b1c9b/disk' index='2'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <backingStore type='file' index='3'>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:         <format type='raw'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:         <source file='/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:         <backingStore/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       </backingStore>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <target dev='vda' bus='virtio'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <alias name='virtio-disk0'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     </disk>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <disk type='file' device='cdrom'>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <driver name='qemu' type='raw' cache='none'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <source file='/opt/stack/data/nova/instances/6307081b-dd75-4ea3-aad6-d01f2b2b1c9b/disk.config' index='1'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <backingStore/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <target dev='hda' bus='ide'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <readonly/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <alias name='ide0-0-0'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     </disk>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <controller type='usb' index='0' model='none'>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <alias name='usb'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     </controller>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <controller type='pci' index='0' model='pci-root'>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <alias name='pci.0'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     </controller>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <controller type='ide' index='0'>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <alias name='ide'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     </controller>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <interface type='ethernet'>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <mac address='fa:16:3e:ba:84:92'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <target dev='tap67b86a71-40'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <model type='virtio'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <driver name='qemu'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <mtu size='1372'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <alias name='net0'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     </interface>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <serial type='pty'>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <source path='/dev/pts/1'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <log file='/opt/stack/data/nova/instances/6307081b-dd75-4ea3-aad6-d01f2b2b1c9b/console.log' append='off'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <target type='isa-serial' port='0'>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:         <model name='isa-serial'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       </target>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <alias name='serial0'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     </serial>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <console type='pty' tty='/dev/pts/1'>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <source path='/dev/pts/1'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <log file='/opt/stack/data/nova/instances/6307081b-dd75-4ea3-aad6-d01f2b2b1c9b/console.log' append='off'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <target type='serial' port='0'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <alias name='serial0'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     </console>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <input type='mouse' bus='ps2'>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <alias name='input0'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     </input>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <input type='keyboard' bus='ps2'>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <alias name='input1'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     </input>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <graphics type='vnc' port='5901' autoport='yes' listen='0.0.0.0'>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <listen type='address' address='0.0.0.0'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     </graphics>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <audio id='1' type='none'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <video>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <model type='virtio' heads='1' primary='yes'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <alias name='video0'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     </video>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <stats period='10'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <alias name='balloon0'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     </memballoon>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <rng model='virtio'>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <backend model='random'>/dev/urandom</backend>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <alias name='rng0'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     </rng>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:   </devices>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <label>libvirt-6307081b-dd75-4ea3-aad6-d01f2b2b1c9b</label>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <imagelabel>libvirt-6307081b-dd75-4ea3-aad6-d01f2b2b1c9b</imagelabel>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:   </seclabel>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <label>+64055:+993</label>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:     <imagelabel>+64055:+993</imagelabel>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:   </seclabel>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]: </domain>
May 21 01:57:32.081410 np0000001127 nova-compute[98206]:  {{(pid=98206) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 21 01:57:32.081410 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [req-8d0a7465-1617-4824-91f1-b0ed4ba5d449 req-d571beab-053d-4b1b-b56f-5ed454a1e0c5 service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Detaching interface fa:16:3e:9e:2a:c6 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapbcbb3f8b-36' not found.
May 21 01:57:32.081410 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [req-8d0a7465-1617-4824-91f1-b0ed4ba5d449 req-d571beab-053d-4b1b-b56f-5ed454a1e0c5 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:55:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1663470333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-1663470333',id=2,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXMK1mbiHi5+o6ufBchj3Bb4+HeC3f5IcR98ZEhanB9o7Q5vVQrjHwCh1Z6wl+J1XeMlcfvzOJWsJzB17pBNOXZgD+WEZqVbkZl5Lc12KudDK67GOxtwwklvUeZ02pjPA==',key_name='tempest-keypair-1942385655',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:56:17Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata=<?>,migration_context=None,new_flavor=None,node='np0000001127',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ffcb955f57a438d998dbdf9bfee0868',ramdisk_id='',reservation_id='r-aopg08rx',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1169987238',owner_user_name='tempest-TaggedAttachmentsTest-1169987238-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:56:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd36d5cf62b4dc49bd53ebc09db2a2d',uuid=6307081b-dd75-4ea3-aad6-d01f2b2b1c9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bcbb3f8b-362a-4634-8baa-f09e0134e596", "address": "fa:16:3e:9e:2a:c6", "network": {"id": "1506c578-ffa9-48da-b8bb-2c0ea4a41146", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1947915502", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ffcb955f57a438d998dbdf9bfee0868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcbb3f8b-36", "ovs_interfaceid": "bcbb3f8b-362a-4634-8baa-f09e0134e596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 01:57:32.081410 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [req-8d0a7465-1617-4824-91f1-b0ed4ba5d449 req-d571beab-053d-4b1b-b56f-5ed454a1e0c5 service nova] Converting VIF {"id": "bcbb3f8b-362a-4634-8baa-f09e0134e596", "address": "fa:16:3e:9e:2a:c6", "network": {"id": "1506c578-ffa9-48da-b8bb-2c0ea4a41146", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1947915502", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ffcb955f57a438d998dbdf9bfee0868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcbb3f8b-36", "ovs_interfaceid": "bcbb3f8b-362a-4634-8baa-f09e0134e596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:57:32.081410 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [req-8d0a7465-1617-4824-91f1-b0ed4ba5d449 req-d571beab-053d-4b1b-b56f-5ed454a1e0c5 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:2a:c6,bridge_name='br-int',has_traffic_filtering=True,id=bcbb3f8b-362a-4634-8baa-f09e0134e596,network=Network(1506c578-ffa9-48da-b8bb-2c0ea4a41146),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcbb3f8b-36') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:57:32.086008 np0000001127 nova-compute[98206]: DEBUG os_vif [req-8d0a7465-1617-4824-91f1-b0ed4ba5d449 req-d571beab-053d-4b1b-b56f-5ed454a1e0c5 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:2a:c6,bridge_name='br-int',has_traffic_filtering=True,id=bcbb3f8b-362a-4634-8baa-f09e0134e596,network=Network(1506c578-ffa9-48da-b8bb-2c0ea4a41146),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcbb3f8b-36') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 01:57:32.086008 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:32.086008 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbcbb3f8b-36, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:32.086008 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 01:57:32.087974 np0000001127 nova-compute[98206]: INFO os_vif [req-8d0a7465-1617-4824-91f1-b0ed4ba5d449 req-d571beab-053d-4b1b-b56f-5ed454a1e0c5 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:2a:c6,bridge_name='br-int',has_traffic_filtering=True,id=bcbb3f8b-362a-4634-8baa-f09e0134e596,network=Network(1506c578-ffa9-48da-b8bb-2c0ea4a41146),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcbb3f8b-36')
May 21 01:57:32.089073 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [req-8d0a7465-1617-4824-91f1-b0ed4ba5d449 req-d571beab-053d-4b1b-b56f-5ed454a1e0c5 service nova] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1663470333', uuid='6307081b-dd75-4ea3-aad6-d01f2b2b1c9b'), owner=OwnerMeta(userid='0fd36d5cf62b4dc49bd53ebc09db2a2d', username='tempest-TaggedAttachmentsTest-1169987238-project-member', projectid='1ffcb955f57a438d998dbdf9bfee0868', projectname='tempest-TaggedAttachmentsTest-1169987238'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "67b86a71-40ec-405f-8d46-56744e34174f", "address": "fa:16:3e:ba:84:92", "network": {"id": "84a294f6-e79d-44ac-90f4-cfa96e67e367", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1771731810-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ffcb955f57a438d998dbdf9bfee0868", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b86a71-40", "ovs_interfaceid": "67b86a71-40ec-405f-8d46-56744e34174f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328652.088692) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 01:57:32.089741 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [req-8d0a7465-1617-4824-91f1-b0ed4ba5d449 req-d571beab-053d-4b1b-b56f-5ed454a1e0c5 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 01:57:32.089741 np0000001127 nova-compute[98206]:   <nova:package version="33.1.0"/>
May 21 01:57:32.089741 np0000001127 nova-compute[98206]:   <nova:name>tempest-device-tagging-server-1663470333</nova:name>
May 21 01:57:32.089741 np0000001127 nova-compute[98206]:   <nova:creationTime>2026-05-21 01:57:32</nova:creationTime>
May 21 01:57:32.089741 np0000001127 nova-compute[98206]:   <nova:flavor name="m1.nano" id="42">
May 21 01:57:32.089741 np0000001127 nova-compute[98206]:     <nova:memory>192</nova:memory>
May 21 01:57:32.089741 np0000001127 nova-compute[98206]:     <nova:disk>1</nova:disk>
May 21 01:57:32.089741 np0000001127 nova-compute[98206]:     <nova:swap>0</nova:swap>
May 21 01:57:32.089741 np0000001127 nova-compute[98206]:     <nova:ephemeral>0</nova:ephemeral>
May 21 01:57:32.089741 np0000001127 nova-compute[98206]:     <nova:vcpus>1</nova:vcpus>
May 21 01:57:32.089741 np0000001127 nova-compute[98206]:     <nova:extraSpecs>
May 21 01:57:32.089741 np0000001127 nova-compute[98206]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 01:57:32.089741 np0000001127 nova-compute[98206]:     </nova:extraSpecs>
May 21 01:57:32.089741 np0000001127 nova-compute[98206]:   </nova:flavor>
May 21 01:57:32.089741 np0000001127 nova-compute[98206]:   <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 01:57:32.089741 np0000001127 nova-compute[98206]:     <nova:containerFormat>bare</nova:containerFormat>
May 21 01:57:32.089741 np0000001127 nova-compute[98206]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 21 01:57:32.089741 np0000001127 nova-compute[98206]:     <nova:minDisk>1</nova:minDisk>
May 21 01:57:32.089741 np0000001127 nova-compute[98206]:     <nova:minRam>0</nova:minRam>
May 21 01:57:32.089741 np0000001127 nova-compute[98206]:     <nova:properties>
May 21 01:57:32.089741 np0000001127 nova-compute[98206]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 21 01:57:32.089741 np0000001127 nova-compute[98206]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 21 01:57:32.089741 np0000001127 nova-compute[98206]:       <nova:property name="hw_machine_type">pc</nova:property>
May 21 01:57:32.089741 np0000001127 nova-compute[98206]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 21 01:57:32.089741 np0000001127 nova-compute[98206]:       <nova:property name="hw_video_model">virtio</nova:property>
May 21 01:57:32.089741 np0000001127 nova-compute[98206]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 21 01:57:32.089741 np0000001127 nova-compute[98206]:     </nova:properties>
May 21 01:57:32.089741 np0000001127 nova-compute[98206]:   </nova:image>
May 21 01:57:32.089741 np0000001127 nova-compute[98206]:   <nova:owner>
May 21 01:57:32.089741 np0000001127 nova-compute[98206]:     <nova:user uuid="0fd36d5cf62b4dc49bd53ebc09db2a2d">tempest-TaggedAttachmentsTest-1169987238-project-member</nova:user>
May 21 01:57:32.089741 np0000001127 nova-compute[98206]:     <nova:project uuid="1ffcb955f57a438d998dbdf9bfee0868">tempest-TaggedAttachmentsTest-1169987238</nova:project>
May 21 01:57:32.089741 np0000001127 nova-compute[98206]:   </nova:owner>
May 21 01:57:32.089741 np0000001127 nova-compute[98206]:   <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 01:57:32.089741 np0000001127 nova-compute[98206]:   <nova:ports>
May 21 01:57:32.089741 np0000001127 nova-compute[98206]:     <nova:port uuid="67b86a71-40ec-405f-8d46-56744e34174f">
May 21 01:57:32.089741 np0000001127 nova-compute[98206]:       <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 21 01:57:32.089741 np0000001127 nova-compute[98206]:     </nova:port>
May 21 01:57:32.089741 np0000001127 nova-compute[98206]:   </nova:ports>
May 21 01:57:32.089741 np0000001127 nova-compute[98206]: </nova:instance>
May 21 01:57:32.089741 np0000001127 nova-compute[98206]:  {{(pid=98206) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 21 01:57:32.091919 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8d0a7465-1617-4824-91f1-b0ed4ba5d449 req-d571beab-053d-4b1b-b56f-5ed454a1e0c5 service nova] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Received event network-vif-unplugged-30254ddf-7ff6-4428-817c-93ea13bd4dcd {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:32.092146 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8d0a7465-1617-4824-91f1-b0ed4ba5d449 req-d571beab-053d-4b1b-b56f-5ed454a1e0c5 service nova] Acquiring lock "ecf25bc4-b32d-4627-9571-f98869b227f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:32.092760 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8d0a7465-1617-4824-91f1-b0ed4ba5d449 req-d571beab-053d-4b1b-b56f-5ed454a1e0c5 service nova] Lock "ecf25bc4-b32d-4627-9571-f98869b227f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:32.092949 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8d0a7465-1617-4824-91f1-b0ed4ba5d449 req-d571beab-053d-4b1b-b56f-5ed454a1e0c5 service nova] Lock "ecf25bc4-b32d-4627-9571-f98869b227f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:32.093115 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8d0a7465-1617-4824-91f1-b0ed4ba5d449 req-d571beab-053d-4b1b-b56f-5ed454a1e0c5 service nova] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] No waiting events found dispatching network-vif-unplugged-30254ddf-7ff6-4428-817c-93ea13bd4dcd {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:57:32.093303 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8d0a7465-1617-4824-91f1-b0ed4ba5d449 req-d571beab-053d-4b1b-b56f-5ed454a1e0c5 service nova] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Received event network-vif-unplugged-30254ddf-7ff6-4428-817c-93ea13bd4dcd for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 01:57:32.158228 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c5fa9183-23af-4f1e-a6f1-eea70704d233 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:57:32.158407 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-c5fa9183-23af-4f1e-a6f1-eea70704d233 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:57:32.301623 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-32cfaad8-2403-42bb-8703-fc474f0bac26 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lock "interface-6307081b-dd75-4ea3-aad6-d01f2b2b1c9b-bcbb3f8b-362a-4634-8baa-f09e0134e596" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 6.579s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:32.324671 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:57:32.326674 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.startup = manual
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:57:32.338722 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:57:32.338722 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.startup = manual
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:57:32.345095 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:57:32.345095 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:32.351256 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:32.359345 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:32.368934 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:32.368934 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:32.368934 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:32.368934 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:32.368934 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:32.368934 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:32.368934 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:57:32.369218 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] iscsi session list stdout=tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:32.369218 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:32.369218 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:32.369218 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:32.369218 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:32.369218 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:32.369218 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:57:32.374754 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:32.374754 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:32.374754 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:32.374754 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:32.374754 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:32.374754 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:32.374754 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:57:32.375241 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] iscsi session list stdout=tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:32.375241 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:32.375241 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:32.375241 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:32.375241 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:32.375241 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:32.375241 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:57:32.409008 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d, portal: 192.168.50.100,3260]
May 21 01:57:32.409008 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d, portal: 192.168.50.100,3260] successful.
May 21 01:57:32.409008 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:32.424168 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:32.431679 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d, portal: 192.168.40.100,3260]
May 21 01:57:32.431679 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d, portal: 192.168.40.100,3260] successful.
May 21 01:57:32.431679 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:32.441773 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:32.441773 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:32.441773 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:32.441773 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:32.441773 np0000001127 nova-compute[98206]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:57:32.441773 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:57:32.441773 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:32.441773 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:32.441773 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:57:32.442144 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] iscsi session list stdout=tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:32.442144 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:32.442144 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:32.442144 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:32.442144 np0000001127 nova-compute[98206]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:57:32.442144 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:57:32.442144 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:32.442144 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:32.442144 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:57:32.442499 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.147s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:57:32.442499 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:57:32.446084 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] HCTL ('11', '-', '-', 0) found on session 18 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:57:32.446236 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:57:32.454114 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:32.474918 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Searching for a device in session 18 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:57:32.475160 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ad40663d-967d-4ee3-8017-cb0686601c4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:57:32.486686 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:32.486686 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:32.486686 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:32.486686 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:32.486686 np0000001127 nova-compute[98206]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:57:32.486686 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:57:32.486686 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:32.486686 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:32.486686 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:57:32.487227 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] iscsi session list stdout=tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:32.487227 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:32.487227 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:32.487227 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:32.487227 np0000001127 nova-compute[98206]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:57:32.487227 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:57:32.487227 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:32.487227 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:32.487227 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:57:32.487227 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.191s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:57:32.487605 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:57:32.488547 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] HCTL ('12', '-', '-', 0) found on session 19 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:57:32.488608 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:57:32.505538 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Searching for a device in session 19 and hctl ['12', '*', '*', 0] yield: None {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:57:32.530627 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:32.660989 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-c5fa9183-23af-4f1e-a6f1-eea70704d233 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:57:33.174053 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c5fa9183-23af-4f1e-a6f1-eea70704d233 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.575s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:33.174399 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-6974ecac-4c0a-412e-b37e-589373ed1b74 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.161s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:33.275744 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-c5fa9183-23af-4f1e-a6f1-eea70704d233 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Deleted allocations for instance 98ace73f-7d4b-4aed-9355-a39c58f9b024
May 21 01:57:33.507010 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Searching for a device in session 19 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:57:33.507010 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ad40663d-967d-4ee3-8017-cb0686601c4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:57:33.634889 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-6974ecac-4c0a-412e-b37e-589373ed1b74 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:57:33.635075 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-6974ecac-4c0a-412e-b37e-589373ed1b74 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:57:33.708279 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-28ddfabf-0ae1-416f-8794-215f1d1d93a4 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Acquiring lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:33.708279 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-28ddfabf-0ae1-416f-8794-215f1d1d93a4 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:33.708279 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-28ddfabf-0ae1-416f-8794-215f1d1d93a4 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Acquiring lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:33.708279 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-28ddfabf-0ae1-416f-8794-215f1d1d93a4 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:33.708279 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-28ddfabf-0ae1-416f-8794-215f1d1d93a4 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:33.710302 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-28ddfabf-0ae1-416f-8794-215f1d1d93a4 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Terminating instance
May 21 01:57:34.098641 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:34.137596 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-6974ecac-4c0a-412e-b37e-589373ed1b74 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:57:34.213186 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-28ddfabf-0ae1-416f-8794-215f1d1d93a4 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 01:57:34.231067 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:34.233815 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:34.261787 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:34.264434 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:34.286213 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c5fa9183-23af-4f1e-a6f1-eea70704d233 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "98ace73f-7d4b-4aed-9355-a39c58f9b024" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.633s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:34.294032 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:34.313703 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Found WWN 3300000005e216863 for multipath device dm-4 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 01:57:34.314421 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:57:34.314551 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '3300000005e216863', 'path': '/dev/dm-4', 'multipath_id': '3300000005e216863'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:57:34.315312 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005e216863', 'path': '/dev/dm-4', 'multipath_id': '3300000005e216863'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 01:57:34.404514 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:34.483851 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cc92a546-40ce-4731-a28e-47b9f57c4a6a req-ddcfc34f-42fb-443d-9d14-497fdf3b47fe service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Received event network-vif-unplugged-67b86a71-40ec-405f-8d46-56744e34174f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:34.484003 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cc92a546-40ce-4731-a28e-47b9f57c4a6a req-ddcfc34f-42fb-443d-9d14-497fdf3b47fe service nova] Acquiring lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:34.484133 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cc92a546-40ce-4731-a28e-47b9f57c4a6a req-ddcfc34f-42fb-443d-9d14-497fdf3b47fe service nova] Lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:34.484240 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cc92a546-40ce-4731-a28e-47b9f57c4a6a req-ddcfc34f-42fb-443d-9d14-497fdf3b47fe service nova] Lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:34.484377 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cc92a546-40ce-4731-a28e-47b9f57c4a6a req-ddcfc34f-42fb-443d-9d14-497fdf3b47fe service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] No waiting events found dispatching network-vif-unplugged-67b86a71-40ec-405f-8d46-56744e34174f {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:57:34.484539 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cc92a546-40ce-4731-a28e-47b9f57c4a6a req-ddcfc34f-42fb-443d-9d14-497fdf3b47fe service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Received event network-vif-unplugged-67b86a71-40ec-405f-8d46-56744e34174f for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 01:57:34.565210 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999613584000144 future=<Future at 0x71c0a255c8c0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:57:34.568958 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Instance destroyed successfully.
May 21 01:57:34.569514 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-28ddfabf-0ae1-416f-8794-215f1d1d93a4 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lazy-loading 'resources' on Instance uuid 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:57:34.644753 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-6974ecac-4c0a-412e-b37e-589373ed1b74 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.471s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:34.716594 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-6974ecac-4c0a-412e-b37e-589373ed1b74 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Deleted allocations for instance ecf25bc4-b32d-4627-9571-f98869b227f9
May 21 01:57:34.823184 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-21T01:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1719541415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumeshelvetestjson-server-1719541415',id=1,image_ref='98434a6a-bf31-4073-8f3c-10081f1d1f22',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1216999249',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:56:17Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2e41dd931ff049868a61f52a251d1122',ramdisk_id='',reservation_id='r-2une16cp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-826866539',owner_user_name='tempest-AttachVolumeShelveTestJSON-826866539-project-member',shelved_at='2026-05-21T01:57:09.008618',shelved_host='np0000001127',shelved_image_id='98434a6a-bf31-4073-8f3c-10081f1d1f22'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:57:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d91dda570ffb45489f81bd0c87e7fda6',uuid=0059a43c-1d34-40a9-af63-b5eca8c30f53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "address": "fa:16:3e:00:d8:d3", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap839e91da-5f", "ovs_interfaceid": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 01:57:34.823486 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Converting VIF {"id": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "address": "fa:16:3e:00:d8:d3", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap839e91da-5f", "ovs_interfaceid": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:57:34.824577 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:d8:d3,bridge_name='br-int',has_traffic_filtering=True,id=839e91da-5ffe-451b-bd9d-dfc1cf83ab19,network=Network(084a1218-5c9f-4f1e-855b-53d284a5202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839e91da-5f') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:57:34.824834 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lazy-loading 'pci_devices' on Instance uuid 0059a43c-1d34-40a9-af63-b5eca8c30f53 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:57:35.074378 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-28ddfabf-0ae1-416f-8794-215f1d1d93a4 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:55:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1663470333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-1663470333',id=2,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXMK1mbiHi5+o6ufBchj3Bb4+HeC3f5IcR98ZEhanB9o7Q5vVQrjHwCh1Z6wl+J1XeMlcfvzOJWsJzB17pBNOXZgD+WEZqVbkZl5Lc12KudDK67GOxtwwklvUeZ02pjPA==',key_name='tempest-keypair-1942385655',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:56:17Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ffcb955f57a438d998dbdf9bfee0868',ramdisk_id='',reservation_id='r-aopg08rx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1169987238',owner_user_name='tempest-TaggedAttachmentsTest-1169987238-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:56:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd36d5cf62b4dc49bd53ebc09db2a2d',uuid=6307081b-dd75-4ea3-aad6-d01f2b2b1c9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67b86a71-40ec-405f-8d46-56744e34174f", "address": "fa:16:3e:ba:84:92", "network": {"id": "84a294f6-e79d-44ac-90f4-cfa96e67e367", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1771731810-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ffcb955f57a438d998dbdf9bfee0868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b86a71-40", "ovs_interfaceid": "67b86a71-40ec-405f-8d46-56744e34174f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 01:57:35.074378 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-28ddfabf-0ae1-416f-8794-215f1d1d93a4 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Converting VIF {"id": "67b86a71-40ec-405f-8d46-56744e34174f", "address": "fa:16:3e:ba:84:92", "network": {"id": "84a294f6-e79d-44ac-90f4-cfa96e67e367", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1771731810-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ffcb955f57a438d998dbdf9bfee0868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b86a71-40", "ovs_interfaceid": "67b86a71-40ec-405f-8d46-56744e34174f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:57:35.075126 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-28ddfabf-0ae1-416f-8794-215f1d1d93a4 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:84:92,bridge_name='br-int',has_traffic_filtering=True,id=67b86a71-40ec-405f-8d46-56744e34174f,network=Network(84a294f6-e79d-44ac-90f4-cfa96e67e367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67b86a71-40') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:57:35.075126 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-28ddfabf-0ae1-416f-8794-215f1d1d93a4 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:84:92,bridge_name='br-int',has_traffic_filtering=True,id=67b86a71-40ec-405f-8d46-56744e34174f,network=Network(84a294f6-e79d-44ac-90f4-cfa96e67e367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67b86a71-40') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 01:57:35.076899 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:35.077122 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67b86a71-40, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:35.079502 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:35.080298 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:57:35.081362 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:35.081841 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:35.082309 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=42665b22-099c-4108-89f3-02c69fdbc4e3) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:35.083071 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:35.083367 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:57:35.086179 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:35.087873 np0000001127 nova-compute[98206]: INFO os_vif [None req-28ddfabf-0ae1-416f-8794-215f1d1d93a4 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:84:92,bridge_name='br-int',has_traffic_filtering=True,id=67b86a71-40ec-405f-8d46-56744e34174f,network=Network(84a294f6-e79d-44ac-90f4-cfa96e67e367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67b86a71-40')
May 21 01:57:35.088270 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-28ddfabf-0ae1-416f-8794-215f1d1d93a4 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Deleting instance files /opt/stack/data/nova/instances/6307081b-dd75-4ea3-aad6-d01f2b2b1c9b_del
May 21 01:57:35.089235 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-28ddfabf-0ae1-416f-8794-215f1d1d93a4 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Deletion of /opt/stack/data/nova/instances/6307081b-dd75-4ea3-aad6-d01f2b2b1c9b_del complete
May 21 01:57:35.326985 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Object Instance<0059a43c-1d34-40a9-af63-b5eca8c30f53> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 01:57:35.328548 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] End _get_guest_xml xml=<domain type="qemu">
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:   <uuid>0059a43c-1d34-40a9-af63-b5eca8c30f53</uuid>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:   <name>instance-00000001</name>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:   <metadata>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1719541415</nova:name>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 01:57:30</nova:creationTime>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:           <nova:property name="hw_machine_type">pc</nova:property>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:           <nova:property name="hw_video_model">virtio</nova:property>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:       </nova:image>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:         <nova:user uuid="d91dda570ffb45489f81bd0c87e7fda6">tempest-AttachVolumeShelveTestJSON-826866539-project-member</nova:user>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:         <nova:project uuid="2e41dd931ff049868a61f52a251d1122">tempest-AttachVolumeShelveTestJSON-826866539</nova:project>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:         <nova:port uuid="839e91da-5ffe-451b-bd9d-dfc1cf83ab19">
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:         </nova:port>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:   </metadata>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:     <system>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:       <entry name="serial">0059a43c-1d34-40a9-af63-b5eca8c30f53</entry>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:       <entry name="uuid">0059a43c-1d34-40a9-af63-b5eca8c30f53</entry>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:     </system>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:   <os>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:   </os>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:   <features>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:     <acpi/>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:     <tcg>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:     </tcg>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:   </features>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:   <devices>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53/disk"/>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:     </disk>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53/disk.config"/>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:     </disk>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:       <alias name="ua-ad40663d-967d-4ee3-8017-cb0686601c4d"/>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-4"/>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:       <target dev="vdc" bus="virtio"/>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:       <serial>ad40663d-967d-4ee3-8017-cb0686601c4d</serial>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:     </disk>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:00:d8:d3"/>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:       <target dev="tap839e91da-5f"/>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:     </interface>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53/console.log" append="off"/>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:     </serial>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:     <video>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:     </video>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:     </rng>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:     </memballoon>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:   </devices>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]: </domain>
May 21 01:57:35.328548 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 01:57:35.330616 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Preparing to wait for external event network-vif-plugged-839e91da-5ffe-451b-bd9d-dfc1cf83ab19 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 01:57:35.330616 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "0059a43c-1d34-40a9-af63-b5eca8c30f53-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:35.330616 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "0059a43c-1d34-40a9-af63-b5eca8c30f53-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:35.330616 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "0059a43c-1d34-40a9-af63-b5eca8c30f53-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:35.330616 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-21T01:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1719541415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumeshelvetestjson-server-1719541415',id=1,image_ref='98434a6a-bf31-4073-8f3c-10081f1d1f22',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1216999249',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:56:17Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2e41dd931ff049868a61f52a251d1122',ramdisk_id='',reservation_id='r-2une16cp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-826866539',owner_user_name='tempest-AttachVolumeShelveTestJSON-826866539-project-member',shelved_at='2026-05-21T01:57:09.008618',shelved_host='np0000001127',shelved_image_id='98434a6a-bf31-4073-8f3c-10081f1d1f22'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:57:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d91dda570ffb45489f81bd0c87e7fda6',uuid=0059a43c-1d34-40a9-af63-b5eca8c30f53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "address": "fa:16:3e:00:d8:d3", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap839e91da-5f", "ovs_interfaceid": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 01:57:35.330616 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Converting VIF {"id": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "address": "fa:16:3e:00:d8:d3", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap839e91da-5f", "ovs_interfaceid": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:57:35.331125 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:d8:d3,bridge_name='br-int',has_traffic_filtering=True,id=839e91da-5ffe-451b-bd9d-dfc1cf83ab19,network=Network(084a1218-5c9f-4f1e-855b-53d284a5202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839e91da-5f') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:57:35.331395 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:d8:d3,bridge_name='br-int',has_traffic_filtering=True,id=839e91da-5ffe-451b-bd9d-dfc1cf83ab19,network=Network(084a1218-5c9f-4f1e-855b-53d284a5202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839e91da-5f') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 01:57:35.333848 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:35.333848 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:35.333848 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 01:57:35.335455 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:35.335455 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9a07c05c-9833-50a3-bc04-f1d8c5680230', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:35.336760 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:35.336760 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:57:35.337866 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:35.340868 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:35.340868 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap839e91da-5f, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:35.340868 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap839e91da-5f, col_values=(('qos', UUID('2ac8c166-e104-4e88-a49f-17e549ff9151')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:35.340868 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap839e91da-5f, col_values=(('external_ids', {'iface-id': '839e91da-5ffe-451b-bd9d-dfc1cf83ab19', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:d8:d3', 'vm-uuid': '0059a43c-1d34-40a9-af63-b5eca8c30f53'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:57:35.341463 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:35.343706 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:57:35.349884 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:35.350170 np0000001127 nova-compute[98206]: INFO os_vif [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:d8:d3,bridge_name='br-int',has_traffic_filtering=True,id=839e91da-5ffe-451b-bd9d-dfc1cf83ab19,network=Network(084a1218-5c9f-4f1e-855b-53d284a5202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839e91da-5f')
May 21 01:57:35.603785 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-28ddfabf-0ae1-416f-8794-215f1d1d93a4 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Took 1.39 seconds to destroy the instance on the hypervisor.
May 21 01:57:35.604630 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-28ddfabf-0ae1-416f-8794-215f1d1d93a4 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 01:57:35.604967 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 01:57:35.605080 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 01:57:35.605370 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:35.720065 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:35.734551 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-6974ecac-4c0a-412e-b37e-589373ed1b74 tempest-TestMultiAttachVolumeSwap-1388661881 tempest-TestMultiAttachVolumeSwap-1388661881-project-member] Lock "ecf25bc4-b32d-4627-9571-f98869b227f9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.200s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:36.105882 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:36.572326 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1c96a36d-11ed-400d-a896-5c857675b17d req-513e3a4a-1d2f-46a2-8aae-9ec7fe4cca1b service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Received event network-vif-unplugged-67b86a71-40ec-405f-8d46-56744e34174f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:36.572326 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1c96a36d-11ed-400d-a896-5c857675b17d req-513e3a4a-1d2f-46a2-8aae-9ec7fe4cca1b service nova] Acquiring lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:36.572326 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1c96a36d-11ed-400d-a896-5c857675b17d req-513e3a4a-1d2f-46a2-8aae-9ec7fe4cca1b service nova] Lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:36.572326 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1c96a36d-11ed-400d-a896-5c857675b17d req-513e3a4a-1d2f-46a2-8aae-9ec7fe4cca1b service nova] Lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:36.572326 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1c96a36d-11ed-400d-a896-5c857675b17d req-513e3a4a-1d2f-46a2-8aae-9ec7fe4cca1b service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] No waiting events found dispatching network-vif-unplugged-67b86a71-40ec-405f-8d46-56744e34174f {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:57:36.572326 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1c96a36d-11ed-400d-a896-5c857675b17d req-513e3a4a-1d2f-46a2-8aae-9ec7fe4cca1b service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Received event network-vif-unplugged-67b86a71-40ec-405f-8d46-56744e34174f for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 01:57:36.572326 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1c96a36d-11ed-400d-a896-5c857675b17d req-513e3a4a-1d2f-46a2-8aae-9ec7fe4cca1b service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Received event network-vif-deleted-67b86a71-40ec-405f-8d46-56744e34174f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:36.572326 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-1c96a36d-11ed-400d-a896-5c857675b17d req-513e3a4a-1d2f-46a2-8aae-9ec7fe4cca1b service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Neutron deleted interface 67b86a71-40ec-405f-8d46-56744e34174f; detaching it from the instance and deleting it from the info cache
May 21 01:57:36.572326 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-1c96a36d-11ed-400d-a896-5c857675b17d req-513e3a4a-1d2f-46a2-8aae-9ec7fe4cca1b service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:57:36.749022 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:57:36.868297 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:57:36.870576 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:57:36.870576 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:57:36.870576 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] No VIF found with MAC fa:16:3e:00:d8:d3, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 01:57:36.870576 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Using config drive
May 21 01:57:37.075356 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1c96a36d-11ed-400d-a896-5c857675b17d req-513e3a4a-1d2f-46a2-8aae-9ec7fe4cca1b service nova] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Detach interface failed, port_id=67b86a71-40ec-405f-8d46-56744e34174f, reason: Instance 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 01:57:37.251611 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Took 1.65 seconds to deallocate network for instance.
May 21 01:57:37.373288 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lazy-loading 'ec2_ids' on Instance uuid 0059a43c-1d34-40a9-af63-b5eca8c30f53 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:57:37.758809 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-28ddfabf-0ae1-416f-8794-215f1d1d93a4 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:37.759227 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-28ddfabf-0ae1-416f-8794-215f1d1d93a4 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:37.877493 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Object Instance<0059a43c-1d34-40a9-af63-b5eca8c30f53> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 01:57:37.877601 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lazy-loading 'keypairs' on Instance uuid 0059a43c-1d34-40a9-af63-b5eca8c30f53 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:57:38.099404 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:38.112699 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-28ddfabf-0ae1-416f-8794-215f1d1d93a4 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:57:38.112985 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-28ddfabf-0ae1-416f-8794-215f1d1d93a4 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:57:38.380500 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Object Instance<0059a43c-1d34-40a9-af63-b5eca8c30f53> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 01:57:38.384120 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:38.579362 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Creating config drive at /opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53/disk.config
May 21 01:57:38.589189 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpghpbcm32 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:38.617678 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-28ddfabf-0ae1-416f-8794-215f1d1d93a4 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:57:38.628072 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpghpbcm32" returned: 0 in 0.039s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:38.676495 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:57:38.676650 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Cleaning up deleted instances {{(pid=98206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}
May 21 01:57:39.133238 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-28ddfabf-0ae1-416f-8794-215f1d1d93a4 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.373s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:39.170632 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:39.180580 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] There are 0 instances to clean {{(pid=98206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12092}}
May 21 01:57:39.183698 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:57:39.183698 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98206) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12121}}
May 21 01:57:39.205090 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:39.205090 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:39.263871 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-28ddfabf-0ae1-416f-8794-215f1d1d93a4 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Deleted allocations for instance 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b
May 21 01:57:39.292993 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:39.536866 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:39.542318 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:39.549490 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:39.550300 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:39.573056 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:39.605965 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d392c76c-7a4b-4473-b4b7-c8846baf9abc req-bf81a6be-d2b3-47f2-b0c8-7f6421da7395 service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Received event network-vif-plugged-839e91da-5ffe-451b-bd9d-dfc1cf83ab19 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:39.606731 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d392c76c-7a4b-4473-b4b7-c8846baf9abc req-bf81a6be-d2b3-47f2-b0c8-7f6421da7395 service nova] Acquiring lock "0059a43c-1d34-40a9-af63-b5eca8c30f53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:39.606932 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d392c76c-7a4b-4473-b4b7-c8846baf9abc req-bf81a6be-d2b3-47f2-b0c8-7f6421da7395 service nova] Lock "0059a43c-1d34-40a9-af63-b5eca8c30f53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:39.607087 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d392c76c-7a4b-4473-b4b7-c8846baf9abc req-bf81a6be-d2b3-47f2-b0c8-7f6421da7395 service nova] Lock "0059a43c-1d34-40a9-af63-b5eca8c30f53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:39.607437 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d392c76c-7a4b-4473-b4b7-c8846baf9abc req-bf81a6be-d2b3-47f2-b0c8-7f6421da7395 service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Processing event network-vif-plugged-839e91da-5ffe-451b-bd9d-dfc1cf83ab19 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 01:57:39.685221 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:57:40.190547 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 01:57:40.272496 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-28ddfabf-0ae1-416f-8794-215f1d1d93a4 tempest-TaggedAttachmentsTest-1169987238 tempest-TaggedAttachmentsTest-1169987238-project-member] Lock "6307081b-dd75-4ea3-aad6-d01f2b2b1c9b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.565s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:40.338979 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328660.338554, 0059a43c-1d34-40a9-af63-b5eca8c30f53 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:57:40.339133 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] VM Started (Lifecycle Event)
May 21 01:57:40.342990 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 01:57:40.343312 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:40.346092 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 01:57:40.349202 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Instance spawned successfully.
May 21 01:57:40.842541 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:57:40.845310 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:57:41.092848 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:57:41.108641 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:41.348979 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 01:57:41.348979 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328661.3469765, 0059a43c-1d34-40a9-af63-b5eca8c30f53 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:57:41.348979 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] VM Paused (Lifecycle Event)
May 21 01:57:41.472940 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:41.602155 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9bb292d8-b6c5-49e4-b577-cf6bd73ebb38 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "0059a43c-1d34-40a9-af63-b5eca8c30f53" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 24.697s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:41.704009 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a6153ecb-625f-4773-9354-952ff79322ca req-ddb3a473-e306-45b4-8e68-4fe49eb0abe3 service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Received event network-vif-plugged-839e91da-5ffe-451b-bd9d-dfc1cf83ab19 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:41.704187 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a6153ecb-625f-4773-9354-952ff79322ca req-ddb3a473-e306-45b4-8e68-4fe49eb0abe3 service nova] Acquiring lock "0059a43c-1d34-40a9-af63-b5eca8c30f53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:41.705433 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a6153ecb-625f-4773-9354-952ff79322ca req-ddb3a473-e306-45b4-8e68-4fe49eb0abe3 service nova] Lock "0059a43c-1d34-40a9-af63-b5eca8c30f53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:41.705668 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a6153ecb-625f-4773-9354-952ff79322ca req-ddb3a473-e306-45b4-8e68-4fe49eb0abe3 service nova] Lock "0059a43c-1d34-40a9-af63-b5eca8c30f53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:41.705823 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a6153ecb-625f-4773-9354-952ff79322ca req-ddb3a473-e306-45b4-8e68-4fe49eb0abe3 service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] No waiting events found dispatching network-vif-plugged-839e91da-5ffe-451b-bd9d-dfc1cf83ab19 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:57:41.705954 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-a6153ecb-625f-4773-9354-952ff79322ca req-ddb3a473-e306-45b4-8e68-4fe49eb0abe3 service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Received unexpected event network-vif-plugged-839e91da-5ffe-451b-bd9d-dfc1cf83ab19 for instance with vm_state active and task_state None.
May 21 01:57:41.852619 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:57:41.858722 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328661.8582826, 0059a43c-1d34-40a9-af63-b5eca8c30f53 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:57:41.859723 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] VM Resumed (Lifecycle Event)
May 21 01:57:42.363025 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:57:42.380156 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:57:42.471876 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:43.552157 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.00045527799989031337 future=<Future at 0x71c07c518dd0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:57:43.553977 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Emitting event <LifecycleEvent: 1779328648.5515487, ecf25bc4-b32d-4627-9571-f98869b227f9 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:57:43.554166 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:57:43.554423 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] VM Stopped (Lifecycle Event)
May 21 01:57:43.555590 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=0.013083898000104455 future=<Future at 0x71c0981d5df0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:57:43.555728 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=0.012930413000049157 future=<Future at 0x71c0981d5df0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:57:43.569076 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.00039499699983025494 future=<Future at 0x71c0981d5df0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:57:43.569205 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:57:43.570922 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Emitting event <LifecycleEvent: 1779328648.5685935, 98ace73f-7d4b-4aed-9355-a39c58f9b024 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:57:43.571487 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=5.993307906000155 future=<Future at 0x71c0a255c8c0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:57:43.571768 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] VM Stopped (Lifecycle Event)
May 21 01:57:43.572371 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=5.9924239460001445 future=<Future at 0x71c0a255c8c0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:57:44.057089 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: ecf25bc4-b32d-4627-9571-f98869b227f9] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:57:44.074929 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 98ace73f-7d4b-4aed-9355-a39c58f9b024] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:57:44.188898 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:57:44.189525 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:57:44.189525 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:57:44.189616 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:57:44.189933 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:57:44.190034 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 21 01:57:44.190281 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:57:44.696002 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:44.696559 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:44.696559 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:44.696559 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Auditing locally available compute resources for np0000001127 (node: np0000001127) {{(pid=98206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 21 01:57:45.345281 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:45.430824 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:45.742028 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:45.850376 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:45.851078 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:45.971385 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:45.984387 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:46.051212 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:46.082669 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:46.083815 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:46.116528 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:46.181378 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:46.186142 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:46.266483 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:46.270416 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:46.355683 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:46.356427 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-4 (vdc) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 01:57:46.359360 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9664d16-b539-4ccc-abd4-47a8fa944520/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:46.448793 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9664d16-b539-4ccc-abd4-47a8fa944520/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:46.449852 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9664d16-b539-4ccc-abd4-47a8fa944520/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:46.554584 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9664d16-b539-4ccc-abd4-47a8fa944520/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:46.559685 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 01:57:46.560043 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 01:57:46.560362 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-3 (vdc) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 01:57:46.562148 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 01:57:46.563706 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:46.598582 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "env LANG=C uptime" returned: 0 in 0.034s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:46.599112 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Hypervisor/Node resource view: name=np0000001127 free_ram=13367MB free_disk=74.58664321899414GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 21 01:57:46.599310 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:46.599653 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:47.691109 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 29a124ee-2b8c-4f44-8f91-8dd11ac78b52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 01:57:47.692896 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 01:57:47.692896 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance e9664d16-b539-4ccc-abd4-47a8fa944520 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 01:57:47.692896 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 6f68556b-0b18-452a-b307-da2dad4ee6ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 01:57:47.692896 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 0059a43c-1d34-40a9-af63-b5eca8c30f53 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 01:57:47.692896 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 21 01:57:47.692896 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Final resource view: name=np0000001127 phys_ram=24030MB used_ram=1472MB phys_disk=95GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:57:46 up 28 min,  2 users,  load average: 8.04, 4.55, 2.18\n', 'num_instances': '5', 'num_vm_active': '5', 'num_task_None': '5', 'num_os_type_None': '5', 'num_proj_2e41dd931ff049868a61f52a251d1122': '1', 'io_workload': '0', 'num_proj_6a15fe7a70464159a778cffa4a36c36f': '2', 'num_proj_d16c5939e8b346a8a2da89fb19b2a812': '1', 'num_proj_9a80dd2c84334f79afe5cb079c50c555': '1'} {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 21 01:57:48.052921 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:57:48.055291 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:57:48.558642 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:57:48.671336 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:49.070244 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Compute_service record updated for np0000001127:np0000001127 {{(pid=98206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 21 01:57:49.070996 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.471s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:49.070996 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.49 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 01:57:49.518629 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:49.559501 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:57:49.559501 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:57:49.559501 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 51.99 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 01:57:49.566045 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0012578129999383236 future=<Future at 0x71c0a255c8c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:57:49.568113 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] Emitting event <LifecycleEvent: 1779328654.5646882, 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:57:49.568113 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] VM Stopped (Lifecycle Event)
May 21 01:57:49.568113 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:57:50.070376 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-65dc2a92-c50d-4492-9ee2-8fded46e6692 tempest-VolumesAdminNegativeTest-2137466894 tempest-VolumesAdminNegativeTest-2137466894-project-member] [instance: 6307081b-dd75-4ea3-aad6-d01f2b2b1c9b] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:57:50.348938 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Acquiring lock "f8921842-2161-4ddf-b3c4-b642fc51a70f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:50.350576 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Lock "f8921842-2161-4ddf-b3c4-b642fc51a70f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:50.351917 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:50.855885 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 01:57:51.116847 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:51.453781 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:51.453930 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:51.457297 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 01:57:51.457462 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Claim successful on node np0000001127
May 21 01:57:52.710795 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "6f68556b-0b18-452a-b307-da2dad4ee6ab" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:52.710795 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "6f68556b-0b18-452a-b307-da2dad4ee6ab" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:52.897430 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:57:52.897753 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:57:53.210753 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lazy-loading 'flavor' on Instance uuid 6f68556b-0b18-452a-b307-da2dad4ee6ab {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:57:53.401409 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:57:53.913258 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.459s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:53.914112 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 01:57:54.219286 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "6f68556b-0b18-452a-b307-da2dad4ee6ab" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:54.421385 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 01:57:54.422451 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 01:57:54.422949 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:54.423293 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:54.540489 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd2f21fb1a04f4a3da623f58204608256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c267ab1fe654c6da45280651b958746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 01:57:54.928198 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
May 21 01:57:55.357966 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:55.431581 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 01:57:55.467534 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "6f68556b-0b18-452a-b307-da2dad4ee6ab" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:55.467534 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "6f68556b-0b18-452a-b307-da2dad4ee6ab" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:55.467534 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Attaching volume 99e89209-ee54-4c1e-922b-ed08da485e1c to /dev/vdb
May 21 01:57:55.549085 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:57:55.568547 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 01:57:55.600327 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:55.637114 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 01:57:55.638078 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 01:57:55.649062 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 01:57:55.652909 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe9e:216', 'fe80::14d9:7bff:fe3b:f0dc', 'fe80::fc16:3eff:fef6:c7e3', 'fe80::68db:c7ff:fe71:da32', 'fe80::fc16:3eff:fe30:ade5', 'fe80::fc16:3eff:fefd:1e9d', 'fe80::3cf5:efff:fe9b:7732', 'fe80::fc16:3eff:fe10:bc3b', 'fe80::fc16:3eff:fe05:2b1', 'fe80::fc16:3eff:fedf:4a48', 'fe80::fc16:3eff:fe70:5b80', 'fe80::fc16:3eff:fee5:ea60', 'fe80::e477:a1ff:fe9c:52f7', 'fe80::fc16:3eff:fe56:b959', 'fe80::60e1:9aff:fec4:237f', 'fe80::fc16:3eff:fe00:d8d3', 'fe80::c062:49ff:fe28:b40d'] 
May 21 01:57:55.652909 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 01:57:55.653115 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 01:57:55.653414 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:57:55.653954 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Updating existing volume attachment record: c89a23ce-3802-4c09-8c1f-4d0205f16157 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 01:57:55.681793 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Successfully created port: 3ef861c1-6e74-4d82-a214-06c2d655f210 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 01:57:56.126580 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:56.271593 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 01:57:56.272141 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '99e89209-ee54-4c1e-922b-ed08da485e1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:57:56.272357 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:57:56.272941 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:57:56.273216 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '99e89209-ee54-4c1e-922b-ed08da485e1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 01:57:56.293649 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:57:56.294732 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:57:56.295342 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:57:56.295683 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:57:56.296171 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:57:56.296861 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:57:56.310666 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 01:57:56.310666 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:56.319916 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 01:57:56.319916 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:56.331452 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c] added
May 21 01:57:56.331452 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 01:57:56.331452 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:57:56.331452 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:57:56.331452 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:57:56.331452 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:57:56.331452 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:56.331452 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 01:57:56.331452 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0348(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 01:57:56.331452 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 01:57:56.336884 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c] added
May 21 01:57:56.336884 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 01:57:56.336884 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:57:56.336884 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:57:56.336884 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:57:56.336884 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:57:56.336884 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:56.337308 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 01:57:56.337308 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0409(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 01:57:56.337400 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 01:57:56.446563 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 01:57:56.447877 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 01:57:56.447877 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Creating image(s)
May 21 01:57:56.448990 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Acquiring lock "/opt/stack/data/nova/instances/f8921842-2161-4ddf-b3c4-b642fc51a70f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:56.448990 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Lock "/opt/stack/data/nova/instances/f8921842-2161-4ddf-b3c4-b642fc51a70f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:56.454258 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Lock "/opt/stack/data/nova/instances/f8921842-2161-4ddf-b3c4-b642fc51a70f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:56.454258 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Acquiring lock "4d92b01e41f2781c0440f45e3408b92e397e20cd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:56.455547 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Lock "4d92b01e41f2781c0440f45e3408b92e397e20cd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:56.671317 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Acquiring lock "e9664d16-b539-4ccc-abd4-47a8fa944520" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:56.671593 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "e9664d16-b539-4ccc-abd4-47a8fa944520" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:56.697106 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:56.790264 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Successfully updated port: 3ef861c1-6e74-4d82-a214-06c2d655f210 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 01:57:56.889890 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-13faabb7-622a-4d43-b674-9b00ecab3d8d req-c6cdbb10-e0ed-419e-9765-0d90bf4a1602 service nova] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Received event network-changed-3ef861c1-6e74-4d82-a214-06c2d655f210 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:57:56.890063 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-13faabb7-622a-4d43-b674-9b00ecab3d8d req-c6cdbb10-e0ed-419e-9765-0d90bf4a1602 service nova] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Refreshing instance network info cache due to event network-changed-3ef861c1-6e74-4d82-a214-06c2d655f210. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:57:56.890230 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-13faabb7-622a-4d43-b674-9b00ecab3d8d req-c6cdbb10-e0ed-419e-9765-0d90bf4a1602 service nova] Acquiring lock "refresh_cache-f8921842-2161-4ddf-b3c4-b642fc51a70f" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:57:56.890353 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-13faabb7-622a-4d43-b674-9b00ecab3d8d req-c6cdbb10-e0ed-419e-9765-0d90bf4a1602 service nova] Acquired lock "refresh_cache-f8921842-2161-4ddf-b3c4-b642fc51a70f" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:57:56.890506 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-13faabb7-622a-4d43-b674-9b00ecab3d8d req-c6cdbb10-e0ed-419e-9765-0d90bf4a1602 service nova] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Refreshing network info cache for port 3ef861c1-6e74-4d82-a214-06c2d655f210 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:57:57.176868 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lazy-loading 'flavor' on Instance uuid e9664d16-b539-4ccc-abd4-47a8fa944520 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:57:57.295543 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Acquiring lock "refresh_cache-f8921842-2161-4ddf-b3c4-b642fc51a70f" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:57:57.331785 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:57:57.338154 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:57:57.355378 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.startup = manual
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:57:57.361626 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:57:57.361626 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.startup = manual
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:57:57.375622 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:57:57.375622 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:57.387930 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:57.395010 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-13faabb7-622a-4d43-b674-9b00ecab3d8d req-c6cdbb10-e0ed-419e-9765-0d90bf4a1602 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:57.402227 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:57.417490 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:57.417490 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:57.417490 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:57.417490 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:57.417490 np0000001127 nova-compute[98206]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:57:57.417490 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:57:57.417490 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:57.417490 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:57.417490 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:57:57.418043 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsi session list stdout=tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:57.418043 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:57.418043 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:57.418043 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:57.418043 np0000001127 nova-compute[98206]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:57:57.418043 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:57:57.418043 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:57.418043 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:57.418043 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:57:57.440297 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:57.440297 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:57.440297 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:57.440297 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:57.440297 np0000001127 nova-compute[98206]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:57:57.440297 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:57:57.440297 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:57.440297 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:57.440297 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:57:57.440297 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsi session list stdout=tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:57.440297 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:57.440297 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:57.440297 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:57.440297 np0000001127 nova-compute[98206]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:57:57.440297 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:57:57.440297 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:57.440297 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:57.440297 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:57:57.467912 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c, portal: 192.168.40.100,3260]
May 21 01:57:57.467912 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c, portal: 192.168.40.100,3260] successful.
May 21 01:57:57.467912 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:57.488762 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:57.499738 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c, portal: 192.168.50.100,3260]
May 21 01:57:57.499738 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c, portal: 192.168.50.100,3260] successful.
May 21 01:57:57.499738 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:57.514202 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:57.514202 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:57.514202 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:57.514202 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:57.514202 np0000001127 nova-compute[98206]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:57:57.514202 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:57:57.514202 np0000001127 nova-compute[98206]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:57:57.514202 np0000001127 nova-compute[98206]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:57:57.514202 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:57.514202 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:57.514202 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:57:57.514595 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsi session list stdout=tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:57.514595 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:57.514595 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:57.514595 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:57.514595 np0000001127 nova-compute[98206]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:57:57.514595 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:57:57.514595 np0000001127 nova-compute[98206]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:57:57.514595 np0000001127 nova-compute[98206]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:57:57.514595 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:57.514595 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:57.514595 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:57:57.514894 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:57:57.515264 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.220s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:57:57.517419 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:57:57.517419 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] HCTL ('15', '-', '-', 0) found on session 20 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:57:57.517419 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:57:57.538049 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:57.538049 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:57.538049 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:57.538049 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:57.538049 np0000001127 nova-compute[98206]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:57:57.538049 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:57:57.538049 np0000001127 nova-compute[98206]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:57:57.538049 np0000001127 nova-compute[98206]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:57:57.538049 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:57.538049 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:57.538049 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:57:57.538049 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsi session list stdout=tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:57.538049 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:57:57.538049 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:57.538049 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:57:57.538049 np0000001127 nova-compute[98206]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:57:57.538049 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:57:57.538049 np0000001127 nova-compute[98206]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:57:57.538049 np0000001127 nova-compute[98206]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:57:57.538049 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:57.538049 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:57:57.538049 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:57:57.538798 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.242s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:57:57.539141 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:57:57.541189 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] HCTL ('16', '-', '-', 0) found on session 21 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:57:57.541189 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:57:57.550196 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Searching for a device in session 20 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:57:57.550422 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '99e89209-ee54-4c1e-922b-ed08da485e1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:57:57.556669 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-13faabb7-622a-4d43-b674-9b00ecab3d8d req-c6cdbb10-e0ed-419e-9765-0d90bf4a1602 service nova] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:57:57.572431 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Searching for a device in session 21 and hctl ['16', '*', '*', 0] yield: None {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:57:57.602024 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:57:57.605152 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:57:57.606533 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d92b01e41f2781c0440f45e3408b92e397e20cd.part --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:57.684178 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Ignoring supplied device name: /dev/vdb
May 21 01:57:57.721935 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d92b01e41f2781c0440f45e3408b92e397e20cd.part --force-share --output=json" returned: 0 in 0.115s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:57.723073 np0000001127 nova-compute[98206]: DEBUG nova.virt.images [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] c88685d1-8ae3-4a18-935c-cbd699617048 was qcow2, converting to raw {{(pid=98206) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 21 01:57:57.727005 np0000001127 nova-compute[98206]: DEBUG nova.privsep.utils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 21 01:57:57.727381 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4d92b01e41f2781c0440f45e3408b92e397e20cd.part /opt/stack/data/nova/instances/_base/4d92b01e41f2781c0440f45e3408b92e397e20cd.converted {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:57.938734 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-13faabb7-622a-4d43-b674-9b00ecab3d8d req-c6cdbb10-e0ed-419e-9765-0d90bf4a1602 service nova] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:57:58.191395 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "e9664d16-b539-4ccc-abd4-47a8fa944520" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.520s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:58.436952 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4d92b01e41f2781c0440f45e3408b92e397e20cd.part /opt/stack/data/nova/instances/_base/4d92b01e41f2781c0440f45e3408b92e397e20cd.converted" returned: 0 in 0.706s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:58.440824 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d92b01e41f2781c0440f45e3408b92e397e20cd.converted --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:58.462138 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-13faabb7-622a-4d43-b674-9b00ecab3d8d req-c6cdbb10-e0ed-419e-9765-0d90bf4a1602 service nova] Releasing lock "refresh_cache-f8921842-2161-4ddf-b3c4-b642fc51a70f" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:57:58.463943 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Acquired lock "refresh_cache-f8921842-2161-4ddf-b3c4-b642fc51a70f" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:57:58.464337 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 01:57:58.540949 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d92b01e41f2781c0440f45e3408b92e397e20cd.converted --force-share --output=json" returned: 0 in 0.100s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:58.541366 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Lock "4d92b01e41f2781c0440f45e3408b92e397e20cd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.087s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:58.543003 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:57:58.548275 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:57:58.550763 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d92b01e41f2781c0440f45e3408b92e397e20cd --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:58.574836 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Searching for a device in session 21 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:57:58.576190 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '99e89209-ee54-4c1e-922b-ed08da485e1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:57:58.673064 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d92b01e41f2781c0440f45e3408b92e397e20cd --force-share --output=json" returned: 0 in 0.123s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:58.674081 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Acquiring lock "4d92b01e41f2781c0440f45e3408b92e397e20cd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:58.674888 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Lock "4d92b01e41f2781c0440f45e3408b92e397e20cd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:58.675693 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:57:58.679810 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:57:58.680666 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d92b01e41f2781c0440f45e3408b92e397e20cd --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:58.781453 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d92b01e41f2781c0440f45e3408b92e397e20cd --force-share --output=json" returned: 0 in 0.101s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:58.782045 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d92b01e41f2781c0440f45e3408b92e397e20cd,backing_fmt=raw /opt/stack/data/nova/instances/f8921842-2161-4ddf-b3c4-b642fc51a70f/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:58.849585 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d92b01e41f2781c0440f45e3408b92e397e20cd,backing_fmt=raw /opt/stack/data/nova/instances/f8921842-2161-4ddf-b3c4-b642fc51a70f/disk 1073741824" returned: 0 in 0.066s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:58.849827 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Lock "4d92b01e41f2781c0440f45e3408b92e397e20cd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.175s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:58.850623 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d92b01e41f2781c0440f45e3408b92e397e20cd --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:58.953827 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d92b01e41f2781c0440f45e3408b92e397e20cd --force-share --output=json" returned: 0 in 0.103s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:58.954360 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f8921842-2161-4ddf-b3c4-b642fc51a70f/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 01:57:58.954903 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8921842-2161-4ddf-b3c4-b642fc51a70f/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:59.051313 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8921842-2161-4ddf-b3c4-b642fc51a70f/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:57:59.051875 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Cannot resize image /opt/stack/data/nova/instances/f8921842-2161-4ddf-b3c4-b642fc51a70f/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 01:57:59.052342 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 01:57:59.052556 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Ensure instance console log exists: /opt/stack/data/nova/instances/f8921842-2161-4ddf-b3c4-b642fc51a70f/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 01:57:59.053647 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:59.053647 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:59.053647 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:57:59.075142 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:57:59.298951 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:57:59.325555 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Found WWN 330000000a9f70f02 for multipath device dm-6 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 01:57:59.327866 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.055s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:57:59.328208 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] <== connect_volume: return (3055ms) {'type': 'block', 'scsi_wwn': '330000000a9f70f02', 'path': '/dev/dm-6', 'multipath_id': '330000000a9f70f02'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:57:59.328544 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a9f70f02', 'path': '/dev/dm-6', 'multipath_id': '330000000a9f70f02'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 01:57:59.334111 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lazy-loading 'flavor' on Instance uuid 6f68556b-0b18-452a-b307-da2dad4ee6ab {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:57:59.378522 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Acquiring lock "e9664d16-b539-4ccc-abd4-47a8fa944520" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:57:59.379069 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "e9664d16-b539-4ccc-abd4-47a8fa944520" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:57:59.379203 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Attaching volume 6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 to /dev/vdb
May 21 01:57:59.449827 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:57:59.468490 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 01:57:59.502818 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:57:59.547319 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 01:57:59.548200 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 01:57:59.565494 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 01:57:59.567522 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe9e:216', 'fe80::14d9:7bff:fe3b:f0dc', 'fe80::fc16:3eff:fef6:c7e3', 'fe80::68db:c7ff:fe71:da32', 'fe80::fc16:3eff:fe30:ade5', 'fe80::fc16:3eff:fefd:1e9d', 'fe80::3cf5:efff:fe9b:7732', 'fe80::fc16:3eff:fe10:bc3b', 'fe80::fc16:3eff:fe05:2b1', 'fe80::fc16:3eff:fedf:4a48', 'fe80::fc16:3eff:fe70:5b80', 'fe80::fc16:3eff:fee5:ea60', 'fe80::e477:a1ff:fe9c:52f7', 'fe80::fc16:3eff:fe56:b959', 'fe80::60e1:9aff:fec4:237f', 'fe80::fc16:3eff:fe00:d8d3', 'fe80::c062:49ff:fe28:b40d'] 
May 21 01:57:59.567838 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 01:57:59.567976 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 01:57:59.568428 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:57:59.569001 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Updating existing volume attachment record: 5f2e2dc0-40ea-4995-b486-0dfdc5c4ea28 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 01:57:59.587767 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Updating instance_info_cache with network_info: [{"id": "3ef861c1-6e74-4d82-a214-06c2d655f210", "address": "fa:16:3e:ef:61:06", "network": {"id": "92596e04-fd2c-46d6-bc35-90386827dd7e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-421500812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0c267ab1fe654c6da45280651b958746", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ef861c1-6e", "ovs_interfaceid": "3ef861c1-6e74-4d82-a214-06c2d655f210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:57:59.838749 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Attempting to attach volume 99e89209-ee54-4c1e-922b-ed08da485e1c with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 01:57:59.842868 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] attach device xml: <disk type="block" device="disk">
May 21 01:57:59.842868 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:57:59.842868 np0000001127 nova-compute[98206]:   <alias name="ua-99e89209-ee54-4c1e-922b-ed08da485e1c"/>
May 21 01:57:59.842868 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-6"/>
May 21 01:57:59.842868 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 01:57:59.842868 np0000001127 nova-compute[98206]:   <serial>99e89209-ee54-4c1e-922b-ed08da485e1c</serial>
May 21 01:57:59.842868 np0000001127 nova-compute[98206]: </disk>
May 21 01:57:59.842868 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 01:58:00.059969 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:00.091893 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Releasing lock "refresh_cache-f8921842-2161-4ddf-b3c4-b642fc51a70f" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:58:00.092990 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Instance network_info: |[{"id": "3ef861c1-6e74-4d82-a214-06c2d655f210", "address": "fa:16:3e:ef:61:06", "network": {"id": "92596e04-fd2c-46d6-bc35-90386827dd7e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-421500812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0c267ab1fe654c6da45280651b958746", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ef861c1-6e", "ovs_interfaceid": "3ef861c1-6e74-4d82-a214-06c2d655f210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 01:58:00.096486 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Start _get_guest_xml network_info=[{"id": "3ef861c1-6e74-4d82-a214-06c2d655f210", "address": "fa:16:3e:ef:61:06", "network": {"id": "92596e04-fd2c-46d6-bc35-90386827dd7e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-421500812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0c267ab1fe654c6da45280651b958746", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ef861c1-6e", "ovs_interfaceid": "3ef861c1-6e74-4d82-a214-06c2d655f210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:57:43Z,direct_url=<?>,disk_format='qcow2',id=c88685d1-8ae3-4a18-935c-cbd699617048,min_disk=0,min_ram=0,name='',owner='19b7cd8fa7a44da5beceaab540aee093',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:57:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/sda', 'encrypted': False, 'disk_bus': 'scsi', 'image_id': 'c88685d1-8ae3-4a18-935c-cbd699617048'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 01:58:00.104123 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 01:58:00.104123 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='c88685d1-8ae3-4a18-935c-cbd699617048', instance_meta=NovaInstanceMeta(name='tempest-AttachSCSIVolumeTestJSON-server-120609668', uuid='f8921842-2161-4ddf-b3c4-b642fc51a70f'), owner=OwnerMeta(userid='d2f21fb1a04f4a3da623f58204608256', username='tempest-AttachSCSIVolumeTestJSON-1415132564-project-member', projectid='0c267ab1fe654c6da45280651b958746', projectname='tempest-AttachSCSIVolumeTestJSON-1415132564'), image=ImageMeta(id='c88685d1-8ae3-4a18-935c-cbd699617048', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'scsi', 'hw_disk_bus': 'scsi', 'hw_scsi_model': 'virtio-scsi'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3ef861c1-6e74-4d82-a214-06c2d655f210", "address": "fa:16:3e:ef:61:06", "network": {"id": "92596e04-fd2c-46d6-bc35-90386827dd7e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-421500812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0c267ab1fe654c6da45280651b958746", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ef861c1-6e", "ovs_interfaceid": "3ef861c1-6e74-4d82-a214-06c2d655f210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328680.1036909) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 01:58:00.106003 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 01:58:00.106448 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 01:58:00.107948 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 01:58:00.108370 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 01:58:00.109812 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 01:58:00.110197 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:57:43Z,direct_url=<?>,disk_format='qcow2',id=c88685d1-8ae3-4a18-935c-cbd699617048,min_disk=0,min_ram=0,name='',owner='19b7cd8fa7a44da5beceaab540aee093',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:57:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 01:58:00.111321 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 01:58:00.114720 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 01:58:00.114720 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 01:58:00.114720 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 01:58:00.114720 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 01:58:00.114720 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 01:58:00.114720 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 01:58:00.114720 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 01:58:00.114720 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 01:58:00.114720 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 01:58:00.135143 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-120609668',display_name='tempest-AttachSCSIVolumeTestJSON-server-120609668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachscsivolumetestjson-server-120609668',id=11,image_ref='c88685d1-8ae3-4a18-935c-cbd699617048',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjXezLAC/wSHg89uCj7jXxty/NyzUeJTjEJ3NgwG1a21UVMA8SBQcKAYD7X4w3UToWoyQqWlkmSLWZNxhl2bzmkrqKwdzHdmQ3U44QO37LDwh6Wt3h1ThtRIBVb5uhqhw==',key_name='tempest-keypair-15728245',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c267ab1fe654c6da45280651b958746',ramdisk_id='',reservation_id='r-lcoxaxht',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c88685d1-8ae3-4a18-935c-cbd699617048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1415132564',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1415132564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:57:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2f21fb1a04f4a3da623f58204608256',uuid=f8921842-2161-4ddf-b3c4-b642fc51a70f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ef861c1-6e74-4d82-a214-06c2d655f210", "address": "fa:16:3e:ef:61:06", "network": {"id": "92596e04-fd2c-46d6-bc35-90386827dd7e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-421500812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0c267ab1fe654c6da45280651b958746", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ef861c1-6e", "ovs_interfaceid": "3ef861c1-6e74-4d82-a214-06c2d655f210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 01:58:00.135441 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Converting VIF {"id": "3ef861c1-6e74-4d82-a214-06c2d655f210", "address": "fa:16:3e:ef:61:06", "network": {"id": "92596e04-fd2c-46d6-bc35-90386827dd7e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-421500812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0c267ab1fe654c6da45280651b958746", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ef861c1-6e", "ovs_interfaceid": "3ef861c1-6e74-4d82-a214-06c2d655f210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:58:00.136798 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:61:06,bridge_name='br-int',has_traffic_filtering=True,id=3ef861c1-6e74-4d82-a214-06c2d655f210,network=Network(92596e04-fd2c-46d6-bc35-90386827dd7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ef861c1-6e') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:58:00.137914 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Lazy-loading 'pci_devices' on Instance uuid f8921842-2161-4ddf-b3c4-b642fc51a70f {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:58:00.185416 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 01:58:00.185924 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48', 'iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:58:00.187404 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:58:00.187404 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:58:00.187404 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48', 'iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 01:58:00.209233 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:58:00.210265 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:58:00.212239 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:58:00.213047 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:58:00.213439 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:58:00.213988 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:58:00.233512 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 01:58:00.233512 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:00.239781 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 01:58:00.239781 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:00.253398 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48] added
May 21 01:58:00.253398 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 01:58:00.253398 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:58:00.253398 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:58:00.253398 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:58:00.253398 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:58:00.253398 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:00.254128 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 01:58:00.254297 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0414(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 01:58:00.254532 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 01:58:00.259048 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48] added
May 21 01:58:00.259048 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 01:58:00.259048 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:58:00.259048 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:58:00.259048 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:58:00.259048 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:58:00.259048 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:00.259048 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 01:58:00.259048 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0453(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 01:58:00.259048 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 01:58:00.359277 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:00.642139 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] End _get_guest_xml xml=<domain type="qemu">
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:   <uuid>f8921842-2161-4ddf-b3c4-b642fc51a70f</uuid>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:   <name>instance-0000000b</name>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:   <metadata>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-120609668</nova:name>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 01:58:00</nova:creationTime>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:       <nova:image uuid="c88685d1-8ae3-4a18-935c-cbd699617048">
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:           <nova:property name="hw_cdrom_bus">scsi</nova:property>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:           <nova:property name="hw_disk_bus">scsi</nova:property>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:           <nova:property name="hw_scsi_model">virtio-scsi</nova:property>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:       </nova:image>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:         <nova:user uuid="d2f21fb1a04f4a3da623f58204608256">tempest-AttachSCSIVolumeTestJSON-1415132564-project-member</nova:user>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:         <nova:project uuid="0c267ab1fe654c6da45280651b958746">tempest-AttachSCSIVolumeTestJSON-1415132564</nova:project>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="c88685d1-8ae3-4a18-935c-cbd699617048"/>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:         <nova:port uuid="3ef861c1-6e74-4d82-a214-06c2d655f210">
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:         </nova:port>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:   </metadata>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:     <system>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:       <entry name="serial">f8921842-2161-4ddf-b3c4-b642fc51a70f</entry>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:       <entry name="uuid">f8921842-2161-4ddf-b3c4-b642fc51a70f</entry>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:     </system>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:   <os>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:   </os>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:   <features>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:     <acpi/>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:     <tcg>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:     </tcg>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:   </features>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:   <devices>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/f8921842-2161-4ddf-b3c4-b642fc51a70f/disk"/>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:       <target dev="sda" bus="scsi"/>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:       <address type="drive" controller="0" unit="0"/>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:     </disk>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/f8921842-2161-4ddf-b3c4-b642fc51a70f/disk.config"/>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:       <target dev="sdb" bus="scsi"/>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:       <address type="drive" controller="0" unit="1"/>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:     </disk>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:     <controller type="scsi" index="0" model="virtio-scsi"/>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:ef:61:06"/>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:       <target dev="tap3ef861c1-6e"/>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:     </interface>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/f8921842-2161-4ddf-b3c4-b642fc51a70f/console.log" append="off"/>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:     </serial>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:     <video>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:     </video>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:     </rng>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:     </memballoon>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:   </devices>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]: </domain>
May 21 01:58:00.642139 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 01:58:00.648592 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Preparing to wait for external event network-vif-plugged-3ef861c1-6e74-4d82-a214-06c2d655f210 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 01:58:00.648592 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Acquiring lock "f8921842-2161-4ddf-b3c4-b642fc51a70f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:00.648592 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Lock "f8921842-2161-4ddf-b3c4-b642fc51a70f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:00.648592 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Lock "f8921842-2161-4ddf-b3c4-b642fc51a70f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:00.648592 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-120609668',display_name='tempest-AttachSCSIVolumeTestJSON-server-120609668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachscsivolumetestjson-server-120609668',id=11,image_ref='c88685d1-8ae3-4a18-935c-cbd699617048',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjXezLAC/wSHg89uCj7jXxty/NyzUeJTjEJ3NgwG1a21UVMA8SBQcKAYD7X4w3UToWoyQqWlkmSLWZNxhl2bzmkrqKwdzHdmQ3U44QO37LDwh6Wt3h1ThtRIBVb5uhqhw==',key_name='tempest-keypair-15728245',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c267ab1fe654c6da45280651b958746',ramdisk_id='',reservation_id='r-lcoxaxht',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c88685d1-8ae3-4a18-935c-cbd699617048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1415132564',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1415132564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:57:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2f21fb1a04f4a3da623f58204608256',uuid=f8921842-2161-4ddf-b3c4-b642fc51a70f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ef861c1-6e74-4d82-a214-06c2d655f210", "address": "fa:16:3e:ef:61:06", "network": {"id": "92596e04-fd2c-46d6-bc35-90386827dd7e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-421500812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0c267ab1fe654c6da45280651b958746", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ef861c1-6e", "ovs_interfaceid": "3ef861c1-6e74-4d82-a214-06c2d655f210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 01:58:00.648592 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Converting VIF {"id": "3ef861c1-6e74-4d82-a214-06c2d655f210", "address": "fa:16:3e:ef:61:06", "network": {"id": "92596e04-fd2c-46d6-bc35-90386827dd7e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-421500812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0c267ab1fe654c6da45280651b958746", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ef861c1-6e", "ovs_interfaceid": "3ef861c1-6e74-4d82-a214-06c2d655f210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:58:00.648592 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:61:06,bridge_name='br-int',has_traffic_filtering=True,id=3ef861c1-6e74-4d82-a214-06c2d655f210,network=Network(92596e04-fd2c-46d6-bc35-90386827dd7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ef861c1-6e') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:58:00.648592 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:61:06,bridge_name='br-int',has_traffic_filtering=True,id=3ef861c1-6e74-4d82-a214-06c2d655f210,network=Network(92596e04-fd2c-46d6-bc35-90386827dd7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ef861c1-6e') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 01:58:00.650110 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:00.650538 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:00.650830 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 01:58:00.652269 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:00.652603 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd162cd60-c58a-51f1-b16f-c094213e1cf0', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:00.654037 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:00.655856 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:58:00.657487 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:00.661841 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:00.663094 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ef861c1-6e, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:00.663094 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ef861c1-6e, col_values=(('qos', UUID('fce8ba75-a63c-4039-a430-bd2b93608962')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:00.664085 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ef861c1-6e, col_values=(('external_ids', {'iface-id': '3ef861c1-6e74-4d82-a214-06c2d655f210', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:61:06', 'vm-uuid': 'f8921842-2161-4ddf-b3c4-b642fc51a70f'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:00.665968 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:00.667912 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:58:00.674309 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:00.676308 np0000001127 nova-compute[98206]: INFO os_vif [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:61:06,bridge_name='br-int',has_traffic_filtering=True,id=3ef861c1-6e74-4d82-a214-06c2d655f210,network=Network(92596e04-fd2c-46d6-bc35-90386827dd7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ef861c1-6e')
May 21 01:58:00.765155 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:00.940229 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:01.124498 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:01.255042 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:58:01.259629 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.startup = manual
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:58:01.271884 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:58:01.271884 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.startup = manual
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:58:01.277340 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:58:01.277340 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:01.296938 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:01.300277 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:01.313806 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:58:01.313806 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:58:01.313806 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:58:01.313806 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:58:01.313806 np0000001127 nova-compute[98206]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:01.313806 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:01.313806 np0000001127 nova-compute[98206]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:01.313806 np0000001127 nova-compute[98206]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:01.313806 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:58:01.313806 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:58:01.313806 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:58:01.315494 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsi session list stdout=tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:58:01.315494 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:58:01.315494 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:58:01.315494 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:58:01.315494 np0000001127 nova-compute[98206]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:01.315494 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:01.315494 np0000001127 nova-compute[98206]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:01.315494 np0000001127 nova-compute[98206]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:01.315494 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:58:01.315494 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:58:01.315494 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:58:01.326960 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:58:01.326960 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:58:01.326960 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:58:01.326960 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:58:01.326960 np0000001127 nova-compute[98206]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:01.326960 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:01.326960 np0000001127 nova-compute[98206]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:01.326960 np0000001127 nova-compute[98206]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:01.326960 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:58:01.326960 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:58:01.326960 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:58:01.326960 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsi session list stdout=tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:58:01.326960 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:58:01.326960 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:58:01.326960 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:58:01.326960 np0000001127 nova-compute[98206]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:01.326960 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:01.326960 np0000001127 nova-compute[98206]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:01.326960 np0000001127 nova-compute[98206]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:01.326960 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:58:01.326960 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:58:01.326960 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:58:01.395593 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48, portal: 192.168.50.100,3260]
May 21 01:58:01.395593 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48, portal: 192.168.50.100,3260] successful.
May 21 01:58:01.395593 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:01.396291 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48, portal: 192.168.40.100,3260]
May 21 01:58:01.396291 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48, portal: 192.168.40.100,3260] successful.
May 21 01:58:01.396291 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:01.414791 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:01.426432 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:01.451999 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:58:01.451999 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:58:01.451999 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:58:01.451999 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:58:01.451999 np0000001127 nova-compute[98206]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:01.451999 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:01.451999 np0000001127 nova-compute[98206]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:01.451999 np0000001127 nova-compute[98206]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:01.451999 np0000001127 nova-compute[98206]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:01.451999 np0000001127 nova-compute[98206]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:01.451999 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:58:01.451999 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:58:01.451999 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:58:01.452544 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsi session list stdout=tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:58:01.452544 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:58:01.452544 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:58:01.452544 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:58:01.452544 np0000001127 nova-compute[98206]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:01.452544 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:01.452544 np0000001127 nova-compute[98206]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:01.452544 np0000001127 nova-compute[98206]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:01.452544 np0000001127 nova-compute[98206]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:01.452544 np0000001127 nova-compute[98206]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:01.452544 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:58:01.452544 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:58:01.452544 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:58:01.453728 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.240s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:58:01.453728 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:58:01.458502 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] HCTL ('18', '-', '-', 0) found on session 23 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:58:01.458502 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:58:01.459293 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:58:01.459293 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:58:01.459293 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:58:01.459293 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:58:01.459293 np0000001127 nova-compute[98206]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:01.459293 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:01.459293 np0000001127 nova-compute[98206]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:01.459293 np0000001127 nova-compute[98206]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:01.459293 np0000001127 nova-compute[98206]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:01.459293 np0000001127 nova-compute[98206]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:01.459293 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:58:01.459293 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:58:01.459293 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:58:01.460644 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsi session list stdout=tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:58:01.460644 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:58:01.460644 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:58:01.460644 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:58:01.460644 np0000001127 nova-compute[98206]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:01.460644 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:01.460644 np0000001127 nova-compute[98206]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:01.460644 np0000001127 nova-compute[98206]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:01.460644 np0000001127 nova-compute[98206]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:01.460644 np0000001127 nova-compute[98206]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:01.460644 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:58:01.460644 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:58:01.460644 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:58:01.461623 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.249s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:58:01.461913 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:58:01.464295 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] HCTL ('17', '-', '-', 0) found on session 22 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:58:01.464295 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:58:01.486593 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Searching for a device in session 23 and hctl ['18', '*', '*', 0] yield: None {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:58:01.496914 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Searching for a device in session 22 and hctl ['17', '*', '*', 0] yield: sdm {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:58:01.496914 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:58:01.581768 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:58:01.582072 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:58:01.582238 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:58:01.582391 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] No VIF found with MAC fa:16:3e:30:ad:e5, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 01:58:02.215501 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] No BDM found with device name sda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:58:02.215716 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] No BDM found with device name sdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:58:02.215766 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] No VIF found with MAC fa:16:3e:ef:61:06, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 01:58:02.216298 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Using config drive
May 21 01:58:02.487650 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Searching for a device in session 23 and hctl ['18', '*', '*', 0] yield: sdl {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:58:02.488289 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:58:02.729413 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:02.902046 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Creating config drive at /opt/stack/data/nova/instances/f8921842-2161-4ddf-b3c4-b642fc51a70f/disk.config
May 21 01:58:02.908049 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f8921842-2161-4ddf-b3c4-b642fc51a70f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpe1jg9lwp {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:02.976919 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f8921842-2161-4ddf-b3c4-b642fc51a70f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpe1jg9lwp" returned: 0 in 0.068s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:03.162128 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c53cdc5e-1df2-4c1f-8b32-6398e7943782 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "6f68556b-0b18-452a-b307-da2dad4ee6ab" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.695s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:03.235991 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Found WWN 33000000057727f7f for multipath device dm-7 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 01:58:03.237109 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.050s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:58:03.237620 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] <== connect_volume: return (3051ms) {'type': 'block', 'scsi_wwn': '33000000057727f7f', 'path': '/dev/dm-7', 'multipath_id': '33000000057727f7f'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:58:03.237813 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000057727f7f', 'path': '/dev/dm-7', 'multipath_id': '33000000057727f7f'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 01:58:03.241262 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lazy-loading 'flavor' on Instance uuid e9664d16-b539-4ccc-abd4-47a8fa944520 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:58:03.488781 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:03.513710 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:03.514499 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:03.627319 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:03.744847 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Attempting to attach volume 6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 01:58:03.747588 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] attach device xml: <disk type="block" device="disk">
May 21 01:58:03.747588 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:58:03.747588 np0000001127 nova-compute[98206]:   <alias name="ua-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48"/>
May 21 01:58:03.747588 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-7"/>
May 21 01:58:03.747588 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 01:58:03.747588 np0000001127 nova-compute[98206]:   <serial>6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48</serial>
May 21 01:58:03.747588 np0000001127 nova-compute[98206]: </disk>
May 21 01:58:03.747588 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 01:58:03.771253 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "0d75ff65-b688-4387-89e3-70567e569682" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:03.771812 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "0d75ff65-b688-4387-89e3-70567e569682" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:03.913813 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:03.916772 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:03.922359 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:03.927282 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:03.951159 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:04.277025 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 01:58:04.698408 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328684.6979747, f8921842-2161-4ddf-b3c4-b642fc51a70f => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:58:04.701731 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] VM Started (Lifecycle Event)
May 21 01:58:05.111028 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Rebuilding instance
May 21 01:58:05.120630 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:05.175812 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:05.176073 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:05.178663 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 01:58:05.178900 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Claim successful on node np0000001127
May 21 01:58:05.204721 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:58:05.207771 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328685.2069187, f8921842-2161-4ddf-b3c4-b642fc51a70f => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:58:05.207771 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] VM Paused (Lifecycle Event)
May 21 01:58:05.312404 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:58:05.480200 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:58:05.480347 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:58:05.480465 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:58:05.480951 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] No VIF found with MAC fa:16:3e:f6:c7:e3, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 01:58:05.665448 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:05.710663 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:58:05.717771 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:58:05.936149 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cca2441e-865d-4b22-9934-c01103b64294 req-e463b552-1e6b-4d68-834d-50a6920e15fd service nova] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Received event network-vif-plugged-3ef861c1-6e74-4d82-a214-06c2d655f210 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:05.936314 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cca2441e-865d-4b22-9934-c01103b64294 req-e463b552-1e6b-4d68-834d-50a6920e15fd service nova] Acquiring lock "f8921842-2161-4ddf-b3c4-b642fc51a70f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:05.936455 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cca2441e-865d-4b22-9934-c01103b64294 req-e463b552-1e6b-4d68-834d-50a6920e15fd service nova] Lock "f8921842-2161-4ddf-b3c4-b642fc51a70f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:05.936608 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cca2441e-865d-4b22-9934-c01103b64294 req-e463b552-1e6b-4d68-834d-50a6920e15fd service nova] Lock "f8921842-2161-4ddf-b3c4-b642fc51a70f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:05.936751 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cca2441e-865d-4b22-9934-c01103b64294 req-e463b552-1e6b-4d68-834d-50a6920e15fd service nova] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Processing event network-vif-plugged-3ef861c1-6e74-4d82-a214-06c2d655f210 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 01:58:05.937370 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 01:58:05.940948 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 01:58:05.942352 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Instance spawned successfully.
May 21 01:58:05.942770 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 01:58:05.945173 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:58:05.945463 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:58:05.945814 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:58:05.946055 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:58:06.131780 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:06.222253 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 01:58:06.222961 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328686.222675, f8921842-2161-4ddf-b3c4-b642fc51a70f => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:58:06.223094 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] VM Resumed (Lifecycle Event)
May 21 01:58:06.248732 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Refreshing inventories for resource provider a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 21 01:58:06.318309 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Updating ProviderTree inventory for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 21 01:58:06.322769 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Updating inventory in ProviderTree for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 21 01:58:06.349350 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:06.355225 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:06.379767 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:06.431202 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Refreshing aggregate associations for resource provider a0b7bd56-5a70-4557-8cfd-9f933f412754, aggregates: None {{(pid=98206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 21 01:58:06.453332 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Took 10.01 seconds to spawn the instance on the hypervisor.
May 21 01:58:06.453332 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:58:06.523962 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Refreshing trait associations for resource provider a0b7bd56-5a70-4557-8cfd-9f933f412754, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_ARCH_X86_64,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ARCH_PPC64LE,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,HW_ARCH_X86_64,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ARCH_S390X,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOUND_MODEL_USB,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_SOUND_MODEL_SB16,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_ARCH_RISCV64,COMPUTE_ARCH_MIPSEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ARCH_AARCH64,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_SOUND_MODEL_AC97,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX {{(pid=98206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 21 01:58:06.586428 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:06.597154 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:06.726273 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:58:06.750498 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:58:06.762724 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Instance destroyed successfully.
May 21 01:58:06.904397 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Detaching volume 99e89209-ee54-4c1e-922b-ed08da485e1c
May 21 01:58:06.978148 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Took 15.62 seconds to build instance.
May 21 01:58:06.994980 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Attempting to driver detach volume 99e89209-ee54-4c1e-922b-ed08da485e1c from mountpoint /dev/vdb
May 21 01:58:07.012625 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Found disk vdb by alias ua-99e89209-ee54-4c1e-922b-ed08da485e1c {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 01:58:07.012833 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Attempting to detach device vdb from instance 6f68556b-0b18-452a-b307-da2dad4ee6ab from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 01:58:07.013114 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] detach device xml: <disk type="block" device="disk">
May 21 01:58:07.013114 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:58:07.013114 np0000001127 nova-compute[98206]:   <alias name="ua-99e89209-ee54-4c1e-922b-ed08da485e1c"/>
May 21 01:58:07.013114 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-6"/>
May 21 01:58:07.013114 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 01:58:07.013114 np0000001127 nova-compute[98206]:   <serial>99e89209-ee54-4c1e-922b-ed08da485e1c</serial>
May 21 01:58:07.013114 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 01:58:07.013114 np0000001127 nova-compute[98206]: </disk>
May 21 01:58:07.013114 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 01:58:07.032281 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Successfully detached device vdb from instance 6f68556b-0b18-452a-b307-da2dad4ee6ab from the persistent domain config.
May 21 01:58:07.034135 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 01:58:07.034135 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '99e89209-ee54-4c1e-922b-ed08da485e1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:58:07.034135 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:58:07.035216 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:58:07.035737 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '99e89209-ee54-4c1e-922b-ed08da485e1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 01:58:07.035903 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 01:58:07.083244 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:58:07.083244 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:58:07.083244 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:58:07.083244 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:58:07.083244 np0000001127 nova-compute[98206]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:07.083244 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:07.083244 np0000001127 nova-compute[98206]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:07.083244 np0000001127 nova-compute[98206]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:07.083244 np0000001127 nova-compute[98206]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:07.083244 np0000001127 nova-compute[98206]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:07.083244 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:58:07.083244 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:58:07.083244 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:58:07.083623 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsi session list stdout=tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:58:07.083623 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:58:07.083623 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:58:07.083623 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:58:07.083623 np0000001127 nova-compute[98206]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:07.083623 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:07.083623 np0000001127 nova-compute[98206]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:07.083623 np0000001127 nova-compute[98206]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:07.083623 np0000001127 nova-compute[98206]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:07.083623 np0000001127 nova-compute[98206]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:07.083623 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:58:07.083623 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:58:07.083623 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:58:07.083623 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48', '22'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88', '6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88', '7')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 01:58:07.086990 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', '20')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 01:58:07.086990 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', '21')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 01:58:07.086990 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c76c540>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c'): ({'sdk'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 01:58:07.087420 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Removing multipathed devices sdk, sdj {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 01:58:07.090804 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Flush multipath device 330000000a9f70f02 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 01:58:07.119866 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:58:07.120098 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:58:07.128009 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 01:58:07.151066 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b16a25ca-be32-4d67-9e98-55e5b6450099 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "e9664d16-b539-4ccc-abd4-47a8fa944520" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.772s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:07.180343 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 01:58:07.233867 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 01:58:07.234061 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 01:58:07.235448 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 01:58:07.246988 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 01:58:07.247194 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 01:58:07.254943 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999729608000052 future=<Future at 0x71c058649310 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:58:07.255306 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999363449999919 future=<Future at 0x71c058649310 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:58:07.255360 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999251170999969 future=<Future at 0x71c058649310 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:58:07.259194 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:07.297154 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c, portal: 192.168.40.100,3260]
May 21 01:58:07.297154 np0000001127 nova-compute[98206]: Logout of [sid: 20, target: iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c, portal: 192.168.40.100,3260] successful.
May 21 01:58:07.297154 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:07.317865 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:07.328686 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:07.367862 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c, portal: 192.168.50.100,3260]
May 21 01:58:07.367862 np0000001127 nova-compute[98206]: Logout of [sid: 21, target: iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c, portal: 192.168.50.100,3260] successful.
May 21 01:58:07.367862 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:07.388397 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:07.388647 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:58:07.388789 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] <== disconnect_volume: return (355ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:58:07.388897 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 01:58:07.479123 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Lock "f8921842-2161-4ddf-b3c4-b642fc51a70f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.130s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:07.623031 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:58:08.043853 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b44e6145-7732-47e3-8217-6dd4c5b09e8e req-9aaf4ef5-02b3-4970-ac35-1e98943815b8 service nova] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Received event network-vif-plugged-3ef861c1-6e74-4d82-a214-06c2d655f210 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:08.045403 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b44e6145-7732-47e3-8217-6dd4c5b09e8e req-9aaf4ef5-02b3-4970-ac35-1e98943815b8 service nova] Acquiring lock "f8921842-2161-4ddf-b3c4-b642fc51a70f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:08.053055 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b44e6145-7732-47e3-8217-6dd4c5b09e8e req-9aaf4ef5-02b3-4970-ac35-1e98943815b8 service nova] Lock "f8921842-2161-4ddf-b3c4-b642fc51a70f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:08.053055 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b44e6145-7732-47e3-8217-6dd4c5b09e8e req-9aaf4ef5-02b3-4970-ac35-1e98943815b8 service nova] Lock "f8921842-2161-4ddf-b3c4-b642fc51a70f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:08.053055 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b44e6145-7732-47e3-8217-6dd4c5b09e8e req-9aaf4ef5-02b3-4970-ac35-1e98943815b8 service nova] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] No waiting events found dispatching network-vif-plugged-3ef861c1-6e74-4d82-a214-06c2d655f210 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:58:08.053055 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-b44e6145-7732-47e3-8217-6dd4c5b09e8e req-9aaf4ef5-02b3-4970-ac35-1e98943815b8 service nova] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Received unexpected event network-vif-plugged-3ef861c1-6e74-4d82-a214-06c2d655f210 for instance with vm_state active and task_state None.
May 21 01:58:08.053055 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b44e6145-7732-47e3-8217-6dd4c5b09e8e req-9aaf4ef5-02b3-4970-ac35-1e98943815b8 service nova] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Received event network-vif-unplugged-069db2b1-36ac-43ce-b643-fcdc9ff52141 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:08.053055 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b44e6145-7732-47e3-8217-6dd4c5b09e8e req-9aaf4ef5-02b3-4970-ac35-1e98943815b8 service nova] Acquiring lock "6f68556b-0b18-452a-b307-da2dad4ee6ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:08.053055 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b44e6145-7732-47e3-8217-6dd4c5b09e8e req-9aaf4ef5-02b3-4970-ac35-1e98943815b8 service nova] Lock "6f68556b-0b18-452a-b307-da2dad4ee6ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:08.053055 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b44e6145-7732-47e3-8217-6dd4c5b09e8e req-9aaf4ef5-02b3-4970-ac35-1e98943815b8 service nova] Lock "6f68556b-0b18-452a-b307-da2dad4ee6ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:08.053055 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b44e6145-7732-47e3-8217-6dd4c5b09e8e req-9aaf4ef5-02b3-4970-ac35-1e98943815b8 service nova] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] No waiting events found dispatching network-vif-unplugged-069db2b1-36ac-43ce-b643-fcdc9ff52141 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:58:08.053055 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-b44e6145-7732-47e3-8217-6dd4c5b09e8e req-9aaf4ef5-02b3-4970-ac35-1e98943815b8 service nova] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Received unexpected event network-vif-unplugged-069db2b1-36ac-43ce-b643-fcdc9ff52141 for instance with vm_state active and task_state rebuilding.
May 21 01:58:08.053055 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b44e6145-7732-47e3-8217-6dd4c5b09e8e req-9aaf4ef5-02b3-4970-ac35-1e98943815b8 service nova] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Received event network-vif-unplugged-069db2b1-36ac-43ce-b643-fcdc9ff52141 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:08.053055 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b44e6145-7732-47e3-8217-6dd4c5b09e8e req-9aaf4ef5-02b3-4970-ac35-1e98943815b8 service nova] Acquiring lock "6f68556b-0b18-452a-b307-da2dad4ee6ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:08.053055 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b44e6145-7732-47e3-8217-6dd4c5b09e8e req-9aaf4ef5-02b3-4970-ac35-1e98943815b8 service nova] Lock "6f68556b-0b18-452a-b307-da2dad4ee6ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:08.053055 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b44e6145-7732-47e3-8217-6dd4c5b09e8e req-9aaf4ef5-02b3-4970-ac35-1e98943815b8 service nova] Lock "6f68556b-0b18-452a-b307-da2dad4ee6ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:08.053055 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b44e6145-7732-47e3-8217-6dd4c5b09e8e req-9aaf4ef5-02b3-4970-ac35-1e98943815b8 service nova] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] No waiting events found dispatching network-vif-unplugged-069db2b1-36ac-43ce-b643-fcdc9ff52141 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:58:08.055561 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-b44e6145-7732-47e3-8217-6dd4c5b09e8e req-9aaf4ef5-02b3-4970-ac35-1e98943815b8 service nova] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Received unexpected event network-vif-unplugged-069db2b1-36ac-43ce-b643-fcdc9ff52141 for instance with vm_state active and task_state rebuilding.
May 21 01:58:08.130369 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.954s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:08.130965 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 01:58:08.573922 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Instance destroyed successfully.
May 21 01:58:08.575903 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:56:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-288227188',display_name='tempest-ServerActionsTestOtherA-server-410489228',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-tempest-common-compute-instance-288227188',id=10,image_ref='fea37df7-c5b0-431e-9e55-09d856a51ff9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFa4h1sACKVx0qMim6t3PkF47uhDyneTJkwL/xOqx10IdCIKzdMNwpXbxDopvRYuon+cm2g/xX3KdbSKB9yixqLXsKKYgUZSUERIMzzqqvllJnaPGuHQmel2EKS0sBdZzQ==',key_name='tempest-keypair-1484910746',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:57:12Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6a15fe7a70464159a778cffa4a36c36f',ramdisk_id='',reservation_id='r-06kjjbvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fea37df7-c5b0-431e-9e55-09d856a51ff9',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1975191698',owner_user_name='tempest-ServerActionsTestOtherA-1975191698-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:58:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbcd1a81252344dd804a4080571f8751',uuid=6f68556b-0b18-452a-b307-da2dad4ee6ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "069db2b1-36ac-43ce-b643-fcdc9ff52141", "address": "fa:16:3e:30:ad:e5", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap069db2b1-36", "ovs_interfaceid": "069db2b1-36ac-43ce-b643-fcdc9ff52141", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 01:58:08.576127 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Converting VIF {"id": "069db2b1-36ac-43ce-b643-fcdc9ff52141", "address": "fa:16:3e:30:ad:e5", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap069db2b1-36", "ovs_interfaceid": "069db2b1-36ac-43ce-b643-fcdc9ff52141", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:58:08.577657 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:ad:e5,bridge_name='br-int',has_traffic_filtering=True,id=069db2b1-36ac-43ce-b643-fcdc9ff52141,network=Network(6d660724-85bf-45e3-895a-b9ce67043c30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap069db2b1-36') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:58:08.577657 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:ad:e5,bridge_name='br-int',has_traffic_filtering=True,id=069db2b1-36ac-43ce-b643-fcdc9ff52141,network=Network(6d660724-85bf-45e3-895a-b9ce67043c30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap069db2b1-36') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 01:58:08.586633 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:08.586944 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap069db2b1-36, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:08.588423 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:08.590347 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:58:08.591416 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:08.591667 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d8133ed-75c3-4231-9a56-096647e6b6d7) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:08.595348 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:58:08.596136 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:08.598664 np0000001127 nova-compute[98206]: INFO os_vif [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:ad:e5,bridge_name='br-int',has_traffic_filtering=True,id=069db2b1-36ac-43ce-b643-fcdc9ff52141,network=Network(6d660724-85bf-45e3-895a-b9ce67043c30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap069db2b1-36')
May 21 01:58:08.602192 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 01:58:08.603883 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '99e89209-ee54-4c1e-922b-ed08da485e1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:58:08.603883 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:58:08.603883 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:58:08.604374 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '99e89209-ee54-4c1e-922b-ed08da485e1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 01:58:08.604374 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 01:58:08.637392 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 01:58:08.637699 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 01:58:08.638828 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:08.639917 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:08.640751 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:58:08.640751 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:58:08.640751 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:58:08.640751 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:58:08.640751 np0000001127 nova-compute[98206]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:08.640751 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:08.640751 np0000001127 nova-compute[98206]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:08.640751 np0000001127 nova-compute[98206]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:08.640751 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:58:08.640751 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:58:08.640751 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:58:08.641200 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsi session list stdout=tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:58:08.641200 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:58:08.641200 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:58:08.641200 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:58:08.641200 np0000001127 nova-compute[98206]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:08.641200 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:08.641200 np0000001127 nova-compute[98206]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:08.641200 np0000001127 nova-compute[98206]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:08.641200 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:58:08.641200 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:58:08.641200 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:58:08.642295 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48', '22'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88', '6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88', '7')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 01:58:08.642482 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c, 0): [] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 01:58:08.643270 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c') {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 21 01:58:08.643429 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c, 0): [] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 01:58:08.643680 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c') {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 21 01:58:08.643853 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c0587d8ae0>, {}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 01:58:08.644214 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Disconnecting from: [] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 01:58:08.646276 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.041s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:58:08.647052 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] <== disconnect_volume: return (42ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:58:08.647052 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 01:58:08.647245 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Deleting instance files /opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab_del
May 21 01:58:08.650663 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Deletion of /opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab_del complete
May 21 01:58:09.098415 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd5b969d5a514d01bacfc7954a5ae4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83df9a84ffaa4398bdafbfbde079964d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 01:58:09.150361 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 01:58:09.606669 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:09.651541 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 01:58:09.667183 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Booting with volume 99e89209-ee54-4c1e-922b-ed08da485e1c at /dev/vdb
May 21 01:58:09.738563 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:58:09.754233 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 01:58:09.756923 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Successfully created port: 43f9f40a-cc12-40f7-8311-7fcb01148125 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 01:58:09.788860 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:09.829174 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 01:58:09.830422 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 01:58:09.844329 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 01:58:09.847313 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe9e:216', 'fe80::14d9:7bff:fe3b:f0dc', 'fe80::fc16:3eff:fef6:c7e3', 'fe80::68db:c7ff:fe71:da32', 'fe80::fc16:3eff:fefd:1e9d', 'fe80::3cf5:efff:fe9b:7732', 'fe80::fc16:3eff:fe10:bc3b', 'fe80::fc16:3eff:fe05:2b1', 'fe80::fc16:3eff:fedf:4a48', 'fe80::fc16:3eff:fe70:5b80', 'fe80::fc16:3eff:fee5:ea60', 'fe80::e477:a1ff:fe9c:52f7', 'fe80::fc16:3eff:fe56:b959', 'fe80::60e1:9aff:fec4:237f', 'fe80::fc16:3eff:fe00:d8d3', 'fe80::c062:49ff:fe28:b40d', 'fe80::fc16:3eff:feef:6106', 'fe80::4f8:d7ff:fe7a:a4fe'] 
May 21 01:58:09.847496 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 01:58:09.847730 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 01:58:09.847973 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:58:09.848158 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Updating existing volume attachment record: eaa0bd6c-cc22-4442-b5a0-f68c610384d7 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 01:58:10.169624 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-5b0362d9-e343-48db-88b3-f00ea6f51a49 req-11b479a9-0b87-4504-a5b8-716dcd23283d service nova] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Received event network-changed-3ef861c1-6e74-4d82-a214-06c2d655f210 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:10.172406 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-5b0362d9-e343-48db-88b3-f00ea6f51a49 req-11b479a9-0b87-4504-a5b8-716dcd23283d service nova] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Refreshing instance network info cache due to event network-changed-3ef861c1-6e74-4d82-a214-06c2d655f210. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:58:10.172406 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5b0362d9-e343-48db-88b3-f00ea6f51a49 req-11b479a9-0b87-4504-a5b8-716dcd23283d service nova] Acquiring lock "refresh_cache-f8921842-2161-4ddf-b3c4-b642fc51a70f" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:58:10.172406 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5b0362d9-e343-48db-88b3-f00ea6f51a49 req-11b479a9-0b87-4504-a5b8-716dcd23283d service nova] Acquired lock "refresh_cache-f8921842-2161-4ddf-b3c4-b642fc51a70f" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:58:10.172406 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-5b0362d9-e343-48db-88b3-f00ea6f51a49 req-11b479a9-0b87-4504-a5b8-716dcd23283d service nova] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Refreshing network info cache for port 3ef861c1-6e74-4d82-a214-06c2d655f210 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:58:10.640318 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Successfully updated port: 43f9f40a-cc12-40f7-8311-7fcb01148125 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 01:58:10.666809 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 01:58:10.671544 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 01:58:10.671861 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Creating image(s)
May 21 01:58:10.672571 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d75ff65-b688-4387-89e3-70567e569682/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:10.674102 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "/opt/stack/data/nova/instances/0d75ff65-b688-4387-89e3-70567e569682/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:10.675539 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "/opt/stack/data/nova/instances/0d75ff65-b688-4387-89e3-70567e569682/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:10.675539 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:58:10.683569 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-5b0362d9-e343-48db-88b3-f00ea6f51a49 req-11b479a9-0b87-4504-a5b8-716dcd23283d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:10.689236 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:58:10.694549 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:10.779558 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-627ff830-8515-4cfa-b809-bc6de01fe7ce req-df4fc410-3535-4482-b2b8-7be94be0abfe service nova] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Received event network-changed-43f9f40a-cc12-40f7-8311-7fcb01148125 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:10.779558 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-627ff830-8515-4cfa-b809-bc6de01fe7ce req-df4fc410-3535-4482-b2b8-7be94be0abfe service nova] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Refreshing instance network info cache due to event network-changed-43f9f40a-cc12-40f7-8311-7fcb01148125. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:58:10.782294 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-627ff830-8515-4cfa-b809-bc6de01fe7ce req-df4fc410-3535-4482-b2b8-7be94be0abfe service nova] Acquiring lock "refresh_cache-0d75ff65-b688-4387-89e3-70567e569682" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:58:10.782294 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-627ff830-8515-4cfa-b809-bc6de01fe7ce req-df4fc410-3535-4482-b2b8-7be94be0abfe service nova] Acquired lock "refresh_cache-0d75ff65-b688-4387-89e3-70567e569682" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:58:10.782294 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-627ff830-8515-4cfa-b809-bc6de01fe7ce req-df4fc410-3535-4482-b2b8-7be94be0abfe service nova] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Refreshing network info cache for port 43f9f40a-cc12-40f7-8311-7fcb01148125 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:58:10.783439 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.089s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:10.784902 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:10.788063 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:10.788063 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:58:10.789091 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:58:10.791515 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:10.900289 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.110s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:10.900815 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/0d75ff65-b688-4387-89e3-70567e569682/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:10.974583 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/0d75ff65-b688-4387-89e3-70567e569682/disk 1073741824" returned: 0 in 0.073s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:10.975172 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:10.975746 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:11.084103 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.102s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:11.084103 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0d75ff65-b688-4387-89e3-70567e569682/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 01:58:11.084103 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d75ff65-b688-4387-89e3-70567e569682/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:11.141908 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "refresh_cache-0d75ff65-b688-4387-89e3-70567e569682" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:58:11.142825 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:11.192604 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d75ff65-b688-4387-89e3-70567e569682/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:11.193174 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Cannot resize image /opt/stack/data/nova/instances/0d75ff65-b688-4387-89e3-70567e569682/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 01:58:11.193417 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 01:58:11.193645 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Ensure instance console log exists: /opt/stack/data/nova/instances/0d75ff65-b688-4387-89e3-70567e569682/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 01:58:11.193968 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:11.194128 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:11.194255 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:11.270278 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-5b0362d9-e343-48db-88b3-f00ea6f51a49 req-11b479a9-0b87-4504-a5b8-716dcd23283d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:11.286941 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-627ff830-8515-4cfa-b809-bc6de01fe7ce req-df4fc410-3535-4482-b2b8-7be94be0abfe service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:11.391150 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-627ff830-8515-4cfa-b809-bc6de01fe7ce req-df4fc410-3535-4482-b2b8-7be94be0abfe service nova] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:58:11.493967 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-5b0362d9-e343-48db-88b3-f00ea6f51a49 req-11b479a9-0b87-4504-a5b8-716dcd23283d service nova] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Updated VIF entry in instance network info cache for port 3ef861c1-6e74-4d82-a214-06c2d655f210. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 01:58:11.495019 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-5b0362d9-e343-48db-88b3-f00ea6f51a49 req-11b479a9-0b87-4504-a5b8-716dcd23283d service nova] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Updating instance_info_cache with network_info: [{"id": "3ef861c1-6e74-4d82-a214-06c2d655f210", "address": "fa:16:3e:ef:61:06", "network": {"id": "92596e04-fd2c-46d6-bc35-90386827dd7e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-421500812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0c267ab1fe654c6da45280651b958746", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ef861c1-6e", "ovs_interfaceid": "3ef861c1-6e74-4d82-a214-06c2d655f210", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:58:11.627222 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-627ff830-8515-4cfa-b809-bc6de01fe7ce req-df4fc410-3535-4482-b2b8-7be94be0abfe service nova] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:58:11.783323 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:12.001182 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5b0362d9-e343-48db-88b3-f00ea6f51a49 req-11b479a9-0b87-4504-a5b8-716dcd23283d service nova] Releasing lock "refresh_cache-f8921842-2161-4ddf-b3c4-b642fc51a70f" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:58:12.120506 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 01:58:12.120777 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Creating image(s)
May 21 01:58:12.121324 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:12.122329 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "/opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:12.123058 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "/opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:12.123058 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "b6f859711b980279c62bd7a96f239bd0eaf5633a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:12.123853 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "b6f859711b980279c62bd7a96f239bd0eaf5633a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:12.130059 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-627ff830-8515-4cfa-b809-bc6de01fe7ce req-df4fc410-3535-4482-b2b8-7be94be0abfe service nova] Releasing lock "refresh_cache-0d75ff65-b688-4387-89e3-70567e569682" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:58:12.130748 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquired lock "refresh_cache-0d75ff65-b688-4387-89e3-70567e569682" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:58:12.130973 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 01:58:12.145698 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:12.145698 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:12.145698 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:12.146402 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:12.147784 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:12.152465 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Terminating instance
May 21 01:58:12.661639 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 01:58:12.695988 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:12.703178 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:12.728361 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:12.743525 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:12.756874 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:58:12.765319 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:12.790511 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:12.796212 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:12.906200 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:12.909333 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:12.962385 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:13.020083 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:13.037538 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:58:13.044118 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:58:13.044118 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6f859711b980279c62bd7a96f239bd0eaf5633a.part --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:13.089699 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:13.096838 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:13.142270 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6f859711b980279c62bd7a96f239bd0eaf5633a.part --force-share --output=json" returned: 0 in 0.099s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:13.142981 np0000001127 nova-compute[98206]: DEBUG nova.virt.images [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] fea37df7-c5b0-431e-9e55-09d856a51ff9 was qcow2, converting to raw {{(pid=98206) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 21 01:58:13.143950 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:13.145202 np0000001127 nova-compute[98206]: DEBUG nova.privsep.utils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 21 01:58:13.146533 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b6f859711b980279c62bd7a96f239bd0eaf5633a.part /opt/stack/data/nova/instances/_base/b6f859711b980279c62bd7a96f239bd0eaf5633a.converted {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:13.166964 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-ab01bcea-03e6-48c1-b3c1-09774c6df436 req-e88e2364-d9a5-40f3-b4e8-92c53884aab2 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-unplugged-db10c43a-9d2b-4250-83b6-0ca8ced88657 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:13.166964 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ab01bcea-03e6-48c1-b3c1-09774c6df436 req-e88e2364-d9a5-40f3-b4e8-92c53884aab2 service nova] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:13.166964 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ab01bcea-03e6-48c1-b3c1-09774c6df436 req-e88e2364-d9a5-40f3-b4e8-92c53884aab2 service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:13.166964 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ab01bcea-03e6-48c1-b3c1-09774c6df436 req-e88e2364-d9a5-40f3-b4e8-92c53884aab2 service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:13.166964 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-ab01bcea-03e6-48c1-b3c1-09774c6df436 req-e88e2364-d9a5-40f3-b4e8-92c53884aab2 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] No waiting events found dispatching network-vif-unplugged-db10c43a-9d2b-4250-83b6-0ca8ced88657 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:58:13.166964 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-ab01bcea-03e6-48c1-b3c1-09774c6df436 req-e88e2364-d9a5-40f3-b4e8-92c53884aab2 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-unplugged-db10c43a-9d2b-4250-83b6-0ca8ced88657 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 01:58:13.183702 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:13.238703 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:13.239851 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:13.305765 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:13.353732 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.99953398699995 future=<Future at 0x71c07c7bc140 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:58:13.353732 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Instance destroyed successfully.
May 21 01:58:13.354732 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lazy-loading 'resources' on Instance uuid 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:58:13.415868 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:13.417063 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:13.437204 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:13.573225 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Updating instance_info_cache with network_info: [{"id": "43f9f40a-cc12-40f7-8311-7fcb01148125", "address": "fa:16:3e:e3:f7:d2", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f9f40a-cc", "ovs_interfaceid": "43f9f40a-cc12-40f7-8311-7fcb01148125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:58:13.594036 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:13.620208 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:13.671647 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:13.700605 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:13.775661 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:13.858417 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1881553016',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-1881553016',id=8,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBhaMEk9DiH2Bx5NNy3a3Zcjn51ZPUcBOQR2tG9r9zsoi7BbVdTpWoBYnD1pSE/ZUlPcBmm+IYQRAksBakKITqSdzVcswYCcllJKJ4mjJEDrm/7oZYVwTy+GTcc+FpFXw==',key_name='tempest-keypair-947972251',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:57:20Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d16c5939e8b346a8a2da89fb19b2a812',ramdisk_id='',reservation_id='r-kje4iw6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1353067880',owner_user_name='tempest-TaggedBootDevicesTest-1353067880-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:57:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06d28d9bc06a4a27bcba288eb5a07e0c',uuid=58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebf91ac5-9634-4897-a1bb-7336846be7cb", "address": "fa:16:3e:fd:1e:9d", "network": {"id": "724d3b04-8f64-44ab-8f94-c1119b9a5b83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1321933524-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf91ac5-96", "ovs_interfaceid": "ebf91ac5-9634-4897-a1bb-7336846be7cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 01:58:13.858851 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converting VIF {"id": "ebf91ac5-9634-4897-a1bb-7336846be7cb", "address": "fa:16:3e:fd:1e:9d", "network": {"id": "724d3b04-8f64-44ab-8f94-c1119b9a5b83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1321933524-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf91ac5-96", "ovs_interfaceid": "ebf91ac5-9634-4897-a1bb-7336846be7cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:58:13.860603 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:1e:9d,bridge_name='br-int',has_traffic_filtering=True,id=ebf91ac5-9634-4897-a1bb-7336846be7cb,network=Network(724d3b04-8f64-44ab-8f94-c1119b9a5b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf91ac5-96') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:58:13.860603 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:1e:9d,bridge_name='br-int',has_traffic_filtering=True,id=ebf91ac5-9634-4897-a1bb-7336846be7cb,network=Network(724d3b04-8f64-44ab-8f94-c1119b9a5b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf91ac5-96') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 01:58:13.862483 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:13.864562 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebf91ac5-96, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:13.867772 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:58:13.902685 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:13.904603 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:13.904856 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=109b58ad-ad71-4191-bd6b-e39802903be8) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:13.909615 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:58:13.944648 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:13.947195 np0000001127 nova-compute[98206]: INFO os_vif [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:1e:9d,bridge_name='br-int',has_traffic_filtering=True,id=ebf91ac5-9634-4897-a1bb-7336846be7cb,network=Network(724d3b04-8f64-44ab-8f94-c1119b9a5b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf91ac5-96')
May 21 01:58:13.948102 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1881553016',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-1881553016',id=8,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBhaMEk9DiH2Bx5NNy3a3Zcjn51ZPUcBOQR2tG9r9zsoi7BbVdTpWoBYnD1pSE/ZUlPcBmm+IYQRAksBakKITqSdzVcswYCcllJKJ4mjJEDrm/7oZYVwTy+GTcc+FpFXw==',key_name='tempest-keypair-947972251',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:57:20Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d16c5939e8b346a8a2da89fb19b2a812',ramdisk_id='',reservation_id='r-kje4iw6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1353067880',owner_user_name='tempest-TaggedBootDevicesTest-1353067880-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:57:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06d28d9bc06a4a27bcba288eb5a07e0c',uuid=58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "319abe1b-caf8-4fa7-bc6c-caa7e755860b", "address": "fa:16:3e:10:bc:3b", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap319abe1b-ca", "ovs_interfaceid": "319abe1b-caf8-4fa7-bc6c-caa7e755860b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 01:58:13.948323 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converting VIF {"id": "319abe1b-caf8-4fa7-bc6c-caa7e755860b", "address": "fa:16:3e:10:bc:3b", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap319abe1b-ca", "ovs_interfaceid": "319abe1b-caf8-4fa7-bc6c-caa7e755860b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:58:13.948985 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:bc:3b,bridge_name='br-int',has_traffic_filtering=True,id=319abe1b-caf8-4fa7-bc6c-caa7e755860b,network=Network(dbb55b2c-d3ef-4540-90e5-c3bb021515d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap319abe1b-ca') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:58:13.949265 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:bc:3b,bridge_name='br-int',has_traffic_filtering=True,id=319abe1b-caf8-4fa7-bc6c-caa7e755860b,network=Network(dbb55b2c-d3ef-4540-90e5-c3bb021515d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap319abe1b-ca') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 01:58:13.950142 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:13.950435 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap319abe1b-ca, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:13.952998 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:58:13.973867 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b6f859711b980279c62bd7a96f239bd0eaf5633a.part /opt/stack/data/nova/instances/_base/b6f859711b980279c62bd7a96f239bd0eaf5633a.converted" returned: 0 in 0.828s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:13.980161 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6f859711b980279c62bd7a96f239bd0eaf5633a.converted --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:13.992685 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:13.996314 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:13.996771 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=469b41ac-d038-4bd0-a636-95fcf4586f2d) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:14.000387 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:58:14.026402 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:14.028805 np0000001127 nova-compute[98206]: INFO os_vif [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:bc:3b,bridge_name='br-int',has_traffic_filtering=True,id=319abe1b-caf8-4fa7-bc6c-caa7e755860b,network=Network(dbb55b2c-d3ef-4540-90e5-c3bb021515d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap319abe1b-ca')
May 21 01:58:14.032044 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1881553016',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-1881553016',id=8,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBhaMEk9DiH2Bx5NNy3a3Zcjn51ZPUcBOQR2tG9r9zsoi7BbVdTpWoBYnD1pSE/ZUlPcBmm+IYQRAksBakKITqSdzVcswYCcllJKJ4mjJEDrm/7oZYVwTy+GTcc+FpFXw==',key_name='tempest-keypair-947972251',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:57:20Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d16c5939e8b346a8a2da89fb19b2a812',ramdisk_id='',reservation_id='r-kje4iw6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1353067880',owner_user_name='tempest-TaggedBootDevicesTest-1353067880-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:57:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06d28d9bc06a4a27bcba288eb5a07e0c',uuid=58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db10c43a-9d2b-4250-83b6-0ca8ced88657", "address": "fa:16:3e:05:02:b1", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb10c43a-9d", "ovs_interfaceid": "db10c43a-9d2b-4250-83b6-0ca8ced88657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 01:58:14.033071 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converting VIF {"id": "db10c43a-9d2b-4250-83b6-0ca8ced88657", "address": "fa:16:3e:05:02:b1", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb10c43a-9d", "ovs_interfaceid": "db10c43a-9d2b-4250-83b6-0ca8ced88657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:58:14.034051 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:02:b1,bridge_name='br-int',has_traffic_filtering=True,id=db10c43a-9d2b-4250-83b6-0ca8ced88657,network=Network(dbb55b2c-d3ef-4540-90e5-c3bb021515d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdb10c43a-9d') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:58:14.034347 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:02:b1,bridge_name='br-int',has_traffic_filtering=True,id=db10c43a-9d2b-4250-83b6-0ca8ced88657,network=Network(dbb55b2c-d3ef-4540-90e5-c3bb021515d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdb10c43a-9d') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 01:58:14.036251 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:14.036461 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb10c43a-9d, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:14.042591 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:58:14.056387 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:14.058401 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:14.058736 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=351e33bc-ddfd-4ed4-8227-b90ff88131d9) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:14.061527 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:58:14.075747 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:14.077747 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Releasing lock "refresh_cache-0d75ff65-b688-4387-89e3-70567e569682" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:58:14.080135 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6f859711b980279c62bd7a96f239bd0eaf5633a.converted --force-share --output=json" returned: 0 in 0.098s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:14.081031 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Instance network_info: |[{"id": "43f9f40a-cc12-40f7-8311-7fcb01148125", "address": "fa:16:3e:e3:f7:d2", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f9f40a-cc", "ovs_interfaceid": "43f9f40a-cc12-40f7-8311-7fcb01148125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 01:58:14.083857 np0000001127 nova-compute[98206]: INFO os_vif [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:02:b1,bridge_name='br-int',has_traffic_filtering=True,id=db10c43a-9d2b-4250-83b6-0ca8ced88657,network=Network(dbb55b2c-d3ef-4540-90e5-c3bb021515d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdb10c43a-9d')
May 21 01:58:14.084758 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Start _get_guest_xml network_info=[{"id": "43f9f40a-cc12-40f7-8311-7fcb01148125", "address": "fa:16:3e:e3:f7:d2", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f9f40a-cc", "ovs_interfaceid": "43f9f40a-cc12-40f7-8311-7fcb01148125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 01:58:14.085233 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "b6f859711b980279c62bd7a96f239bd0eaf5633a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.960s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:14.086324 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1881553016',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-1881553016',id=8,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBhaMEk9DiH2Bx5NNy3a3Zcjn51ZPUcBOQR2tG9r9zsoi7BbVdTpWoBYnD1pSE/ZUlPcBmm+IYQRAksBakKITqSdzVcswYCcllJKJ4mjJEDrm/7oZYVwTy+GTcc+FpFXw==',key_name='tempest-keypair-947972251',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:57:20Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d16c5939e8b346a8a2da89fb19b2a812',ramdisk_id='',reservation_id='r-kje4iw6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1353067880',owner_user_name='tempest-TaggedBootDevicesTest-1353067880-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:57:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06d28d9bc06a4a27bcba288eb5a07e0c',uuid=58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d807c564-314d-4f8e-8984-8068d59d3538", "address": "fa:16:3e:df:4a:48", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd807c564-31", "ovs_interfaceid": "d807c564-314d-4f8e-8984-8068d59d3538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 01:58:14.086681 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converting VIF {"id": "d807c564-314d-4f8e-8984-8068d59d3538", "address": "fa:16:3e:df:4a:48", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd807c564-31", "ovs_interfaceid": "d807c564-314d-4f8e-8984-8068d59d3538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:58:14.088241 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:58:14.088552 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:4a:48,bridge_name='br-int',has_traffic_filtering=True,id=d807c564-314d-4f8e-8984-8068d59d3538,network=Network(dbb55b2c-d3ef-4540-90e5-c3bb021515d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd807c564-31') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:58:14.088773 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:4a:48,bridge_name='br-int',has_traffic_filtering=True,id=d807c564-314d-4f8e-8984-8068d59d3538,network=Network(dbb55b2c-d3ef-4540-90e5-c3bb021515d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd807c564-31') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 01:58:14.091074 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 01:58:14.092771 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-598493742', uuid='0d75ff65-b688-4387-89e3-70567e569682'), owner=OwnerMeta(userid='bd5b969d5a514d01bacfc7954a5ae4ab', username='tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member', projectid='83df9a84ffaa4398bdafbfbde079964d', projectname='tempest-ServerBootFromVolumeStableRescueTest-260444396'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "43f9f40a-cc12-40f7-8311-7fcb01148125", "address": "fa:16:3e:e3:f7:d2", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f9f40a-cc", "ovs_interfaceid": "43f9f40a-cc12-40f7-8311-7fcb01148125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328694.0922863) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 01:58:14.100502 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:14.104626 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd807c564-31, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:14.106738 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 01:58:14.108179 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 01:58:14.116602 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:58:14.117766 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:58:14.118085 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 01:58:14.118772 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 01:58:14.120154 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 01:58:14.120648 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 01:58:14.121108 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 01:58:14.121108 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 01:58:14.121234 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 01:58:14.121332 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 01:58:14.121418 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 01:58:14.121630 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 01:58:14.122095 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 01:58:14.122770 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6f859711b980279c62bd7a96f239bd0eaf5633a --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:14.123151 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 01:58:14.123380 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:14.124067 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 01:58:14.124260 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 01:58:14.134867 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:14.151183 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9120f104-1184-4396-932d-1ba4c84ebc68) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:14.159313 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T01:58:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-598493742',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serverbootfromvolumestablerescuetest-server-598493742',id=12,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83df9a84ffaa4398bdafbfbde079964d',ramdisk_id='',reservation_id='r-m28dtruh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-260444396',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:58:10Z,user_data=None,user_id='bd5b969d5a514d01bacfc7954a5ae4ab',uuid=0d75ff65-b688-4387-89e3-70567e569682,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43f9f40a-cc12-40f7-8311-7fcb01148125", "address": "fa:16:3e:e3:f7:d2", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f9f40a-cc", "ovs_interfaceid": "43f9f40a-cc12-40f7-8311-7fcb01148125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 01:58:14.159846 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Converting VIF {"id": "43f9f40a-cc12-40f7-8311-7fcb01148125", "address": "fa:16:3e:e3:f7:d2", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f9f40a-cc", "ovs_interfaceid": "43f9f40a-cc12-40f7-8311-7fcb01148125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:58:14.160649 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:f7:d2,bridge_name='br-int',has_traffic_filtering=True,id=43f9f40a-cc12-40f7-8311-7fcb01148125,network=Network(b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43f9f40a-cc') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:58:14.161660 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d75ff65-b688-4387-89e3-70567e569682 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:58:14.165403 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:58:14.174729 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:14.178364 np0000001127 nova-compute[98206]: INFO os_vif [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:4a:48,bridge_name='br-int',has_traffic_filtering=True,id=d807c564-314d-4f8e-8984-8068d59d3538,network=Network(dbb55b2c-d3ef-4540-90e5-c3bb021515d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd807c564-31')
May 21 01:58:14.178364 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1881553016',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-1881553016',id=8,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBhaMEk9DiH2Bx5NNy3a3Zcjn51ZPUcBOQR2tG9r9zsoi7BbVdTpWoBYnD1pSE/ZUlPcBmm+IYQRAksBakKITqSdzVcswYCcllJKJ4mjJEDrm/7oZYVwTy+GTcc+FpFXw==',key_name='tempest-keypair-947972251',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:57:20Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d16c5939e8b346a8a2da89fb19b2a812',ramdisk_id='',reservation_id='r-kje4iw6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1353067880',owner_user_name='tempest-TaggedBootDevicesTest-1353067880-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:57:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06d28d9bc06a4a27bcba288eb5a07e0c',uuid=58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d03a47d5-bec7-4099-96e0-c102edfe9e8e", "address": "fa:16:3e:70:5b:80", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03a47d5-be", "ovs_interfaceid": "d03a47d5-bec7-4099-96e0-c102edfe9e8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 01:58:14.178774 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converting VIF {"id": "d03a47d5-bec7-4099-96e0-c102edfe9e8e", "address": "fa:16:3e:70:5b:80", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03a47d5-be", "ovs_interfaceid": "d03a47d5-bec7-4099-96e0-c102edfe9e8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:58:14.179156 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:5b:80,bridge_name='br-int',has_traffic_filtering=True,id=d03a47d5-bec7-4099-96e0-c102edfe9e8e,network=Network(dbb55b2c-d3ef-4540-90e5-c3bb021515d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd03a47d5-be') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:58:14.181162 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:5b:80,bridge_name='br-int',has_traffic_filtering=True,id=d03a47d5-bec7-4099-96e0-c102edfe9e8e,network=Network(dbb55b2c-d3ef-4540-90e5-c3bb021515d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd03a47d5-be') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 01:58:14.181832 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:14.181887 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd03a47d5-be, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:14.185822 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:58:14.193612 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:14.194873 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:14.195049 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=13140cd6-86d6-4195-9f05-517c622969bc) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:14.200491 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:58:14.207778 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:14.209758 np0000001127 nova-compute[98206]: INFO os_vif [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:5b:80,bridge_name='br-int',has_traffic_filtering=True,id=d03a47d5-bec7-4099-96e0-c102edfe9e8e,network=Network(dbb55b2c-d3ef-4540-90e5-c3bb021515d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd03a47d5-be')
May 21 01:58:14.210587 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1881553016',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-1881553016',id=8,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBhaMEk9DiH2Bx5NNy3a3Zcjn51ZPUcBOQR2tG9r9zsoi7BbVdTpWoBYnD1pSE/ZUlPcBmm+IYQRAksBakKITqSdzVcswYCcllJKJ4mjJEDrm/7oZYVwTy+GTcc+FpFXw==',key_name='tempest-keypair-947972251',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:57:20Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d16c5939e8b346a8a2da89fb19b2a812',ramdisk_id='',reservation_id='r-kje4iw6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1353067880',owner_user_name='tempest-TaggedBootDevicesTest-1353067880-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:57:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06d28d9bc06a4a27bcba288eb5a07e0c',uuid=58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14e48bfc-fab0-433c-b291-0e75e2da496c", "address": "fa:16:3e:e5:ea:60", "network": {"id": "7b5c3ed1-837f-404f-9062-8babcc21dfd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-715008204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e48bfc-fa", "ovs_interfaceid": "14e48bfc-fab0-433c-b291-0e75e2da496c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 01:58:14.211127 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converting VIF {"id": "14e48bfc-fab0-433c-b291-0e75e2da496c", "address": "fa:16:3e:e5:ea:60", "network": {"id": "7b5c3ed1-837f-404f-9062-8babcc21dfd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-715008204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e48bfc-fa", "ovs_interfaceid": "14e48bfc-fab0-433c-b291-0e75e2da496c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:58:14.211873 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:ea:60,bridge_name='br-int',has_traffic_filtering=True,id=14e48bfc-fab0-433c-b291-0e75e2da496c,network=Network(7b5c3ed1-837f-404f-9062-8babcc21dfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14e48bfc-fa') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:58:14.212362 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:ea:60,bridge_name='br-int',has_traffic_filtering=True,id=14e48bfc-fab0-433c-b291-0e75e2da496c,network=Network(7b5c3ed1-837f-404f-9062-8babcc21dfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14e48bfc-fa') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 01:58:14.213598 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:14.213853 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap14e48bfc-fa, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:14.217699 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:14.217808 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:58:14.223813 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:14.224911 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:14.225096 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5ba0c65f-b17c-41c3-81eb-2c81fe6ea7a8) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:14.226276 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:58:14.228863 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6f859711b980279c62bd7a96f239bd0eaf5633a --force-share --output=json" returned: 0 in 0.107s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:14.231541 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "b6f859711b980279c62bd7a96f239bd0eaf5633a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:14.231541 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "b6f859711b980279c62bd7a96f239bd0eaf5633a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:14.231541 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:58:14.231722 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:14.235243 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:58:14.235859 np0000001127 nova-compute[98206]: INFO os_vif [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:ea:60,bridge_name='br-int',has_traffic_filtering=True,id=14e48bfc-fab0-433c-b291-0e75e2da496c,network=Network(7b5c3ed1-837f-404f-9062-8babcc21dfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14e48bfc-fa')
May 21 01:58:14.236485 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1881553016',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-1881553016',id=8,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBhaMEk9DiH2Bx5NNy3a3Zcjn51ZPUcBOQR2tG9r9zsoi7BbVdTpWoBYnD1pSE/ZUlPcBmm+IYQRAksBakKITqSdzVcswYCcllJKJ4mjJEDrm/7oZYVwTy+GTcc+FpFXw==',key_name='tempest-keypair-947972251',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:57:20Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d16c5939e8b346a8a2da89fb19b2a812',ramdisk_id='',reservation_id='r-kje4iw6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1353067880',owner_user_name='tempest-TaggedBootDevicesTest-1353067880-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:57:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06d28d9bc06a4a27bcba288eb5a07e0c',uuid=58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93b6a994-3c94-45b3-be4c-d63ce41a8557", "address": "fa:16:3e:56:b9:59", "network": {"id": "7b5c3ed1-837f-404f-9062-8babcc21dfd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-715008204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93b6a994-3c", "ovs_interfaceid": "93b6a994-3c94-45b3-be4c-d63ce41a8557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 01:58:14.236718 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converting VIF {"id": "93b6a994-3c94-45b3-be4c-d63ce41a8557", "address": "fa:16:3e:56:b9:59", "network": {"id": "7b5c3ed1-837f-404f-9062-8babcc21dfd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-715008204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93b6a994-3c", "ovs_interfaceid": "93b6a994-3c94-45b3-be4c-d63ce41a8557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:58:14.237244 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:b9:59,bridge_name='br-int',has_traffic_filtering=True,id=93b6a994-3c94-45b3-be4c-d63ce41a8557,network=Network(7b5c3ed1-837f-404f-9062-8babcc21dfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93b6a994-3c') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:58:14.237489 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:b9:59,bridge_name='br-int',has_traffic_filtering=True,id=93b6a994-3c94-45b3-be4c-d63ce41a8557,network=Network(7b5c3ed1-837f-404f-9062-8babcc21dfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93b6a994-3c') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 01:58:14.240177 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6f859711b980279c62bd7a96f239bd0eaf5633a --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:14.240626 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:14.240861 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93b6a994-3c, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:14.257447 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:58:14.259634 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:14.259985 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6e9e5f9d-8d69-4b99-ac75-95f4a7334ae1) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:14.262142 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:58:14.263034 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:14.266191 np0000001127 nova-compute[98206]: INFO os_vif [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:b9:59,bridge_name='br-int',has_traffic_filtering=True,id=93b6a994-3c94-45b3-be4c-d63ce41a8557,network=Network(7b5c3ed1-837f-404f-9062-8babcc21dfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93b6a994-3c')
May 21 01:58:14.268409 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 01:58:14.269073 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88', 'iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5d11385-1cda-4417-8269-f34d36246e88', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:58:14.269533 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:58:14.270178 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:58:14.270691 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88', 'iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5d11385-1cda-4417-8269-f34d36246e88', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 01:58:14.270941 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 01:58:14.301828 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:58:14.301828 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:58:14.301828 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:58:14.301828 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:58:14.301828 np0000001127 nova-compute[98206]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:14.301828 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:14.301828 np0000001127 nova-compute[98206]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:14.301828 np0000001127 nova-compute[98206]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:14.301828 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:58:14.301828 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:58:14.301828 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:58:14.302381 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsi session list stdout=tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:58:14.302381 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:58:14.302381 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:58:14.302381 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:58:14.302381 np0000001127 nova-compute[98206]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:14.302381 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:14.302381 np0000001127 nova-compute[98206]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:14.302381 np0000001127 nova-compute[98206]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:14.302381 np0000001127 nova-compute[98206]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:58:14.302381 np0000001127 nova-compute[98206]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88 (non-flash)
May 21 01:58:14.302381 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:58:14.302381 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48', '22'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88', '6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88', '7')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 01:58:14.302381 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88', '6')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 01:58:14.303521 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88', '7')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 01:58:14.305025 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c505c60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88'): ({'sdc'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 01:58:14.305687 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Removing multipathed devices sdc, sdb {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 01:58:14.305979 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Flush multipath device 33000000026243d12 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 01:58:14.322666 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6f859711b980279c62bd7a96f239bd0eaf5633a --force-share --output=json" returned: 0 in 0.082s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:14.329579 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6f859711b980279c62bd7a96f239bd0eaf5633a,backing_fmt=raw /opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:14.366536 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 01:58:14.401803 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6f859711b980279c62bd7a96f239bd0eaf5633a,backing_fmt=raw /opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab/disk 1073741824" returned: 0 in 0.075s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:14.401803 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "b6f859711b980279c62bd7a96f239bd0eaf5633a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.169s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:14.401803 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6f859711b980279c62bd7a96f239bd0eaf5633a --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:14.425785 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 01:58:14.462927 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:14.474544 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 01:58:14.474794 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 01:58:14.476095 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 01:58:14.491424 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6f859711b980279c62bd7a96f239bd0eaf5633a --force-share --output=json" returned: 0 in 0.092s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:14.492170 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 01:58:14.493212 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 01:58:14.493740 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 01:58:14.495233 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:14.510315 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:14.550928 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88, portal: 192.168.40.100,3260]
May 21 01:58:14.550928 np0000001127 nova-compute[98206]: Logout of [sid: 6, target: iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88, portal: 192.168.40.100,3260] successful.
May 21 01:58:14.550928 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:14.573033 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:14.587195 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:14.590556 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:14.590556 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Cannot resize image /opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 01:58:14.590692 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 01:58:14.593490 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Ensure instance console log exists: /opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 01:58:14.593490 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:14.593490 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:14.593490 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:14.593754 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Start _get_guest_xml network_info=[{"id": "069db2b1-36ac-43ce-b643-fcdc9ff52141", "address": "fa:16:3e:30:ad:e5", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap069db2b1-36", "ovs_interfaceid": "069db2b1-36ac-43ce-b643-fcdc9ff52141", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-21T01:53:03Z,direct_url=<?>,disk_format='qcow2',id=fea37df7-c5b0-431e-9e55-09d856a51ff9,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-21T01:53:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '99e89209-ee54-4c1e-922b-ed08da485e1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '6f68556b-0b18-452a-b307-da2dad4ee6ab', 'attached_at': '', 'detached_at': '', 'volume_id': '99e89209-ee54-4c1e-922b-ed08da485e1c', 'serial': '99e89209-ee54-4c1e-922b-ed08da485e1c'}, 'delete_on_termination': False, 'attachment_id': 'eaa0bd6c-cc22-4442-b5a0-f68c610384d7', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 01:58:14.604423 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
May 21 01:58:14.605779 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='fea37df7-c5b0-431e-9e55-09d856a51ff9', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-410489228', uuid='6f68556b-0b18-452a-b307-da2dad4ee6ab'), owner=OwnerMeta(userid='bbcd1a81252344dd804a4080571f8751', username='tempest-ServerActionsTestOtherA-1975191698-project-member', projectid='6a15fe7a70464159a778cffa4a36c36f', projectname='tempest-ServerActionsTestOtherA-1975191698'), image=ImageMeta(id='fea37df7-c5b0-431e-9e55-09d856a51ff9', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "069db2b1-36ac-43ce-b643-fcdc9ff52141", "address": "fa:16:3e:30:ad:e5", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap069db2b1-36", "ovs_interfaceid": "069db2b1-36ac-43ce-b643-fcdc9ff52141", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328694.6053429) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 01:58:14.607277 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 01:58:14.607659 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 01:58:14.611206 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 01:58:14.612370 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 01:58:14.612727 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 01:58:14.613150 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-21T01:53:03Z,direct_url=<?>,disk_format='qcow2',id=fea37df7-c5b0-431e-9e55-09d856a51ff9,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-21T01:53:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 01:58:14.613796 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 01:58:14.613796 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 01:58:14.613796 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 01:58:14.613796 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 01:58:14.614040 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 01:58:14.614097 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 01:58:14.614214 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 01:58:14.614325 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 01:58:14.614661 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 01:58:14.614999 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 01:58:14.615233 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6f68556b-0b18-452a-b307-da2dad4ee6ab {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:58:14.633420 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88, portal: 192.168.50.100,3260]
May 21 01:58:14.633420 np0000001127 nova-compute[98206]: Logout of [sid: 7, target: iqn.2023-03.storpool.com:os--volume-f5d11385-1cda-4417-8269-f34d36246e88, portal: 192.168.50.100,3260] successful.
May 21 01:58:14.633420 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:14.655754 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:14.655754 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:58:14.655754 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] <== disconnect_volume: return (384ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:58:14.655754 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 01:58:14.655754 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 01:58:14.656055 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57', 'iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'de377f05-4bd5-4c5b-bf60-f92093972e57', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:58:14.656540 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:58:14.656976 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:58:14.659618 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57', 'iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'de377f05-4bd5-4c5b-bf60-f92093972e57', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 01:58:14.659618 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 01:58:14.670682 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] End _get_guest_xml xml=<domain type="qemu">
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:   <uuid>0d75ff65-b688-4387-89e3-70567e569682</uuid>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:   <name>instance-0000000c</name>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:   <metadata>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-598493742</nova:name>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 01:58:14</nova:creationTime>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:       </nova:image>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:         <nova:user uuid="bd5b969d5a514d01bacfc7954a5ae4ab">tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member</nova:user>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:         <nova:project uuid="83df9a84ffaa4398bdafbfbde079964d">tempest-ServerBootFromVolumeStableRescueTest-260444396</nova:project>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:         <nova:port uuid="43f9f40a-cc12-40f7-8311-7fcb01148125">
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:         </nova:port>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:   </metadata>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:     <system>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:       <entry name="serial">0d75ff65-b688-4387-89e3-70567e569682</entry>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:       <entry name="uuid">0d75ff65-b688-4387-89e3-70567e569682</entry>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:     </system>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:   <os>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:   </os>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:   <features>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:     <acpi/>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:     <tcg>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:     </tcg>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:   </features>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:   <devices>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/0d75ff65-b688-4387-89e3-70567e569682/disk"/>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:     </disk>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/0d75ff65-b688-4387-89e3-70567e569682/disk.config"/>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:     </disk>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:e3:f7:d2"/>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:       <target dev="tap43f9f40a-cc"/>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:     </interface>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/0d75ff65-b688-4387-89e3-70567e569682/console.log" append="off"/>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:     </serial>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:     <video>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:     </video>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:     </rng>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:     </memballoon>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:   </devices>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]: </domain>
May 21 01:58:14.670682 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 01:58:14.674353 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Preparing to wait for external event network-vif-plugged-43f9f40a-cc12-40f7-8311-7fcb01148125 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 01:58:14.674353 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "0d75ff65-b688-4387-89e3-70567e569682-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:14.674353 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "0d75ff65-b688-4387-89e3-70567e569682-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:14.674353 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "0d75ff65-b688-4387-89e3-70567e569682-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:14.674353 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T01:58:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-598493742',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serverbootfromvolumestablerescuetest-server-598493742',id=12,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83df9a84ffaa4398bdafbfbde079964d',ramdisk_id='',reservation_id='r-m28dtruh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-260444396',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:58:10Z,user_data=None,user_id='bd5b969d5a514d01bacfc7954a5ae4ab',uuid=0d75ff65-b688-4387-89e3-70567e569682,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43f9f40a-cc12-40f7-8311-7fcb01148125", "address": "fa:16:3e:e3:f7:d2", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f9f40a-cc", "ovs_interfaceid": "43f9f40a-cc12-40f7-8311-7fcb01148125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 01:58:14.674353 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Converting VIF {"id": "43f9f40a-cc12-40f7-8311-7fcb01148125", "address": "fa:16:3e:e3:f7:d2", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f9f40a-cc", "ovs_interfaceid": "43f9f40a-cc12-40f7-8311-7fcb01148125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:58:14.674353 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:f7:d2,bridge_name='br-int',has_traffic_filtering=True,id=43f9f40a-cc12-40f7-8311-7fcb01148125,network=Network(b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43f9f40a-cc') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:58:14.674828 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:f7:d2,bridge_name='br-int',has_traffic_filtering=True,id=43f9f40a-cc12-40f7-8311-7fcb01148125,network=Network(b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43f9f40a-cc') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 01:58:14.675901 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:14.676613 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:14.676896 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 01:58:14.678068 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:14.678257 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2ee049f8-0038-5d9e-9f68-21dddd364823', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:14.680380 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:58:14.683788 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:14.685826 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43f9f40a-cc, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:14.686312 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap43f9f40a-cc, col_values=(('qos', UUID('caba2666-b889-4131-b29d-82b5863c7071')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:14.686582 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap43f9f40a-cc, col_values=(('external_ids', {'iface-id': '43f9f40a-cc12-40f7-8311-7fcb01148125', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:f7:d2', 'vm-uuid': '0d75ff65-b688-4387-89e3-70567e569682'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:14.689674 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:14.693062 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:58:14.693302 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:58:14.693302 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:58:14.693302 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:58:14.693302 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:58:14.693302 np0000001127 nova-compute[98206]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:14.693302 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:14.693302 np0000001127 nova-compute[98206]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:14.693302 np0000001127 nova-compute[98206]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:14.693302 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:58:14.693624 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsi session list stdout=tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:58:14.693624 np0000001127 nova-compute[98206]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57 (non-flash)
May 21 01:58:14.693624 np0000001127 nova-compute[98206]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:58:14.693624 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:58:14.693624 np0000001127 nova-compute[98206]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:14.693624 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:14.693624 np0000001127 nova-compute[98206]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:14.693624 np0000001127 nova-compute[98206]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:14.693624 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:58:14.693624 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48', '22'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48', '23')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 01:58:14.693952 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57', '13')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 01:58:14.694760 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57', '12')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 01:58:14.696226 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c7ecd60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57'): ({'sdi'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 01:58:14.696226 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Removing multipathed devices sdi, sdh {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 01:58:14.696226 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Flush multipath device 330000000a3360359 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 01:58:14.697010 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:14.698783 np0000001127 nova-compute[98206]: INFO os_vif [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:f7:d2,bridge_name='br-int',has_traffic_filtering=True,id=43f9f40a-cc12-40f7-8311-7fcb01148125,network=Network(b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43f9f40a-cc')
May 21 01:58:14.734794 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 01:58:14.795334 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 01:58:14.850526 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 01:58:14.850526 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 01:58:14.850526 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 01:58:14.862451 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 01:58:14.862813 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 01:58:14.867173 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Acquiring lock "e9664d16-b539-4ccc-abd4-47a8fa944520" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:14.867463 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "e9664d16-b539-4ccc-abd4-47a8fa944520" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:14.878343 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:14.921496 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57, portal: 192.168.40.100,3260]
May 21 01:58:14.921496 np0000001127 nova-compute[98206]: Logout of [sid: 13, target: iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57, portal: 192.168.40.100,3260] successful.
May 21 01:58:14.921496 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:14.948483 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:14.968792 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:15.007940 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57, portal: 192.168.50.100,3260]
May 21 01:58:15.007940 np0000001127 nova-compute[98206]: Logout of [sid: 12, target: iqn.2023-03.storpool.com:os--volume-de377f05-4bd5-4c5b-bf60-f92093972e57, portal: 192.168.50.100,3260] successful.
May 21 01:58:15.007940 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:15.026776 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-444ffc84-a655-4959-8423-99c73edbdfa6 req-98a95b56-cb44-40e3-aaec-ca3cbac6445b service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-unplugged-ebf91ac5-9634-4897-a1bb-7336846be7cb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:15.027496 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-444ffc84-a655-4959-8423-99c73edbdfa6 req-98a95b56-cb44-40e3-aaec-ca3cbac6445b service nova] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:15.027731 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-444ffc84-a655-4959-8423-99c73edbdfa6 req-98a95b56-cb44-40e3-aaec-ca3cbac6445b service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:15.027909 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-444ffc84-a655-4959-8423-99c73edbdfa6 req-98a95b56-cb44-40e3-aaec-ca3cbac6445b service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:15.028082 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-444ffc84-a655-4959-8423-99c73edbdfa6 req-98a95b56-cb44-40e3-aaec-ca3cbac6445b service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] No waiting events found dispatching network-vif-unplugged-ebf91ac5-9634-4897-a1bb-7336846be7cb {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:58:15.028253 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-444ffc84-a655-4959-8423-99c73edbdfa6 req-98a95b56-cb44-40e3-aaec-ca3cbac6445b service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-unplugged-ebf91ac5-9634-4897-a1bb-7336846be7cb for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 01:58:15.031232 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Acquiring lock "e9664d16-b539-4ccc-abd4-47a8fa944520" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:15.032905 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:15.035491 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:58:15.035491 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] <== disconnect_volume: return (376ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:58:15.035491 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 01:58:15.035491 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 01:58:15.035491 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7', 'iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '728d4669-c172-4f18-ae34-53ce485326e7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:58:15.035491 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:58:15.035491 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:58:15.035859 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7', 'iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '728d4669-c172-4f18-ae34-53ce485326e7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 01:58:15.035906 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 01:58:15.066960 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:58:15.066960 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:58:15.066960 np0000001127 nova-compute[98206]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:15.066960 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:15.066960 np0000001127 nova-compute[98206]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:15.066960 np0000001127 nova-compute[98206]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:15.066960 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:58:15.067345 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsi session list stdout=tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:58:15.067345 np0000001127 nova-compute[98206]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7 (non-flash)
May 21 01:58:15.067345 np0000001127 nova-compute[98206]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:15.067345 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:15.067345 np0000001127 nova-compute[98206]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:15.067345 np0000001127 nova-compute[98206]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:15.067345 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:58:15.067807 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48', '22'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48', '23')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 01:58:15.068458 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7', '15')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 01:58:15.069749 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7', '14')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 01:58:15.070897 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c2fd940>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7'): ({'sdd'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 01:58:15.071169 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Removing multipathed devices sde, sdd {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 01:58:15.071699 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Flush multipath device 3300000004b97a869 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 01:58:15.102116 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 01:58:15.130967 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 01:58:15.130967 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '99e89209-ee54-4c1e-922b-ed08da485e1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:58:15.130967 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:58:15.156133 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 01:58:15.216829 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 01:58:15.217009 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 01:58:15.218127 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 01:58:15.233249 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 01:58:15.233249 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 01:58:15.243680 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-9735357c-ad55-4552-ab21-a8bd440dc604 req-14067e3e-7b01-422f-99df-6427445f5f52 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-unplugged-db10c43a-9d2b-4250-83b6-0ca8ced88657 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:15.243968 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-9735357c-ad55-4552-ab21-a8bd440dc604 req-14067e3e-7b01-422f-99df-6427445f5f52 service nova] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:15.244141 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-9735357c-ad55-4552-ab21-a8bd440dc604 req-14067e3e-7b01-422f-99df-6427445f5f52 service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:15.245048 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-9735357c-ad55-4552-ab21-a8bd440dc604 req-14067e3e-7b01-422f-99df-6427445f5f52 service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:15.245453 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-9735357c-ad55-4552-ab21-a8bd440dc604 req-14067e3e-7b01-422f-99df-6427445f5f52 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] No waiting events found dispatching network-vif-unplugged-db10c43a-9d2b-4250-83b6-0ca8ced88657 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:58:15.246152 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-9735357c-ad55-4552-ab21-a8bd440dc604 req-14067e3e-7b01-422f-99df-6427445f5f52 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-unplugged-db10c43a-9d2b-4250-83b6-0ca8ced88657 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 01:58:15.247262 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-9735357c-ad55-4552-ab21-a8bd440dc604 req-14067e3e-7b01-422f-99df-6427445f5f52 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-unplugged-319abe1b-caf8-4fa7-bc6c-caa7e755860b {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:15.247262 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-9735357c-ad55-4552-ab21-a8bd440dc604 req-14067e3e-7b01-422f-99df-6427445f5f52 service nova] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:15.247262 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-9735357c-ad55-4552-ab21-a8bd440dc604 req-14067e3e-7b01-422f-99df-6427445f5f52 service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:15.247262 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-9735357c-ad55-4552-ab21-a8bd440dc604 req-14067e3e-7b01-422f-99df-6427445f5f52 service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:15.247418 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-9735357c-ad55-4552-ab21-a8bd440dc604 req-14067e3e-7b01-422f-99df-6427445f5f52 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] No waiting events found dispatching network-vif-unplugged-319abe1b-caf8-4fa7-bc6c-caa7e755860b {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:58:15.248068 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-9735357c-ad55-4552-ab21-a8bd440dc604 req-14067e3e-7b01-422f-99df-6427445f5f52 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-unplugged-319abe1b-caf8-4fa7-bc6c-caa7e755860b for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 01:58:15.248068 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-9735357c-ad55-4552-ab21-a8bd440dc604 req-14067e3e-7b01-422f-99df-6427445f5f52 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-unplugged-319abe1b-caf8-4fa7-bc6c-caa7e755860b {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:15.248068 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-9735357c-ad55-4552-ab21-a8bd440dc604 req-14067e3e-7b01-422f-99df-6427445f5f52 service nova] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:15.248068 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-9735357c-ad55-4552-ab21-a8bd440dc604 req-14067e3e-7b01-422f-99df-6427445f5f52 service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:15.248068 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-9735357c-ad55-4552-ab21-a8bd440dc604 req-14067e3e-7b01-422f-99df-6427445f5f52 service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:15.248260 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-9735357c-ad55-4552-ab21-a8bd440dc604 req-14067e3e-7b01-422f-99df-6427445f5f52 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] No waiting events found dispatching network-vif-unplugged-319abe1b-caf8-4fa7-bc6c-caa7e755860b {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:58:15.248260 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-9735357c-ad55-4552-ab21-a8bd440dc604 req-14067e3e-7b01-422f-99df-6427445f5f52 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-unplugged-319abe1b-caf8-4fa7-bc6c-caa7e755860b for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 01:58:15.249070 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:15.283680 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7, portal: 192.168.40.100,3260]
May 21 01:58:15.283680 np0000001127 nova-compute[98206]: Logout of [sid: 15, target: iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7, portal: 192.168.40.100,3260] successful.
May 21 01:58:15.283680 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:15.308933 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:15.321114 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:15.349621 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7, portal: 192.168.50.100,3260]
May 21 01:58:15.349621 np0000001127 nova-compute[98206]: Logout of [sid: 14, target: iqn.2023-03.storpool.com:os--volume-728d4669-c172-4f18-ae34-53ce485326e7, portal: 192.168.50.100,3260] successful.
May 21 01:58:15.349621 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:15.372352 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Detaching volume 6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48
May 21 01:58:15.377761 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:15.378053 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:58:15.378175 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] <== disconnect_volume: return (343ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:58:15.378320 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 01:58:15.378917 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Deleting instance files /opt/stack/data/nova/instances/58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8_del
May 21 01:58:15.381084 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.251s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:58:15.381298 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '99e89209-ee54-4c1e-922b-ed08da485e1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 01:58:15.382913 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Deletion of /opt/stack/data/nova/instances/58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8_del complete
May 21 01:58:15.394934 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:58:15.400254 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:58:15.400933 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:58:15.401183 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:58:15.401851 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:58:15.402093 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:58:15.413715 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 01:58:15.413715 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:15.423250 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 01:58:15.423250 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:15.432857 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c] added
May 21 01:58:15.432857 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 01:58:15.432857 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:58:15.432857 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:58:15.432857 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:58:15.432857 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:58:15.432857 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:15.433259 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 01:58:15.433307 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0321(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 01:58:15.433530 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 01:58:15.447846 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c] added
May 21 01:58:15.447846 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 01:58:15.447846 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:58:15.447846 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:58:15.447846 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:58:15.447846 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:58:15.447846 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:15.447846 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 01:58:15.447846 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0425(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 01:58:15.447846 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 01:58:15.453060 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Attempting to driver detach volume 6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 from mountpoint /dev/vdb
May 21 01:58:15.458657 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Found disk vdb by alias ua-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 01:58:15.459917 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Found disk vdb by alias ua-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 01:58:15.460064 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Attempting to detach device vdb from instance e9664d16-b539-4ccc-abd4-47a8fa944520 from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 01:58:15.460342 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] detach device xml: <disk type="block" device="disk">
May 21 01:58:15.460342 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:58:15.460342 np0000001127 nova-compute[98206]:   <alias name="ua-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48"/>
May 21 01:58:15.460342 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-7"/>
May 21 01:58:15.460342 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 01:58:15.460342 np0000001127 nova-compute[98206]:   <serial>6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48</serial>
May 21 01:58:15.460342 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 01:58:15.460342 np0000001127 nova-compute[98206]: </disk>
May 21 01:58:15.460342 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 01:58:15.472727 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Successfully detached device vdb from instance e9664d16-b539-4ccc-abd4-47a8fa944520 from the persistent domain config.
May 21 01:58:15.472892 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] (1/8): Attempting to detach device vdb with device alias ua-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 from instance e9664d16-b539-4ccc-abd4-47a8fa944520 from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 01:58:15.473153 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] detach device xml: <disk type="block" device="disk">
May 21 01:58:15.473153 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:58:15.473153 np0000001127 nova-compute[98206]:   <alias name="ua-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48"/>
May 21 01:58:15.473153 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-7"/>
May 21 01:58:15.473153 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 01:58:15.473153 np0000001127 nova-compute[98206]:   <serial>6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48</serial>
May 21 01:58:15.473153 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 01:58:15.473153 np0000001127 nova-compute[98206]: </disk>
May 21 01:58:15.473153 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 01:58:15.891829 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Took 3.23 seconds to destroy the instance on the hypervisor.
May 21 01:58:15.892351 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 01:58:15.892701 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 01:58:15.900836 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 01:58:15.900836 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:15.974932 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-fbb5a670-b148-4074-b5ae-71c8c589e964 req-3a1206eb-f8f5-4161-ae70-4450dbbdfa74 service nova] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Received event network-vif-unplugged-43f9f40a-cc12-40f7-8311-7fcb01148125 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:15.975140 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fbb5a670-b148-4074-b5ae-71c8c589e964 req-3a1206eb-f8f5-4161-ae70-4450dbbdfa74 service nova] Acquiring lock "0d75ff65-b688-4387-89e3-70567e569682-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:15.975330 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fbb5a670-b148-4074-b5ae-71c8c589e964 req-3a1206eb-f8f5-4161-ae70-4450dbbdfa74 service nova] Lock "0d75ff65-b688-4387-89e3-70567e569682-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:15.975515 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fbb5a670-b148-4074-b5ae-71c8c589e964 req-3a1206eb-f8f5-4161-ae70-4450dbbdfa74 service nova] Lock "0d75ff65-b688-4387-89e3-70567e569682-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:15.975693 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-fbb5a670-b148-4074-b5ae-71c8c589e964 req-3a1206eb-f8f5-4161-ae70-4450dbbdfa74 service nova] [instance: 0d75ff65-b688-4387-89e3-70567e569682] No event matching network-vif-unplugged-43f9f40a-cc12-40f7-8311-7fcb01148125 in dict_keys([('network-vif-plugged', '43f9f40a-cc12-40f7-8311-7fcb01148125')]) {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 21 01:58:15.975809 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-fbb5a670-b148-4074-b5ae-71c8c589e964 req-3a1206eb-f8f5-4161-ae70-4450dbbdfa74 service nova] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Received unexpected event network-vif-unplugged-43f9f40a-cc12-40f7-8311-7fcb01148125 for instance with vm_state building and task_state spawning.
May 21 01:58:16.030078 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 for instance e9664d16-b539-4ccc-abd4-47a8fa944520 {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 01:58:16.030799 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779328696.0300915, e9664d16-b539-4ccc-abd4-47a8fa944520 => ua-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 01:58:16.039239 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Successfully detached device vdb from instance e9664d16-b539-4ccc-abd4-47a8fa944520 from the live domain config.
May 21 01:58:16.041335 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 01:58:16.041658 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48', 'iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:58:16.041788 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:58:16.070481 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:16.146096 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:16.230003 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:58:16.230160 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:58:16.230160 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] No VIF found with MAC fa:16:3e:e3:f7:d2, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 01:58:16.230564 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Using config drive
May 21 01:58:16.433972 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:58:16.445453 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.startup = manual
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:58:16.451632 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:58:16.451632 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.startup = manual
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:58:16.462330 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:58:16.462330 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:16.469647 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:16.480497 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:16.490884 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:16.490884 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:16.490884 np0000001127 nova-compute[98206]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:16.490884 np0000001127 nova-compute[98206]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:16.490884 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:58:16.492015 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsi session list stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:16.492015 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:16.492015 np0000001127 nova-compute[98206]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:16.492015 np0000001127 nova-compute[98206]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:16.492015 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:58:16.499186 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:16.499186 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:16.499186 np0000001127 nova-compute[98206]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:16.499186 np0000001127 nova-compute[98206]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:16.499186 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:58:16.499615 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsi session list stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:16.499615 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:16.499615 np0000001127 nova-compute[98206]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:16.499615 np0000001127 nova-compute[98206]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:16.499615 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:58:16.538288 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c, portal: 192.168.40.100,3260]
May 21 01:58:16.538288 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c, portal: 192.168.40.100,3260] successful.
May 21 01:58:16.538288 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:16.554169 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c, portal: 192.168.50.100,3260]
May 21 01:58:16.554169 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c, portal: 192.168.50.100,3260] successful.
May 21 01:58:16.554169 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:16.555040 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:16.570949 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:16.584348 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:16.584348 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:16.584348 np0000001127 nova-compute[98206]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:16.584348 np0000001127 nova-compute[98206]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:16.584348 np0000001127 nova-compute[98206]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:16.584348 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:16.584348 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:58:16.585128 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsi session list stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:16.585128 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:16.585128 np0000001127 nova-compute[98206]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:16.585128 np0000001127 nova-compute[98206]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:16.585128 np0000001127 nova-compute[98206]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:16.585128 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:16.585128 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:58:16.585573 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.185s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:58:16.585704 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:58:16.586463 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] HCTL ('7', '-', '-', 0) found on session 24 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:58:16.586659 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:58:16.596075 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:16.596075 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:16.596075 np0000001127 nova-compute[98206]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:16.596075 np0000001127 nova-compute[98206]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:16.596075 np0000001127 nova-compute[98206]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:16.596075 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:16.596075 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:58:16.596528 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsi session list stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:16.596528 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:16.596528 np0000001127 nova-compute[98206]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:16.596528 np0000001127 nova-compute[98206]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:16.596528 np0000001127 nova-compute[98206]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:16.596528 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:16.596528 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:58:16.598939 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.195s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:58:16.598939 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:58:16.598939 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] HCTL ('8', '-', '-', 0) found on session 25 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:58:16.598939 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:58:16.616071 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Searching for a device in session 24 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:58:16.616303 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '99e89209-ee54-4c1e-922b-ed08da485e1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:58:16.624195 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Searching for a device in session 25 and hctl ['8', '*', '*', 0] yield: None {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:58:16.736177 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:17.120039 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8b1a4d49-aca9-4b9f-80b6-fa57cf1e2099 req-196bc706-9619-4536-a294-4ff7e6c68862 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-unplugged-ebf91ac5-9634-4897-a1bb-7336846be7cb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:17.120388 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8b1a4d49-aca9-4b9f-80b6-fa57cf1e2099 req-196bc706-9619-4536-a294-4ff7e6c68862 service nova] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:17.120831 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8b1a4d49-aca9-4b9f-80b6-fa57cf1e2099 req-196bc706-9619-4536-a294-4ff7e6c68862 service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:17.120831 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8b1a4d49-aca9-4b9f-80b6-fa57cf1e2099 req-196bc706-9619-4536-a294-4ff7e6c68862 service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:17.120831 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8b1a4d49-aca9-4b9f-80b6-fa57cf1e2099 req-196bc706-9619-4536-a294-4ff7e6c68862 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] No waiting events found dispatching network-vif-unplugged-ebf91ac5-9634-4897-a1bb-7336846be7cb {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:58:17.121213 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8b1a4d49-aca9-4b9f-80b6-fa57cf1e2099 req-196bc706-9619-4536-a294-4ff7e6c68862 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-unplugged-ebf91ac5-9634-4897-a1bb-7336846be7cb for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 01:58:17.121213 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8b1a4d49-aca9-4b9f-80b6-fa57cf1e2099 req-196bc706-9619-4536-a294-4ff7e6c68862 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-unplugged-14e48bfc-fab0-433c-b291-0e75e2da496c {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:17.121331 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8b1a4d49-aca9-4b9f-80b6-fa57cf1e2099 req-196bc706-9619-4536-a294-4ff7e6c68862 service nova] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:17.122013 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8b1a4d49-aca9-4b9f-80b6-fa57cf1e2099 req-196bc706-9619-4536-a294-4ff7e6c68862 service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:17.122492 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8b1a4d49-aca9-4b9f-80b6-fa57cf1e2099 req-196bc706-9619-4536-a294-4ff7e6c68862 service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:17.128147 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8b1a4d49-aca9-4b9f-80b6-fa57cf1e2099 req-196bc706-9619-4536-a294-4ff7e6c68862 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] No waiting events found dispatching network-vif-unplugged-14e48bfc-fab0-433c-b291-0e75e2da496c {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:58:17.128147 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8b1a4d49-aca9-4b9f-80b6-fa57cf1e2099 req-196bc706-9619-4536-a294-4ff7e6c68862 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-unplugged-14e48bfc-fab0-433c-b291-0e75e2da496c for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 01:58:17.128147 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8b1a4d49-aca9-4b9f-80b6-fa57cf1e2099 req-196bc706-9619-4536-a294-4ff7e6c68862 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-unplugged-14e48bfc-fab0-433c-b291-0e75e2da496c {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:17.128147 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8b1a4d49-aca9-4b9f-80b6-fa57cf1e2099 req-196bc706-9619-4536-a294-4ff7e6c68862 service nova] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:17.128147 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8b1a4d49-aca9-4b9f-80b6-fa57cf1e2099 req-196bc706-9619-4536-a294-4ff7e6c68862 service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:17.128147 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8b1a4d49-aca9-4b9f-80b6-fa57cf1e2099 req-196bc706-9619-4536-a294-4ff7e6c68862 service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:17.128147 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8b1a4d49-aca9-4b9f-80b6-fa57cf1e2099 req-196bc706-9619-4536-a294-4ff7e6c68862 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] No waiting events found dispatching network-vif-unplugged-14e48bfc-fab0-433c-b291-0e75e2da496c {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:58:17.128147 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8b1a4d49-aca9-4b9f-80b6-fa57cf1e2099 req-196bc706-9619-4536-a294-4ff7e6c68862 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-unplugged-14e48bfc-fab0-433c-b291-0e75e2da496c for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 01:58:17.128147 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8b1a4d49-aca9-4b9f-80b6-fa57cf1e2099 req-196bc706-9619-4536-a294-4ff7e6c68862 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-plugged-14e48bfc-fab0-433c-b291-0e75e2da496c {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:17.128147 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8b1a4d49-aca9-4b9f-80b6-fa57cf1e2099 req-196bc706-9619-4536-a294-4ff7e6c68862 service nova] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:17.128147 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8b1a4d49-aca9-4b9f-80b6-fa57cf1e2099 req-196bc706-9619-4536-a294-4ff7e6c68862 service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:17.128147 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8b1a4d49-aca9-4b9f-80b6-fa57cf1e2099 req-196bc706-9619-4536-a294-4ff7e6c68862 service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:17.128147 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8b1a4d49-aca9-4b9f-80b6-fa57cf1e2099 req-196bc706-9619-4536-a294-4ff7e6c68862 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] No waiting events found dispatching network-vif-plugged-14e48bfc-fab0-433c-b291-0e75e2da496c {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:58:17.128147 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-8b1a4d49-aca9-4b9f-80b6-fa57cf1e2099 req-196bc706-9619-4536-a294-4ff7e6c68862 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received unexpected event network-vif-plugged-14e48bfc-fab0-433c-b291-0e75e2da496c for instance with vm_state active and task_state deleting.
May 21 01:58:17.128147 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8b1a4d49-aca9-4b9f-80b6-fa57cf1e2099 req-196bc706-9619-4536-a294-4ff7e6c68862 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-plugged-14e48bfc-fab0-433c-b291-0e75e2da496c {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:17.128147 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8b1a4d49-aca9-4b9f-80b6-fa57cf1e2099 req-196bc706-9619-4536-a294-4ff7e6c68862 service nova] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:17.128147 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8b1a4d49-aca9-4b9f-80b6-fa57cf1e2099 req-196bc706-9619-4536-a294-4ff7e6c68862 service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:17.128147 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8b1a4d49-aca9-4b9f-80b6-fa57cf1e2099 req-196bc706-9619-4536-a294-4ff7e6c68862 service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:17.128147 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8b1a4d49-aca9-4b9f-80b6-fa57cf1e2099 req-196bc706-9619-4536-a294-4ff7e6c68862 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] No waiting events found dispatching network-vif-plugged-14e48bfc-fab0-433c-b291-0e75e2da496c {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:58:17.128147 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-8b1a4d49-aca9-4b9f-80b6-fa57cf1e2099 req-196bc706-9619-4536-a294-4ff7e6c68862 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received unexpected event network-vif-plugged-14e48bfc-fab0-433c-b291-0e75e2da496c for instance with vm_state active and task_state deleting.
May 21 01:58:17.128147 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8b1a4d49-aca9-4b9f-80b6-fa57cf1e2099 req-196bc706-9619-4536-a294-4ff7e6c68862 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-unplugged-14e48bfc-fab0-433c-b291-0e75e2da496c {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:17.128147 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8b1a4d49-aca9-4b9f-80b6-fa57cf1e2099 req-196bc706-9619-4536-a294-4ff7e6c68862 service nova] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:17.128147 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8b1a4d49-aca9-4b9f-80b6-fa57cf1e2099 req-196bc706-9619-4536-a294-4ff7e6c68862 service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:17.128147 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8b1a4d49-aca9-4b9f-80b6-fa57cf1e2099 req-196bc706-9619-4536-a294-4ff7e6c68862 service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:17.128147 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8b1a4d49-aca9-4b9f-80b6-fa57cf1e2099 req-196bc706-9619-4536-a294-4ff7e6c68862 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] No waiting events found dispatching network-vif-unplugged-14e48bfc-fab0-433c-b291-0e75e2da496c {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:58:17.128147 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8b1a4d49-aca9-4b9f-80b6-fa57cf1e2099 req-196bc706-9619-4536-a294-4ff7e6c68862 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-unplugged-14e48bfc-fab0-433c-b291-0e75e2da496c for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 01:58:17.427167 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Creating config drive at /opt/stack/data/nova/instances/0d75ff65-b688-4387-89e3-70567e569682/disk.config
May 21 01:58:17.431457 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0d75ff65-b688-4387-89e3-70567e569682/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpll8awf6x {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:17.481241 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0d75ff65-b688-4387-89e3-70567e569682/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpll8awf6x" returned: 0 in 0.050s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:17.625025 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Searching for a device in session 25 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:58:17.625329 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '99e89209-ee54-4c1e-922b-ed08da485e1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:58:18.032304 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:18.056147 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-23cdbe9c-76c2-4e62-8d9f-a97b2fd2e9ed req-0d52c2e2-1d77-4bc0-9cd6-9321826a315e service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-unplugged-d807c564-314d-4f8e-8984-8068d59d3538 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:18.056994 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-23cdbe9c-76c2-4e62-8d9f-a97b2fd2e9ed req-0d52c2e2-1d77-4bc0-9cd6-9321826a315e service nova] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:18.057258 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-23cdbe9c-76c2-4e62-8d9f-a97b2fd2e9ed req-0d52c2e2-1d77-4bc0-9cd6-9321826a315e service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:18.057510 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-23cdbe9c-76c2-4e62-8d9f-a97b2fd2e9ed req-0d52c2e2-1d77-4bc0-9cd6-9321826a315e service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:18.057669 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-23cdbe9c-76c2-4e62-8d9f-a97b2fd2e9ed req-0d52c2e2-1d77-4bc0-9cd6-9321826a315e service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] No waiting events found dispatching network-vif-unplugged-d807c564-314d-4f8e-8984-8068d59d3538 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:58:18.057840 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-23cdbe9c-76c2-4e62-8d9f-a97b2fd2e9ed req-0d52c2e2-1d77-4bc0-9cd6-9321826a315e service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-unplugged-d807c564-314d-4f8e-8984-8068d59d3538 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 01:58:18.060985 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-23cdbe9c-76c2-4e62-8d9f-a97b2fd2e9ed req-0d52c2e2-1d77-4bc0-9cd6-9321826a315e service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-unplugged-d807c564-314d-4f8e-8984-8068d59d3538 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:18.060985 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-23cdbe9c-76c2-4e62-8d9f-a97b2fd2e9ed req-0d52c2e2-1d77-4bc0-9cd6-9321826a315e service nova] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:18.060985 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-23cdbe9c-76c2-4e62-8d9f-a97b2fd2e9ed req-0d52c2e2-1d77-4bc0-9cd6-9321826a315e service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:18.060985 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-23cdbe9c-76c2-4e62-8d9f-a97b2fd2e9ed req-0d52c2e2-1d77-4bc0-9cd6-9321826a315e service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:18.060985 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-23cdbe9c-76c2-4e62-8d9f-a97b2fd2e9ed req-0d52c2e2-1d77-4bc0-9cd6-9321826a315e service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] No waiting events found dispatching network-vif-unplugged-d807c564-314d-4f8e-8984-8068d59d3538 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:58:18.060985 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-23cdbe9c-76c2-4e62-8d9f-a97b2fd2e9ed req-0d52c2e2-1d77-4bc0-9cd6-9321826a315e service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-unplugged-d807c564-314d-4f8e-8984-8068d59d3538 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 01:58:18.060985 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-23cdbe9c-76c2-4e62-8d9f-a97b2fd2e9ed req-0d52c2e2-1d77-4bc0-9cd6-9321826a315e service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-unplugged-d03a47d5-bec7-4099-96e0-c102edfe9e8e {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:18.060985 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-23cdbe9c-76c2-4e62-8d9f-a97b2fd2e9ed req-0d52c2e2-1d77-4bc0-9cd6-9321826a315e service nova] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:18.060985 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-23cdbe9c-76c2-4e62-8d9f-a97b2fd2e9ed req-0d52c2e2-1d77-4bc0-9cd6-9321826a315e service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:18.060985 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-23cdbe9c-76c2-4e62-8d9f-a97b2fd2e9ed req-0d52c2e2-1d77-4bc0-9cd6-9321826a315e service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:18.060985 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-23cdbe9c-76c2-4e62-8d9f-a97b2fd2e9ed req-0d52c2e2-1d77-4bc0-9cd6-9321826a315e service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] No waiting events found dispatching network-vif-unplugged-d03a47d5-bec7-4099-96e0-c102edfe9e8e {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:58:18.061617 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-23cdbe9c-76c2-4e62-8d9f-a97b2fd2e9ed req-0d52c2e2-1d77-4bc0-9cd6-9321826a315e service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-unplugged-d03a47d5-bec7-4099-96e0-c102edfe9e8e for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 01:58:18.061617 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-23cdbe9c-76c2-4e62-8d9f-a97b2fd2e9ed req-0d52c2e2-1d77-4bc0-9cd6-9321826a315e service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-unplugged-d03a47d5-bec7-4099-96e0-c102edfe9e8e {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:18.061617 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-23cdbe9c-76c2-4e62-8d9f-a97b2fd2e9ed req-0d52c2e2-1d77-4bc0-9cd6-9321826a315e service nova] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:18.061617 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-23cdbe9c-76c2-4e62-8d9f-a97b2fd2e9ed req-0d52c2e2-1d77-4bc0-9cd6-9321826a315e service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:18.062200 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-23cdbe9c-76c2-4e62-8d9f-a97b2fd2e9ed req-0d52c2e2-1d77-4bc0-9cd6-9321826a315e service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:18.062200 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-23cdbe9c-76c2-4e62-8d9f-a97b2fd2e9ed req-0d52c2e2-1d77-4bc0-9cd6-9321826a315e service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] No waiting events found dispatching network-vif-unplugged-d03a47d5-bec7-4099-96e0-c102edfe9e8e {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:58:18.062200 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-23cdbe9c-76c2-4e62-8d9f-a97b2fd2e9ed req-0d52c2e2-1d77-4bc0-9cd6-9321826a315e service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-unplugged-d03a47d5-bec7-4099-96e0-c102edfe9e8e for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 01:58:18.062200 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-23cdbe9c-76c2-4e62-8d9f-a97b2fd2e9ed req-0d52c2e2-1d77-4bc0-9cd6-9321826a315e service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-unplugged-93b6a994-3c94-45b3-be4c-d63ce41a8557 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:18.062806 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-23cdbe9c-76c2-4e62-8d9f-a97b2fd2e9ed req-0d52c2e2-1d77-4bc0-9cd6-9321826a315e service nova] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:18.062806 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-23cdbe9c-76c2-4e62-8d9f-a97b2fd2e9ed req-0d52c2e2-1d77-4bc0-9cd6-9321826a315e service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:18.062806 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-23cdbe9c-76c2-4e62-8d9f-a97b2fd2e9ed req-0d52c2e2-1d77-4bc0-9cd6-9321826a315e service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:18.063074 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-23cdbe9c-76c2-4e62-8d9f-a97b2fd2e9ed req-0d52c2e2-1d77-4bc0-9cd6-9321826a315e service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] No waiting events found dispatching network-vif-unplugged-93b6a994-3c94-45b3-be4c-d63ce41a8557 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:58:18.064141 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-23cdbe9c-76c2-4e62-8d9f-a97b2fd2e9ed req-0d52c2e2-1d77-4bc0-9cd6-9321826a315e service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-unplugged-93b6a994-3c94-45b3-be4c-d63ce41a8557 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 01:58:18.064300 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-23cdbe9c-76c2-4e62-8d9f-a97b2fd2e9ed req-0d52c2e2-1d77-4bc0-9cd6-9321826a315e service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-unplugged-93b6a994-3c94-45b3-be4c-d63ce41a8557 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:18.064498 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-23cdbe9c-76c2-4e62-8d9f-a97b2fd2e9ed req-0d52c2e2-1d77-4bc0-9cd6-9321826a315e service nova] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:18.064776 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-23cdbe9c-76c2-4e62-8d9f-a97b2fd2e9ed req-0d52c2e2-1d77-4bc0-9cd6-9321826a315e service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:18.064931 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-23cdbe9c-76c2-4e62-8d9f-a97b2fd2e9ed req-0d52c2e2-1d77-4bc0-9cd6-9321826a315e service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:18.066530 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-23cdbe9c-76c2-4e62-8d9f-a97b2fd2e9ed req-0d52c2e2-1d77-4bc0-9cd6-9321826a315e service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] No waiting events found dispatching network-vif-unplugged-93b6a994-3c94-45b3-be4c-d63ce41a8557 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:58:18.066530 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-23cdbe9c-76c2-4e62-8d9f-a97b2fd2e9ed req-0d52c2e2-1d77-4bc0-9cd6-9321826a315e service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-unplugged-93b6a994-3c94-45b3-be4c-d63ce41a8557 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 01:58:18.072235 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:18.074590 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:18.180603 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:18.388478 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:18.396588 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:18.419643 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:18.422916 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Found WWN 330000000a9f70f02 for multipath device dm-0 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 01:58:18.423438 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:58:18.423769 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] <== connect_volume: return (3294ms) {'type': 'block', 'scsi_wwn': '330000000a9f70f02', 'path': '/dev/dm-0', 'multipath_id': '330000000a9f70f02'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:58:18.423989 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a9f70f02', 'path': '/dev/dm-0', 'multipath_id': '330000000a9f70f02'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 01:58:18.424658 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.383s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:58:18.425177 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48', 'iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 01:58:18.425393 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 01:58:18.469186 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:18.469186 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:18.469186 np0000001127 nova-compute[98206]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:18.469186 np0000001127 nova-compute[98206]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:18.469186 np0000001127 nova-compute[98206]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:18.469186 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:18.469186 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:58:18.469186 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsi session list stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:18.469186 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:18.469186 np0000001127 nova-compute[98206]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:18.469186 np0000001127 nova-compute[98206]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48 (non-flash)
May 21 01:58:18.469186 np0000001127 nova-compute[98206]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:18.469186 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:18.469186 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:58:18.469186 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48', '22'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', '25')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 01:58:18.469186 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48', '23')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 01:58:18.469828 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48', '22')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 01:58:18.471064 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c5db9c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48'): ({'sdm'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 01:58:18.471490 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Removing multipathed devices sdl, sdm {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 01:58:18.471924 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Flush multipath device 33000000057727f7f {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 01:58:18.540528 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 01:58:18.587535 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 01:58:18.642984 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Checking to see if SCSI volumes sdl, sdm have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 01:58:18.643218 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] SCSI volumes sdl, sdm have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 01:58:18.644427 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Checking to see if device paths {'sdl', 'sdm'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 01:58:18.665349 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Device paths {'sdl', 'sdm'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 01:58:18.665625 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 01:58:18.679623 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:18.719636 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48, portal: 192.168.40.100,3260]
May 21 01:58:18.719636 np0000001127 nova-compute[98206]: Logout of [sid: 23, target: iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48, portal: 192.168.40.100,3260] successful.
May 21 01:58:18.719636 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:18.736996 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:18.751974 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:18.784117 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48, portal: 192.168.50.100,3260]
May 21 01:58:18.784117 np0000001127 nova-compute[98206]: Logout of [sid: 22, target: iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48, portal: 192.168.50.100,3260] successful.
May 21 01:58:18.784117 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:18.802831 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:18.803851 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:58:18.804282 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] <== disconnect_volume: return (2762ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:58:18.804831 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 01:58:18.937685 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-21T01:56:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-288227188',display_name='tempest-ServerActionsTestOtherA-server-410489228',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-tempest-common-compute-instance-288227188',id=10,image_ref='fea37df7-c5b0-431e-9e55-09d856a51ff9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFa4h1sACKVx0qMim6t3PkF47uhDyneTJkwL/xOqx10IdCIKzdMNwpXbxDopvRYuon+cm2g/xX3KdbSKB9yixqLXsKKYgUZSUERIMzzqqvllJnaPGuHQmel2EKS0sBdZzQ==',key_name='tempest-keypair-1484910746',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:57:12Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6a15fe7a70464159a778cffa4a36c36f',ramdisk_id='',reservation_id='r-06kjjbvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='fea37df7-c5b0-431e-9e55-09d856a51ff9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1975191698',owner_user_name='tempest-ServerActionsTestOtherA-1975191698-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:58:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbcd1a81252344dd804a4080571f8751',uuid=6f68556b-0b18-452a-b307-da2dad4ee6ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "069db2b1-36ac-43ce-b643-fcdc9ff52141", "address": "fa:16:3e:30:ad:e5", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap069db2b1-36", "ovs_interfaceid": "069db2b1-36ac-43ce-b643-fcdc9ff52141", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 01:58:18.937883 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Converting VIF {"id": "069db2b1-36ac-43ce-b643-fcdc9ff52141", "address": "fa:16:3e:30:ad:e5", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap069db2b1-36", "ovs_interfaceid": "069db2b1-36ac-43ce-b643-fcdc9ff52141", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:58:18.938566 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:ad:e5,bridge_name='br-int',has_traffic_filtering=True,id=069db2b1-36ac-43ce-b643-fcdc9ff52141,network=Network(6d660724-85bf-45e3-895a-b9ce67043c30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap069db2b1-36') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:58:18.947106 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] End _get_guest_xml xml=<domain type="qemu">
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:   <uuid>6f68556b-0b18-452a-b307-da2dad4ee6ab</uuid>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:   <name>instance-0000000a</name>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:   <metadata>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:       <nova:name>tempest-ServerActionsTestOtherA-server-410489228</nova:name>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 01:58:14</nova:creationTime>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:       <nova:image uuid="fea37df7-c5b0-431e-9e55-09d856a51ff9">
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:       </nova:image>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:         <nova:user uuid="bbcd1a81252344dd804a4080571f8751">tempest-ServerActionsTestOtherA-1975191698-project-member</nova:user>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:         <nova:project uuid="6a15fe7a70464159a778cffa4a36c36f">tempest-ServerActionsTestOtherA-1975191698</nova:project>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="fea37df7-c5b0-431e-9e55-09d856a51ff9"/>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:         <nova:port uuid="069db2b1-36ac-43ce-b643-fcdc9ff52141">
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:         </nova:port>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:   </metadata>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:     <system>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:       <entry name="serial">6f68556b-0b18-452a-b307-da2dad4ee6ab</entry>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:       <entry name="uuid">6f68556b-0b18-452a-b307-da2dad4ee6ab</entry>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:     </system>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:   <os>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:   </os>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:   <features>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:     <acpi/>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:     <tcg>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:     </tcg>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:   </features>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:   <devices>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab/disk"/>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:     </disk>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab/disk.config"/>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:     </disk>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:       <alias name="ua-99e89209-ee54-4c1e-922b-ed08da485e1c"/>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-0"/>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:       <target dev="vdb" bus="virtio"/>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:       <serial>99e89209-ee54-4c1e-922b-ed08da485e1c</serial>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:     </disk>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:30:ad:e5"/>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:       <target dev="tap069db2b1-36"/>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:     </interface>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab/console.log" append="off"/>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:     </serial>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:     <video>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:     </video>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:     </rng>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:     </memballoon>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:   </devices>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]: </domain>
May 21 01:58:18.947106 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 01:58:18.950322 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-21T01:56:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-288227188',display_name='tempest-ServerActionsTestOtherA-server-410489228',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-tempest-common-compute-instance-288227188',id=10,image_ref='fea37df7-c5b0-431e-9e55-09d856a51ff9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFa4h1sACKVx0qMim6t3PkF47uhDyneTJkwL/xOqx10IdCIKzdMNwpXbxDopvRYuon+cm2g/xX3KdbSKB9yixqLXsKKYgUZSUERIMzzqqvllJnaPGuHQmel2EKS0sBdZzQ==',key_name='tempest-keypair-1484910746',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:57:12Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6a15fe7a70464159a778cffa4a36c36f',ramdisk_id='',reservation_id='r-06kjjbvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='fea37df7-c5b0-431e-9e55-09d856a51ff9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1975191698',owner_user_name='tempest-ServerActionsTestOtherA-1975191698-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:58:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbcd1a81252344dd804a4080571f8751',uuid=6f68556b-0b18-452a-b307-da2dad4ee6ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "069db2b1-36ac-43ce-b643-fcdc9ff52141", "address": "fa:16:3e:30:ad:e5", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap069db2b1-36", "ovs_interfaceid": "069db2b1-36ac-43ce-b643-fcdc9ff52141", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 01:58:18.950322 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Converting VIF {"id": "069db2b1-36ac-43ce-b643-fcdc9ff52141", "address": "fa:16:3e:30:ad:e5", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap069db2b1-36", "ovs_interfaceid": "069db2b1-36ac-43ce-b643-fcdc9ff52141", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:58:18.950322 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:ad:e5,bridge_name='br-int',has_traffic_filtering=True,id=069db2b1-36ac-43ce-b643-fcdc9ff52141,network=Network(6d660724-85bf-45e3-895a-b9ce67043c30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap069db2b1-36') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:58:18.950322 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:ad:e5,bridge_name='br-int',has_traffic_filtering=True,id=069db2b1-36ac-43ce-b643-fcdc9ff52141,network=Network(6d660724-85bf-45e3-895a-b9ce67043c30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap069db2b1-36') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 01:58:18.952964 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:18.953241 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:18.953559 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 01:58:18.954455 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:18.954668 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '39ade087-6754-56ba-9b92-1372e45fd013', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:18.955534 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:18.956490 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:58:18.966716 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:18.971112 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:18.971341 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap069db2b1-36, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:18.971737 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap069db2b1-36, col_values=(('qos', UUID('5eb898fd-5fbc-46f7-aec5-e2ae4c63f17a')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:18.971958 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap069db2b1-36, col_values=(('external_ids', {'iface-id': '069db2b1-36ac-43ce-b643-fcdc9ff52141', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:ad:e5', 'vm-uuid': '6f68556b-0b18-452a-b307-da2dad4ee6ab'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:18.974318 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:18.974318 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:58:18.979268 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:18.980481 np0000001127 nova-compute[98206]: INFO os_vif [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:ad:e5,bridge_name='br-int',has_traffic_filtering=True,id=069db2b1-36ac-43ce-b643-fcdc9ff52141,network=Network(6d660724-85bf-45e3-895a-b9ce67043c30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap069db2b1-36')
May 21 01:58:18.981079 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "0059a43c-1d34-40a9-af63-b5eca8c30f53" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:18.981231 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "0059a43c-1d34-40a9-af63-b5eca8c30f53" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:19.174028 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328699.1736257, 0d75ff65-b688-4387-89e3-70567e569682 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:58:19.174288 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0d75ff65-b688-4387-89e3-70567e569682] VM Started (Lifecycle Event)
May 21 01:58:19.219336 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-46f3a8cd-43c3-48ab-974d-1211bbb81d29 req-724073de-e552-45b1-a4b2-fe27f1fac4ff service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-unplugged-14e48bfc-fab0-433c-b291-0e75e2da496c {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:19.221480 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-46f3a8cd-43c3-48ab-974d-1211bbb81d29 req-724073de-e552-45b1-a4b2-fe27f1fac4ff service nova] Acquiring lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:19.221631 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-46f3a8cd-43c3-48ab-974d-1211bbb81d29 req-724073de-e552-45b1-a4b2-fe27f1fac4ff service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:19.222013 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-46f3a8cd-43c3-48ab-974d-1211bbb81d29 req-724073de-e552-45b1-a4b2-fe27f1fac4ff service nova] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:19.222130 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-46f3a8cd-43c3-48ab-974d-1211bbb81d29 req-724073de-e552-45b1-a4b2-fe27f1fac4ff service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] No waiting events found dispatching network-vif-unplugged-14e48bfc-fab0-433c-b291-0e75e2da496c {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:58:19.222234 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-46f3a8cd-43c3-48ab-974d-1211bbb81d29 req-724073de-e552-45b1-a4b2-fe27f1fac4ff service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-unplugged-14e48bfc-fab0-433c-b291-0e75e2da496c for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 01:58:19.384062 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lazy-loading 'flavor' on Instance uuid e9664d16-b539-4ccc-abd4-47a8fa944520 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:58:19.484549 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Detaching volume ad40663d-967d-4ee3-8017-cb0686601c4d
May 21 01:58:19.563920 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Attempting to driver detach volume ad40663d-967d-4ee3-8017-cb0686601c4d from mountpoint /dev/vdc
May 21 01:58:19.566911 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Found disk vdc by alias ua-ad40663d-967d-4ee3-8017-cb0686601c4d {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 01:58:19.568063 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Found disk vdc by alias ua-ad40663d-967d-4ee3-8017-cb0686601c4d {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 01:58:19.568263 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Attempting to detach device vdc from instance 0059a43c-1d34-40a9-af63-b5eca8c30f53 from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 01:58:19.568644 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] detach device xml: <disk type="block" device="disk">
May 21 01:58:19.568644 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:58:19.568644 np0000001127 nova-compute[98206]:   <alias name="ua-ad40663d-967d-4ee3-8017-cb0686601c4d"/>
May 21 01:58:19.568644 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-4"/>
May 21 01:58:19.568644 np0000001127 nova-compute[98206]:   <target dev="vdc" bus="virtio"/>
May 21 01:58:19.568644 np0000001127 nova-compute[98206]:   <serial>ad40663d-967d-4ee3-8017-cb0686601c4d</serial>
May 21 01:58:19.568644 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 21 01:58:19.568644 np0000001127 nova-compute[98206]: </disk>
May 21 01:58:19.568644 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 01:58:19.597782 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Successfully detached device vdc from instance 0059a43c-1d34-40a9-af63-b5eca8c30f53 from the persistent domain config.
May 21 01:58:19.597782 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] (1/8): Attempting to detach device vdc with device alias ua-ad40663d-967d-4ee3-8017-cb0686601c4d from instance 0059a43c-1d34-40a9-af63-b5eca8c30f53 from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 01:58:19.597782 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] detach device xml: <disk type="block" device="disk">
May 21 01:58:19.597782 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:58:19.597782 np0000001127 nova-compute[98206]:   <alias name="ua-ad40663d-967d-4ee3-8017-cb0686601c4d"/>
May 21 01:58:19.597782 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-4"/>
May 21 01:58:19.597782 np0000001127 nova-compute[98206]:   <target dev="vdc" bus="virtio"/>
May 21 01:58:19.597782 np0000001127 nova-compute[98206]:   <serial>ad40663d-967d-4ee3-8017-cb0686601c4d</serial>
May 21 01:58:19.597782 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 21 01:58:19.597782 np0000001127 nova-compute[98206]: </disk>
May 21 01:58:19.597782 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 01:58:19.679331 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:58:19.683586 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328699.68323, 0d75ff65-b688-4387-89e3-70567e569682 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:58:19.683762 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0d75ff65-b688-4387-89e3-70567e569682] VM Paused (Lifecycle Event)
May 21 01:58:20.186305 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:58:20.188144 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:58:20.214936 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-ad40663d-967d-4ee3-8017-cb0686601c4d for instance 0059a43c-1d34-40a9-af63-b5eca8c30f53 {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 01:58:20.395538 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a31ba238-9435-40c1-8839-a118d6c25875 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "e9664d16-b539-4ccc-abd4-47a8fa944520" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.528s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:20.397892 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "e9664d16-b539-4ccc-abd4-47a8fa944520" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 5.365s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:20.398150 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Acquiring lock "e9664d16-b539-4ccc-abd4-47a8fa944520-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:20.398723 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "e9664d16-b539-4ccc-abd4-47a8fa944520-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:20.398723 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "e9664d16-b539-4ccc-abd4-47a8fa944520-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:20.403314 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Terminating instance
May 21 01:58:20.509494 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:58:20.509776 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:58:20.510116 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:58:20.510116 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] No VIF found with MAC fa:16:3e:30:ad:e5, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 01:58:20.510485 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Using config drive
May 21 01:58:20.632707 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-69693905-80af-41c3-bbb0-aac872764956 req-2a82f703-98ae-4e60-8ac1-ddec06a69c93 service nova] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Received event network-vif-plugged-43f9f40a-cc12-40f7-8311-7fcb01148125 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:20.633172 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-69693905-80af-41c3-bbb0-aac872764956 req-2a82f703-98ae-4e60-8ac1-ddec06a69c93 service nova] Acquiring lock "0d75ff65-b688-4387-89e3-70567e569682-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:20.634432 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-69693905-80af-41c3-bbb0-aac872764956 req-2a82f703-98ae-4e60-8ac1-ddec06a69c93 service nova] Lock "0d75ff65-b688-4387-89e3-70567e569682-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:20.634432 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-69693905-80af-41c3-bbb0-aac872764956 req-2a82f703-98ae-4e60-8ac1-ddec06a69c93 service nova] Lock "0d75ff65-b688-4387-89e3-70567e569682-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:20.634432 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-69693905-80af-41c3-bbb0-aac872764956 req-2a82f703-98ae-4e60-8ac1-ddec06a69c93 service nova] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Processing event network-vif-plugged-43f9f40a-cc12-40f7-8311-7fcb01148125 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 01:58:20.640214 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-69693905-80af-41c3-bbb0-aac872764956 req-2a82f703-98ae-4e60-8ac1-ddec06a69c93 service nova] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Received event network-vif-plugged-43f9f40a-cc12-40f7-8311-7fcb01148125 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:20.640214 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-69693905-80af-41c3-bbb0-aac872764956 req-2a82f703-98ae-4e60-8ac1-ddec06a69c93 service nova] Acquiring lock "0d75ff65-b688-4387-89e3-70567e569682-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:20.640214 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-69693905-80af-41c3-bbb0-aac872764956 req-2a82f703-98ae-4e60-8ac1-ddec06a69c93 service nova] Lock "0d75ff65-b688-4387-89e3-70567e569682-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:20.640214 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-69693905-80af-41c3-bbb0-aac872764956 req-2a82f703-98ae-4e60-8ac1-ddec06a69c93 service nova] Lock "0d75ff65-b688-4387-89e3-70567e569682-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:20.640214 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-69693905-80af-41c3-bbb0-aac872764956 req-2a82f703-98ae-4e60-8ac1-ddec06a69c93 service nova] [instance: 0d75ff65-b688-4387-89e3-70567e569682] No waiting events found dispatching network-vif-plugged-43f9f40a-cc12-40f7-8311-7fcb01148125 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:58:20.640214 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-69693905-80af-41c3-bbb0-aac872764956 req-2a82f703-98ae-4e60-8ac1-ddec06a69c93 service nova] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Received unexpected event network-vif-plugged-43f9f40a-cc12-40f7-8311-7fcb01148125 for instance with vm_state building and task_state spawning.
May 21 01:58:20.640214 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-69693905-80af-41c3-bbb0-aac872764956 req-2a82f703-98ae-4e60-8ac1-ddec06a69c93 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-deleted-d03a47d5-bec7-4099-96e0-c102edfe9e8e {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:20.640214 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-69693905-80af-41c3-bbb0-aac872764956 req-2a82f703-98ae-4e60-8ac1-ddec06a69c93 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Neutron deleted interface d03a47d5-bec7-4099-96e0-c102edfe9e8e; detaching it from the instance and deleting it from the info cache
May 21 01:58:20.641950 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-69693905-80af-41c3-bbb0-aac872764956 req-2a82f703-98ae-4e60-8ac1-ddec06a69c93 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Updating instance_info_cache with network_info: [{"id": "ebf91ac5-9634-4897-a1bb-7336846be7cb", "address": "fa:16:3e:fd:1e:9d", "network": {"id": "724d3b04-8f64-44ab-8f94-c1119b9a5b83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1321933524-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf91ac5-96", "ovs_interfaceid": "ebf91ac5-9634-4897-a1bb-7336846be7cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "319abe1b-caf8-4fa7-bc6c-caa7e755860b", "address": "fa:16:3e:10:bc:3b", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap319abe1b-ca", "ovs_interfaceid": "319abe1b-caf8-4fa7-bc6c-caa7e755860b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "db10c43a-9d2b-4250-83b6-0ca8ced88657", "address": "fa:16:3e:05:02:b1", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb10c43a-9d", "ovs_interfaceid": "db10c43a-9d2b-4250-83b6-0ca8ced88657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d807c564-314d-4f8e-8984-8068d59d3538", "address": "fa:16:3e:df:4a:48", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd807c564-31", "ovs_interfaceid": "d807c564-314d-4f8e-8984-8068d59d3538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "14e48bfc-fab0-433c-b291-0e75e2da496c", "address": "fa:16:3e:e5:ea:60", "network": {"id": "7b5c3ed1-837f-404f-9062-8babcc21dfd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-715008204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e48bfc-fa", "ovs_interfaceid": "14e48bfc-fab0-433c-b291-0e75e2da496c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "93b6a994-3c94-45b3-be4c-d63ce41a8557", "address": "fa:16:3e:56:b9:59", "network": {"id": "7b5c3ed1-837f-404f-9062-8babcc21dfd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-715008204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93b6a994-3c", "ovs_interfaceid": "93b6a994-3c94-45b3-be4c-d63ce41a8557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:58:20.642328 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 01:58:20.646263 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 01:58:20.650176 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Instance spawned successfully.
May 21 01:58:20.650584 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 01:58:20.690337 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0d75ff65-b688-4387-89e3-70567e569682] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 01:58:20.690612 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779328700.6903665, 0059a43c-1d34-40a9-af63-b5eca8c30f53 => ua-ad40663d-967d-4ee3-8017-cb0686601c4d> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 01:58:20.691124 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328700.6907415, 0d75ff65-b688-4387-89e3-70567e569682 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:58:20.691124 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0d75ff65-b688-4387-89e3-70567e569682] VM Resumed (Lifecycle Event)
May 21 01:58:20.694461 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Successfully detached device vdc from instance 0059a43c-1d34-40a9-af63-b5eca8c30f53 from the live domain config.
May 21 01:58:20.696272 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 01:58:20.696673 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d', 'iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ad40663d-967d-4ee3-8017-cb0686601c4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:58:20.696839 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:58:20.697319 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:58:20.697590 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d', 'iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ad40663d-967d-4ee3-8017-cb0686601c4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 01:58:20.697765 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 01:58:20.729612 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:20.729612 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:20.729612 np0000001127 nova-compute[98206]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:20.729612 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:20.729612 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:58:20.730654 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] iscsi session list stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:20.730654 np0000001127 nova-compute[98206]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d (non-flash)
May 21 01:58:20.730654 np0000001127 nova-compute[98206]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:20.730654 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:20.730654 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:58:20.730654 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', '25')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 01:58:20.730654 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d', '19')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 01:58:20.731283 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d', '18')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 01:58:20.732239 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c0587f2480>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d'): ({'sdf'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 01:58:20.733716 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Removing multipathed devices sdg, sdf {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 01:58:20.733716 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Flush multipath device 3300000005e216863 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 01:58:20.766656 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 01:58:20.810484 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 01:58:20.876041 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 01:58:20.876410 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 01:58:20.877122 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 01:58:20.891789 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 01:58:20.891789 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 01:58:20.907611 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 01:58:20.909217 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:20.942396 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:20.952286 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:20.960024 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d, portal: 192.168.40.100,3260]
May 21 01:58:20.960024 np0000001127 nova-compute[98206]: Logout of [sid: 19, target: iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d, portal: 192.168.40.100,3260] successful.
May 21 01:58:20.960024 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:20.973497 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:20.980533 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:20.983486 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:21.001503 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:21.013048 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:21.017463 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lazy-loading 'ec2_ids' on Instance uuid 6f68556b-0b18-452a-b307-da2dad4ee6ab {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:58:21.034185 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d, portal: 192.168.50.100,3260]
May 21 01:58:21.034185 np0000001127 nova-compute[98206]: Logout of [sid: 18, target: iqn.2023-03.storpool.com:os--volume-ad40663d-967d-4ee3-8017-cb0686601c4d, portal: 192.168.50.100,3260] successful.
May 21 01:58:21.034185 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:21.055104 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:21.055346 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:58:21.055849 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] <== disconnect_volume: return (358ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:58:21.055849 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 01:58:21.144073 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:21.155113 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-69693905-80af-41c3-bbb0-aac872764956 req-2a82f703-98ae-4e60-8ac1-ddec06a69c93 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Detach interface failed, port_id=d03a47d5-bec7-4099-96e0-c102edfe9e8e, reason: Instance 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 01:58:21.155277 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-69693905-80af-41c3-bbb0-aac872764956 req-2a82f703-98ae-4e60-8ac1-ddec06a69c93 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-deleted-d807c564-314d-4f8e-8984-8068d59d3538 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:21.155435 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-69693905-80af-41c3-bbb0-aac872764956 req-2a82f703-98ae-4e60-8ac1-ddec06a69c93 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Neutron deleted interface d807c564-314d-4f8e-8984-8068d59d3538; detaching it from the instance and deleting it from the info cache
May 21 01:58:21.155883 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-69693905-80af-41c3-bbb0-aac872764956 req-2a82f703-98ae-4e60-8ac1-ddec06a69c93 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Updating instance_info_cache with network_info: [{"id": "ebf91ac5-9634-4897-a1bb-7336846be7cb", "address": "fa:16:3e:fd:1e:9d", "network": {"id": "724d3b04-8f64-44ab-8f94-c1119b9a5b83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1321933524-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf91ac5-96", "ovs_interfaceid": "ebf91ac5-9634-4897-a1bb-7336846be7cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "319abe1b-caf8-4fa7-bc6c-caa7e755860b", "address": "fa:16:3e:10:bc:3b", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap319abe1b-ca", "ovs_interfaceid": "319abe1b-caf8-4fa7-bc6c-caa7e755860b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "db10c43a-9d2b-4250-83b6-0ca8ced88657", "address": "fa:16:3e:05:02:b1", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb10c43a-9d", "ovs_interfaceid": "db10c43a-9d2b-4250-83b6-0ca8ced88657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "14e48bfc-fab0-433c-b291-0e75e2da496c", "address": "fa:16:3e:e5:ea:60", "network": {"id": "7b5c3ed1-837f-404f-9062-8babcc21dfd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-715008204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e48bfc-fa", "ovs_interfaceid": "14e48bfc-fab0-433c-b291-0e75e2da496c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "93b6a994-3c94-45b3-be4c-d63ce41a8557", "address": "fa:16:3e:56:b9:59", "network": {"id": "7b5c3ed1-837f-404f-9062-8babcc21dfd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-715008204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93b6a994-3c", "ovs_interfaceid": "93b6a994-3c94-45b3-be4c-d63ce41a8557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:58:21.170006 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:58:21.170217 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:58:21.170938 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:58:21.171276 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:58:21.171678 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:58:21.172072 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:58:21.194371 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:58:21.196744 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:58:21.254880 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Instance destroyed successfully.
May 21 01:58:21.257041 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lazy-loading 'resources' on Instance uuid e9664d16-b539-4ccc-abd4-47a8fa944520 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:58:21.527251 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Object Instance<6f68556b-0b18-452a-b307-da2dad4ee6ab> lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 01:58:21.527820 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lazy-loading 'keypairs' on Instance uuid 6f68556b-0b18-452a-b307-da2dad4ee6ab {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:58:21.641391 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lazy-loading 'flavor' on Instance uuid 0059a43c-1d34-40a9-af63-b5eca8c30f53 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:58:21.658634 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:58:21.661816 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-69693905-80af-41c3-bbb0-aac872764956 req-2a82f703-98ae-4e60-8ac1-ddec06a69c93 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Detach interface failed, port_id=d807c564-314d-4f8e-8984-8068d59d3538, reason: Instance 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 01:58:21.663315 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-69693905-80af-41c3-bbb0-aac872764956 req-2a82f703-98ae-4e60-8ac1-ddec06a69c93 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-deleted-93b6a994-3c94-45b3-be4c-d63ce41a8557 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:21.663315 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-69693905-80af-41c3-bbb0-aac872764956 req-2a82f703-98ae-4e60-8ac1-ddec06a69c93 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Neutron deleted interface 93b6a994-3c94-45b3-be4c-d63ce41a8557; detaching it from the instance and deleting it from the info cache
May 21 01:58:21.663315 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-69693905-80af-41c3-bbb0-aac872764956 req-2a82f703-98ae-4e60-8ac1-ddec06a69c93 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Updating instance_info_cache with network_info: [{"id": "ebf91ac5-9634-4897-a1bb-7336846be7cb", "address": "fa:16:3e:fd:1e:9d", "network": {"id": "724d3b04-8f64-44ab-8f94-c1119b9a5b83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1321933524-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf91ac5-96", "ovs_interfaceid": "ebf91ac5-9634-4897-a1bb-7336846be7cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "319abe1b-caf8-4fa7-bc6c-caa7e755860b", "address": "fa:16:3e:10:bc:3b", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap319abe1b-ca", "ovs_interfaceid": "319abe1b-caf8-4fa7-bc6c-caa7e755860b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "db10c43a-9d2b-4250-83b6-0ca8ced88657", "address": "fa:16:3e:05:02:b1", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb10c43a-9d", "ovs_interfaceid": "db10c43a-9d2b-4250-83b6-0ca8ced88657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "14e48bfc-fab0-433c-b291-0e75e2da496c", "address": "fa:16:3e:e5:ea:60", "network": {"id": "7b5c3ed1-837f-404f-9062-8babcc21dfd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-715008204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e48bfc-fa", "ovs_interfaceid": "14e48bfc-fab0-433c-b291-0e75e2da496c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:58:21.681046 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Took 11.01 seconds to spawn the instance on the hypervisor.
May 21 01:58:21.681309 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:58:21.700288 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0d75ff65-b688-4387-89e3-70567e569682] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 01:58:21.700696 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999793727999986 future=<Future at 0x71c05864d3a0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:58:21.760108 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:56:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-702854126',display_name='tempest-VolumesSnapshotTestJSON-instance-702854126',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumessnapshottestjson-instance-702854126',id=9,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMcBj8Yxk1lhi1gpm4+248B3FfxYWxY0/YeGb+59b8Aa0wCxnoRMbWzsgRV2kNYWfX7BEJmbnmMjOgRBTCcP/Cmj9rN0eQ4E1vBTRsFRc8nwc1z0oo2pnfXW4AhBNCIKg==',key_name='tempest-keypair-29798417',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:57:08Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a80dd2c84334f79afe5cb079c50c555',ramdisk_id='',reservation_id='r-votukee3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-315332802',owner_user_name='tempest-VolumesSnapshotTestJSON-315332802-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:57:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='457854a2cf2844b8b693d835d2c9b699',uuid=e9664d16-b539-4ccc-abd4-47a8fa944520,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f478597-015e-4c42-b8d5-af05bb7c8f8e", "address": "fa:16:3e:f6:c7:e3", "network": {"id": "aba610ba-f311-41c2-b94d-2495441912e4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-360728390-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a80dd2c84334f79afe5cb079c50c555", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f478597-01", "ovs_interfaceid": "1f478597-015e-4c42-b8d5-af05bb7c8f8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 01:58:21.760339 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Converting VIF {"id": "1f478597-015e-4c42-b8d5-af05bb7c8f8e", "address": "fa:16:3e:f6:c7:e3", "network": {"id": "aba610ba-f311-41c2-b94d-2495441912e4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-360728390-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a80dd2c84334f79afe5cb079c50c555", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f478597-01", "ovs_interfaceid": "1f478597-015e-4c42-b8d5-af05bb7c8f8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:58:21.760969 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:c7:e3,bridge_name='br-int',has_traffic_filtering=True,id=1f478597-015e-4c42-b8d5-af05bb7c8f8e,network=Network(aba610ba-f311-41c2-b94d-2495441912e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f478597-01') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:58:21.761215 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:c7:e3,bridge_name='br-int',has_traffic_filtering=True,id=1f478597-015e-4c42-b8d5-af05bb7c8f8e,network=Network(aba610ba-f311-41c2-b94d-2495441912e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f478597-01') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 01:58:21.765002 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:21.765408 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f478597-01, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:21.766615 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:21.769314 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:58:21.773696 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:21.774707 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:21.774907 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e1a60412-d1f2-4a23-9a77-53d41323dabb) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:21.775549 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:21.776174 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:58:21.783699 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:21.788837 np0000001127 nova-compute[98206]: INFO os_vif [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:c7:e3,bridge_name='br-int',has_traffic_filtering=True,id=1f478597-015e-4c42-b8d5-af05bb7c8f8e,network=Network(aba610ba-f311-41c2-b94d-2495441912e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f478597-01')
May 21 01:58:21.790055 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 01:58:21.790321 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48', 'iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:58:21.790460 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:58:21.790804 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:58:21.791049 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48', 'iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 01:58:21.791165 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 01:58:21.816338 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:21.816338 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:21.816338 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:58:21.816580 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsi session list stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:21.816580 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:21.816580 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:58:21.816734 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', '25')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 01:58:21.816865 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48, 0): [] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 01:58:21.816977 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48') {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 21 01:58:21.817135 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48, 0): [] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 01:58:21.817221 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6afa9ebc-1c0d-4569-a9e0-a3fc70b3dd48') {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 21 01:58:21.817304 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c0587f0540>, {}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 01:58:21.817453 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Disconnecting from: [] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 01:58:21.817687 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.027s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:58:21.817788 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] <== disconnect_volume: return (27ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:58:21.817920 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 01:58:21.818307 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Deleting instance files /opt/stack/data/nova/instances/e9664d16-b539-4ccc-abd4-47a8fa944520_del
May 21 01:58:21.820064 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Deletion of /opt/stack/data/nova/instances/e9664d16-b539-4ccc-abd4-47a8fa944520_del complete
May 21 01:58:22.030679 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Object Instance<6f68556b-0b18-452a-b307-da2dad4ee6ab> lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 01:58:22.033962 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError
May 21 01:58:22.161854 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Took 6.27 seconds to deallocate network for instance.
May 21 01:58:22.168101 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-69693905-80af-41c3-bbb0-aac872764956 req-2a82f703-98ae-4e60-8ac1-ddec06a69c93 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Detach interface failed, port_id=93b6a994-3c94-45b3-be4c-d63ce41a8557, reason: Instance 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 01:58:22.168267 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-69693905-80af-41c3-bbb0-aac872764956 req-2a82f703-98ae-4e60-8ac1-ddec06a69c93 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-deleted-14e48bfc-fab0-433c-b291-0e75e2da496c {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:22.172043 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-69693905-80af-41c3-bbb0-aac872764956 req-2a82f703-98ae-4e60-8ac1-ddec06a69c93 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Neutron deleted interface 14e48bfc-fab0-433c-b291-0e75e2da496c; detaching it from the instance and deleting it from the info cache
May 21 01:58:22.172043 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-69693905-80af-41c3-bbb0-aac872764956 req-2a82f703-98ae-4e60-8ac1-ddec06a69c93 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Updating instance_info_cache with network_info: [{"id": "ebf91ac5-9634-4897-a1bb-7336846be7cb", "address": "fa:16:3e:fd:1e:9d", "network": {"id": "724d3b04-8f64-44ab-8f94-c1119b9a5b83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1321933524-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf91ac5-96", "ovs_interfaceid": "ebf91ac5-9634-4897-a1bb-7336846be7cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "319abe1b-caf8-4fa7-bc6c-caa7e755860b", "address": "fa:16:3e:10:bc:3b", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap319abe1b-ca", "ovs_interfaceid": "319abe1b-caf8-4fa7-bc6c-caa7e755860b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "db10c43a-9d2b-4250-83b6-0ca8ced88657", "address": "fa:16:3e:05:02:b1", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb10c43a-9d", "ovs_interfaceid": "db10c43a-9d2b-4250-83b6-0ca8ced88657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:58:22.187955 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Creating config drive at /opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab/disk.config
May 21 01:58:22.193021 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Took 17.41 seconds to build instance.
May 21 01:58:22.196835 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfa8vl6z_ {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:22.247261 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfa8vl6z_" returned: 0 in 0.050s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:22.257448 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0023511530000632774 future=<Future at 0x71c058649310 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:58:22.257448 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:58:22.257448 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=6.093998692000014 future=<Future at 0x71c07c7bc140 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:58:22.257579 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=6.09383033999984 future=<Future at 0x71c07c7bc140 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:58:22.258005 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Emitting event <LifecycleEvent: 1779328687.254567, 6f68556b-0b18-452a-b307-da2dad4ee6ab => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:58:22.258249 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] VM Stopped (Lifecycle Event)
May 21 01:58:22.332077 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Took 1.42 seconds to destroy the instance on the hypervisor.
May 21 01:58:22.337628 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0574b977-6008-4657-a9ef-779bda495fbe req-2a9aa3eb-57de-4328-81b4-a501b1fe3f55 service nova] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Received event network-vif-unplugged-1f478597-015e-4c42-b8d5-af05bb7c8f8e {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:22.337628 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0574b977-6008-4657-a9ef-779bda495fbe req-2a9aa3eb-57de-4328-81b4-a501b1fe3f55 service nova] Acquiring lock "e9664d16-b539-4ccc-abd4-47a8fa944520-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:22.337628 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0574b977-6008-4657-a9ef-779bda495fbe req-2a9aa3eb-57de-4328-81b4-a501b1fe3f55 service nova] Lock "e9664d16-b539-4ccc-abd4-47a8fa944520-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:22.337628 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0574b977-6008-4657-a9ef-779bda495fbe req-2a9aa3eb-57de-4328-81b4-a501b1fe3f55 service nova] Lock "e9664d16-b539-4ccc-abd4-47a8fa944520-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:22.337628 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0574b977-6008-4657-a9ef-779bda495fbe req-2a9aa3eb-57de-4328-81b4-a501b1fe3f55 service nova] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] No waiting events found dispatching network-vif-unplugged-1f478597-015e-4c42-b8d5-af05bb7c8f8e {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:58:22.337628 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0574b977-6008-4657-a9ef-779bda495fbe req-2a9aa3eb-57de-4328-81b4-a501b1fe3f55 service nova] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Received event network-vif-unplugged-1f478597-015e-4c42-b8d5-af05bb7c8f8e for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 01:58:22.339282 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 01:58:22.339282 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 01:58:22.339282 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 01:58:22.339282 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:22.464422 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:22.649871 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e848cd1e-b784-4100-b874-2745c7e79081 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "0059a43c-1d34-40a9-af63-b5eca8c30f53" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.668s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:22.679082 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-69693905-80af-41c3-bbb0-aac872764956 req-2a82f703-98ae-4e60-8ac1-ddec06a69c93 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Detach interface failed, port_id=14e48bfc-fab0-433c-b291-0e75e2da496c, reason: Instance 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 01:58:22.695118 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "0d75ff65-b688-4387-89e3-70567e569682" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.923s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:22.761620 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-417fed7b-e5f1-48b3-9303-8c6a500e34d9 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:58:22.774214 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:22.801995 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:22.806253 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:22.894665 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-9cd6527c-b687-42ea-9bf7-ed9df188e790 req-6f6b01db-c51a-405e-9520-30fd1ef1ca98 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Received event network-vif-deleted-ebf91ac5-9634-4897-a1bb-7336846be7cb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:22.895243 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-9cd6527c-b687-42ea-9bf7-ed9df188e790 req-6f6b01db-c51a-405e-9520-30fd1ef1ca98 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Neutron deleted interface ebf91ac5-9634-4897-a1bb-7336846be7cb; detaching it from the instance and deleting it from the info cache
May 21 01:58:22.895535 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-9cd6527c-b687-42ea-9bf7-ed9df188e790 req-6f6b01db-c51a-405e-9520-30fd1ef1ca98 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Updating instance_info_cache with network_info: [{"id": "319abe1b-caf8-4fa7-bc6c-caa7e755860b", "address": "fa:16:3e:10:bc:3b", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap319abe1b-ca", "ovs_interfaceid": "319abe1b-caf8-4fa7-bc6c-caa7e755860b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "db10c43a-9d2b-4250-83b6-0ca8ced88657", "address": "fa:16:3e:05:02:b1", "network": {"id": "dbb55b2c-d3ef-4540-90e5-c3bb021515d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1307427445", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16c5939e8b346a8a2da89fb19b2a812", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb10c43a-9d", "ovs_interfaceid": "db10c43a-9d2b-4250-83b6-0ca8ced88657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:58:22.903785 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:22.929912 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:23.014159 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:23.015587 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:23.402074 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-9cd6527c-b687-42ea-9bf7-ed9df188e790 req-6f6b01db-c51a-405e-9520-30fd1ef1ca98 service nova] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Detach interface failed, port_id=ebf91ac5-9634-4897-a1bb-7336846be7cb, reason: Instance 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 01:58:23.593085 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:58:23.645945 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f3b1f471-df6b-4342-be54-2dd8cf684592 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "0059a43c-1d34-40a9-af63-b5eca8c30f53" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:23.646328 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f3b1f471-df6b-4342-be54-2dd8cf684592 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "0059a43c-1d34-40a9-af63-b5eca8c30f53" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:23.646440 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f3b1f471-df6b-4342-be54-2dd8cf684592 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "0059a43c-1d34-40a9-af63-b5eca8c30f53-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:23.646616 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f3b1f471-df6b-4342-be54-2dd8cf684592 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "0059a43c-1d34-40a9-af63-b5eca8c30f53-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:23.646786 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f3b1f471-df6b-4342-be54-2dd8cf684592 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "0059a43c-1d34-40a9-af63-b5eca8c30f53-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:23.649806 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-f3b1f471-df6b-4342-be54-2dd8cf684592 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Terminating instance
May 21 01:58:23.930301 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Took 1.77 seconds to detach 3 volumes for instance.
May 21 01:58:24.005739 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328704.004726, 6f68556b-0b18-452a-b307-da2dad4ee6ab => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:58:24.005739 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] VM Resumed (Lifecycle Event)
May 21 01:58:24.006122 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Instance event wait completed in 0 seconds for  {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 01:58:24.006550 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 01:58:24.011544 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Instance spawned successfully.
May 21 01:58:24.012001 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 01:58:24.097395 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Took 1.76 seconds to deallocate network for instance.
May 21 01:58:24.117486 np0000001127 nova-compute[98206]: WARNING nova.volume.cinder [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Attachment 5f2e2dc0-40ea-4995-b486-0dfdc5c4ea28 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 5f2e2dc0-40ea-4995-b486-0dfdc5c4ea28. (HTTP 404) (Request-ID: req-f77439ce-71a8-47b7-bb09-d112c986c7af)
May 21 01:58:24.117811 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Took 0.02 seconds to detach 1 volumes for instance.
May 21 01:58:24.154403 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-f3b1f471-df6b-4342-be54-2dd8cf684592 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 01:58:24.179079 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:24.186405 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:24.206240 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:24.218479 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:24.253065 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:24.422549 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-663dfb78-9ea6-4f35-a67a-7ace76d5c84b req-5ab7c082-c24a-4393-8b8a-0d42977867a2 service nova] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Received event network-vif-unplugged-1f478597-015e-4c42-b8d5-af05bb7c8f8e {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:24.424048 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-663dfb78-9ea6-4f35-a67a-7ace76d5c84b req-5ab7c082-c24a-4393-8b8a-0d42977867a2 service nova] Acquiring lock "e9664d16-b539-4ccc-abd4-47a8fa944520-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:24.424422 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-663dfb78-9ea6-4f35-a67a-7ace76d5c84b req-5ab7c082-c24a-4393-8b8a-0d42977867a2 service nova] Lock "e9664d16-b539-4ccc-abd4-47a8fa944520-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:24.425062 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-663dfb78-9ea6-4f35-a67a-7ace76d5c84b req-5ab7c082-c24a-4393-8b8a-0d42977867a2 service nova] Lock "e9664d16-b539-4ccc-abd4-47a8fa944520-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:24.425568 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-663dfb78-9ea6-4f35-a67a-7ace76d5c84b req-5ab7c082-c24a-4393-8b8a-0d42977867a2 service nova] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] No waiting events found dispatching network-vif-unplugged-1f478597-015e-4c42-b8d5-af05bb7c8f8e {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:58:24.425933 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-663dfb78-9ea6-4f35-a67a-7ace76d5c84b req-5ab7c082-c24a-4393-8b8a-0d42977867a2 service nova] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Received unexpected event network-vif-unplugged-1f478597-015e-4c42-b8d5-af05bb7c8f8e for instance with vm_state deleted and task_state None.
May 21 01:58:24.442916 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:24.443140 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:24.479025 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:24.489647 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:24.523056 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:58:24.523056 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:58:24.523795 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:58:24.523795 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:58:24.523999 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:58:24.524283 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:58:24.524626 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:58:24.525877 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Instance destroyed successfully.
May 21 01:58:24.527698 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-f3b1f471-df6b-4342-be54-2dd8cf684592 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lazy-loading 'resources' on Instance uuid 0059a43c-1d34-40a9-af63-b5eca8c30f53 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:58:24.527698 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:58:24.629077 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:24.854834 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-fd1a2507-dbd4-4dfa-a672-b90226d5e8a2 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:58:24.925258 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:58:24.925562 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:58:25.008697 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8bfac644-5106-421a-9e54-a09d4e7050be req-96a29396-4731-46fe-bc15-dcfaf87ba494 service nova] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Received event network-vif-plugged-069db2b1-36ac-43ce-b643-fcdc9ff52141 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:25.009104 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8bfac644-5106-421a-9e54-a09d4e7050be req-96a29396-4731-46fe-bc15-dcfaf87ba494 service nova] Acquiring lock "6f68556b-0b18-452a-b307-da2dad4ee6ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:25.009104 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8bfac644-5106-421a-9e54-a09d4e7050be req-96a29396-4731-46fe-bc15-dcfaf87ba494 service nova] Lock "6f68556b-0b18-452a-b307-da2dad4ee6ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:25.009104 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8bfac644-5106-421a-9e54-a09d4e7050be req-96a29396-4731-46fe-bc15-dcfaf87ba494 service nova] Lock "6f68556b-0b18-452a-b307-da2dad4ee6ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:25.010543 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8bfac644-5106-421a-9e54-a09d4e7050be req-96a29396-4731-46fe-bc15-dcfaf87ba494 service nova] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] No waiting events found dispatching network-vif-plugged-069db2b1-36ac-43ce-b643-fcdc9ff52141 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:58:25.010543 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-8bfac644-5106-421a-9e54-a09d4e7050be req-96a29396-4731-46fe-bc15-dcfaf87ba494 service nova] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Received unexpected event network-vif-plugged-069db2b1-36ac-43ce-b643-fcdc9ff52141 for instance with vm_state active and task_state rebuild_spawning.
May 21 01:58:25.010543 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8bfac644-5106-421a-9e54-a09d4e7050be req-96a29396-4731-46fe-bc15-dcfaf87ba494 service nova] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Received event network-vif-deleted-1f478597-015e-4c42-b8d5-af05bb7c8f8e {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:25.010543 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8bfac644-5106-421a-9e54-a09d4e7050be req-96a29396-4731-46fe-bc15-dcfaf87ba494 service nova] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Received event network-vif-plugged-069db2b1-36ac-43ce-b643-fcdc9ff52141 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:25.010543 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8bfac644-5106-421a-9e54-a09d4e7050be req-96a29396-4731-46fe-bc15-dcfaf87ba494 service nova] Acquiring lock "6f68556b-0b18-452a-b307-da2dad4ee6ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:25.010543 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8bfac644-5106-421a-9e54-a09d4e7050be req-96a29396-4731-46fe-bc15-dcfaf87ba494 service nova] Lock "6f68556b-0b18-452a-b307-da2dad4ee6ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:25.010543 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8bfac644-5106-421a-9e54-a09d4e7050be req-96a29396-4731-46fe-bc15-dcfaf87ba494 service nova] Lock "6f68556b-0b18-452a-b307-da2dad4ee6ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:25.010543 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8bfac644-5106-421a-9e54-a09d4e7050be req-96a29396-4731-46fe-bc15-dcfaf87ba494 service nova] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] No waiting events found dispatching network-vif-plugged-069db2b1-36ac-43ce-b643-fcdc9ff52141 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:58:25.010543 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-8bfac644-5106-421a-9e54-a09d4e7050be req-96a29396-4731-46fe-bc15-dcfaf87ba494 service nova] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Received unexpected event network-vif-plugged-069db2b1-36ac-43ce-b643-fcdc9ff52141 for instance with vm_state active and task_state rebuild_spawning.
May 21 01:58:25.010857 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8bfac644-5106-421a-9e54-a09d4e7050be req-96a29396-4731-46fe-bc15-dcfaf87ba494 service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Received event network-vif-unplugged-839e91da-5ffe-451b-bd9d-dfc1cf83ab19 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:25.010857 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8bfac644-5106-421a-9e54-a09d4e7050be req-96a29396-4731-46fe-bc15-dcfaf87ba494 service nova] Acquiring lock "0059a43c-1d34-40a9-af63-b5eca8c30f53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:25.011053 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8bfac644-5106-421a-9e54-a09d4e7050be req-96a29396-4731-46fe-bc15-dcfaf87ba494 service nova] Lock "0059a43c-1d34-40a9-af63-b5eca8c30f53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:25.011158 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8bfac644-5106-421a-9e54-a09d4e7050be req-96a29396-4731-46fe-bc15-dcfaf87ba494 service nova] Lock "0059a43c-1d34-40a9-af63-b5eca8c30f53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:25.011197 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8bfac644-5106-421a-9e54-a09d4e7050be req-96a29396-4731-46fe-bc15-dcfaf87ba494 service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] No waiting events found dispatching network-vif-unplugged-839e91da-5ffe-451b-bd9d-dfc1cf83ab19 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:58:25.011269 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8bfac644-5106-421a-9e54-a09d4e7050be req-96a29396-4731-46fe-bc15-dcfaf87ba494 service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Received event network-vif-unplugged-839e91da-5ffe-451b-bd9d-dfc1cf83ab19 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 01:58:25.011399 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8bfac644-5106-421a-9e54-a09d4e7050be req-96a29396-4731-46fe-bc15-dcfaf87ba494 service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Received event network-vif-unplugged-839e91da-5ffe-451b-bd9d-dfc1cf83ab19 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:25.011564 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8bfac644-5106-421a-9e54-a09d4e7050be req-96a29396-4731-46fe-bc15-dcfaf87ba494 service nova] Acquiring lock "0059a43c-1d34-40a9-af63-b5eca8c30f53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:25.011730 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8bfac644-5106-421a-9e54-a09d4e7050be req-96a29396-4731-46fe-bc15-dcfaf87ba494 service nova] Lock "0059a43c-1d34-40a9-af63-b5eca8c30f53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:25.012280 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8bfac644-5106-421a-9e54-a09d4e7050be req-96a29396-4731-46fe-bc15-dcfaf87ba494 service nova] Lock "0059a43c-1d34-40a9-af63-b5eca8c30f53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:25.012439 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8bfac644-5106-421a-9e54-a09d4e7050be req-96a29396-4731-46fe-bc15-dcfaf87ba494 service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] No waiting events found dispatching network-vif-unplugged-839e91da-5ffe-451b-bd9d-dfc1cf83ab19 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:58:25.012616 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8bfac644-5106-421a-9e54-a09d4e7050be req-96a29396-4731-46fe-bc15-dcfaf87ba494 service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Received event network-vif-unplugged-839e91da-5ffe-451b-bd9d-dfc1cf83ab19 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 01:58:25.023210 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
May 21 01:58:25.023527 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328705.0232904, 6f68556b-0b18-452a-b307-da2dad4ee6ab => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:58:25.023685 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] VM Started (Lifecycle Event)
May 21 01:58:25.034518 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-f3b1f471-df6b-4342-be54-2dd8cf684592 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-21T01:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1719541415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumeshelvetestjson-server-1719541415',id=1,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2zmFe4sQuXWXUjhz16/AauWIZ+ngdfS4R0mqQiLGq9SjV71VzozhRC8Z3F1F+0764niXRdGZVFgH+pUevCihuQEDmwwISw1j+rj6qnUSw4ecZaPwrSQfd2Xm4Jics0Vw==',key_name='tempest-keypair-1216999249',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:57:41Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e41dd931ff049868a61f52a251d1122',ramdisk_id='',reservation_id='r-2une16cp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-826866539',owner_user_name='tempest-AttachVolumeShelveTestJSON-826866539-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:57:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d91dda570ffb45489f81bd0c87e7fda6',uuid=0059a43c-1d34-40a9-af63-b5eca8c30f53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "address": "fa:16:3e:00:d8:d3", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap839e91da-5f", "ovs_interfaceid": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 01:58:25.034800 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-f3b1f471-df6b-4342-be54-2dd8cf684592 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Converting VIF {"id": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "address": "fa:16:3e:00:d8:d3", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap839e91da-5f", "ovs_interfaceid": "839e91da-5ffe-451b-bd9d-dfc1cf83ab19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:58:25.035598 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-f3b1f471-df6b-4342-be54-2dd8cf684592 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:d8:d3,bridge_name='br-int',has_traffic_filtering=True,id=839e91da-5ffe-451b-bd9d-dfc1cf83ab19,network=Network(084a1218-5c9f-4f1e-855b-53d284a5202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839e91da-5f') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:58:25.035861 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-f3b1f471-df6b-4342-be54-2dd8cf684592 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:d8:d3,bridge_name='br-int',has_traffic_filtering=True,id=839e91da-5ffe-451b-bd9d-dfc1cf83ab19,network=Network(084a1218-5c9f-4f1e-855b-53d284a5202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839e91da-5f') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 01:58:25.039244 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:58:25.039934 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:25.040165 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap839e91da-5f, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:25.042188 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:25.043365 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:58:25.044288 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:25.044560 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2ac8c166-e104-4e88-a49f-17e549ff9151) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:25.048308 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:25.049109 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:58:25.050017 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:25.052030 np0000001127 nova-compute[98206]: INFO os_vif [None req-f3b1f471-df6b-4342-be54-2dd8cf684592 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:d8:d3,bridge_name='br-int',has_traffic_filtering=True,id=839e91da-5ffe-451b-bd9d-dfc1cf83ab19,network=Network(084a1218-5c9f-4f1e-855b-53d284a5202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839e91da-5f')
May 21 01:58:25.052607 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-f3b1f471-df6b-4342-be54-2dd8cf684592 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Deleting instance files /opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53_del
May 21 01:58:25.064094 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-f3b1f471-df6b-4342-be54-2dd8cf684592 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Deletion of /opt/stack/data/nova/instances/0059a43c-1d34-40a9-af63-b5eca8c30f53_del complete
May 21 01:58:25.365847 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-fd1a2507-dbd4-4dfa-a672-b90226d5e8a2 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] instance snapshotting
May 21 01:58:25.428428 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:58:25.524755 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-fd1a2507-dbd4-4dfa-a672-b90226d5e8a2 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Beginning live snapshot process
May 21 01:58:25.528706 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:58:25.534036 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:58:25.555377 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:25.574522 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-f3b1f471-df6b-4342-be54-2dd8cf684592 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Took 1.42 seconds to destroy the instance on the hypervisor.
May 21 01:58:25.574522 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-f3b1f471-df6b-4342-be54-2dd8cf684592 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 01:58:25.574522 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 01:58:25.574522 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 01:58:25.574522 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:25.665818 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:25.938915 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.496s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:25.941936 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.313s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:26.038207 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999436353999954 future=<Future at 0x71c07c787da0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:58:26.038750 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Deleted allocations for instance 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8
May 21 01:58:26.145916 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:26.348763 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c645036f-4406-465a-bcb4-cdcf5fe4ab9a req-57b23615-066f-49c5-b02c-a1ce4c2536ee service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Received event network-vif-deleted-839e91da-5ffe-451b-bd9d-dfc1cf83ab19 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:26.348916 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-c645036f-4406-465a-bcb4-cdcf5fe4ab9a req-57b23615-066f-49c5-b02c-a1ce4c2536ee service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Neutron deleted interface 839e91da-5ffe-451b-bd9d-dfc1cf83ab19; detaching it from the instance and deleting it from the info cache
May 21 01:58:26.349041 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-c645036f-4406-465a-bcb4-cdcf5fe4ab9a req-57b23615-066f-49c5-b02c-a1ce4c2536ee service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:58:26.375859 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:58:26.376131 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:58:26.786232 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:58:26.854289 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c645036f-4406-465a-bcb4-cdcf5fe4ab9a req-57b23615-066f-49c5-b02c-a1ce4c2536ee service nova] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Detach interface failed, port_id=839e91da-5ffe-451b-bd9d-dfc1cf83ab19, reason: Instance 0059a43c-1d34-40a9-af63-b5eca8c30f53 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 01:58:26.880089 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:58:27.042984 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-fd1a2507-dbd4-4dfa-a672-b90226d5e8a2 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d75ff65-b688-4387-89e3-70567e569682/disk --force-share --output=json -f qcow2 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:27.063539 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c420401d-f224-45d5-a183-6fa17defa65a tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Lock "58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.918s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:27.140568 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-fd1a2507-dbd4-4dfa-a672-b90226d5e8a2 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d75ff65-b688-4387-89e3-70567e569682/disk --force-share --output=json -f qcow2" returned: 0 in 0.098s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:27.140940 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-fd1a2507-dbd4-4dfa-a672-b90226d5e8a2 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d75ff65-b688-4387-89e3-70567e569682/disk --force-share --output=json -f qcow2 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:27.199315 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:27.201056 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:27.231414 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:27.231659 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:27.238665 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-fd1a2507-dbd4-4dfa-a672-b90226d5e8a2 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d75ff65-b688-4387-89e3-70567e569682/disk --force-share --output=json -f qcow2" returned: 0 in 0.098s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:27.239423 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-fd1a2507-dbd4-4dfa-a672-b90226d5e8a2 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:58:27.243486 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-fd1a2507-dbd4-4dfa-a672-b90226d5e8a2 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:58:27.243873 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-fd1a2507-dbd4-4dfa-a672-b90226d5e8a2 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:27.289189 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Took 1.72 seconds to deallocate network for instance.
May 21 01:58:27.330923 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-fd1a2507-dbd4-4dfa-a672-b90226d5e8a2 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.087s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:27.331409 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-fd1a2507-dbd4-4dfa-a672-b90226d5e8a2 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpll6t7wm5/0d56845539394cb5adce4ce034a7f1a0.delta 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:27.390430 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.448s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:27.393895 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 1.838s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:27.394207 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Trying to apply a migration context that does not seem to be set for this instance {{(pid=98206) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}}
May 21 01:58:27.399378 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-fd1a2507-dbd4-4dfa-a672-b90226d5e8a2 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpll6t7wm5/0d56845539394cb5adce4ce034a7f1a0.delta 1073741824" returned: 0 in 0.066s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:27.403631 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-fd1a2507-dbd4-4dfa-a672-b90226d5e8a2 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Quiescing instance not available: QEMU guest agent is not enabled.
May 21 01:58:27.469376 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Deleted allocations for instance e9664d16-b539-4ccc-abd4-47a8fa944520
May 21 01:58:27.686560 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-fd1a2507-dbd4-4dfa-a672-b90226d5e8a2 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=98206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 21 01:58:27.689384 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-fd1a2507-dbd4-4dfa-a672-b90226d5e8a2 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Skipping quiescing instance: QEMU guest agent is not enabled.
May 21 01:58:27.703208 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 01:58:27.734195 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 01:58:27.742143 np0000001127 nova-compute[98206]: DEBUG nova.privsep.utils [None req-fd1a2507-dbd4-4dfa-a672-b90226d5e8a2 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 21 01:58:27.745564 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-fd1a2507-dbd4-4dfa-a672-b90226d5e8a2 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpll6t7wm5/0d56845539394cb5adce4ce034a7f1a0.delta /opt/stack/data/nova/instances/snapshots/tmpll6t7wm5/0d56845539394cb5adce4ce034a7f1a0 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:27.798636 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f3b1f471-df6b-4342-be54-2dd8cf684592 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:27.956580 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-fd1a2507-dbd4-4dfa-a672-b90226d5e8a2 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpll6t7wm5/0d56845539394cb5adce4ce034a7f1a0.delta /opt/stack/data/nova/instances/snapshots/tmpll6t7wm5/0d56845539394cb5adce4ce034a7f1a0" returned: 0 in 0.214s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:27.957173 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-fd1a2507-dbd4-4dfa-a672-b90226d5e8a2 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Snapshot extracted, beginning image upload
May 21 01:58:28.290568 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:28.314651 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:28.351834 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.00044923500013283046 future=<Future at 0x71c07c7bc140 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:58:28.352050 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:58:28.352150 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=8.348340879000034 future=<Future at 0x71c05864d3a0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:58:28.352252 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=8.348244100000102 future=<Future at 0x71c05864d3a0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:58:28.352742 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1779328693.351247, 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:58:28.352974 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] VM Stopped (Lifecycle Event)
May 21 01:58:28.411641 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1d67fca7-9638-4f5d-a989-f5333028f958 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.018s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:28.412436 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f3b1f471-df6b-4342-be54-2dd8cf684592 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.613s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:28.479215 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1bcffe74-0416-4a45-98b1-e1b328d5b445 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "e9664d16-b539-4ccc-abd4-47a8fa944520" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.083s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:28.856660 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-85e1374b-d1d2-4b9d-b0d3-46a1ac00b6b8 None None] [instance: 58df0cf7-8bd5-4e55-8aa7-34b61cfbbdc8] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:58:28.929530 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f3b1f471-df6b-4342-be54-2dd8cf684592 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:58:28.929792 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-f3b1f471-df6b-4342-be54-2dd8cf684592 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:58:28.975592 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:29.432337 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-f3b1f471-df6b-4342-be54-2dd8cf684592 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:58:29.942495 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f3b1f471-df6b-4342-be54-2dd8cf684592 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.530s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:29.944807 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.654s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:29.949432 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 01:58:29.949652 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Claim successful on node np0000001127
May 21 01:58:30.049341 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:30.061845 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-f3b1f471-df6b-4342-be54-2dd8cf684592 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Deleted allocations for instance 0059a43c-1d34-40a9-af63-b5eca8c30f53
May 21 01:58:30.651524 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-fd1a2507-dbd4-4dfa-a672-b90226d5e8a2 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Snapshot image upload complete
May 21 01:58:30.651524 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-fd1a2507-dbd4-4dfa-a672-b90226d5e8a2 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Took 5.28 seconds to snapshot the instance on the hypervisor.
May 21 01:58:31.071585 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f3b1f471-df6b-4342-be54-2dd8cf684592 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "0059a43c-1d34-40a9-af63-b5eca8c30f53" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.425s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:31.148863 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:31.393305 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:58:31.393305 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:58:31.895784 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:58:32.401453 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.457s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:32.402072 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 4.087s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:32.402169 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 01:58:32.407006 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 01:58:32.407155 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Claim successful on node np0000001127
May 21 01:58:32.916759 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 01:58:32.917156 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 01:58:32.924368 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:32.924694 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:32.961846 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:32.962140 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:33.181202 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dcc45f6ca81d42fbb09ff1916bb11787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea6765f0d474e20a8cf4ce239d06576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 01:58:33.419244 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 01:58:33.466401 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 01:58:33.952298 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:58:33.952298 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:58:33.970807 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Successfully created port: f99ceda9-fad6-4a73-af2a-c63d3d320e2f {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 01:58:34.044946 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:34.455700 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:58:34.616523 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Successfully created port: 407bbd3c-7537-4404-aaf5-a5ed533bb33b {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 01:58:34.940012 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 01:58:34.972895 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.567s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:34.972895 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 01:58:34.984872 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.932s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:34.984872 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 01:58:34.984872 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Claim successful on node np0000001127
May 21 01:58:34.992391 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "64f1cde4-f11a-4da7-8bbc-aaf777432069" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:34.994659 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "64f1cde4-f11a-4da7-8bbc-aaf777432069" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:35.051399 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:35.136179 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:35.431957 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Successfully created port: a350a027-1ffc-4539-a238-d98bbb9baeba {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 01:58:35.447788 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Booting with volume f8b13fac-25c3-40f9-8506-1236b8dc8fd2 at /dev/vda
May 21 01:58:35.485237 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 01:58:35.485237 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 01:58:35.485237 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:35.485237 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:35.496103 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 01:58:35.521654 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:58:35.535655 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 01:58:35.559708 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:35.603619 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 01:58:35.605666 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 01:58:35.613299 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 01:58:35.615715 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe9e:216', 'fe80::14d9:7bff:fe3b:f0dc', 'fe80::fc16:3eff:feef:6106', 'fe80::4f8:d7ff:fe7a:a4fe', 'fe80::fc16:3eff:fee3:f7d2', 'fe80::6c2e:11ff:fea1:7eb7', 'fe80::fc16:3eff:fe30:ade5'] 
May 21 01:58:35.615972 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 01:58:35.616110 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 01:58:35.616515 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] <== get_connector_properties: return (94ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:58:35.616723 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Updating existing volume attachment record: d20fc237-95a7-4337-aaaf-eeced605035f {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 01:58:35.805124 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '44907638a40d4fb4ad9014b58dcd6bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc797708a5a7400992765e41ee6ec260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 01:58:35.988753 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 01:58:36.080554 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:36.150636 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:36.161643 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Successfully created port: 58939f92-ac70-47fb-90c0-5f7bc2421c47 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 01:58:36.495928 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 01:58:36.623547 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:58:36.625461 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:58:36.701544 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0004970729999058676 future=<Future at 0x71c05864d3a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:58:36.702515 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:58:36.702515 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=4.33465940699989 future=<Future at 0x71c07c787da0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:58:36.702515 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=4.334530818999838 future=<Future at 0x71c07c787da0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:58:36.702807 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] Emitting event <LifecycleEvent: 1779328701.7004135, e9664d16-b539-4ccc-abd4-47a8fa944520 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:58:36.702908 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] VM Stopped (Lifecycle Event)
May 21 01:58:36.770089 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Successfully created port: d99a2cf4-260b-4ca3-b72e-7db23358b831 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 01:58:37.128294 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:58:37.206165 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ed44a86e-c4de-480f-8a66-653800b74b17 tempest-VolumesAssistedSnapshotsTest-721813794 tempest-VolumesAssistedSnapshotsTest-721813794-project-member] [instance: e9664d16-b539-4ccc-abd4-47a8fa944520] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:58:37.271743 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Successfully created port: 1ac81609-4fab-4940-9313-6dd7160c7a9b {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 01:58:37.328074 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Booting with volume 5410bf8e-8978-4bf4-b8f9-592be340a6b6 at /dev/vdb
May 21 01:58:37.387775 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:58:37.402809 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 01:58:37.436356 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:37.480375 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 01:58:37.481334 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 01:58:37.490928 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 01:58:37.495577 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe9e:216', 'fe80::14d9:7bff:fe3b:f0dc', 'fe80::fc16:3eff:feef:6106', 'fe80::4f8:d7ff:fe7a:a4fe', 'fe80::fc16:3eff:fee3:f7d2', 'fe80::6c2e:11ff:fea1:7eb7', 'fe80::fc16:3eff:fe30:ade5'] 
May 21 01:58:37.495577 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 01:58:37.495577 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 01:58:37.495577 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:58:37.495577 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Updating existing volume attachment record: 9cf617ac-9cdd-4d6e-af81-c5fe772004b5 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 01:58:37.509405 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 01:58:37.511232 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 01:58:37.511655 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Creating image(s)
May 21 01:58:37.512168 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "/opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:37.512462 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "/opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:37.513048 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "/opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:37.513574 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "0066f00a071b6bfd563ca0d541bc609a816e4ac2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:37.518750 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Successfully updated port: d99a2cf4-260b-4ca3-b72e-7db23358b831 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 01:58:37.522378 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "0066f00a071b6bfd563ca0d541bc609a816e4ac2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.007s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:37.595503 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-49fd76ba-ad8f-43f0-b8fb-b971b7756172 req-ceca94f0-37de-4afb-9fd1-e867d3ef87ee service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Received event network-changed-d99a2cf4-260b-4ca3-b72e-7db23358b831 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:37.596293 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-49fd76ba-ad8f-43f0-b8fb-b971b7756172 req-ceca94f0-37de-4afb-9fd1-e867d3ef87ee service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Refreshing instance network info cache due to event network-changed-d99a2cf4-260b-4ca3-b72e-7db23358b831. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:58:37.596582 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-49fd76ba-ad8f-43f0-b8fb-b971b7756172 req-ceca94f0-37de-4afb-9fd1-e867d3ef87ee service nova] Acquiring lock "refresh_cache-a6839691-a7ec-4dea-bc39-a7e89c94cf4d" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:58:37.597696 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-49fd76ba-ad8f-43f0-b8fb-b971b7756172 req-ceca94f0-37de-4afb-9fd1-e867d3ef87ee service nova] Acquired lock "refresh_cache-a6839691-a7ec-4dea-bc39-a7e89c94cf4d" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:58:37.597696 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-49fd76ba-ad8f-43f0-b8fb-b971b7756172 req-ceca94f0-37de-4afb-9fd1-e867d3ef87ee service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Refreshing network info cache for port d99a2cf4-260b-4ca3-b72e-7db23358b831 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:58:37.635750 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.660s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:37.636663 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.556s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:37.636963 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 01:58:37.642326 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 01:58:37.642504 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Claim successful on node np0000001127
May 21 01:58:38.025129 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "refresh_cache-a6839691-a7ec-4dea-bc39-a7e89c94cf4d" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:58:38.101920 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-49fd76ba-ad8f-43f0-b8fb-b971b7756172 req-ceca94f0-37de-4afb-9fd1-e867d3ef87ee service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:38.151004 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 01:58:38.151530 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 01:58:38.151587 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:38.151888 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:38.207057 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-49fd76ba-ad8f-43f0-b8fb-b971b7756172 req-ceca94f0-37de-4afb-9fd1-e867d3ef87ee service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:58:38.291992 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd5b969d5a514d01bacfc7954a5ae4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83df9a84ffaa4398bdafbfbde079964d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 01:58:38.295581 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Successfully updated port: f99ceda9-fad6-4a73-af2a-c63d3d320e2f {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 01:58:38.363719 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e238e420-cc46-41d7-8519-8a837ef4addc req-20a6b67a-1e27-4968-a0d7-b890a3f90f5f service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-changed-f99ceda9-fad6-4a73-af2a-c63d3d320e2f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:38.363873 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e238e420-cc46-41d7-8519-8a837ef4addc req-20a6b67a-1e27-4968-a0d7-b890a3f90f5f service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Refreshing instance network info cache due to event network-changed-f99ceda9-fad6-4a73-af2a-c63d3d320e2f. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:58:38.364031 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e238e420-cc46-41d7-8519-8a837ef4addc req-20a6b67a-1e27-4968-a0d7-b890a3f90f5f service nova] Acquiring lock "refresh_cache-a4b3355b-92d6-4b36-8dad-6cb4b3c579a2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:58:38.365087 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e238e420-cc46-41d7-8519-8a837ef4addc req-20a6b67a-1e27-4968-a0d7-b890a3f90f5f service nova] Acquired lock "refresh_cache-a4b3355b-92d6-4b36-8dad-6cb4b3c579a2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:58:38.365087 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-e238e420-cc46-41d7-8519-8a837ef4addc req-20a6b67a-1e27-4968-a0d7-b890a3f90f5f service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Refreshing network info cache for port f99ceda9-fad6-4a73-af2a-c63d3d320e2f {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:58:38.377959 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:58:38.387973 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:58:38.387973 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0066f00a071b6bfd563ca0d541bc609a816e4ac2.part --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:38.483002 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-49fd76ba-ad8f-43f0-b8fb-b971b7756172 req-ceca94f0-37de-4afb-9fd1-e867d3ef87ee service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:58:38.499828 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0066f00a071b6bfd563ca0d541bc609a816e4ac2.part --force-share --output=json" returned: 0 in 0.115s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:38.500344 np0000001127 nova-compute[98206]: DEBUG nova.virt.images [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] a377f14f-f022-4902-8291-4e733e0a7be0 was qcow2, converting to raw {{(pid=98206) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 21 01:58:38.503929 np0000001127 nova-compute[98206]: DEBUG nova.privsep.utils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 21 01:58:38.504365 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0066f00a071b6bfd563ca0d541bc609a816e4ac2.part /opt/stack/data/nova/instances/_base/0066f00a071b6bfd563ca0d541bc609a816e4ac2.converted {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:38.536323 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:38.658643 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 01:58:38.868551 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-e238e420-cc46-41d7-8519-8a837ef4addc req-20a6b67a-1e27-4968-a0d7-b890a3f90f5f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:38.962845 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0066f00a071b6bfd563ca0d541bc609a816e4ac2.part /opt/stack/data/nova/instances/_base/0066f00a071b6bfd563ca0d541bc609a816e4ac2.converted" returned: 0 in 0.459s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:38.968664 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0066f00a071b6bfd563ca0d541bc609a816e4ac2.converted --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:38.995912 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-49fd76ba-ad8f-43f0-b8fb-b971b7756172 req-ceca94f0-37de-4afb-9fd1-e867d3ef87ee service nova] Releasing lock "refresh_cache-a6839691-a7ec-4dea-bc39-a7e89c94cf4d" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:58:39.000328 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquired lock "refresh_cache-a6839691-a7ec-4dea-bc39-a7e89c94cf4d" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:58:39.001365 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 01:58:39.041332 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Acquiring lock "800e7287-2ec0-48a2-b959-d7fbcc1f3c10" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:39.041804 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "800e7287-2ec0-48a2-b959-d7fbcc1f3c10" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:39.086030 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0066f00a071b6bfd563ca0d541bc609a816e4ac2.converted --force-share --output=json" returned: 0 in 0.117s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:39.087669 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "0066f00a071b6bfd563ca0d541bc609a816e4ac2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.567s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:39.087669 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:58:39.092161 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Successfully created port: 44670b22-c758-456b-a200-f0323baea57f {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 01:58:39.099852 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:58:39.101737 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0066f00a071b6bfd563ca0d541bc609a816e4ac2 --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:39.143567 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-e238e420-cc46-41d7-8519-8a837ef4addc req-20a6b67a-1e27-4968-a0d7-b890a3f90f5f service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:58:39.166869 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 01:58:39.211280 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0066f00a071b6bfd563ca0d541bc609a816e4ac2 --force-share --output=json" returned: 0 in 0.110s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:39.212698 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "0066f00a071b6bfd563ca0d541bc609a816e4ac2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:39.214661 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "0066f00a071b6bfd563ca0d541bc609a816e4ac2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:39.214661 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:58:39.221234 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:58:39.221234 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0066f00a071b6bfd563ca0d541bc609a816e4ac2 --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:39.248424 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Booting with volume f84e5871-8b85-40d8-af76-554e0f6ce566 at /dev/vdc
May 21 01:58:39.313522 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:58:39.331260 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0066f00a071b6bfd563ca0d541bc609a816e4ac2 --force-share --output=json" returned: 0 in 0.107s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:39.331260 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0066f00a071b6bfd563ca0d541bc609a816e4ac2,backing_fmt=raw /opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:39.331260 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 01:58:39.375671 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:39.402943 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0066f00a071b6bfd563ca0d541bc609a816e4ac2,backing_fmt=raw /opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d/disk 1073741824" returned: 0 in 0.073s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:39.404712 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "0066f00a071b6bfd563ca0d541bc609a816e4ac2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:39.405801 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0066f00a071b6bfd563ca0d541bc609a816e4ac2 --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:39.428293 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 01:58:39.428828 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 01:58:39.441827 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 01:58:39.444278 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe9e:216', 'fe80::14d9:7bff:fe3b:f0dc', 'fe80::fc16:3eff:feef:6106', 'fe80::4f8:d7ff:fe7a:a4fe', 'fe80::fc16:3eff:fee3:f7d2', 'fe80::6c2e:11ff:fea1:7eb7', 'fe80::fc16:3eff:fe30:ade5'] 
May 21 01:58:39.444541 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 01:58:39.444776 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 01:58:39.445147 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:58:39.445817 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Updating existing volume attachment record: 1e1a6ae5-23be-40ad-ab81-c23eaab41435 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 01:58:39.475036 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-e238e420-cc46-41d7-8519-8a837ef4addc req-20a6b67a-1e27-4968-a0d7-b890a3f90f5f service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:58:39.503672 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:58:39.503672 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:58:39.527861 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0066f00a071b6bfd563ca0d541bc609a816e4ac2 --force-share --output=json" returned: 0 in 0.122s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:39.528661 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 01:58:39.528737 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:39.549479 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 01:58:39.618035 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:58:39.636837 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:39.638677 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Cannot resize image /opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 01:58:39.640487 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 01:58:39.640487 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Ensure instance console log exists: /opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 01:58:39.641016 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:39.641336 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:39.641599 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:39.680791 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Booting with blank volume at /dev/vda
May 21 01:58:39.845700 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Successfully updated port: 71580ee4-3192-484a-9ee6-5096ac78a4ce {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 01:58:39.870490 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:39.931352 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-608b3455-36c1-4735-8825-8fa64e77dab2 req-42ebba4b-1387-46b7-a360-8c79cd2f3737 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-changed-71580ee4-3192-484a-9ee6-5096ac78a4ce {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:39.935073 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-608b3455-36c1-4735-8825-8fa64e77dab2 req-42ebba4b-1387-46b7-a360-8c79cd2f3737 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Refreshing instance network info cache due to event network-changed-71580ee4-3192-484a-9ee6-5096ac78a4ce. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:58:39.935073 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-608b3455-36c1-4735-8825-8fa64e77dab2 req-42ebba4b-1387-46b7-a360-8c79cd2f3737 service nova] Acquiring lock "refresh_cache-a4b3355b-92d6-4b36-8dad-6cb4b3c579a2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:58:39.980930 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e238e420-cc46-41d7-8519-8a837ef4addc req-20a6b67a-1e27-4968-a0d7-b890a3f90f5f service nova] Releasing lock "refresh_cache-a4b3355b-92d6-4b36-8dad-6cb4b3c579a2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:58:39.981296 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-608b3455-36c1-4735-8825-8fa64e77dab2 req-42ebba4b-1387-46b7-a360-8c79cd2f3737 service nova] Acquired lock "refresh_cache-a4b3355b-92d6-4b36-8dad-6cb4b3c579a2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:58:39.981480 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-608b3455-36c1-4735-8825-8fa64e77dab2 req-42ebba4b-1387-46b7-a360-8c79cd2f3737 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Refreshing network info cache for port 71580ee4-3192-484a-9ee6-5096ac78a4ce {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:58:40.010161 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:58:40.026643 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Successfully updated port: 44670b22-c758-456b-a200-f0323baea57f {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 01:58:40.053275 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:40.130965 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:40.254875 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Updating instance_info_cache with network_info: [{"id": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "address": "fa:16:3e:76:c8:70", "network": {"id": "7cdbc224-429f-49a6-86f3-307f51e53dfc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2078432126-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc797708a5a7400992765e41ee6ec260", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99a2cf4-26", "ovs_interfaceid": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:58:40.444750 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f0df3ea6-e60c-475e-bf12-6dc5c76b16c1 req-0d1b6690-86cd-4a53-84ea-59c818a01743 service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Received event network-changed-44670b22-c758-456b-a200-f0323baea57f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:40.445406 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f0df3ea6-e60c-475e-bf12-6dc5c76b16c1 req-0d1b6690-86cd-4a53-84ea-59c818a01743 service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Refreshing instance network info cache due to event network-changed-44670b22-c758-456b-a200-f0323baea57f. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:58:40.445406 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f0df3ea6-e60c-475e-bf12-6dc5c76b16c1 req-0d1b6690-86cd-4a53-84ea-59c818a01743 service nova] Acquiring lock "refresh_cache-392bbdc4-beaa-4c44-93f5-3a76f331ceb0" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:58:40.445755 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f0df3ea6-e60c-475e-bf12-6dc5c76b16c1 req-0d1b6690-86cd-4a53-84ea-59c818a01743 service nova] Acquired lock "refresh_cache-392bbdc4-beaa-4c44-93f5-3a76f331ceb0" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:58:40.445755 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-f0df3ea6-e60c-475e-bf12-6dc5c76b16c1 req-0d1b6690-86cd-4a53-84ea-59c818a01743 service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Refreshing network info cache for port 44670b22-c758-456b-a200-f0323baea57f {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:58:40.483803 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-608b3455-36c1-4735-8825-8fa64e77dab2 req-42ebba4b-1387-46b7-a360-8c79cd2f3737 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:40.528566 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "refresh_cache-392bbdc4-beaa-4c44-93f5-3a76f331ceb0" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:58:40.529925 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.893s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:40.530639 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.399s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:40.530863 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 01:58:40.537156 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 01:58:40.537156 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Claim successful on node np0000001127
May 21 01:58:40.649494 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-608b3455-36c1-4735-8825-8fa64e77dab2 req-42ebba4b-1387-46b7-a360-8c79cd2f3737 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:58:40.756776 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Releasing lock "refresh_cache-a6839691-a7ec-4dea-bc39-a7e89c94cf4d" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:58:40.757049 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Instance network_info: |[{"id": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "address": "fa:16:3e:76:c8:70", "network": {"id": "7cdbc224-429f-49a6-86f3-307f51e53dfc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2078432126-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc797708a5a7400992765e41ee6ec260", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99a2cf4-26", "ovs_interfaceid": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 01:58:40.759605 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Start _get_guest_xml network_info=[{"id": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "address": "fa:16:3e:76:c8:70", "network": {"id": "7cdbc224-429f-49a6-86f3-307f51e53dfc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2078432126-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc797708a5a7400992765e41ee6ec260", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99a2cf4-26", "ovs_interfaceid": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:58:24Z,direct_url=<?>,disk_format='qcow2',id=a377f14f-f022-4902-8291-4e733e0a7be0,min_disk=0,min_ram=0,name='tempest-scenario-img--1988823582',owner='dc797708a5a7400992765e41ee6ec260',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:58:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'a377f14f-f022-4902-8291-4e733e0a7be0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 01:58:40.769738 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 01:58:40.771350 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a377f14f-f022-4902-8291-4e733e0a7be0', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-715258350', uuid='a6839691-a7ec-4dea-bc39-a7e89c94cf4d'), owner=OwnerMeta(userid='44907638a40d4fb4ad9014b58dcd6bac', username='tempest-TestMinimumBasicScenario-654915677-project-member', projectid='dc797708a5a7400992765e41ee6ec260', projectname='tempest-TestMinimumBasicScenario-654915677'), image=ImageMeta(id='a377f14f-f022-4902-8291-4e733e0a7be0', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "address": "fa:16:3e:76:c8:70", "network": {"id": "7cdbc224-429f-49a6-86f3-307f51e53dfc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2078432126-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc797708a5a7400992765e41ee6ec260", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99a2cf4-26", "ovs_interfaceid": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328720.770847) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 01:58:40.772640 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 01:58:40.773041 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 01:58:40.776392 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 01:58:40.776661 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 01:58:40.777870 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 01:58:40.778297 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:58:24Z,direct_url=<?>,disk_format='qcow2',id=a377f14f-f022-4902-8291-4e733e0a7be0,min_disk=0,min_ram=0,name='tempest-scenario-img--1988823582',owner='dc797708a5a7400992765e41ee6ec260',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:58:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 01:58:40.778517 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 01:58:40.778659 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 01:58:40.778838 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 01:58:40.778956 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 01:58:40.779120 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 01:58:40.779347 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 01:58:40.779519 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 01:58:40.779677 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 01:58:40.779833 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 01:58:40.780400 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 01:58:40.794841 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T01:58:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-715258350',display_name='tempest-TestMinimumBasicScenario-server-715258350',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testminimumbasicscenario-server-715258350',id=14,image_ref='a377f14f-f022-4902-8291-4e733e0a7be0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXVa1e4OFd0NMMgqm+4/xZwNI5dMebNPDeh14+7JZ91orpoik4qLtCbEUIRp2DSHHVcppNPspElPEIhYTAGUliS3RSE8t15WkhilyCcQF6xleusOu5YpLtoNfQpTRunwg==',key_name='tempest-TestMinimumBasicScenario-2026356756',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc797708a5a7400992765e41ee6ec260',ramdisk_id='',reservation_id='r-qn7g4mne',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a377f14f-f022-4902-8291-4e733e0a7be0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-654915677',owner_user_name='tempest-TestMinimumBasicScenario-654915677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:58:37Z,user_data=None,user_id='44907638a40d4fb4ad9014b58dcd6bac',uuid=a6839691-a7ec-4dea-bc39-a7e89c94cf4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "address": "fa:16:3e:76:c8:70", "network": {"id": "7cdbc224-429f-49a6-86f3-307f51e53dfc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2078432126-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc797708a5a7400992765e41ee6ec260", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99a2cf4-26", "ovs_interfaceid": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 01:58:40.795042 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Converting VIF {"id": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "address": "fa:16:3e:76:c8:70", "network": {"id": "7cdbc224-429f-49a6-86f3-307f51e53dfc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2078432126-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc797708a5a7400992765e41ee6ec260", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99a2cf4-26", "ovs_interfaceid": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:58:40.795735 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:c8:70,bridge_name='br-int',has_traffic_filtering=True,id=d99a2cf4-260b-4ca3-b72e-7db23358b831,network=Network(7cdbc224-429f-49a6-86f3-307f51e53dfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99a2cf4-26') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:58:40.796525 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lazy-loading 'pci_devices' on Instance uuid a6839691-a7ec-4dea-bc39-a7e89c94cf4d {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:58:40.830340 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-608b3455-36c1-4735-8825-8fa64e77dab2 req-42ebba4b-1387-46b7-a360-8c79cd2f3737 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:58:40.948495 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-f0df3ea6-e60c-475e-bf12-6dc5c76b16c1 req-0d1b6690-86cd-4a53-84ea-59c818a01743 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:41.039027 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0020464760000322713 future=<Future at 0x71c07c787da0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:58:41.039027 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:58:41.039931 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Emitting event <LifecycleEvent: 1779328706.0367823, 0059a43c-1d34-40a9-af63-b5eca8c30f53 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:58:41.039931 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] VM Stopped (Lifecycle Event)
May 21 01:58:41.055055 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 01:58:41.055055 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 01:58:41.058297 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:41.058297 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:41.060544 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-f0df3ea6-e60c-475e-bf12-6dc5c76b16c1 req-0d1b6690-86cd-4a53-84ea-59c818a01743 service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:58:41.120814 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Successfully updated port: 9e74661c-8435-43a4-82d7-b7d757552d24 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 01:58:41.154868 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:41.169818 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd91dda570ffb45489f81bd0c87e7fda6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e41dd931ff049868a61f52a251d1122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 01:58:41.200399 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d234b206-3a4f-4e90-85b7-97b8e7c658d3 req-b2c0ddb3-4b22-4d34-a526-98018c6a30ac service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-changed-9e74661c-8435-43a4-82d7-b7d757552d24 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:41.200549 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d234b206-3a4f-4e90-85b7-97b8e7c658d3 req-b2c0ddb3-4b22-4d34-a526-98018c6a30ac service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Refreshing instance network info cache due to event network-changed-9e74661c-8435-43a4-82d7-b7d757552d24. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:58:41.200685 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d234b206-3a4f-4e90-85b7-97b8e7c658d3 req-b2c0ddb3-4b22-4d34-a526-98018c6a30ac service nova] Acquiring lock "refresh_cache-a4b3355b-92d6-4b36-8dad-6cb4b3c579a2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:58:41.250676 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-f0df3ea6-e60c-475e-bf12-6dc5c76b16c1 req-0d1b6690-86cd-4a53-84ea-59c818a01743 service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:58:41.301357 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] End _get_guest_xml xml=<domain type="qemu">
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:   <uuid>a6839691-a7ec-4dea-bc39-a7e89c94cf4d</uuid>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:   <name>instance-0000000e</name>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:   <metadata>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:       <nova:name>tempest-TestMinimumBasicScenario-server-715258350</nova:name>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 01:58:40</nova:creationTime>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:       <nova:image uuid="a377f14f-f022-4902-8291-4e733e0a7be0">
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:         <nova:properties/>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:       </nova:image>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:         <nova:user uuid="44907638a40d4fb4ad9014b58dcd6bac">tempest-TestMinimumBasicScenario-654915677-project-member</nova:user>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:         <nova:project uuid="dc797708a5a7400992765e41ee6ec260">tempest-TestMinimumBasicScenario-654915677</nova:project>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="a377f14f-f022-4902-8291-4e733e0a7be0"/>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:         <nova:port uuid="d99a2cf4-260b-4ca3-b72e-7db23358b831">
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:         </nova:port>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:   </metadata>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:     <system>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:       <entry name="serial">a6839691-a7ec-4dea-bc39-a7e89c94cf4d</entry>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:       <entry name="uuid">a6839691-a7ec-4dea-bc39-a7e89c94cf4d</entry>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:     </system>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:   <os>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:   </os>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:   <features>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:     <acpi/>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:     <tcg>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:     </tcg>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:   </features>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:   <devices>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d/disk"/>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:     </disk>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d/disk.config"/>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:     </disk>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:76:c8:70"/>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:       <target dev="tapd99a2cf4-26"/>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:     </interface>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d/console.log" append="off"/>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:     </serial>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:     <video>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:     </video>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:     </rng>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:     </memballoon>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:   </devices>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]: </domain>
May 21 01:58:41.301357 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 01:58:41.301357 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Preparing to wait for external event network-vif-plugged-d99a2cf4-260b-4ca3-b72e-7db23358b831 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 01:58:41.301357 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:41.301357 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:41.301357 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:41.301357 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T01:58:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-715258350',display_name='tempest-TestMinimumBasicScenario-server-715258350',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testminimumbasicscenario-server-715258350',id=14,image_ref='a377f14f-f022-4902-8291-4e733e0a7be0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXVa1e4OFd0NMMgqm+4/xZwNI5dMebNPDeh14+7JZ91orpoik4qLtCbEUIRp2DSHHVcppNPspElPEIhYTAGUliS3RSE8t15WkhilyCcQF6xleusOu5YpLtoNfQpTRunwg==',key_name='tempest-TestMinimumBasicScenario-2026356756',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc797708a5a7400992765e41ee6ec260',ramdisk_id='',reservation_id='r-qn7g4mne',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a377f14f-f022-4902-8291-4e733e0a7be0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-654915677',owner_user_name='tempest-TestMinimumBasicScenario-654915677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:58:37Z,user_data=None,user_id='44907638a40d4fb4ad9014b58dcd6bac',uuid=a6839691-a7ec-4dea-bc39-a7e89c94cf4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "address": "fa:16:3e:76:c8:70", "network": {"id": "7cdbc224-429f-49a6-86f3-307f51e53dfc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2078432126-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc797708a5a7400992765e41ee6ec260", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99a2cf4-26", "ovs_interfaceid": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 01:58:41.301357 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Converting VIF {"id": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "address": "fa:16:3e:76:c8:70", "network": {"id": "7cdbc224-429f-49a6-86f3-307f51e53dfc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2078432126-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc797708a5a7400992765e41ee6ec260", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99a2cf4-26", "ovs_interfaceid": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:58:41.301357 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:c8:70,bridge_name='br-int',has_traffic_filtering=True,id=d99a2cf4-260b-4ca3-b72e-7db23358b831,network=Network(7cdbc224-429f-49a6-86f3-307f51e53dfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99a2cf4-26') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:58:41.301357 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:c8:70,bridge_name='br-int',has_traffic_filtering=True,id=d99a2cf4-260b-4ca3-b72e-7db23358b831,network=Network(7cdbc224-429f-49a6-86f3-307f51e53dfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99a2cf4-26') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 01:58:41.303701 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:41.303701 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:41.303701 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 01:58:41.305291 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:41.305510 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '34f809f1-1dc2-5916-8c0a-12196e2c4c00', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:41.306204 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:41.306826 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:58:41.307197 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:41.308904 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:41.309047 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd99a2cf4-26, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:41.309324 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd99a2cf4-26, col_values=(('qos', UUID('afa027c8-8806-4f58-b432-4715b574108e')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:41.309480 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd99a2cf4-26, col_values=(('external_ids', {'iface-id': 'd99a2cf4-260b-4ca3-b72e-7db23358b831', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:c8:70', 'vm-uuid': 'a6839691-a7ec-4dea-bc39-a7e89c94cf4d'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:41.310140 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:41.311121 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:58:41.315883 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:41.317411 np0000001127 nova-compute[98206]: INFO os_vif [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:c8:70,bridge_name='br-int',has_traffic_filtering=True,id=d99a2cf4-260b-4ca3-b72e-7db23358b831,network=Network(7cdbc224-429f-49a6-86f3-307f51e53dfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99a2cf4-26')
May 21 01:58:41.331397 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-608b3455-36c1-4735-8825-8fa64e77dab2 req-42ebba4b-1387-46b7-a360-8c79cd2f3737 service nova] Releasing lock "refresh_cache-a4b3355b-92d6-4b36-8dad-6cb4b3c579a2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:58:41.332690 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d234b206-3a4f-4e90-85b7-97b8e7c658d3 req-b2c0ddb3-4b22-4d34-a526-98018c6a30ac service nova] Acquired lock "refresh_cache-a4b3355b-92d6-4b36-8dad-6cb4b3c579a2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:58:41.333505 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-d234b206-3a4f-4e90-85b7-97b8e7c658d3 req-b2c0ddb3-4b22-4d34-a526-98018c6a30ac service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Refreshing network info cache for port 9e74661c-8435-43a4-82d7-b7d757552d24 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:58:41.552335 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:58:41.552771 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.12 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 01:58:41.554759 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ea864c47-f158-4eba-983e-797ec06255af tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 0059a43c-1d34-40a9-af63-b5eca8c30f53] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:58:41.560759 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 01:58:41.648626 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 01:58:41.649309 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 01:58:41.649654 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Creating image(s)
May 21 01:58:41.650038 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Did not create local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 21 01:58:41.650274 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Ensure instance console log exists: /opt/stack/data/nova/instances/a4b3355b-92d6-4b36-8dad-6cb4b3c579a2/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 01:58:41.650585 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:41.650828 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:41.651115 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:41.755505 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f0df3ea6-e60c-475e-bf12-6dc5c76b16c1 req-0d1b6690-86cd-4a53-84ea-59c818a01743 service nova] Releasing lock "refresh_cache-392bbdc4-beaa-4c44-93f5-3a76f331ceb0" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:58:41.755665 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquired lock "refresh_cache-392bbdc4-beaa-4c44-93f5-3a76f331ceb0" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:58:41.757105 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 01:58:41.837506 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-d234b206-3a4f-4e90-85b7-97b8e7c658d3 req-b2c0ddb3-4b22-4d34-a526-98018c6a30ac service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:41.871933 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Successfully created port: 3b1f76f9-cf49-4dea-b9a2-762c2ad220bf {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 01:58:41.968175 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-d234b206-3a4f-4e90-85b7-97b8e7c658d3 req-b2c0ddb3-4b22-4d34-a526-98018c6a30ac service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:58:42.068668 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 01:58:42.168559 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-d234b206-3a4f-4e90-85b7-97b8e7c658d3 req-b2c0ddb3-4b22-4d34-a526-98018c6a30ac service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:58:42.210949 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:58:42.211120 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:58:42.222098 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Successfully updated port: 407bbd3c-7537-4404-aaf5-a5ed533bb33b {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 01:58:42.322431 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:58:42.494569 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:42.517003 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f25e2d19-c64f-436d-81e8-453232248f73 req-2375898e-8484-431f-918f-599787c9d7d6 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-changed-407bbd3c-7537-4404-aaf5-a5ed533bb33b {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:42.517392 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f25e2d19-c64f-436d-81e8-453232248f73 req-2375898e-8484-431f-918f-599787c9d7d6 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Refreshing instance network info cache due to event network-changed-407bbd3c-7537-4404-aaf5-a5ed533bb33b. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:58:42.517583 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f25e2d19-c64f-436d-81e8-453232248f73 req-2375898e-8484-431f-918f-599787c9d7d6 service nova] Acquiring lock "refresh_cache-a4b3355b-92d6-4b36-8dad-6cb4b3c579a2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:58:42.542217 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Successfully updated port: 3b1f76f9-cf49-4dea-b9a2-762c2ad220bf {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 01:58:42.621971 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a09bcceb-96ab-4bc7-822a-5c21cf445268 req-47a5f274-e390-42bc-9e26-727df586f673 service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Received event network-changed-3b1f76f9-cf49-4dea-b9a2-762c2ad220bf {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:42.622161 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a09bcceb-96ab-4bc7-822a-5c21cf445268 req-47a5f274-e390-42bc-9e26-727df586f673 service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Refreshing instance network info cache due to event network-changed-3b1f76f9-cf49-4dea-b9a2-762c2ad220bf. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:58:42.623409 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a09bcceb-96ab-4bc7-822a-5c21cf445268 req-47a5f274-e390-42bc-9e26-727df586f673 service nova] Acquiring lock "refresh_cache-64f1cde4-f11a-4da7-8bbc-aaf777432069" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:58:42.623409 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a09bcceb-96ab-4bc7-822a-5c21cf445268 req-47a5f274-e390-42bc-9e26-727df586f673 service nova] Acquired lock "refresh_cache-64f1cde4-f11a-4da7-8bbc-aaf777432069" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:58:42.623409 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-a09bcceb-96ab-4bc7-822a-5c21cf445268 req-47a5f274-e390-42bc-9e26-727df586f673 service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Refreshing network info cache for port 3b1f76f9-cf49-4dea-b9a2-762c2ad220bf {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:58:42.670394 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d234b206-3a4f-4e90-85b7-97b8e7c658d3 req-b2c0ddb3-4b22-4d34-a526-98018c6a30ac service nova] Releasing lock "refresh_cache-a4b3355b-92d6-4b36-8dad-6cb4b3c579a2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:58:42.671493 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f25e2d19-c64f-436d-81e8-453232248f73 req-2375898e-8484-431f-918f-599787c9d7d6 service nova] Acquired lock "refresh_cache-a4b3355b-92d6-4b36-8dad-6cb4b3c579a2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:58:42.671707 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-f25e2d19-c64f-436d-81e8-453232248f73 req-2375898e-8484-431f-918f-599787c9d7d6 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Refreshing network info cache for port 407bbd3c-7537-4404-aaf5-a5ed533bb33b {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:58:42.676387 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:58:42.676847 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:58:42.677012 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 21 01:58:42.677304 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 01:58:42.699605 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Updating instance_info_cache with network_info: [{"id": "44670b22-c758-456b-a200-f0323baea57f", "address": "fa:16:3e:50:bf:d8", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap44670b22-c7", "ovs_interfaceid": "44670b22-c758-456b-a200-f0323baea57f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:58:42.714539 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:58:42.837412 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:58:42.837646 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:58:42.837810 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] No VIF found with MAC fa:16:3e:76:c8:70, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 01:58:42.838287 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Using config drive
May 21 01:58:43.045806 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "refresh_cache-64f1cde4-f11a-4da7-8bbc-aaf777432069" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:58:43.080077 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 01:58:43.081116 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 01:58:43.081407 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Creating image(s)
May 21 01:58:43.081909 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "/opt/stack/data/nova/instances/64f1cde4-f11a-4da7-8bbc-aaf777432069/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:43.082130 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "/opt/stack/data/nova/instances/64f1cde4-f11a-4da7-8bbc-aaf777432069/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:43.082738 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "/opt/stack/data/nova/instances/64f1cde4-f11a-4da7-8bbc-aaf777432069/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:43.083336 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:58:43.089849 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:58:43.089849 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:43.126461 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-a09bcceb-96ab-4bc7-822a-5c21cf445268 req-47a5f274-e390-42bc-9e26-727df586f673 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:43.168865 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.079s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:43.169431 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:43.170005 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:43.171612 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:58:43.175988 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-f25e2d19-c64f-436d-81e8-453232248f73 req-2375898e-8484-431f-918f-599787c9d7d6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:43.178975 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:58:43.181818 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:43.211032 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-a09bcceb-96ab-4bc7-822a-5c21cf445268 req-47a5f274-e390-42bc-9e26-727df586f673 service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:58:43.215000 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Releasing lock "refresh_cache-392bbdc4-beaa-4c44-93f5-3a76f331ceb0" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:58:43.215614 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Instance network_info: |[{"id": "44670b22-c758-456b-a200-f0323baea57f", "address": "fa:16:3e:50:bf:d8", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap44670b22-c7", "ovs_interfaceid": "44670b22-c758-456b-a200-f0323baea57f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 01:58:43.223219 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.694s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:43.223888 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 01:58:43.281091 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.099s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:43.281612 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/64f1cde4-f11a-4da7-8bbc-aaf777432069/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:43.326323 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-f25e2d19-c64f-436d-81e8-453232248f73 req-2375898e-8484-431f-918f-599787c9d7d6 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:58:43.335801 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Successfully updated port: a350a027-1ffc-4539-a238-d98bbb9baeba {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 01:58:43.346213 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:43.349830 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/64f1cde4-f11a-4da7-8bbc-aaf777432069/disk 1073741824" returned: 0 in 0.068s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:43.350942 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.181s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:43.351295 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:43.438547 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.087s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:43.438816 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Checking if we can resize image /opt/stack/data/nova/instances/64f1cde4-f11a-4da7-8bbc-aaf777432069/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 01:58:43.439051 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64f1cde4-f11a-4da7-8bbc-aaf777432069/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:43.457498 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:58:43.470703 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-a09bcceb-96ab-4bc7-822a-5c21cf445268 req-47a5f274-e390-42bc-9e26-727df586f673 service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:58:43.485502 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 01:58:43.513540 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:43.532002 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64f1cde4-f11a-4da7-8bbc-aaf777432069/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:43.534318 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Cannot resize image /opt/stack/data/nova/instances/64f1cde4-f11a-4da7-8bbc-aaf777432069/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 01:58:43.534318 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 01:58:43.535498 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Ensure instance console log exists: /opt/stack/data/nova/instances/64f1cde4-f11a-4da7-8bbc-aaf777432069/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 01:58:43.535498 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:43.536059 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:43.536305 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:43.552049 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 01:58:43.552404 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 01:58:43.557543 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-f25e2d19-c64f-436d-81e8-453232248f73 req-2375898e-8484-431f-918f-599787c9d7d6 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:58:43.564016 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 01:58:43.566138 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe9e:216', 'fe80::14d9:7bff:fe3b:f0dc', 'fe80::fc16:3eff:feef:6106', 'fe80::4f8:d7ff:fe7a:a4fe', 'fe80::fc16:3eff:fee3:f7d2', 'fe80::6c2e:11ff:fea1:7eb7', 'fe80::fc16:3eff:fe30:ade5'] 
May 21 01:58:43.567242 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 01:58:43.568705 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 01:58:43.569270 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:58:43.569556 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Updating existing volume attachment record: 3df2ec60-1443-4dba-a5db-af1a028c7cf1 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 01:58:43.581434 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Creating config drive at /opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d/disk.config
May 21 01:58:43.589644 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpuwh0e8kq {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:43.650527 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpuwh0e8kq" returned: 0 in 0.061s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:43.676260 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:58:43.676853 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:58:43.739766 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 01:58:43.740174 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 01:58:43.740670 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:43.740921 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:43.881748 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '457854a2cf2844b8b693d835d2c9b699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a80dd2c84334f79afe5cb079c50c555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 01:58:43.980743 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a09bcceb-96ab-4bc7-822a-5c21cf445268 req-47a5f274-e390-42bc-9e26-727df586f673 service nova] Releasing lock "refresh_cache-64f1cde4-f11a-4da7-8bbc-aaf777432069" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:58:43.982219 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquired lock "refresh_cache-64f1cde4-f11a-4da7-8bbc-aaf777432069" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:58:43.983545 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 01:58:44.060456 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f25e2d19-c64f-436d-81e8-453232248f73 req-2375898e-8484-431f-918f-599787c9d7d6 service nova] Releasing lock "refresh_cache-a4b3355b-92d6-4b36-8dad-6cb4b3c579a2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:58:44.151516 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:44.188952 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:44.188952 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:44.189427 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:44.189617 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Auditing locally available compute resources for np0000001127 (node: np0000001127) {{(pid=98206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 21 01:58:44.192783 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:44.248643 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 01:58:44.278249 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:44.550231 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:44.550702 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:44.562536 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:44.562536 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:44.578367 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:58:44.589102 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:44.608985 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-fbc53501-2d5d-4dc0-addd-0371b013cfa9 req-538ceb94-ec63-4c4b-9157-b4e06a8ef3f5 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-changed-a350a027-1ffc-4539-a238-d98bbb9baeba {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:44.609163 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-fbc53501-2d5d-4dc0-addd-0371b013cfa9 req-538ceb94-ec63-4c4b-9157-b4e06a8ef3f5 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Refreshing instance network info cache due to event network-changed-a350a027-1ffc-4539-a238-d98bbb9baeba. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:58:44.609343 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fbc53501-2d5d-4dc0-addd-0371b013cfa9 req-538ceb94-ec63-4c4b-9157-b4e06a8ef3f5 service nova] Acquiring lock "refresh_cache-a4b3355b-92d6-4b36-8dad-6cb4b3c579a2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:58:44.609841 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fbc53501-2d5d-4dc0-addd-0371b013cfa9 req-538ceb94-ec63-4c4b-9157-b4e06a8ef3f5 service nova] Acquired lock "refresh_cache-a4b3355b-92d6-4b36-8dad-6cb4b3c579a2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:58:44.610011 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-fbc53501-2d5d-4dc0-addd-0371b013cfa9 req-538ceb94-ec63-4c4b-9157-b4e06a8ef3f5 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Refreshing network info cache for port a350a027-1ffc-4539-a238-d98bbb9baeba {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:58:44.633301 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Successfully updated port: 58939f92-ac70-47fb-90c0-5f7bc2421c47 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 01:58:44.689267 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bfeebd17-b732-4796-be0f-46fe2aa3f2b2 req-fe590179-338c-4aa2-9f20-12a17f3166bd service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-changed-58939f92-ac70-47fb-90c0-5f7bc2421c47 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:44.691702 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bfeebd17-b732-4796-be0f-46fe2aa3f2b2 req-fe590179-338c-4aa2-9f20-12a17f3166bd service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Refreshing instance network info cache due to event network-changed-58939f92-ac70-47fb-90c0-5f7bc2421c47. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:58:44.691702 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bfeebd17-b732-4796-be0f-46fe2aa3f2b2 req-fe590179-338c-4aa2-9f20-12a17f3166bd service nova] Acquiring lock "refresh_cache-a4b3355b-92d6-4b36-8dad-6cb4b3c579a2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:58:44.751631 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 01:58:44.798599 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:44.930868 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Successfully created port: 23851da2-f984-4946-af6d-2b652ff984e1 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 01:58:44.982746 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Updating instance_info_cache with network_info: [{"id": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "address": "fa:16:3e:12:66:8e", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1f76f9-cf", "ovs_interfaceid": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:58:45.112431 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-fbc53501-2d5d-4dc0-addd-0371b013cfa9 req-538ceb94-ec63-4c4b-9157-b4e06a8ef3f5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:45.234601 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328725.234122, a6839691-a7ec-4dea-bc39-a7e89c94cf4d => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:58:45.234881 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] VM Started (Lifecycle Event)
May 21 01:58:45.239496 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-fbc53501-2d5d-4dc0-addd-0371b013cfa9 req-538ceb94-ec63-4c4b-9157-b4e06a8ef3f5 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:58:45.388479 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8921842-2161-4ddf-b3c4-b642fc51a70f/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:45.486633 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Releasing lock "refresh_cache-64f1cde4-f11a-4da7-8bbc-aaf777432069" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:58:45.487146 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Instance network_info: |[{"id": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "address": "fa:16:3e:12:66:8e", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1f76f9-cf", "ovs_interfaceid": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 01:58:45.492195 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Start _get_guest_xml network_info=[{"id": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "address": "fa:16:3e:12:66:8e", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1f76f9-cf", "ovs_interfaceid": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 01:58:45.492195 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8921842-2161-4ddf-b3c4-b642fc51a70f/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:45.492758 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8921842-2161-4ddf-b3c4-b642fc51a70f/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:45.513342 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 01:58:45.518538 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-826846662', uuid='64f1cde4-f11a-4da7-8bbc-aaf777432069'), owner=OwnerMeta(userid='d91dda570ffb45489f81bd0c87e7fda6', username='tempest-AttachVolumeShelveTestJSON-826866539-project-member', projectid='2e41dd931ff049868a61f52a251d1122', projectname='tempest-AttachVolumeShelveTestJSON-826866539'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "address": "fa:16:3e:12:66:8e", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1f76f9-cf", "ovs_interfaceid": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328725.5167532) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 01:58:45.524090 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 01:58:45.524090 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 01:58:45.526322 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 01:58:45.526322 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 01:58:45.527777 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 01:58:45.528694 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 01:58:45.529149 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 01:58:45.531132 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 01:58:45.531132 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 01:58:45.531132 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 01:58:45.531132 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 01:58:45.531845 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 01:58:45.531845 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 01:58:45.534510 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 01:58:45.537495 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 01:58:45.537495 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 01:58:45.551947 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T01:58:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-826846662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumeshelvetestjson-server-826846662',id=16,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKP9TmPgal987nAj8h88D1Bmcj2I422T9n2Tj8WjCd1Om2bcKH0baNEdUw3HbpQOVs38hbin/FqToAhhAhLP26z0i0oQr4Z8Ka0Fy18AshY/UNiFwP9hn8pglGsErkHX4w==',key_name='tempest-keypair-1059394299',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e41dd931ff049868a61f52a251d1122',ramdisk_id='',reservation_id='r-fbiukq5r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-826866539',owner_user_name='tempest-AttachVolumeShelveTestJSON-826866539-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:58:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d91dda570ffb45489f81bd0c87e7fda6',uuid=64f1cde4-f11a-4da7-8bbc-aaf777432069,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "address": "fa:16:3e:12:66:8e", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1f76f9-cf", "ovs_interfaceid": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 01:58:45.553047 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Converting VIF {"id": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "address": "fa:16:3e:12:66:8e", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1f76f9-cf", "ovs_interfaceid": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:58:45.554095 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:66:8e,bridge_name='br-int',has_traffic_filtering=True,id=3b1f76f9-cf49-4dea-b9a2-762c2ad220bf,network=Network(084a1218-5c9f-4f1e-855b-53d284a5202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b1f76f9-cf') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:58:45.554852 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lazy-loading 'pci_devices' on Instance uuid 64f1cde4-f11a-4da7-8bbc-aaf777432069 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:58:45.563344 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Successfully updated port: 23851da2-f984-4946-af6d-2b652ff984e1 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 01:58:45.591262 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8921842-2161-4ddf-b3c4-b642fc51a70f/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:45.593698 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:45.621024 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-fbc53501-2d5d-4dc0-addd-0371b013cfa9 req-538ceb94-ec63-4c4b-9157-b4e06a8ef3f5 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:58:45.691089 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:45.693517 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:45.742795 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:58:45.745057 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328725.744683, a6839691-a7ec-4dea-bc39-a7e89c94cf4d => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:58:45.745271 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] VM Paused (Lifecycle Event)
May 21 01:58:45.766548 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 01:58:45.768111 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 01:58:45.768422 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Creating image(s)
May 21 01:58:45.769338 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Acquiring lock "/opt/stack/data/nova/instances/800e7287-2ec0-48a2-b959-d7fbcc1f3c10/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:45.769607 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "/opt/stack/data/nova/instances/800e7287-2ec0-48a2-b959-d7fbcc1f3c10/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:45.773084 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "/opt/stack/data/nova/instances/800e7287-2ec0-48a2-b959-d7fbcc1f3c10/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:45.774097 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:58:45.777890 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:58:45.781116 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 01:58:45.782845 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 01:58:45.783584 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:45.783762 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Creating image(s)
May 21 01:58:45.784140 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Did not create local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 21 01:58:45.799251 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Ensure instance console log exists: /opt/stack/data/nova/instances/392bbdc4-beaa-4c44-93f5-3a76f331ceb0/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 01:58:45.799876 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:45.800347 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:45.800757 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:45.800952 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:45.805495 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Start _get_guest_xml network_info=[{"id": "44670b22-c758-456b-a200-f0323baea57f", "address": "fa:16:3e:50:bf:d8", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap44670b22-c7", "ovs_interfaceid": "44670b22-c758-456b-a200-f0323baea57f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '69f8ed84-393f-414e-9868-ac8c3126b175', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '392bbdc4-beaa-4c44-93f5-3a76f331ceb0', 'attached_at': '', 'detached_at': '', 'volume_id': '69f8ed84-393f-414e-9868-ac8c3126b175', 'serial': '69f8ed84-393f-414e-9868-ac8c3126b175'}, 'delete_on_termination': True, 'attachment_id': '3df2ec60-1443-4dba-a5db-af1a028c7cf1', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 01:58:45.814158 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:45.831248 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 01:58:45.835676 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1558814074', uuid='392bbdc4-beaa-4c44-93f5-3a76f331ceb0'), owner=OwnerMeta(userid='bd5b969d5a514d01bacfc7954a5ae4ab', username='tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member', projectid='83df9a84ffaa4398bdafbfbde079964d', projectname='tempest-ServerBootFromVolumeStableRescueTest-260444396'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "44670b22-c758-456b-a200-f0323baea57f", "address": "fa:16:3e:50:bf:d8", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap44670b22-c7", "ovs_interfaceid": "44670b22-c758-456b-a200-f0323baea57f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328725.8327749) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 01:58:45.839892 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 01:58:45.840384 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 01:58:45.841170 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 01:58:45.841424 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 01:58:45.842846 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 01:58:45.845134 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 01:58:45.845134 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 01:58:45.845134 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 01:58:45.845134 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 01:58:45.845134 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 01:58:45.845134 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 01:58:45.845134 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 01:58:45.845134 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 01:58:45.845134 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 01:58:45.845134 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 01:58:45.845134 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 01:58:45.855323 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 01:58:45.855752 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '69f8ed84-393f-414e-9868-ac8c3126b175', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:58:45.855944 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:58:45.856389 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:58:45.856633 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '69f8ed84-393f-414e-9868-ac8c3126b175', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 01:58:45.868422 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:58:45.869263 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:58:45.870044 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:58:45.870340 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:58:45.870892 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:58:45.871208 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:58:45.886078 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.103s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:45.886658 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:45.887501 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 01:58:45.887501 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:45.891626 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:45.891626 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:58:45.902243 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:58:45.907703 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 01:58:45.907703 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:45.910602 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:45.910602 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Successfully updated port: 1ac81609-4fab-4940-9313-6dd7160c7a9b {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 01:58:45.911453 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175] added
May 21 01:58:45.911453 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 01:58:45.911453 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:58:45.911453 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:58:45.911453 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:58:45.911453 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:58:45.911453 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:45.911704 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 01:58:45.912298 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0411(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 01:58:45.912522 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 01:58:45.914377 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:45.928463 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:45.945628 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175] added
May 21 01:58:45.945628 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 01:58:45.945628 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:58:45.945628 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:58:45.945628 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:58:45.945628 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:58:45.945628 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:45.945628 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 01:58:45.945628 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0726(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 01:58:45.945628 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 01:58:46.005522 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.100s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:46.005938 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/800e7287-2ec0-48a2-b959-d7fbcc1f3c10/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:46.020225 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:46.022416 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 01:58:46.034305 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d75ff65-b688-4387-89e3-70567e569682/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:46.065996 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] End _get_guest_xml xml=<domain type="qemu">
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:   <uuid>64f1cde4-f11a-4da7-8bbc-aaf777432069</uuid>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:   <name>instance-00000010</name>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:   <metadata>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-826846662</nova:name>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 01:58:45</nova:creationTime>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:       </nova:image>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:         <nova:user uuid="d91dda570ffb45489f81bd0c87e7fda6">tempest-AttachVolumeShelveTestJSON-826866539-project-member</nova:user>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:         <nova:project uuid="2e41dd931ff049868a61f52a251d1122">tempest-AttachVolumeShelveTestJSON-826866539</nova:project>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:         <nova:port uuid="3b1f76f9-cf49-4dea-b9a2-762c2ad220bf">
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:         </nova:port>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:   </metadata>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:     <system>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:       <entry name="serial">64f1cde4-f11a-4da7-8bbc-aaf777432069</entry>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:       <entry name="uuid">64f1cde4-f11a-4da7-8bbc-aaf777432069</entry>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:     </system>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:   <os>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:   </os>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:   <features>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:     <acpi/>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:     <tcg>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:     </tcg>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:   </features>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:   <devices>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/64f1cde4-f11a-4da7-8bbc-aaf777432069/disk"/>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:     </disk>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/64f1cde4-f11a-4da7-8bbc-aaf777432069/disk.config"/>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:     </disk>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:12:66:8e"/>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:       <target dev="tap3b1f76f9-cf"/>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:     </interface>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/64f1cde4-f11a-4da7-8bbc-aaf777432069/console.log" append="off"/>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:     </serial>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:     <video>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:     </video>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:     </rng>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:     </memballoon>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:   </devices>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]: </domain>
May 21 01:58:46.065996 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 01:58:46.068585 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Preparing to wait for external event network-vif-plugged-3b1f76f9-cf49-4dea-b9a2-762c2ad220bf {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 01:58:46.068585 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "64f1cde4-f11a-4da7-8bbc-aaf777432069-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:46.068585 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "64f1cde4-f11a-4da7-8bbc-aaf777432069-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:46.068585 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "64f1cde4-f11a-4da7-8bbc-aaf777432069-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:46.068900 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T01:58:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-826846662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumeshelvetestjson-server-826846662',id=16,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKP9TmPgal987nAj8h88D1Bmcj2I422T9n2Tj8WjCd1Om2bcKH0baNEdUw3HbpQOVs38hbin/FqToAhhAhLP26z0i0oQr4Z8Ka0Fy18AshY/UNiFwP9hn8pglGsErkHX4w==',key_name='tempest-keypair-1059394299',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e41dd931ff049868a61f52a251d1122',ramdisk_id='',reservation_id='r-fbiukq5r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-826866539',owner_user_name='tempest-AttachVolumeShelveTestJSON-826866539-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:58:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d91dda570ffb45489f81bd0c87e7fda6',uuid=64f1cde4-f11a-4da7-8bbc-aaf777432069,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "address": "fa:16:3e:12:66:8e", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1f76f9-cf", "ovs_interfaceid": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 01:58:46.072496 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Converting VIF {"id": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "address": "fa:16:3e:12:66:8e", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1f76f9-cf", "ovs_interfaceid": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:58:46.072496 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:66:8e,bridge_name='br-int',has_traffic_filtering=True,id=3b1f76f9-cf49-4dea-b9a2-762c2ad220bf,network=Network(084a1218-5c9f-4f1e-855b-53d284a5202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b1f76f9-cf') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:58:46.072496 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:66:8e,bridge_name='br-int',has_traffic_filtering=True,id=3b1f76f9-cf49-4dea-b9a2-762c2ad220bf,network=Network(084a1218-5c9f-4f1e-855b-53d284a5202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b1f76f9-cf') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 01:58:46.072496 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Acquiring lock "refresh_cache-800e7287-2ec0-48a2-b959-d7fbcc1f3c10" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:58:46.072496 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Acquired lock "refresh_cache-800e7287-2ec0-48a2-b959-d7fbcc1f3c10" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:58:46.072496 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 01:58:46.073091 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:46.073533 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:46.074890 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 01:58:46.076679 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:46.076858 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '08838d51-66a8-5094-828a-862c95438ce3', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:46.077712 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:46.078509 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:58:46.079513 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:46.082803 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:46.083114 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b1f76f9-cf, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:46.083862 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/800e7287-2ec0-48a2-b959-d7fbcc1f3c10/disk 1073741824" returned: 0 in 0.077s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:46.083960 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3b1f76f9-cf, col_values=(('qos', UUID('70cb1497-9eab-43ff-a98d-b3d134b69a7b')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:46.084647 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:46.085264 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3b1f76f9-cf, col_values=(('external_ids', {'iface-id': '3b1f76f9-cf49-4dea-b9a2-762c2ad220bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:66:8e', 'vm-uuid': '64f1cde4-f11a-4da7-8bbc-aaf777432069'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:46.086037 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:46.087959 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:58:46.100654 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:46.105938 np0000001127 nova-compute[98206]: INFO os_vif [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:66:8e,bridge_name='br-int',has_traffic_filtering=True,id=3b1f76f9-cf49-4dea-b9a2-762c2ad220bf,network=Network(084a1218-5c9f-4f1e-855b-53d284a5202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b1f76f9-cf')
May 21 01:58:46.125986 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fbc53501-2d5d-4dc0-addd-0371b013cfa9 req-538ceb94-ec63-4c4b-9157-b4e06a8ef3f5 service nova] Releasing lock "refresh_cache-a4b3355b-92d6-4b36-8dad-6cb4b3c579a2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:58:46.126267 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-fbc53501-2d5d-4dc0-addd-0371b013cfa9 req-538ceb94-ec63-4c4b-9157-b4e06a8ef3f5 service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Received event network-vif-plugged-d99a2cf4-260b-4ca3-b72e-7db23358b831 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:46.126528 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fbc53501-2d5d-4dc0-addd-0371b013cfa9 req-538ceb94-ec63-4c4b-9157-b4e06a8ef3f5 service nova] Acquiring lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:46.126815 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fbc53501-2d5d-4dc0-addd-0371b013cfa9 req-538ceb94-ec63-4c4b-9157-b4e06a8ef3f5 service nova] Lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:46.130641 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bfeebd17-b732-4796-be0f-46fe2aa3f2b2 req-fe590179-338c-4aa2-9f20-12a17f3166bd service nova] Acquired lock "refresh_cache-a4b3355b-92d6-4b36-8dad-6cb4b3c579a2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:58:46.130857 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-bfeebd17-b732-4796-be0f-46fe2aa3f2b2 req-fe590179-338c-4aa2-9f20-12a17f3166bd service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Refreshing network info cache for port 58939f92-ac70-47fb-90c0-5f7bc2421c47 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:58:46.132502 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fbc53501-2d5d-4dc0-addd-0371b013cfa9 req-538ceb94-ec63-4c4b-9157-b4e06a8ef3f5 service nova] Lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:46.132693 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-fbc53501-2d5d-4dc0-addd-0371b013cfa9 req-538ceb94-ec63-4c4b-9157-b4e06a8ef3f5 service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Processing event network-vif-plugged-d99a2cf4-260b-4ca3-b72e-7db23358b831 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 01:58:46.133747 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d75ff65-b688-4387-89e3-70567e569682/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:46.134104 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 01:58:46.134929 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d75ff65-b688-4387-89e3-70567e569682/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:46.149071 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 01:58:46.153577 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Instance spawned successfully.
May 21 01:58:46.154492 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 01:58:46.160505 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:46.178240 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.093s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:46.178596 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Checking if we can resize image /opt/stack/data/nova/instances/800e7287-2ec0-48a2-b959-d7fbcc1f3c10/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 01:58:46.178821 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/800e7287-2ec0-48a2-b959-d7fbcc1f3c10/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:46.216875 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d75ff65-b688-4387-89e3-70567e569682/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:46.221971 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:46.253764 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:58:46.262949 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328726.2624931, a6839691-a7ec-4dea-bc39-a7e89c94cf4d => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:58:46.266067 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] VM Resumed (Lifecycle Event)
May 21 01:58:46.266199 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/800e7287-2ec0-48a2-b959-d7fbcc1f3c10/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:46.267358 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Cannot resize image /opt/stack/data/nova/instances/800e7287-2ec0-48a2-b959-d7fbcc1f3c10/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 01:58:46.267751 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 01:58:46.267958 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Ensure instance console log exists: /opt/stack/data/nova/instances/800e7287-2ec0-48a2-b959-d7fbcc1f3c10/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 01:58:46.268768 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:46.269057 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:46.269207 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:46.331656 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:46.332423 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:46.431206 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:46.432545 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Acquiring lock "refresh_cache-a4b3355b-92d6-4b36-8dad-6cb4b3c579a2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:58:46.439327 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 01:58:46.443193 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:46.493970 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "env LANG=C uptime" returned: 0 in 0.051s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:46.494702 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Hypervisor/Node resource view: name=np0000001127 free_ram=13420MB free_disk=74.38385009765625GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 21 01:58:46.495568 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:46.496090 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:46.637422 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-bfeebd17-b732-4796-be0f-46fe2aa3f2b2 req-fe590179-338c-4aa2-9f20-12a17f3166bd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:46.649022 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:58:46.672083 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:58:46.672438 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:58:46.672829 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:58:46.673418 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:58:46.673510 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:58:46.673804 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:58:46.720601 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-48bcad1d-8342-487e-9427-1b456aa0fcb7 req-4b27f0b6-e95c-4a4f-b942-06d0262f32b7 service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Received event network-vif-plugged-d99a2cf4-260b-4ca3-b72e-7db23358b831 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:46.720828 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-48bcad1d-8342-487e-9427-1b456aa0fcb7 req-4b27f0b6-e95c-4a4f-b942-06d0262f32b7 service nova] Acquiring lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:46.721026 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-48bcad1d-8342-487e-9427-1b456aa0fcb7 req-4b27f0b6-e95c-4a4f-b942-06d0262f32b7 service nova] Lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:46.721134 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-48bcad1d-8342-487e-9427-1b456aa0fcb7 req-4b27f0b6-e95c-4a4f-b942-06d0262f32b7 service nova] Lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:46.722134 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-48bcad1d-8342-487e-9427-1b456aa0fcb7 req-4b27f0b6-e95c-4a4f-b942-06d0262f32b7 service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] No waiting events found dispatching network-vif-plugged-d99a2cf4-260b-4ca3-b72e-7db23358b831 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:58:46.722134 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-48bcad1d-8342-487e-9427-1b456aa0fcb7 req-4b27f0b6-e95c-4a4f-b942-06d0262f32b7 service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Received unexpected event network-vif-plugged-d99a2cf4-260b-4ca3-b72e-7db23358b831 for instance with vm_state building and task_state spawning.
May 21 01:58:46.722134 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-48bcad1d-8342-487e-9427-1b456aa0fcb7 req-4b27f0b6-e95c-4a4f-b942-06d0262f32b7 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-changed-1ac81609-4fab-4940-9313-6dd7160c7a9b {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:46.722134 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-48bcad1d-8342-487e-9427-1b456aa0fcb7 req-4b27f0b6-e95c-4a4f-b942-06d0262f32b7 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Refreshing instance network info cache due to event network-changed-1ac81609-4fab-4940-9313-6dd7160c7a9b. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:58:46.722134 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-48bcad1d-8342-487e-9427-1b456aa0fcb7 req-4b27f0b6-e95c-4a4f-b942-06d0262f32b7 service nova] Acquiring lock "refresh_cache-a4b3355b-92d6-4b36-8dad-6cb4b3c579a2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:58:46.737751 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Acquiring lock "f8921842-2161-4ddf-b3c4-b642fc51a70f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:46.737751 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Lock "f8921842-2161-4ddf-b3c4-b642fc51a70f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:46.771414 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:58:46.773302 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:58:46.782115 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-bfeebd17-b732-4796-be0f-46fe2aa3f2b2 req-fe590179-338c-4aa2-9f20-12a17f3166bd service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:58:46.867868 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:46.913030 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:58:46.929438 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d09a034c-962b-43f9-90ee-4200174011fd req-0711eded-7fed-4f79-be04-ad3c0b49460b service nova] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Received event network-changed-23851da2-f984-4946-af6d-2b652ff984e1 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:46.930450 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d09a034c-962b-43f9-90ee-4200174011fd req-0711eded-7fed-4f79-be04-ad3c0b49460b service nova] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Refreshing instance network info cache due to event network-changed-23851da2-f984-4946-af6d-2b652ff984e1. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:58:46.930639 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d09a034c-962b-43f9-90ee-4200174011fd req-0711eded-7fed-4f79-be04-ad3c0b49460b service nova] Acquiring lock "refresh_cache-800e7287-2ec0-48a2-b959-d7fbcc1f3c10" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.startup = manual
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:58:46.931343 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:58:46.931343 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:46.944240 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:58:46.947144 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.startup = manual
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:58:46.968875 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:58:46.968875 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:46.971626 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:46.971626 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:46.971626 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:58:46.971626 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsi session list stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:46.971626 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:46.971626 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:58:46.980290 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:47.004215 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-bfeebd17-b732-4796-be0f-46fe2aa3f2b2 req-fe590179-338c-4aa2-9f20-12a17f3166bd service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:58:47.014809 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:47.014809 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:47.014809 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:47.014809 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:58:47.015029 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsi session list stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:47.015029 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:47.015029 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:47.015029 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:58:47.017341 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175, portal: 192.168.50.100,3260]
May 21 01:58:47.017341 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175, portal: 192.168.50.100,3260] successful.
May 21 01:58:47.017341 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:47.035148 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:47.049889 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Updating instance_info_cache with network_info: [{"id": "23851da2-f984-4946-af6d-2b652ff984e1", "address": "fa:16:3e:af:51:f1", "network": {"id": "aba610ba-f311-41c2-b94d-2495441912e4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-360728390-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a80dd2c84334f79afe5cb079c50c555", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23851da2-f9", "ovs_interfaceid": "23851da2-f984-4946-af6d-2b652ff984e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:58:47.053610 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175, portal: 192.168.40.100,3260]
May 21 01:58:47.053610 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175, portal: 192.168.40.100,3260] successful.
May 21 01:58:47.053610 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:47.054879 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:47.054879 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:47.054879 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:47.054879 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:47.054879 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:58:47.055072 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsi session list stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:47.055072 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:47.055072 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:47.055072 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:47.055072 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:58:47.055599 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.185s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:58:47.055831 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:58:47.056669 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] HCTL ('9', '-', '-', 0) found on session 26 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:58:47.056810 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:58:47.068161 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:47.075738 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Searching for a device in session 26 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:58:47.075925 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '69f8ed84-393f-414e-9868-ac8c3126b175', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:58:47.086495 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:47.086495 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:47.086495 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:47.086495 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:47.086495 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:58:47.086495 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsi session list stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:47.086495 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:47.086495 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:47.086495 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:47.086495 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:58:47.086495 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.216s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:58:47.086495 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:58:47.087000 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] HCTL ('10', '-', '-', 0) found on session 27 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:58:47.087188 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:58:47.109302 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Searching for a device in session 27 and hctl ['10', '*', '*', 0] yield: None {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:58:47.184488 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Took 9.67 seconds to spawn the instance on the hypervisor.
May 21 01:58:47.184755 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:58:47.242189 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Lazy-loading 'flavor' on Instance uuid f8921842-2161-4ddf-b3c4-b642fc51a70f {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:58:47.277632 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 01:58:47.517671 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bfeebd17-b732-4796-be0f-46fe2aa3f2b2 req-fe590179-338c-4aa2-9f20-12a17f3166bd service nova] Releasing lock "refresh_cache-a4b3355b-92d6-4b36-8dad-6cb4b3c579a2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:58:47.518575 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Acquired lock "refresh_cache-a4b3355b-92d6-4b36-8dad-6cb4b3c579a2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:58:47.521839 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 01:58:47.552418 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Releasing lock "refresh_cache-800e7287-2ec0-48a2-b959-d7fbcc1f3c10" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:58:47.552745 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Instance network_info: |[{"id": "23851da2-f984-4946-af6d-2b652ff984e1", "address": "fa:16:3e:af:51:f1", "network": {"id": "aba610ba-f311-41c2-b94d-2495441912e4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-360728390-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a80dd2c84334f79afe5cb079c50c555", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23851da2-f9", "ovs_interfaceid": "23851da2-f984-4946-af6d-2b652ff984e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 01:58:47.555393 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Start _get_guest_xml network_info=[{"id": "23851da2-f984-4946-af6d-2b652ff984e1", "address": "fa:16:3e:af:51:f1", "network": {"id": "aba610ba-f311-41c2-b94d-2495441912e4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-360728390-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a80dd2c84334f79afe5cb079c50c555", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23851da2-f9", "ovs_interfaceid": "23851da2-f984-4946-af6d-2b652ff984e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 01:58:47.556357 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d09a034c-962b-43f9-90ee-4200174011fd req-0711eded-7fed-4f79-be04-ad3c0b49460b service nova] Acquired lock "refresh_cache-800e7287-2ec0-48a2-b959-d7fbcc1f3c10" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:58:47.556574 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-d09a034c-962b-43f9-90ee-4200174011fd req-0711eded-7fed-4f79-be04-ad3c0b49460b service nova] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Refreshing network info cache for port 23851da2-f984-4946-af6d-2b652ff984e1 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:58:47.562406 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 01:58:47.563946 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-VolumesSnapshotTestJSON-instance-1282008379', uuid='800e7287-2ec0-48a2-b959-d7fbcc1f3c10'), owner=OwnerMeta(userid='457854a2cf2844b8b693d835d2c9b699', username='tempest-VolumesSnapshotTestJSON-315332802-project-member', projectid='9a80dd2c84334f79afe5cb079c50c555', projectname='tempest-VolumesSnapshotTestJSON-315332802'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "23851da2-f984-4946-af6d-2b652ff984e1", "address": "fa:16:3e:af:51:f1", "network": {"id": "aba610ba-f311-41c2-b94d-2495441912e4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-360728390-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a80dd2c84334f79afe5cb079c50c555", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23851da2-f9", "ovs_interfaceid": "23851da2-f984-4946-af6d-2b652ff984e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328727.5634868) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 01:58:47.569937 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 01:58:47.570723 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 01:58:47.572117 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 01:58:47.573626 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 01:58:47.574831 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 01:58:47.575287 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 01:58:47.575493 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 01:58:47.575803 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 01:58:47.576015 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 01:58:47.576144 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 01:58:47.576297 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 01:58:47.576814 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 01:58:47.577032 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 01:58:47.577633 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 01:58:47.577633 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 01:58:47.577853 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 01:58:47.586584 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 29a124ee-2b8c-4f44-8f91-8dd11ac78b52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 01:58:47.592856 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 6f68556b-0b18-452a-b307-da2dad4ee6ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 01:58:47.593500 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance f8921842-2161-4ddf-b3c4-b642fc51a70f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 01:58:47.594201 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 0d75ff65-b688-4387-89e3-70567e569682 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 01:58:47.594201 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance a4b3355b-92d6-4b36-8dad-6cb4b3c579a2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 01:58:47.594201 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance a6839691-a7ec-4dea-bc39-a7e89c94cf4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 01:58:47.594201 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 392bbdc4-beaa-4c44-93f5-3a76f331ceb0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 01:58:47.594201 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 64f1cde4-f11a-4da7-8bbc-aaf777432069 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 01:58:47.594426 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 800e7287-2ec0-48a2-b959-d7fbcc1f3c10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 01:58:47.594551 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 21 01:58:47.595003 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Final resource view: name=np0000001127 phys_ram=24030MB used_ram=2240MB phys_disk=95GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:58:46 up 29 min,  2 users,  load average: 9.12, 5.49, 2.65\n', 'num_instances': '9', 'num_vm_active': '4', 'num_task_None': '4', 'num_os_type_None': '9', 'num_proj_6a15fe7a70464159a778cffa4a36c36f': '2', 'io_workload': '5', 'num_proj_0c267ab1fe654c6da45280651b958746': '1', 'num_proj_83df9a84ffaa4398bdafbfbde079964d': '2', 'num_vm_building': '5', 'num_task_spawning': '5', 'num_proj_fea6765f0d474e20a8cf4ce239d06576': '1', 'num_proj_dc797708a5a7400992765e41ee6ec260': '1', 'num_proj_2e41dd931ff049868a61f52a251d1122': '1', 'num_proj_9a80dd2c84334f79afe5cb079c50c555': '1'} {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 21 01:58:47.600436 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T01:58:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1282008379',display_name='tempest-VolumesSnapshotTestJSON-instance-1282008379',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumessnapshottestjson-instance-1282008379',id=17,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/D5kqBe8wboxjntZ6XpC06rz5RhcDXTbaSsvoMewntysJOstkWoBzRLZ2faqM0pedYjWrRBZ16rWiuBNd8VS5xaE1Iwhu2NWyhBWLMJ4dTHxhzRBJN+aM4ILjpKPC9/g==',key_name='tempest-keypair-2002170955',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a80dd2c84334f79afe5cb079c50c555',ramdisk_id='',reservation_id='r-am8snqoa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-315332802',owner_user_name='tempest-VolumesSnapshotTestJSON-315332802-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:58:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='457854a2cf2844b8b693d835d2c9b699',uuid=800e7287-2ec0-48a2-b959-d7fbcc1f3c10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23851da2-f984-4946-af6d-2b652ff984e1", "address": "fa:16:3e:af:51:f1", "network": {"id": "aba610ba-f311-41c2-b94d-2495441912e4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-360728390-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a80dd2c84334f79afe5cb079c50c555", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23851da2-f9", "ovs_interfaceid": "23851da2-f984-4946-af6d-2b652ff984e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 01:58:47.600628 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Converting VIF {"id": "23851da2-f984-4946-af6d-2b652ff984e1", "address": "fa:16:3e:af:51:f1", "network": {"id": "aba610ba-f311-41c2-b94d-2495441912e4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-360728390-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a80dd2c84334f79afe5cb079c50c555", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23851da2-f9", "ovs_interfaceid": "23851da2-f984-4946-af6d-2b652ff984e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:58:47.601316 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:51:f1,bridge_name='br-int',has_traffic_filtering=True,id=23851da2-f984-4946-af6d-2b652ff984e1,network=Network(aba610ba-f311-41c2-b94d-2495441912e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23851da2-f9') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:58:47.601951 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lazy-loading 'pci_devices' on Instance uuid 800e7287-2ec0-48a2-b959-d7fbcc1f3c10 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:58:47.645102 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:58:47.645794 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:58:47.645794 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] No VIF found with MAC fa:16:3e:12:66:8e, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 01:58:47.645794 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Using config drive
May 21 01:58:47.702425 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Took 19.46 seconds to build instance.
May 21 01:58:48.060453 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-d09a034c-962b-43f9-90ee-4200174011fd req-0711eded-7fed-4f79-be04-ad3c0b49460b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:48.104968 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] End _get_guest_xml xml=<domain type="qemu">
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:   <uuid>800e7287-2ec0-48a2-b959-d7fbcc1f3c10</uuid>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:   <name>instance-00000011</name>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:   <metadata>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1282008379</nova:name>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 01:58:47</nova:creationTime>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:       </nova:image>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:         <nova:user uuid="457854a2cf2844b8b693d835d2c9b699">tempest-VolumesSnapshotTestJSON-315332802-project-member</nova:user>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:         <nova:project uuid="9a80dd2c84334f79afe5cb079c50c555">tempest-VolumesSnapshotTestJSON-315332802</nova:project>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:         <nova:port uuid="23851da2-f984-4946-af6d-2b652ff984e1">
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:         </nova:port>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:   </metadata>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:     <system>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:       <entry name="serial">800e7287-2ec0-48a2-b959-d7fbcc1f3c10</entry>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:       <entry name="uuid">800e7287-2ec0-48a2-b959-d7fbcc1f3c10</entry>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:     </system>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:   <os>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:   </os>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:   <features>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:     <acpi/>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:     <tcg>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:     </tcg>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:   </features>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:   <devices>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/800e7287-2ec0-48a2-b959-d7fbcc1f3c10/disk"/>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:     </disk>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/800e7287-2ec0-48a2-b959-d7fbcc1f3c10/disk.config"/>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:     </disk>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:af:51:f1"/>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:       <target dev="tap23851da2-f9"/>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:     </interface>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/800e7287-2ec0-48a2-b959-d7fbcc1f3c10/console.log" append="off"/>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:     </serial>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:     <video>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:     </video>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:     </rng>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:     </memballoon>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:   </devices>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]: </domain>
May 21 01:58:48.104968 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 01:58:48.106791 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Preparing to wait for external event network-vif-plugged-23851da2-f984-4946-af6d-2b652ff984e1 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 01:58:48.106791 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Acquiring lock "800e7287-2ec0-48a2-b959-d7fbcc1f3c10-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:48.106791 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "800e7287-2ec0-48a2-b959-d7fbcc1f3c10-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:48.106791 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "800e7287-2ec0-48a2-b959-d7fbcc1f3c10-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:48.106791 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T01:58:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1282008379',display_name='tempest-VolumesSnapshotTestJSON-instance-1282008379',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumessnapshottestjson-instance-1282008379',id=17,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/D5kqBe8wboxjntZ6XpC06rz5RhcDXTbaSsvoMewntysJOstkWoBzRLZ2faqM0pedYjWrRBZ16rWiuBNd8VS5xaE1Iwhu2NWyhBWLMJ4dTHxhzRBJN+aM4ILjpKPC9/g==',key_name='tempest-keypair-2002170955',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a80dd2c84334f79afe5cb079c50c555',ramdisk_id='',reservation_id='r-am8snqoa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-315332802',owner_user_name='tempest-VolumesSnapshotTestJSON-315332802-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:58:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='457854a2cf2844b8b693d835d2c9b699',uuid=800e7287-2ec0-48a2-b959-d7fbcc1f3c10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23851da2-f984-4946-af6d-2b652ff984e1", "address": "fa:16:3e:af:51:f1", "network": {"id": "aba610ba-f311-41c2-b94d-2495441912e4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-360728390-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a80dd2c84334f79afe5cb079c50c555", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23851da2-f9", "ovs_interfaceid": "23851da2-f984-4946-af6d-2b652ff984e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 01:58:48.106791 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Converting VIF {"id": "23851da2-f984-4946-af6d-2b652ff984e1", "address": "fa:16:3e:af:51:f1", "network": {"id": "aba610ba-f311-41c2-b94d-2495441912e4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-360728390-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a80dd2c84334f79afe5cb079c50c555", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23851da2-f9", "ovs_interfaceid": "23851da2-f984-4946-af6d-2b652ff984e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:58:48.107271 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:51:f1,bridge_name='br-int',has_traffic_filtering=True,id=23851da2-f984-4946-af6d-2b652ff984e1,network=Network(aba610ba-f311-41c2-b94d-2495441912e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23851da2-f9') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:58:48.107271 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:51:f1,bridge_name='br-int',has_traffic_filtering=True,id=23851da2-f984-4946-af6d-2b652ff984e1,network=Network(aba610ba-f311-41c2-b94d-2495441912e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23851da2-f9') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 01:58:48.109854 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:48.109854 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:48.109854 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 01:58:48.110889 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:48.111148 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'af56095b-2eeb-5c1a-b13a-b934edfae8cf', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:48.114245 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Searching for a device in session 27 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:58:48.114418 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '69f8ed84-393f-414e-9868-ac8c3126b175', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:58:48.114771 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:48.115799 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:58:48.123148 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:48.127838 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:48.128052 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23851da2-f9, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:48.128498 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap23851da2-f9, col_values=(('qos', UUID('a509ef91-21e6-4169-8d5a-9cf30441b9e1')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:48.128668 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap23851da2-f9, col_values=(('external_ids', {'iface-id': '23851da2-f984-4946-af6d-2b652ff984e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:51:f1', 'vm-uuid': '800e7287-2ec0-48a2-b959-d7fbcc1f3c10'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:48.130740 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:48.132084 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:58:48.152867 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:48.152867 np0000001127 nova-compute[98206]: INFO os_vif [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:51:f1,bridge_name='br-int',has_traffic_filtering=True,id=23851da2-f984-4946-af6d-2b652ff984e1,network=Network(aba610ba-f311-41c2-b94d-2495441912e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23851da2-f9')
May 21 01:58:48.154080 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:48.162860 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:58:48.205491 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1798ad35-4259-42bd-b34f-7e526f02f4e0 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.973s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:48.248395 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Lock "f8921842-2161-4ddf-b3c4-b642fc51a70f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:48.273731 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:58:48.274238 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:58:48.388937 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Creating config drive at /opt/stack/data/nova/instances/64f1cde4-f11a-4da7-8bbc-aaf777432069/disk.config
May 21 01:58:48.396878 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/64f1cde4-f11a-4da7-8bbc-aaf777432069/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpw_4qnctd {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:48.455941 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/64f1cde4-f11a-4da7-8bbc-aaf777432069/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpw_4qnctd" returned: 0 in 0.059s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:48.474779 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:48.570495 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-d09a034c-962b-43f9-90ee-4200174011fd req-0711eded-7fed-4f79-be04-ad3c0b49460b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:48.782923 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:58:48.793504 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-d09a034c-962b-43f9-90ee-4200174011fd req-0711eded-7fed-4f79-be04-ad3c0b49460b service nova] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Updated VIF entry in instance network info cache for port 23851da2-f984-4946-af6d-2b652ff984e1. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 01:58:48.793719 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-d09a034c-962b-43f9-90ee-4200174011fd req-0711eded-7fed-4f79-be04-ad3c0b49460b service nova] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Updating instance_info_cache with network_info: [{"id": "23851da2-f984-4946-af6d-2b652ff984e1", "address": "fa:16:3e:af:51:f1", "network": {"id": "aba610ba-f311-41c2-b94d-2495441912e4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-360728390-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a80dd2c84334f79afe5cb079c50c555", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23851da2-f9", "ovs_interfaceid": "23851da2-f984-4946-af6d-2b652ff984e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:58:48.886493 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Found WWN 330000000e3a8a7be for multipath device dm-1 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 01:58:48.886930 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:58:48.887163 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '330000000e3a8a7be', 'path': '/dev/dm-1', 'multipath_id': '330000000e3a8a7be'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:58:48.887289 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e3a8a7be', 'path': '/dev/dm-1', 'multipath_id': '330000000e3a8a7be'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 01:58:48.893340 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:48.973586 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:49.014088 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:49.096858 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:49.291635 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Compute_service record updated for np0000001127:np0000001127 {{(pid=98206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 21 01:58:49.293012 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.796s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:49.293012 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 01:58:49.299745 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d09a034c-962b-43f9-90ee-4200174011fd req-0711eded-7fed-4f79-be04-ad3c0b49460b service nova] Releasing lock "refresh_cache-800e7287-2ec0-48a2-b959-d7fbcc1f3c10" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:58:49.311437 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b03791df-4bf8-49a0-97ab-ccf9ef57c2d7 req-1f703307-b61f-4d1e-9641-9524a9a265d9 service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Received event network-vif-plugged-3b1f76f9-cf49-4dea-b9a2-762c2ad220bf {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:49.311437 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b03791df-4bf8-49a0-97ab-ccf9ef57c2d7 req-1f703307-b61f-4d1e-9641-9524a9a265d9 service nova] Acquiring lock "64f1cde4-f11a-4da7-8bbc-aaf777432069-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:49.311437 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b03791df-4bf8-49a0-97ab-ccf9ef57c2d7 req-1f703307-b61f-4d1e-9641-9524a9a265d9 service nova] Lock "64f1cde4-f11a-4da7-8bbc-aaf777432069-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:49.311437 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b03791df-4bf8-49a0-97ab-ccf9ef57c2d7 req-1f703307-b61f-4d1e-9641-9524a9a265d9 service nova] Lock "64f1cde4-f11a-4da7-8bbc-aaf777432069-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:49.311437 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b03791df-4bf8-49a0-97ab-ccf9ef57c2d7 req-1f703307-b61f-4d1e-9641-9524a9a265d9 service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Processing event network-vif-plugged-3b1f76f9-cf49-4dea-b9a2-762c2ad220bf {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 01:58:49.395808 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T01:58:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1558814074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serverbootfromvolumestablerescuetest-server-1558814074',id=15,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83df9a84ffaa4398bdafbfbde079964d',ramdisk_id='',reservation_id='r-cgn40wpx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-260444396',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:58:39Z,user_data=None,user_id='bd5b969d5a514d01bacfc7954a5ae4ab',uuid=392bbdc4-beaa-4c44-93f5-3a76f331ceb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44670b22-c758-456b-a200-f0323baea57f", "address": "fa:16:3e:50:bf:d8", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap44670b22-c7", "ovs_interfaceid": "44670b22-c758-456b-a200-f0323baea57f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 01:58:49.395808 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Converting VIF {"id": "44670b22-c758-456b-a200-f0323baea57f", "address": "fa:16:3e:50:bf:d8", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap44670b22-c7", "ovs_interfaceid": "44670b22-c758-456b-a200-f0323baea57f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:58:49.396459 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:bf:d8,bridge_name='br-int',has_traffic_filtering=True,id=44670b22-c758-456b-a200-f0323baea57f,network=Network(b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44670b22-c7') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:58:49.397337 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lazy-loading 'pci_devices' on Instance uuid 392bbdc4-beaa-4c44-93f5-3a76f331ceb0 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:58:49.407671 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:49.419100 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:49.423023 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:49.445002 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Acquiring lock "f8921842-2161-4ddf-b3c4-b642fc51a70f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:49.445319 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Lock "f8921842-2161-4ddf-b3c4-b642fc51a70f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:49.445532 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Attaching volume 9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 to /dev/sdc
May 21 01:58:49.453724 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:49.463612 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:49.483514 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:49.515011 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:58:49.529856 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 01:58:49.558378 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:49.595030 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 01:58:49.598209 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 01:58:49.611598 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 01:58:49.612932 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe9e:216', 'fe80::14d9:7bff:fe3b:f0dc', 'fe80::fc16:3eff:feef:6106', 'fe80::4f8:d7ff:fe7a:a4fe', 'fe80::fc16:3eff:fee3:f7d2', 'fe80::6c2e:11ff:fea1:7eb7', 'fe80::fc16:3eff:fe30:ade5', 'fe80::fc16:3eff:fe76:c870', 'fe80::a403:4dff:fe5a:1b07', 'fe80::fc16:3eff:fe12:668e', 'fe80::c062:49ff:fe28:b40d'] 
May 21 01:58:49.613059 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 01:58:49.615494 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 01:58:49.615494 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:58:49.615494 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Updating existing volume attachment record: 077a670c-1932-4bf5-bcab-49214d2e416f {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 01:58:49.692437 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:58:49.692437 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:58:49.692437 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] No VIF found with MAC fa:16:3e:af:51:f1, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 01:58:49.692437 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Using config drive
May 21 01:58:49.905652 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] End _get_guest_xml xml=<domain type="qemu">
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:   <uuid>392bbdc4-beaa-4c44-93f5-3a76f331ceb0</uuid>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:   <name>instance-0000000f</name>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:   <metadata>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1558814074</nova:name>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 01:58:45</nova:creationTime>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:       </nova:image>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:         <nova:user uuid="bd5b969d5a514d01bacfc7954a5ae4ab">tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member</nova:user>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:         <nova:project uuid="83df9a84ffaa4398bdafbfbde079964d">tempest-ServerBootFromVolumeStableRescueTest-260444396</nova:project>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:         <nova:port uuid="44670b22-c758-456b-a200-f0323baea57f">
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:         </nova:port>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:   </metadata>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:     <system>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:       <entry name="serial">392bbdc4-beaa-4c44-93f5-3a76f331ceb0</entry>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:       <entry name="uuid">392bbdc4-beaa-4c44-93f5-3a76f331ceb0</entry>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:     </system>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:   <os>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:   </os>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:   <features>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:     <acpi/>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:     <tcg>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:     </tcg>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:   </features>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:   <devices>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/392bbdc4-beaa-4c44-93f5-3a76f331ceb0/disk.config"/>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:     </disk>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:       <alias name="ua-69f8ed84-393f-414e-9868-ac8c3126b175"/>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-1"/>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:       <serial>69f8ed84-393f-414e-9868-ac8c3126b175</serial>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:     </disk>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:50:bf:d8"/>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:       <target dev="tap44670b22-c7"/>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:     </interface>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/392bbdc4-beaa-4c44-93f5-3a76f331ceb0/console.log" append="off"/>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:     </serial>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:     <video>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:     </video>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:     </rng>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:     </memballoon>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:   </devices>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]: </domain>
May 21 01:58:49.905652 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 01:58:49.905652 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Preparing to wait for external event network-vif-plugged-44670b22-c758-456b-a200-f0323baea57f {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 01:58:49.905652 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:49.905652 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:49.907764 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:49.907764 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T01:58:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1558814074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serverbootfromvolumestablerescuetest-server-1558814074',id=15,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83df9a84ffaa4398bdafbfbde079964d',ramdisk_id='',reservation_id='r-cgn40wpx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-260444396',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:58:39Z,user_data=None,user_id='bd5b969d5a514d01bacfc7954a5ae4ab',uuid=392bbdc4-beaa-4c44-93f5-3a76f331ceb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44670b22-c758-456b-a200-f0323baea57f", "address": "fa:16:3e:50:bf:d8", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap44670b22-c7", "ovs_interfaceid": "44670b22-c758-456b-a200-f0323baea57f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 01:58:49.907764 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Converting VIF {"id": "44670b22-c758-456b-a200-f0323baea57f", "address": "fa:16:3e:50:bf:d8", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap44670b22-c7", "ovs_interfaceid": "44670b22-c758-456b-a200-f0323baea57f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:58:49.907764 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:bf:d8,bridge_name='br-int',has_traffic_filtering=True,id=44670b22-c758-456b-a200-f0323baea57f,network=Network(b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44670b22-c7') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:58:49.907764 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:bf:d8,bridge_name='br-int',has_traffic_filtering=True,id=44670b22-c758-456b-a200-f0323baea57f,network=Network(b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44670b22-c7') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 01:58:49.908690 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:49.909133 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:49.909399 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 01:58:49.910648 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:49.910890 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '017dce3c-bc3d-5af1-9822-eb04f615ac54', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:49.911822 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:49.914205 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:58:49.918488 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:49.920970 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:49.921179 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap44670b22-c7, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:49.921667 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap44670b22-c7, col_values=(('qos', UUID('54ede111-c478-4f64-b8d6-feb2cfde58c8')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:49.921893 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap44670b22-c7, col_values=(('external_ids', {'iface-id': '44670b22-c758-456b-a200-f0323baea57f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:bf:d8', 'vm-uuid': '392bbdc4-beaa-4c44-93f5-3a76f331ceb0'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:58:49.922870 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:49.924258 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:58:49.930447 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:49.934272 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:49.935289 np0000001127 nova-compute[98206]: INFO os_vif [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:bf:d8,bridge_name='br-int',has_traffic_filtering=True,id=44670b22-c758-456b-a200-f0323baea57f,network=Network(b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44670b22-c7')
May 21 01:58:50.074036 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 01:58:50.076001 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328730.0742774, 64f1cde4-f11a-4da7-8bbc-aaf777432069 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:58:50.078198 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] VM Started (Lifecycle Event)
May 21 01:58:50.078974 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 01:58:50.082934 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Instance spawned successfully.
May 21 01:58:50.083646 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 01:58:50.195368 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 01:58:50.203562 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9', 'iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:58:50.204274 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:58:50.204731 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:50.208531 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:58:50.208819 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9', 'iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 01:58:50.229199 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:58:50.230207 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:58:50.231078 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:58:50.231078 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:58:50.231790 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:58:50.232100 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:58:50.246050 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 01:58:50.246050 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:50.253249 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 01:58:50.253249 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:50.264640 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9] added
May 21 01:58:50.264640 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 01:58:50.264640 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:58:50.264640 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:58:50.264640 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:58:50.264640 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:58:50.264640 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:50.265783 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9] added
May 21 01:58:50.265783 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 01:58:50.265783 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:58:50.265783 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:58:50.265783 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:58:50.265783 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:58:50.265783 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:50.265941 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 01:58:50.266401 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 01:58:50.266574 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0341(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 01:58:50.266835 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0354(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 01:58:50.266944 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 01:58:50.267191 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 01:58:50.292896 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:58:50.293757 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:58:50.294926 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:58:50.295365 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:58:50.295692 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 53.38 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 01:58:50.330026 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:50.429124 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Creating config drive at /opt/stack/data/nova/instances/800e7287-2ec0-48a2-b959-d7fbcc1f3c10/disk.config
May 21 01:58:50.433947 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/800e7287-2ec0-48a2-b959-d7fbcc1f3c10/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp892d9873 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:50.465993 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:50.466407 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:50.489431 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/800e7287-2ec0-48a2-b959-d7fbcc1f3c10/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp892d9873" returned: 0 in 0.055s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:50.580795 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:58:50.588348 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:58:50.595068 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:58:50.595946 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:58:50.596131 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:58:50.596847 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:58:50.597023 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:58:50.598306 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:58:50.749910 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:50.974745 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lazy-loading 'flavor' on Instance uuid a6839691-a7ec-4dea-bc39-a7e89c94cf4d {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:58:51.095156 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 01:58:51.095156 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328731.0936315, 64f1cde4-f11a-4da7-8bbc-aaf777432069 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:58:51.095156 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] VM Paused (Lifecycle Event)
May 21 01:58:51.109614 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Took 8.02 seconds to spawn the instance on the hypervisor.
May 21 01:58:51.109614 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:58:51.117491 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:51.155461 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:51.164065 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:51.267673 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:58:51.270179 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:58:51.291245 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.startup = manual
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:58:51.296169 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:58:51.296169 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.startup = manual
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:58:51.306514 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:58:51.306514 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:51.310744 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:51.318964 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:51.331385 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:51.349153 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:51.349153 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:51.349153 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:51.349153 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:51.349153 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:58:51.349352 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] iscsi session list stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:51.349352 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:51.349352 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:51.349352 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:51.349352 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:58:51.356670 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:51.356670 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:51.356670 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:51.356670 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:51.356670 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:58:51.357339 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] iscsi session list stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:51.357339 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:51.357339 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:51.357339 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:51.357339 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:58:51.405228 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9, portal: 192.168.50.100,3260]
May 21 01:58:51.405228 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9, portal: 192.168.50.100,3260] successful.
May 21 01:58:51.405228 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:51.419294 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8e0f02ac-2594-4a92-9309-a78f680e44cb req-8e6a3b2c-dcc5-4da3-98d6-ce2ce07c1c5b service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Received event network-vif-plugged-3b1f76f9-cf49-4dea-b9a2-762c2ad220bf {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:51.419569 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8e0f02ac-2594-4a92-9309-a78f680e44cb req-8e6a3b2c-dcc5-4da3-98d6-ce2ce07c1c5b service nova] Acquiring lock "64f1cde4-f11a-4da7-8bbc-aaf777432069-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:51.421490 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8e0f02ac-2594-4a92-9309-a78f680e44cb req-8e6a3b2c-dcc5-4da3-98d6-ce2ce07c1c5b service nova] Lock "64f1cde4-f11a-4da7-8bbc-aaf777432069-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:51.421490 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8e0f02ac-2594-4a92-9309-a78f680e44cb req-8e6a3b2c-dcc5-4da3-98d6-ce2ce07c1c5b service nova] Lock "64f1cde4-f11a-4da7-8bbc-aaf777432069-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:51.421490 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8e0f02ac-2594-4a92-9309-a78f680e44cb req-8e6a3b2c-dcc5-4da3-98d6-ce2ce07c1c5b service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] No waiting events found dispatching network-vif-plugged-3b1f76f9-cf49-4dea-b9a2-762c2ad220bf {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:58:51.421490 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-8e0f02ac-2594-4a92-9309-a78f680e44cb req-8e6a3b2c-dcc5-4da3-98d6-ce2ce07c1c5b service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Received unexpected event network-vif-plugged-3b1f76f9-cf49-4dea-b9a2-762c2ad220bf for instance with vm_state active and task_state None.
May 21 01:58:51.427581 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9, portal: 192.168.40.100,3260]
May 21 01:58:51.427581 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9, portal: 192.168.40.100,3260] successful.
May 21 01:58:51.427581 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:51.440174 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:51.451729 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:51.469440 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:51.469440 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:51.469440 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:51.469440 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:51.469440 np0000001127 nova-compute[98206]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:58:51.469440 np0000001127 nova-compute[98206]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:58:51.469440 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:58:51.470653 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] iscsi session list stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:51.470653 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:51.470653 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:51.470653 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:51.470653 np0000001127 nova-compute[98206]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:58:51.470653 np0000001127 nova-compute[98206]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:58:51.470653 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:58:51.470653 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.240s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:58:51.471090 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:58:51.471279 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:51.471279 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:51.471279 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:51.471279 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:51.471279 np0000001127 nova-compute[98206]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:58:51.471279 np0000001127 nova-compute[98206]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:58:51.471279 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:58:51.471523 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] iscsi session list stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:51.471523 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:51.471523 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:51.471523 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:51.471523 np0000001127 nova-compute[98206]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:58:51.471523 np0000001127 nova-compute[98206]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:58:51.471523 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:58:51.472022 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.240s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:58:51.472022 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:58:51.473530 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] HCTL ('11', '-', '-', 0) found on session 28 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:58:51.473728 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:58:51.474256 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] HCTL ('12', '-', '-', 0) found on session 29 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:58:51.474371 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:58:51.486479 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:58:51.486479 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:58:51.487104 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] No VIF found with MAC fa:16:3e:50:bf:d8, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 01:58:51.487104 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Using config drive
May 21 01:58:51.511549 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Searching for a device in session 28 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:58:51.511857 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:58:51.537769 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Searching for a device in session 29 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:58:51.537769 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:58:51.564790 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Updating instance_info_cache with network_info: [{"id": "f99ceda9-fad6-4a73-af2a-c63d3d320e2f", "address": "fa:16:3e:f8:14:ac", "network": {"id": "0ab35e13-b362-4576-91d1-569cb811b2d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1427614225-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf99ceda9-fa", "ovs_interfaceid": "f99ceda9-fad6-4a73-af2a-c63d3d320e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71580ee4-3192-484a-9ee6-5096ac78a4ce", "address": "fa:16:3e:32:44:18", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71580ee4-31", "ovs_interfaceid": "71580ee4-3192-484a-9ee6-5096ac78a4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9e74661c-8435-43a4-82d7-b7d757552d24", "address": "fa:16:3e:e6:51:87", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e74661c-84", "ovs_interfaceid": "9e74661c-8435-43a4-82d7-b7d757552d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "407bbd3c-7537-4404-aaf5-a5ed533bb33b", "address": "fa:16:3e:80:dd:78", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap407bbd3c-75", "ovs_interfaceid": "407bbd3c-7537-4404-aaf5-a5ed533bb33b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a350a027-1ffc-4539-a238-d98bbb9baeba", "address": "fa:16:3e:19:d5:ae", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa350a027-1f", "ovs_interfaceid": "a350a027-1ffc-4539-a238-d98bbb9baeba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58939f92-ac70-47fb-90c0-5f7bc2421c47", "address": "fa:16:3e:db:3c:f9", "network": {"id": "54c4e0a1-6a66-4891-94c3-c85fc5fe181c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2031114495", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58939f92-ac", "ovs_interfaceid": "58939f92-ac70-47fb-90c0-5f7bc2421c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1ac81609-4fab-4940-9313-6dd7160c7a9b", "address": "fa:16:3e:c9:a8:b1", "network": {"id": "54c4e0a1-6a66-4891-94c3-c85fc5fe181c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2031114495", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac81609-4f", "ovs_interfaceid": "1ac81609-4fab-4940-9313-6dd7160c7a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:58:51.579451 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-3dde1125-3d74-4a31-9ccb-841d480d038d req-e6c5cf51-8fa5-4d47-bff2-d88d229708f0 service nova] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Received event network-vif-plugged-23851da2-f984-4946-af6d-2b652ff984e1 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:51.579747 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-3dde1125-3d74-4a31-9ccb-841d480d038d req-e6c5cf51-8fa5-4d47-bff2-d88d229708f0 service nova] Acquiring lock "800e7287-2ec0-48a2-b959-d7fbcc1f3c10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:51.579831 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-3dde1125-3d74-4a31-9ccb-841d480d038d req-e6c5cf51-8fa5-4d47-bff2-d88d229708f0 service nova] Lock "800e7287-2ec0-48a2-b959-d7fbcc1f3c10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:51.579947 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-3dde1125-3d74-4a31-9ccb-841d480d038d req-e6c5cf51-8fa5-4d47-bff2-d88d229708f0 service nova] Lock "800e7287-2ec0-48a2-b959-d7fbcc1f3c10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:51.580047 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-3dde1125-3d74-4a31-9ccb-841d480d038d req-e6c5cf51-8fa5-4d47-bff2-d88d229708f0 service nova] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Processing event network-vif-plugged-23851da2-f984-4946-af6d-2b652ff984e1 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 01:58:51.598490 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:58:51.603149 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328731.6022274, 64f1cde4-f11a-4da7-8bbc-aaf777432069 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:58:51.603149 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] VM Resumed (Lifecycle Event)
May 21 01:58:51.637165 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Took 15.63 seconds to build instance.
May 21 01:58:51.670912 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:51.684710 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:51.717357 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:51.728725 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:51.997705 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:52.001806 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.534s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:52.068704 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Releasing lock "refresh_cache-a4b3355b-92d6-4b36-8dad-6cb4b3c579a2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:58:52.069306 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Instance network_info: |[{"id": "f99ceda9-fad6-4a73-af2a-c63d3d320e2f", "address": "fa:16:3e:f8:14:ac", "network": {"id": "0ab35e13-b362-4576-91d1-569cb811b2d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1427614225-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf99ceda9-fa", "ovs_interfaceid": "f99ceda9-fad6-4a73-af2a-c63d3d320e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71580ee4-3192-484a-9ee6-5096ac78a4ce", "address": "fa:16:3e:32:44:18", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71580ee4-31", "ovs_interfaceid": "71580ee4-3192-484a-9ee6-5096ac78a4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9e74661c-8435-43a4-82d7-b7d757552d24", "address": "fa:16:3e:e6:51:87", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e74661c-84", "ovs_interfaceid": "9e74661c-8435-43a4-82d7-b7d757552d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "407bbd3c-7537-4404-aaf5-a5ed533bb33b", "address": "fa:16:3e:80:dd:78", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap407bbd3c-75", "ovs_interfaceid": "407bbd3c-7537-4404-aaf5-a5ed533bb33b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a350a027-1ffc-4539-a238-d98bbb9baeba", "address": "fa:16:3e:19:d5:ae", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa350a027-1f", "ovs_interfaceid": "a350a027-1ffc-4539-a238-d98bbb9baeba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58939f92-ac70-47fb-90c0-5f7bc2421c47", "address": "fa:16:3e:db:3c:f9", "network": {"id": "54c4e0a1-6a66-4891-94c3-c85fc5fe181c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2031114495", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58939f92-ac", "ovs_interfaceid": "58939f92-ac70-47fb-90c0-5f7bc2421c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1ac81609-4fab-4940-9313-6dd7160c7a9b", "address": "fa:16:3e:c9:a8:b1", "network": {"id": "54c4e0a1-6a66-4891-94c3-c85fc5fe181c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2031114495", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac81609-4f", "ovs_interfaceid": "1ac81609-4fab-4940-9313-6dd7160c7a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 01:58:52.070502 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-48bcad1d-8342-487e-9427-1b456aa0fcb7 req-4b27f0b6-e95c-4a4f-b942-06d0262f32b7 service nova] Acquired lock "refresh_cache-a4b3355b-92d6-4b36-8dad-6cb4b3c579a2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:58:52.070502 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-48bcad1d-8342-487e-9427-1b456aa0fcb7 req-4b27f0b6-e95c-4a4f-b942-06d0262f32b7 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Refreshing network info cache for port 1ac81609-4fab-4940-9313-6dd7160c7a9b {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:58:52.073815 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Start _get_guest_xml network_info=[{"id": "f99ceda9-fad6-4a73-af2a-c63d3d320e2f", "address": "fa:16:3e:f8:14:ac", "network": {"id": "0ab35e13-b362-4576-91d1-569cb811b2d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1427614225-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf99ceda9-fa", "ovs_interfaceid": "f99ceda9-fad6-4a73-af2a-c63d3d320e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71580ee4-3192-484a-9ee6-5096ac78a4ce", "address": "fa:16:3e:32:44:18", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71580ee4-31", "ovs_interfaceid": "71580ee4-3192-484a-9ee6-5096ac78a4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9e74661c-8435-43a4-82d7-b7d757552d24", "address": "fa:16:3e:e6:51:87", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e74661c-84", "ovs_interfaceid": "9e74661c-8435-43a4-82d7-b7d757552d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "407bbd3c-7537-4404-aaf5-a5ed533bb33b", "address": "fa:16:3e:80:dd:78", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap407bbd3c-75", "ovs_interfaceid": "407bbd3c-7537-4404-aaf5-a5ed533bb33b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a350a027-1ffc-4539-a238-d98bbb9baeba", "address": "fa:16:3e:19:d5:ae", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa350a027-1f", "ovs_interfaceid": "a350a027-1ffc-4539-a238-d98bbb9baeba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58939f92-ac70-47fb-90c0-5f7bc2421c47", "address": "fa:16:3e:db:3c:f9", "network": {"id": "54c4e0a1-6a66-4891-94c3-c85fc5fe181c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2031114495", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58939f92-ac", "ovs_interfaceid": "58939f92-ac70-47fb-90c0-5f7bc2421c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1ac81609-4fab-4940-9313-6dd7160c7a9b", "address": "fa:16:3e:c9:a8:b1", "network": {"id": "54c4e0a1-6a66-4891-94c3-c85fc5fe181c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2031114495", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac81609-4f", "ovs_interfaceid": "1ac81609-4fab-4940-9313-6dd7160c7a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2', 'iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f8b13fac-25c3-40f9-8506-1236b8dc8fd2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'a4b3355b-92d6-4b36-8dad-6cb4b3c579a2', 'attached_at': '', 'detached_at': '', 'volume_id': 'f8b13fac-25c3-40f9-8506-1236b8dc8fd2', 'serial': 'f8b13fac-25c3-40f9-8506-1236b8dc8fd2'}, 'delete_on_termination': False, 'attachment_id': 'd20fc237-95a7-4337-aaaf-eeced605035f', 'volume_type': None}, {'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': 1, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6', 'iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5410bf8e-8978-4bf4-b8f9-592be340a6b6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'a4b3355b-92d6-4b36-8dad-6cb4b3c579a2', 'attached_at': '', 'detached_at': '', 'volume_id': '5410bf8e-8978-4bf4-b8f9-592be340a6b6', 'serial': '5410bf8e-8978-4bf4-b8f9-592be340a6b6'}, 'delete_on_termination': False, 'attachment_id': '9cf617ac-9cdd-4d6e-af81-c5fe772004b5', 'volume_type': None}, {'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'boot_index': 2, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566', 'iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f84e5871-8b85-40d8-af76-554e0f6ce566', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'a4b3355b-92d6-4b36-8dad-6cb4b3c579a2', 'attached_at': '', 'detached_at': '', 'volume_id': 'f84e5871-8b85-40d8-af76-554e0f6ce566', 'serial': 'f84e5871-8b85-40d8-af76-554e0f6ce566'}, 'delete_on_termination': False, 'attachment_id': '1e1a6ae5-23be-40ad-ab81-c23eaab41435', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 01:58:52.083050 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 01:58:52.088955 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-920193654', uuid='a4b3355b-92d6-4b36-8dad-6cb4b3c579a2'), owner=OwnerMeta(userid='dcc45f6ca81d42fbb09ff1916bb11787', username='tempest-TaggedBootDevicesTest_v242-1306570717-project-member', projectid='fea6765f0d474e20a8cf4ce239d06576', projectname='tempest-TaggedBootDevicesTest_v242-1306570717'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f99ceda9-fad6-4a73-af2a-c63d3d320e2f", "address": "fa:16:3e:f8:14:ac", "network": {"id": "0ab35e13-b362-4576-91d1-569cb811b2d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1427614225-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf99ceda9-fa", "ovs_interfaceid": "f99ceda9-fad6-4a73-af2a-c63d3d320e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71580ee4-3192-484a-9ee6-5096ac78a4ce", "address": "fa:16:3e:32:44:18", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71580ee4-31", "ovs_interfaceid": "71580ee4-3192-484a-9ee6-5096ac78a4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9e74661c-8435-43a4-82d7-b7d757552d24", "address": "fa:16:3e:e6:51:87", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e74661c-84", "ovs_interfaceid": "9e74661c-8435-43a4-82d7-b7d757552d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "407bbd3c-7537-4404-aaf5-a5ed533bb33b", "address": "fa:16:3e:80:dd:78", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap407bbd3c-75", "ovs_interfaceid": "407bbd3c-7537-4404-aaf5-a5ed533bb33b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a350a027-1ffc-4539-a238-d98bbb9baeba", "address": "fa:16:3e:19:d5:ae", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa350a027-1f", "ovs_interfaceid": "a350a027-1ffc-4539-a238-d98bbb9baeba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58939f92-ac70-47fb-90c0-5f7bc2421c47", "address": "fa:16:3e:db:3c:f9", "network": {"id": "54c4e0a1-6a66-4891-94c3-c85fc5fe181c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2031114495", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58939f92-ac", "ovs_interfaceid": "58939f92-ac70-47fb-90c0-5f7bc2421c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1ac81609-4fab-4940-9313-6dd7160c7a9b", "address": "fa:16:3e:c9:a8:b1", "network": {"id": "54c4e0a1-6a66-4891-94c3-c85fc5fe181c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2031114495", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac81609-4f", "ovs_interfaceid": "1ac81609-4fab-4940-9313-6dd7160c7a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328732.0875468) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 01:58:52.092530 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 01:58:52.093077 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 01:58:52.102338 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 01:58:52.103173 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 01:58:52.104560 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 01:58:52.104966 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 01:58:52.105159 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 01:58:52.105281 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 01:58:52.105436 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 01:58:52.109658 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 01:58:52.110112 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 01:58:52.110488 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 01:58:52.111606 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:58:52.111813 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 01:58:52.112011 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 01:58:52.112194 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 01:58:52.115036 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 01:58:52.125326 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:58:52.134639 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 01:58:52.135245 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2', 'iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f8b13fac-25c3-40f9-8506-1236b8dc8fd2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:58:52.135412 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:58:52.146905 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "64f1cde4-f11a-4da7-8bbc-aaf777432069" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.153s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:52.181409 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Creating config drive at /opt/stack/data/nova/instances/392bbdc4-beaa-4c44-93f5-3a76f331ceb0/disk.config
May 21 01:58:52.188946 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/392bbdc4-beaa-4c44-93f5-3a76f331ceb0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpm_u4tpss {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:52.233276 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 01:58:52.246039 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/392bbdc4-beaa-4c44-93f5-3a76f331ceb0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpm_u4tpss" returned: 0 in 0.057s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:58:52.442606 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 01:58:52.450502 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 01:58:52.457689 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Instance spawned successfully.
May 21 01:58:52.458670 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 01:58:52.578725 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-48bcad1d-8342-487e-9427-1b456aa0fcb7 req-4b27f0b6-e95c-4a4f-b942-06d0262f32b7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:52.632564 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328732.6318195, 800e7287-2ec0-48a2-b959-d7fbcc1f3c10 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:58:52.633024 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] VM Started (Lifecycle Event)
May 21 01:58:52.835687 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:52.865398 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:52.865398 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:52.991503 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:58:52.991503 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:58:52.999633 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:58:52.999633 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:58:52.999633 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:58:52.999633 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:58:53.011870 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:53.076549 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-48bcad1d-8342-487e-9427-1b456aa0fcb7 req-4b27f0b6-e95c-4a4f-b942-06d0262f32b7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:53.081434 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:53.083532 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:53.113373 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:53.113373 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:53.113373 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Attaching volume 51b4adb6-eb47-40ee-a8ab-9a7ee5901253 to /dev/vdb
May 21 01:58:53.138711 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:58:53.144519 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:58:53.172487 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:58:53.192652 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 01:58:53.237346 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:58:53.267504 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Found WWN 330000000e9f569ee for multipath device dm-2 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 01:58:53.272334 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.063s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:58:53.272334 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] <== connect_volume: return (3067ms) {'type': 'block', 'scsi_wwn': '330000000e9f569ee', 'path': '/dev/dm-2', 'multipath_id': '330000000e9f569ee'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:58:53.273380 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e9f569ee', 'path': '/dev/dm-2', 'multipath_id': '330000000e9f569ee'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 01:58:53.276360 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.141s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:58:53.277021 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2', 'iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f8b13fac-25c3-40f9-8506-1236b8dc8fd2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 01:58:53.294491 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Lazy-loading 'flavor' on Instance uuid f8921842-2161-4ddf-b3c4-b642fc51a70f {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:58:53.311205 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:58:53.311205 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:58:53.311720 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:58:53.314571 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:58:53.314866 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:58:53.315207 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:58:53.315730 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 01:58:53.316152 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 01:58:53.342059 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-48bcad1d-8342-487e-9427-1b456aa0fcb7 req-4b27f0b6-e95c-4a4f-b942-06d0262f32b7 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Updated VIF entry in instance network info cache for port 1ac81609-4fab-4940-9313-6dd7160c7a9b. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 01:58:53.344514 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-48bcad1d-8342-487e-9427-1b456aa0fcb7 req-4b27f0b6-e95c-4a4f-b942-06d0262f32b7 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Updating instance_info_cache with network_info: [{"id": "f99ceda9-fad6-4a73-af2a-c63d3d320e2f", "address": "fa:16:3e:f8:14:ac", "network": {"id": "0ab35e13-b362-4576-91d1-569cb811b2d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1427614225-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf99ceda9-fa", "ovs_interfaceid": "f99ceda9-fad6-4a73-af2a-c63d3d320e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71580ee4-3192-484a-9ee6-5096ac78a4ce", "address": "fa:16:3e:32:44:18", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71580ee4-31", "ovs_interfaceid": "71580ee4-3192-484a-9ee6-5096ac78a4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9e74661c-8435-43a4-82d7-b7d757552d24", "address": "fa:16:3e:e6:51:87", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e74661c-84", "ovs_interfaceid": "9e74661c-8435-43a4-82d7-b7d757552d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "407bbd3c-7537-4404-aaf5-a5ed533bb33b", "address": "fa:16:3e:80:dd:78", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap407bbd3c-75", "ovs_interfaceid": "407bbd3c-7537-4404-aaf5-a5ed533bb33b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a350a027-1ffc-4539-a238-d98bbb9baeba", "address": "fa:16:3e:19:d5:ae", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa350a027-1f", "ovs_interfaceid": "a350a027-1ffc-4539-a238-d98bbb9baeba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58939f92-ac70-47fb-90c0-5f7bc2421c47", "address": "fa:16:3e:db:3c:f9", "network": {"id": "54c4e0a1-6a66-4891-94c3-c85fc5fe181c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2031114495", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58939f92-ac", "ovs_interfaceid": "58939f92-ac70-47fb-90c0-5f7bc2421c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1ac81609-4fab-4940-9313-6dd7160c7a9b", "address": "fa:16:3e:c9:a8:b1", "network": {"id": "54c4e0a1-6a66-4891-94c3-c85fc5fe181c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2031114495", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac81609-4f", "ovs_interfaceid": "1ac81609-4fab-4940-9313-6dd7160c7a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:58:53.345815 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 01:58:53.345815 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:53.345815 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 01:58:53.345815 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:53.346619 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 01:58:53.348070 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe9e:216', 'fe80::14d9:7bff:fe3b:f0dc', 'fe80::fc16:3eff:feef:6106', 'fe80::4f8:d7ff:fe7a:a4fe', 'fe80::fc16:3eff:fee3:f7d2', 'fe80::6c2e:11ff:fea1:7eb7', 'fe80::fc16:3eff:fe30:ade5', 'fe80::fc16:3eff:fe76:c870', 'fe80::a403:4dff:fe5a:1b07', 'fe80::fc16:3eff:fe12:668e', 'fe80::c062:49ff:fe28:b40d', 'fe80::fc16:3eff:feaf:51f1', 'fe80::68db:c7ff:fe71:da32', 'fe80::fc16:3eff:fe50:bfd8'] 
May 21 01:58:53.348458 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 01:58:53.348618 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 01:58:53.348805 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] <== get_connector_properties: return (176ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:58:53.349194 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Updating existing volume attachment record: 5274ff3b-b2fa-4701-8c3c-904404913c6b {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 01:58:53.364957 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2] added
May 21 01:58:53.364957 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 01:58:53.364957 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:58:53.364957 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:58:53.364957 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:58:53.364957 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:58:53.364957 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:53.365449 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 01:58:53.365449 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0513(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 01:58:53.367002 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 01:58:53.374851 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2] added
May 21 01:58:53.374851 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 01:58:53.374851 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:58:53.374851 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:58:53.374851 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:58:53.374851 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:58:53.374851 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:53.375155 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 01:58:53.375291 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0604(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 01:58:53.375489 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 01:58:53.505998 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Took 7.74 seconds to spawn the instance on the hypervisor.
May 21 01:58:53.506519 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:58:53.557425 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8cf52bef-c7ca-451d-9ec1-2cfa5b8f6db3 req-bf49aa0f-3588-40ae-92ad-fa0f7826a4dd service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Received event network-vif-plugged-44670b22-c758-456b-a200-f0323baea57f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:53.557425 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8cf52bef-c7ca-451d-9ec1-2cfa5b8f6db3 req-bf49aa0f-3588-40ae-92ad-fa0f7826a4dd service nova] Acquiring lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:53.557425 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8cf52bef-c7ca-451d-9ec1-2cfa5b8f6db3 req-bf49aa0f-3588-40ae-92ad-fa0f7826a4dd service nova] Lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:53.557425 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8cf52bef-c7ca-451d-9ec1-2cfa5b8f6db3 req-bf49aa0f-3588-40ae-92ad-fa0f7826a4dd service nova] Lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:53.557425 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8cf52bef-c7ca-451d-9ec1-2cfa5b8f6db3 req-bf49aa0f-3588-40ae-92ad-fa0f7826a4dd service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Processing event network-vif-plugged-44670b22-c758-456b-a200-f0323baea57f {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 01:58:53.649892 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 01:58:53.650588 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328733.650001, 800e7287-2ec0-48a2-b959-d7fbcc1f3c10 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:58:53.650588 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] VM Paused (Lifecycle Event)
May 21 01:58:53.680923 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7b5917cd-c2a9-411e-99dc-11d4f1d0bace req-81f2db15-6c4c-43eb-9f36-00015b3961d7 service nova] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Received event network-vif-plugged-23851da2-f984-4946-af6d-2b652ff984e1 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:53.680923 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7b5917cd-c2a9-411e-99dc-11d4f1d0bace req-81f2db15-6c4c-43eb-9f36-00015b3961d7 service nova] Acquiring lock "800e7287-2ec0-48a2-b959-d7fbcc1f3c10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:53.680923 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7b5917cd-c2a9-411e-99dc-11d4f1d0bace req-81f2db15-6c4c-43eb-9f36-00015b3961d7 service nova] Lock "800e7287-2ec0-48a2-b959-d7fbcc1f3c10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:53.680923 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7b5917cd-c2a9-411e-99dc-11d4f1d0bace req-81f2db15-6c4c-43eb-9f36-00015b3961d7 service nova] Lock "800e7287-2ec0-48a2-b959-d7fbcc1f3c10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:53.680923 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7b5917cd-c2a9-411e-99dc-11d4f1d0bace req-81f2db15-6c4c-43eb-9f36-00015b3961d7 service nova] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] No waiting events found dispatching network-vif-plugged-23851da2-f984-4946-af6d-2b652ff984e1 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:58:53.680923 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-7b5917cd-c2a9-411e-99dc-11d4f1d0bace req-81f2db15-6c4c-43eb-9f36-00015b3961d7 service nova] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Received unexpected event network-vif-plugged-23851da2-f984-4946-af6d-2b652ff984e1 for instance with vm_state active and task_state None.
May 21 01:58:53.802559 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] attach device xml: <disk type="block" device="disk">
May 21 01:58:53.802559 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:58:53.802559 np0000001127 nova-compute[98206]:   <alias name="ua-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9"/>
May 21 01:58:53.802559 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-2"/>
May 21 01:58:53.802559 np0000001127 nova-compute[98206]:   <target dev="sdc" bus="scsi"/>
May 21 01:58:53.802559 np0000001127 nova-compute[98206]:   <serial>9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9</serial>
May 21 01:58:53.802559 np0000001127 nova-compute[98206]:   <address type="drive" controller="0" unit="2"/>
May 21 01:58:53.802559 np0000001127 nova-compute[98206]: </disk>
May 21 01:58:53.802559 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 01:58:53.847304 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-48bcad1d-8342-487e-9427-1b456aa0fcb7 req-4b27f0b6-e95c-4a4f-b942-06d0262f32b7 service nova] Releasing lock "refresh_cache-a4b3355b-92d6-4b36-8dad-6cb4b3c579a2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:58:53.963540 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 01:58:53.963684 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '51b4adb6-eb47-40ee-a8ab-9a7ee5901253', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:58:53.964303 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:58:54.037493 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Took 13.98 seconds to build instance.
May 21 01:58:54.153679 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:58:54.157626 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328734.1572573, 800e7287-2ec0-48a2-b959-d7fbcc1f3c10 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:58:54.157755 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] VM Resumed (Lifecycle Event)
May 21 01:58:54.367622 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:58:54.378455 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.startup = manual
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:58:54.391781 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:58:54.391781 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.startup = manual
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:58:54.399512 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:58:54.399512 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:54.412200 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:54.424768 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 01:58:54.426152 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:54.429384 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 01:58:54.435579 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Instance spawned successfully.
May 21 01:58:54.436501 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 01:58:54.445178 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:54.445178 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:54.445178 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:54.445178 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:54.445178 np0000001127 nova-compute[98206]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:58:54.445178 np0000001127 nova-compute[98206]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:58:54.445178 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:58:54.445827 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsi session list stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:54.445827 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:54.445827 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:54.445827 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:54.445827 np0000001127 nova-compute[98206]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:58:54.445827 np0000001127 nova-compute[98206]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:58:54.445827 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:58:54.454038 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:54.454038 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:54.454038 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:54.454038 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:54.454038 np0000001127 nova-compute[98206]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:58:54.454038 np0000001127 nova-compute[98206]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:58:54.454038 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:58:54.454421 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsi session list stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:54.454421 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:54.454421 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:54.454421 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:54.454421 np0000001127 nova-compute[98206]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:58:54.454421 np0000001127 nova-compute[98206]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:58:54.454421 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:58:54.494711 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2, portal: 192.168.40.100,3260]
May 21 01:58:54.494711 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2, portal: 192.168.40.100,3260] successful.
May 21 01:58:54.494711 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:54.507031 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2, portal: 192.168.50.100,3260]
May 21 01:58:54.507031 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2, portal: 192.168.50.100,3260] successful.
May 21 01:58:54.507031 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:54.518972 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:54.528675 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:54.549167 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:54.549167 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:54.549167 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:54.549167 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:54.549167 np0000001127 nova-compute[98206]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:58:54.549167 np0000001127 nova-compute[98206]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:58:54.549167 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:58:54.549167 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:58:54.549167 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:58:54.549711 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsi session list stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:54.549711 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:54.549711 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:54.549711 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:54.549711 np0000001127 nova-compute[98206]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:58:54.549711 np0000001127 nova-compute[98206]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:58:54.549711 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:58:54.549711 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:58:54.549711 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:58:54.550222 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1a99cecb-fcff-4864-aa1b-1426a228f1b2 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "800e7287-2ec0-48a2-b959-d7fbcc1f3c10" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.508s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:54.551592 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.239s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:58:54.551592 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:58:54.552977 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:54.552977 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:54.552977 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:54.552977 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:54.552977 np0000001127 nova-compute[98206]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:58:54.552977 np0000001127 nova-compute[98206]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:58:54.552977 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:58:54.552977 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:58:54.552977 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:58:54.553941 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsi session list stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:54.553941 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:54.553941 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:54.553941 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:54.553941 np0000001127 nova-compute[98206]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:58:54.553941 np0000001127 nova-compute[98206]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:58:54.553941 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:58:54.553941 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:58:54.553941 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:58:54.553941 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.240s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:58:54.553941 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:58:54.557529 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] HCTL ('14', '-', '-', 0) found on session 31 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:58:54.557529 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:58:54.558496 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] HCTL ('13', '-', '-', 0) found on session 30 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:58:54.558496 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:58:54.619625 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Searching for a device in session 30 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:58:54.619625 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f8b13fac-25c3-40f9-8506-1236b8dc8fd2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:58:54.619625 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Searching for a device in session 31 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:58:54.619625 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f8b13fac-25c3-40f9-8506-1236b8dc8fd2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:58:54.662671 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:58:54.667839 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:58:54.926787 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:54.947824 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:58:54.948087 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:58:54.949391 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:58:54.949391 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:58:54.953875 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:58:54.955428 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:58:55.173685 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328735.1714158, 392bbdc4-beaa-4c44-93f5-3a76f331ceb0 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:58:55.173685 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] VM Started (Lifecycle Event)
May 21 01:58:55.316341 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 01:58:55.462689 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Took 9.68 seconds to spawn the instance on the hypervisor.
May 21 01:58:55.462689 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:58:55.597665 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] No BDM found with device name sda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:58:55.598504 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] No BDM found with device name sdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:58:55.598504 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] No BDM found with device name sdc, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:58:55.598504 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] No VIF found with MAC fa:16:3e:ef:61:06, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 01:58:55.671940 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a1ac623f-65d1-46e2-acbe-7424ce3b6d09 req-fc13eea1-623d-45e7-b382-f1e66f225f28 service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Received event network-changed-3b1f76f9-cf49-4dea-b9a2-762c2ad220bf {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:55.672535 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a1ac623f-65d1-46e2-acbe-7424ce3b6d09 req-fc13eea1-623d-45e7-b382-f1e66f225f28 service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Refreshing instance network info cache due to event network-changed-3b1f76f9-cf49-4dea-b9a2-762c2ad220bf. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:58:55.672535 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a1ac623f-65d1-46e2-acbe-7424ce3b6d09 req-fc13eea1-623d-45e7-b382-f1e66f225f28 service nova] Acquiring lock "refresh_cache-64f1cde4-f11a-4da7-8bbc-aaf777432069" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:58:55.672659 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a1ac623f-65d1-46e2-acbe-7424ce3b6d09 req-fc13eea1-623d-45e7-b382-f1e66f225f28 service nova] Acquired lock "refresh_cache-64f1cde4-f11a-4da7-8bbc-aaf777432069" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:58:55.672975 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-a1ac623f-65d1-46e2-acbe-7424ce3b6d09 req-fc13eea1-623d-45e7-b382-f1e66f225f28 service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Refreshing network info cache for port 3b1f76f9-cf49-4dea-b9a2-762c2ad220bf {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:58:55.677266 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:58:55.682527 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:58:55.890549 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2498e099-6bf2-49f0-a1eb-4ec15f7cf34a req-5b90bb8f-7faf-446e-b2eb-48e267aaa4f4 service nova] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Received event network-changed-23851da2-f984-4946-af6d-2b652ff984e1 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:55.890695 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2498e099-6bf2-49f0-a1eb-4ec15f7cf34a req-5b90bb8f-7faf-446e-b2eb-48e267aaa4f4 service nova] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Refreshing instance network info cache due to event network-changed-23851da2-f984-4946-af6d-2b652ff984e1. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:58:55.890829 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2498e099-6bf2-49f0-a1eb-4ec15f7cf34a req-5b90bb8f-7faf-446e-b2eb-48e267aaa4f4 service nova] Acquiring lock "refresh_cache-800e7287-2ec0-48a2-b959-d7fbcc1f3c10" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:58:55.890916 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2498e099-6bf2-49f0-a1eb-4ec15f7cf34a req-5b90bb8f-7faf-446e-b2eb-48e267aaa4f4 service nova] Acquired lock "refresh_cache-800e7287-2ec0-48a2-b959-d7fbcc1f3c10" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:58:55.891047 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-2498e099-6bf2-49f0-a1eb-4ec15f7cf34a req-5b90bb8f-7faf-446e-b2eb-48e267aaa4f4 service nova] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Refreshing network info cache for port 23851da2-f984-4946-af6d-2b652ff984e1 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:58:55.975797 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Took 22.00 seconds to build instance.
May 21 01:58:56.168860 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:58:56.177819 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-a1ac623f-65d1-46e2-acbe-7424ce3b6d09 req-fc13eea1-623d-45e7-b382-f1e66f225f28 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:56.186713 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328736.1864178, 392bbdc4-beaa-4c44-93f5-3a76f331ceb0 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:58:56.186828 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] VM Paused (Lifecycle Event)
May 21 01:58:56.338160 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Found WWN 330000000347729e8 for multipath device dm-3 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 01:58:56.338878 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.063s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:58:56.339293 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] <== connect_volume: return (4203ms) {'type': 'block', 'scsi_wwn': '330000000347729e8', 'path': '/dev/dm-3', 'multipath_id': '330000000347729e8'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:58:56.339482 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000347729e8', 'path': '/dev/dm-3', 'multipath_id': '330000000347729e8'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 01:58:56.339814 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.376s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:58:56.340403 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '51b4adb6-eb47-40ee-a8ab-9a7ee5901253', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 01:58:56.355850 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:58:56.356356 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:58:56.356560 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:58:56.357498 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:58:56.359439 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:58:56.359439 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:58:56.372903 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 01:58:56.372903 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:56.379668 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 01:58:56.379668 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:56.388693 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253] added
May 21 01:58:56.388693 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 01:58:56.388693 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:58:56.388693 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:58:56.388693 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:58:56.388693 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:58:56.388693 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:56.388978 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 01:58:56.389240 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0307(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 01:58:56.389427 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 01:58:56.396631 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-2498e099-6bf2-49f0-a1eb-4ec15f7cf34a req-5b90bb8f-7faf-446e-b2eb-48e267aaa4f4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:56.402869 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253] added
May 21 01:58:56.402869 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 01:58:56.402869 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:58:56.402869 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:58:56.402869 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:58:56.402869 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:58:56.402869 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:56.403406 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 01:58:56.403406 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0467(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 01:58:56.403406 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 01:58:56.477159 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.515s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:56.646414 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-a1ac623f-65d1-46e2-acbe-7424ce3b6d09 req-fc13eea1-623d-45e7-b382-f1e66f225f28 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:56.690136 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:58:56.694661 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328736.69308, 392bbdc4-beaa-4c44-93f5-3a76f331ceb0 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:58:56.696652 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] VM Resumed (Lifecycle Event)
May 21 01:58:56.851005 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 01:58:56.852118 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6', 'iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5410bf8e-8978-4bf4-b8f9-592be340a6b6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:58:56.852377 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:58:57.002286 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-a1ac623f-65d1-46e2-acbe-7424ce3b6d09 req-fc13eea1-623d-45e7-b382-f1e66f225f28 service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Updated VIF entry in instance network info cache for port 3b1f76f9-cf49-4dea-b9a2-762c2ad220bf. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 01:58:57.003033 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-a1ac623f-65d1-46e2-acbe-7424ce3b6d09 req-fc13eea1-623d-45e7-b382-f1e66f225f28 service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Updating instance_info_cache with network_info: [{"id": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "address": "fa:16:3e:12:66:8e", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1f76f9-cf", "ovs_interfaceid": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:58:57.022396 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-2498e099-6bf2-49f0-a1eb-4ec15f7cf34a req-5b90bb8f-7faf-446e-b2eb-48e267aaa4f4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:57.201907 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:58:57.205881 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:58:57.229862 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8524b2b7-b950-4ccc-b1bf-26d73bf204e2 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Lock "f8921842-2161-4ddf-b3c4-b642fc51a70f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.784s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:57.238641 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-2498e099-6bf2-49f0-a1eb-4ec15f7cf34a req-5b90bb8f-7faf-446e-b2eb-48e267aaa4f4 service nova] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Updated VIF entry in instance network info cache for port 23851da2-f984-4946-af6d-2b652ff984e1. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 01:58:57.241412 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-2498e099-6bf2-49f0-a1eb-4ec15f7cf34a req-5b90bb8f-7faf-446e-b2eb-48e267aaa4f4 service nova] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Updating instance_info_cache with network_info: [{"id": "23851da2-f984-4946-af6d-2b652ff984e1", "address": "fa:16:3e:af:51:f1", "network": {"id": "aba610ba-f311-41c2-b94d-2495441912e4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-360728390-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a80dd2c84334f79afe5cb079c50c555", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23851da2-f9", "ovs_interfaceid": "23851da2-f984-4946-af6d-2b652ff984e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:58:57.389933 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.startup = manual
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:58:57.403918 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:58:57.403918 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:57.407845 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:58:57.420712 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.startup = manual
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:58:57.423517 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:58:57.423517 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:57.438508 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:57.438508 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:57.438508 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:57.438508 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:57.438508 np0000001127 nova-compute[98206]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:58:57.438508 np0000001127 nova-compute[98206]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:58:57.438508 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:58:57.438508 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:58:57.438508 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:58:57.438508 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsi session list stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:57.438508 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:57.438508 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:57.438508 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:57.438508 np0000001127 nova-compute[98206]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:58:57.438508 np0000001127 nova-compute[98206]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:58:57.438508 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:58:57.438508 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:58:57.438508 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:58:57.450259 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:57.470421 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:57.470421 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:57.470421 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:57.470421 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:57.470421 np0000001127 nova-compute[98206]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:58:57.470421 np0000001127 nova-compute[98206]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:58:57.470421 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:58:57.470421 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:58:57.470421 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:58:57.470804 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsi session list stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:57.470804 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:57.470804 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:57.470804 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:57.470804 np0000001127 nova-compute[98206]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:58:57.470804 np0000001127 nova-compute[98206]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:58:57.470804 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:58:57.470804 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:58:57.470804 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:58:57.497743 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253, portal: 192.168.50.100,3260]
May 21 01:58:57.497743 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253, portal: 192.168.50.100,3260] successful.
May 21 01:58:57.497743 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:57.512099 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a1ac623f-65d1-46e2-acbe-7424ce3b6d09 req-fc13eea1-623d-45e7-b382-f1e66f225f28 service nova] Releasing lock "refresh_cache-64f1cde4-f11a-4da7-8bbc-aaf777432069" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:58:57.512490 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a1ac623f-65d1-46e2-acbe-7424ce3b6d09 req-fc13eea1-623d-45e7-b382-f1e66f225f28 service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Received event network-vif-plugged-44670b22-c758-456b-a200-f0323baea57f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:58:57.514694 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a1ac623f-65d1-46e2-acbe-7424ce3b6d09 req-fc13eea1-623d-45e7-b382-f1e66f225f28 service nova] Acquiring lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:57.514694 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a1ac623f-65d1-46e2-acbe-7424ce3b6d09 req-fc13eea1-623d-45e7-b382-f1e66f225f28 service nova] Lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:57.514694 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a1ac623f-65d1-46e2-acbe-7424ce3b6d09 req-fc13eea1-623d-45e7-b382-f1e66f225f28 service nova] Lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:58:57.514694 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a1ac623f-65d1-46e2-acbe-7424ce3b6d09 req-fc13eea1-623d-45e7-b382-f1e66f225f28 service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] No waiting events found dispatching network-vif-plugged-44670b22-c758-456b-a200-f0323baea57f {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:58:57.514694 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-a1ac623f-65d1-46e2-acbe-7424ce3b6d09 req-fc13eea1-623d-45e7-b382-f1e66f225f28 service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Received unexpected event network-vif-plugged-44670b22-c758-456b-a200-f0323baea57f for instance with vm_state active and task_state None.
May 21 01:58:57.516269 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:57.517346 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253, portal: 192.168.40.100,3260]
May 21 01:58:57.517346 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253, portal: 192.168.40.100,3260] successful.
May 21 01:58:57.517346 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:57.534935 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:57.540873 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:57.540873 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:57.540873 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:57.540873 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:57.540873 np0000001127 nova-compute[98206]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:58:57.540873 np0000001127 nova-compute[98206]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:58:57.540873 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:58:57.540873 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:58:57.540873 np0000001127 nova-compute[98206]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:58:57.540873 np0000001127 nova-compute[98206]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:58:57.540873 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:58:57.541299 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsi session list stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:57.541299 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:57.541299 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:57.541299 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:57.541299 np0000001127 nova-compute[98206]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:58:57.541299 np0000001127 nova-compute[98206]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:58:57.541299 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:58:57.541299 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:58:57.541299 np0000001127 nova-compute[98206]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:58:57.541299 np0000001127 nova-compute[98206]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:58:57.541299 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:58:57.541598 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.183s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:58:57.541598 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:58:57.542948 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] HCTL ('15', '-', '-', 0) found on session 32 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:58:57.543089 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:58:57.551855 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:57.551855 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:57.551855 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:57.551855 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:57.551855 np0000001127 nova-compute[98206]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:58:57.551855 np0000001127 nova-compute[98206]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:58:57.551855 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:58:57.551855 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:58:57.551855 np0000001127 nova-compute[98206]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:58:57.551855 np0000001127 nova-compute[98206]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:58:57.551855 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:58:57.552142 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsi session list stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:57.552142 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:58:57.552142 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:57.552142 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:58:57.552142 np0000001127 nova-compute[98206]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:58:57.552142 np0000001127 nova-compute[98206]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:58:57.552142 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:58:57.552142 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:58:57.552142 np0000001127 nova-compute[98206]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:58:57.552142 np0000001127 nova-compute[98206]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:58:57.552142 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:58:57.552557 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.196s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:58:57.554173 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:58:57.557516 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] HCTL ('16', '-', '-', 0) found on session 33 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:58:57.557516 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:58:57.559974 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Searching for a device in session 32 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:58:57.560227 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '51b4adb6-eb47-40ee-a8ab-9a7ee5901253', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:58:57.577273 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Searching for a device in session 33 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:58:57.577380 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '51b4adb6-eb47-40ee-a8ab-9a7ee5901253', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:58:57.665078 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Acquiring lock "f8921842-2161-4ddf-b3c4-b642fc51a70f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:58:57.665731 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Lock "f8921842-2161-4ddf-b3c4-b642fc51a70f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:58:57.742780 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2498e099-6bf2-49f0-a1eb-4ec15f7cf34a req-5b90bb8f-7faf-446e-b2eb-48e267aaa4f4 service nova] Releasing lock "refresh_cache-800e7287-2ec0-48a2-b959-d7fbcc1f3c10" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:58:58.177642 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Detaching volume 9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9
May 21 01:58:58.240437 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Attempting to driver detach volume 9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 from mountpoint /dev/sdc
May 21 01:58:58.246977 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Found disk sdc by alias ua-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 01:58:58.249069 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Found disk sdc by alias ua-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 01:58:58.249069 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Attempting to detach device sdc from instance f8921842-2161-4ddf-b3c4-b642fc51a70f from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 01:58:58.249903 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] detach device xml: <disk type="block" device="disk">
May 21 01:58:58.249903 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:58:58.249903 np0000001127 nova-compute[98206]:   <alias name="ua-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9"/>
May 21 01:58:58.249903 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-2"/>
May 21 01:58:58.249903 np0000001127 nova-compute[98206]:   <target dev="sdc" bus="scsi"/>
May 21 01:58:58.249903 np0000001127 nova-compute[98206]:   <serial>9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9</serial>
May 21 01:58:58.249903 np0000001127 nova-compute[98206]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
May 21 01:58:58.249903 np0000001127 nova-compute[98206]: </disk>
May 21 01:58:58.249903 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 01:58:58.268109 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Successfully detached device sdc from instance f8921842-2161-4ddf-b3c4-b642fc51a70f from the persistent domain config.
May 21 01:58:58.268280 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] (1/8): Attempting to detach device sdc with device alias ua-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 from instance f8921842-2161-4ddf-b3c4-b642fc51a70f from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 01:58:58.268608 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] detach device xml: <disk type="block" device="disk">
May 21 01:58:58.268608 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:58:58.268608 np0000001127 nova-compute[98206]:   <alias name="ua-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9"/>
May 21 01:58:58.268608 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-2"/>
May 21 01:58:58.268608 np0000001127 nova-compute[98206]:   <target dev="sdc" bus="scsi"/>
May 21 01:58:58.268608 np0000001127 nova-compute[98206]:   <serial>9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9</serial>
May 21 01:58:58.268608 np0000001127 nova-compute[98206]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
May 21 01:58:58.268608 np0000001127 nova-compute[98206]: </disk>
May 21 01:58:58.268608 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 01:58:58.360787 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 01:58:58.364985 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Rescuing
May 21 01:58:58.365305 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "refresh_cache-392bbdc4-beaa-4c44-93f5-3a76f331ceb0" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:58:58.365482 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquired lock "refresh_cache-392bbdc4-beaa-4c44-93f5-3a76f331ceb0" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:58:58.366229 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 01:58:58.477873 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779328738.4773777, f8921842-2161-4ddf-b3c4-b642fc51a70f => ua-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 01:58:58.479273 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Start waiting for the detach event from libvirt for device sdc with device alias ua-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 for instance f8921842-2161-4ddf-b3c4-b642fc51a70f {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 01:58:58.483271 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Successfully detached device sdc from instance f8921842-2161-4ddf-b3c4-b642fc51a70f from the live domain config.
May 21 01:58:58.496196 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 01:58:58.496551 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9', 'iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:58:58.496701 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:58:58.871074 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:59.237906 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:58:59.391734 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Found WWN 3300000009b658662 for multipath device dm-6 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 01:58:59.392190 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.052s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:58:59.393252 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] <== connect_volume: return (5428ms) {'type': 'block', 'scsi_wwn': '3300000009b658662', 'path': '/dev/dm-6', 'multipath_id': '3300000009b658662'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:58:59.393252 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.540s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:58:59.393252 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6', 'iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5410bf8e-8978-4bf4-b8f9-592be340a6b6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 01:58:59.393252 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009b658662', 'path': '/dev/dm-6', 'multipath_id': '3300000009b658662'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 01:58:59.399091 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lazy-loading 'flavor' on Instance uuid a6839691-a7ec-4dea-bc39-a7e89c94cf4d {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:58:59.414907 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Updating instance_info_cache with network_info: [{"id": "44670b22-c758-456b-a200-f0323baea57f", "address": "fa:16:3e:50:bf:d8", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap44670b22-c7", "ovs_interfaceid": "44670b22-c758-456b-a200-f0323baea57f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:58:59.420649 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:58:59.420649 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:58:59.420649 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:58:59.422499 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:58:59.422499 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:58:59.425977 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:58:59.437127 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 01:58:59.437127 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:59.445549 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 01:58:59.445549 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:59.451811 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6] added
May 21 01:58:59.451811 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 01:58:59.451811 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:58:59.451811 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:58:59.451811 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:58:59.451811 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:58:59.451811 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:59.453550 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 01:58:59.453965 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0344(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 01:58:59.455100 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 01:58:59.458241 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6] added
May 21 01:58:59.458241 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 01:58:59.458241 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:58:59.458241 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:58:59.458241 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:58:59.458241 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:58:59.458241 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:58:59.458493 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 01:58:59.458634 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0334(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 01:58:59.458783 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 01:58:59.903140 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Attempting to attach volume 51b4adb6-eb47-40ee-a8ab-9a7ee5901253 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 01:58:59.904459 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] attach device xml: <disk type="block" device="disk">
May 21 01:58:59.904459 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:58:59.904459 np0000001127 nova-compute[98206]:   <alias name="ua-51b4adb6-eb47-40ee-a8ab-9a7ee5901253"/>
May 21 01:58:59.904459 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-6"/>
May 21 01:58:59.904459 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 01:58:59.904459 np0000001127 nova-compute[98206]:   <serial>51b4adb6-eb47-40ee-a8ab-9a7ee5901253</serial>
May 21 01:58:59.904459 np0000001127 nova-compute[98206]: </disk>
May 21 01:58:59.904459 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 01:58:59.918724 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Releasing lock "refresh_cache-392bbdc4-beaa-4c44-93f5-3a76f331ceb0" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:58:59.934601 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:00.456261 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:59:00.459720 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.startup = manual
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:59:00.468976 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:59:00.468976 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.startup = manual
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:59:00.481513 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:59:00.481513 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:00.489755 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:00.501844 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:00.508572 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:59:00.508572 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:59:00.508572 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:00.508572 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:00.508572 np0000001127 nova-compute[98206]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:59:00.508572 np0000001127 nova-compute[98206]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:59:00.508572 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:00.508572 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:00.508572 np0000001127 nova-compute[98206]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:00.508572 np0000001127 nova-compute[98206]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:00.508572 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:59:00.508989 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsi session list stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:59:00.508989 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:59:00.508989 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:00.508989 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:00.508989 np0000001127 nova-compute[98206]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:59:00.508989 np0000001127 nova-compute[98206]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:59:00.508989 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:00.508989 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:00.508989 np0000001127 nova-compute[98206]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:00.508989 np0000001127 nova-compute[98206]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:00.508989 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:59:00.521694 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:59:00.521694 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:59:00.521694 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:00.521694 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:00.521694 np0000001127 nova-compute[98206]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:59:00.521694 np0000001127 nova-compute[98206]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:59:00.521694 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:00.521694 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:00.521694 np0000001127 nova-compute[98206]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:00.521694 np0000001127 nova-compute[98206]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:00.521694 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:59:00.522034 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsi session list stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:59:00.522034 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:59:00.522034 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:00.522034 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:00.522034 np0000001127 nova-compute[98206]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:59:00.522034 np0000001127 nova-compute[98206]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:59:00.522034 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:00.522034 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:00.522034 np0000001127 nova-compute[98206]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:00.522034 np0000001127 nova-compute[98206]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:00.522034 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:59:00.556094 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6, portal: 192.168.40.100,3260]
May 21 01:59:00.556094 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6, portal: 192.168.40.100,3260] successful.
May 21 01:59:00.556094 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:00.571140 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:00.582397 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6, portal: 192.168.50.100,3260]
May 21 01:59:00.582397 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6, portal: 192.168.50.100,3260] successful.
May 21 01:59:00.582397 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:00.595141 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:59:00.595141 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:59:00.595141 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:00.595141 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:00.595141 np0000001127 nova-compute[98206]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:59:00.595141 np0000001127 nova-compute[98206]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:59:00.595141 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:00.595141 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:00.595141 np0000001127 nova-compute[98206]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:00.595141 np0000001127 nova-compute[98206]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:00.595141 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:00.595141 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:00.595141 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:59:00.595511 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsi session list stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:59:00.595511 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:59:00.595511 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:00.595511 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:00.595511 np0000001127 nova-compute[98206]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:59:00.595511 np0000001127 nova-compute[98206]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:59:00.595511 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:00.595511 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:00.595511 np0000001127 nova-compute[98206]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:00.595511 np0000001127 nova-compute[98206]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:00.595511 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:00.595511 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:00.595511 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:59:00.596981 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.176s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:59:00.596981 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:59:00.597099 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] HCTL ('17', '-', '-', 0) found on session 34 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:59:00.597208 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:59:00.597932 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:00.621510 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Searching for a device in session 34 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:59:00.622774 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5410bf8e-8978-4bf4-b8f9-592be340a6b6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:59:00.635113 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:59:00.635113 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:59:00.635113 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:00.635113 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:00.635113 np0000001127 nova-compute[98206]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:59:00.635113 np0000001127 nova-compute[98206]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:59:00.635113 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:00.635113 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:00.635113 np0000001127 nova-compute[98206]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:00.635113 np0000001127 nova-compute[98206]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:00.635113 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:00.635113 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:00.635113 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:59:00.636113 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsi session list stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:59:00.636113 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:59:00.636113 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:00.636113 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:00.636113 np0000001127 nova-compute[98206]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:59:00.636113 np0000001127 nova-compute[98206]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:59:00.636113 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:00.636113 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:00.636113 np0000001127 nova-compute[98206]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:00.636113 np0000001127 nova-compute[98206]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:00.636113 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:00.636113 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:00.636113 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:59:00.636113 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.213s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:59:00.636113 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:59:00.636764 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] HCTL ('18', '-', '-', 0) found on session 35 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:59:00.637397 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:59:00.659310 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Searching for a device in session 35 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:59:00.659310 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5410bf8e-8978-4bf4-b8f9-592be340a6b6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:59:01.178154 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:01.430272 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 01:59:01.579648 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:01.601832 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:01.623391 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:59:01.624189 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:59:01.624507 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:59:01.624659 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] No VIF found with MAC fa:16:3e:76:c8:70, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 01:59:01.765315 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:01.773848 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:01.797022 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-23999669-f3e4-46bc-b3eb-b9a98a8dbc09 req-52692b4e-a367-404d-94f6-036b5cdf3d1c service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Received event network-vif-unplugged-44670b22-c758-456b-a200-f0323baea57f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:01.799458 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-23999669-f3e4-46bc-b3eb-b9a98a8dbc09 req-52692b4e-a367-404d-94f6-036b5cdf3d1c service nova] Acquiring lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:01.799948 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-23999669-f3e4-46bc-b3eb-b9a98a8dbc09 req-52692b4e-a367-404d-94f6-036b5cdf3d1c service nova] Lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:01.800265 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-23999669-f3e4-46bc-b3eb-b9a98a8dbc09 req-52692b4e-a367-404d-94f6-036b5cdf3d1c service nova] Lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:01.800342 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-23999669-f3e4-46bc-b3eb-b9a98a8dbc09 req-52692b4e-a367-404d-94f6-036b5cdf3d1c service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] No waiting events found dispatching network-vif-unplugged-44670b22-c758-456b-a200-f0323baea57f {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:59:01.801789 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-23999669-f3e4-46bc-b3eb-b9a98a8dbc09 req-52692b4e-a367-404d-94f6-036b5cdf3d1c service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Received unexpected event network-vif-unplugged-44670b22-c758-456b-a200-f0323baea57f for instance with vm_state active and task_state rescuing.
May 21 01:59:01.880731 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.99959823600011 future=<Future at 0x71c05864fe00 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:59:01.881617 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.99871181200001 future=<Future at 0x71c05864fe00 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:59:01.885428 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.995993951999935 future=<Future at 0x71c05864fe00 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:59:01.889933 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Instance destroyed successfully.
May 21 01:59:01.889933 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lazy-loading 'numa_topology' on Instance uuid 392bbdc4-beaa-4c44-93f5-3a76f331ceb0 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:59:01.947541 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:02.397309 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Attempting a stable device rescue
May 21 01:59:02.451514 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Found WWN 3300000009dd5ed90 for multipath device dm-7 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 01:59:02.451884 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.059s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:59:02.451979 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] <== connect_volume: return (5599ms) {'type': 'block', 'scsi_wwn': '3300000009dd5ed90', 'path': '/dev/dm-7', 'multipath_id': '3300000009dd5ed90'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:59:02.452563 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009dd5ed90', 'path': '/dev/dm-7', 'multipath_id': '3300000009dd5ed90'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 01:59:02.453041 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 3.956s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:59:02.453171 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9', 'iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 01:59:02.453353 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 01:59:02.493868 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:59:02.493868 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:59:02.493868 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:02.493868 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:02.493868 np0000001127 nova-compute[98206]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:59:02.493868 np0000001127 nova-compute[98206]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:59:02.493868 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:02.493868 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:02.493868 np0000001127 nova-compute[98206]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:02.493868 np0000001127 nova-compute[98206]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:02.493868 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:02.493868 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:02.493868 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:59:02.493868 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] iscsi session list stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:59:02.493868 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:59:02.493868 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:02.493868 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:02.493868 np0000001127 nova-compute[98206]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:59:02.493868 np0000001127 nova-compute[98206]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9 (non-flash)
May 21 01:59:02.493868 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:02.493868 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:02.493868 np0000001127 nova-compute[98206]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:02.493868 np0000001127 nova-compute[98206]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:02.493868 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:02.493868 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:02.493868 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:59:02.493868 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6', '35')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 01:59:02.493868 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9', '29')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 01:59:02.495965 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9', '28')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 01:59:02.498226 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c05863be20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9'): ({'sdf'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 01:59:02.498226 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Removing multipathed devices sdg, sdf {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 01:59:02.498226 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Flush multipath device 330000000e9f569ee {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 01:59:02.524710 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=98206) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 21 01:59:02.532509 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Instance directory exists: not creating {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 21 01:59:02.532509 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Creating image(s)
May 21 01:59:02.536518 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "/opt/stack/data/nova/instances/392bbdc4-beaa-4c44-93f5-3a76f331ceb0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:02.536518 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "/opt/stack/data/nova/instances/392bbdc4-beaa-4c44-93f5-3a76f331ceb0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:02.536518 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 01:59:02.536518 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "/opt/stack/data/nova/instances/392bbdc4-beaa-4c44-93f5-3a76f331ceb0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:02.540120 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lazy-loading 'trusted_certs' on Instance uuid 392bbdc4-beaa-4c44-93f5-3a76f331ceb0 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:59:02.590133 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 01:59:02.642148 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 01:59:02.642148 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 01:59:02.643390 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 01:59:02.658726 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 01:59:02.658911 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 01:59:02.672903 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:02.717131 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9, portal: 192.168.40.100,3260]
May 21 01:59:02.717131 np0000001127 nova-compute[98206]: Logout of [sid: 29, target: iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9, portal: 192.168.40.100,3260] successful.
May 21 01:59:02.717131 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:02.741438 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:02.762033 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:02.797592 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9, portal: 192.168.50.100,3260]
May 21 01:59:02.797592 np0000001127 nova-compute[98206]: Logout of [sid: 28, target: iqn.2023-03.storpool.com:os--volume-9fcc2d62-15aa-44f9-965e-99ac8b8bbbb9, portal: 192.168.50.100,3260] successful.
May 21 01:59:02.797592 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:02.820453 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:02.820708 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:59:02.820853 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] <== disconnect_volume: return (4324ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:59:02.820989 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 01:59:02.960687 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 01:59:02.961161 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566', 'iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f84e5871-8b85-40d8-af76-554e0f6ce566', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:59:02.961283 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:59:02.962199 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:59:02.962199 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566', 'iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f84e5871-8b85-40d8-af76-554e0f6ce566', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 01:59:02.979518 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:59:02.980347 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:59:02.980961 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:59:02.981224 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:59:02.981649 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:59:02.981948 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:59:02.995869 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 01:59:02.995869 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:03.003885 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 01:59:03.003885 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:03.012857 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566] added
May 21 01:59:03.012857 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 01:59:03.012857 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:59:03.012857 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:59:03.012857 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:59:03.012857 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:59:03.012857 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:03.012857 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 01:59:03.013249 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0318(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 01:59:03.013249 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 01:59:03.016519 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566] added
May 21 01:59:03.016519 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 01:59:03.016519 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:59:03.016519 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:59:03.016519 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:59:03.016519 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:59:03.016519 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:03.016830 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 01:59:03.016830 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0349(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 01:59:03.016946 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 01:59:03.040805 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Object Instance<392bbdc4-beaa-4c44-93f5-3a76f331ceb0> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 01:59:03.041556 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "bdda4ebd5287240aadeeba633bba399726b93436" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:03.041772 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "bdda4ebd5287240aadeeba633bba399726b93436" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:03.209974 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a273eef3-4e21-4561-b95e-5d2f22c3765b tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.098s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:03.270021 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "6f68556b-0b18-452a-b307-da2dad4ee6ab" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:03.270126 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "6f68556b-0b18-452a-b307-da2dad4ee6ab" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:03.397115 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Lazy-loading 'flavor' on Instance uuid f8921842-2161-4ddf-b3c4-b642fc51a70f {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:59:03.778453 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Detaching volume 99e89209-ee54-4c1e-922b-ed08da485e1c
May 21 01:59:03.815612 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:59:03.820588 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:59:03.822080 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdda4ebd5287240aadeeba633bba399726b93436.part --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:03.841778 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Attempting to driver detach volume 99e89209-ee54-4c1e-922b-ed08da485e1c from mountpoint /dev/vdb
May 21 01:59:03.861743 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Found disk vdb by alias ua-99e89209-ee54-4c1e-922b-ed08da485e1c {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 01:59:03.864083 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Found disk vdb by alias ua-99e89209-ee54-4c1e-922b-ed08da485e1c {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 01:59:03.864083 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Attempting to detach device vdb from instance 6f68556b-0b18-452a-b307-da2dad4ee6ab from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 01:59:03.864083 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] detach device xml: <disk type="block" device="disk">
May 21 01:59:03.864083 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:59:03.864083 np0000001127 nova-compute[98206]:   <alias name="ua-99e89209-ee54-4c1e-922b-ed08da485e1c"/>
May 21 01:59:03.864083 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-0"/>
May 21 01:59:03.864083 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 01:59:03.864083 np0000001127 nova-compute[98206]:   <serial>99e89209-ee54-4c1e-922b-ed08da485e1c</serial>
May 21 01:59:03.864083 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 21 01:59:03.864083 np0000001127 nova-compute[98206]: </disk>
May 21 01:59:03.864083 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 01:59:03.875145 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Successfully detached device vdb from instance 6f68556b-0b18-452a-b307-da2dad4ee6ab from the persistent domain config.
May 21 01:59:03.876041 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] (1/8): Attempting to detach device vdb with device alias ua-99e89209-ee54-4c1e-922b-ed08da485e1c from instance 6f68556b-0b18-452a-b307-da2dad4ee6ab from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 01:59:03.876189 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] detach device xml: <disk type="block" device="disk">
May 21 01:59:03.876189 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:59:03.876189 np0000001127 nova-compute[98206]:   <alias name="ua-99e89209-ee54-4c1e-922b-ed08da485e1c"/>
May 21 01:59:03.876189 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-0"/>
May 21 01:59:03.876189 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 01:59:03.876189 np0000001127 nova-compute[98206]:   <serial>99e89209-ee54-4c1e-922b-ed08da485e1c</serial>
May 21 01:59:03.876189 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 21 01:59:03.876189 np0000001127 nova-compute[98206]: </disk>
May 21 01:59:03.876189 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 01:59:03.887734 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cf1dd709-c816-4776-bf8c-bff12480ecd2 req-9ea3f7fd-5f7e-48d1-a5f8-39c45454e120 service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Received event network-vif-unplugged-44670b22-c758-456b-a200-f0323baea57f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:03.887911 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cf1dd709-c816-4776-bf8c-bff12480ecd2 req-9ea3f7fd-5f7e-48d1-a5f8-39c45454e120 service nova] Acquiring lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:03.888063 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cf1dd709-c816-4776-bf8c-bff12480ecd2 req-9ea3f7fd-5f7e-48d1-a5f8-39c45454e120 service nova] Lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:03.888241 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cf1dd709-c816-4776-bf8c-bff12480ecd2 req-9ea3f7fd-5f7e-48d1-a5f8-39c45454e120 service nova] Lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:03.888935 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cf1dd709-c816-4776-bf8c-bff12480ecd2 req-9ea3f7fd-5f7e-48d1-a5f8-39c45454e120 service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] No waiting events found dispatching network-vif-unplugged-44670b22-c758-456b-a200-f0323baea57f {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:59:03.888935 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-cf1dd709-c816-4776-bf8c-bff12480ecd2 req-9ea3f7fd-5f7e-48d1-a5f8-39c45454e120 service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Received unexpected event network-vif-unplugged-44670b22-c758-456b-a200-f0323baea57f for instance with vm_state active and task_state rescuing.
May 21 01:59:03.956068 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdda4ebd5287240aadeeba633bba399726b93436.part --force-share --output=json" returned: 0 in 0.134s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:03.959035 np0000001127 nova-compute[98206]: DEBUG nova.virt.images [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] c133b1d0-726a-42e0-b0d6-cd339c969d1b was qcow2, converting to raw {{(pid=98206) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 21 01:59:03.961511 np0000001127 nova-compute[98206]: DEBUG nova.privsep.utils [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 21 01:59:03.961822 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bdda4ebd5287240aadeeba633bba399726b93436.part /opt/stack/data/nova/instances/_base/bdda4ebd5287240aadeeba633bba399726b93436.converted {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:04.014612 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:59:04.017548 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.startup = manual
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:59:04.033321 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:59:04.033321 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.startup = manual
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:59:04.045121 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:59:04.045121 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:04.054401 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:04.067999 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:04.082548 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:59:04.082548 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:59:04.082548 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:04.082548 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:04.082548 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:04.082548 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:04.082548 np0000001127 nova-compute[98206]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:04.082548 np0000001127 nova-compute[98206]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:04.082548 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:04.082548 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:04.082548 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:59:04.082918 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsi session list stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:59:04.082918 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:59:04.082918 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:04.082918 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:04.082918 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:04.082918 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:04.082918 np0000001127 nova-compute[98206]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:04.082918 np0000001127 nova-compute[98206]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:04.082918 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:04.082918 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:04.082918 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:59:04.096745 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:59:04.096745 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:59:04.096745 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:04.096745 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:04.096745 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:04.096745 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:04.096745 np0000001127 nova-compute[98206]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:04.096745 np0000001127 nova-compute[98206]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:04.096745 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:04.096745 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:04.096745 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:59:04.097288 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsi session list stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:59:04.097288 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:59:04.097288 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:04.097288 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:04.097288 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:04.097288 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:04.097288 np0000001127 nova-compute[98206]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:04.097288 np0000001127 nova-compute[98206]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:04.097288 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:04.097288 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:04.097288 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:59:04.135526 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bdda4ebd5287240aadeeba633bba399726b93436.part /opt/stack/data/nova/instances/_base/bdda4ebd5287240aadeeba633bba399726b93436.converted" returned: 0 in 0.173s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:04.142986 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566, portal: 192.168.40.100,3260]
May 21 01:59:04.142986 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566, portal: 192.168.40.100,3260] successful.
May 21 01:59:04.142986 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:04.144009 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdda4ebd5287240aadeeba633bba399726b93436.converted --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:04.163693 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:04.168318 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566, portal: 192.168.50.100,3260]
May 21 01:59:04.168318 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566, portal: 192.168.50.100,3260] successful.
May 21 01:59:04.168318 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:04.184558 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:04.190812 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:59:04.190812 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:59:04.190812 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:04.190812 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:04.190812 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:04.190812 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:04.190812 np0000001127 nova-compute[98206]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:04.190812 np0000001127 nova-compute[98206]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:04.190812 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:04.190812 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:04.190812 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:04.190812 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:04.190812 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:59:04.191401 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsi session list stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:59:04.191401 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:59:04.191401 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:04.191401 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:04.191401 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:04.191401 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:04.191401 np0000001127 nova-compute[98206]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:04.191401 np0000001127 nova-compute[98206]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:04.191401 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:04.191401 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:04.191401 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:04.191401 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:04.191401 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:59:04.191789 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.211s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:59:04.191868 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:59:04.193356 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] HCTL ('11', '-', '-', 0) found on session 36 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:59:04.193555 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:59:04.209489 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:59:04.209489 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:59:04.209489 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:04.209489 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:04.209489 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:04.209489 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:04.209489 np0000001127 nova-compute[98206]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:04.209489 np0000001127 nova-compute[98206]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:04.209489 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:04.209489 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:04.209489 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:04.209489 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:04.209489 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:59:04.209489 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsi session list stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:59:04.209489 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:59:04.209489 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:04.209489 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:04.209489 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:04.209489 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:04.209489 np0000001127 nova-compute[98206]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:04.209489 np0000001127 nova-compute[98206]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:04.209489 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:04.209489 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:04.209489 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:04.209489 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:04.209489 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:59:04.209489 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.227s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:59:04.209489 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:59:04.211390 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] HCTL ('12', '-', '-', 0) found on session 37 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:59:04.211652 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:59:04.218318 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Searching for a device in session 36 and hctl ['11', '*', '*', 0] yield: None {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:59:04.243939 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Searching for a device in session 37 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:59:04.243939 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f84e5871-8b85-40d8-af76-554e0f6ce566', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:59:04.264856 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdda4ebd5287240aadeeba633bba399726b93436.converted --force-share --output=json" returned: 0 in 0.121s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:04.265836 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "bdda4ebd5287240aadeeba633bba399726b93436" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.224s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:04.266723 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:59:04.273567 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:59:04.276294 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "bdda4ebd5287240aadeeba633bba399726b93436" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:04.276884 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "bdda4ebd5287240aadeeba633bba399726b93436" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:04.277320 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:59:04.283596 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:59:04.285065 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdda4ebd5287240aadeeba633bba399726b93436 --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:04.396013 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdda4ebd5287240aadeeba633bba399726b93436 --force-share --output=json" returned: 0 in 0.111s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:04.396645 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bdda4ebd5287240aadeeba633bba399726b93436,backing_fmt=raw /opt/stack/data/nova/instances/392bbdc4-beaa-4c44-93f5-3a76f331ceb0/disk.rescue {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:04.425257 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bd92790a-7719-4219-a8de-42a28bd78e57 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Lock "f8921842-2161-4ddf-b3c4-b642fc51a70f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.758s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:04.486296 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bdda4ebd5287240aadeeba633bba399726b93436,backing_fmt=raw /opt/stack/data/nova/instances/392bbdc4-beaa-4c44-93f5-3a76f331ceb0/disk.rescue" returned: 0 in 0.089s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:04.488667 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "bdda4ebd5287240aadeeba633bba399726b93436" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:04.488667 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lazy-loading 'migration_context' on Instance uuid 392bbdc4-beaa-4c44-93f5-3a76f331ceb0 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:59:04.763811 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779328744.763326, 6f68556b-0b18-452a-b307-da2dad4ee6ab => ua-99e89209-ee54-4c1e-922b-ed08da485e1c> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 01:59:04.765220 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-99e89209-ee54-4c1e-922b-ed08da485e1c for instance 6f68556b-0b18-452a-b307-da2dad4ee6ab {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 01:59:04.769869 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Successfully detached device vdb from instance 6f68556b-0b18-452a-b307-da2dad4ee6ab from the live domain config.
May 21 01:59:04.771126 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 01:59:04.772408 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '99e89209-ee54-4c1e-922b-ed08da485e1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:59:04.772408 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:59:04.938969 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:04.992791 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Object Instance<392bbdc4-beaa-4c44-93f5-3a76f331ceb0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 01:59:04.993134 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 01:59:04.994618 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Start _get_guest_xml network_info=[{"id": "44670b22-c758-456b-a200-f0323baea57f", "address": "fa:16:3e:50:bf:d8", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "vif_mac": "fa:16:3e:50:bf:d8"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap44670b22-c7", "ovs_interfaceid": "44670b22-c758-456b-a200-f0323baea57f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c133b1d0-726a-42e0-b0d6-cd339c969d1b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '69f8ed84-393f-414e-9868-ac8c3126b175', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, 'status': 'reserved', 'instance': '392bbdc4-beaa-4c44-93f5-3a76f331ceb0', 'attached_at': '', 'detached_at': '', 'volume_id': '69f8ed84-393f-414e-9868-ac8c3126b175', 'serial': '69f8ed84-393f-414e-9868-ac8c3126b175'}, 'delete_on_termination': True, 'attachment_id': '3df2ec60-1443-4dba-a5db-af1a028c7cf1', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 01:59:04.995162 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lazy-loading 'resources' on Instance uuid 392bbdc4-beaa-4c44-93f5-3a76f331ceb0 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:59:05.172760 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.49 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 01:59:05.219416 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Searching for a device in session 36 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:59:05.219560 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f84e5871-8b85-40d8-af76-554e0f6ce566', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:59:05.480894 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f878b2d6-885d-4ebf-af2f-026318227273 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Acquiring lock "f8921842-2161-4ddf-b3c4-b642fc51a70f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:05.481145 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f878b2d6-885d-4ebf-af2f-026318227273 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Lock "f8921842-2161-4ddf-b3c4-b642fc51a70f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:05.481379 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f878b2d6-885d-4ebf-af2f-026318227273 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Acquiring lock "f8921842-2161-4ddf-b3c4-b642fc51a70f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:05.481564 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f878b2d6-885d-4ebf-af2f-026318227273 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Lock "f8921842-2161-4ddf-b3c4-b642fc51a70f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:05.481713 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f878b2d6-885d-4ebf-af2f-026318227273 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Lock "f8921842-2161-4ddf-b3c4-b642fc51a70f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:05.487759 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-f878b2d6-885d-4ebf-af2f-026318227273 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Terminating instance
May 21 01:59:05.500325 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Object Instance<392bbdc4-beaa-4c44-93f5-3a76f331ceb0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 01:59:05.508715 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 01:59:05.511148 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1558814074', uuid='392bbdc4-beaa-4c44-93f5-3a76f331ceb0'), owner=OwnerMeta(userid='bd5b969d5a514d01bacfc7954a5ae4ab', username='tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member', projectid='83df9a84ffaa4398bdafbfbde079964d', projectname='tempest-ServerBootFromVolumeStableRescueTest-260444396'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "44670b22-c758-456b-a200-f0323baea57f", "address": "fa:16:3e:50:bf:d8", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "vif_mac": "fa:16:3e:50:bf:d8"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap44670b22-c7", "ovs_interfaceid": "44670b22-c758-456b-a200-f0323baea57f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328745.510557) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 01:59:05.513838 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 01:59:05.514485 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 01:59:05.516254 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 01:59:05.516254 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 01:59:05.517713 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 01:59:05.517713 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 01:59:05.517713 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 01:59:05.517713 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 01:59:05.517984 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 01:59:05.517984 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 01:59:05.518284 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 01:59:05.518682 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 01:59:05.518870 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 01:59:05.519089 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 01:59:05.519234 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 01:59:05.519431 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 01:59:05.519670 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lazy-loading 'vcpu_model' on Instance uuid 392bbdc4-beaa-4c44-93f5-3a76f331ceb0 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:59:05.992607 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-f878b2d6-885d-4ebf-af2f-026318227273 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 01:59:06.012571 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Found WWN 330000000753c49ce for multipath device dm-2 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 01:59:06.013011 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.051s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:59:06.013416 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] <== connect_volume: return (3051ms) {'type': 'block', 'scsi_wwn': '330000000753c49ce', 'path': '/dev/dm-2', 'multipath_id': '330000000753c49ce'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:59:06.015490 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000753c49ce', 'path': '/dev/dm-2', 'multipath_id': '330000000753c49ce'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 01:59:06.015490 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.243s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:59:06.015490 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '99e89209-ee54-4c1e-922b-ed08da485e1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 01:59:06.015490 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 01:59:06.024178 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Object Instance<392bbdc4-beaa-4c44-93f5-3a76f331ceb0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 01:59:06.042261 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:06.049758 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/392bbdc4-beaa-4c44-93f5-3a76f331ceb0/disk.config --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:06.077968 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:06.085948 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:59:06.085948 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:59:06.085948 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:06.085948 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:06.085948 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:06.085948 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:06.085948 np0000001127 nova-compute[98206]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:06.085948 np0000001127 nova-compute[98206]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:06.085948 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:06.085948 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:06.085948 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:06.085948 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:06.085948 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:59:06.085948 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsi session list stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:59:06.085948 np0000001127 nova-compute[98206]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c (non-flash)
May 21 01:59:06.085948 np0000001127 nova-compute[98206]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:06.085948 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:06.085948 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:06.085948 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:06.085948 np0000001127 nova-compute[98206]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:06.085948 np0000001127 nova-compute[98206]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:06.085948 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:06.085948 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:06.085948 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:06.085948 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:06.085948 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:59:06.085948 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', '27'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6', '35'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566', '37')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 01:59:06.085948 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', '24')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 01:59:06.089514 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c', '25')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 01:59:06.093569 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c7479c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c'): ({'sdc'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 01:59:06.095727 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Removing multipathed devices sdc, sdb {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 01:59:06.096945 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Flush multipath device 330000000a9f70f02 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 01:59:06.121363 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:06.137132 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 01:59:06.176594 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/392bbdc4-beaa-4c44-93f5-3a76f331ceb0/disk.config --force-share --output=json" returned: 0 in 0.127s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:06.176920 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "/opt/stack/data/nova/instances/392bbdc4-beaa-4c44-93f5-3a76f331ceb0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:06.177228 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "/opt/stack/data/nova/instances/392bbdc4-beaa-4c44-93f5-3a76f331ceb0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:06.178038 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "/opt/stack/data/nova/instances/392bbdc4-beaa-4c44-93f5-3a76f331ceb0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:06.179967 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 01:59:06.179967 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '69f8ed84-393f-414e-9868-ac8c3126b175', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:59:06.179967 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:59:06.180974 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:06.189639 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 01:59:06.252276 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 01:59:06.252558 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 01:59:06.255751 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 01:59:06.275875 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-051e8d84-eef5-47f4-a5e6-6cc893c3c494 req-6250bb24-31c1-498f-a8f6-5e75a64140dc service nova] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Received event network-vif-unplugged-3ef861c1-6e74-4d82-a214-06c2d655f210 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:06.275875 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-051e8d84-eef5-47f4-a5e6-6cc893c3c494 req-6250bb24-31c1-498f-a8f6-5e75a64140dc service nova] Acquiring lock "f8921842-2161-4ddf-b3c4-b642fc51a70f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:06.276690 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-051e8d84-eef5-47f4-a5e6-6cc893c3c494 req-6250bb24-31c1-498f-a8f6-5e75a64140dc service nova] Lock "f8921842-2161-4ddf-b3c4-b642fc51a70f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:06.276690 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-051e8d84-eef5-47f4-a5e6-6cc893c3c494 req-6250bb24-31c1-498f-a8f6-5e75a64140dc service nova] Lock "f8921842-2161-4ddf-b3c4-b642fc51a70f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:06.277792 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 01:59:06.277959 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-051e8d84-eef5-47f4-a5e6-6cc893c3c494 req-6250bb24-31c1-498f-a8f6-5e75a64140dc service nova] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] No waiting events found dispatching network-vif-unplugged-3ef861c1-6e74-4d82-a214-06c2d655f210 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:59:06.278221 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-051e8d84-eef5-47f4-a5e6-6cc893c3c494 req-6250bb24-31c1-498f-a8f6-5e75a64140dc service nova] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Received event network-vif-unplugged-3ef861c1-6e74-4d82-a214-06c2d655f210 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 01:59:06.281666 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 01:59:06.294083 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:06.342671 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c, portal: 192.168.40.100,3260]
May 21 01:59:06.342671 np0000001127 nova-compute[98206]: Logout of [sid: 24, target: iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c, portal: 192.168.40.100,3260] successful.
May 21 01:59:06.342671 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:06.379177 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:06.386893 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999638259999983 future=<Future at 0x71c05853f110 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:59:06.391179 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Instance destroyed successfully.
May 21 01:59:06.392510 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-f878b2d6-885d-4ebf-af2f-026318227273 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Lazy-loading 'resources' on Instance uuid f8921842-2161-4ddf-b3c4-b642fc51a70f {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:59:06.394537 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:06.430923 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c, portal: 192.168.50.100,3260]
May 21 01:59:06.430923 np0000001127 nova-compute[98206]: Logout of [sid: 25, target: iqn.2023-03.storpool.com:os--volume-99e89209-ee54-4c1e-922b-ed08da485e1c, portal: 192.168.50.100,3260] successful.
May 21 01:59:06.430923 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:06.459803 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:06.459803 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.445s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:59:06.459803 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] <== disconnect_volume: return (1687ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:59:06.459803 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 01:59:06.460190 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.281s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:59:06.460545 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '69f8ed84-393f-414e-9868-ac8c3126b175', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 01:59:06.483985 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:59:06.484839 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:59:06.485335 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:59:06.485627 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:59:06.486261 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:59:06.487052 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.startup = automatic
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.session.scan = manual
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:59:06.503624 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:59:06.503624 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.startup = automatic
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.session.scan = manual
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:59:06.512125 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:59:06.512125 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:06.524063 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:06.534150 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:06.552495 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920193654',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-920193654',id=13,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj8xG3nqMprKxBLzehkwhGN33AYwwuQUWlcQ1BDSSIisfdbQN22oI+LOb499AbZ3PG8oEFQTNwey0tKs5r9Gc1kC6R76tIW1PhxpT/IYUNrOGb6wd7IJKgcO7Q871ucMw==',key_name='tempest-keypair-272806868',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fea6765f0d474e20a8cf4ce239d06576',ramdisk_id='',reservation_id='r-5gkaau5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306570717',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306570717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:58:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcc45f6ca81d42fbb09ff1916bb11787',uuid=a4b3355b-92d6-4b36-8dad-6cb4b3c579a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f99ceda9-fad6-4a73-af2a-c63d3d320e2f", "address": "fa:16:3e:f8:14:ac", "network": {"id": "0ab35e13-b362-4576-91d1-569cb811b2d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1427614225-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf99ceda9-fa", "ovs_interfaceid": "f99ceda9-fad6-4a73-af2a-c63d3d320e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 01:59:06.552495 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converting VIF {"id": "f99ceda9-fad6-4a73-af2a-c63d3d320e2f", "address": "fa:16:3e:f8:14:ac", "network": {"id": "0ab35e13-b362-4576-91d1-569cb811b2d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1427614225-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf99ceda9-fa", "ovs_interfaceid": "f99ceda9-fad6-4a73-af2a-c63d3d320e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:59:06.552495 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:14:ac,bridge_name='br-int',has_traffic_filtering=True,id=f99ceda9-fad6-4a73-af2a-c63d3d320e2f,network=Network(0ab35e13-b362-4576-91d1-569cb811b2d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf99ceda9-fa') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:59:06.553301 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920193654',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-920193654',id=13,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj8xG3nqMprKxBLzehkwhGN33AYwwuQUWlcQ1BDSSIisfdbQN22oI+LOb499AbZ3PG8oEFQTNwey0tKs5r9Gc1kC6R76tIW1PhxpT/IYUNrOGb6wd7IJKgcO7Q871ucMw==',key_name='tempest-keypair-272806868',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fea6765f0d474e20a8cf4ce239d06576',ramdisk_id='',reservation_id='r-5gkaau5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306570717',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306570717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:58:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcc45f6ca81d42fbb09ff1916bb11787',uuid=a4b3355b-92d6-4b36-8dad-6cb4b3c579a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71580ee4-3192-484a-9ee6-5096ac78a4ce", "address": "fa:16:3e:32:44:18", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71580ee4-31", "ovs_interfaceid": "71580ee4-3192-484a-9ee6-5096ac78a4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 01:59:06.553883 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converting VIF {"id": "71580ee4-3192-484a-9ee6-5096ac78a4ce", "address": "fa:16:3e:32:44:18", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71580ee4-31", "ovs_interfaceid": "71580ee4-3192-484a-9ee6-5096ac78a4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:59:06.556217 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:44:18,bridge_name='br-int',has_traffic_filtering=True,id=71580ee4-3192-484a-9ee6-5096ac78a4ce,network=Network(34d80d18-cae3-4477-a29e-164067d97021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap71580ee4-31') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:59:06.557291 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920193654',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-920193654',id=13,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj8xG3nqMprKxBLzehkwhGN33AYwwuQUWlcQ1BDSSIisfdbQN22oI+LOb499AbZ3PG8oEFQTNwey0tKs5r9Gc1kC6R76tIW1PhxpT/IYUNrOGb6wd7IJKgcO7Q871ucMw==',key_name='tempest-keypair-272806868',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fea6765f0d474e20a8cf4ce239d06576',ramdisk_id='',reservation_id='r-5gkaau5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306570717',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306570717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:58:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcc45f6ca81d42fbb09ff1916bb11787',uuid=a4b3355b-92d6-4b36-8dad-6cb4b3c579a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e74661c-8435-43a4-82d7-b7d757552d24", "address": "fa:16:3e:e6:51:87", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e74661c-84", "ovs_interfaceid": "9e74661c-8435-43a4-82d7-b7d757552d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 01:59:06.558402 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:06.558402 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:06.558402 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:06.558402 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:06.558402 np0000001127 nova-compute[98206]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:06.558402 np0000001127 nova-compute[98206]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:06.558402 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:06.558402 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:06.558402 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:06.558402 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:06.558402 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:59:06.558402 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:06.558402 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:06.558402 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:06.558402 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:06.558402 np0000001127 nova-compute[98206]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:06.558402 np0000001127 nova-compute[98206]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:06.558402 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:06.558402 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:06.558402 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:06.558402 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:06.558402 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:59:06.559829 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.073s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:59:06.559829 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:59:06.559829 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converting VIF {"id": "9e74661c-8435-43a4-82d7-b7d757552d24", "address": "fa:16:3e:e6:51:87", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e74661c-84", "ovs_interfaceid": "9e74661c-8435-43a4-82d7-b7d757552d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:59:06.560308 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:51:87,bridge_name='br-int',has_traffic_filtering=True,id=9e74661c-8435-43a4-82d7-b7d757552d24,network=Network(34d80d18-cae3-4477-a29e-164067d97021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9e74661c-84') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:59:06.560938 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920193654',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-920193654',id=13,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj8xG3nqMprKxBLzehkwhGN33AYwwuQUWlcQ1BDSSIisfdbQN22oI+LOb499AbZ3PG8oEFQTNwey0tKs5r9Gc1kC6R76tIW1PhxpT/IYUNrOGb6wd7IJKgcO7Q871ucMw==',key_name='tempest-keypair-272806868',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fea6765f0d474e20a8cf4ce239d06576',ramdisk_id='',reservation_id='r-5gkaau5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306570717',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306570717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:58:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcc45f6ca81d42fbb09ff1916bb11787',uuid=a4b3355b-92d6-4b36-8dad-6cb4b3c579a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "407bbd3c-7537-4404-aaf5-a5ed533bb33b", "address": "fa:16:3e:80:dd:78", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap407bbd3c-75", "ovs_interfaceid": "407bbd3c-7537-4404-aaf5-a5ed533bb33b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 01:59:06.561135 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converting VIF {"id": "407bbd3c-7537-4404-aaf5-a5ed533bb33b", "address": "fa:16:3e:80:dd:78", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap407bbd3c-75", "ovs_interfaceid": "407bbd3c-7537-4404-aaf5-a5ed533bb33b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:59:06.561558 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:dd:78,bridge_name='br-int',has_traffic_filtering=True,id=407bbd3c-7537-4404-aaf5-a5ed533bb33b,network=Network(34d80d18-cae3-4477-a29e-164067d97021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap407bbd3c-75') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:59:06.562167 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920193654',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-920193654',id=13,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj8xG3nqMprKxBLzehkwhGN33AYwwuQUWlcQ1BDSSIisfdbQN22oI+LOb499AbZ3PG8oEFQTNwey0tKs5r9Gc1kC6R76tIW1PhxpT/IYUNrOGb6wd7IJKgcO7Q871ucMw==',key_name='tempest-keypair-272806868',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fea6765f0d474e20a8cf4ce239d06576',ramdisk_id='',reservation_id='r-5gkaau5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306570717',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306570717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:58:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcc45f6ca81d42fbb09ff1916bb11787',uuid=a4b3355b-92d6-4b36-8dad-6cb4b3c579a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a350a027-1ffc-4539-a238-d98bbb9baeba", "address": "fa:16:3e:19:d5:ae", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa350a027-1f", "ovs_interfaceid": "a350a027-1ffc-4539-a238-d98bbb9baeba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 01:59:06.562310 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converting VIF {"id": "a350a027-1ffc-4539-a238-d98bbb9baeba", "address": "fa:16:3e:19:d5:ae", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa350a027-1f", "ovs_interfaceid": "a350a027-1ffc-4539-a238-d98bbb9baeba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:59:06.562736 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:d5:ae,bridge_name='br-int',has_traffic_filtering=True,id=a350a027-1ffc-4539-a238-d98bbb9baeba,network=Network(34d80d18-cae3-4477-a29e-164067d97021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa350a027-1f') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:59:06.563679 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920193654',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-920193654',id=13,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj8xG3nqMprKxBLzehkwhGN33AYwwuQUWlcQ1BDSSIisfdbQN22oI+LOb499AbZ3PG8oEFQTNwey0tKs5r9Gc1kC6R76tIW1PhxpT/IYUNrOGb6wd7IJKgcO7Q871ucMw==',key_name='tempest-keypair-272806868',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fea6765f0d474e20a8cf4ce239d06576',ramdisk_id='',reservation_id='r-5gkaau5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306570717',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306570717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:58:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcc45f6ca81d42fbb09ff1916bb11787',uuid=a4b3355b-92d6-4b36-8dad-6cb4b3c579a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58939f92-ac70-47fb-90c0-5f7bc2421c47", "address": "fa:16:3e:db:3c:f9", "network": {"id": "54c4e0a1-6a66-4891-94c3-c85fc5fe181c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2031114495", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58939f92-ac", "ovs_interfaceid": "58939f92-ac70-47fb-90c0-5f7bc2421c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 01:59:06.563876 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converting VIF {"id": "58939f92-ac70-47fb-90c0-5f7bc2421c47", "address": "fa:16:3e:db:3c:f9", "network": {"id": "54c4e0a1-6a66-4891-94c3-c85fc5fe181c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2031114495", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58939f92-ac", "ovs_interfaceid": "58939f92-ac70-47fb-90c0-5f7bc2421c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:59:06.564485 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:3c:f9,bridge_name='br-int',has_traffic_filtering=True,id=58939f92-ac70-47fb-90c0-5f7bc2421c47,network=Network(54c4e0a1-6a66-4891-94c3-c85fc5fe181c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58939f92-ac') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:59:06.564949 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920193654',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-920193654',id=13,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj8xG3nqMprKxBLzehkwhGN33AYwwuQUWlcQ1BDSSIisfdbQN22oI+LOb499AbZ3PG8oEFQTNwey0tKs5r9Gc1kC6R76tIW1PhxpT/IYUNrOGb6wd7IJKgcO7Q871ucMw==',key_name='tempest-keypair-272806868',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fea6765f0d474e20a8cf4ce239d06576',ramdisk_id='',reservation_id='r-5gkaau5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306570717',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306570717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:58:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcc45f6ca81d42fbb09ff1916bb11787',uuid=a4b3355b-92d6-4b36-8dad-6cb4b3c579a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ac81609-4fab-4940-9313-6dd7160c7a9b", "address": "fa:16:3e:c9:a8:b1", "network": {"id": "54c4e0a1-6a66-4891-94c3-c85fc5fe181c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2031114495", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac81609-4f", "ovs_interfaceid": "1ac81609-4fab-4940-9313-6dd7160c7a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 01:59:06.565122 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converting VIF {"id": "1ac81609-4fab-4940-9313-6dd7160c7a9b", "address": "fa:16:3e:c9:a8:b1", "network": {"id": "54c4e0a1-6a66-4891-94c3-c85fc5fe181c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2031114495", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac81609-4f", "ovs_interfaceid": "1ac81609-4fab-4940-9313-6dd7160c7a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:59:06.565503 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:a8:b1,bridge_name='br-int',has_traffic_filtering=True,id=1ac81609-4fab-4940-9313-6dd7160c7a9b,network=Network(54c4e0a1-6a66-4891-94c3-c85fc5fe181c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ac81609-4f') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:59:06.566652 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:06.566652 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:06.566652 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:06.566652 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:06.566652 np0000001127 nova-compute[98206]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:06.566652 np0000001127 nova-compute[98206]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:06.566652 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:06.566652 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:06.566652 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:06.566652 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:06.566652 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:59:06.567128 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:06.567128 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:06.567128 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:06.567128 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:06.567128 np0000001127 nova-compute[98206]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:06.567128 np0000001127 nova-compute[98206]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:06.567128 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:06.567128 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:06.567128 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:06.567128 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:06.567128 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:59:06.567627 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.081s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:59:06.567627 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:59:06.568222 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lazy-loading 'pci_devices' on Instance uuid a4b3355b-92d6-4b36-8dad-6cb4b3c579a2 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:59:06.571122 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] HCTL ('9', '0', '0', 0) found on session 26 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:59:06.572182 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Scanning host 9 c: 0, t: 0, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:59:06.572956 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] HCTL ('10', '0', '0', 0) found on session 27 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:59:06.573195 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Scanning host 10 c: 0, t: 0, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:59:06.585563 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Searching for a device in session 27 and hctl ('10', '0', '0', 0) yield: sde {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:59:06.585806 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '69f8ed84-393f-414e-9868-ac8c3126b175', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:59:06.596760 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Searching for a device in session 26 and hctl ('9', '0', '0', 0) yield: sdd {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:59:06.596760 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '69f8ed84-393f-414e-9868-ac8c3126b175', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:59:06.899755 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-f878b2d6-885d-4ebf-af2f-026318227273 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-120609668',display_name='tempest-AttachSCSIVolumeTestJSON-server-120609668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachscsivolumetestjson-server-120609668',id=11,image_ref='c88685d1-8ae3-4a18-935c-cbd699617048',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjXezLAC/wSHg89uCj7jXxty/NyzUeJTjEJ3NgwG1a21UVMA8SBQcKAYD7X4w3UToWoyQqWlkmSLWZNxhl2bzmkrqKwdzHdmQ3U44QO37LDwh6Wt3h1ThtRIBVb5uhqhw==',key_name='tempest-keypair-15728245',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:58:06Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c267ab1fe654c6da45280651b958746',ramdisk_id='',reservation_id='r-lcoxaxht',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c88685d1-8ae3-4a18-935c-cbd699617048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1415132564',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1415132564-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:58:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2f21fb1a04f4a3da623f58204608256',uuid=f8921842-2161-4ddf-b3c4-b642fc51a70f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ef861c1-6e74-4d82-a214-06c2d655f210", "address": "fa:16:3e:ef:61:06", "network": {"id": "92596e04-fd2c-46d6-bc35-90386827dd7e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-421500812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0c267ab1fe654c6da45280651b958746", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ef861c1-6e", "ovs_interfaceid": "3ef861c1-6e74-4d82-a214-06c2d655f210", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 01:59:06.899985 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-f878b2d6-885d-4ebf-af2f-026318227273 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Converting VIF {"id": "3ef861c1-6e74-4d82-a214-06c2d655f210", "address": "fa:16:3e:ef:61:06", "network": {"id": "92596e04-fd2c-46d6-bc35-90386827dd7e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-421500812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0c267ab1fe654c6da45280651b958746", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ef861c1-6e", "ovs_interfaceid": "3ef861c1-6e74-4d82-a214-06c2d655f210", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:59:06.901067 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-f878b2d6-885d-4ebf-af2f-026318227273 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:61:06,bridge_name='br-int',has_traffic_filtering=True,id=3ef861c1-6e74-4d82-a214-06c2d655f210,network=Network(92596e04-fd2c-46d6-bc35-90386827dd7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ef861c1-6e') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:59:06.901386 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-f878b2d6-885d-4ebf-af2f-026318227273 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:61:06,bridge_name='br-int',has_traffic_filtering=True,id=3ef861c1-6e74-4d82-a214-06c2d655f210,network=Network(92596e04-fd2c-46d6-bc35-90386827dd7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ef861c1-6e') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 01:59:06.906575 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:06.906860 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ef861c1-6e, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:06.908220 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:06.909364 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:59:06.916384 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:06.918262 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:06.918592 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fce8ba75-a63c-4039-a430-bd2b93608962) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:06.921733 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:06.923022 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:59:06.927332 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:06.929613 np0000001127 nova-compute[98206]: INFO os_vif [None req-f878b2d6-885d-4ebf-af2f-026318227273 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:61:06,bridge_name='br-int',has_traffic_filtering=True,id=3ef861c1-6e74-4d82-a214-06c2d655f210,network=Network(92596e04-fd2c-46d6-bc35-90386827dd7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ef861c1-6e')
May 21 01:59:06.930008 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-f878b2d6-885d-4ebf-af2f-026318227273 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Deleting instance files /opt/stack/data/nova/instances/f8921842-2161-4ddf-b3c4-b642fc51a70f_del
May 21 01:59:06.930720 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-f878b2d6-885d-4ebf-af2f-026318227273 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Deletion of /opt/stack/data/nova/instances/f8921842-2161-4ddf-b3c4-b642fc51a70f_del complete
May 21 01:59:07.062127 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lazy-loading 'flavor' on Instance uuid 6f68556b-0b18-452a-b307-da2dad4ee6ab {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:59:07.075635 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] End _get_guest_xml xml=<domain type="qemu">
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:   <uuid>a4b3355b-92d6-4b36-8dad-6cb4b3c579a2</uuid>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:   <name>instance-0000000d</name>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:   <metadata>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <nova:name>tempest-device-tagging-server-920193654</nova:name>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 01:58:52</nova:creationTime>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       </nova:image>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:         <nova:user uuid="dcc45f6ca81d42fbb09ff1916bb11787">tempest-TaggedBootDevicesTest_v242-1306570717-project-member</nova:user>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:         <nova:project uuid="fea6765f0d474e20a8cf4ce239d06576">tempest-TaggedBootDevicesTest_v242-1306570717</nova:project>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:         <nova:port uuid="f99ceda9-fad6-4a73-af2a-c63d3d320e2f">
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:         </nova:port>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:         <nova:port uuid="71580ee4-3192-484a-9ee6-5096ac78a4ce">
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.1.148" ipVersion="4"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:         </nova:port>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:         <nova:port uuid="9e74661c-8435-43a4-82d7-b7d757552d24">
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.1.65" ipVersion="4"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:         </nova:port>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:         <nova:port uuid="407bbd3c-7537-4404-aaf5-a5ed533bb33b">
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.1.173" ipVersion="4"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:         </nova:port>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:         <nova:port uuid="a350a027-1ffc-4539-a238-d98bbb9baeba">
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.1.56" ipVersion="4"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:         </nova:port>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:         <nova:port uuid="58939f92-ac70-47fb-90c0-5f7bc2421c47">
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:         </nova:port>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:         <nova:port uuid="1ac81609-4fab-4940-9313-6dd7160c7a9b">
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:         </nova:port>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:   </metadata>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     <system>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <entry name="serial">a4b3355b-92d6-4b36-8dad-6cb4b3c579a2</entry>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <entry name="uuid">a4b3355b-92d6-4b36-8dad-6cb4b3c579a2</entry>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     </system>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:   <os>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:   </os>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:   <features>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     <acpi/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     <tcg>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     </tcg>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:   </features>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:   <devices>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/a4b3355b-92d6-4b36-8dad-6cb4b3c579a2/disk.config"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     </disk>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <alias name="ua-f8b13fac-25c3-40f9-8506-1236b8dc8fd2"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-3"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <serial>f8b13fac-25c3-40f9-8506-1236b8dc8fd2</serial>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     </disk>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <alias name="ua-5410bf8e-8978-4bf4-b8f9-592be340a6b6"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-7"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <target dev="vdb" bus="virtio"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <serial>5410bf8e-8978-4bf4-b8f9-592be340a6b6</serial>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     </disk>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <alias name="ua-f84e5871-8b85-40d8-af76-554e0f6ce566"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-2"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <target dev="vdc" bus="virtio"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <serial>f84e5871-8b85-40d8-af76-554e0f6ce566</serial>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     </disk>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:f8:14:ac"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <target dev="tapf99ceda9-fa"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     </interface>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:32:44:18"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <target dev="tap71580ee4-31"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     </interface>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:e6:51:87"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <target dev="tap9e74661c-84"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     </interface>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:80:dd:78"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <target dev="tap407bbd3c-75"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     </interface>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:19:d5:ae"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <target dev="tapa350a027-1f"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     </interface>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:db:3c:f9"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <target dev="tap58939f92-ac"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     </interface>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:c9:a8:b1"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <target dev="tap1ac81609-4f"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     </interface>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/a4b3355b-92d6-4b36-8dad-6cb4b3c579a2/console.log" append="off"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     </serial>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     <video>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     </video>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     </rng>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:     </memballoon>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:   </devices>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]: </domain>
May 21 01:59:07.075635 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 01:59:07.079695 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Preparing to wait for external event network-vif-plugged-f99ceda9-fad6-4a73-af2a-c63d3d320e2f {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 01:59:07.079695 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:07.079695 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:07.079695 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:07.079695 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Preparing to wait for external event network-vif-plugged-71580ee4-3192-484a-9ee6-5096ac78a4ce {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 01:59:07.079695 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:07.079695 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:07.079695 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:07.079695 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Preparing to wait for external event network-vif-plugged-9e74661c-8435-43a4-82d7-b7d757552d24 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 01:59:07.079695 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:07.079695 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:07.079695 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:07.079695 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Preparing to wait for external event network-vif-plugged-407bbd3c-7537-4404-aaf5-a5ed533bb33b {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 01:59:07.080555 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:07.080555 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:07.080555 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:07.080555 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Preparing to wait for external event network-vif-plugged-a350a027-1ffc-4539-a238-d98bbb9baeba {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 01:59:07.080555 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:07.080555 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:07.080791 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:07.080844 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Preparing to wait for external event network-vif-plugged-58939f92-ac70-47fb-90c0-5f7bc2421c47 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 01:59:07.080940 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:07.081674 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:07.081674 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:07.082913 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Preparing to wait for external event network-vif-plugged-1ac81609-4fab-4940-9313-6dd7160c7a9b {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 01:59:07.082913 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:07.084140 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:07.084140 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:07.084826 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920193654',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-920193654',id=13,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj8xG3nqMprKxBLzehkwhGN33AYwwuQUWlcQ1BDSSIisfdbQN22oI+LOb499AbZ3PG8oEFQTNwey0tKs5r9Gc1kC6R76tIW1PhxpT/IYUNrOGb6wd7IJKgcO7Q871ucMw==',key_name='tempest-keypair-272806868',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fea6765f0d474e20a8cf4ce239d06576',ramdisk_id='',reservation_id='r-5gkaau5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306570717',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306570717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:58:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcc45f6ca81d42fbb09ff1916bb11787',uuid=a4b3355b-92d6-4b36-8dad-6cb4b3c579a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f99ceda9-fad6-4a73-af2a-c63d3d320e2f", "address": "fa:16:3e:f8:14:ac", "network": {"id": "0ab35e13-b362-4576-91d1-569cb811b2d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1427614225-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf99ceda9-fa", "ovs_interfaceid": "f99ceda9-fad6-4a73-af2a-c63d3d320e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 01:59:07.084992 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converting VIF {"id": "f99ceda9-fad6-4a73-af2a-c63d3d320e2f", "address": "fa:16:3e:f8:14:ac", "network": {"id": "0ab35e13-b362-4576-91d1-569cb811b2d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1427614225-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf99ceda9-fa", "ovs_interfaceid": "f99ceda9-fad6-4a73-af2a-c63d3d320e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:59:07.087212 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:14:ac,bridge_name='br-int',has_traffic_filtering=True,id=f99ceda9-fad6-4a73-af2a-c63d3d320e2f,network=Network(0ab35e13-b362-4576-91d1-569cb811b2d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf99ceda9-fa') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:59:07.087212 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:14:ac,bridge_name='br-int',has_traffic_filtering=True,id=f99ceda9-fad6-4a73-af2a-c63d3d320e2f,network=Network(0ab35e13-b362-4576-91d1-569cb811b2d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf99ceda9-fa') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 01:59:07.088911 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.089481 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:07.089860 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 01:59:07.091404 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.091846 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '88f544f6-f50e-589f-92d1-b98af4124319', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:07.103662 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.104152 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:59:07.115872 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.121313 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.121313 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf99ceda9-fa, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:07.121313 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf99ceda9-fa, col_values=(('qos', UUID('a8f693c1-566e-4b4f-b2c9-870ac9315eb9')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:07.121313 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf99ceda9-fa, col_values=(('external_ids', {'iface-id': 'f99ceda9-fad6-4a73-af2a-c63d3d320e2f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:14:ac', 'vm-uuid': 'a4b3355b-92d6-4b36-8dad-6cb4b3c579a2'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:07.124135 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:59:07.137822 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.141119 np0000001127 nova-compute[98206]: INFO os_vif [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:14:ac,bridge_name='br-int',has_traffic_filtering=True,id=f99ceda9-fad6-4a73-af2a-c63d3d320e2f,network=Network(0ab35e13-b362-4576-91d1-569cb811b2d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf99ceda9-fa')
May 21 01:59:07.141733 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920193654',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-920193654',id=13,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj8xG3nqMprKxBLzehkwhGN33AYwwuQUWlcQ1BDSSIisfdbQN22oI+LOb499AbZ3PG8oEFQTNwey0tKs5r9Gc1kC6R76tIW1PhxpT/IYUNrOGb6wd7IJKgcO7Q871ucMw==',key_name='tempest-keypair-272806868',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fea6765f0d474e20a8cf4ce239d06576',ramdisk_id='',reservation_id='r-5gkaau5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306570717',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306570717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:58:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcc45f6ca81d42fbb09ff1916bb11787',uuid=a4b3355b-92d6-4b36-8dad-6cb4b3c579a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71580ee4-3192-484a-9ee6-5096ac78a4ce", "address": "fa:16:3e:32:44:18", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71580ee4-31", "ovs_interfaceid": "71580ee4-3192-484a-9ee6-5096ac78a4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 01:59:07.142254 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converting VIF {"id": "71580ee4-3192-484a-9ee6-5096ac78a4ce", "address": "fa:16:3e:32:44:18", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71580ee4-31", "ovs_interfaceid": "71580ee4-3192-484a-9ee6-5096ac78a4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:59:07.143330 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:44:18,bridge_name='br-int',has_traffic_filtering=True,id=71580ee4-3192-484a-9ee6-5096ac78a4ce,network=Network(34d80d18-cae3-4477-a29e-164067d97021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap71580ee4-31') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:59:07.143719 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:44:18,bridge_name='br-int',has_traffic_filtering=True,id=71580ee4-3192-484a-9ee6-5096ac78a4ce,network=Network(34d80d18-cae3-4477-a29e-164067d97021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap71580ee4-31') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 01:59:07.144800 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.144800 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:07.144800 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 01:59:07.147995 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.147995 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3779b93d-8a51-521d-8e13-af7f517ddf24', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:07.153339 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.153339 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:59:07.167400 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.170532 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.171752 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71580ee4-31, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:07.171752 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap71580ee4-31, col_values=(('qos', UUID('90340b3b-1291-4428-87f1-f23227b6582b')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:07.171752 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap71580ee4-31, col_values=(('external_ids', {'iface-id': '71580ee4-3192-484a-9ee6-5096ac78a4ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:44:18', 'vm-uuid': 'a4b3355b-92d6-4b36-8dad-6cb4b3c579a2'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:07.172494 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.173737 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:59:07.194087 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.194087 np0000001127 nova-compute[98206]: INFO os_vif [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:44:18,bridge_name='br-int',has_traffic_filtering=True,id=71580ee4-3192-484a-9ee6-5096ac78a4ce,network=Network(34d80d18-cae3-4477-a29e-164067d97021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap71580ee4-31')
May 21 01:59:07.196196 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920193654',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-920193654',id=13,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj8xG3nqMprKxBLzehkwhGN33AYwwuQUWlcQ1BDSSIisfdbQN22oI+LOb499AbZ3PG8oEFQTNwey0tKs5r9Gc1kC6R76tIW1PhxpT/IYUNrOGb6wd7IJKgcO7Q871ucMw==',key_name='tempest-keypair-272806868',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fea6765f0d474e20a8cf4ce239d06576',ramdisk_id='',reservation_id='r-5gkaau5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306570717',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306570717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:58:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcc45f6ca81d42fbb09ff1916bb11787',uuid=a4b3355b-92d6-4b36-8dad-6cb4b3c579a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e74661c-8435-43a4-82d7-b7d757552d24", "address": "fa:16:3e:e6:51:87", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e74661c-84", "ovs_interfaceid": "9e74661c-8435-43a4-82d7-b7d757552d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 01:59:07.197329 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converting VIF {"id": "9e74661c-8435-43a4-82d7-b7d757552d24", "address": "fa:16:3e:e6:51:87", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e74661c-84", "ovs_interfaceid": "9e74661c-8435-43a4-82d7-b7d757552d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:59:07.197329 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:51:87,bridge_name='br-int',has_traffic_filtering=True,id=9e74661c-8435-43a4-82d7-b7d757552d24,network=Network(34d80d18-cae3-4477-a29e-164067d97021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9e74661c-84') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:59:07.197329 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:51:87,bridge_name='br-int',has_traffic_filtering=True,id=9e74661c-8435-43a4-82d7-b7d757552d24,network=Network(34d80d18-cae3-4477-a29e-164067d97021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9e74661c-84') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 01:59:07.197745 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.198075 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:07.198417 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 01:59:07.200233 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.200547 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ca46b1e5-fb6d-5bdb-be28-e04a2684b28a', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:07.201575 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.202347 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:59:07.221236 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.226397 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.226397 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e74661c-84, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:07.226397 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9e74661c-84, col_values=(('qos', UUID('c2e74cf2-8957-4140-9935-0f11e2d13ad5')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:07.226397 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9e74661c-84, col_values=(('external_ids', {'iface-id': '9e74661c-8435-43a4-82d7-b7d757552d24', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:51:87', 'vm-uuid': 'a4b3355b-92d6-4b36-8dad-6cb4b3c579a2'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:07.227968 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.230870 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:59:07.256191 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.256614 np0000001127 nova-compute[98206]: INFO os_vif [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:51:87,bridge_name='br-int',has_traffic_filtering=True,id=9e74661c-8435-43a4-82d7-b7d757552d24,network=Network(34d80d18-cae3-4477-a29e-164067d97021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9e74661c-84')
May 21 01:59:07.257648 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920193654',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-920193654',id=13,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj8xG3nqMprKxBLzehkwhGN33AYwwuQUWlcQ1BDSSIisfdbQN22oI+LOb499AbZ3PG8oEFQTNwey0tKs5r9Gc1kC6R76tIW1PhxpT/IYUNrOGb6wd7IJKgcO7Q871ucMw==',key_name='tempest-keypair-272806868',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fea6765f0d474e20a8cf4ce239d06576',ramdisk_id='',reservation_id='r-5gkaau5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306570717',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306570717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:58:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcc45f6ca81d42fbb09ff1916bb11787',uuid=a4b3355b-92d6-4b36-8dad-6cb4b3c579a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "407bbd3c-7537-4404-aaf5-a5ed533bb33b", "address": "fa:16:3e:80:dd:78", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap407bbd3c-75", "ovs_interfaceid": "407bbd3c-7537-4404-aaf5-a5ed533bb33b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 01:59:07.258543 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converting VIF {"id": "407bbd3c-7537-4404-aaf5-a5ed533bb33b", "address": "fa:16:3e:80:dd:78", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap407bbd3c-75", "ovs_interfaceid": "407bbd3c-7537-4404-aaf5-a5ed533bb33b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:59:07.258689 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:dd:78,bridge_name='br-int',has_traffic_filtering=True,id=407bbd3c-7537-4404-aaf5-a5ed533bb33b,network=Network(34d80d18-cae3-4477-a29e-164067d97021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap407bbd3c-75') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:59:07.259147 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:dd:78,bridge_name='br-int',has_traffic_filtering=True,id=407bbd3c-7537-4404-aaf5-a5ed533bb33b,network=Network(34d80d18-cae3-4477-a29e-164067d97021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap407bbd3c-75') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 01:59:07.259391 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.259708 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:07.259977 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 01:59:07.261365 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.261703 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f1684cce-9302-5b13-8540-1c4c6000434e', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:07.262995 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.264208 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:59:07.292985 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.296741 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.297618 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap407bbd3c-75, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:07.298343 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap407bbd3c-75, col_values=(('qos', UUID('110dd18b-a9f2-4d5a-8e57-a56180043f65')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:07.299092 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap407bbd3c-75, col_values=(('external_ids', {'iface-id': '407bbd3c-7537-4404-aaf5-a5ed533bb33b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:dd:78', 'vm-uuid': 'a4b3355b-92d6-4b36-8dad-6cb4b3c579a2'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:07.300216 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.302286 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:59:07.336619 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.337885 np0000001127 nova-compute[98206]: INFO os_vif [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:dd:78,bridge_name='br-int',has_traffic_filtering=True,id=407bbd3c-7537-4404-aaf5-a5ed533bb33b,network=Network(34d80d18-cae3-4477-a29e-164067d97021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap407bbd3c-75')
May 21 01:59:07.339284 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920193654',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-920193654',id=13,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj8xG3nqMprKxBLzehkwhGN33AYwwuQUWlcQ1BDSSIisfdbQN22oI+LOb499AbZ3PG8oEFQTNwey0tKs5r9Gc1kC6R76tIW1PhxpT/IYUNrOGb6wd7IJKgcO7Q871ucMw==',key_name='tempest-keypair-272806868',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fea6765f0d474e20a8cf4ce239d06576',ramdisk_id='',reservation_id='r-5gkaau5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306570717',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306570717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:58:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcc45f6ca81d42fbb09ff1916bb11787',uuid=a4b3355b-92d6-4b36-8dad-6cb4b3c579a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a350a027-1ffc-4539-a238-d98bbb9baeba", "address": "fa:16:3e:19:d5:ae", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa350a027-1f", "ovs_interfaceid": "a350a027-1ffc-4539-a238-d98bbb9baeba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 01:59:07.339284 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converting VIF {"id": "a350a027-1ffc-4539-a238-d98bbb9baeba", "address": "fa:16:3e:19:d5:ae", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa350a027-1f", "ovs_interfaceid": "a350a027-1ffc-4539-a238-d98bbb9baeba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:59:07.340247 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:d5:ae,bridge_name='br-int',has_traffic_filtering=True,id=a350a027-1ffc-4539-a238-d98bbb9baeba,network=Network(34d80d18-cae3-4477-a29e-164067d97021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa350a027-1f') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:59:07.340561 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:d5:ae,bridge_name='br-int',has_traffic_filtering=True,id=a350a027-1ffc-4539-a238-d98bbb9baeba,network=Network(34d80d18-cae3-4477-a29e-164067d97021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa350a027-1f') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 01:59:07.340804 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.342657 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:07.343662 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 01:59:07.345485 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.346228 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '791504cc-3bce-5930-a343-6d136ff1bd6e', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:07.349017 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.349977 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:59:07.365480 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-eceb3c68-7e5f-462a-bf96-a7da02d73578 req-4366df7c-1d57-46ee-9800-53eeb59e4f98 service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Received event network-changed-d99a2cf4-260b-4ca3-b72e-7db23358b831 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:07.365638 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-eceb3c68-7e5f-462a-bf96-a7da02d73578 req-4366df7c-1d57-46ee-9800-53eeb59e4f98 service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Refreshing instance network info cache due to event network-changed-d99a2cf4-260b-4ca3-b72e-7db23358b831. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:59:07.365831 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-eceb3c68-7e5f-462a-bf96-a7da02d73578 req-4366df7c-1d57-46ee-9800-53eeb59e4f98 service nova] Acquiring lock "refresh_cache-a6839691-a7ec-4dea-bc39-a7e89c94cf4d" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:59:07.366161 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-eceb3c68-7e5f-462a-bf96-a7da02d73578 req-4366df7c-1d57-46ee-9800-53eeb59e4f98 service nova] Acquired lock "refresh_cache-a6839691-a7ec-4dea-bc39-a7e89c94cf4d" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:59:07.366161 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-eceb3c68-7e5f-462a-bf96-a7da02d73578 req-4366df7c-1d57-46ee-9800-53eeb59e4f98 service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Refreshing network info cache for port d99a2cf4-260b-4ca3-b72e-7db23358b831 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:59:07.383544 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.390546 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.390769 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa350a027-1f, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:07.391168 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa350a027-1f, col_values=(('qos', UUID('8ce65758-e9da-4f9b-84ea-b55b636a239c')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:07.391345 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa350a027-1f, col_values=(('external_ids', {'iface-id': 'a350a027-1ffc-4539-a238-d98bbb9baeba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:d5:ae', 'vm-uuid': 'a4b3355b-92d6-4b36-8dad-6cb4b3c579a2'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:07.392485 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.394300 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:59:07.432811 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.434301 np0000001127 nova-compute[98206]: INFO os_vif [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:d5:ae,bridge_name='br-int',has_traffic_filtering=True,id=a350a027-1ffc-4539-a238-d98bbb9baeba,network=Network(34d80d18-cae3-4477-a29e-164067d97021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa350a027-1f')
May 21 01:59:07.435100 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920193654',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-920193654',id=13,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj8xG3nqMprKxBLzehkwhGN33AYwwuQUWlcQ1BDSSIisfdbQN22oI+LOb499AbZ3PG8oEFQTNwey0tKs5r9Gc1kC6R76tIW1PhxpT/IYUNrOGb6wd7IJKgcO7Q871ucMw==',key_name='tempest-keypair-272806868',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fea6765f0d474e20a8cf4ce239d06576',ramdisk_id='',reservation_id='r-5gkaau5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306570717',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306570717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:58:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcc45f6ca81d42fbb09ff1916bb11787',uuid=a4b3355b-92d6-4b36-8dad-6cb4b3c579a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58939f92-ac70-47fb-90c0-5f7bc2421c47", "address": "fa:16:3e:db:3c:f9", "network": {"id": "54c4e0a1-6a66-4891-94c3-c85fc5fe181c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2031114495", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58939f92-ac", "ovs_interfaceid": "58939f92-ac70-47fb-90c0-5f7bc2421c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 01:59:07.435322 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converting VIF {"id": "58939f92-ac70-47fb-90c0-5f7bc2421c47", "address": "fa:16:3e:db:3c:f9", "network": {"id": "54c4e0a1-6a66-4891-94c3-c85fc5fe181c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2031114495", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58939f92-ac", "ovs_interfaceid": "58939f92-ac70-47fb-90c0-5f7bc2421c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:59:07.437999 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:3c:f9,bridge_name='br-int',has_traffic_filtering=True,id=58939f92-ac70-47fb-90c0-5f7bc2421c47,network=Network(54c4e0a1-6a66-4891-94c3-c85fc5fe181c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58939f92-ac') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:59:07.438983 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:3c:f9,bridge_name='br-int',has_traffic_filtering=True,id=58939f92-ac70-47fb-90c0-5f7bc2421c47,network=Network(54c4e0a1-6a66-4891-94c3-c85fc5fe181c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58939f92-ac') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 01:59:07.439897 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.440140 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:07.440308 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 01:59:07.443056 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.443847 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7bb1868d-e7b4-5970-a789-71584b6517b8', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:07.444547 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.448095 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:59:07.448095 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-f878b2d6-885d-4ebf-af2f-026318227273 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Took 1.45 seconds to destroy the instance on the hypervisor.
May 21 01:59:07.448095 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-f878b2d6-885d-4ebf-af2f-026318227273 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 01:59:07.448413 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 01:59:07.448550 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 01:59:07.449289 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:07.477769 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.480398 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.480677 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58939f92-ac, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:07.481105 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap58939f92-ac, col_values=(('qos', UUID('5d16c0ec-c7e5-4b08-bd6c-0b9868e19e2e')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:07.481308 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap58939f92-ac, col_values=(('external_ids', {'iface-id': '58939f92-ac70-47fb-90c0-5f7bc2421c47', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:3c:f9', 'vm-uuid': 'a4b3355b-92d6-4b36-8dad-6cb4b3c579a2'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:07.482597 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.484528 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:59:07.486268 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 01:59:07.531092 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.532575 np0000001127 nova-compute[98206]: INFO os_vif [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:3c:f9,bridge_name='br-int',has_traffic_filtering=True,id=58939f92-ac70-47fb-90c0-5f7bc2421c47,network=Network(54c4e0a1-6a66-4891-94c3-c85fc5fe181c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58939f92-ac')
May 21 01:59:07.533644 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920193654',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-920193654',id=13,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj8xG3nqMprKxBLzehkwhGN33AYwwuQUWlcQ1BDSSIisfdbQN22oI+LOb499AbZ3PG8oEFQTNwey0tKs5r9Gc1kC6R76tIW1PhxpT/IYUNrOGb6wd7IJKgcO7Q871ucMw==',key_name='tempest-keypair-272806868',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fea6765f0d474e20a8cf4ce239d06576',ramdisk_id='',reservation_id='r-5gkaau5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306570717',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306570717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:58:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcc45f6ca81d42fbb09ff1916bb11787',uuid=a4b3355b-92d6-4b36-8dad-6cb4b3c579a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ac81609-4fab-4940-9313-6dd7160c7a9b", "address": "fa:16:3e:c9:a8:b1", "network": {"id": "54c4e0a1-6a66-4891-94c3-c85fc5fe181c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2031114495", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac81609-4f", "ovs_interfaceid": "1ac81609-4fab-4940-9313-6dd7160c7a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 01:59:07.534083 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converting VIF {"id": "1ac81609-4fab-4940-9313-6dd7160c7a9b", "address": "fa:16:3e:c9:a8:b1", "network": {"id": "54c4e0a1-6a66-4891-94c3-c85fc5fe181c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2031114495", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac81609-4f", "ovs_interfaceid": "1ac81609-4fab-4940-9313-6dd7160c7a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:59:07.535930 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:a8:b1,bridge_name='br-int',has_traffic_filtering=True,id=1ac81609-4fab-4940-9313-6dd7160c7a9b,network=Network(54c4e0a1-6a66-4891-94c3-c85fc5fe181c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ac81609-4f') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:59:07.535930 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:a8:b1,bridge_name='br-int',has_traffic_filtering=True,id=1ac81609-4fab-4940-9313-6dd7160c7a9b,network=Network(54c4e0a1-6a66-4891-94c3-c85fc5fe181c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ac81609-4f') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 01:59:07.535930 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.536157 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:07.537519 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 01:59:07.540197 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.540197 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e441d1c4-0c59-52e2-a4bc-e0e49cbf6e4f', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:07.542746 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.543454 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:59:07.590148 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.593170 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.593766 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ac81609-4f, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:07.594544 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1ac81609-4f, col_values=(('qos', UUID('4edd0863-8ee4-489a-8777-dbe1c92b11b9')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:07.594962 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1ac81609-4f, col_values=(('external_ids', {'iface-id': '1ac81609-4fab-4940-9313-6dd7160c7a9b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:a8:b1', 'vm-uuid': 'a4b3355b-92d6-4b36-8dad-6cb4b3c579a2'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:07.598711 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.600243 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:59:07.657353 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:07.664673 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:07.666005 np0000001127 nova-compute[98206]: INFO os_vif [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:a8:b1,bridge_name='br-int',has_traffic_filtering=True,id=1ac81609-4fab-4940-9313-6dd7160c7a9b,network=Network(54c4e0a1-6a66-4891-94c3-c85fc5fe181c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ac81609-4f')
May 21 01:59:07.869162 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-eceb3c68-7e5f-462a-bf96-a7da02d73578 req-4366df7c-1d57-46ee-9800-53eeb59e4f98 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:08.071288 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-6f6b105a-2069-49cf-ab4e-4345975594f3 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "6f68556b-0b18-452a-b307-da2dad4ee6ab" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.801s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:08.523574 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Found WWN 330000000e3a8a7be for multipath device dm-1 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 01:59:08.523894 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.064s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:59:08.524140 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] <== connect_volume: return (2344ms) {'type': 'block', 'scsi_wwn': '330000000e3a8a7be', 'path': '/dev/dm-1', 'multipath_id': '330000000e3a8a7be'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:59:08.524307 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e3a8a7be', 'path': '/dev/dm-1', 'multipath_id': '330000000e3a8a7be'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 01:59:08.740592 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:59:08.823114 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-6aaaec49-0dba-4310-b46c-1c331037a63e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "6f68556b-0b18-452a-b307-da2dad4ee6ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:08.823287 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-6aaaec49-0dba-4310-b46c-1c331037a63e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "6f68556b-0b18-452a-b307-da2dad4ee6ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:08.823489 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-6aaaec49-0dba-4310-b46c-1c331037a63e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "6f68556b-0b18-452a-b307-da2dad4ee6ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:08.823627 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-6aaaec49-0dba-4310-b46c-1c331037a63e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "6f68556b-0b18-452a-b307-da2dad4ee6ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:08.823744 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-6aaaec49-0dba-4310-b46c-1c331037a63e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "6f68556b-0b18-452a-b307-da2dad4ee6ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:08.826007 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-6aaaec49-0dba-4310-b46c-1c331037a63e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Terminating instance
May 21 01:59:08.901277 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-ddb6acfb-a396-4fe8-958a-b543b86b2930 req-90a5c877-f6cd-4453-9eee-d214dfbba4d8 service nova] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Received event network-vif-unplugged-3ef861c1-6e74-4d82-a214-06c2d655f210 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:08.901277 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ddb6acfb-a396-4fe8-958a-b543b86b2930 req-90a5c877-f6cd-4453-9eee-d214dfbba4d8 service nova] Acquiring lock "f8921842-2161-4ddf-b3c4-b642fc51a70f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:08.901277 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ddb6acfb-a396-4fe8-958a-b543b86b2930 req-90a5c877-f6cd-4453-9eee-d214dfbba4d8 service nova] Lock "f8921842-2161-4ddf-b3c4-b642fc51a70f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:08.901443 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ddb6acfb-a396-4fe8-958a-b543b86b2930 req-90a5c877-f6cd-4453-9eee-d214dfbba4d8 service nova] Lock "f8921842-2161-4ddf-b3c4-b642fc51a70f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:08.902592 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-ddb6acfb-a396-4fe8-958a-b543b86b2930 req-90a5c877-f6cd-4453-9eee-d214dfbba4d8 service nova] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] No waiting events found dispatching network-vif-unplugged-3ef861c1-6e74-4d82-a214-06c2d655f210 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:59:08.902592 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-ddb6acfb-a396-4fe8-958a-b543b86b2930 req-90a5c877-f6cd-4453-9eee-d214dfbba4d8 service nova] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Received event network-vif-unplugged-3ef861c1-6e74-4d82-a214-06c2d655f210 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 01:59:09.034652 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:58:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1558814074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serverbootfromvolumestablerescuetest-server-1558814074',id=15,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:58:55Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83df9a84ffaa4398bdafbfbde079964d',ramdisk_id='',reservation_id='r-cgn40wpx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-260444396',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:58:56Z,user_data=None,user_id='bd5b969d5a514d01bacfc7954a5ae4ab',uuid=392bbdc4-beaa-4c44-93f5-3a76f331ceb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44670b22-c758-456b-a200-f0323baea57f", "address": "fa:16:3e:50:bf:d8", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "vif_mac": "fa:16:3e:50:bf:d8"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap44670b22-c7", "ovs_interfaceid": "44670b22-c758-456b-a200-f0323baea57f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 01:59:09.034923 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Converting VIF {"id": "44670b22-c758-456b-a200-f0323baea57f", "address": "fa:16:3e:50:bf:d8", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "vif_mac": "fa:16:3e:50:bf:d8"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap44670b22-c7", "ovs_interfaceid": "44670b22-c758-456b-a200-f0323baea57f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:59:09.035481 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:bf:d8,bridge_name='br-int',has_traffic_filtering=True,id=44670b22-c758-456b-a200-f0323baea57f,network=Network(b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44670b22-c7') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:59:09.036420 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lazy-loading 'pci_devices' on Instance uuid 392bbdc4-beaa-4c44-93f5-3a76f331ceb0 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:59:09.121372 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-eceb3c68-7e5f-462a-bf96-a7da02d73578 req-4366df7c-1d57-46ee-9800-53eeb59e4f98 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:09.214139 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:59:09.214544 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:59:09.214717 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] No VIF found with MAC fa:16:3e:f8:14:ac, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 01:59:09.214960 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] No VIF found with MAC fa:16:3e:19:d5:ae, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 01:59:09.217093 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Using config drive
May 21 01:59:09.243089 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Took 1.79 seconds to deallocate network for instance.
May 21 01:59:09.307451 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-eceb3c68-7e5f-462a-bf96-a7da02d73578 req-4366df7c-1d57-46ee-9800-53eeb59e4f98 service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Updated VIF entry in instance network info cache for port d99a2cf4-260b-4ca3-b72e-7db23358b831. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 01:59:09.307781 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-eceb3c68-7e5f-462a-bf96-a7da02d73578 req-4366df7c-1d57-46ee-9800-53eeb59e4f98 service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Updating instance_info_cache with network_info: [{"id": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "address": "fa:16:3e:76:c8:70", "network": {"id": "7cdbc224-429f-49a6-86f3-307f51e53dfc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2078432126-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc797708a5a7400992765e41ee6ec260", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99a2cf4-26", "ovs_interfaceid": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:59:09.329960 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-6aaaec49-0dba-4310-b46c-1c331037a63e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 01:59:09.443720 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:09.444199 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:09.463333 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:09.479200 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-53f2f3de-b980-438b-afdc-e74b6d53d5ae req-c622bac0-3e2b-4a74-823e-6265d84a3f7b service nova] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Received event network-vif-deleted-3ef861c1-6e74-4d82-a214-06c2d655f210 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:09.539119 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Object Instance<392bbdc4-beaa-4c44-93f5-3a76f331ceb0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 01:59:09.541658 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] End _get_guest_xml xml=<domain type="qemu">
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:   <uuid>392bbdc4-beaa-4c44-93f5-3a76f331ceb0</uuid>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:   <name>instance-0000000f</name>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:   <metadata>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1558814074</nova:name>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 01:59:05</nova:creationTime>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:           <nova:property name="hw_machine_type">pc</nova:property>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:           <nova:property name="hw_video_model">virtio</nova:property>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:       </nova:image>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:         <nova:user uuid="bd5b969d5a514d01bacfc7954a5ae4ab">tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member</nova:user>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:         <nova:project uuid="83df9a84ffaa4398bdafbfbde079964d">tempest-ServerBootFromVolumeStableRescueTest-260444396</nova:project>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:         <nova:port uuid="44670b22-c758-456b-a200-f0323baea57f">
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:         </nova:port>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:   </metadata>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:     <system>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:       <entry name="serial">392bbdc4-beaa-4c44-93f5-3a76f331ceb0</entry>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:       <entry name="uuid">392bbdc4-beaa-4c44-93f5-3a76f331ceb0</entry>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:     </system>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:   <os>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:   </os>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:   <features>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:     <acpi/>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:     <tcg>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:     </tcg>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:   </features>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:   <devices>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/392bbdc4-beaa-4c44-93f5-3a76f331ceb0/disk.config"/>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:     </disk>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:       <alias name="ua-69f8ed84-393f-414e-9868-ac8c3126b175"/>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-1"/>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:       <serial>69f8ed84-393f-414e-9868-ac8c3126b175</serial>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:     </disk>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/392bbdc4-beaa-4c44-93f5-3a76f331ceb0/disk.rescue"/>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:       <target dev="vdb" bus="virtio"/>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:       <boot order="1"/>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:     </disk>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:50:bf:d8"/>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:       <target dev="tap44670b22-c7"/>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:     </interface>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/392bbdc4-beaa-4c44-93f5-3a76f331ceb0/console.log" append="off"/>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:     </serial>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:     <video>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:     </video>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:     </rng>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:     </memballoon>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:   </devices>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]: </domain>
May 21 01:59:09.541658 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 01:59:09.543506 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:09.550227 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Instance destroyed successfully.
May 21 01:59:09.659794 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:09.667915 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999649751000106 future=<Future at 0x71c05858f050 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:59:09.670740 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Instance destroyed successfully.
May 21 01:59:09.671435 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-6aaaec49-0dba-4310-b46c-1c331037a63e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lazy-loading 'resources' on Instance uuid 6f68556b-0b18-452a-b307-da2dad4ee6ab {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:59:09.725493 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:09.747579 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:09.751245 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f878b2d6-885d-4ebf-af2f-026318227273 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:09.751434 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f878b2d6-885d-4ebf-af2f-026318227273 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:09.811546 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-eceb3c68-7e5f-462a-bf96-a7da02d73578 req-4366df7c-1d57-46ee-9800-53eeb59e4f98 service nova] Releasing lock "refresh_cache-a6839691-a7ec-4dea-bc39-a7e89c94cf4d" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:59:09.958782 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Creating config drive at /opt/stack/data/nova/instances/a4b3355b-92d6-4b36-8dad-6cb4b3c579a2/disk.config
May 21 01:59:09.971073 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a4b3355b-92d6-4b36-8dad-6cb4b3c579a2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9nhmlpx4 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:10.024561 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a4b3355b-92d6-4b36-8dad-6cb4b3c579a2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9nhmlpx4" returned: 0 in 0.054s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:10.175163 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-6aaaec49-0dba-4310-b46c-1c331037a63e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-21T01:56:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-288227188',display_name='tempest-ServerActionsTestOtherA-server-410489228',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-tempest-common-compute-instance-288227188',id=10,image_ref='fea37df7-c5b0-431e-9e55-09d856a51ff9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFa4h1sACKVx0qMim6t3PkF47uhDyneTJkwL/xOqx10IdCIKzdMNwpXbxDopvRYuon+cm2g/xX3KdbSKB9yixqLXsKKYgUZSUERIMzzqqvllJnaPGuHQmel2EKS0sBdZzQ==',key_name='tempest-keypair-1484910746',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:58:25Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a15fe7a70464159a778cffa4a36c36f',ramdisk_id='',reservation_id='r-06kjjbvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='fea37df7-c5b0-431e-9e55-09d856a51ff9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1975191698',owner_user_name='tempest-ServerActionsTestOtherA-1975191698-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:58:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbcd1a81252344dd804a4080571f8751',uuid=6f68556b-0b18-452a-b307-da2dad4ee6ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "069db2b1-36ac-43ce-b643-fcdc9ff52141", "address": "fa:16:3e:30:ad:e5", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap069db2b1-36", "ovs_interfaceid": "069db2b1-36ac-43ce-b643-fcdc9ff52141", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 01:59:10.175709 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-6aaaec49-0dba-4310-b46c-1c331037a63e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Converting VIF {"id": "069db2b1-36ac-43ce-b643-fcdc9ff52141", "address": "fa:16:3e:30:ad:e5", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap069db2b1-36", "ovs_interfaceid": "069db2b1-36ac-43ce-b643-fcdc9ff52141", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:59:10.176399 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-6aaaec49-0dba-4310-b46c-1c331037a63e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:ad:e5,bridge_name='br-int',has_traffic_filtering=True,id=069db2b1-36ac-43ce-b643-fcdc9ff52141,network=Network(6d660724-85bf-45e3-895a-b9ce67043c30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap069db2b1-36') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:59:10.177038 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-6aaaec49-0dba-4310-b46c-1c331037a63e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:ad:e5,bridge_name='br-int',has_traffic_filtering=True,id=069db2b1-36ac-43ce-b643-fcdc9ff52141,network=Network(6d660724-85bf-45e3-895a-b9ce67043c30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap069db2b1-36') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 01:59:10.179462 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:10.179957 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap069db2b1-36, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:10.181339 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:10.182333 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:59:10.239179 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:10.241311 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:10.241311 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5eb898fd-5fbc-46f7-aec5-e2ae4c63f17a) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:10.243318 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:10.243390 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:59:10.295919 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:10.300445 np0000001127 nova-compute[98206]: INFO os_vif [None req-6aaaec49-0dba-4310-b46c-1c331037a63e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:ad:e5,bridge_name='br-int',has_traffic_filtering=True,id=069db2b1-36ac-43ce-b643-fcdc9ff52141,network=Network(6d660724-85bf-45e3-895a-b9ce67043c30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap069db2b1-36')
May 21 01:59:10.300873 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-6aaaec49-0dba-4310-b46c-1c331037a63e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Deleting instance files /opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab_del
May 21 01:59:10.301877 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-6aaaec49-0dba-4310-b46c-1c331037a63e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Deletion of /opt/stack/data/nova/instances/6f68556b-0b18-452a-b307-da2dad4ee6ab_del complete
May 21 01:59:10.391824 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f878b2d6-885d-4ebf-af2f-026318227273 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:59:10.391824 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-f878b2d6-885d-4ebf-af2f-026318227273 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:59:10.611859 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:10.672116 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:10.731672 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:10.732549 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:10.811624 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-6aaaec49-0dba-4310-b46c-1c331037a63e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Took 1.48 seconds to destroy the instance on the hypervisor.
May 21 01:59:10.811624 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-6aaaec49-0dba-4310-b46c-1c331037a63e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 01:59:10.811624 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 01:59:10.811624 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 01:59:10.812155 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:10.849346 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:10.880948 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:10.883782 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:10.895568 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-f878b2d6-885d-4ebf-af2f-026318227273 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:59:10.904226 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:10.908517 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:10.988294 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:10.990084 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:11.001683 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:11.040320 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:11.072431 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:11.077410 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:11.081537 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:59:11.081537 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:59:11.081537 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:59:11.081537 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] No VIF found with MAC fa:16:3e:50:bf:d8, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 01:59:11.081860 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Using config drive
May 21 01:59:11.124728 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:11.148583 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:11.189270 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1a6a935d-336e-4753-8bae-d43fb33df26f req-2315b7c0-ca9e-44e9-af8f-1b91fabc72c1 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-plugged-9e74661c-8435-43a4-82d7-b7d757552d24 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:11.192740 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1a6a935d-336e-4753-8bae-d43fb33df26f req-2315b7c0-ca9e-44e9-af8f-1b91fabc72c1 service nova] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:11.192740 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1a6a935d-336e-4753-8bae-d43fb33df26f req-2315b7c0-ca9e-44e9-af8f-1b91fabc72c1 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:11.192740 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1a6a935d-336e-4753-8bae-d43fb33df26f req-2315b7c0-ca9e-44e9-af8f-1b91fabc72c1 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:11.192740 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1a6a935d-336e-4753-8bae-d43fb33df26f req-2315b7c0-ca9e-44e9-af8f-1b91fabc72c1 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Processing event network-vif-plugged-9e74661c-8435-43a4-82d7-b7d757552d24 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 01:59:11.199313 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:11.201135 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:11.287936 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:11.356929 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:11.358410 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:11.360008 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:11.407251 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f878b2d6-885d-4ebf-af2f-026318227273 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.654s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:11.437553 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:11.451669 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:11.495727 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:11.509451 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-f878b2d6-885d-4ebf-af2f-026318227273 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Deleted allocations for instance f8921842-2161-4ddf-b3c4-b642fc51a70f
May 21 01:59:11.591130 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lazy-loading 'ec2_ids' on Instance uuid 392bbdc4-beaa-4c44-93f5-3a76f331ceb0 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:59:11.602502 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:11.618988 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b4a25d84-7d19-4028-a24c-17c38f6dbb58 req-003e29cd-f1eb-480c-9eb4-178ae0a2ebf6 service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Received event network-changed-d99a2cf4-260b-4ca3-b72e-7db23358b831 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:11.619130 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b4a25d84-7d19-4028-a24c-17c38f6dbb58 req-003e29cd-f1eb-480c-9eb4-178ae0a2ebf6 service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Refreshing instance network info cache due to event network-changed-d99a2cf4-260b-4ca3-b72e-7db23358b831. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:59:11.619314 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b4a25d84-7d19-4028-a24c-17c38f6dbb58 req-003e29cd-f1eb-480c-9eb4-178ae0a2ebf6 service nova] Acquiring lock "refresh_cache-a6839691-a7ec-4dea-bc39-a7e89c94cf4d" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:59:11.620492 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b4a25d84-7d19-4028-a24c-17c38f6dbb58 req-003e29cd-f1eb-480c-9eb4-178ae0a2ebf6 service nova] Acquired lock "refresh_cache-a6839691-a7ec-4dea-bc39-a7e89c94cf4d" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:59:11.620492 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-b4a25d84-7d19-4028-a24c-17c38f6dbb58 req-003e29cd-f1eb-480c-9eb4-178ae0a2ebf6 service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Refreshing network info cache for port d99a2cf4-260b-4ca3-b72e-7db23358b831 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:59:11.729723 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:11.745298 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:11.747239 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:11.780459 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:11.788669 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:12.074802 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:12.084822 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:12.107650 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Object Instance<392bbdc4-beaa-4c44-93f5-3a76f331ceb0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 01:59:12.107776 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lazy-loading 'keypairs' on Instance uuid 392bbdc4-beaa-4c44-93f5-3a76f331ceb0 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:59:12.123522 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-b4a25d84-7d19-4028-a24c-17c38f6dbb58 req-003e29cd-f1eb-480c-9eb4-178ae0a2ebf6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:12.268801 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:12.277155 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:12.460593 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:12.466294 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:12.501804 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:59:12.522484 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f878b2d6-885d-4ebf-af2f-026318227273 tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Lock "f8921842-2161-4ddf-b3c4-b642fc51a70f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.041s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:12.619545 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Object Instance<392bbdc4-beaa-4c44-93f5-3a76f331ceb0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 01:59:12.619545 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:12.722603 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328752.722171, a4b3355b-92d6-4b36-8dad-6cb4b3c579a2 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:59:12.723027 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] VM Started (Lifecycle Event)
May 21 01:59:12.870313 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:12.878243 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:12.885846 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:12.910540 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:12.918339 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:12.938710 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-b4a25d84-7d19-4028-a24c-17c38f6dbb58 req-003e29cd-f1eb-480c-9eb4-178ae0a2ebf6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:12.970126 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Creating config drive at /opt/stack/data/nova/instances/392bbdc4-beaa-4c44-93f5-3a76f331ceb0/disk.config.rescue
May 21 01:59:12.973566 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/392bbdc4-beaa-4c44-93f5-3a76f331ceb0/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5butz48c {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:13.007315 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Took 2.20 seconds to deallocate network for instance.
May 21 01:59:13.041848 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/392bbdc4-beaa-4c44-93f5-3a76f331ceb0/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5butz48c" returned: 0 in 0.068s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:13.063503 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-39f9eac7-30e5-424a-8a0f-5b0423ea93be req-cebae55f-9164-4543-ad79-320b8971c8a8 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-plugged-f99ceda9-fad6-4a73-af2a-c63d3d320e2f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:13.064412 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-39f9eac7-30e5-424a-8a0f-5b0423ea93be req-cebae55f-9164-4543-ad79-320b8971c8a8 service nova] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:13.064730 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-39f9eac7-30e5-424a-8a0f-5b0423ea93be req-cebae55f-9164-4543-ad79-320b8971c8a8 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:13.064930 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-39f9eac7-30e5-424a-8a0f-5b0423ea93be req-cebae55f-9164-4543-ad79-320b8971c8a8 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:13.065211 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-39f9eac7-30e5-424a-8a0f-5b0423ea93be req-cebae55f-9164-4543-ad79-320b8971c8a8 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Processing event network-vif-plugged-f99ceda9-fad6-4a73-af2a-c63d3d320e2f {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 01:59:13.193027 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-b4a25d84-7d19-4028-a24c-17c38f6dbb58 req-003e29cd-f1eb-480c-9eb4-178ae0a2ebf6 service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Updated VIF entry in instance network info cache for port d99a2cf4-260b-4ca3-b72e-7db23358b831. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 01:59:13.193638 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-b4a25d84-7d19-4028-a24c-17c38f6dbb58 req-003e29cd-f1eb-480c-9eb4-178ae0a2ebf6 service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Updating instance_info_cache with network_info: [{"id": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "address": "fa:16:3e:76:c8:70", "network": {"id": "7cdbc224-429f-49a6-86f3-307f51e53dfc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2078432126-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc797708a5a7400992765e41ee6ec260", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99a2cf4-26", "ovs_interfaceid": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:59:13.228493 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:59:13.236172 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328753.2357802, a4b3355b-92d6-4b36-8dad-6cb4b3c579a2 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:59:13.236315 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] VM Paused (Lifecycle Event)
May 21 01:59:13.255844 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:13.262002 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:13.280607 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6e8010f6-d0fd-494d-b4fd-45972a204e24 req-02f86c3c-fa83-41f8-8ac8-232e81aa1df4 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-plugged-9e74661c-8435-43a4-82d7-b7d757552d24 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:13.282219 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6e8010f6-d0fd-494d-b4fd-45972a204e24 req-02f86c3c-fa83-41f8-8ac8-232e81aa1df4 service nova] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:13.282384 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6e8010f6-d0fd-494d-b4fd-45972a204e24 req-02f86c3c-fa83-41f8-8ac8-232e81aa1df4 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:13.282521 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6e8010f6-d0fd-494d-b4fd-45972a204e24 req-02f86c3c-fa83-41f8-8ac8-232e81aa1df4 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:13.282708 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6e8010f6-d0fd-494d-b4fd-45972a204e24 req-02f86c3c-fa83-41f8-8ac8-232e81aa1df4 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] No event matching network-vif-plugged-9e74661c-8435-43a4-82d7-b7d757552d24 in dict_keys([('network-vif-plugged', '71580ee4-3192-484a-9ee6-5096ac78a4ce'), ('network-vif-plugged', '407bbd3c-7537-4404-aaf5-a5ed533bb33b'), ('network-vif-plugged', 'a350a027-1ffc-4539-a238-d98bbb9baeba'), ('network-vif-plugged', '58939f92-ac70-47fb-90c0-5f7bc2421c47'), ('network-vif-plugged', '1ac81609-4fab-4940-9313-6dd7160c7a9b')]) {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 21 01:59:13.282974 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-6e8010f6-d0fd-494d-b4fd-45972a204e24 req-02f86c3c-fa83-41f8-8ac8-232e81aa1df4 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received unexpected event network-vif-plugged-9e74661c-8435-43a4-82d7-b7d757552d24 for instance with vm_state building and task_state spawning.
May 21 01:59:13.283179 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6e8010f6-d0fd-494d-b4fd-45972a204e24 req-02f86c3c-fa83-41f8-8ac8-232e81aa1df4 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-plugged-a350a027-1ffc-4539-a238-d98bbb9baeba {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:13.283348 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6e8010f6-d0fd-494d-b4fd-45972a204e24 req-02f86c3c-fa83-41f8-8ac8-232e81aa1df4 service nova] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:13.283525 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6e8010f6-d0fd-494d-b4fd-45972a204e24 req-02f86c3c-fa83-41f8-8ac8-232e81aa1df4 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:13.283799 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6e8010f6-d0fd-494d-b4fd-45972a204e24 req-02f86c3c-fa83-41f8-8ac8-232e81aa1df4 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:13.283799 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6e8010f6-d0fd-494d-b4fd-45972a204e24 req-02f86c3c-fa83-41f8-8ac8-232e81aa1df4 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Processing event network-vif-plugged-a350a027-1ffc-4539-a238-d98bbb9baeba {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 01:59:13.283998 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6e8010f6-d0fd-494d-b4fd-45972a204e24 req-02f86c3c-fa83-41f8-8ac8-232e81aa1df4 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-plugged-a350a027-1ffc-4539-a238-d98bbb9baeba {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:13.283998 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6e8010f6-d0fd-494d-b4fd-45972a204e24 req-02f86c3c-fa83-41f8-8ac8-232e81aa1df4 service nova] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:13.284144 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6e8010f6-d0fd-494d-b4fd-45972a204e24 req-02f86c3c-fa83-41f8-8ac8-232e81aa1df4 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:13.284505 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6e8010f6-d0fd-494d-b4fd-45972a204e24 req-02f86c3c-fa83-41f8-8ac8-232e81aa1df4 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:13.284505 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6e8010f6-d0fd-494d-b4fd-45972a204e24 req-02f86c3c-fa83-41f8-8ac8-232e81aa1df4 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] No event matching network-vif-plugged-a350a027-1ffc-4539-a238-d98bbb9baeba in dict_keys([('network-vif-plugged', '71580ee4-3192-484a-9ee6-5096ac78a4ce'), ('network-vif-plugged', '407bbd3c-7537-4404-aaf5-a5ed533bb33b'), ('network-vif-plugged', '58939f92-ac70-47fb-90c0-5f7bc2421c47'), ('network-vif-plugged', '1ac81609-4fab-4940-9313-6dd7160c7a9b')]) {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 21 01:59:13.284505 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-6e8010f6-d0fd-494d-b4fd-45972a204e24 req-02f86c3c-fa83-41f8-8ac8-232e81aa1df4 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received unexpected event network-vif-plugged-a350a027-1ffc-4539-a238-d98bbb9baeba for instance with vm_state building and task_state spawning.
May 21 01:59:13.522887 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-6aaaec49-0dba-4310-b46c-1c331037a63e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:13.523176 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-6aaaec49-0dba-4310-b46c-1c331037a63e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:13.571206 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:13.595811 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:13.699536 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b4a25d84-7d19-4028-a24c-17c38f6dbb58 req-003e29cd-f1eb-480c-9eb4-178ae0a2ebf6 service nova] Releasing lock "refresh_cache-a6839691-a7ec-4dea-bc39-a7e89c94cf4d" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:59:13.699536 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b4a25d84-7d19-4028-a24c-17c38f6dbb58 req-003e29cd-f1eb-480c-9eb4-178ae0a2ebf6 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-plugged-71580ee4-3192-484a-9ee6-5096ac78a4ce {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:13.699536 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b4a25d84-7d19-4028-a24c-17c38f6dbb58 req-003e29cd-f1eb-480c-9eb4-178ae0a2ebf6 service nova] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:13.699672 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b4a25d84-7d19-4028-a24c-17c38f6dbb58 req-003e29cd-f1eb-480c-9eb4-178ae0a2ebf6 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:13.699915 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b4a25d84-7d19-4028-a24c-17c38f6dbb58 req-003e29cd-f1eb-480c-9eb4-178ae0a2ebf6 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:13.700095 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b4a25d84-7d19-4028-a24c-17c38f6dbb58 req-003e29cd-f1eb-480c-9eb4-178ae0a2ebf6 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Processing event network-vif-plugged-71580ee4-3192-484a-9ee6-5096ac78a4ce {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 01:59:13.724765 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bb09a8e3-51f1-4c04-9fe1-002e264271ee req-30a43612-7d68-4eb9-8f50-4281e15666f1 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-plugged-71580ee4-3192-484a-9ee6-5096ac78a4ce {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:13.725086 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bb09a8e3-51f1-4c04-9fe1-002e264271ee req-30a43612-7d68-4eb9-8f50-4281e15666f1 service nova] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:13.725288 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bb09a8e3-51f1-4c04-9fe1-002e264271ee req-30a43612-7d68-4eb9-8f50-4281e15666f1 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:13.725436 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bb09a8e3-51f1-4c04-9fe1-002e264271ee req-30a43612-7d68-4eb9-8f50-4281e15666f1 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:13.732098 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bb09a8e3-51f1-4c04-9fe1-002e264271ee req-30a43612-7d68-4eb9-8f50-4281e15666f1 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] No event matching network-vif-plugged-71580ee4-3192-484a-9ee6-5096ac78a4ce in dict_keys([('network-vif-plugged', '407bbd3c-7537-4404-aaf5-a5ed533bb33b'), ('network-vif-plugged', '58939f92-ac70-47fb-90c0-5f7bc2421c47'), ('network-vif-plugged', '1ac81609-4fab-4940-9313-6dd7160c7a9b')]) {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 21 01:59:13.732319 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-bb09a8e3-51f1-4c04-9fe1-002e264271ee req-30a43612-7d68-4eb9-8f50-4281e15666f1 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received unexpected event network-vif-plugged-71580ee4-3192-484a-9ee6-5096ac78a4ce for instance with vm_state building and task_state spawning.
May 21 01:59:13.734095 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bb09a8e3-51f1-4c04-9fe1-002e264271ee req-30a43612-7d68-4eb9-8f50-4281e15666f1 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-plugged-407bbd3c-7537-4404-aaf5-a5ed533bb33b {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:13.734095 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bb09a8e3-51f1-4c04-9fe1-002e264271ee req-30a43612-7d68-4eb9-8f50-4281e15666f1 service nova] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:13.734095 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bb09a8e3-51f1-4c04-9fe1-002e264271ee req-30a43612-7d68-4eb9-8f50-4281e15666f1 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:13.734095 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bb09a8e3-51f1-4c04-9fe1-002e264271ee req-30a43612-7d68-4eb9-8f50-4281e15666f1 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:13.734095 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bb09a8e3-51f1-4c04-9fe1-002e264271ee req-30a43612-7d68-4eb9-8f50-4281e15666f1 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Processing event network-vif-plugged-407bbd3c-7537-4404-aaf5-a5ed533bb33b {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 01:59:13.734095 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bb09a8e3-51f1-4c04-9fe1-002e264271ee req-30a43612-7d68-4eb9-8f50-4281e15666f1 service nova] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Received event network-vif-deleted-069db2b1-36ac-43ce-b643-fcdc9ff52141 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:13.734095 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bb09a8e3-51f1-4c04-9fe1-002e264271ee req-30a43612-7d68-4eb9-8f50-4281e15666f1 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-plugged-407bbd3c-7537-4404-aaf5-a5ed533bb33b {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:13.734095 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bb09a8e3-51f1-4c04-9fe1-002e264271ee req-30a43612-7d68-4eb9-8f50-4281e15666f1 service nova] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:13.734095 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bb09a8e3-51f1-4c04-9fe1-002e264271ee req-30a43612-7d68-4eb9-8f50-4281e15666f1 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:13.734095 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bb09a8e3-51f1-4c04-9fe1-002e264271ee req-30a43612-7d68-4eb9-8f50-4281e15666f1 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:13.734095 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bb09a8e3-51f1-4c04-9fe1-002e264271ee req-30a43612-7d68-4eb9-8f50-4281e15666f1 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] No event matching network-vif-plugged-407bbd3c-7537-4404-aaf5-a5ed533bb33b in dict_keys([('network-vif-plugged', '58939f92-ac70-47fb-90c0-5f7bc2421c47'), ('network-vif-plugged', '1ac81609-4fab-4940-9313-6dd7160c7a9b')]) {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 21 01:59:13.736354 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-bb09a8e3-51f1-4c04-9fe1-002e264271ee req-30a43612-7d68-4eb9-8f50-4281e15666f1 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received unexpected event network-vif-plugged-407bbd3c-7537-4404-aaf5-a5ed533bb33b for instance with vm_state building and task_state spawning.
May 21 01:59:13.736648 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bb09a8e3-51f1-4c04-9fe1-002e264271ee req-30a43612-7d68-4eb9-8f50-4281e15666f1 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-plugged-1ac81609-4fab-4940-9313-6dd7160c7a9b {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:13.736845 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bb09a8e3-51f1-4c04-9fe1-002e264271ee req-30a43612-7d68-4eb9-8f50-4281e15666f1 service nova] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:13.737134 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bb09a8e3-51f1-4c04-9fe1-002e264271ee req-30a43612-7d68-4eb9-8f50-4281e15666f1 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:13.737218 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bb09a8e3-51f1-4c04-9fe1-002e264271ee req-30a43612-7d68-4eb9-8f50-4281e15666f1 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:13.737382 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bb09a8e3-51f1-4c04-9fe1-002e264271ee req-30a43612-7d68-4eb9-8f50-4281e15666f1 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Processing event network-vif-plugged-1ac81609-4fab-4940-9313-6dd7160c7a9b {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 01:59:13.737577 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bb09a8e3-51f1-4c04-9fe1-002e264271ee req-30a43612-7d68-4eb9-8f50-4281e15666f1 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-plugged-1ac81609-4fab-4940-9313-6dd7160c7a9b {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:13.737732 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bb09a8e3-51f1-4c04-9fe1-002e264271ee req-30a43612-7d68-4eb9-8f50-4281e15666f1 service nova] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:13.737909 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bb09a8e3-51f1-4c04-9fe1-002e264271ee req-30a43612-7d68-4eb9-8f50-4281e15666f1 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:13.738065 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bb09a8e3-51f1-4c04-9fe1-002e264271ee req-30a43612-7d68-4eb9-8f50-4281e15666f1 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:13.738180 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bb09a8e3-51f1-4c04-9fe1-002e264271ee req-30a43612-7d68-4eb9-8f50-4281e15666f1 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] No event matching network-vif-plugged-1ac81609-4fab-4940-9313-6dd7160c7a9b in dict_keys([('network-vif-plugged', '58939f92-ac70-47fb-90c0-5f7bc2421c47')]) {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 21 01:59:13.738292 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-bb09a8e3-51f1-4c04-9fe1-002e264271ee req-30a43612-7d68-4eb9-8f50-4281e15666f1 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received unexpected event network-vif-plugged-1ac81609-4fab-4940-9313-6dd7160c7a9b for instance with vm_state building and task_state spawning.
May 21 01:59:13.748377 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:59:13.758151 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:59:13.775237 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:13.782548 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:13.806175 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:13.807827 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:14.143451 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-6aaaec49-0dba-4310-b46c-1c331037a63e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:59:14.143721 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-6aaaec49-0dba-4310-b46c-1c331037a63e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:59:14.260804 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 01:59:14.647314 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-6aaaec49-0dba-4310-b46c-1c331037a63e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:59:14.693190 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Removed pending STOPPED event for 392bbdc4-beaa-4c44-93f5-3a76f331ceb0 due to new event <LifecycleEvent: 1779328754.6928074, 392bbdc4-beaa-4c44-93f5-3a76f331ceb0 => Resumed> {{(pid=98206) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 21 01:59:14.693405 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328754.6928074, 392bbdc4-beaa-4c44-93f5-3a76f331ceb0 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:59:14.693581 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] VM Resumed (Lifecycle Event)
May 21 01:59:14.699319 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-837163d9-ac3f-4bca-9df3-554d7f293818 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:59:15.158236 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-6aaaec49-0dba-4310-b46c-1c331037a63e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.635s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:15.198895 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:59:15.201275 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:59:15.217378 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-6aaaec49-0dba-4310-b46c-1c331037a63e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Deleted allocations for instance 6f68556b-0b18-452a-b307-da2dad4ee6ab
May 21 01:59:15.244110 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:15.414071 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-da7d2c0c-a1a6-4284-9ea1-fd84de499539 req-b27283c9-f091-45eb-821b-412ad212e1d2 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-plugged-f99ceda9-fad6-4a73-af2a-c63d3d320e2f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:15.415562 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-da7d2c0c-a1a6-4284-9ea1-fd84de499539 req-b27283c9-f091-45eb-821b-412ad212e1d2 service nova] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:15.415562 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-da7d2c0c-a1a6-4284-9ea1-fd84de499539 req-b27283c9-f091-45eb-821b-412ad212e1d2 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:15.415784 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-da7d2c0c-a1a6-4284-9ea1-fd84de499539 req-b27283c9-f091-45eb-821b-412ad212e1d2 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:15.415945 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-da7d2c0c-a1a6-4284-9ea1-fd84de499539 req-b27283c9-f091-45eb-821b-412ad212e1d2 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] No event matching network-vif-plugged-f99ceda9-fad6-4a73-af2a-c63d3d320e2f in dict_keys([('network-vif-plugged', '58939f92-ac70-47fb-90c0-5f7bc2421c47')]) {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 21 01:59:15.416144 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-da7d2c0c-a1a6-4284-9ea1-fd84de499539 req-b27283c9-f091-45eb-821b-412ad212e1d2 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received unexpected event network-vif-plugged-f99ceda9-fad6-4a73-af2a-c63d3d320e2f for instance with vm_state building and task_state spawning.
May 21 01:59:15.416301 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-da7d2c0c-a1a6-4284-9ea1-fd84de499539 req-b27283c9-f091-45eb-821b-412ad212e1d2 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-plugged-58939f92-ac70-47fb-90c0-5f7bc2421c47 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:15.416522 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-da7d2c0c-a1a6-4284-9ea1-fd84de499539 req-b27283c9-f091-45eb-821b-412ad212e1d2 service nova] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:15.416701 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-da7d2c0c-a1a6-4284-9ea1-fd84de499539 req-b27283c9-f091-45eb-821b-412ad212e1d2 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:15.416863 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-da7d2c0c-a1a6-4284-9ea1-fd84de499539 req-b27283c9-f091-45eb-821b-412ad212e1d2 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:15.417017 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-da7d2c0c-a1a6-4284-9ea1-fd84de499539 req-b27283c9-f091-45eb-821b-412ad212e1d2 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Processing event network-vif-plugged-58939f92-ac70-47fb-90c0-5f7bc2421c47 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 01:59:15.417891 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-da7d2c0c-a1a6-4284-9ea1-fd84de499539 req-b27283c9-f091-45eb-821b-412ad212e1d2 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-plugged-58939f92-ac70-47fb-90c0-5f7bc2421c47 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:15.420139 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Instance event wait completed in 2 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 01:59:15.420139 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-da7d2c0c-a1a6-4284-9ea1-fd84de499539 req-b27283c9-f091-45eb-821b-412ad212e1d2 service nova] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:15.420139 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-da7d2c0c-a1a6-4284-9ea1-fd84de499539 req-b27283c9-f091-45eb-821b-412ad212e1d2 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:15.420139 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-da7d2c0c-a1a6-4284-9ea1-fd84de499539 req-b27283c9-f091-45eb-821b-412ad212e1d2 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:15.420139 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-da7d2c0c-a1a6-4284-9ea1-fd84de499539 req-b27283c9-f091-45eb-821b-412ad212e1d2 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] No waiting events found dispatching network-vif-plugged-58939f92-ac70-47fb-90c0-5f7bc2421c47 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:59:15.420139 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-da7d2c0c-a1a6-4284-9ea1-fd84de499539 req-b27283c9-f091-45eb-821b-412ad212e1d2 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received unexpected event network-vif-plugged-58939f92-ac70-47fb-90c0-5f7bc2421c47 for instance with vm_state building and task_state spawning.
May 21 01:59:15.425240 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 01:59:15.427032 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Instance spawned successfully.
May 21 01:59:15.427507 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 01:59:15.709071 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328755.708733, 392bbdc4-beaa-4c44-93f5-3a76f331ceb0 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:59:15.710559 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] VM Started (Lifecycle Event)
May 21 01:59:15.834595 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-37696481-855a-4aae-b12d-865ae42ad58d req-0468006b-90ed-4356-9c19-00ff53e2936a service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Received event network-vif-plugged-44670b22-c758-456b-a200-f0323baea57f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:15.835227 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-37696481-855a-4aae-b12d-865ae42ad58d req-0468006b-90ed-4356-9c19-00ff53e2936a service nova] Acquiring lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:15.835580 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-37696481-855a-4aae-b12d-865ae42ad58d req-0468006b-90ed-4356-9c19-00ff53e2936a service nova] Lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:15.836415 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-37696481-855a-4aae-b12d-865ae42ad58d req-0468006b-90ed-4356-9c19-00ff53e2936a service nova] Lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:15.836681 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-37696481-855a-4aae-b12d-865ae42ad58d req-0468006b-90ed-4356-9c19-00ff53e2936a service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] No waiting events found dispatching network-vif-plugged-44670b22-c758-456b-a200-f0323baea57f {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:59:15.836975 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-37696481-855a-4aae-b12d-865ae42ad58d req-0468006b-90ed-4356-9c19-00ff53e2936a service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Received unexpected event network-vif-plugged-44670b22-c758-456b-a200-f0323baea57f for instance with vm_state rescued and task_state None.
May 21 01:59:15.837182 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-37696481-855a-4aae-b12d-865ae42ad58d req-0468006b-90ed-4356-9c19-00ff53e2936a service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Received event network-vif-plugged-44670b22-c758-456b-a200-f0323baea57f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:15.838324 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-37696481-855a-4aae-b12d-865ae42ad58d req-0468006b-90ed-4356-9c19-00ff53e2936a service nova] Acquiring lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:15.838570 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-37696481-855a-4aae-b12d-865ae42ad58d req-0468006b-90ed-4356-9c19-00ff53e2936a service nova] Lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:15.838892 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-37696481-855a-4aae-b12d-865ae42ad58d req-0468006b-90ed-4356-9c19-00ff53e2936a service nova] Lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:15.839188 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-37696481-855a-4aae-b12d-865ae42ad58d req-0468006b-90ed-4356-9c19-00ff53e2936a service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] No waiting events found dispatching network-vif-plugged-44670b22-c758-456b-a200-f0323baea57f {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:59:15.839599 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-37696481-855a-4aae-b12d-865ae42ad58d req-0468006b-90ed-4356-9c19-00ff53e2936a service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Received unexpected event network-vif-plugged-44670b22-c758-456b-a200-f0323baea57f for instance with vm_state rescued and task_state None.
May 21 01:59:15.939873 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:59:15.940080 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:59:15.940438 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:59:15.940786 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:59:15.941086 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:59:15.941304 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:59:16.205463 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:16.216088 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:59:16.217852 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:59:16.233784 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-6aaaec49-0dba-4310-b46c-1c331037a63e tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "6f68556b-0b18-452a-b307-da2dad4ee6ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.410s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:16.450107 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Took 34.80 seconds to spawn the instance on the hypervisor.
May 21 01:59:16.450107 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:59:16.599682 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-300ae7c7-8dc5-48ba-a6db-b458e68aa12a tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Unrescuing
May 21 01:59:16.600406 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-300ae7c7-8dc5-48ba-a6db-b458e68aa12a tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "refresh_cache-392bbdc4-beaa-4c44-93f5-3a76f331ceb0" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:59:16.600774 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-300ae7c7-8dc5-48ba-a6db-b458e68aa12a tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquired lock "refresh_cache-392bbdc4-beaa-4c44-93f5-3a76f331ceb0" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:59:16.601107 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-300ae7c7-8dc5-48ba-a6db-b458e68aa12a tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 01:59:16.723624 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 21 01:59:16.724034 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328756.7236953, a4b3355b-92d6-4b36-8dad-6cb4b3c579a2 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:59:16.724077 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] VM Resumed (Lifecycle Event)
May 21 01:59:16.881075 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0007812950000243291 future=<Future at 0x71c05864fe00 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:59:16.881251 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:59:16.881321 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=4.504916478000041 future=<Future at 0x71c05853f110 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:59:16.881409 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=4.504815289999897 future=<Future at 0x71c05853f110 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:59:16.966215 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Took 48.76 seconds to build instance.
May 21 01:59:17.105791 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-300ae7c7-8dc5-48ba-a6db-b458e68aa12a tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:17.229049 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:59:17.233295 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:59:17.475161 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-44a6d0bc-aa4b-471c-b679-628a4aaaf679 tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 50.275s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:17.877916 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:18.038779 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:18.147282 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-300ae7c7-8dc5-48ba-a6db-b458e68aa12a tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:18.597454 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-77229234-2531-4e02-83c9-3d8389098721 req-71cca145-0499-47de-8b3e-bfe5e3594d17 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-changed-f99ceda9-fad6-4a73-af2a-c63d3d320e2f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:18.597454 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-77229234-2531-4e02-83c9-3d8389098721 req-71cca145-0499-47de-8b3e-bfe5e3594d17 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Refreshing instance network info cache due to event network-changed-f99ceda9-fad6-4a73-af2a-c63d3d320e2f. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:59:18.597454 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-77229234-2531-4e02-83c9-3d8389098721 req-71cca145-0499-47de-8b3e-bfe5e3594d17 service nova] Acquiring lock "refresh_cache-a4b3355b-92d6-4b36-8dad-6cb4b3c579a2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:59:18.597454 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-77229234-2531-4e02-83c9-3d8389098721 req-71cca145-0499-47de-8b3e-bfe5e3594d17 service nova] Acquired lock "refresh_cache-a4b3355b-92d6-4b36-8dad-6cb4b3c579a2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:59:18.597454 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-77229234-2531-4e02-83c9-3d8389098721 req-71cca145-0499-47de-8b3e-bfe5e3594d17 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Refreshing network info cache for port f99ceda9-fad6-4a73-af2a-c63d3d320e2f {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:59:18.714176 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-300ae7c7-8dc5-48ba-a6db-b458e68aa12a tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Updating instance_info_cache with network_info: [{"id": "44670b22-c758-456b-a200-f0323baea57f", "address": "fa:16:3e:50:bf:d8", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap44670b22-c7", "ovs_interfaceid": "44670b22-c758-456b-a200-f0323baea57f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:59:19.103264 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-77229234-2531-4e02-83c9-3d8389098721 req-71cca145-0499-47de-8b3e-bfe5e3594d17 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:19.217211 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-300ae7c7-8dc5-48ba-a6db-b458e68aa12a tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Releasing lock "refresh_cache-392bbdc4-beaa-4c44-93f5-3a76f331ceb0" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:59:19.218113 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-300ae7c7-8dc5-48ba-a6db-b458e68aa12a tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lazy-loading 'flavor' on Instance uuid 392bbdc4-beaa-4c44-93f5-3a76f331ceb0 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:59:19.633319 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-77229234-2531-4e02-83c9-3d8389098721 req-71cca145-0499-47de-8b3e-bfe5e3594d17 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:19.757614 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:19.769493 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:19.792228 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:19.897413 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-77229234-2531-4e02-83c9-3d8389098721 req-71cca145-0499-47de-8b3e-bfe5e3594d17 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Updated VIF entry in instance network info cache for port f99ceda9-fad6-4a73-af2a-c63d3d320e2f. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 01:59:19.898542 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-77229234-2531-4e02-83c9-3d8389098721 req-71cca145-0499-47de-8b3e-bfe5e3594d17 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Updating instance_info_cache with network_info: [{"id": "f99ceda9-fad6-4a73-af2a-c63d3d320e2f", "address": "fa:16:3e:f8:14:ac", "network": {"id": "0ab35e13-b362-4576-91d1-569cb811b2d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1427614225-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf99ceda9-fa", "ovs_interfaceid": "f99ceda9-fad6-4a73-af2a-c63d3d320e2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71580ee4-3192-484a-9ee6-5096ac78a4ce", "address": "fa:16:3e:32:44:18", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71580ee4-31", "ovs_interfaceid": "71580ee4-3192-484a-9ee6-5096ac78a4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9e74661c-8435-43a4-82d7-b7d757552d24", "address": "fa:16:3e:e6:51:87", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e74661c-84", "ovs_interfaceid": "9e74661c-8435-43a4-82d7-b7d757552d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "407bbd3c-7537-4404-aaf5-a5ed533bb33b", "address": "fa:16:3e:80:dd:78", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap407bbd3c-75", "ovs_interfaceid": "407bbd3c-7537-4404-aaf5-a5ed533bb33b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a350a027-1ffc-4539-a238-d98bbb9baeba", "address": "fa:16:3e:19:d5:ae", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa350a027-1f", "ovs_interfaceid": "a350a027-1ffc-4539-a238-d98bbb9baeba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58939f92-ac70-47fb-90c0-5f7bc2421c47", "address": "fa:16:3e:db:3c:f9", "network": {"id": "54c4e0a1-6a66-4891-94c3-c85fc5fe181c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2031114495", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58939f92-ac", "ovs_interfaceid": "58939f92-ac70-47fb-90c0-5f7bc2421c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1ac81609-4fab-4940-9313-6dd7160c7a9b", "address": "fa:16:3e:c9:a8:b1", "network": {"id": "54c4e0a1-6a66-4891-94c3-c85fc5fe181c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2031114495", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac81609-4f", "ovs_interfaceid": "1ac81609-4fab-4940-9313-6dd7160c7a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:59:20.018742 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:20.025842 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:20.127965 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999731291999979 future=<Future at 0x71c0585bb8f0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:59:20.130328 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Instance destroyed successfully.
May 21 01:59:20.130879 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-300ae7c7-8dc5-48ba-a6db-b458e68aa12a tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lazy-loading 'numa_topology' on Instance uuid 392bbdc4-beaa-4c44-93f5-3a76f331ceb0 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:59:20.247078 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:20.404538 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-77229234-2531-4e02-83c9-3d8389098721 req-71cca145-0499-47de-8b3e-bfe5e3594d17 service nova] Releasing lock "refresh_cache-a4b3355b-92d6-4b36-8dad-6cb4b3c579a2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:59:20.634675 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-300ae7c7-8dc5-48ba-a6db-b458e68aa12a tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Object Instance<392bbdc4-beaa-4c44-93f5-3a76f331ceb0> lazy-loaded attributes: flavor,numa_topology {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 01:59:20.926455 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:21.189087 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:21.205076 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "66fe5d80-9012-44fe-9b82-1e993211ddf1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:21.206985 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "66fe5d80-9012-44fe-9b82-1e993211ddf1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:21.212292 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:21.336646 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:21.375907 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:21.377348 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:21.387933 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.001676264000025185 future=<Future at 0x71c05853f110 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:59:21.389580 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Emitting event <LifecycleEvent: 1779328746.386139, f8921842-2161-4ddf-b3c4-b642fc51a70f => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:59:21.389580 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:59:21.389580 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] VM Stopped (Lifecycle Event)
May 21 01:59:21.390545 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=3.2770039160000124 future=<Future at 0x71c05858f050 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:59:21.390640 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=3.2768431070001043 future=<Future at 0x71c05858f050 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:59:21.713257 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 01:59:21.773387 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cbdb71e3-f365-4fe3-92a8-cb22d7b19bbf req-d1696961-503b-497e-801e-62ae27408fa3 service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Received event network-vif-unplugged-44670b22-c758-456b-a200-f0323baea57f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:21.773387 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cbdb71e3-f365-4fe3-92a8-cb22d7b19bbf req-d1696961-503b-497e-801e-62ae27408fa3 service nova] Acquiring lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:21.773387 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cbdb71e3-f365-4fe3-92a8-cb22d7b19bbf req-d1696961-503b-497e-801e-62ae27408fa3 service nova] Lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:21.773387 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cbdb71e3-f365-4fe3-92a8-cb22d7b19bbf req-d1696961-503b-497e-801e-62ae27408fa3 service nova] Lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:21.773387 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cbdb71e3-f365-4fe3-92a8-cb22d7b19bbf req-d1696961-503b-497e-801e-62ae27408fa3 service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] No waiting events found dispatching network-vif-unplugged-44670b22-c758-456b-a200-f0323baea57f {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:59:21.773387 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-cbdb71e3-f365-4fe3-92a8-cb22d7b19bbf req-d1696961-503b-497e-801e-62ae27408fa3 service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Received unexpected event network-vif-unplugged-44670b22-c758-456b-a200-f0323baea57f for instance with vm_state rescued and task_state unrescuing.
May 21 01:59:21.891535 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: f8921842-2161-4ddf-b3c4-b642fc51a70f] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:59:22.293498 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:22.293498 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:22.297103 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 01:59:22.297672 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Claim successful on node np0000001127
May 21 01:59:22.314814 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:22.329701 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Removed pending STOPPED event for 392bbdc4-beaa-4c44-93f5-3a76f331ceb0 due to new event <LifecycleEvent: 1779328762.3293018, 392bbdc4-beaa-4c44-93f5-3a76f331ceb0 => Resumed> {{(pid=98206) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 21 01:59:22.330120 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328762.3293018, 392bbdc4-beaa-4c44-93f5-3a76f331ceb0 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:59:22.330369 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] VM Resumed (Lifecycle Event)
May 21 01:59:22.332572 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-300ae7c7-8dc5-48ba-a6db-b458e68aa12a tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:59:22.834333 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:59:22.839302 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:59:23.347098 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328763.3467443, 392bbdc4-beaa-4c44-93f5-3a76f331ceb0 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:59:23.350498 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] VM Started (Lifecycle Event)
May 21 01:59:23.847713 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:59:23.847997 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:59:23.856794 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c8a19f60-50a6-4dec-84ba-54ebd4910721 req-dd50f066-ff2b-4822-bbb9-5c9db2b9a67b service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Received event network-vif-unplugged-44670b22-c758-456b-a200-f0323baea57f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:23.859055 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c8a19f60-50a6-4dec-84ba-54ebd4910721 req-dd50f066-ff2b-4822-bbb9-5c9db2b9a67b service nova] Acquiring lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:23.859299 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c8a19f60-50a6-4dec-84ba-54ebd4910721 req-dd50f066-ff2b-4822-bbb9-5c9db2b9a67b service nova] Lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:23.859299 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c8a19f60-50a6-4dec-84ba-54ebd4910721 req-dd50f066-ff2b-4822-bbb9-5c9db2b9a67b service nova] Lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:23.859750 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:59:23.859925 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c8a19f60-50a6-4dec-84ba-54ebd4910721 req-dd50f066-ff2b-4822-bbb9-5c9db2b9a67b service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] No waiting events found dispatching network-vif-unplugged-44670b22-c758-456b-a200-f0323baea57f {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:59:23.860092 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-c8a19f60-50a6-4dec-84ba-54ebd4910721 req-dd50f066-ff2b-4822-bbb9-5c9db2b9a67b service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Received unexpected event network-vif-unplugged-44670b22-c758-456b-a200-f0323baea57f for instance with vm_state active and task_state None.
May 21 01:59:23.860298 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c8a19f60-50a6-4dec-84ba-54ebd4910721 req-dd50f066-ff2b-4822-bbb9-5c9db2b9a67b service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Received event network-vif-plugged-44670b22-c758-456b-a200-f0323baea57f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:23.862819 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c8a19f60-50a6-4dec-84ba-54ebd4910721 req-dd50f066-ff2b-4822-bbb9-5c9db2b9a67b service nova] Acquiring lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:23.863096 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c8a19f60-50a6-4dec-84ba-54ebd4910721 req-dd50f066-ff2b-4822-bbb9-5c9db2b9a67b service nova] Lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:23.863708 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c8a19f60-50a6-4dec-84ba-54ebd4910721 req-dd50f066-ff2b-4822-bbb9-5c9db2b9a67b service nova] Lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:23.864103 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c8a19f60-50a6-4dec-84ba-54ebd4910721 req-dd50f066-ff2b-4822-bbb9-5c9db2b9a67b service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] No waiting events found dispatching network-vif-plugged-44670b22-c758-456b-a200-f0323baea57f {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:59:23.864854 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-c8a19f60-50a6-4dec-84ba-54ebd4910721 req-dd50f066-ff2b-4822-bbb9-5c9db2b9a67b service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Received unexpected event network-vif-plugged-44670b22-c758-456b-a200-f0323baea57f for instance with vm_state active and task_state None.
May 21 01:59:23.865038 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c8a19f60-50a6-4dec-84ba-54ebd4910721 req-dd50f066-ff2b-4822-bbb9-5c9db2b9a67b service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Received event network-vif-plugged-44670b22-c758-456b-a200-f0323baea57f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:23.865183 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c8a19f60-50a6-4dec-84ba-54ebd4910721 req-dd50f066-ff2b-4822-bbb9-5c9db2b9a67b service nova] Acquiring lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:23.865335 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c8a19f60-50a6-4dec-84ba-54ebd4910721 req-dd50f066-ff2b-4822-bbb9-5c9db2b9a67b service nova] Lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:23.865412 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c8a19f60-50a6-4dec-84ba-54ebd4910721 req-dd50f066-ff2b-4822-bbb9-5c9db2b9a67b service nova] Lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:23.865543 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c8a19f60-50a6-4dec-84ba-54ebd4910721 req-dd50f066-ff2b-4822-bbb9-5c9db2b9a67b service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] No waiting events found dispatching network-vif-plugged-44670b22-c758-456b-a200-f0323baea57f {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:59:23.865682 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-c8a19f60-50a6-4dec-84ba-54ebd4910721 req-dd50f066-ff2b-4822-bbb9-5c9db2b9a67b service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Received unexpected event network-vif-plugged-44670b22-c758-456b-a200-f0323baea57f for instance with vm_state active and task_state None.
May 21 01:59:23.867812 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:59:24.181553 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Acquiring lock "07596a09-d614-48c6-849f-a306f65c7a5c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:24.181749 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Lock "07596a09-d614-48c6-849f-a306f65c7a5c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:24.350813 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:59:24.418888 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "6c48501b-d03d-40bc-aef5-450fa580bd69" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:24.419112 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "6c48501b-d03d-40bc-aef5-450fa580bd69" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:24.668189 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.00039735299992571527 future=<Future at 0x71c05858f050 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:59:24.668189 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:59:24.668189 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=10.45944626299979 future=<Future at 0x71c0585bb8f0 state=cancelled>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:59:24.668454 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=10.459332672999835 future=<Future at 0x71c0585bb8f0 state=cancelled>) was cancelled while queued, skipping {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:59:24.668454 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:59:24.670799 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Emitting event <LifecycleEvent: 1779328749.6674275, 6f68556b-0b18-452a-b307-da2dad4ee6ab => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:59:24.670954 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] VM Stopped (Lifecycle Event)
May 21 01:59:24.683757 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 01:59:24.861662 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.569s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:24.862085 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 01:59:24.924067 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 01:59:25.173304 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-8fc44558-fbd3-45dd-9a76-3fb9b834822d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 6f68556b-0b18-452a-b307-da2dad4ee6ab] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:59:25.193771 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:25.193967 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:25.194199 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Rebooting instance
May 21 01:59:25.243592 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:25.243745 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:25.246530 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 01:59:25.246653 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Claim successful on node np0000001127
May 21 01:59:25.249049 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:25.371132 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 01:59:25.371132 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 01:59:25.371696 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:25.371696 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:25.450302 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bbcd1a81252344dd804a4080571f8751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15fe7a70464159a778cffa4a36c36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 01:59:25.492555 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:25.777434 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "refresh_cache-a6839691-a7ec-4dea-bc39-a7e89c94cf4d" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:59:25.777434 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquired lock "refresh_cache-a6839691-a7ec-4dea-bc39-a7e89c94cf4d" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:59:25.777434 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 01:59:25.878588 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 01:59:26.085761 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Successfully created port: 29bf5645-d178-459e-b25f-1b1db9f87374 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 01:59:26.217665 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:26.280328 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:26.381430 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 01:59:26.758918 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:26.809405 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:26.825613 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Successfully updated port: 29bf5645-d178-459e-b25f-1b1db9f87374 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 01:59:26.885745 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Booting with volume 7721af1e-8f1d-4ffa-b905-045839f8645d at /dev/vda
May 21 01:59:26.909573 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6d068ab6-7f04-4fff-8681-4a4546daf7ef req-0a81b72e-a265-48f1-9aa7-62bb12fa552d service nova] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Received event network-changed-29bf5645-d178-459e-b25f-1b1db9f87374 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:26.909770 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6d068ab6-7f04-4fff-8681-4a4546daf7ef req-0a81b72e-a265-48f1-9aa7-62bb12fa552d service nova] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Refreshing instance network info cache due to event network-changed-29bf5645-d178-459e-b25f-1b1db9f87374. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:59:26.910003 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6d068ab6-7f04-4fff-8681-4a4546daf7ef req-0a81b72e-a265-48f1-9aa7-62bb12fa552d service nova] Acquiring lock "refresh_cache-66fe5d80-9012-44fe-9b82-1e993211ddf1" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:59:26.910140 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6d068ab6-7f04-4fff-8681-4a4546daf7ef req-0a81b72e-a265-48f1-9aa7-62bb12fa552d service nova] Acquired lock "refresh_cache-66fe5d80-9012-44fe-9b82-1e993211ddf1" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:59:26.910303 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-6d068ab6-7f04-4fff-8681-4a4546daf7ef req-0a81b72e-a265-48f1-9aa7-62bb12fa552d service nova] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Refreshing network info cache for port 29bf5645-d178-459e-b25f-1b1db9f87374 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:59:26.945694 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:59:26.959451 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 01:59:26.985815 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:27.014915 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:59:27.015420 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:59:27.037088 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Updating instance_info_cache with network_info: [{"id": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "address": "fa:16:3e:76:c8:70", "network": {"id": "7cdbc224-429f-49a6-86f3-307f51e53dfc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2078432126-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc797708a5a7400992765e41ee6ec260", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99a2cf4-26", "ovs_interfaceid": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:59:27.039741 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 01:59:27.040332 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 01:59:27.055767 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 01:59:27.059910 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe9e:216', 'fe80::14d9:7bff:fe3b:f0dc', 'fe80::fc16:3eff:fee3:f7d2', 'fe80::6c2e:11ff:fea1:7eb7', 'fe80::fc16:3eff:fe76:c870', 'fe80::a403:4dff:fe5a:1b07', 'fe80::fc16:3eff:fe12:668e', 'fe80::c062:49ff:fe28:b40d', 'fe80::fc16:3eff:feaf:51f1', 'fe80::68db:c7ff:fe71:da32', 'fe80::fc16:3eff:fef8:14ac', 'fe80::c058:52ff:fed8:cd31', 'fe80::fc16:3eff:fe32:4418', 'fe80::fc16:3eff:fee6:5187', 'fe80::fc16:3eff:fe80:dd78', 'fe80::fc16:3eff:fe19:d5ae', 'fe80::fc16:3eff:fedb:3cf9', 'fe80::2040:23ff:febb:db06', 'fe80::fc16:3eff:fec9:a8b1', 'fe80::3003:9cff:fe70:ad4e', 'fe80::fc16:3eff:fe50:bfd8'] 
May 21 01:59:27.061863 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 01:59:27.062028 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 01:59:27.062343 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:59:27.062585 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Updating existing volume attachment record: 246edb8f-1604-4d4d-b154-38c89b3d56bd {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 01:59:27.329476 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "refresh_cache-66fe5d80-9012-44fe-9b82-1e993211ddf1" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:59:27.423827 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-6d068ab6-7f04-4fff-8681-4a4546daf7ef req-0a81b72e-a265-48f1-9aa7-62bb12fa552d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:27.525332 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:59:27.540846 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Releasing lock "refresh_cache-a6839691-a7ec-4dea-bc39-a7e89c94cf4d" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:59:27.578330 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-6d068ab6-7f04-4fff-8681-4a4546daf7ef req-0a81b72e-a265-48f1-9aa7-62bb12fa552d service nova] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:59:27.840130 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-6d068ab6-7f04-4fff-8681-4a4546daf7ef req-0a81b72e-a265-48f1-9aa7-62bb12fa552d service nova] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:59:28.033257 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.789s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:28.034583 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.541s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:28.036456 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 01:59:28.040121 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 01:59:28.040301 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Claim successful on node np0000001127
May 21 01:59:28.047313 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:59:28.343585 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6d068ab6-7f04-4fff-8681-4a4546daf7ef req-0a81b72e-a265-48f1-9aa7-62bb12fa552d service nova] Releasing lock "refresh_cache-66fe5d80-9012-44fe-9b82-1e993211ddf1" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:59:28.344459 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquired lock "refresh_cache-66fe5d80-9012-44fe-9b82-1e993211ddf1" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:59:28.344459 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 01:59:28.549433 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 01:59:28.556739 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 01:59:28.563691 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:28.568920 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:28.666299 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00bdcdf44d37445cb35f1f8491858627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe24730468647869c1f1c973ecafdd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 01:59:28.803674 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:28.919879 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:59:28.998023 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2b27cd6c-3c1b-4af9-a2b5-57e2b29a7456 req-bed67d88-25df-4373-a9d9-2cced1c70be8 service nova] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Received event network-vif-unplugged-29bf5645-d178-459e-b25f-1b1db9f87374 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:28.998279 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2b27cd6c-3c1b-4af9-a2b5-57e2b29a7456 req-bed67d88-25df-4373-a9d9-2cced1c70be8 service nova] Acquiring lock "66fe5d80-9012-44fe-9b82-1e993211ddf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:28.998492 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2b27cd6c-3c1b-4af9-a2b5-57e2b29a7456 req-bed67d88-25df-4373-a9d9-2cced1c70be8 service nova] Lock "66fe5d80-9012-44fe-9b82-1e993211ddf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:28.998648 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2b27cd6c-3c1b-4af9-a2b5-57e2b29a7456 req-bed67d88-25df-4373-a9d9-2cced1c70be8 service nova] Lock "66fe5d80-9012-44fe-9b82-1e993211ddf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:28.998850 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2b27cd6c-3c1b-4af9-a2b5-57e2b29a7456 req-bed67d88-25df-4373-a9d9-2cced1c70be8 service nova] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] No waiting events found dispatching network-vif-unplugged-29bf5645-d178-459e-b25f-1b1db9f87374 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:59:28.999026 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-2b27cd6c-3c1b-4af9-a2b5-57e2b29a7456 req-bed67d88-25df-4373-a9d9-2cced1c70be8 service nova] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Received unexpected event network-vif-unplugged-29bf5645-d178-459e-b25f-1b1db9f87374 for instance with vm_state building and task_state spawning.
May 21 01:59:29.053041 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 01:59:29.115282 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:29.121666 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:29.154573 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:29.160932 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:29.195139 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:29.196429 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:29.226890 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 01:59:29.228228 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 01:59:29.231068 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Creating image(s)
May 21 01:59:29.231068 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Did not create local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 21 01:59:29.231068 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Ensure instance console log exists: /opt/stack/data/nova/instances/66fe5d80-9012-44fe-9b82-1e993211ddf1/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 01:59:29.231068 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:29.231068 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:29.231068 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:29.283492 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:29.371899 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Successfully created port: 660421e7-d9e9-4f1e-92af-3d7e62bd7a87 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 01:59:29.444376 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999575983999875 future=<Future at 0x71c0586a84a0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:59:29.445330 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.998479620999888 future=<Future at 0x71c0586a84a0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:59:29.445483 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.998303073999978 future=<Future at 0x71c0586a84a0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:59:29.446818 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Instance destroyed successfully.
May 21 01:59:29.447689 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lazy-loading 'resources' on Instance uuid a6839691-a7ec-4dea-bc39-a7e89c94cf4d {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:59:29.512118 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Updating instance_info_cache with network_info: [{"id": "29bf5645-d178-459e-b25f-1b1db9f87374", "address": "fa:16:3e:45:a2:37", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bf5645-d1", "ovs_interfaceid": "29bf5645-d178-459e-b25f-1b1db9f87374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:59:29.561688 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 01:59:29.816331 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:59:29.818006 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:59:29.950371 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:58:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-715258350',display_name='tempest-TestMinimumBasicScenario-server-715258350',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testminimumbasicscenario-server-715258350',id=14,image_ref='a377f14f-f022-4902-8291-4e733e0a7be0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXVa1e4OFd0NMMgqm+4/xZwNI5dMebNPDeh14+7JZ91orpoik4qLtCbEUIRp2DSHHVcppNPspElPEIhYTAGUliS3RSE8t15WkhilyCcQF6xleusOu5YpLtoNfQpTRunwg==',key_name='tempest-TestMinimumBasicScenario-2026356756',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:58:47Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc797708a5a7400992765e41ee6ec260',ramdisk_id='',reservation_id='r-qn7g4mne',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a377f14f-f022-4902-8291-4e733e0a7be0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-654915677',owner_user_name='tempest-TestMinimumBasicScenario-654915677-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:59:28Z,user_data=None,user_id='44907638a40d4fb4ad9014b58dcd6bac',uuid=a6839691-a7ec-4dea-bc39-a7e89c94cf4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "address": "fa:16:3e:76:c8:70", "network": {"id": "7cdbc224-429f-49a6-86f3-307f51e53dfc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2078432126-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc797708a5a7400992765e41ee6ec260", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99a2cf4-26", "ovs_interfaceid": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 01:59:29.950672 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Converting VIF {"id": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "address": "fa:16:3e:76:c8:70", "network": {"id": "7cdbc224-429f-49a6-86f3-307f51e53dfc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2078432126-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc797708a5a7400992765e41ee6ec260", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99a2cf4-26", "ovs_interfaceid": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:59:29.951297 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:c8:70,bridge_name='br-int',has_traffic_filtering=True,id=d99a2cf4-260b-4ca3-b72e-7db23358b831,network=Network(7cdbc224-429f-49a6-86f3-307f51e53dfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99a2cf4-26') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:59:29.951659 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:c8:70,bridge_name='br-int',has_traffic_filtering=True,id=d99a2cf4-260b-4ca3-b72e-7db23358b831,network=Network(7cdbc224-429f-49a6-86f3-307f51e53dfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99a2cf4-26') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 01:59:29.952941 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:29.954047 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd99a2cf4-26, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:29.954210 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:29.955153 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:59:29.955527 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:29.957166 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:29.957166 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=afa027c8-8806-4f58-b432-4715b574108e) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:29.959902 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:29.960730 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:59:29.962414 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:29.964758 np0000001127 nova-compute[98206]: INFO os_vif [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:c8:70,bridge_name='br-int',has_traffic_filtering=True,id=d99a2cf4-260b-4ca3-b72e-7db23358b831,network=Network(7cdbc224-429f-49a6-86f3-307f51e53dfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99a2cf4-26')
May 21 01:59:29.967323 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 01:59:29.967739 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '51b4adb6-eb47-40ee-a8ab-9a7ee5901253', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:59:29.967955 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:59:29.969608 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:59:29.970061 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '51b4adb6-eb47-40ee-a8ab-9a7ee5901253', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 01:59:29.971433 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 01:59:30.010708 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:30.010708 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:30.010708 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:30.010708 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:30.010708 np0000001127 nova-compute[98206]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:30.010708 np0000001127 nova-compute[98206]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:30.010708 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:30.010708 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:30.010708 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:30.010708 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:30.010708 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:59:30.011462 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:30.011462 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:30.011462 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:30.011462 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:30.011462 np0000001127 nova-compute[98206]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:30.011462 np0000001127 nova-compute[98206]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:30.011462 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:30.011462 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:30.011462 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:30.011462 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:30.011462 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:59:30.011462 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', '27'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6', '35'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566', '37')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 01:59:30.011462 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', '33')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 01:59:30.012232 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', '32')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 01:59:30.013115 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c2fcf40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253'): ({'sdj'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 01:59:30.013318 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Removing multipathed devices sdk, sdj {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 01:59:30.015491 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Flush multipath device 3300000009b658662 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 01:59:30.016112 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Releasing lock "refresh_cache-66fe5d80-9012-44fe-9b82-1e993211ddf1" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:59:30.016367 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Instance network_info: |[{"id": "29bf5645-d178-459e-b25f-1b1db9f87374", "address": "fa:16:3e:45:a2:37", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bf5645-d1", "ovs_interfaceid": "29bf5645-d178-459e-b25f-1b1db9f87374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 01:59:30.017344 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Start _get_guest_xml network_info=[{"id": "29bf5645-d178-459e-b25f-1b1db9f87374", "address": "fa:16:3e:45:a2:37", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bf5645-d1", "ovs_interfaceid": "29bf5645-d178-459e-b25f-1b1db9f87374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7721af1e-8f1d-4ffa-b905-045839f8645d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '66fe5d80-9012-44fe-9b82-1e993211ddf1', 'attached_at': '', 'detached_at': '', 'volume_id': '7721af1e-8f1d-4ffa-b905-045839f8645d', 'serial': '7721af1e-8f1d-4ffa-b905-045839f8645d'}, 'delete_on_termination': True, 'attachment_id': '246edb8f-1604-4d4d-b154-38c89b3d56bd', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 01:59:30.020800 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 01:59:30.022349 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-1476667320', uuid='66fe5d80-9012-44fe-9b82-1e993211ddf1'), owner=OwnerMeta(userid='bbcd1a81252344dd804a4080571f8751', username='tempest-ServerActionsTestOtherA-1975191698-project-member', projectid='6a15fe7a70464159a778cffa4a36c36f', projectname='tempest-ServerActionsTestOtherA-1975191698'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "29bf5645-d178-459e-b25f-1b1db9f87374", "address": "fa:16:3e:45:a2:37", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bf5645-d1", "ovs_interfaceid": "29bf5645-d178-459e-b25f-1b1db9f87374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328770.0218086) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 01:59:30.027037 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 01:59:30.027556 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 01:59:30.031072 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 01:59:30.031225 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 01:59:30.032218 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 01:59:30.032537 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 01:59:30.032675 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 01:59:30.032756 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 01:59:30.032849 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 01:59:30.032932 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 01:59:30.033047 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 01:59:30.033259 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 01:59:30.033375 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 01:59:30.033458 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 01:59:30.033589 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 01:59:30.034069 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 01:59:30.049554 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 01:59:30.049876 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7721af1e-8f1d-4ffa-b905-045839f8645d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:59:30.049948 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:59:30.055113 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 01:59:30.137549 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 01:59:30.138947 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Successfully updated port: 660421e7-d9e9-4f1e-92af-3d7e62bd7a87 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 01:59:30.151983 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 01:59:30.153528 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 01:59:30.154386 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 01:59:30.167927 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 01:59:30.169399 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 01:59:30.187050 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:30.229557 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253, portal: 192.168.40.100,3260]
May 21 01:59:30.229557 np0000001127 nova-compute[98206]: Logout of [sid: 33, target: iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253, portal: 192.168.40.100,3260] successful.
May 21 01:59:30.229557 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:30.250174 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:30.266050 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:30.302801 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253, portal: 192.168.50.100,3260]
May 21 01:59:30.302801 np0000001127 nova-compute[98206]: Logout of [sid: 32, target: iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253, portal: 192.168.50.100,3260] successful.
May 21 01:59:30.302801 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:30.313016 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-9f3429ea-930f-4b23-9b75-79d47d0279fc req-09714fae-41f3-46f3-b1ff-eb4912503676 service nova] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Received event network-changed-660421e7-d9e9-4f1e-92af-3d7e62bd7a87 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:30.315531 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-9f3429ea-930f-4b23-9b75-79d47d0279fc req-09714fae-41f3-46f3-b1ff-eb4912503676 service nova] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Refreshing instance network info cache due to event network-changed-660421e7-d9e9-4f1e-92af-3d7e62bd7a87. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:59:30.315531 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-9f3429ea-930f-4b23-9b75-79d47d0279fc req-09714fae-41f3-46f3-b1ff-eb4912503676 service nova] Acquiring lock "refresh_cache-07596a09-d614-48c6-849f-a306f65c7a5c" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:59:30.315531 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-9f3429ea-930f-4b23-9b75-79d47d0279fc req-09714fae-41f3-46f3-b1ff-eb4912503676 service nova] Acquired lock "refresh_cache-07596a09-d614-48c6-849f-a306f65c7a5c" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:59:30.315531 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-9f3429ea-930f-4b23-9b75-79d47d0279fc req-09714fae-41f3-46f3-b1ff-eb4912503676 service nova] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Refreshing network info cache for port 660421e7-d9e9-4f1e-92af-3d7e62bd7a87 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:59:30.319344 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:59:30.333750 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:30.333958 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:59:30.334119 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] <== disconnect_volume: return (366ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:59:30.334284 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 01:59:30.335279 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.285s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:59:30.335550 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7721af1e-8f1d-4ffa-b905-045839f8645d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 01:59:30.343401 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Start _get_guest_xml network_info=[{"id": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "address": "fa:16:3e:76:c8:70", "network": {"id": "7cdbc224-429f-49a6-86f3-307f51e53dfc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2078432126-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc797708a5a7400992765e41ee6ec260", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99a2cf4-26", "ovs_interfaceid": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a377f14f-f022-4902-8291-4e733e0a7be0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'a377f14f-f022-4902-8291-4e733e0a7be0'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '51b4adb6-eb47-40ee-a8ab-9a7ee5901253', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, 'status': 'reserved', 'instance': 'a6839691-a7ec-4dea-bc39-a7e89c94cf4d', 'attached_at': '', 'detached_at': '', 'volume_id': '51b4adb6-eb47-40ee-a8ab-9a7ee5901253', 'serial': '51b4adb6-eb47-40ee-a8ab-9a7ee5901253'}, 'delete_on_termination': False, 'attachment_id': '5274ff3b-b2fa-4701-8c3c-904404913c6b', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 01:59:30.350925 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:59:30.352034 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:59:30.353500 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:59:30.355485 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:59:30.355485 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:59:30.355485 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:59:30.357190 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 01:59:30.358665 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a377f14f-f022-4902-8291-4e733e0a7be0', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-715258350', uuid='a6839691-a7ec-4dea-bc39-a7e89c94cf4d'), owner=OwnerMeta(userid='44907638a40d4fb4ad9014b58dcd6bac', username='tempest-TestMinimumBasicScenario-654915677-project-member', projectid='dc797708a5a7400992765e41ee6ec260', projectname='tempest-TestMinimumBasicScenario-654915677'), image=ImageMeta(id='a377f14f-f022-4902-8291-4e733e0a7be0', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "address": "fa:16:3e:76:c8:70", "network": {"id": "7cdbc224-429f-49a6-86f3-307f51e53dfc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2078432126-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc797708a5a7400992765e41ee6ec260", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99a2cf4-26", "ovs_interfaceid": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328770.3582847) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 01:59:30.366401 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 01:59:30.366822 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 01:59:30.368368 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 01:59:30.368441 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 01:59:30.369604 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 01:59:30.369942 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a377f14f-f022-4902-8291-4e733e0a7be0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 01:59:30.370138 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 01:59:30.370539 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 01:59:30.370539 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 01:59:30.370723 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 01:59:30.370848 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 01:59:30.371048 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 01:59:30.371186 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 01:59:30.371332 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 01:59:30.371602 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 01:59:30.371752 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 01:59:30.371976 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lazy-loading 'vcpu_model' on Instance uuid a6839691-a7ec-4dea-bc39-a7e89c94cf4d {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:59:30.373458 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 01:59:30.373458 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:30.374225 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 01:59:30.374225 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:30.385646 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d] added
May 21 01:59:30.385646 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 01:59:30.385646 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:59:30.385646 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:59:30.385646 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:59:30.385646 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:59:30.385646 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:30.385646 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 01:59:30.386356 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0302(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 01:59:30.389893 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 01:59:30.390792 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d] added
May 21 01:59:30.390792 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 01:59:30.390792 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:59:30.390792 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:59:30.390792 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:59:30.390792 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:59:30.390792 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:30.391081 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 01:59:30.391140 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0367(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 01:59:30.391279 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 01:59:30.573509 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 01:59:30.575553 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 01:59:30.575907 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Creating image(s)
May 21 01:59:30.576598 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Acquiring lock "/opt/stack/data/nova/instances/07596a09-d614-48c6-849f-a306f65c7a5c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:30.576840 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Lock "/opt/stack/data/nova/instances/07596a09-d614-48c6-849f-a306f65c7a5c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:30.577761 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Lock "/opt/stack/data/nova/instances/07596a09-d614-48c6-849f-a306f65c7a5c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:30.578501 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:59:30.585591 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:59:30.586097 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:30.644722 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Acquiring lock "refresh_cache-07596a09-d614-48c6-849f-a306f65c7a5c" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:59:30.694334 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.108s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:30.694813 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:30.695382 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:30.695964 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:59:30.699359 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:59:30.699883 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:30.788632 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.088s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:30.789105 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/07596a09-d614-48c6-849f-a306f65c7a5c/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:30.821036 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-9f3429ea-930f-4b23-9b75-79d47d0279fc req-09714fae-41f3-46f3-b1ff-eb4912503676 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:30.832204 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.799s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:30.833018 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 01:59:30.846370 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/07596a09-d614-48c6-849f-a306f65c7a5c/disk 1073741824" returned: 0 in 0.057s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:30.846830 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.151s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:30.847266 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:30.881311 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Object Instance<a6839691-a7ec-4dea-bc39-a7e89c94cf4d> lazy-loaded attributes: resources,vcpu_model {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 01:59:30.904494 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d/disk.config --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:30.943184 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-9f3429ea-930f-4b23-9b75-79d47d0279fc req-09714fae-41f3-46f3-b1ff-eb4912503676 service nova] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:59:30.955581 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Acquiring lock "cb319b5a-9797-421c-ad9d-2fd9a1aaba38" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:30.955819 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Lock "cb319b5a-9797-421c-ad9d-2fd9a1aaba38" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:30.965779 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.118s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:30.966395 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Checking if we can resize image /opt/stack/data/nova/instances/07596a09-d614-48c6-849f-a306f65c7a5c/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 01:59:30.966486 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07596a09-d614-48c6-849f-a306f65c7a5c/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:30.988215 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d/disk.config --force-share --output=json" returned: 0 in 0.085s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:30.990442 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "/opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:30.990442 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "/opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:30.991259 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "/opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:30.992325 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 01:59:30.992791 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '51b4adb6-eb47-40ee-a8ab-9a7ee5901253', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:59:30.993037 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:59:31.058356 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07596a09-d614-48c6-849f-a306f65c7a5c/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:31.058737 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Cannot resize image /opt/stack/data/nova/instances/07596a09-d614-48c6-849f-a306f65c7a5c/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 01:59:31.059419 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 01:59:31.059691 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Ensure instance console log exists: /opt/stack/data/nova/instances/07596a09-d614-48c6-849f-a306f65c7a5c/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 01:59:31.059899 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:31.060056 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:31.060191 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:31.072106 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-618a7b35-23f9-4996-b02c-43966dd6fc97 req-045d231e-db90-42d2-b8cf-bc7f9fbe5716 service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Received event network-vif-unplugged-d99a2cf4-260b-4ca3-b72e-7db23358b831 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:31.072320 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-618a7b35-23f9-4996-b02c-43966dd6fc97 req-045d231e-db90-42d2-b8cf-bc7f9fbe5716 service nova] Acquiring lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:31.072498 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-618a7b35-23f9-4996-b02c-43966dd6fc97 req-045d231e-db90-42d2-b8cf-bc7f9fbe5716 service nova] Lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:31.072633 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-618a7b35-23f9-4996-b02c-43966dd6fc97 req-045d231e-db90-42d2-b8cf-bc7f9fbe5716 service nova] Lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:31.072749 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-618a7b35-23f9-4996-b02c-43966dd6fc97 req-045d231e-db90-42d2-b8cf-bc7f9fbe5716 service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] No waiting events found dispatching network-vif-unplugged-d99a2cf4-260b-4ca3-b72e-7db23358b831 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:59:31.072866 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-618a7b35-23f9-4996-b02c-43966dd6fc97 req-045d231e-db90-42d2-b8cf-bc7f9fbe5716 service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Received unexpected event network-vif-unplugged-d99a2cf4-260b-4ca3-b72e-7db23358b831 for instance with vm_state active and task_state reboot_started_hard.
May 21 01:59:31.072970 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-618a7b35-23f9-4996-b02c-43966dd6fc97 req-045d231e-db90-42d2-b8cf-bc7f9fbe5716 service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Received event network-vif-unplugged-d99a2cf4-260b-4ca3-b72e-7db23358b831 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:31.073077 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-618a7b35-23f9-4996-b02c-43966dd6fc97 req-045d231e-db90-42d2-b8cf-bc7f9fbe5716 service nova] Acquiring lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:31.073190 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-618a7b35-23f9-4996-b02c-43966dd6fc97 req-045d231e-db90-42d2-b8cf-bc7f9fbe5716 service nova] Lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:31.073284 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-618a7b35-23f9-4996-b02c-43966dd6fc97 req-045d231e-db90-42d2-b8cf-bc7f9fbe5716 service nova] Lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:31.073390 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-618a7b35-23f9-4996-b02c-43966dd6fc97 req-045d231e-db90-42d2-b8cf-bc7f9fbe5716 service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] No waiting events found dispatching network-vif-unplugged-d99a2cf4-260b-4ca3-b72e-7db23358b831 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:59:31.073740 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-618a7b35-23f9-4996-b02c-43966dd6fc97 req-045d231e-db90-42d2-b8cf-bc7f9fbe5716 service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Received unexpected event network-vif-unplugged-d99a2cf4-260b-4ca3-b72e-7db23358b831 for instance with vm_state active and task_state reboot_started_hard.
May 21 01:59:31.127143 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-9f3429ea-930f-4b23-9b75-79d47d0279fc req-09714fae-41f3-46f3-b1ff-eb4912503676 service nova] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:59:31.236134 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:31.342544 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 01:59:31.342752 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 01:59:31.343156 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:31.343415 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:31.391775 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:59:31.393157 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.startup = manual
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:59:31.409244 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:59:31.409244 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.startup = manual
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:59:31.413391 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:59:31.413391 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:31.423929 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:31.431666 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd5b969d5a514d01bacfc7954a5ae4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83df9a84ffaa4398bdafbfbde079964d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 01:59:31.433193 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:31.441573 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:31.441573 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:31.441573 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:31.441573 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:31.441573 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:31.441573 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:31.441573 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:31.441573 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:31.441573 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:59:31.441919 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:31.441919 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:31.441919 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:31.441919 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:31.441919 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:31.441919 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:31.441919 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:31.441919 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:31.441919 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:59:31.453489 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:31.453489 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:31.453489 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:31.453489 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:31.453489 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:31.453489 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:31.453489 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:31.453489 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:31.453489 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:59:31.453489 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:31.453489 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:31.453489 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:31.453489 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:31.453489 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:31.453489 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:31.453489 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:31.453489 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:31.453489 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:59:31.459628 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 01:59:31.492220 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d, portal: 192.168.40.100,3260]
May 21 01:59:31.492220 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d, portal: 192.168.40.100,3260] successful.
May 21 01:59:31.492220 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:31.504583 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:31.514549 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d, portal: 192.168.50.100,3260]
May 21 01:59:31.514549 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d, portal: 192.168.50.100,3260] successful.
May 21 01:59:31.514549 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:31.527514 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:31.528298 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:31.528298 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:31.528298 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:31.528298 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:31.528298 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:31.528298 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:31.528298 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:31.528298 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:31.528298 np0000001127 nova-compute[98206]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:31.528298 np0000001127 nova-compute[98206]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:31.528298 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:59:31.528595 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:31.528595 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:31.528595 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:31.528595 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:31.528595 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:31.528595 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:31.528595 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:31.528595 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:31.528595 np0000001127 nova-compute[98206]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:31.528595 np0000001127 nova-compute[98206]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:31.528595 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:59:31.529089 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.174s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:59:31.529281 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:59:31.531111 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] HCTL ('7', '-', '-', 0) found on session 38 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:59:31.531270 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:59:31.543605 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:31.543605 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:31.543605 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:31.543605 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:31.543605 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:31.543605 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:31.543605 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:31.543605 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:31.543605 np0000001127 nova-compute[98206]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:31.543605 np0000001127 nova-compute[98206]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:31.543605 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:59:31.544205 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:31.544205 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:31.544205 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:31.544205 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:31.544205 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:31.544205 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:31.544205 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:31.544205 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:31.544205 np0000001127 nova-compute[98206]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:31.544205 np0000001127 nova-compute[98206]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:31.544205 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:59:31.544205 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.191s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:59:31.544205 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:59:31.546411 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] HCTL ('8', '-', '-', 0) found on session 39 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:59:31.548315 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:59:31.555436 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Searching for a device in session 38 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:59:31.555436 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7721af1e-8f1d-4ffa-b905-045839f8645d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:59:31.563937 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Searching for a device in session 39 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:59:31.563937 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7721af1e-8f1d-4ffa-b905-045839f8645d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:59:31.629650 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-9f3429ea-930f-4b23-9b75-79d47d0279fc req-09714fae-41f3-46f3-b1ff-eb4912503676 service nova] Releasing lock "refresh_cache-07596a09-d614-48c6-849f-a306f65c7a5c" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:59:31.630305 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Acquired lock "refresh_cache-07596a09-d614-48c6-849f-a306f65c7a5c" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:59:31.630575 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 01:59:31.845562 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 01:59:31.918458 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Acquiring lock "800e7287-2ec0-48a2-b959-d7fbcc1f3c10" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:31.919310 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "800e7287-2ec0-48a2-b959-d7fbcc1f3c10" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:31.988014 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Successfully created port: 3356c6b8-bf6b-43aa-bb09-491a7b40115f {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 01:59:32.048560 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:32.048560 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:32.052160 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 01:59:32.052400 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Claim successful on node np0000001127
May 21 01:59:32.222562 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:59:32.349710 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 01:59:32.354448 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 01:59:32.425654 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lazy-loading 'flavor' on Instance uuid 800e7287-2ec0-48a2-b959-d7fbcc1f3c10 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:59:32.435709 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:32.543790 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Successfully updated port: 3356c6b8-bf6b-43aa-bb09-491a7b40115f {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 01:59:32.591216 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Updating instance_info_cache with network_info: [{"id": "660421e7-d9e9-4f1e-92af-3d7e62bd7a87", "address": "fa:16:3e:ed:f3:de", "network": {"id": "17498fbc-1581-4d2b-82d2-3865a39e8d1f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1622249524-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ebe24730468647869c1f1c973ecafdd2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap660421e7-d9", "ovs_interfaceid": "660421e7-d9e9-4f1e-92af-3d7e62bd7a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:59:32.630666 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f6cd626b-394b-4f99-b6ef-68e9e892326c req-2df2b767-0aae-41a9-8a8c-005834363fd7 service nova] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Received event network-changed-3356c6b8-bf6b-43aa-bb09-491a7b40115f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:32.631250 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f6cd626b-394b-4f99-b6ef-68e9e892326c req-2df2b767-0aae-41a9-8a8c-005834363fd7 service nova] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Refreshing instance network info cache due to event network-changed-3356c6b8-bf6b-43aa-bb09-491a7b40115f. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:59:32.631250 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f6cd626b-394b-4f99-b6ef-68e9e892326c req-2df2b767-0aae-41a9-8a8c-005834363fd7 service nova] Acquiring lock "refresh_cache-6c48501b-d03d-40bc-aef5-450fa580bd69" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:59:32.631250 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f6cd626b-394b-4f99-b6ef-68e9e892326c req-2df2b767-0aae-41a9-8a8c-005834363fd7 service nova] Acquired lock "refresh_cache-6c48501b-d03d-40bc-aef5-450fa580bd69" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:59:32.631384 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-f6cd626b-394b-4f99-b6ef-68e9e892326c req-2df2b767-0aae-41a9-8a8c-005834363fd7 service nova] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Refreshing network info cache for port 3356c6b8-bf6b-43aa-bb09-491a7b40115f {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:59:32.877247 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-518549b5-7c74-409f-ac47-57cac9ce230d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "64f1cde4-f11a-4da7-8bbc-aaf777432069" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:32.877427 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-518549b5-7c74-409f-ac47-57cac9ce230d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "64f1cde4-f11a-4da7-8bbc-aaf777432069" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:32.877559 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-518549b5-7c74-409f-ac47-57cac9ce230d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Shelving
May 21 01:59:32.928741 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Ignoring supplied device name: /dev/vdb
May 21 01:59:33.046735 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "refresh_cache-6c48501b-d03d-40bc-aef5-450fa580bd69" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:59:33.093620 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Releasing lock "refresh_cache-07596a09-d614-48c6-849f-a306f65c7a5c" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:59:33.093995 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Instance network_info: |[{"id": "660421e7-d9e9-4f1e-92af-3d7e62bd7a87", "address": "fa:16:3e:ed:f3:de", "network": {"id": "17498fbc-1581-4d2b-82d2-3865a39e8d1f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1622249524-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ebe24730468647869c1f1c973ecafdd2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap660421e7-d9", "ovs_interfaceid": "660421e7-d9e9-4f1e-92af-3d7e62bd7a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 01:59:33.095568 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Start _get_guest_xml network_info=[{"id": "660421e7-d9e9-4f1e-92af-3d7e62bd7a87", "address": "fa:16:3e:ed:f3:de", "network": {"id": "17498fbc-1581-4d2b-82d2-3865a39e8d1f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1622249524-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ebe24730468647869c1f1c973ecafdd2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap660421e7-d9", "ovs_interfaceid": "660421e7-d9e9-4f1e-92af-3d7e62bd7a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 01:59:33.097739 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 01:59:33.098854 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-598838675', uuid='07596a09-d614-48c6-849f-a306f65c7a5c'), owner=OwnerMeta(userid='00bdcdf44d37445cb35f1f8491858627', username='tempest-VolumesActionsTest-271344132-project-member', projectid='ebe24730468647869c1f1c973ecafdd2', projectname='tempest-VolumesActionsTest-271344132'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "660421e7-d9e9-4f1e-92af-3d7e62bd7a87", "address": "fa:16:3e:ed:f3:de", "network": {"id": "17498fbc-1581-4d2b-82d2-3865a39e8d1f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1622249524-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ebe24730468647869c1f1c973ecafdd2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap660421e7-d9", "ovs_interfaceid": "660421e7-d9e9-4f1e-92af-3d7e62bd7a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328773.0985198) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 01:59:33.100115 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 01:59:33.100458 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 01:59:33.101234 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 01:59:33.101607 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 01:59:33.102645 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 01:59:33.102987 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 01:59:33.103177 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 01:59:33.103311 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 01:59:33.103480 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 01:59:33.103662 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 01:59:33.103845 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 01:59:33.104043 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 01:59:33.104172 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 01:59:33.104318 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 01:59:33.104455 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 01:59:33.104624 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 01:59:33.117369 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T01:59:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-598838675',display_name='tempest-VolumesActionsTest-instance-598838675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumesactionstest-instance-598838675',id=19,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebe24730468647869c1f1c973ecafdd2',ramdisk_id='',reservation_id='r-u4mzryid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-271344132',owner_user_name='tempest-VolumesActionsTest-271344132-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:59:30Z,user_data=None,user_id='00bdcdf44d37445cb35f1f8491858627',uuid=07596a09-d614-48c6-849f-a306f65c7a5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "660421e7-d9e9-4f1e-92af-3d7e62bd7a87", "address": "fa:16:3e:ed:f3:de", "network": {"id": "17498fbc-1581-4d2b-82d2-3865a39e8d1f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1622249524-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ebe24730468647869c1f1c973ecafdd2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap660421e7-d9", "ovs_interfaceid": "660421e7-d9e9-4f1e-92af-3d7e62bd7a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 01:59:33.117612 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Converting VIF {"id": "660421e7-d9e9-4f1e-92af-3d7e62bd7a87", "address": "fa:16:3e:ed:f3:de", "network": {"id": "17498fbc-1581-4d2b-82d2-3865a39e8d1f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1622249524-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ebe24730468647869c1f1c973ecafdd2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap660421e7-d9", "ovs_interfaceid": "660421e7-d9e9-4f1e-92af-3d7e62bd7a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:59:33.118077 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f3:de,bridge_name='br-int',has_traffic_filtering=True,id=660421e7-d9e9-4f1e-92af-3d7e62bd7a87,network=Network(17498fbc-1581-4d2b-82d2-3865a39e8d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap660421e7-d9') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:59:33.118976 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Lazy-loading 'pci_devices' on Instance uuid 07596a09-d614-48c6-849f-a306f65c7a5c {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:59:33.135584 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-f6cd626b-394b-4f99-b6ef-68e9e892326c req-2df2b767-0aae-41a9-8a8c-005834363fd7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:33.220588 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-f6cd626b-394b-4f99-b6ef-68e9e892326c req-2df2b767-0aae-41a9-8a8c-005834363fd7 service nova] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:59:33.357998 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 01:59:33.358652 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 01:59:33.358896 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Creating image(s)
May 21 01:59:33.359417 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "/opt/stack/data/nova/instances/6c48501b-d03d-40bc-aef5-450fa580bd69/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:33.359758 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "/opt/stack/data/nova/instances/6c48501b-d03d-40bc-aef5-450fa580bd69/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:33.360300 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "/opt/stack/data/nova/instances/6c48501b-d03d-40bc-aef5-450fa580bd69/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:33.360868 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:59:33.364395 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:59:33.365562 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:33.382194 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Found WWN 3300000007eb86ea1 for multipath device dm-0 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 01:59:33.384424 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.049s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:59:33.392490 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] <== connect_volume: return (3342ms) {'type': 'block', 'scsi_wwn': '3300000007eb86ea1', 'path': '/dev/dm-0', 'multipath_id': '3300000007eb86ea1'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:59:33.398246 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007eb86ea1', 'path': '/dev/dm-0', 'multipath_id': '3300000007eb86ea1'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 01:59:33.399957 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.407s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:59:33.400297 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '51b4adb6-eb47-40ee-a8ab-9a7ee5901253', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 01:59:33.418814 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:59:33.424668 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:59:33.427091 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.009s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:59:33.428161 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:59:33.430007 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:59:33.438696 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:59:33.439923 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "800e7287-2ec0-48a2-b959-d7fbcc1f3c10" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.515s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:33.449053 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 01:59:33.449053 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:33.458452 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 01:59:33.458452 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:33.459094 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.093s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:33.459665 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:33.460088 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:33.461338 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:59:33.465677 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:59:33.467209 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253] added
May 21 01:59:33.467209 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 01:59:33.467209 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:59:33.467209 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:59:33.467209 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:59:33.467209 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:59:33.467209 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:33.467209 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 01:59:33.467209 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.039(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 01:59:33.467209 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 01:59:33.468408 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:33.472251 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-f6cd626b-394b-4f99-b6ef-68e9e892326c req-2df2b767-0aae-41a9-8a8c-005834363fd7 service nova] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:59:33.493143 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253] added
May 21 01:59:33.493143 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 01:59:33.493143 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:59:33.493143 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:59:33.493143 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:59:33.493143 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:59:33.493143 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:33.493486 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 01:59:33.494013 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0552(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 01:59:33.494306 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 01:59:33.566280 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.098s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:33.566651 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/6c48501b-d03d-40bc-aef5-450fa580bd69/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:33.625127 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] End _get_guest_xml xml=<domain type="qemu">
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:   <uuid>07596a09-d614-48c6-849f-a306f65c7a5c</uuid>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:   <name>instance-00000013</name>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:   <metadata>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:       <nova:name>tempest-VolumesActionsTest-instance-598838675</nova:name>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 01:59:33</nova:creationTime>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:       </nova:image>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:         <nova:user uuid="00bdcdf44d37445cb35f1f8491858627">tempest-VolumesActionsTest-271344132-project-member</nova:user>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:         <nova:project uuid="ebe24730468647869c1f1c973ecafdd2">tempest-VolumesActionsTest-271344132</nova:project>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:         <nova:port uuid="660421e7-d9e9-4f1e-92af-3d7e62bd7a87">
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:         </nova:port>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:   </metadata>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:     <system>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:       <entry name="serial">07596a09-d614-48c6-849f-a306f65c7a5c</entry>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:       <entry name="uuid">07596a09-d614-48c6-849f-a306f65c7a5c</entry>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:     </system>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:   <os>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:   </os>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:   <features>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:     <acpi/>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:     <tcg>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:     </tcg>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:   </features>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:   <devices>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/07596a09-d614-48c6-849f-a306f65c7a5c/disk"/>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:     </disk>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/07596a09-d614-48c6-849f-a306f65c7a5c/disk.config"/>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:     </disk>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:ed:f3:de"/>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:       <target dev="tap660421e7-d9"/>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:     </interface>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/07596a09-d614-48c6-849f-a306f65c7a5c/console.log" append="off"/>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:     </serial>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:     <video>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:     </video>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:     </rng>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:     </memballoon>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:   </devices>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]: </domain>
May 21 01:59:33.625127 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 01:59:33.628237 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Preparing to wait for external event network-vif-plugged-660421e7-d9e9-4f1e-92af-3d7e62bd7a87 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 01:59:33.628237 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Acquiring lock "07596a09-d614-48c6-849f-a306f65c7a5c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:33.628237 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Lock "07596a09-d614-48c6-849f-a306f65c7a5c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:33.628237 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Lock "07596a09-d614-48c6-849f-a306f65c7a5c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:33.628237 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T01:59:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-598838675',display_name='tempest-VolumesActionsTest-instance-598838675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumesactionstest-instance-598838675',id=19,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebe24730468647869c1f1c973ecafdd2',ramdisk_id='',reservation_id='r-u4mzryid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-271344132',owner_user_name='tempest-VolumesActionsTest-271344132-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:59:30Z,user_data=None,user_id='00bdcdf44d37445cb35f1f8491858627',uuid=07596a09-d614-48c6-849f-a306f65c7a5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "660421e7-d9e9-4f1e-92af-3d7e62bd7a87", "address": "fa:16:3e:ed:f3:de", "network": {"id": "17498fbc-1581-4d2b-82d2-3865a39e8d1f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1622249524-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ebe24730468647869c1f1c973ecafdd2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap660421e7-d9", "ovs_interfaceid": "660421e7-d9e9-4f1e-92af-3d7e62bd7a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 01:59:33.628237 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Converting VIF {"id": "660421e7-d9e9-4f1e-92af-3d7e62bd7a87", "address": "fa:16:3e:ed:f3:de", "network": {"id": "17498fbc-1581-4d2b-82d2-3865a39e8d1f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1622249524-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ebe24730468647869c1f1c973ecafdd2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap660421e7-d9", "ovs_interfaceid": "660421e7-d9e9-4f1e-92af-3d7e62bd7a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:59:33.629321 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f3:de,bridge_name='br-int',has_traffic_filtering=True,id=660421e7-d9e9-4f1e-92af-3d7e62bd7a87,network=Network(17498fbc-1581-4d2b-82d2-3865a39e8d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap660421e7-d9') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:59:33.629817 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f3:de,bridge_name='br-int',has_traffic_filtering=True,id=660421e7-d9e9-4f1e-92af-3d7e62bd7a87,network=Network(17498fbc-1581-4d2b-82d2-3865a39e8d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap660421e7-d9') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 01:59:33.630434 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:33.631995 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:33.631995 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 01:59:33.633109 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:33.633536 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ca65faf5-e238-5329-9603-0989c885cd4f', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:33.634598 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:33.635629 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:59:33.638029 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:33.640551 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:33.641056 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap660421e7-d9, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:33.641559 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap660421e7-d9, col_values=(('qos', UUID('61472ac6-41da-426e-bd7e-83179a7bd681')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:33.641706 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap660421e7-d9, col_values=(('external_ids', {'iface-id': '660421e7-d9e9-4f1e-92af-3d7e62bd7a87', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:f3:de', 'vm-uuid': '07596a09-d614-48c6-849f-a306f65c7a5c'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:33.642627 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:33.643603 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/6c48501b-d03d-40bc-aef5-450fa580bd69/disk 1073741824" returned: 0 in 0.077s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:33.643943 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.184s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:33.644254 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:33.662549 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:59:33.673843 np0000001127 nova-compute[98206]: INFO os_vif [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f3:de,bridge_name='br-int',has_traffic_filtering=True,id=660421e7-d9e9-4f1e-92af-3d7e62bd7a87,network=Network(17498fbc-1581-4d2b-82d2-3865a39e8d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap660421e7-d9')
May 21 01:59:33.750009 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.106s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:33.753595 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6c48501b-d03d-40bc-aef5-450fa580bd69/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 01:59:33.753595 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c48501b-d03d-40bc-aef5-450fa580bd69/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:33.838344 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c48501b-d03d-40bc-aef5-450fa580bd69/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:33.838766 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Cannot resize image /opt/stack/data/nova/instances/6c48501b-d03d-40bc-aef5-450fa580bd69/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 01:59:33.839215 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 01:59:33.839376 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Ensure instance console log exists: /opt/stack/data/nova/instances/6c48501b-d03d-40bc-aef5-450fa580bd69/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 01:59:33.839666 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:33.839887 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:33.840081 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:33.890220 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:59:33.890449 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:59:33.927997 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T01:59:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1476667320',display_name='tempest-ServerActionsTestOtherA-server-1476667320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serveractionstestothera-server-1476667320',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxRidCAMyb/mDvqucBNL6o1pu4ohR9TfsTnx1DGEBK8Hs9Bxy4viDAtOuJAjHZZuWNRGwi0rwlQFKlYKc+oTj/M3U8o3nzcuoUHvHlwyO9ufXio2O1Y8v01hvWMmUCFbg==',key_name='tempest-keypair-631476445',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a15fe7a70464159a778cffa4a36c36f',ramdisk_id='',reservation_id='r-szx080g8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1975191698',owner_user_name='tempest-ServerActionsTestOtherA-1975191698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:59:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbcd1a81252344dd804a4080571f8751',uuid=66fe5d80-9012-44fe-9b82-1e993211ddf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29bf5645-d178-459e-b25f-1b1db9f87374", "address": "fa:16:3e:45:a2:37", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bf5645-d1", "ovs_interfaceid": "29bf5645-d178-459e-b25f-1b1db9f87374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 01:59:33.928208 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Converting VIF {"id": "29bf5645-d178-459e-b25f-1b1db9f87374", "address": "fa:16:3e:45:a2:37", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bf5645-d1", "ovs_interfaceid": "29bf5645-d178-459e-b25f-1b1db9f87374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:59:33.929669 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:a2:37,bridge_name='br-int',has_traffic_filtering=True,id=29bf5645-d178-459e-b25f-1b1db9f87374,network=Network(6d660724-85bf-45e3-895a-b9ce67043c30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29bf5645-d1') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:59:33.929669 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lazy-loading 'pci_devices' on Instance uuid 66fe5d80-9012-44fe-9b82-1e993211ddf1 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:59:33.961040 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:33.967578 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:33.996771 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:34.001615 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f6cd626b-394b-4f99-b6ef-68e9e892326c req-2df2b767-0aae-41a9-8a8c-005834363fd7 service nova] Releasing lock "refresh_cache-6c48501b-d03d-40bc-aef5-450fa580bd69" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:59:34.001615 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquired lock "refresh_cache-6c48501b-d03d-40bc-aef5-450fa580bd69" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:59:34.001615 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 01:59:34.002064 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:34.033280 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:34.158383 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-259594fc-cfa1-453f-ad1b-9affb87f99e6 req-ca1dee18-30b8-432d-94f2-bb6b7aefbeb9 service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Received event network-vif-unplugged-3b1f76f9-cf49-4dea-b9a2-762c2ad220bf {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:34.159000 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-259594fc-cfa1-453f-ad1b-9affb87f99e6 req-ca1dee18-30b8-432d-94f2-bb6b7aefbeb9 service nova] Acquiring lock "64f1cde4-f11a-4da7-8bbc-aaf777432069-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:34.159168 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-259594fc-cfa1-453f-ad1b-9affb87f99e6 req-ca1dee18-30b8-432d-94f2-bb6b7aefbeb9 service nova] Lock "64f1cde4-f11a-4da7-8bbc-aaf777432069-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:34.159294 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-259594fc-cfa1-453f-ad1b-9affb87f99e6 req-ca1dee18-30b8-432d-94f2-bb6b7aefbeb9 service nova] Lock "64f1cde4-f11a-4da7-8bbc-aaf777432069-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:34.159425 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-259594fc-cfa1-453f-ad1b-9affb87f99e6 req-ca1dee18-30b8-432d-94f2-bb6b7aefbeb9 service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] No waiting events found dispatching network-vif-unplugged-3b1f76f9-cf49-4dea-b9a2-762c2ad220bf {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:59:34.159557 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-259594fc-cfa1-453f-ad1b-9affb87f99e6 req-ca1dee18-30b8-432d-94f2-bb6b7aefbeb9 service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Received unexpected event network-vif-unplugged-3b1f76f9-cf49-4dea-b9a2-762c2ad220bf for instance with vm_state active and task_state shelving.
May 21 01:59:34.261492 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999707778999891 future=<Future at 0x71c0585ece30 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:59:34.263214 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Instance destroyed successfully.
May 21 01:59:34.263673 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-518549b5-7c74-409f-ac47-57cac9ce230d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lazy-loading 'numa_topology' on Instance uuid 64f1cde4-f11a-4da7-8bbc-aaf777432069 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:59:34.394504 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:59:34.436151 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] End _get_guest_xml xml=<domain type="qemu">
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:   <uuid>66fe5d80-9012-44fe-9b82-1e993211ddf1</uuid>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:   <name>instance-00000012</name>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:   <metadata>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:       <nova:name>tempest-ServerActionsTestOtherA-server-1476667320</nova:name>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 01:59:30</nova:creationTime>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:       <nova:image uuid="">
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:       </nova:image>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:         <nova:user uuid="bbcd1a81252344dd804a4080571f8751">tempest-ServerActionsTestOtherA-1975191698-project-member</nova:user>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:         <nova:project uuid="6a15fe7a70464159a778cffa4a36c36f">tempest-ServerActionsTestOtherA-1975191698</nova:project>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:       <nova:root type="volume" uuid=""/>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:         <nova:port uuid="29bf5645-d178-459e-b25f-1b1db9f87374">
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:         </nova:port>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:   </metadata>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:     <system>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:       <entry name="serial">66fe5d80-9012-44fe-9b82-1e993211ddf1</entry>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:       <entry name="uuid">66fe5d80-9012-44fe-9b82-1e993211ddf1</entry>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:     </system>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:   <os>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:   </os>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:   <features>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:     <acpi/>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:     <tcg>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:     </tcg>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:   </features>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:   <devices>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/66fe5d80-9012-44fe-9b82-1e993211ddf1/disk.config"/>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:     </disk>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:       <alias name="ua-7721af1e-8f1d-4ffa-b905-045839f8645d"/>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-0"/>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:       <serial>7721af1e-8f1d-4ffa-b905-045839f8645d</serial>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:     </disk>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:45:a2:37"/>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:       <target dev="tap29bf5645-d1"/>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:     </interface>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/66fe5d80-9012-44fe-9b82-1e993211ddf1/console.log" append="off"/>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:     </serial>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:     <video>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:     </video>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:     </rng>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:     </memballoon>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:   </devices>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]: </domain>
May 21 01:59:34.436151 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 01:59:34.441007 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Preparing to wait for external event network-vif-plugged-29bf5645-d178-459e-b25f-1b1db9f87374 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 01:59:34.441007 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "66fe5d80-9012-44fe-9b82-1e993211ddf1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:34.441007 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "66fe5d80-9012-44fe-9b82-1e993211ddf1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:34.441007 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "66fe5d80-9012-44fe-9b82-1e993211ddf1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:34.441798 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T01:59:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1476667320',display_name='tempest-ServerActionsTestOtherA-server-1476667320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serveractionstestothera-server-1476667320',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxRidCAMyb/mDvqucBNL6o1pu4ohR9TfsTnx1DGEBK8Hs9Bxy4viDAtOuJAjHZZuWNRGwi0rwlQFKlYKc+oTj/M3U8o3nzcuoUHvHlwyO9ufXio2O1Y8v01hvWMmUCFbg==',key_name='tempest-keypair-631476445',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a15fe7a70464159a778cffa4a36c36f',ramdisk_id='',reservation_id='r-szx080g8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1975191698',owner_user_name='tempest-ServerActionsTestOtherA-1975191698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:59:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbcd1a81252344dd804a4080571f8751',uuid=66fe5d80-9012-44fe-9b82-1e993211ddf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29bf5645-d178-459e-b25f-1b1db9f87374", "address": "fa:16:3e:45:a2:37", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bf5645-d1", "ovs_interfaceid": "29bf5645-d178-459e-b25f-1b1db9f87374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 01:59:34.442268 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Converting VIF {"id": "29bf5645-d178-459e-b25f-1b1db9f87374", "address": "fa:16:3e:45:a2:37", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bf5645-d1", "ovs_interfaceid": "29bf5645-d178-459e-b25f-1b1db9f87374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:59:34.443263 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:a2:37,bridge_name='br-int',has_traffic_filtering=True,id=29bf5645-d178-459e-b25f-1b1db9f87374,network=Network(6d660724-85bf-45e3-895a-b9ce67043c30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29bf5645-d1') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:59:34.443698 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:a2:37,bridge_name='br-int',has_traffic_filtering=True,id=29bf5645-d178-459e-b25f-1b1db9f87374,network=Network(6d660724-85bf-45e3-895a-b9ce67043c30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29bf5645-d1') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 01:59:34.444114 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:34.444381 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:34.444641 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 01:59:34.445810 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:34.446002 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1572cfb5-662c-5a3e-9797-e047b2421374', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:34.447449 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:59:34.457077 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:34.459970 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:34.460168 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29bf5645-d1, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:34.460483 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap29bf5645-d1, col_values=(('qos', UUID('c3311743-0c6c-483c-ae27-553fe9b8b473')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:34.460659 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap29bf5645-d1, col_values=(('external_ids', {'iface-id': '29bf5645-d178-459e-b25f-1b1db9f87374', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:a2:37', 'vm-uuid': '66fe5d80-9012-44fe-9b82-1e993211ddf1'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:34.461803 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:34.462886 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:59:34.469213 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:59:34.479590 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:34.480647 np0000001127 nova-compute[98206]: INFO os_vif [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:a2:37,bridge_name='br-int',has_traffic_filtering=True,id=29bf5645-d178-459e-b25f-1b1db9f87374,network=Network(6d660724-85bf-45e3-895a-b9ce67043c30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29bf5645-d1')
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.startup = manual
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:59:34.488328 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:59:34.488328 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:34.494656 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:59:34.502275 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.startup = manual
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:59:34.509534 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:59:34.509534 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:34.521495 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:34.528731 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:34.528731 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:34.528731 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:34.528731 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:34.528731 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:34.528731 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:34.528731 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:34.528731 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:34.528731 np0000001127 nova-compute[98206]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:34.528731 np0000001127 nova-compute[98206]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:34.528731 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:59:34.540323 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:34.540323 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:34.540323 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:34.540323 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:34.540323 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:34.540323 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:34.540323 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:34.540323 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:34.540323 np0000001127 nova-compute[98206]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:34.540323 np0000001127 nova-compute[98206]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:34.540323 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:59:34.545614 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:34.545614 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:34.545614 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:34.545614 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:34.545614 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:34.545614 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:34.545614 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:34.545614 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:34.545614 np0000001127 nova-compute[98206]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:34.545614 np0000001127 nova-compute[98206]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:34.545614 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:59:34.545614 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:34.545614 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:34.545614 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:34.545614 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:34.545614 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:34.545614 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:34.545614 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:34.545614 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:34.545614 np0000001127 nova-compute[98206]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:34.545614 np0000001127 nova-compute[98206]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:34.545614 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:59:34.577364 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253, portal: 192.168.40.100,3260]
May 21 01:59:34.577364 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253, portal: 192.168.40.100,3260] successful.
May 21 01:59:34.577364 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:34.586365 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Acquiring lock "800e7287-2ec0-48a2-b959-d7fbcc1f3c10" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:34.586603 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "800e7287-2ec0-48a2-b959-d7fbcc1f3c10" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:34.586937 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Attaching volume 61d544f9-87fe-4afb-9cf7-04dec39c92a1 to /dev/vdb
May 21 01:59:34.593161 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:59:34.595712 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:34.596481 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253, portal: 192.168.50.100,3260]
May 21 01:59:34.596481 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253, portal: 192.168.50.100,3260] successful.
May 21 01:59:34.596481 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:34.616905 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:34.625854 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:34.625854 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:34.625854 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:34.625854 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:34.625854 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:34.625854 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:34.625854 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:34.625854 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:34.625854 np0000001127 nova-compute[98206]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:34.625854 np0000001127 nova-compute[98206]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:34.625854 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:34.625854 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:34.625854 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:59:34.626132 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:34.626132 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:34.626132 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:34.626132 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:34.626132 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:34.626132 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:34.626132 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:34.626132 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:34.626132 np0000001127 nova-compute[98206]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:34.626132 np0000001127 nova-compute[98206]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:34.626132 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:34.626132 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:34.626132 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:59:34.626328 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.199s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:59:34.626380 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:59:34.627896 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] HCTL ('15', '-', '-', 0) found on session 40 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:59:34.628055 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:59:34.635774 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:59:34.644395 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:34.644395 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:34.644395 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:34.644395 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:34.644395 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:34.644395 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:34.644395 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:34.644395 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:34.644395 np0000001127 nova-compute[98206]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:34.644395 np0000001127 nova-compute[98206]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:34.644395 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:34.644395 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:34.644395 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:59:34.651736 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:34.651736 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:34.651736 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:34.651736 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:34.651736 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:34.651736 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:34.651736 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:34.651736 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:34.651736 np0000001127 nova-compute[98206]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:34.651736 np0000001127 nova-compute[98206]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:34.651736 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:34.651736 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:34.651736 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:59:34.651736 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.216s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:59:34.651736 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:59:34.651736 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] HCTL ('16', '-', '-', 0) found on session 41 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:59:34.651736 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:59:34.651736 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 01:59:34.653452 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Searching for a device in session 40 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:59:34.653650 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '51b4adb6-eb47-40ee-a8ab-9a7ee5901253', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:59:34.675171 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Searching for a device in session 41 and hctl ['16', '*', '*', 0] yield: None {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:59:34.679360 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:34.735131 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 01:59:34.737122 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 01:59:34.747924 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 01:59:34.747924 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe9e:216', 'fe80::14d9:7bff:fe3b:f0dc', 'fe80::fc16:3eff:fee3:f7d2', 'fe80::6c2e:11ff:fea1:7eb7', 'fe80::fc16:3eff:feaf:51f1', 'fe80::68db:c7ff:fe71:da32', 'fe80::fc16:3eff:fef8:14ac', 'fe80::c058:52ff:fed8:cd31', 'fe80::fc16:3eff:fe32:4418', 'fe80::fc16:3eff:fee6:5187', 'fe80::fc16:3eff:fe80:dd78', 'fe80::fc16:3eff:fe19:d5ae', 'fe80::fc16:3eff:fedb:3cf9', 'fe80::2040:23ff:febb:db06', 'fe80::fc16:3eff:fec9:a8b1', 'fe80::3003:9cff:fe70:ad4e', 'fe80::fc16:3eff:fe50:bfd8'] 
May 21 01:59:34.747924 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 01:59:34.749605 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 01:59:34.749605 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:59:34.749605 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Updating existing volume attachment record: cc856a04-548c-466d-80eb-0c84030431a1 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 01:59:34.858277 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:34.902627 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.854s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:34.903179 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 01:59:34.941018 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-518549b5-7c74-409f-ac47-57cac9ce230d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Beginning cold snapshot process
May 21 01:59:35.022337 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Updating instance_info_cache with network_info: [{"id": "3356c6b8-bf6b-43aa-bb09-491a7b40115f", "address": "fa:16:3e:23:65:cb", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3356c6b8-bf", "ovs_interfaceid": "3356c6b8-bf6b-43aa-bb09-491a7b40115f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:59:35.217947 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:59:35.217947 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:59:35.217947 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] No VIF found with MAC fa:16:3e:ed:f3:de, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 01:59:35.217947 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Using config drive
May 21 01:59:35.326966 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 01:59:35.326966 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1', 'iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '61d544f9-87fe-4afb-9cf7-04dec39c92a1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:59:35.326966 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:59:35.412850 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 01:59:35.413045 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 01:59:35.413384 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:35.413907 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:35.496161 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dc202b3265224b1186e34494436cb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e8df58805f415fa39327f7f81e7852', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 01:59:35.524760 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Releasing lock "refresh_cache-6c48501b-d03d-40bc-aef5-450fa580bd69" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:59:35.525144 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Instance network_info: |[{"id": "3356c6b8-bf6b-43aa-bb09-491a7b40115f", "address": "fa:16:3e:23:65:cb", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3356c6b8-bf", "ovs_interfaceid": "3356c6b8-bf6b-43aa-bb09-491a7b40115f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 01:59:35.528677 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Start _get_guest_xml network_info=[{"id": "3356c6b8-bf6b-43aa-bb09-491a7b40115f", "address": "fa:16:3e:23:65:cb", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3356c6b8-bf", "ovs_interfaceid": "3356c6b8-bf6b-43aa-bb09-491a7b40115f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 01:59:35.531366 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 01:59:35.532612 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-215292592', uuid='6c48501b-d03d-40bc-aef5-450fa580bd69'), owner=OwnerMeta(userid='bd5b969d5a514d01bacfc7954a5ae4ab', username='tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member', projectid='83df9a84ffaa4398bdafbfbde079964d', projectname='tempest-ServerBootFromVolumeStableRescueTest-260444396'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3356c6b8-bf6b-43aa-bb09-491a7b40115f", "address": "fa:16:3e:23:65:cb", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3356c6b8-bf", "ovs_interfaceid": "3356c6b8-bf6b-43aa-bb09-491a7b40115f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328775.532221) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 01:59:35.533463 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 01:59:35.533863 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 01:59:35.534559 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 01:59:35.534758 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 01:59:35.535864 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 01:59:35.536291 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 01:59:35.536498 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 01:59:35.536638 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 01:59:35.536797 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 01:59:35.536943 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 01:59:35.537072 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 01:59:35.537260 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 01:59:35.537489 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 01:59:35.537860 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 01:59:35.538037 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 01:59:35.538220 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 01:59:35.550376 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T01:59:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-215292592',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serverbootfromvolumestablerescuetest-server-215292592',id=20,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83df9a84ffaa4398bdafbfbde079964d',ramdisk_id='',reservation_id='r-3r9rd7o1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-260444396',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:59:32Z,user_data=None,user_id='bd5b969d5a514d01bacfc7954a5ae4ab',uuid=6c48501b-d03d-40bc-aef5-450fa580bd69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3356c6b8-bf6b-43aa-bb09-491a7b40115f", "address": "fa:16:3e:23:65:cb", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3356c6b8-bf", "ovs_interfaceid": "3356c6b8-bf6b-43aa-bb09-491a7b40115f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 01:59:35.550625 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Converting VIF {"id": "3356c6b8-bf6b-43aa-bb09-491a7b40115f", "address": "fa:16:3e:23:65:cb", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3356c6b8-bf", "ovs_interfaceid": "3356c6b8-bf6b-43aa-bb09-491a7b40115f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:59:35.551360 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:65:cb,bridge_name='br-int',has_traffic_filtering=True,id=3356c6b8-bf6b-43aa-bb09-491a7b40115f,network=Network(b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3356c6b8-bf') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:59:35.552226 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c48501b-d03d-40bc-aef5-450fa580bd69 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:59:35.670392 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Searching for a device in session 41 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:59:35.670958 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '51b4adb6-eb47-40ee-a8ab-9a7ee5901253', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:59:35.724577 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:35.859676 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Creating config drive at /opt/stack/data/nova/instances/07596a09-d614-48c6-849f-a306f65c7a5c/disk.config
May 21 01:59:35.862753 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/07596a09-d614-48c6-849f-a306f65c7a5c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmprd450t5m {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:35.911938 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/07596a09-d614-48c6-849f-a306f65c7a5c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmprd450t5m" returned: 0 in 0.049s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:35.914892 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 01:59:35.977545 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Successfully created port: 20346b2b-b6d7-4a1a-a9fa-21aa6d702f17 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 01:59:36.004780 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:59:36.004948 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:59:36.005086 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] No VIF found with MAC fa:16:3e:45:a2:37, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 01:59:36.006237 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Using config drive
May 21 01:59:36.055348 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] End _get_guest_xml xml=<domain type="qemu">
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:   <uuid>6c48501b-d03d-40bc-aef5-450fa580bd69</uuid>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:   <name>instance-00000014</name>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:   <metadata>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-215292592</nova:name>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 01:59:35</nova:creationTime>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:       </nova:image>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:         <nova:user uuid="bd5b969d5a514d01bacfc7954a5ae4ab">tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member</nova:user>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:         <nova:project uuid="83df9a84ffaa4398bdafbfbde079964d">tempest-ServerBootFromVolumeStableRescueTest-260444396</nova:project>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:         <nova:port uuid="3356c6b8-bf6b-43aa-bb09-491a7b40115f">
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:         </nova:port>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:   </metadata>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:     <system>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:       <entry name="serial">6c48501b-d03d-40bc-aef5-450fa580bd69</entry>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:       <entry name="uuid">6c48501b-d03d-40bc-aef5-450fa580bd69</entry>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:     </system>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:   <os>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:   </os>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:   <features>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:     <acpi/>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:     <tcg>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:     </tcg>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:   </features>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:   <devices>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/6c48501b-d03d-40bc-aef5-450fa580bd69/disk"/>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:     </disk>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/6c48501b-d03d-40bc-aef5-450fa580bd69/disk.config"/>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:     </disk>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:23:65:cb"/>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:       <target dev="tap3356c6b8-bf"/>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:     </interface>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/6c48501b-d03d-40bc-aef5-450fa580bd69/console.log" append="off"/>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:     </serial>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:     <video>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:     </video>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:     </rng>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:     </memballoon>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:   </devices>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]: </domain>
May 21 01:59:36.055348 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 01:59:36.059352 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Preparing to wait for external event network-vif-plugged-3356c6b8-bf6b-43aa-bb09-491a7b40115f {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 01:59:36.059352 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "6c48501b-d03d-40bc-aef5-450fa580bd69-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:36.059352 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "6c48501b-d03d-40bc-aef5-450fa580bd69-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:36.059352 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "6c48501b-d03d-40bc-aef5-450fa580bd69-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:36.059352 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T01:59:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-215292592',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serverbootfromvolumestablerescuetest-server-215292592',id=20,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83df9a84ffaa4398bdafbfbde079964d',ramdisk_id='',reservation_id='r-3r9rd7o1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-260444396',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:59:32Z,user_data=None,user_id='bd5b969d5a514d01bacfc7954a5ae4ab',uuid=6c48501b-d03d-40bc-aef5-450fa580bd69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3356c6b8-bf6b-43aa-bb09-491a7b40115f", "address": "fa:16:3e:23:65:cb", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3356c6b8-bf", "ovs_interfaceid": "3356c6b8-bf6b-43aa-bb09-491a7b40115f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 01:59:36.059352 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Converting VIF {"id": "3356c6b8-bf6b-43aa-bb09-491a7b40115f", "address": "fa:16:3e:23:65:cb", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3356c6b8-bf", "ovs_interfaceid": "3356c6b8-bf6b-43aa-bb09-491a7b40115f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:59:36.059352 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:65:cb,bridge_name='br-int',has_traffic_filtering=True,id=3356c6b8-bf6b-43aa-bb09-491a7b40115f,network=Network(b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3356c6b8-bf') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:59:36.059352 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:65:cb,bridge_name='br-int',has_traffic_filtering=True,id=3356c6b8-bf6b-43aa-bb09-491a7b40115f,network=Network(b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3356c6b8-bf') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 01:59:36.059352 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:36.059352 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:36.060693 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 01:59:36.061124 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:36.061371 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f24cb37c-de1d-5130-a848-b20324cff32f', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:36.063233 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:59:36.081589 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:36.085794 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:36.086457 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3356c6b8-bf, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:36.087018 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3356c6b8-bf, col_values=(('qos', UUID('1e9f8d40-5c43-44a3-aea7-c43c7b9fc580')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:36.087259 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3356c6b8-bf, col_values=(('external_ids', {'iface-id': '3356c6b8-bf6b-43aa-bb09-491a7b40115f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:65:cb', 'vm-uuid': '6c48501b-d03d-40bc-aef5-450fa580bd69'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:36.090134 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:36.091852 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:59:36.113391 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:36.114322 np0000001127 nova-compute[98206]: INFO os_vif [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:65:cb,bridge_name='br-int',has_traffic_filtering=True,id=3356c6b8-bf6b-43aa-bb09-491a7b40115f,network=Network(b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3356c6b8-bf')
May 21 01:59:36.239337 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:36.241514 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c91bb4f7-22d3-4d6f-a062-f0d6ee9123d0 req-b10e7d27-88ff-419e-a384-9ed5e12523c4 service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Received event network-vif-unplugged-3b1f76f9-cf49-4dea-b9a2-762c2ad220bf {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:36.241514 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c91bb4f7-22d3-4d6f-a062-f0d6ee9123d0 req-b10e7d27-88ff-419e-a384-9ed5e12523c4 service nova] Acquiring lock "64f1cde4-f11a-4da7-8bbc-aaf777432069-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:36.241514 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c91bb4f7-22d3-4d6f-a062-f0d6ee9123d0 req-b10e7d27-88ff-419e-a384-9ed5e12523c4 service nova] Lock "64f1cde4-f11a-4da7-8bbc-aaf777432069-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:36.241695 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c91bb4f7-22d3-4d6f-a062-f0d6ee9123d0 req-b10e7d27-88ff-419e-a384-9ed5e12523c4 service nova] Lock "64f1cde4-f11a-4da7-8bbc-aaf777432069-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:36.241695 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c91bb4f7-22d3-4d6f-a062-f0d6ee9123d0 req-b10e7d27-88ff-419e-a384-9ed5e12523c4 service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] No waiting events found dispatching network-vif-unplugged-3b1f76f9-cf49-4dea-b9a2-762c2ad220bf {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:59:36.241793 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-c91bb4f7-22d3-4d6f-a062-f0d6ee9123d0 req-b10e7d27-88ff-419e-a384-9ed5e12523c4 service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Received unexpected event network-vif-unplugged-3b1f76f9-cf49-4dea-b9a2-762c2ad220bf for instance with vm_state active and task_state shelving_image_pending_upload.
May 21 01:59:36.420050 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 01:59:36.450570 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Found WWN 3300000009b658662 for multipath device dm-9 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 01:59:36.451091 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.051s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:59:36.451320 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] <== connect_volume: return (5458ms) {'type': 'block', 'scsi_wwn': '3300000009b658662', 'path': '/dev/dm-9', 'multipath_id': '3300000009b658662'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:59:36.451452 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009b658662', 'path': '/dev/dm-9', 'multipath_id': '3300000009b658662'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 01:59:36.451755 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:36.453398 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.127s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:59:36.453662 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1', 'iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '61d544f9-87fe-4afb-9cf7-04dec39c92a1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 01:59:36.456964 np0000001127 nova-compute[98206]: DEBUG nova.privsep.utils [None req-518549b5-7c74-409f-ac47-57cac9ce230d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 21 01:59:36.457663 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-518549b5-7c74-409f-ac47-57cac9ce230d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/64f1cde4-f11a-4da7-8bbc-aaf777432069/disk /opt/stack/data/nova/instances/snapshots/tmpgskfor7q/f3cf1760f54a46fcb4dc3f5f4bd544f5 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:36.483157 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:59:36.485906 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:59:36.488236 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:59:36.491502 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:59:36.503040 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:59:36.503866 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:59:36.508539 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:36.517057 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:36.523568 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 01:59:36.523568 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:36.532952 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 01:59:36.532952 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:36.538707 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1] added
May 21 01:59:36.538707 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 01:59:36.538707 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:59:36.538707 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:59:36.538707 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:59:36.538707 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:59:36.538707 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:36.538970 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 01:59:36.539243 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0484(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 01:59:36.539434 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 01:59:36.553669 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1] added
May 21 01:59:36.553669 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 01:59:36.553669 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:59:36.553669 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:59:36.553669 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:59:36.553669 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:59:36.553669 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:36.554032 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 01:59:36.554500 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0621(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 01:59:36.554671 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 01:59:36.590342 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:36.684633 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Successfully updated port: 20346b2b-b6d7-4a1a-a9fa-21aa6d702f17 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 01:59:36.693264 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Creating config drive at /opt/stack/data/nova/instances/66fe5d80-9012-44fe-9b82-1e993211ddf1/disk.config
May 21 01:59:36.699708 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/66fe5d80-9012-44fe-9b82-1e993211ddf1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfr6h68zd {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:36.754482 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-40115baa-0a4c-432f-9091-3b16c7617ea7 req-da745781-255a-4821-889a-c376dba6a856 service nova] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Received event network-changed-20346b2b-b6d7-4a1a-a9fa-21aa6d702f17 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:36.754482 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-40115baa-0a4c-432f-9091-3b16c7617ea7 req-da745781-255a-4821-889a-c376dba6a856 service nova] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Refreshing instance network info cache due to event network-changed-20346b2b-b6d7-4a1a-a9fa-21aa6d702f17. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:59:36.754636 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-40115baa-0a4c-432f-9091-3b16c7617ea7 req-da745781-255a-4821-889a-c376dba6a856 service nova] Acquiring lock "refresh_cache-cb319b5a-9797-421c-ad9d-2fd9a1aaba38" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:59:36.755703 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-40115baa-0a4c-432f-9091-3b16c7617ea7 req-da745781-255a-4821-889a-c376dba6a856 service nova] Acquired lock "refresh_cache-cb319b5a-9797-421c-ad9d-2fd9a1aaba38" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:59:36.755703 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-40115baa-0a4c-432f-9091-3b16c7617ea7 req-da745781-255a-4821-889a-c376dba6a856 service nova] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Refreshing network info cache for port 20346b2b-b6d7-4a1a-a9fa-21aa6d702f17 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:59:36.762412 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/66fe5d80-9012-44fe-9b82-1e993211ddf1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfr6h68zd" returned: 0 in 0.062s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:36.864356 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:36.884481 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:36.887247 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:36.924114 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:36.946115 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:37.010429 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:58:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-715258350',display_name='tempest-TestMinimumBasicScenario-server-715258350',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testminimumbasicscenario-server-715258350',id=14,image_ref='a377f14f-f022-4902-8291-4e733e0a7be0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXVa1e4OFd0NMMgqm+4/xZwNI5dMebNPDeh14+7JZ91orpoik4qLtCbEUIRp2DSHHVcppNPspElPEIhYTAGUliS3RSE8t15WkhilyCcQF6xleusOu5YpLtoNfQpTRunwg==',key_name='tempest-TestMinimumBasicScenario-2026356756',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:58:47Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc797708a5a7400992765e41ee6ec260',ramdisk_id='',reservation_id='r-qn7g4mne',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a377f14f-f022-4902-8291-4e733e0a7be0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-654915677',owner_user_name='tempest-TestMinimumBasicScenario-654915677-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:59:28Z,user_data=None,user_id='44907638a40d4fb4ad9014b58dcd6bac',uuid=a6839691-a7ec-4dea-bc39-a7e89c94cf4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "address": "fa:16:3e:76:c8:70", "network": {"id": "7cdbc224-429f-49a6-86f3-307f51e53dfc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2078432126-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc797708a5a7400992765e41ee6ec260", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99a2cf4-26", "ovs_interfaceid": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 01:59:37.010794 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Converting VIF {"id": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "address": "fa:16:3e:76:c8:70", "network": {"id": "7cdbc224-429f-49a6-86f3-307f51e53dfc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2078432126-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc797708a5a7400992765e41ee6ec260", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99a2cf4-26", "ovs_interfaceid": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:59:37.011859 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:c8:70,bridge_name='br-int',has_traffic_filtering=True,id=d99a2cf4-260b-4ca3-b72e-7db23358b831,network=Network(7cdbc224-429f-49a6-86f3-307f51e53dfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99a2cf4-26') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:59:37.013722 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lazy-loading 'pci_devices' on Instance uuid a6839691-a7ec-4dea-bc39-a7e89c94cf4d {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:59:37.023950 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-518549b5-7c74-409f-ac47-57cac9ce230d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/64f1cde4-f11a-4da7-8bbc-aaf777432069/disk /opt/stack/data/nova/instances/snapshots/tmpgskfor7q/f3cf1760f54a46fcb4dc3f5f4bd544f5" returned: 0 in 0.566s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:37.024625 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-518549b5-7c74-409f-ac47-57cac9ce230d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Snapshot extracted, beginning image upload
May 21 01:59:37.187293 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Acquiring lock "refresh_cache-cb319b5a-9797-421c-ad9d-2fd9a1aaba38" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:59:37.260459 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:37.263223 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-40115baa-0a4c-432f-9091-3b16c7617ea7 req-da745781-255a-4821-889a-c376dba6a856 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:37.299875 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:37.301492 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:37.334693 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-40115baa-0a4c-432f-9091-3b16c7617ea7 req-da745781-255a-4821-889a-c376dba6a856 service nova] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:59:37.386906 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328777.386307, 07596a09-d614-48c6-849f-a306f65c7a5c => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:59:37.386906 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] VM Started (Lifecycle Event)
May 21 01:59:37.400775 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:37.432400 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 01:59:37.433620 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 01:59:37.433874 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Creating image(s)
May 21 01:59:37.434493 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Acquiring lock "/opt/stack/data/nova/instances/cb319b5a-9797-421c-ad9d-2fd9a1aaba38/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:37.434697 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Lock "/opt/stack/data/nova/instances/cb319b5a-9797-421c-ad9d-2fd9a1aaba38/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:37.435210 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Lock "/opt/stack/data/nova/instances/cb319b5a-9797-421c-ad9d-2fd9a1aaba38/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:37.436525 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:59:37.439422 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:59:37.442232 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:37.459152 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:37.518580 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Object Instance<a6839691-a7ec-4dea-bc39-a7e89c94cf4d> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 01:59:37.521573 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] End _get_guest_xml xml=<domain type="qemu">
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:   <uuid>a6839691-a7ec-4dea-bc39-a7e89c94cf4d</uuid>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:   <name>instance-0000000e</name>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:   <metadata>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:       <nova:name>tempest-TestMinimumBasicScenario-server-715258350</nova:name>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 01:59:30</nova:creationTime>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:       <nova:image uuid="a377f14f-f022-4902-8291-4e733e0a7be0">
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:           <nova:property name="hw_machine_type">pc</nova:property>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:           <nova:property name="hw_video_model">virtio</nova:property>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:       </nova:image>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:         <nova:user uuid="44907638a40d4fb4ad9014b58dcd6bac">tempest-TestMinimumBasicScenario-654915677-project-member</nova:user>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:         <nova:project uuid="dc797708a5a7400992765e41ee6ec260">tempest-TestMinimumBasicScenario-654915677</nova:project>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="a377f14f-f022-4902-8291-4e733e0a7be0"/>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:         <nova:port uuid="d99a2cf4-260b-4ca3-b72e-7db23358b831">
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:         </nova:port>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:   </metadata>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:     <system>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:       <entry name="serial">a6839691-a7ec-4dea-bc39-a7e89c94cf4d</entry>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:       <entry name="uuid">a6839691-a7ec-4dea-bc39-a7e89c94cf4d</entry>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:     </system>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:   <os>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:   </os>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:   <features>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:     <acpi/>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:     <tcg>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:     </tcg>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:   </features>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:   <devices>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d/disk"/>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:     </disk>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d/disk.config"/>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:     </disk>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:       <alias name="ua-51b4adb6-eb47-40ee-a8ab-9a7ee5901253"/>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-9"/>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:       <target dev="vdb" bus="virtio"/>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:       <serial>51b4adb6-eb47-40ee-a8ab-9a7ee5901253</serial>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:     </disk>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:76:c8:70"/>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:       <target dev="tapd99a2cf4-26"/>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:     </interface>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d/console.log" append="off"/>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:     </serial>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:     <video>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:     </video>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:     </rng>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:     </memballoon>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:   </devices>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]: </domain>
May 21 01:59:37.521573 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 01:59:37.528696 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:37.550183 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-40115baa-0a4c-432f-9091-3b16c7617ea7 req-da745781-255a-4821-889a-c376dba6a856 service nova] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:59:37.555291 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:59:37.569554 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:59:37.573387 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.128s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.startup = manual
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:59:37.575568 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:59:37.575568 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:37.577436 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:37.577436 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:59:37.583038 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:59:37.583766 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.startup = manual
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:59:37.604668 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:59:37.604668 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:37.611499 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:37.615685 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:37.617756 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:37.639534 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:37.647290 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:37.647290 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:37.647290 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:37.647290 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:37.647290 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:37.647290 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:37.647290 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:37.647290 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:37.647290 np0000001127 nova-compute[98206]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:37.647290 np0000001127 nova-compute[98206]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:37.647290 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:37.647290 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:37.647290 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:59:37.647290 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:37.647290 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:37.647290 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:37.647290 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:37.647290 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:37.647290 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:37.647290 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:37.647290 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:37.647290 np0000001127 nova-compute[98206]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:37.647290 np0000001127 nova-compute[98206]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:37.647290 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:37.647290 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:37.647290 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:59:37.659560 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:59:37.659560 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:59:37.660365 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] No VIF found with MAC fa:16:3e:23:65:cb, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 01:59:37.662934 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Using config drive
May 21 01:59:37.663508 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:37.663508 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:37.663508 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:37.663508 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:37.663508 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:37.663508 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:37.663508 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:37.663508 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:37.663508 np0000001127 nova-compute[98206]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:37.663508 np0000001127 nova-compute[98206]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:37.663508 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:37.663508 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:37.663508 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:59:37.664076 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:37.664076 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:37.664076 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:37.664076 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:37.664076 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:37.664076 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:37.664076 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:37.664076 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:37.664076 np0000001127 nova-compute[98206]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:37.664076 np0000001127 nova-compute[98206]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:37.664076 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:37.664076 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:37.664076 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:59:37.669186 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.085s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:37.670991 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/cb319b5a-9797-421c-ad9d-2fd9a1aaba38/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:37.716752 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:37.721649 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] skipping disk /dev/dm-9 (vdb) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 01:59:37.721649 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lazy-loading 'trusted_certs' on Instance uuid a6839691-a7ec-4dea-bc39-a7e89c94cf4d {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:59:37.730102 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1, portal: 192.168.40.100,3260]
May 21 01:59:37.730102 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1, portal: 192.168.40.100,3260] successful.
May 21 01:59:37.730102 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:37.738679 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1, portal: 192.168.50.100,3260]
May 21 01:59:37.738679 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1, portal: 192.168.50.100,3260] successful.
May 21 01:59:37.738679 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:37.745294 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:37.746759 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/cb319b5a-9797-421c-ad9d-2fd9a1aaba38/disk 1073741824" returned: 0 in 0.075s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:37.747391 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.172s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:37.747785 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:37.783890 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:37.783890 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:37.783890 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:37.783890 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:37.783890 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:37.783890 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:37.783890 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:37.783890 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:37.783890 np0000001127 nova-compute[98206]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:37.783890 np0000001127 nova-compute[98206]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:37.783890 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:37.783890 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:37.783890 np0000001127 nova-compute[98206]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1 (non-flash)
May 21 01:59:37.783890 np0000001127 nova-compute[98206]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1 (non-flash)
May 21 01:59:37.783890 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:59:37.784302 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:37.784302 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:37.784302 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:37.784302 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:37.784302 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:37.784302 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:37.784302 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:37.784302 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:37.784302 np0000001127 nova-compute[98206]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:37.784302 np0000001127 nova-compute[98206]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:37.784302 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:37.784302 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:37.784302 np0000001127 nova-compute[98206]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1 (non-flash)
May 21 01:59:37.784302 np0000001127 nova-compute[98206]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1 (non-flash)
May 21 01:59:37.784302 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:59:37.784772 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:37.785837 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.299s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:59:37.786231 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:59:37.788914 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] HCTL ('19', '-', '-', 0) found on session 42 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:59:37.789077 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:59:37.806975 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Searching for a device in session 42 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:59:37.807200 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '61d544f9-87fe-4afb-9cf7-04dec39c92a1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:59:37.811130 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:37.811130 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:37.811130 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:37.811130 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:37.811130 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:37.811130 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:37.811130 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:37.811130 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:37.811130 np0000001127 nova-compute[98206]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:37.811130 np0000001127 nova-compute[98206]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:37.811130 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:37.811130 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:37.811130 np0000001127 nova-compute[98206]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1 (non-flash)
May 21 01:59:37.811130 np0000001127 nova-compute[98206]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1 (non-flash)
May 21 01:59:37.811130 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:59:37.811428 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:37.811428 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:37.811428 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:37.811428 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:37.811428 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:37.811428 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:37.811428 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:37.811428 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:37.811428 np0000001127 nova-compute[98206]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:37.811428 np0000001127 nova-compute[98206]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:37.811428 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:37.811428 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:37.811428 np0000001127 nova-compute[98206]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1 (non-flash)
May 21 01:59:37.811428 np0000001127 nova-compute[98206]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1 (non-flash)
May 21 01:59:37.811428 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:59:37.811682 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.325s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:59:37.811811 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:59:37.814687 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] HCTL ('20', '-', '-', 0) found on session 43 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:59:37.814687 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:59:37.838907 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Searching for a device in session 43 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:59:37.839003 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '61d544f9-87fe-4afb-9cf7-04dec39c92a1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:59:37.843480 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.095s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:37.843585 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cb319b5a-9797-421c-ad9d-2fd9a1aaba38/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 01:59:37.843946 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb319b5a-9797-421c-ad9d-2fd9a1aaba38/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:37.890677 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:59:37.894330 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328777.8939219, 07596a09-d614-48c6-849f-a306f65c7a5c => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:59:37.894456 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] VM Paused (Lifecycle Event)
May 21 01:59:37.931333 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb319b5a-9797-421c-ad9d-2fd9a1aaba38/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:37.931846 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Cannot resize image /opt/stack/data/nova/instances/cb319b5a-9797-421c-ad9d-2fd9a1aaba38/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 01:59:37.932513 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 01:59:37.932513 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Ensure instance console log exists: /opt/stack/data/nova/instances/cb319b5a-9797-421c-ad9d-2fd9a1aaba38/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 01:59:37.932675 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:37.934030 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:37.934030 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:38.058961 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-40115baa-0a4c-432f-9091-3b16c7617ea7 req-da745781-255a-4821-889a-c376dba6a856 service nova] Releasing lock "refresh_cache-cb319b5a-9797-421c-ad9d-2fd9a1aaba38" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:59:38.059558 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Acquired lock "refresh_cache-cb319b5a-9797-421c-ad9d-2fd9a1aaba38" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:59:38.059826 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 01:59:38.177039 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:38.224559 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Object Instance<a6839691-a7ec-4dea-bc39-a7e89c94cf4d> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 01:59:38.224929 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0066f00a071b6bfd563ca0d541bc609a816e4ac2 --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:38.313617 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Creating config drive at /opt/stack/data/nova/instances/6c48501b-d03d-40bc-aef5-450fa580bd69/disk.config
May 21 01:59:38.317244 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6c48501b-d03d-40bc-aef5-450fa580bd69/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp19llters {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:38.328210 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0066f00a071b6bfd563ca0d541bc609a816e4ac2 --force-share --output=json" returned: 0 in 0.102s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:38.330269 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 01:59:38.331067 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:38.373270 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6c48501b-d03d-40bc-aef5-450fa580bd69/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp19llters" returned: 0 in 0.055s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:38.398566 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:59:38.400439 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:59:38.442659 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:38.444271 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Cannot resize image /opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 01:59:38.444271 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lazy-loading 'migration_context' on Instance uuid a6839691-a7ec-4dea-bc39-a7e89c94cf4d {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:59:38.495395 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 01:59:38.638539 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 01:59:38.825695 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:38.825695 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:38.845350 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-424f07aa-fc91-4ec2-9940-33a9e8e9e68e req-bc008649-3dde-47a1-8eac-67b8894e21a5 service nova] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Received event network-vif-plugged-660421e7-d9e9-4f1e-92af-3d7e62bd7a87 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:38.845654 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-424f07aa-fc91-4ec2-9940-33a9e8e9e68e req-bc008649-3dde-47a1-8eac-67b8894e21a5 service nova] Acquiring lock "07596a09-d614-48c6-849f-a306f65c7a5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:38.846985 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-424f07aa-fc91-4ec2-9940-33a9e8e9e68e req-bc008649-3dde-47a1-8eac-67b8894e21a5 service nova] Lock "07596a09-d614-48c6-849f-a306f65c7a5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:38.846985 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-424f07aa-fc91-4ec2-9940-33a9e8e9e68e req-bc008649-3dde-47a1-8eac-67b8894e21a5 service nova] Lock "07596a09-d614-48c6-849f-a306f65c7a5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:38.846985 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-424f07aa-fc91-4ec2-9940-33a9e8e9e68e req-bc008649-3dde-47a1-8eac-67b8894e21a5 service nova] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Processing event network-vif-plugged-660421e7-d9e9-4f1e-92af-3d7e62bd7a87 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 01:59:38.846985 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-424f07aa-fc91-4ec2-9940-33a9e8e9e68e req-bc008649-3dde-47a1-8eac-67b8894e21a5 service nova] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Received event network-vif-plugged-660421e7-d9e9-4f1e-92af-3d7e62bd7a87 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:38.846985 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-424f07aa-fc91-4ec2-9940-33a9e8e9e68e req-bc008649-3dde-47a1-8eac-67b8894e21a5 service nova] Acquiring lock "07596a09-d614-48c6-849f-a306f65c7a5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:38.846985 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-424f07aa-fc91-4ec2-9940-33a9e8e9e68e req-bc008649-3dde-47a1-8eac-67b8894e21a5 service nova] Lock "07596a09-d614-48c6-849f-a306f65c7a5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:38.846985 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-424f07aa-fc91-4ec2-9940-33a9e8e9e68e req-bc008649-3dde-47a1-8eac-67b8894e21a5 service nova] Lock "07596a09-d614-48c6-849f-a306f65c7a5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:38.848031 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-424f07aa-fc91-4ec2-9940-33a9e8e9e68e req-bc008649-3dde-47a1-8eac-67b8894e21a5 service nova] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] No waiting events found dispatching network-vif-plugged-660421e7-d9e9-4f1e-92af-3d7e62bd7a87 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:59:38.848214 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-424f07aa-fc91-4ec2-9940-33a9e8e9e68e req-bc008649-3dde-47a1-8eac-67b8894e21a5 service nova] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Received unexpected event network-vif-plugged-660421e7-d9e9-4f1e-92af-3d7e62bd7a87 for instance with vm_state building and task_state spawning.
May 21 01:59:38.848350 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-424f07aa-fc91-4ec2-9940-33a9e8e9e68e req-bc008649-3dde-47a1-8eac-67b8894e21a5 service nova] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Received event network-vif-plugged-29bf5645-d178-459e-b25f-1b1db9f87374 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:38.848539 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-424f07aa-fc91-4ec2-9940-33a9e8e9e68e req-bc008649-3dde-47a1-8eac-67b8894e21a5 service nova] Acquiring lock "66fe5d80-9012-44fe-9b82-1e993211ddf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:38.850172 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 01:59:38.852136 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-424f07aa-fc91-4ec2-9940-33a9e8e9e68e req-bc008649-3dde-47a1-8eac-67b8894e21a5 service nova] Lock "66fe5d80-9012-44fe-9b82-1e993211ddf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:38.852136 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-424f07aa-fc91-4ec2-9940-33a9e8e9e68e req-bc008649-3dde-47a1-8eac-67b8894e21a5 service nova] Lock "66fe5d80-9012-44fe-9b82-1e993211ddf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:38.852136 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-424f07aa-fc91-4ec2-9940-33a9e8e9e68e req-bc008649-3dde-47a1-8eac-67b8894e21a5 service nova] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Processing event network-vif-plugged-29bf5645-d178-459e-b25f-1b1db9f87374 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 01:59:38.852136 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-424f07aa-fc91-4ec2-9940-33a9e8e9e68e req-bc008649-3dde-47a1-8eac-67b8894e21a5 service nova] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Received event network-vif-plugged-29bf5645-d178-459e-b25f-1b1db9f87374 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:38.852136 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-424f07aa-fc91-4ec2-9940-33a9e8e9e68e req-bc008649-3dde-47a1-8eac-67b8894e21a5 service nova] Acquiring lock "66fe5d80-9012-44fe-9b82-1e993211ddf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:38.852136 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-424f07aa-fc91-4ec2-9940-33a9e8e9e68e req-bc008649-3dde-47a1-8eac-67b8894e21a5 service nova] Lock "66fe5d80-9012-44fe-9b82-1e993211ddf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:38.852136 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-424f07aa-fc91-4ec2-9940-33a9e8e9e68e req-bc008649-3dde-47a1-8eac-67b8894e21a5 service nova] Lock "66fe5d80-9012-44fe-9b82-1e993211ddf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:38.852356 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-424f07aa-fc91-4ec2-9940-33a9e8e9e68e req-bc008649-3dde-47a1-8eac-67b8894e21a5 service nova] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] No waiting events found dispatching network-vif-plugged-29bf5645-d178-459e-b25f-1b1db9f87374 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:59:38.852356 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-424f07aa-fc91-4ec2-9940-33a9e8e9e68e req-bc008649-3dde-47a1-8eac-67b8894e21a5 service nova] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Received unexpected event network-vif-plugged-29bf5645-d178-459e-b25f-1b1db9f87374 for instance with vm_state building and task_state spawning.
May 21 01:59:38.854195 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 01:59:38.863963 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:38.863963 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 01:59:38.865145 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 01:59:38.868591 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Instance spawned successfully.
May 21 01:59:38.869525 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 01:59:38.872608 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Instance spawned successfully.
May 21 01:59:38.873061 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 01:59:38.903280 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 01:59:38.903959 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328778.9033813, 66fe5d80-9012-44fe-9b82-1e993211ddf1 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:59:38.904072 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] VM Started (Lifecycle Event)
May 21 01:59:38.950499 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Object Instance<a6839691-a7ec-4dea-bc39-a7e89c94cf4d> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 01:59:38.950499 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:58:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-715258350',display_name='tempest-TestMinimumBasicScenario-server-715258350',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testminimumbasicscenario-server-715258350',id=14,image_ref='a377f14f-f022-4902-8291-4e733e0a7be0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXVa1e4OFd0NMMgqm+4/xZwNI5dMebNPDeh14+7JZ91orpoik4qLtCbEUIRp2DSHHVcppNPspElPEIhYTAGUliS3RSE8t15WkhilyCcQF6xleusOu5YpLtoNfQpTRunwg==',key_name='tempest-TestMinimumBasicScenario-2026356756',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:58:47Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='dc797708a5a7400992765e41ee6ec260',ramdisk_id='',reservation_id='r-qn7g4mne',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a377f14f-f022-4902-8291-4e733e0a7be0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-654915677',owner_user_name='tempest-TestMinimumBasicScenario-654915677-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:59:28Z,user_data=None,user_id='44907638a40d4fb4ad9014b58dcd6bac',uuid=a6839691-a7ec-4dea-bc39-a7e89c94cf4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "address": "fa:16:3e:76:c8:70", "network": {"id": "7cdbc224-429f-49a6-86f3-307f51e53dfc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2078432126-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc797708a5a7400992765e41ee6ec260", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99a2cf4-26", "ovs_interfaceid": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 01:59:38.950499 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Converting VIF {"id": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "address": "fa:16:3e:76:c8:70", "network": {"id": "7cdbc224-429f-49a6-86f3-307f51e53dfc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2078432126-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc797708a5a7400992765e41ee6ec260", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99a2cf4-26", "ovs_interfaceid": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:59:38.950499 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:c8:70,bridge_name='br-int',has_traffic_filtering=True,id=d99a2cf4-260b-4ca3-b72e-7db23358b831,network=Network(7cdbc224-429f-49a6-86f3-307f51e53dfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99a2cf4-26') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:59:38.950499 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:c8:70,bridge_name='br-int',has_traffic_filtering=True,id=d99a2cf4-260b-4ca3-b72e-7db23358b831,network=Network(7cdbc224-429f-49a6-86f3-307f51e53dfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99a2cf4-26') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 01:59:38.954547 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:38.956489 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:38.956489 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 01:59:38.958321 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:38.958321 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '34f809f1-1dc2-5916-8c0a-12196e2c4c00', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:38.958831 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:38.959822 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:59:38.966231 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:38.971201 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:38.971433 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd99a2cf4-26, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:38.971894 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd99a2cf4-26, col_values=(('qos', UUID('ef53af13-20c6-4c2c-8bd1-5ba16207d956')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:38.972112 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd99a2cf4-26, col_values=(('external_ids', {'iface-id': 'd99a2cf4-260b-4ca3-b72e-7db23358b831', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:c8:70', 'vm-uuid': 'a6839691-a7ec-4dea-bc39-a7e89c94cf4d'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:38.974702 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:38.976440 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:59:38.996906 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:38.999286 np0000001127 nova-compute[98206]: INFO os_vif [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:c8:70,bridge_name='br-int',has_traffic_filtering=True,id=d99a2cf4-260b-4ca3-b72e-7db23358b831,network=Network(7cdbc224-429f-49a6-86f3-307f51e53dfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99a2cf4-26')
May 21 01:59:39.032955 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Updating instance_info_cache with network_info: [{"id": "20346b2b-b6d7-4a1a-a9fa-21aa6d702f17", "address": "fa:16:3e:b9:2c:dc", "network": {"id": "70208dc7-6706-4b4b-a35b-ad83c3826234", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1206266505-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73e8df58805f415fa39327f7f81e7852", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20346b2b-b6", "ovs_interfaceid": "20346b2b-b6d7-4a1a-a9fa-21aa6d702f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:59:39.069720 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:39.088558 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:39.168791 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-831e5f24-5d84-416c-8045-f3f0ce7220e9 req-27cf5f40-d1ce-48b8-abc9-cc454810bbb0 service nova] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Received event network-vif-plugged-3356c6b8-bf6b-43aa-bb09-491a7b40115f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:39.168971 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-831e5f24-5d84-416c-8045-f3f0ce7220e9 req-27cf5f40-d1ce-48b8-abc9-cc454810bbb0 service nova] Acquiring lock "6c48501b-d03d-40bc-aef5-450fa580bd69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:39.169126 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-831e5f24-5d84-416c-8045-f3f0ce7220e9 req-27cf5f40-d1ce-48b8-abc9-cc454810bbb0 service nova] Lock "6c48501b-d03d-40bc-aef5-450fa580bd69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:39.169269 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-831e5f24-5d84-416c-8045-f3f0ce7220e9 req-27cf5f40-d1ce-48b8-abc9-cc454810bbb0 service nova] Lock "6c48501b-d03d-40bc-aef5-450fa580bd69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:39.169435 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-831e5f24-5d84-416c-8045-f3f0ce7220e9 req-27cf5f40-d1ce-48b8-abc9-cc454810bbb0 service nova] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Processing event network-vif-plugged-3356c6b8-bf6b-43aa-bb09-491a7b40115f {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 01:59:39.379550 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:59:39.379692 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:59:39.380346 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:59:39.380346 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:59:39.380616 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:59:39.380884 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:59:39.397150 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:59:39.397401 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:59:39.397943 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:59:39.398366 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:59:39.398821 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:59:39.399136 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:59:39.407161 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:59:39.412570 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:59:39.517131 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Found WWN 330000000bf3e8ed7 for multipath device dm-10 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 01:59:39.517585 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.064s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:59:39.517851 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] <== connect_volume: return (4191ms) {'type': 'block', 'scsi_wwn': '330000000bf3e8ed7', 'path': '/dev/dm-10', 'multipath_id': '330000000bf3e8ed7'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:59:39.520891 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000bf3e8ed7', 'path': '/dev/dm-10', 'multipath_id': '330000000bf3e8ed7'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 01:59:39.525778 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lazy-loading 'flavor' on Instance uuid 800e7287-2ec0-48a2-b959-d7fbcc1f3c10 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:59:39.537383 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Releasing lock "refresh_cache-cb319b5a-9797-421c-ad9d-2fd9a1aaba38" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:59:39.537842 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Instance network_info: |[{"id": "20346b2b-b6d7-4a1a-a9fa-21aa6d702f17", "address": "fa:16:3e:b9:2c:dc", "network": {"id": "70208dc7-6706-4b4b-a35b-ad83c3826234", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1206266505-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73e8df58805f415fa39327f7f81e7852", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20346b2b-b6", "ovs_interfaceid": "20346b2b-b6d7-4a1a-a9fa-21aa6d702f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 01:59:39.541236 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Start _get_guest_xml network_info=[{"id": "20346b2b-b6d7-4a1a-a9fa-21aa6d702f17", "address": "fa:16:3e:b9:2c:dc", "network": {"id": "70208dc7-6706-4b4b-a35b-ad83c3826234", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1206266505-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73e8df58805f415fa39327f7f81e7852", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20346b2b-b6", "ovs_interfaceid": "20346b2b-b6d7-4a1a-a9fa-21aa6d702f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 01:59:39.544654 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 01:59:39.546432 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-DeleteServersTestJSON-server-1810733260', uuid='cb319b5a-9797-421c-ad9d-2fd9a1aaba38'), owner=OwnerMeta(userid='dc202b3265224b1186e34494436cb4b5', username='tempest-DeleteServersTestJSON-411161592-project-member', projectid='73e8df58805f415fa39327f7f81e7852', projectname='tempest-DeleteServersTestJSON-411161592'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "20346b2b-b6d7-4a1a-a9fa-21aa6d702f17", "address": "fa:16:3e:b9:2c:dc", "network": {"id": "70208dc7-6706-4b4b-a35b-ad83c3826234", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1206266505-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73e8df58805f415fa39327f7f81e7852", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20346b2b-b6", "ovs_interfaceid": "20346b2b-b6d7-4a1a-a9fa-21aa6d702f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328779.545935) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 01:59:39.547944 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 01:59:39.548367 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 01:59:39.549352 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 01:59:39.549556 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 01:59:39.550440 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 01:59:39.550765 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 01:59:39.550949 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 01:59:39.551067 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 01:59:39.551191 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 01:59:39.551283 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 01:59:39.551372 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 01:59:39.551531 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 01:59:39.551639 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 01:59:39.551773 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 01:59:39.551959 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 01:59:39.552137 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 01:59:39.571660 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T01:59:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1810733260',display_name='tempest-DeleteServersTestJSON-server-1810733260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-deleteserverstestjson-server-1810733260',id=21,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73e8df58805f415fa39327f7f81e7852',ramdisk_id='',reservation_id='r-uchth4ca',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-411161592',owner_user_name='tempest-DeleteServersTestJSON-411161592-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:59:36Z,user_data=None,user_id='dc202b3265224b1186e34494436cb4b5',uuid=cb319b5a-9797-421c-ad9d-2fd9a1aaba38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20346b2b-b6d7-4a1a-a9fa-21aa6d702f17", "address": "fa:16:3e:b9:2c:dc", "network": {"id": "70208dc7-6706-4b4b-a35b-ad83c3826234", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1206266505-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73e8df58805f415fa39327f7f81e7852", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20346b2b-b6", "ovs_interfaceid": "20346b2b-b6d7-4a1a-a9fa-21aa6d702f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 01:59:39.571926 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Converting VIF {"id": "20346b2b-b6d7-4a1a-a9fa-21aa6d702f17", "address": "fa:16:3e:b9:2c:dc", "network": {"id": "70208dc7-6706-4b4b-a35b-ad83c3826234", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1206266505-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73e8df58805f415fa39327f7f81e7852", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20346b2b-b6", "ovs_interfaceid": "20346b2b-b6d7-4a1a-a9fa-21aa6d702f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:59:39.572391 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:2c:dc,bridge_name='br-int',has_traffic_filtering=True,id=20346b2b-b6d7-4a1a-a9fa-21aa6d702f17,network=Network(70208dc7-6706-4b4b-a35b-ad83c3826234),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20346b2b-b6') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:59:39.574209 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Lazy-loading 'pci_devices' on Instance uuid cb319b5a-9797-421c-ad9d-2fd9a1aaba38 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:59:39.595248 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:39.640539 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:39.761841 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:39.893780 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Took 10.67 seconds to spawn the instance on the hypervisor.
May 21 01:59:39.894241 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:59:39.907040 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Took 9.33 seconds to spawn the instance on the hypervisor.
May 21 01:59:39.919933 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:59:39.922012 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 01:59:39.923864 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328779.9223163, 66fe5d80-9012-44fe-9b82-1e993211ddf1 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:59:39.923864 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] VM Paused (Lifecycle Event)
May 21 01:59:40.034494 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Attempting to attach volume 61d544f9-87fe-4afb-9cf7-04dec39c92a1 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 01:59:40.035708 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] attach device xml: <disk type="block" device="disk">
May 21 01:59:40.035708 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:59:40.035708 np0000001127 nova-compute[98206]:   <alias name="ua-61d544f9-87fe-4afb-9cf7-04dec39c92a1"/>
May 21 01:59:40.035708 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-10"/>
May 21 01:59:40.035708 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 01:59:40.035708 np0000001127 nova-compute[98206]:   <serial>61d544f9-87fe-4afb-9cf7-04dec39c92a1</serial>
May 21 01:59:40.035708 np0000001127 nova-compute[98206]: </disk>
May 21 01:59:40.035708 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 01:59:40.080624 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] End _get_guest_xml xml=<domain type="qemu">
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:   <uuid>cb319b5a-9797-421c-ad9d-2fd9a1aaba38</uuid>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:   <name>instance-00000015</name>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:   <metadata>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:       <nova:name>tempest-DeleteServersTestJSON-server-1810733260</nova:name>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 01:59:39</nova:creationTime>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:       </nova:image>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:         <nova:user uuid="dc202b3265224b1186e34494436cb4b5">tempest-DeleteServersTestJSON-411161592-project-member</nova:user>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:         <nova:project uuid="73e8df58805f415fa39327f7f81e7852">tempest-DeleteServersTestJSON-411161592</nova:project>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:         <nova:port uuid="20346b2b-b6d7-4a1a-a9fa-21aa6d702f17">
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:         </nova:port>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:   </metadata>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:     <system>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:       <entry name="serial">cb319b5a-9797-421c-ad9d-2fd9a1aaba38</entry>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:       <entry name="uuid">cb319b5a-9797-421c-ad9d-2fd9a1aaba38</entry>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:     </system>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:   <os>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:   </os>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:   <features>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:     <acpi/>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:     <tcg>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:     </tcg>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:   </features>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:   </cpu>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:   <devices>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/cb319b5a-9797-421c-ad9d-2fd9a1aaba38/disk"/>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:     </disk>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/cb319b5a-9797-421c-ad9d-2fd9a1aaba38/disk.config"/>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:     </disk>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:b9:2c:dc"/>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:       <target dev="tap20346b2b-b6"/>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:     </interface>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/cb319b5a-9797-421c-ad9d-2fd9a1aaba38/console.log" append="off"/>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:     </serial>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:     <video>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:     </video>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:     </rng>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:     </memballoon>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:   </devices>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]: </domain>
May 21 01:59:40.080624 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 01:59:40.084217 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Preparing to wait for external event network-vif-plugged-20346b2b-b6d7-4a1a-a9fa-21aa6d702f17 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 01:59:40.084217 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Acquiring lock "cb319b5a-9797-421c-ad9d-2fd9a1aaba38-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:40.084217 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Lock "cb319b5a-9797-421c-ad9d-2fd9a1aaba38-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:40.084217 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Lock "cb319b5a-9797-421c-ad9d-2fd9a1aaba38-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:40.085392 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T01:59:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1810733260',display_name='tempest-DeleteServersTestJSON-server-1810733260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-deleteserverstestjson-server-1810733260',id=21,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73e8df58805f415fa39327f7f81e7852',ramdisk_id='',reservation_id='r-uchth4ca',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-411161592',owner_user_name='tempest-DeleteServersTestJSON-411161592-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:59:36Z,user_data=None,user_id='dc202b3265224b1186e34494436cb4b5',uuid=cb319b5a-9797-421c-ad9d-2fd9a1aaba38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20346b2b-b6d7-4a1a-a9fa-21aa6d702f17", "address": "fa:16:3e:b9:2c:dc", "network": {"id": "70208dc7-6706-4b4b-a35b-ad83c3826234", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1206266505-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73e8df58805f415fa39327f7f81e7852", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20346b2b-b6", "ovs_interfaceid": "20346b2b-b6d7-4a1a-a9fa-21aa6d702f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 01:59:40.085392 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Converting VIF {"id": "20346b2b-b6d7-4a1a-a9fa-21aa6d702f17", "address": "fa:16:3e:b9:2c:dc", "network": {"id": "70208dc7-6706-4b4b-a35b-ad83c3826234", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1206266505-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73e8df58805f415fa39327f7f81e7852", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20346b2b-b6", "ovs_interfaceid": "20346b2b-b6d7-4a1a-a9fa-21aa6d702f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:59:40.088738 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:2c:dc,bridge_name='br-int',has_traffic_filtering=True,id=20346b2b-b6d7-4a1a-a9fa-21aa6d702f17,network=Network(70208dc7-6706-4b4b-a35b-ad83c3826234),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20346b2b-b6') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:59:40.089064 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:2c:dc,bridge_name='br-int',has_traffic_filtering=True,id=20346b2b-b6d7-4a1a-a9fa-21aa6d702f17,network=Network(70208dc7-6706-4b4b-a35b-ad83c3826234),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20346b2b-b6') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 01:59:40.089490 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:40.089847 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:40.090102 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 01:59:40.092451 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:40.092451 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '881f6a00-2d04-5951-836c-9617856f009c', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:40.094020 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:40.095523 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:59:40.101806 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:40.107612 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:40.108002 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap20346b2b-b6, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:40.108364 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap20346b2b-b6, col_values=(('qos', UUID('87a0c527-5b08-4734-88d2-0587de87abe2')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:40.108723 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap20346b2b-b6, col_values=(('external_ids', {'iface-id': '20346b2b-b6d7-4a1a-a9fa-21aa6d702f17', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:2c:dc', 'vm-uuid': 'cb319b5a-9797-421c-ad9d-2fd9a1aaba38'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:40.121667 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:40.128639 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:59:40.166632 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:40.170168 np0000001127 nova-compute[98206]: INFO os_vif [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:2c:dc,bridge_name='br-int',has_traffic_filtering=True,id=20346b2b-b6d7-4a1a-a9fa-21aa6d702f17,network=Network(70208dc7-6706-4b4b-a35b-ad83c3826234),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20346b2b-b6')
May 21 01:59:40.176810 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 01:59:40.188507 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 01:59:40.194570 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Instance spawned successfully.
May 21 01:59:40.195326 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 01:59:40.424746 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Took 18.20 seconds to build instance.
May 21 01:59:40.432572 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:59:40.438920 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328780.4385598, 07596a09-d614-48c6-849f-a306f65c7a5c => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:59:40.439110 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] VM Resumed (Lifecycle Event)
May 21 01:59:40.443613 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Took 15.25 seconds to build instance.
May 21 01:59:40.547312 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-518549b5-7c74-409f-ac47-57cac9ce230d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Snapshot image upload complete
May 21 01:59:40.547658 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-518549b5-7c74-409f-ac47-57cac9ce230d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:59:40.703795 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:59:40.703795 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:59:40.704250 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:59:40.704461 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:59:40.704747 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:59:40.706575 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:59:40.813674 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Instance event wait completed in 0 seconds for  {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 01:59:40.815536 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Instance rebooted successfully.
May 21 01:59:40.926616 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-354bdcef-0b0f-4f6a-9fe2-b90fd2dcf8bc tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "66fe5d80-9012-44fe-9b82-1e993211ddf1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.721s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:40.933396 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-792cfdd3-9b3e-4601-bd29-734c7e46f266 req-999e128f-e562-45bc-9d24-6519e45b66df service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Received event network-vif-plugged-d99a2cf4-260b-4ca3-b72e-7db23358b831 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:40.933396 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-792cfdd3-9b3e-4601-bd29-734c7e46f266 req-999e128f-e562-45bc-9d24-6519e45b66df service nova] Acquiring lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:40.933396 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-792cfdd3-9b3e-4601-bd29-734c7e46f266 req-999e128f-e562-45bc-9d24-6519e45b66df service nova] Lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:40.933396 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-792cfdd3-9b3e-4601-bd29-734c7e46f266 req-999e128f-e562-45bc-9d24-6519e45b66df service nova] Lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:40.933396 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-792cfdd3-9b3e-4601-bd29-734c7e46f266 req-999e128f-e562-45bc-9d24-6519e45b66df service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] No waiting events found dispatching network-vif-plugged-d99a2cf4-260b-4ca3-b72e-7db23358b831 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:59:40.933396 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-792cfdd3-9b3e-4601-bd29-734c7e46f266 req-999e128f-e562-45bc-9d24-6519e45b66df service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Received unexpected event network-vif-plugged-d99a2cf4-260b-4ca3-b72e-7db23358b831 for instance with vm_state active and task_state reboot_started_hard.
May 21 01:59:40.934502 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-792cfdd3-9b3e-4601-bd29-734c7e46f266 req-999e128f-e562-45bc-9d24-6519e45b66df service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Received event network-vif-plugged-d99a2cf4-260b-4ca3-b72e-7db23358b831 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:40.934959 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-792cfdd3-9b3e-4601-bd29-734c7e46f266 req-999e128f-e562-45bc-9d24-6519e45b66df service nova] Acquiring lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:40.936142 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-792cfdd3-9b3e-4601-bd29-734c7e46f266 req-999e128f-e562-45bc-9d24-6519e45b66df service nova] Lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:40.936142 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-792cfdd3-9b3e-4601-bd29-734c7e46f266 req-999e128f-e562-45bc-9d24-6519e45b66df service nova] Lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:40.936142 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-792cfdd3-9b3e-4601-bd29-734c7e46f266 req-999e128f-e562-45bc-9d24-6519e45b66df service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] No waiting events found dispatching network-vif-plugged-d99a2cf4-260b-4ca3-b72e-7db23358b831 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:59:40.936142 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-792cfdd3-9b3e-4601-bd29-734c7e46f266 req-999e128f-e562-45bc-9d24-6519e45b66df service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Received unexpected event network-vif-plugged-d99a2cf4-260b-4ca3-b72e-7db23358b831 for instance with vm_state active and task_state reboot_started_hard.
May 21 01:59:40.943676 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:59:40.945625 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:59:40.951004 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ccd5639a-cf5c-4403-a74c-c6e72aef2166 tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Lock "07596a09-d614-48c6-849f-a306f65c7a5c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.769s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:41.059323 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-518549b5-7c74-409f-ac47-57cac9ce230d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Shelve offloading
May 21 01:59:41.211879 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Took 7.85 seconds to spawn the instance on the hypervisor.
May 21 01:59:41.212106 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:59:41.249376 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:41.286368 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cbfdcd3c-c063-4ae6-871e-aeaadc0e689c req-80f3ad48-98b3-4960-88f5-8413d3feee38 service nova] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Received event network-vif-plugged-3356c6b8-bf6b-43aa-bb09-491a7b40115f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:41.288351 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cbfdcd3c-c063-4ae6-871e-aeaadc0e689c req-80f3ad48-98b3-4960-88f5-8413d3feee38 service nova] Acquiring lock "6c48501b-d03d-40bc-aef5-450fa580bd69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:41.289147 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cbfdcd3c-c063-4ae6-871e-aeaadc0e689c req-80f3ad48-98b3-4960-88f5-8413d3feee38 service nova] Lock "6c48501b-d03d-40bc-aef5-450fa580bd69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:41.289147 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cbfdcd3c-c063-4ae6-871e-aeaadc0e689c req-80f3ad48-98b3-4960-88f5-8413d3feee38 service nova] Lock "6c48501b-d03d-40bc-aef5-450fa580bd69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:41.289536 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cbfdcd3c-c063-4ae6-871e-aeaadc0e689c req-80f3ad48-98b3-4960-88f5-8413d3feee38 service nova] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] No waiting events found dispatching network-vif-plugged-3356c6b8-bf6b-43aa-bb09-491a7b40115f {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:59:41.289773 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-cbfdcd3c-c063-4ae6-871e-aeaadc0e689c req-80f3ad48-98b3-4960-88f5-8413d3feee38 service nova] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Received unexpected event network-vif-plugged-3356c6b8-bf6b-43aa-bb09-491a7b40115f for instance with vm_state active and task_state None.
May 21 01:59:41.450354 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328781.4499073, 66fe5d80-9012-44fe-9b82-1e993211ddf1 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:59:41.450534 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] VM Resumed (Lifecycle Event)
May 21 01:59:41.569736 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Instance destroyed successfully.
May 21 01:59:41.571241 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-518549b5-7c74-409f-ac47-57cac9ce230d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:59:41.573907 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-518549b5-7c74-409f-ac47-57cac9ce230d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "refresh_cache-64f1cde4-f11a-4da7-8bbc-aaf777432069" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:59:41.574126 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-518549b5-7c74-409f-ac47-57cac9ce230d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquired lock "refresh_cache-64f1cde4-f11a-4da7-8bbc-aaf777432069" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:59:41.574363 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-518549b5-7c74-409f-ac47-57cac9ce230d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 01:59:41.697703 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:59:41.697890 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:59:41.698071 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] No VIF found with MAC fa:16:3e:b9:2c:dc, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 01:59:41.698559 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Using config drive
May 21 01:59:41.723848 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Took 16.30 seconds to build instance.
May 21 01:59:41.769218 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:59:41.769631 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:59:41.769631 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:59:41.769631 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] No VIF found with MAC fa:16:3e:af:51:f1, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 01:59:41.956534 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:59:41.958108 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:59:42.053333 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-07672df1-6db8-42b1-871d-50259273ea46 req-7044e276-e133-4d4a-9479-e3e43d53be8e service nova] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Received event network-changed-8b22719a-06e5-4d47-9e5c-66aa0c497f52 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:42.053502 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-07672df1-6db8-42b1-871d-50259273ea46 req-7044e276-e133-4d4a-9479-e3e43d53be8e service nova] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Refreshing instance network info cache due to event network-changed-8b22719a-06e5-4d47-9e5c-66aa0c497f52. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:59:42.053661 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-07672df1-6db8-42b1-871d-50259273ea46 req-7044e276-e133-4d4a-9479-e3e43d53be8e service nova] Acquiring lock "refresh_cache-29a124ee-2b8c-4f44-8f91-8dd11ac78b52" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:59:42.054120 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-07672df1-6db8-42b1-871d-50259273ea46 req-7044e276-e133-4d4a-9479-e3e43d53be8e service nova] Acquired lock "refresh_cache-29a124ee-2b8c-4f44-8f91-8dd11ac78b52" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:59:42.054120 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-07672df1-6db8-42b1-871d-50259273ea46 req-7044e276-e133-4d4a-9479-e3e43d53be8e service nova] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Refreshing network info cache for port 8b22719a-06e5-4d47-9e5c-66aa0c497f52 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:59:42.079219 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-518549b5-7c74-409f-ac47-57cac9ce230d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:42.205857 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:42.226495 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "6c48501b-d03d-40bc-aef5-450fa580bd69" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.806s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:42.327501 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:59:42.330101 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:59:42.330411 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:59:42.330563 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] No VIF found with MAC fa:16:3e:76:c8:70, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 01:59:42.331084 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:59:42.401893 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Creating config drive at /opt/stack/data/nova/instances/cb319b5a-9797-421c-ad9d-2fd9a1aaba38/disk.config
May 21 01:59:42.414131 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cb319b5a-9797-421c-ad9d-2fd9a1aaba38/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdf141nzq {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:42.466822 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328782.4641507, 6c48501b-d03d-40bc-aef5-450fa580bd69 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:59:42.466822 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] VM Started (Lifecycle Event)
May 21 01:59:42.478438 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cb319b5a-9797-421c-ad9d-2fd9a1aaba38/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdf141nzq" returned: 0 in 0.065s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:42.521231 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-518549b5-7c74-409f-ac47-57cac9ce230d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:42.556492 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-07672df1-6db8-42b1-871d-50259273ea46 req-7044e276-e133-4d4a-9479-e3e43d53be8e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:42.774124 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-518549b5-7c74-409f-ac47-57cac9ce230d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Updating instance_info_cache with network_info: [{"id": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "address": "fa:16:3e:12:66:8e", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1f76f9-cf", "ovs_interfaceid": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:59:42.847729 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-372904e2-0c63-43ab-aff8-a6f7ac30324e tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 17.653s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:42.969533 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:59:42.975384 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:59:43.064502 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-07672df1-6db8-42b1-871d-50259273ea46 req-7044e276-e133-4d4a-9479-e3e43d53be8e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:43.081341 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:43.123636 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:43.281671 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:43.293605 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-518549b5-7c74-409f-ac47-57cac9ce230d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Releasing lock "refresh_cache-64f1cde4-f11a-4da7-8bbc-aaf777432069" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:59:43.293605 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-518549b5-7c74-409f-ac47-57cac9ce230d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:43.294157 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-518549b5-7c74-409f-ac47-57cac9ce230d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:43.307519 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-07672df1-6db8-42b1-871d-50259273ea46 req-7044e276-e133-4d4a-9479-e3e43d53be8e service nova] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Updated VIF entry in instance network info cache for port 8b22719a-06e5-4d47-9e5c-66aa0c497f52. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 01:59:43.307743 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-07672df1-6db8-42b1-871d-50259273ea46 req-7044e276-e133-4d4a-9479-e3e43d53be8e service nova] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Updating instance_info_cache with network_info: [{"id": "8b22719a-06e5-4d47-9e5c-66aa0c497f52", "address": "fa:16:3e:9e:02:16", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b22719a-06", "ovs_interfaceid": "8b22719a-06e5-4d47-9e5c-66aa0c497f52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:59:43.385920 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-58264013-ed02-402e-b92e-463d9ee708fe tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "800e7287-2ec0-48a2-b959-d7fbcc1f3c10" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.798s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:43.416629 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a965b22f-a1d6-47f9-8be4-705aea36f571 req-c4354c21-356e-40a2-8bbd-f8471adde1bf service nova] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Received event network-vif-plugged-20346b2b-b6d7-4a1a-a9fa-21aa6d702f17 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:43.424702 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a965b22f-a1d6-47f9-8be4-705aea36f571 req-c4354c21-356e-40a2-8bbd-f8471adde1bf service nova] Acquiring lock "cb319b5a-9797-421c-ad9d-2fd9a1aaba38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:43.424702 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a965b22f-a1d6-47f9-8be4-705aea36f571 req-c4354c21-356e-40a2-8bbd-f8471adde1bf service nova] Lock "cb319b5a-9797-421c-ad9d-2fd9a1aaba38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:43.424702 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a965b22f-a1d6-47f9-8be4-705aea36f571 req-c4354c21-356e-40a2-8bbd-f8471adde1bf service nova] Lock "cb319b5a-9797-421c-ad9d-2fd9a1aaba38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:43.424702 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a965b22f-a1d6-47f9-8be4-705aea36f571 req-c4354c21-356e-40a2-8bbd-f8471adde1bf service nova] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Processing event network-vif-plugged-20346b2b-b6d7-4a1a-a9fa-21aa6d702f17 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 01:59:43.492584 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328783.492259, 6c48501b-d03d-40bc-aef5-450fa580bd69 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:59:43.492734 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] VM Paused (Lifecycle Event)
May 21 01:59:43.555878 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:43.569277 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:43.578018 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:43.603865 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:43.617005 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:43.677421 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:59:43.678500 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:59:43.678695 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 21 01:59:43.681294 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:59:43.811800 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-07672df1-6db8-42b1-871d-50259273ea46 req-7044e276-e133-4d4a-9479-e3e43d53be8e service nova] Releasing lock "refresh_cache-29a124ee-2b8c-4f44-8f91-8dd11ac78b52" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:59:43.995381 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:59:44.001022 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328784.000735, 6c48501b-d03d-40bc-aef5-450fa580bd69 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:59:44.001178 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] VM Resumed (Lifecycle Event)
May 21 01:59:44.056005 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Instance destroyed successfully.
May 21 01:59:44.056607 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-518549b5-7c74-409f-ac47-57cac9ce230d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lazy-loading 'resources' on Instance uuid 64f1cde4-f11a-4da7-8bbc-aaf777432069 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:59:44.116158 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-b0e526d0-5837-4726-92f4-b70b95861f7c tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:59:44.130366 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-231990d2-d133-450d-9cfd-f0f06dce8fbd req-76c4f447-becf-4e64-8de1-65a615a01cc4 service nova] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Received event network-changed-29bf5645-d178-459e-b25f-1b1db9f87374 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:44.130366 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-231990d2-d133-450d-9cfd-f0f06dce8fbd req-76c4f447-becf-4e64-8de1-65a615a01cc4 service nova] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Refreshing instance network info cache due to event network-changed-29bf5645-d178-459e-b25f-1b1db9f87374. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:59:44.132110 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-231990d2-d133-450d-9cfd-f0f06dce8fbd req-76c4f447-becf-4e64-8de1-65a615a01cc4 service nova] Acquiring lock "refresh_cache-66fe5d80-9012-44fe-9b82-1e993211ddf1" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:59:44.132818 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-231990d2-d133-450d-9cfd-f0f06dce8fbd req-76c4f447-becf-4e64-8de1-65a615a01cc4 service nova] Acquired lock "refresh_cache-66fe5d80-9012-44fe-9b82-1e993211ddf1" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:59:44.132818 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-231990d2-d133-450d-9cfd-f0f06dce8fbd req-76c4f447-becf-4e64-8de1-65a615a01cc4 service nova] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Refreshing network info cache for port 29bf5645-d178-459e-b25f-1b1db9f87374 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:59:44.194516 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:44.194800 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:44.194970 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:44.195156 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Auditing locally available compute resources for np0000001127 (node: np0000001127) {{(pid=98206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 21 01:59:44.314821 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 01:59:44.316944 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 01:59:44.319096 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Instance spawned successfully.
May 21 01:59:44.319514 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 01:59:44.360697 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Stashing vm_state: active {{(pid=98206) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 21 01:59:44.444387 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.00044581200018001255 future=<Future at 0x71c0586a84a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:59:44.444567 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:59:44.444657 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=4.816572742000062 future=<Future at 0x71c0585ece30 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:59:44.444711 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=4.816463960999954 future=<Future at 0x71c0585ece30 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:59:44.445400 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Emitting event <LifecycleEvent: 1779328769.4437048, a6839691-a7ec-4dea-bc39-a7e89c94cf4d => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:59:44.445614 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] VM Stopped (Lifecycle Event)
May 21 01:59:44.504120 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:59:44.506177 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: image_snapshot, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:59:44.559332 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-518549b5-7c74-409f-ac47-57cac9ce230d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Object Instance<64f1cde4-f11a-4da7-8bbc-aaf777432069> lazy-loaded attributes: numa_topology,resources {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 01:59:44.560052 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-518549b5-7c74-409f-ac47-57cac9ce230d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:58:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-826846662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumeshelvetestjson-server-826846662',id=16,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKP9TmPgal987nAj8h88D1Bmcj2I422T9n2Tj8WjCd1Om2bcKH0baNEdUw3HbpQOVs38hbin/FqToAhhAhLP26z0i0oQr4Z8Ka0Fy18AshY/UNiFwP9hn8pglGsErkHX4w==',key_name='tempest-keypair-1059394299',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:58:51Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2e41dd931ff049868a61f52a251d1122',ramdisk_id='',reservation_id='r-fbiukq5r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-826866539',owner_user_name='tempest-AttachVolumeShelveTestJSON-826866539-project-member',shelved_at='2026-05-21T01:59:40.547321',shelved_host='np0000001127',shelved_image_id='ac3ea09d-f213-4275-8c8d-1d15ec8aaeb5'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:59:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d91dda570ffb45489f81bd0c87e7fda6',uuid=64f1cde4-f11a-4da7-8bbc-aaf777432069,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "address": "fa:16:3e:12:66:8e", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1f76f9-cf", "ovs_interfaceid": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 01:59:44.560264 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-518549b5-7c74-409f-ac47-57cac9ce230d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Converting VIF {"id": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "address": "fa:16:3e:12:66:8e", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1f76f9-cf", "ovs_interfaceid": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:59:44.560885 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-518549b5-7c74-409f-ac47-57cac9ce230d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:66:8e,bridge_name='br-int',has_traffic_filtering=True,id=3b1f76f9-cf49-4dea-b9a2-762c2ad220bf,network=Network(084a1218-5c9f-4f1e-855b-53d284a5202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b1f76f9-cf') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:59:44.561308 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-518549b5-7c74-409f-ac47-57cac9ce230d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:66:8e,bridge_name='br-int',has_traffic_filtering=True,id=3b1f76f9-cf49-4dea-b9a2-762c2ad220bf,network=Network(084a1218-5c9f-4f1e-855b-53d284a5202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b1f76f9-cf') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 01:59:44.563235 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:44.563582 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b1f76f9-cf, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:44.565164 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:44.566050 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:59:44.568686 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:44.570483 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:44.570483 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=70cb1497-9eab-43ff-a98d-b3d134b69a7b) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:44.572428 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:44.573481 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:59:44.575576 np0000001127 nova-compute[98206]: INFO os_vif [None req-518549b5-7c74-409f-ac47-57cac9ce230d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:66:8e,bridge_name='br-int',has_traffic_filtering=True,id=3b1f76f9-cf49-4dea-b9a2-762c2ad220bf,network=Network(084a1218-5c9f-4f1e-855b-53d284a5202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b1f76f9-cf')
May 21 01:59:44.575917 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-518549b5-7c74-409f-ac47-57cac9ce230d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Deleting instance files /opt/stack/data/nova/instances/64f1cde4-f11a-4da7-8bbc-aaf777432069_del
May 21 01:59:44.581161 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-518549b5-7c74-409f-ac47-57cac9ce230d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Deletion of /opt/stack/data/nova/instances/64f1cde4-f11a-4da7-8bbc-aaf777432069_del complete
May 21 01:59:44.635395 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-231990d2-d133-450d-9cfd-f0f06dce8fbd req-76c4f447-becf-4e64-8de1-65a615a01cc4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:44.645223 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-b0e526d0-5837-4726-92f4-b70b95861f7c tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] instance snapshotting
May 21 01:59:44.814530 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-b0e526d0-5837-4726-92f4-b70b95861f7c tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Beginning live snapshot process
May 21 01:59:44.828086 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:59:44.828086 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:59:44.829016 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:59:44.832548 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:59:44.832548 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:59:44.832548 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 01:59:44.950521 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:44.950521 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:44.951628 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:59:45.008499 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] During sync_power_state the instance has a pending task (image_snapshot). Skip.
May 21 01:59:45.009042 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328785.0085988, a6839691-a7ec-4dea-bc39-a7e89c94cf4d => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:59:45.009042 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] VM Resumed (Lifecycle Event)
May 21 01:59:45.161597 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-231990d2-d133-450d-9cfd-f0f06dce8fbd req-76c4f447-becf-4e64-8de1-65a615a01cc4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:45.184982 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-518549b5-7c74-409f-ac47-57cac9ce230d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Deleted allocations for instance 64f1cde4-f11a-4da7-8bbc-aaf777432069
May 21 01:59:45.257717 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:45.338290 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Took 7.91 seconds to spawn the instance on the hypervisor.
May 21 01:59:45.341866 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:59:45.389715 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:45.393490 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:45.424189 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-231990d2-d133-450d-9cfd-f0f06dce8fbd req-76c4f447-becf-4e64-8de1-65a615a01cc4 service nova] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Updated VIF entry in instance network info cache for port 29bf5645-d178-459e-b25f-1b1db9f87374. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 01:59:45.425246 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-231990d2-d133-450d-9cfd-f0f06dce8fbd req-76c4f447-becf-4e64-8de1-65a615a01cc4 service nova] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Updating instance_info_cache with network_info: [{"id": "29bf5645-d178-459e-b25f-1b1db9f87374", "address": "fa:16:3e:45:a2:37", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bf5645-d1", "ovs_interfaceid": "29bf5645-d178-459e-b25f-1b1db9f87374", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:59:45.468600 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 01:59:45.468600 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Claim successful on node np0000001127
May 21 01:59:45.514272 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:59:45.523062 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-026c9b4a-a1ff-4270-9e69-0d6be33cb584 req-90adb761-8578-4ac6-a8f1-2d0eafcffc58 service nova] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Received event network-vif-plugged-20346b2b-b6d7-4a1a-a9fa-21aa6d702f17 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:45.523567 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-026c9b4a-a1ff-4270-9e69-0d6be33cb584 req-90adb761-8578-4ac6-a8f1-2d0eafcffc58 service nova] Acquiring lock "cb319b5a-9797-421c-ad9d-2fd9a1aaba38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:45.523909 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-026c9b4a-a1ff-4270-9e69-0d6be33cb584 req-90adb761-8578-4ac6-a8f1-2d0eafcffc58 service nova] Lock "cb319b5a-9797-421c-ad9d-2fd9a1aaba38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:45.524090 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-026c9b4a-a1ff-4270-9e69-0d6be33cb584 req-90adb761-8578-4ac6-a8f1-2d0eafcffc58 service nova] Lock "cb319b5a-9797-421c-ad9d-2fd9a1aaba38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:45.524349 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-026c9b4a-a1ff-4270-9e69-0d6be33cb584 req-90adb761-8578-4ac6-a8f1-2d0eafcffc58 service nova] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] No waiting events found dispatching network-vif-plugged-20346b2b-b6d7-4a1a-a9fa-21aa6d702f17 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:59:45.524492 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-026c9b4a-a1ff-4270-9e69-0d6be33cb584 req-90adb761-8578-4ac6-a8f1-2d0eafcffc58 service nova] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Received unexpected event network-vif-plugged-20346b2b-b6d7-4a1a-a9fa-21aa6d702f17 for instance with vm_state active and task_state None.
May 21 01:59:45.525835 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:59:45.543189 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:45.549075 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 01:59:45.552508 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 01:59:45.560440 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 01:59:45.560987 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-7 (vdb) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 01:59:45.560987 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-2 (vdc) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 01:59:45.563321 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07596a09-d614-48c6-849f-a306f65c7a5c/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:45.678051 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07596a09-d614-48c6-849f-a306f65c7a5c/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:45.678662 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07596a09-d614-48c6-849f-a306f65c7a5c/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:45.695782 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-518549b5-7c74-409f-ac47-57cac9ce230d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:45.781791 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07596a09-d614-48c6-849f-a306f65c7a5c/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:45.785853 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c48501b-d03d-40bc-aef5-450fa580bd69/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:45.858917 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Took 13.89 seconds to build instance.
May 21 01:59:45.890902 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c48501b-d03d-40bc-aef5-450fa580bd69/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:45.891519 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c48501b-d03d-40bc-aef5-450fa580bd69/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:45.930638 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-231990d2-d133-450d-9cfd-f0f06dce8fbd req-76c4f447-becf-4e64-8de1-65a615a01cc4 service nova] Releasing lock "refresh_cache-66fe5d80-9012-44fe-9b82-1e993211ddf1" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:59:45.931274 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-231990d2-d133-450d-9cfd-f0f06dce8fbd req-76c4f447-becf-4e64-8de1-65a615a01cc4 service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Received event network-changed-3b1f76f9-cf49-4dea-b9a2-762c2ad220bf {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:45.931555 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-231990d2-d133-450d-9cfd-f0f06dce8fbd req-76c4f447-becf-4e64-8de1-65a615a01cc4 service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Refreshing instance network info cache due to event network-changed-3b1f76f9-cf49-4dea-b9a2-762c2ad220bf. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:59:45.931938 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-231990d2-d133-450d-9cfd-f0f06dce8fbd req-76c4f447-becf-4e64-8de1-65a615a01cc4 service nova] Acquiring lock "refresh_cache-64f1cde4-f11a-4da7-8bbc-aaf777432069" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:59:45.932087 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-231990d2-d133-450d-9cfd-f0f06dce8fbd req-76c4f447-becf-4e64-8de1-65a615a01cc4 service nova] Acquired lock "refresh_cache-64f1cde4-f11a-4da7-8bbc-aaf777432069" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:59:45.932315 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-231990d2-d133-450d-9cfd-f0f06dce8fbd req-76c4f447-becf-4e64-8de1-65a615a01cc4 service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Refreshing network info cache for port 3b1f76f9-cf49-4dea-b9a2-762c2ad220bf {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 01:59:45.984568 np0000001127 nova-compute[98206]: INFO nova.compute.resource_tracker [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Updating resource usage from migration d91cd6ac-36a6-4061-bb3d-b315e844b573
May 21 01:59:46.001280 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c48501b-d03d-40bc-aef5-450fa580bd69/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:46.004489 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb319b5a-9797-421c-ad9d-2fd9a1aaba38/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:46.033248 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328786.0313036, a6839691-a7ec-4dea-bc39-a7e89c94cf4d => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:59:46.040108 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] VM Started (Lifecycle Event)
May 21 01:59:46.103993 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb319b5a-9797-421c-ad9d-2fd9a1aaba38/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:46.105497 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb319b5a-9797-421c-ad9d-2fd9a1aaba38/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:46.193573 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb319b5a-9797-421c-ad9d-2fd9a1aaba38/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:46.199862 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/800e7287-2ec0-48a2-b959-d7fbcc1f3c10/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:46.254611 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:46.302242 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/800e7287-2ec0-48a2-b959-d7fbcc1f3c10/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:46.302834 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/800e7287-2ec0-48a2-b959-d7fbcc1f3c10/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:46.349952 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-b0e526d0-5837-4726-92f4-b70b95861f7c tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c48501b-d03d-40bc-aef5-450fa580bd69/disk --force-share --output=json -f qcow2 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:46.370657 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Lock "cb319b5a-9797-421c-ad9d-2fd9a1aaba38" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.414s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:46.437519 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-231990d2-d133-450d-9cfd-f0f06dce8fbd req-76c4f447-becf-4e64-8de1-65a615a01cc4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:46.444283 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/800e7287-2ec0-48a2-b959-d7fbcc1f3c10/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:46.445222 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-10 (vdb) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 01:59:46.450625 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d75ff65-b688-4387-89e3-70567e569682/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:46.514053 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-b0e526d0-5837-4726-92f4-b70b95861f7c tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c48501b-d03d-40bc-aef5-450fa580bd69/disk --force-share --output=json -f qcow2" returned: 0 in 0.164s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:46.514931 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-b0e526d0-5837-4726-92f4-b70b95861f7c tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c48501b-d03d-40bc-aef5-450fa580bd69/disk --force-share --output=json -f qcow2 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:46.558360 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:59:46.562239 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d75ff65-b688-4387-89e3-70567e569682/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:46.563400 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d75ff65-b688-4387-89e3-70567e569682/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:46.601926 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:59:46.653483 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-b0e526d0-5837-4726-92f4-b70b95861f7c tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c48501b-d03d-40bc-aef5-450fa580bd69/disk --force-share --output=json -f qcow2" returned: 0 in 0.138s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:46.654316 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-b0e526d0-5837-4726-92f4-b70b95861f7c tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:59:46.665600 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-b0e526d0-5837-4726-92f4-b70b95861f7c tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 01:59:46.666540 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-b0e526d0-5837-4726-92f4-b70b95861f7c tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:46.701084 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d75ff65-b688-4387-89e3-70567e569682/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:46.716846 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:46.817067 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-b0e526d0-5837-4726-92f4-b70b95861f7c tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.150s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:46.817246 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-b0e526d0-5837-4726-92f4-b70b95861f7c tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpy90dhbv9/d30ecf7d406240fdb3d282eed5563756.delta 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:46.867881 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:46.868437 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:46.903783 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-b0e526d0-5837-4726-92f4-b70b95861f7c tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpy90dhbv9/d30ecf7d406240fdb3d282eed5563756.delta 1073741824" returned: 0 in 0.085s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:46.905945 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-b0e526d0-5837-4726-92f4-b70b95861f7c tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Quiescing instance not available: QEMU guest agent is not enabled.
May 21 01:59:46.997099 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:46.998444 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-9 (vdb) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 01:59:47.002179 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Error from libvirt while getting description of instance-00000010: [Error Code 42] Domain not found: no domain with matching uuid '64f1cde4-f11a-4da7-8bbc-aaf777432069' (instance-00000010): libvirt.libvirtError: Domain not found: no domain with matching uuid '64f1cde4-f11a-4da7-8bbc-aaf777432069' (instance-00000010)
May 21 01:59:47.007152 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 01:59:47.007798 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:47.055721 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "env LANG=C uptime" returned: 0 in 0.047s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:47.057324 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Hypervisor/Node resource view: name=np0000001127 free_ram=12519MB free_disk=74.2691879272461GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 21 01:59:47.058487 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:47.116663 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328787.1151774, cb319b5a-9797-421c-ad9d-2fd9a1aaba38 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:59:47.116987 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] VM Started (Lifecycle Event)
May 21 01:59:47.206094 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-231990d2-d133-450d-9cfd-f0f06dce8fbd req-76c4f447-becf-4e64-8de1-65a615a01cc4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:47.220711 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:59:47.221085 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:59:47.261621 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-b0e526d0-5837-4726-92f4-b70b95861f7c tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=98206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 21 01:59:47.263945 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-b0e526d0-5837-4726-92f4-b70b95861f7c tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Skipping quiescing instance: QEMU guest agent is not enabled.
May 21 01:59:47.285068 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0d644f73-86d4-42c1-9b95-63949d80444d tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Acquiring lock "07596a09-d614-48c6-849f-a306f65c7a5c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:47.285367 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0d644f73-86d4-42c1-9b95-63949d80444d tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Lock "07596a09-d614-48c6-849f-a306f65c7a5c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:47.285665 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0d644f73-86d4-42c1-9b95-63949d80444d tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Acquiring lock "07596a09-d614-48c6-849f-a306f65c7a5c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:47.285882 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0d644f73-86d4-42c1-9b95-63949d80444d tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Lock "07596a09-d614-48c6-849f-a306f65c7a5c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:47.286188 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0d644f73-86d4-42c1-9b95-63949d80444d tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Lock "07596a09-d614-48c6-849f-a306f65c7a5c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:47.290065 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-0d644f73-86d4-42c1-9b95-63949d80444d tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Terminating instance
May 21 01:59:47.325002 np0000001127 nova-compute[98206]: DEBUG nova.privsep.utils [None req-b0e526d0-5837-4726-92f4-b70b95861f7c tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 21 01:59:47.326350 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-b0e526d0-5837-4726-92f4-b70b95861f7c tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpy90dhbv9/d30ecf7d406240fdb3d282eed5563756.delta /opt/stack/data/nova/instances/snapshots/tmpy90dhbv9/d30ecf7d406240fdb3d282eed5563756 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:47.411568 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-231990d2-d133-450d-9cfd-f0f06dce8fbd req-76c4f447-becf-4e64-8de1-65a615a01cc4 service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Updated VIF entry in instance network info cache for port 3b1f76f9-cf49-4dea-b9a2-762c2ad220bf. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 01:59:47.413306 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-231990d2-d133-450d-9cfd-f0f06dce8fbd req-76c4f447-becf-4e64-8de1-65a615a01cc4 service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Updating instance_info_cache with network_info: [{"id": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "address": "fa:16:3e:12:66:8e", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap3b1f76f9-cf", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:59:47.463969 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-b0e526d0-5837-4726-92f4-b70b95861f7c tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpy90dhbv9/d30ecf7d406240fdb3d282eed5563756.delta /opt/stack/data/nova/instances/snapshots/tmpy90dhbv9/d30ecf7d406240fdb3d282eed5563756" returned: 0 in 0.138s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:47.464997 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-b0e526d0-5837-4726-92f4-b70b95861f7c tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Snapshot extracted, beginning image upload
May 21 01:59:47.632928 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:59:47.634925 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:59:47.724982 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:59:47.795323 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-0d644f73-86d4-42c1-9b95-63949d80444d tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 01:59:47.818557 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:47.824689 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:47.851558 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:47.851804 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:47.882073 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:47.917339 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-231990d2-d133-450d-9cfd-f0f06dce8fbd req-76c4f447-becf-4e64-8de1-65a615a01cc4 service nova] Releasing lock "refresh_cache-64f1cde4-f11a-4da7-8bbc-aaf777432069" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:59:47.989130 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Acquiring lock "cb319b5a-9797-421c-ad9d-2fd9a1aaba38" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:47.990282 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Lock "cb319b5a-9797-421c-ad9d-2fd9a1aaba38" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:48.056399 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-06e87250-fb7b-40b3-80b2-6061583ddb2e req-35778926-f016-46e1-b9c1-dd7b29faf6fd service nova] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Received event network-vif-unplugged-660421e7-d9e9-4f1e-92af-3d7e62bd7a87 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:48.060441 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-06e87250-fb7b-40b3-80b2-6061583ddb2e req-35778926-f016-46e1-b9c1-dd7b29faf6fd service nova] Acquiring lock "07596a09-d614-48c6-849f-a306f65c7a5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:48.060867 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-06e87250-fb7b-40b3-80b2-6061583ddb2e req-35778926-f016-46e1-b9c1-dd7b29faf6fd service nova] Lock "07596a09-d614-48c6-849f-a306f65c7a5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:48.061177 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-06e87250-fb7b-40b3-80b2-6061583ddb2e req-35778926-f016-46e1-b9c1-dd7b29faf6fd service nova] Lock "07596a09-d614-48c6-849f-a306f65c7a5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:48.061504 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-06e87250-fb7b-40b3-80b2-6061583ddb2e req-35778926-f016-46e1-b9c1-dd7b29faf6fd service nova] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] No waiting events found dispatching network-vif-unplugged-660421e7-d9e9-4f1e-92af-3d7e62bd7a87 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:59:48.061725 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-06e87250-fb7b-40b3-80b2-6061583ddb2e req-35778926-f016-46e1-b9c1-dd7b29faf6fd service nova] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Received event network-vif-unplugged-660421e7-d9e9-4f1e-92af-3d7e62bd7a87 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 01:59:48.135284 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:48.141846 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328788.1374893, cb319b5a-9797-421c-ad9d-2fd9a1aaba38 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:59:48.141846 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] VM Paused (Lifecycle Event)
May 21 01:59:48.152709 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:48.178086 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Instance destroyed successfully.
May 21 01:59:48.178626 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-0d644f73-86d4-42c1-9b95-63949d80444d tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Lazy-loading 'resources' on Instance uuid 07596a09-d614-48c6-849f-a306f65c7a5c {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:59:48.233532 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 3.283s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:48.237402 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-518549b5-7c74-409f-ac47-57cac9ce230d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.539s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:48.238082 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Migrating
May 21 01:59:48.238082 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:59:48.238082 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquired lock "compute-rpcapi-router" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:59:48.495405 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Lazy-loading 'flavor' on Instance uuid cb319b5a-9797-421c-ad9d-2fd9a1aaba38 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:59:48.645128 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:59:48.648014 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328788.6476276, cb319b5a-9797-421c-ad9d-2fd9a1aaba38 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:59:48.648242 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] VM Resumed (Lifecycle Event)
May 21 01:59:48.681645 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-0d644f73-86d4-42c1-9b95-63949d80444d tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:59:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-598838675',display_name='tempest-VolumesActionsTest-instance-598838675',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumesactionstest-instance-598838675',id=19,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:59:39Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ebe24730468647869c1f1c973ecafdd2',ramdisk_id='',reservation_id='r-u4mzryid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-271344132',owner_user_name='tempest-VolumesActionsTest-271344132-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:59:40Z,user_data=None,user_id='00bdcdf44d37445cb35f1f8491858627',uuid=07596a09-d614-48c6-849f-a306f65c7a5c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "660421e7-d9e9-4f1e-92af-3d7e62bd7a87", "address": "fa:16:3e:ed:f3:de", "network": {"id": "17498fbc-1581-4d2b-82d2-3865a39e8d1f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1622249524-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ebe24730468647869c1f1c973ecafdd2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap660421e7-d9", "ovs_interfaceid": "660421e7-d9e9-4f1e-92af-3d7e62bd7a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 01:59:48.681908 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-0d644f73-86d4-42c1-9b95-63949d80444d tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Converting VIF {"id": "660421e7-d9e9-4f1e-92af-3d7e62bd7a87", "address": "fa:16:3e:ed:f3:de", "network": {"id": "17498fbc-1581-4d2b-82d2-3865a39e8d1f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1622249524-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ebe24730468647869c1f1c973ecafdd2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap660421e7-d9", "ovs_interfaceid": "660421e7-d9e9-4f1e-92af-3d7e62bd7a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:59:48.682801 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-0d644f73-86d4-42c1-9b95-63949d80444d tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f3:de,bridge_name='br-int',has_traffic_filtering=True,id=660421e7-d9e9-4f1e-92af-3d7e62bd7a87,network=Network(17498fbc-1581-4d2b-82d2-3865a39e8d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap660421e7-d9') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:59:48.683141 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-0d644f73-86d4-42c1-9b95-63949d80444d tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f3:de,bridge_name='br-int',has_traffic_filtering=True,id=660421e7-d9e9-4f1e-92af-3d7e62bd7a87,network=Network(17498fbc-1581-4d2b-82d2-3865a39e8d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap660421e7-d9') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 01:59:48.685814 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:48.686101 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap660421e7-d9, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:48.691879 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:48.692990 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:59:48.694842 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:48.695024 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=61472ac6-41da-426e-bd7e-83179a7bd681) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:48.696756 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:48.696756 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:59:48.696865 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:48.699441 np0000001127 nova-compute[98206]: INFO os_vif [None req-0d644f73-86d4-42c1-9b95-63949d80444d tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f3:de,bridge_name='br-int',has_traffic_filtering=True,id=660421e7-d9e9-4f1e-92af-3d7e62bd7a87,network=Network(17498fbc-1581-4d2b-82d2-3865a39e8d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap660421e7-d9')
May 21 01:59:48.699979 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-0d644f73-86d4-42c1-9b95-63949d80444d tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Deleting instance files /opt/stack/data/nova/instances/07596a09-d614-48c6-849f-a306f65c7a5c_del
May 21 01:59:48.700962 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-0d644f73-86d4-42c1-9b95-63949d80444d tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Deletion of /opt/stack/data/nova/instances/07596a09-d614-48c6-849f-a306f65c7a5c_del complete
May 21 01:59:48.744567 np0000001127 nova-compute[98206]: INFO nova.compute.rpcapi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Automatically selected compute RPC version 6.5 from minimum service version 72
May 21 01:59:48.745336 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Releasing lock "compute-rpcapi-router" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:59:48.745619 np0000001127 nova-compute[98206]: DEBUG nova.compute.rpcapi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98206) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 21 01:59:48.921298 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-518549b5-7c74-409f-ac47-57cac9ce230d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:59:48.921555 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-518549b5-7c74-409f-ac47-57cac9ce230d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:59:49.152262 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:59:49.156601 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 01:59:49.385495 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "64f1cde4-f11a-4da7-8bbc-aaf777432069" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:49.405359 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.1441554109999288 future=<Future at 0x71c0585ece30 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:59:49.406223 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "refresh_cache-66fe5d80-9012-44fe-9b82-1e993211ddf1" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:59:49.406301 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquired lock "refresh_cache-66fe5d80-9012-44fe-9b82-1e993211ddf1" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:59:49.406689 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Emitting event <LifecycleEvent: 1779328774.2610888, 64f1cde4-f11a-4da7-8bbc-aaf777432069 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 01:59:49.406890 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 01:59:49.407915 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-0d644f73-86d4-42c1-9b95-63949d80444d tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Took 1.61 seconds to destroy the instance on the hypervisor.
May 21 01:59:49.408234 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:59:49.408644 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-0d644f73-86d4-42c1-9b95-63949d80444d tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 01:59:49.408969 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] VM Stopped (Lifecycle Event)
May 21 01:59:49.410811 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 01:59:49.410983 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 01:59:49.411561 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:49.424533 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-518549b5-7c74-409f-ac47-57cac9ce230d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:59:49.489221 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:49.501320 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Lock "cb319b5a-9797-421c-ad9d-2fd9a1aaba38" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:49.659025 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999712737000209 future=<Future at 0x71c0585b4050 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:59:49.662013 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.99674293000021 future=<Future at 0x71c0585b4050 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:59:49.666355 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.996550784000192 future=<Future at 0x71c0585b4050 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:59:49.913648 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:49.918620 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 01:59:49.932660 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-518549b5-7c74-409f-ac47-57cac9ce230d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.699s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:49.938515 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 2.881s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:50.009726 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8c4093a7-0fc0-4d79-9b3d-26efc2a99a8e req-9848ac94-a0e7-4f39-8a9f-a2cf1d627431 service nova] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Received event network-vif-deleted-660421e7-d9e9-4f1e-92af-3d7e62bd7a87 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:50.010008 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-8c4093a7-0fc0-4d79-9b3d-26efc2a99a8e req-9848ac94-a0e7-4f39-8a9f-a2cf1d627431 service nova] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Neutron deleted interface 660421e7-d9e9-4f1e-92af-3d7e62bd7a87; detaching it from the instance and deleting it from the info cache
May 21 01:59:50.010542 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-8c4093a7-0fc0-4d79-9b3d-26efc2a99a8e req-9848ac94-a0e7-4f39-8a9f-a2cf1d627431 service nova] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:59:50.138952 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8352df8c-75b5-4e05-b31b-4da4e1ac04fc req-c79a95c0-88a1-4f29-b2f7-16cbe27147fc service nova] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Received event network-vif-unplugged-660421e7-d9e9-4f1e-92af-3d7e62bd7a87 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:50.139160 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8352df8c-75b5-4e05-b31b-4da4e1ac04fc req-c79a95c0-88a1-4f29-b2f7-16cbe27147fc service nova] Acquiring lock "07596a09-d614-48c6-849f-a306f65c7a5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:50.139342 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8352df8c-75b5-4e05-b31b-4da4e1ac04fc req-c79a95c0-88a1-4f29-b2f7-16cbe27147fc service nova] Lock "07596a09-d614-48c6-849f-a306f65c7a5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:50.139486 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8352df8c-75b5-4e05-b31b-4da4e1ac04fc req-c79a95c0-88a1-4f29-b2f7-16cbe27147fc service nova] Lock "07596a09-d614-48c6-849f-a306f65c7a5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:50.140710 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8352df8c-75b5-4e05-b31b-4da4e1ac04fc req-c79a95c0-88a1-4f29-b2f7-16cbe27147fc service nova] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] No waiting events found dispatching network-vif-unplugged-660421e7-d9e9-4f1e-92af-3d7e62bd7a87 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:59:50.140710 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8352df8c-75b5-4e05-b31b-4da4e1ac04fc req-c79a95c0-88a1-4f29-b2f7-16cbe27147fc service nova] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Received event network-vif-unplugged-660421e7-d9e9-4f1e-92af-3d7e62bd7a87 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 01:59:50.224885 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-b0e526d0-5837-4726-92f4-b70b95861f7c tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Snapshot image upload complete
May 21 01:59:50.225435 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-b0e526d0-5837-4726-92f4-b70b95861f7c tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Took 5.57 seconds to snapshot the instance on the hypervisor.
May 21 01:59:50.389559 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:50.422132 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:59:50.443659 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-518549b5-7c74-409f-ac47-57cac9ce230d tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "64f1cde4-f11a-4da7-8bbc-aaf777432069" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 17.566s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:50.445910 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "64f1cde4-f11a-4da7-8bbc-aaf777432069" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 1.059s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:50.445910 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Unshelving
May 21 01:59:50.495072 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Acquiring lock "800e7287-2ec0-48a2-b959-d7fbcc1f3c10" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:50.495317 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "800e7287-2ec0-48a2-b959-d7fbcc1f3c10" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:50.515932 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8c4093a7-0fc0-4d79-9b3d-26efc2a99a8e req-9848ac94-a0e7-4f39-8a9f-a2cf1d627431 service nova] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Detach interface failed, port_id=660421e7-d9e9-4f1e-92af-3d7e62bd7a87, reason: Instance 07596a09-d614-48c6-849f-a306f65c7a5c could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 01:59:50.559806 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Updating instance_info_cache with network_info: [{"id": "29bf5645-d178-459e-b25f-1b1db9f87374", "address": "fa:16:3e:45:a2:37", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bf5645-d1", "ovs_interfaceid": "29bf5645-d178-459e-b25f-1b1db9f87374", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:59:50.651689 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Acquiring lock "800e7287-2ec0-48a2-b959-d7fbcc1f3c10" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:50.696242 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Acquiring lock "cb319b5a-9797-421c-ad9d-2fd9a1aaba38" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:50.696242 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Lock "cb319b5a-9797-421c-ad9d-2fd9a1aaba38" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:50.696242 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Attaching volume e7cd2f86-88c0-4d0e-990a-73477eeafcda to /dev/vdb
May 21 01:59:50.745995 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:59:50.757730 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 01:59:50.783379 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:50.826514 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 01:59:50.827372 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 01:59:50.836828 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 01:59:50.840008 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe9e:216', 'fe80::14d9:7bff:fe3b:f0dc', 'fe80::fc16:3eff:fee3:f7d2', 'fe80::6c2e:11ff:fea1:7eb7', 'fe80::fc16:3eff:feaf:51f1', 'fe80::68db:c7ff:fe71:da32', 'fe80::fc16:3eff:fef8:14ac', 'fe80::c058:52ff:fed8:cd31', 'fe80::fc16:3eff:fe32:4418', 'fe80::fc16:3eff:fee6:5187', 'fe80::fc16:3eff:fe80:dd78', 'fe80::fc16:3eff:fe19:d5ae', 'fe80::fc16:3eff:fedb:3cf9', 'fe80::2040:23ff:febb:db06', 'fe80::fc16:3eff:fec9:a8b1', 'fe80::3003:9cff:fe70:ad4e', 'fe80::fc16:3eff:fe50:bfd8', 'fe80::fc16:3eff:fe45:a237', 'fe80::fc16:3eff:fe23:65cb', 'fe80::fc16:3eff:fe76:c870', 'fe80::a403:4dff:fe5a:1b07', 'fe80::fc16:3eff:feb9:2cdc', 'fe80::387e:45ff:fe8f:4c13'] 
May 21 01:59:50.842121 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 01:59:50.842121 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 01:59:50.842121 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] <== get_connector_properties: return (95ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:59:50.842121 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Updating existing volume attachment record: e43aa3b7-33a1-4334-ac34-e201e91b81f3 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 01:59:50.924682 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Took 1.51 seconds to deallocate network for instance.
May 21 01:59:50.959626 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Applying migration context for instance 66fe5d80-9012-44fe-9b82-1e993211ddf1 as it has an incoming, in-progress migration d91cd6ac-36a6-4061-bb3d-b315e844b573. Migration status is pre-migrating {{(pid=98206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
May 21 01:59:50.960810 np0000001127 nova-compute[98206]: INFO nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Updating resource usage from migration d91cd6ac-36a6-4061-bb3d-b315e844b573
May 21 01:59:50.998165 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Detaching volume 61d544f9-87fe-4afb-9cf7-04dec39c92a1
May 21 01:59:51.039244 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 29a124ee-2b8c-4f44-8f91-8dd11ac78b52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 01:59:51.039508 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 0d75ff65-b688-4387-89e3-70567e569682 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 01:59:51.039508 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance a4b3355b-92d6-4b36-8dad-6cb4b3c579a2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 01:59:51.039639 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance a6839691-a7ec-4dea-bc39-a7e89c94cf4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 01:59:51.039639 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 392bbdc4-beaa-4c44-93f5-3a76f331ceb0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 01:59:51.040013 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 800e7287-2ec0-48a2-b959-d7fbcc1f3c10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 01:59:51.040013 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 07596a09-d614-48c6-849f-a306f65c7a5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 01:59:51.040013 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 6c48501b-d03d-40bc-aef5-450fa580bd69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 01:59:51.041009 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance cb319b5a-9797-421c-ad9d-2fd9a1aaba38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 01:59:51.041009 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Migration d91cd6ac-36a6-4061-bb3d-b315e844b573 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 21 01:59:51.041009 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 66fe5d80-9012-44fe-9b82-1e993211ddf1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 01:59:51.041009 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Instance with task_state "unshelving" is not being actively managed by this compute host but has allocations referencing this compute node (a0b7bd56-5a70-4557-8cfd-9f933f412754): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1813}}
May 21 01:59:51.041009 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 21 01:59:51.041346 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Final resource view: name=np0000001127 phys_ram=24030MB used_ram=2688MB phys_disk=95GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:59:47 up 30 min,  2 users,  load average: 10.40, 6.46, 3.16\n', 'num_instances': '10', 'num_vm_active': '10', 'num_task_None': '7', 'num_os_type_None': '10', 'num_proj_6a15fe7a70464159a778cffa4a36c36f': '2', 'io_workload': '1', 'num_proj_83df9a84ffaa4398bdafbfbde079964d': '3', 'num_proj_fea6765f0d474e20a8cf4ce239d06576': '1', 'num_proj_dc797708a5a7400992765e41ee6ec260': '1', 'num_proj_9a80dd2c84334f79afe5cb079c50c555': '1', 'num_task_resize_prep': '1', 'num_task_image_uploading': '1', 'num_proj_73e8df58805f415fa39327f7f81e7852': '1', 'num_task_deleting': '1', 'num_proj_ebe24730468647869c1f1c973ecafdd2': '1'} {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 21 01:59:51.060888 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Attempting to driver detach volume 61d544f9-87fe-4afb-9cf7-04dec39c92a1 from mountpoint /dev/vdb
May 21 01:59:51.062738 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Releasing lock "refresh_cache-66fe5d80-9012-44fe-9b82-1e993211ddf1" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 01:59:51.070095 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Found disk vdb by alias ua-61d544f9-87fe-4afb-9cf7-04dec39c92a1 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 01:59:51.071827 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Found disk vdb by alias ua-61d544f9-87fe-4afb-9cf7-04dec39c92a1 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 01:59:51.071965 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Attempting to detach device vdb from instance 800e7287-2ec0-48a2-b959-d7fbcc1f3c10 from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 01:59:51.072218 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] detach device xml: <disk type="block" device="disk">
May 21 01:59:51.072218 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:59:51.072218 np0000001127 nova-compute[98206]:   <alias name="ua-61d544f9-87fe-4afb-9cf7-04dec39c92a1"/>
May 21 01:59:51.072218 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-10"/>
May 21 01:59:51.072218 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 01:59:51.072218 np0000001127 nova-compute[98206]:   <serial>61d544f9-87fe-4afb-9cf7-04dec39c92a1</serial>
May 21 01:59:51.072218 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 01:59:51.072218 np0000001127 nova-compute[98206]: </disk>
May 21 01:59:51.072218 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 01:59:51.090983 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Successfully detached device vdb from instance 800e7287-2ec0-48a2-b959-d7fbcc1f3c10 from the persistent domain config.
May 21 01:59:51.091354 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] (1/8): Attempting to detach device vdb with device alias ua-61d544f9-87fe-4afb-9cf7-04dec39c92a1 from instance 800e7287-2ec0-48a2-b959-d7fbcc1f3c10 from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 01:59:51.091826 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] detach device xml: <disk type="block" device="disk">
May 21 01:59:51.091826 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:59:51.091826 np0000001127 nova-compute[98206]:   <alias name="ua-61d544f9-87fe-4afb-9cf7-04dec39c92a1"/>
May 21 01:59:51.091826 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-10"/>
May 21 01:59:51.091826 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 01:59:51.091826 np0000001127 nova-compute[98206]:   <serial>61d544f9-87fe-4afb-9cf7-04dec39c92a1</serial>
May 21 01:59:51.091826 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 01:59:51.091826 np0000001127 nova-compute[98206]: </disk>
May 21 01:59:51.091826 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 01:59:51.264679 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:51.417062 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 01:59:51.418134 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda', 'iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7cd2f86-88c0-4d0e-990a-73477eeafcda', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:59:51.419531 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:59:51.419531 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:59:51.419934 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda', 'iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7cd2f86-88c0-4d0e-990a-73477eeafcda', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 01:59:51.437132 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0d644f73-86d4-42c1-9b95-63949d80444d tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:51.439939 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:59:51.440737 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:59:51.441571 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:59:51.442088 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:59:51.445930 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:59:51.447115 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:59:51.462196 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 01:59:51.462196 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:51.470540 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 01:59:51.470540 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:51.479291 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda] added
May 21 01:59:51.479291 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 01:59:51.479291 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:59:51.479291 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:59:51.479291 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:59:51.479291 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:59:51.479291 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:51.479674 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 01:59:51.479936 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0379(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 01:59:51.479936 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 01:59:51.492257 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda] added
May 21 01:59:51.492257 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 01:59:51.492257 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:59:51.492257 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:59:51.492257 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 01:59:51.492257 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 01:59:51.492257 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:51.492257 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 01:59:51.492564 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.046(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 01:59:51.492564 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 01:59:51.563625 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:51.791213 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779328791.7908149, 800e7287-2ec0-48a2-b959-d7fbcc1f3c10 => ua-61d544f9-87fe-4afb-9cf7-04dec39c92a1> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 01:59:51.793640 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-61d544f9-87fe-4afb-9cf7-04dec39c92a1 for instance 800e7287-2ec0-48a2-b959-d7fbcc1f3c10 {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 01:59:51.796482 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Successfully detached device vdb from instance 800e7287-2ec0-48a2-b959-d7fbcc1f3c10 from the live domain config.
May 21 01:59:51.797104 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 01:59:51.797401 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1', 'iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '61d544f9-87fe-4afb-9cf7-04dec39c92a1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:59:51.797588 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:59:51.906551 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:59:51.907433 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:59:52.259761 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "61f5b839-7cd4-428d-8dc0-327effc695d8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:52.260860 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "61f5b839-7cd4-428d-8dc0-327effc695d8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:52.411598 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:59:52.482601 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.startup = manual
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:59:52.492682 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:59:52.492682 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:52.499186 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 01:59:52.513256 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.startup = manual
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.port = 0
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 01:59:52.517100 np0000001127 nova-compute[98206]: # END RECORD
May 21 01:59:52.517100 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:52.533904 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:52.533904 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:52.533904 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:52.533904 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:52.533904 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:52.533904 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:52.533904 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:52.533904 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:52.533904 np0000001127 nova-compute[98206]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:52.533904 np0000001127 nova-compute[98206]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:52.533904 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:52.533904 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:52.533904 np0000001127 nova-compute[98206]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1 (non-flash)
May 21 01:59:52.533904 np0000001127 nova-compute[98206]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1 (non-flash)
May 21 01:59:52.533904 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:59:52.533904 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:52.533904 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:52.533904 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:52.533904 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:52.533904 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:52.533904 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:52.533904 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:52.533904 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:52.533904 np0000001127 nova-compute[98206]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:52.533904 np0000001127 nova-compute[98206]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:52.533904 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:52.533904 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:52.533904 np0000001127 nova-compute[98206]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1 (non-flash)
May 21 01:59:52.533904 np0000001127 nova-compute[98206]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1 (non-flash)
May 21 01:59:52.533904 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:59:52.539953 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:52.561901 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:52.561901 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:52.561901 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:52.561901 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:52.561901 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:52.561901 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:52.561901 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:52.561901 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:52.561901 np0000001127 nova-compute[98206]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:52.561901 np0000001127 nova-compute[98206]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:52.561901 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:52.561901 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:52.561901 np0000001127 nova-compute[98206]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1 (non-flash)
May 21 01:59:52.561901 np0000001127 nova-compute[98206]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1 (non-flash)
May 21 01:59:52.561901 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:59:52.562499 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:52.562499 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:52.562499 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:52.562499 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:52.562499 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:52.562499 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:52.562499 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:52.562499 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:52.562499 np0000001127 nova-compute[98206]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:52.562499 np0000001127 nova-compute[98206]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:52.562499 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:52.562499 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:52.562499 np0000001127 nova-compute[98206]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1 (non-flash)
May 21 01:59:52.562499 np0000001127 nova-compute[98206]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1 (non-flash)
May 21 01:59:52.562499 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:59:52.575239 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Starting migrate_disk_and_power_off {{(pid=98206) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 21 01:59:52.586226 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda, portal: 192.168.40.100,3260]
May 21 01:59:52.586226 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda, portal: 192.168.40.100,3260] successful.
May 21 01:59:52.586226 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:52.598445 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:52.602852 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:52.603839 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:52.631785 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:52.635112 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda, portal: 192.168.50.100,3260]
May 21 01:59:52.635112 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda, portal: 192.168.50.100,3260] successful.
May 21 01:59:52.635112 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:52.635112 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:52.635112 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:52.635112 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:52.635112 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:52.635112 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:52.635112 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:52.635112 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:52.635112 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:52.635112 np0000001127 nova-compute[98206]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:52.635112 np0000001127 nova-compute[98206]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:52.635112 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:52.635112 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:52.635112 np0000001127 nova-compute[98206]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1 (non-flash)
May 21 01:59:52.635112 np0000001127 nova-compute[98206]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1 (non-flash)
May 21 01:59:52.635112 np0000001127 nova-compute[98206]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda (non-flash)
May 21 01:59:52.635112 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:59:52.635112 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:52.635112 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:52.635112 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:52.635112 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:52.635112 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:52.635112 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:52.635112 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:52.635112 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:52.635112 np0000001127 nova-compute[98206]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:52.635112 np0000001127 nova-compute[98206]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:52.635112 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:52.635112 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:52.635112 np0000001127 nova-compute[98206]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1 (non-flash)
May 21 01:59:52.635112 np0000001127 nova-compute[98206]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1 (non-flash)
May 21 01:59:52.635112 np0000001127 nova-compute[98206]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda (non-flash)
May 21 01:59:52.635112 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:59:52.635112 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.194s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:59:52.636202 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:59:52.639298 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] HCTL ('21', '-', '-', 0) found on session 44 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:59:52.639298 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Scanning host 21 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:59:52.649559 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:52.666096 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Searching for a device in session 44 and hctl ['21', '*', '*', 0] yield: None {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:59:52.679057 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:52.679057 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:52.679057 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:52.679057 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:52.679057 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:52.679057 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:52.679057 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:52.679057 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:52.679057 np0000001127 nova-compute[98206]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:52.679057 np0000001127 nova-compute[98206]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:52.679057 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:52.679057 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:52.679057 np0000001127 nova-compute[98206]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1 (non-flash)
May 21 01:59:52.679057 np0000001127 nova-compute[98206]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1 (non-flash)
May 21 01:59:52.679057 np0000001127 nova-compute[98206]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda (non-flash)
May 21 01:59:52.679057 np0000001127 nova-compute[98206]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda (non-flash)
May 21 01:59:52.679057 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:59:52.680136 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:52.680136 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:52.680136 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:52.680136 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:52.680136 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:52.680136 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:52.680136 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:52.680136 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:52.680136 np0000001127 nova-compute[98206]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:52.680136 np0000001127 nova-compute[98206]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:52.680136 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:52.680136 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:52.680136 np0000001127 nova-compute[98206]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1 (non-flash)
May 21 01:59:52.680136 np0000001127 nova-compute[98206]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1 (non-flash)
May 21 01:59:52.680136 np0000001127 nova-compute[98206]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda (non-flash)
May 21 01:59:52.680136 np0000001127 nova-compute[98206]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda (non-flash)
May 21 01:59:52.680136 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:59:52.680136 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.237s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:59:52.680136 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 01:59:52.681069 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] HCTL ('22', '-', '-', 0) found on session 45 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 01:59:52.681198 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Scanning host 22 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 01:59:52.702583 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Searching for a device in session 45 and hctl ['22', '*', '*', 0] yield: sdq {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:59:52.702583 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Connected to sdq using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e7cd2f86-88c0-4d0e-990a-73477eeafcda', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:59:52.762402 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 01:59:52.822281 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:52.837522 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:52.882004 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b70c47d9-5ba4-4927-84b3-7ad5784ae496 req-2c2708d0-70ec-414f-b6ee-6f6867cbd10a service nova] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Received event network-vif-unplugged-29bf5645-d178-459e-b25f-1b1db9f87374 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:52.884230 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b70c47d9-5ba4-4927-84b3-7ad5784ae496 req-2c2708d0-70ec-414f-b6ee-6f6867cbd10a service nova] Acquiring lock "66fe5d80-9012-44fe-9b82-1e993211ddf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:52.884230 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b70c47d9-5ba4-4927-84b3-7ad5784ae496 req-2c2708d0-70ec-414f-b6ee-6f6867cbd10a service nova] Lock "66fe5d80-9012-44fe-9b82-1e993211ddf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:52.884230 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b70c47d9-5ba4-4927-84b3-7ad5784ae496 req-2c2708d0-70ec-414f-b6ee-6f6867cbd10a service nova] Lock "66fe5d80-9012-44fe-9b82-1e993211ddf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:52.884230 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b70c47d9-5ba4-4927-84b3-7ad5784ae496 req-2c2708d0-70ec-414f-b6ee-6f6867cbd10a service nova] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] No waiting events found dispatching network-vif-unplugged-29bf5645-d178-459e-b25f-1b1db9f87374 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:59:52.885581 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-b70c47d9-5ba4-4927-84b3-7ad5784ae496 req-2c2708d0-70ec-414f-b6ee-6f6867cbd10a service nova] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Received unexpected event network-vif-unplugged-29bf5645-d178-459e-b25f-1b1db9f87374 for instance with vm_state active and task_state resize_migrating.
May 21 01:59:52.902634 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:52.913962 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:52.931199 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Compute_service record updated for np0000001127:np0000001127 {{(pid=98206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 21 01:59:52.931199 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.993s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:52.931685 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 01:59:52.932742 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0d644f73-86d4-42c1-9b95-63949d80444d tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.495s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:52.933574 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999692950000053 future=<Future at 0x71c05865c950 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:59:52.942278 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Instance destroyed successfully.
May 21 01:59:52.945848 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:59:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1476667320',display_name='tempest-ServerActionsTestOtherA-server-1476667320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serveractionstestothera-server-1476667320',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxRidCAMyb/mDvqucBNL6o1pu4ohR9TfsTnx1DGEBK8Hs9Bxy4viDAtOuJAjHZZuWNRGwi0rwlQFKlYKc+oTj/M3U8o3nzcuoUHvHlwyO9ufXio2O1Y8v01hvWMmUCFbg==',key_name='tempest-keypair-631476445',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:59:39Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6a15fe7a70464159a778cffa4a36c36f',ramdisk_id='',reservation_id='r-szx080g8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1975191698',owner_user_name='tempest-ServerActionsTestOtherA-1975191698-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:59:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbcd1a81252344dd804a4080571f8751',uuid=66fe5d80-9012-44fe-9b82-1e993211ddf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29bf5645-d178-459e-b25f-1b1db9f87374", "address": "fa:16:3e:45:a2:37", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1391831945-network", "vif_mac": "fa:16:3e:45:a2:37"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bf5645-d1", "ovs_interfaceid": "29bf5645-d178-459e-b25f-1b1db9f87374", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 01:59:52.945848 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Converting VIF {"id": "29bf5645-d178-459e-b25f-1b1db9f87374", "address": "fa:16:3e:45:a2:37", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1391831945-network", "vif_mac": "fa:16:3e:45:a2:37"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bf5645-d1", "ovs_interfaceid": "29bf5645-d178-459e-b25f-1b1db9f87374", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:59:52.945848 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:a2:37,bridge_name='br-int',has_traffic_filtering=True,id=29bf5645-d178-459e-b25f-1b1db9f87374,network=Network(6d660724-85bf-45e3-895a-b9ce67043c30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29bf5645-d1') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:59:52.946267 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:a2:37,bridge_name='br-int',has_traffic_filtering=True,id=29bf5645-d178-459e-b25f-1b1db9f87374,network=Network(6d660724-85bf-45e3-895a-b9ce67043c30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29bf5645-d1') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 01:59:52.950971 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:52.951228 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29bf5645-d1, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:52.952527 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:52.953395 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:59:52.954129 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:52.955341 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:52.956255 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c3311743-0c6c-483c-ae27-553fe9b8b473) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:52.956663 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:52.957569 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:59:52.961242 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:52.965050 np0000001127 nova-compute[98206]: INFO os_vif [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:a2:37,bridge_name='br-int',has_traffic_filtering=True,id=29bf5645-d178-459e-b25f-1b1db9f87374,network=Network(6d660724-85bf-45e3-895a-b9ce67043c30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29bf5645-d1')
May 21 01:59:52.966356 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 01:59:52.966612 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7721af1e-8f1d-4ffa-b905-045839f8645d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:59:52.966805 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:59:53.329487 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:53.666551 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Searching for a device in session 44 and hctl ['21', '*', '*', 0] yield: sdp {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 01:59:53.667110 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7cd2f86-88c0-4d0e-990a-73477eeafcda', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 01:59:53.761018 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0d644f73-86d4-42c1-9b95-63949d80444d tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:59:53.761251 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-0d644f73-86d4-42c1-9b95-63949d80444d tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:59:53.929373 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:59:53.929936 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:59:53.930398 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:59:53.930822 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:59:53.931090 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 01:59:53.931562 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 48.62 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 01:59:54.264314 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-0d644f73-86d4-42c1-9b95-63949d80444d tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:59:54.465966 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Found WWN 3300000000eca1ff7 for multipath device dm-11 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 01:59:54.466844 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.047s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:59:54.468050 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.670s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:59:54.468340 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1', 'iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '61d544f9-87fe-4afb-9cf7-04dec39c92a1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 01:59:54.468735 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 01:59:54.468922 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] <== connect_volume: return (3049ms) {'type': 'block', 'scsi_wwn': '3300000000eca1ff7', 'path': '/dev/dm-11', 'multipath_id': '3300000000eca1ff7'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:59:54.469632 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000eca1ff7', 'path': '/dev/dm-11', 'multipath_id': '3300000000eca1ff7'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 01:59:54.479922 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Lazy-loading 'flavor' on Instance uuid cb319b5a-9797-421c-ad9d-2fd9a1aaba38 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:59:54.515725 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:54.515725 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:54.515725 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:54.515725 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:54.515725 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:54.515725 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:54.515725 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:54.515725 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:54.515725 np0000001127 nova-compute[98206]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:54.515725 np0000001127 nova-compute[98206]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:54.515725 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:54.515725 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:54.515725 np0000001127 nova-compute[98206]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1 (non-flash)
May 21 01:59:54.515725 np0000001127 nova-compute[98206]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1 (non-flash)
May 21 01:59:54.515725 np0000001127 nova-compute[98206]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda (non-flash)
May 21 01:59:54.515725 np0000001127 nova-compute[98206]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda (non-flash)
May 21 01:59:54.515725 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:59:54.516339 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:54.516339 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:54.516339 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:54.516339 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:54.516339 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:54.516339 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:54.516339 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:54.516339 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:54.516339 np0000001127 nova-compute[98206]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:54.516339 np0000001127 nova-compute[98206]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:54.516339 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:54.516339 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:54.516339 np0000001127 nova-compute[98206]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1 (non-flash)
May 21 01:59:54.516339 np0000001127 nova-compute[98206]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1 (non-flash)
May 21 01:59:54.516339 np0000001127 nova-compute[98206]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda (non-flash)
May 21 01:59:54.516339 np0000001127 nova-compute[98206]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda (non-flash)
May 21 01:59:54.516339 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:59:54.516339 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', '27'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6', '35'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '38'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '39'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', '41'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1', '42'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda', '45')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 01:59:54.516339 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1', '42')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 01:59:54.517944 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1', '43')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 01:59:54.520506 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c0587d9800>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1'): ({'sdn'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1'): ({'sdo'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 01:59:54.520819 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Removing multipathed devices sdo, sdn {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 01:59:54.521154 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Flush multipath device 330000000bf3e8ed7 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 01:59:54.558577 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 01:59:54.604833 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 01:59:54.652443 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Checking to see if SCSI volumes sdo, sdn have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 01:59:54.652443 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] SCSI volumes sdo, sdn have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 01:59:54.655386 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Checking to see if device paths {'sdo', 'sdn'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 01:59:54.671918 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Device paths {'sdo', 'sdn'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 01:59:54.672447 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 01:59:54.687417 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:54.734757 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1, portal: 192.168.40.100,3260]
May 21 01:59:54.734757 np0000001127 nova-compute[98206]: Logout of [sid: 42, target: iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1, portal: 192.168.40.100,3260] successful.
May 21 01:59:54.734757 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:54.774242 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0d644f73-86d4-42c1-9b95-63949d80444d tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.842s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:54.776377 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.211s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:54.776845 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:54.778324 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lazy-loading 'pci_requests' on Instance uuid 64f1cde4-f11a-4da7-8bbc-aaf777432069 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:59:54.795170 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:54.854830 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1, portal: 192.168.50.100,3260]
May 21 01:59:54.854830 np0000001127 nova-compute[98206]: Logout of [sid: 43, target: iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1, portal: 192.168.50.100,3260] successful.
May 21 01:59:54.854830 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:54.870887 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-0d644f73-86d4-42c1-9b95-63949d80444d tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Deleted allocations for instance 07596a09-d614-48c6-849f-a306f65c7a5c
May 21 01:59:54.891218 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:54.891844 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.425s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:59:54.892001 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] <== disconnect_volume: return (3094ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:59:54.892238 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 01:59:54.894925 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.928s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:59:54.897079 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7721af1e-8f1d-4ffa-b905-045839f8645d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 01:59:54.897307 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 01:59:54.946640 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:54.946640 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:54.946640 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:54.946640 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:54.946640 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:54.946640 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:54.946640 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:54.946640 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:54.946640 np0000001127 nova-compute[98206]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:54.946640 np0000001127 nova-compute[98206]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:54.946640 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:54.946640 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:54.946640 np0000001127 nova-compute[98206]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda (non-flash)
May 21 01:59:54.946640 np0000001127 nova-compute[98206]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda (non-flash)
May 21 01:59:54.946640 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:59:54.947044 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:54.947044 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:54.947044 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:54.947044 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:54.947044 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:54.947044 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:54.947044 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:54.947044 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:54.947044 np0000001127 nova-compute[98206]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:54.947044 np0000001127 nova-compute[98206]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 01:59:54.947044 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:54.947044 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:54.947044 np0000001127 nova-compute[98206]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda (non-flash)
May 21 01:59:54.947044 np0000001127 nova-compute[98206]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda (non-flash)
May 21 01:59:54.947044 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:59:54.947408 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', '27'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6', '35'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '38'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '39'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', '41'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda', '45')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 01:59:54.951033 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '38')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 01:59:54.955382 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '39')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 01:59:54.958068 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c058564ae0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d'): ({'sdc'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 01:59:54.959073 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Removing multipathed devices sdc, sdb {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 01:59:54.959073 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Flush multipath device 3300000007eb86ea1 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 01:59:54.984056 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Attempting to attach volume e7cd2f86-88c0-4d0e-990a-73477eeafcda with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 01:59:54.986232 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] attach device xml: <disk type="block" device="disk">
May 21 01:59:54.986232 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 01:59:54.986232 np0000001127 nova-compute[98206]:   <alias name="ua-e7cd2f86-88c0-4d0e-990a-73477eeafcda"/>
May 21 01:59:54.986232 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-11"/>
May 21 01:59:54.986232 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 01:59:54.986232 np0000001127 nova-compute[98206]:   <serial>e7cd2f86-88c0-4d0e-990a-73477eeafcda</serial>
May 21 01:59:54.986232 np0000001127 nova-compute[98206]: </disk>
May 21 01:59:54.986232 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 01:59:55.003443 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-58835cf1-a759-4385-a83e-4c7383f69c5f req-c461ee35-b78c-41e2-a65f-53b5e2039569 service nova] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Received event network-vif-unplugged-29bf5645-d178-459e-b25f-1b1db9f87374 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:55.005339 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-58835cf1-a759-4385-a83e-4c7383f69c5f req-c461ee35-b78c-41e2-a65f-53b5e2039569 service nova] Acquiring lock "66fe5d80-9012-44fe-9b82-1e993211ddf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:55.005639 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-58835cf1-a759-4385-a83e-4c7383f69c5f req-c461ee35-b78c-41e2-a65f-53b5e2039569 service nova] Lock "66fe5d80-9012-44fe-9b82-1e993211ddf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:55.005890 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-58835cf1-a759-4385-a83e-4c7383f69c5f req-c461ee35-b78c-41e2-a65f-53b5e2039569 service nova] Lock "66fe5d80-9012-44fe-9b82-1e993211ddf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:55.006299 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-58835cf1-a759-4385-a83e-4c7383f69c5f req-c461ee35-b78c-41e2-a65f-53b5e2039569 service nova] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] No waiting events found dispatching network-vif-unplugged-29bf5645-d178-459e-b25f-1b1db9f87374 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:59:55.006494 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-58835cf1-a759-4385-a83e-4c7383f69c5f req-c461ee35-b78c-41e2-a65f-53b5e2039569 service nova] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Received unexpected event network-vif-unplugged-29bf5645-d178-459e-b25f-1b1db9f87374 for instance with vm_state active and task_state resize_migrating.
May 21 01:59:55.014933 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 01:59:55.061829 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 01:59:55.110276 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 01:59:55.110495 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 01:59:55.112189 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 01:59:55.128005 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 01:59:55.128580 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 01:59:55.145760 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:55.189016 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d, portal: 192.168.40.100,3260]
May 21 01:59:55.189016 np0000001127 nova-compute[98206]: Logout of [sid: 38, target: iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d, portal: 192.168.40.100,3260] successful.
May 21 01:59:55.189016 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:55.224656 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:55.241545 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:55.282553 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lazy-loading 'numa_topology' on Instance uuid 64f1cde4-f11a-4da7-8bbc-aaf777432069 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:59:55.284906 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d, portal: 192.168.50.100,3260]
May 21 01:59:55.284906 np0000001127 nova-compute[98206]: Logout of [sid: 39, target: iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d, portal: 192.168.50.100,3260] successful.
May 21 01:59:55.284906 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:55.309853 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 01:59:55.309853 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.415s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:59:55.310092 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] <== disconnect_volume: return (2343ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:59:55.310251 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 01:59:55.313389 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 01:59:55.313910 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/66fe5d80-9012-44fe-9b82-1e993211ddf1_resize/disk.config /opt/stack/data/nova/instances/66fe5d80-9012-44fe-9b82-1e993211ddf1/disk.config {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 01:59:55.356198 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] CMD "cp -r /opt/stack/data/nova/instances/66fe5d80-9012-44fe-9b82-1e993211ddf1_resize/disk.config /opt/stack/data/nova/instances/66fe5d80-9012-44fe-9b82-1e993211ddf1/disk.config" returned: 0 in 0.042s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 01:59:55.494878 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lazy-loading 'flavor' on Instance uuid 800e7287-2ec0-48a2-b959-d7fbcc1f3c10 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:59:55.790291 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 01:59:55.790890 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Claim successful on node np0000001127
May 21 01:59:55.886197 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0d644f73-86d4-42c1-9b95-63949d80444d tempest-VolumesActionsTest-271344132 tempest-VolumesActionsTest-271344132-project-member] Lock "07596a09-d614-48c6-849f-a306f65c7a5c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.601s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:56.275587 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:56.507607 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-eac23418-8ed2-4fb9-b83d-a5edadb837b1 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "800e7287-2ec0-48a2-b959-d7fbcc1f3c10" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.012s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:56.509327 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "800e7287-2ec0-48a2-b959-d7fbcc1f3c10" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 5.856s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:56.509744 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Acquiring lock "800e7287-2ec0-48a2-b959-d7fbcc1f3c10-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:56.509879 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "800e7287-2ec0-48a2-b959-d7fbcc1f3c10-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:56.510009 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "800e7287-2ec0-48a2-b959-d7fbcc1f3c10-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:56.517142 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Terminating instance
May 21 01:59:56.556330 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:56.556662 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:56.666422 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:59:56.666636 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:59:56.666826 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 01:59:56.666917 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] No VIF found with MAC fa:16:3e:b9:2c:dc, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 01:59:56.688089 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Port 29bf5645-d178-459e-b25f-1b1db9f87374 binding to destination host np0000001127 is already ACTIVE {{(pid=98206) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3211}}
May 21 01:59:57.024408 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 01:59:57.050015 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:57.053453 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:57.083286 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:57.090070 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:57.118809 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:57.253257 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d8182e5d-3e7d-4302-81f9-e6621467648b req-0c9ad2ff-9a13-4ee7-a25e-6ce78ed38d29 service nova] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Received event network-vif-unplugged-23851da2-f984-4946-af6d-2b652ff984e1 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:57.253257 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d8182e5d-3e7d-4302-81f9-e6621467648b req-0c9ad2ff-9a13-4ee7-a25e-6ce78ed38d29 service nova] Acquiring lock "800e7287-2ec0-48a2-b959-d7fbcc1f3c10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:57.253931 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d8182e5d-3e7d-4302-81f9-e6621467648b req-0c9ad2ff-9a13-4ee7-a25e-6ce78ed38d29 service nova] Lock "800e7287-2ec0-48a2-b959-d7fbcc1f3c10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:57.254092 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d8182e5d-3e7d-4302-81f9-e6621467648b req-0c9ad2ff-9a13-4ee7-a25e-6ce78ed38d29 service nova] Lock "800e7287-2ec0-48a2-b959-d7fbcc1f3c10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:57.254242 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d8182e5d-3e7d-4302-81f9-e6621467648b req-0c9ad2ff-9a13-4ee7-a25e-6ce78ed38d29 service nova] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] No waiting events found dispatching network-vif-unplugged-23851da2-f984-4946-af6d-2b652ff984e1 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:59:57.254418 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d8182e5d-3e7d-4302-81f9-e6621467648b req-0c9ad2ff-9a13-4ee7-a25e-6ce78ed38d29 service nova] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Received event network-vif-unplugged-23851da2-f984-4946-af6d-2b652ff984e1 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 01:59:57.373287 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999677513000051 future=<Future at 0x71c05853eea0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:59:57.375423 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Instance destroyed successfully.
May 21 01:59:57.376080 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lazy-loading 'resources' on Instance uuid 800e7287-2ec0-48a2-b959-d7fbcc1f3c10 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:59:57.547699 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 01:59:57.547918 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 01:59:57.696553 np0000001127 nova-compute[98206]: DEBUG nova.compute.rpcapi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98206) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 21 01:59:57.710649 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "66fe5d80-9012-44fe-9b82-1e993211ddf1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:57.711032 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "66fe5d80-9012-44fe-9b82-1e993211ddf1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:57.711181 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "66fe5d80-9012-44fe-9b82-1e993211ddf1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:57.878614 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:58:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1282008379',display_name='tempest-VolumesSnapshotTestJSON-instance-1282008379',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumessnapshottestjson-instance-1282008379',id=17,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/D5kqBe8wboxjntZ6XpC06rz5RhcDXTbaSsvoMewntysJOstkWoBzRLZ2faqM0pedYjWrRBZ16rWiuBNd8VS5xaE1Iwhu2NWyhBWLMJ4dTHxhzRBJN+aM4ILjpKPC9/g==',key_name='tempest-keypair-2002170955',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:58:53Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a80dd2c84334f79afe5cb079c50c555',ramdisk_id='',reservation_id='r-am8snqoa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-315332802',owner_user_name='tempest-VolumesSnapshotTestJSON-315332802-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:58:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='457854a2cf2844b8b693d835d2c9b699',uuid=800e7287-2ec0-48a2-b959-d7fbcc1f3c10,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23851da2-f984-4946-af6d-2b652ff984e1", "address": "fa:16:3e:af:51:f1", "network": {"id": "aba610ba-f311-41c2-b94d-2495441912e4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-360728390-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a80dd2c84334f79afe5cb079c50c555", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23851da2-f9", "ovs_interfaceid": "23851da2-f984-4946-af6d-2b652ff984e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 01:59:57.878898 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Converting VIF {"id": "23851da2-f984-4946-af6d-2b652ff984e1", "address": "fa:16:3e:af:51:f1", "network": {"id": "aba610ba-f311-41c2-b94d-2495441912e4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-360728390-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a80dd2c84334f79afe5cb079c50c555", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23851da2-f9", "ovs_interfaceid": "23851da2-f984-4946-af6d-2b652ff984e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 01:59:57.880360 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:51:f1,bridge_name='br-int',has_traffic_filtering=True,id=23851da2-f984-4946-af6d-2b652ff984e1,network=Network(aba610ba-f311-41c2-b94d-2495441912e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23851da2-f9') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 01:59:57.880708 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:51:f1,bridge_name='br-int',has_traffic_filtering=True,id=23851da2-f984-4946-af6d-2b652ff984e1,network=Network(aba610ba-f311-41c2-b94d-2495441912e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23851da2-f9') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 01:59:57.882204 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:57.882531 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23851da2-f9, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:57.884854 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:57.885812 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:59:57.887501 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:57.887811 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:57.888020 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a509ef91-21e6-4169-8d5a-9cf30441b9e1) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 01:59:57.890624 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:57.890624 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 01:59:57.890624 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:57.892092 np0000001127 nova-compute[98206]: INFO os_vif [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:51:f1,bridge_name='br-int',has_traffic_filtering=True,id=23851da2-f984-4946-af6d-2b652ff984e1,network=Network(aba610ba-f311-41c2-b94d-2495441912e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23851da2-f9')
May 21 01:59:57.893454 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 01:59:57.894022 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1', 'iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '61d544f9-87fe-4afb-9cf7-04dec39c92a1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 01:59:57.894193 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 01:59:57.894847 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 01:59:57.895249 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1', 'iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '61d544f9-87fe-4afb-9cf7-04dec39c92a1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 01:59:57.895435 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 01:59:57.933547 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:57.933547 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:57.933547 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:57.933547 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:57.933547 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:57.933547 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:57.933547 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:57.933547 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:57.933547 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:57.933547 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:57.933547 np0000001127 nova-compute[98206]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda (non-flash)
May 21 01:59:57.933547 np0000001127 nova-compute[98206]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda (non-flash)
May 21 01:59:57.933547 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 01:59:57.933871 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:57.933871 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 01:59:57.933871 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:57.933871 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 01:59:57.933871 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:57.933871 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 01:59:57.933871 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:57.933871 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 01:59:57.933871 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:57.933871 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 01:59:57.933871 np0000001127 nova-compute[98206]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda (non-flash)
May 21 01:59:57.933871 np0000001127 nova-compute[98206]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda (non-flash)
May 21 01:59:57.933871 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 01:59:57.934818 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', '27'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6', '35'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', '41'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda', '45')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 01:59:57.935001 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1, 0): [] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 01:59:57.935163 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1') {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 21 01:59:57.935304 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1, 0): [] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 01:59:57.935433 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-61d544f9-87fe-4afb-9cf7-04dec39c92a1') {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 21 01:59:57.935597 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c058638d60>, {}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 01:59:57.935779 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Disconnecting from: [] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 01:59:57.936019 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.041s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 01:59:57.936162 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] <== disconnect_volume: return (42ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 01:59:57.936313 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 01:59:57.936643 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Deleting instance files /opt/stack/data/nova/instances/800e7287-2ec0-48a2-b959-d7fbcc1f3c10_del
May 21 01:59:57.940805 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Deletion of /opt/stack/data/nova/instances/800e7287-2ec0-48a2-b959-d7fbcc1f3c10_del complete
May 21 01:59:58.051985 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 01:59:58.223116 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0465c309-ce12-42bf-9be1-8f407a1d40f5 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Lock "cb319b5a-9797-421c-ad9d-2fd9a1aaba38" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.527s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:58.448067 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Took 1.42 seconds to destroy the instance on the hypervisor.
May 21 01:59:58.448676 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 01:59:58.448949 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 01:59:58.449042 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 01:59:58.449287 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:58.559702 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:58.562082 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.788s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:58.562285 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:58.564092 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 5.235s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:58.567172 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 01:59:58.567398 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Claim successful on node np0000001127
May 21 01:59:58.616124 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Acquiring lock "cb319b5a-9797-421c-ad9d-2fd9a1aaba38" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:58.616456 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Lock "cb319b5a-9797-421c-ad9d-2fd9a1aaba38" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:58.616607 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Acquiring lock "cb319b5a-9797-421c-ad9d-2fd9a1aaba38-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:58.616833 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Lock "cb319b5a-9797-421c-ad9d-2fd9a1aaba38-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:58.617029 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Lock "cb319b5a-9797-421c-ad9d-2fd9a1aaba38-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:58.621829 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Terminating instance
May 21 01:59:58.680607 np0000001127 nova-compute[98206]: INFO nova.network.neutron [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Updating port 3b1f76f9-cf49-4dea-b9a2-762c2ad220bf with attributes {'binding:host_id': 'np0000001127', 'device_owner': 'compute:nova'}
May 21 01:59:58.716309 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:58.812379 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "refresh_cache-66fe5d80-9012-44fe-9b82-1e993211ddf1" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:59:58.812546 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquired lock "refresh_cache-66fe5d80-9012-44fe-9b82-1e993211ddf1" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:59:58.812834 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 01:59:59.083356 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8b33cd1d-5161-45c6-b138-71980cfd9dd6 req-6649279a-5f67-47c2-94bf-442fd20b78e4 service nova] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Received event network-vif-deleted-23851da2-f984-4946-af6d-2b652ff984e1 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:59.083356 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-8b33cd1d-5161-45c6-b138-71980cfd9dd6 req-6649279a-5f67-47c2-94bf-442fd20b78e4 service nova] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Neutron deleted interface 23851da2-f984-4946-af6d-2b652ff984e1; detaching it from the instance and deleting it from the info cache
May 21 01:59:59.083802 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-8b33cd1d-5161-45c6-b138-71980cfd9dd6 req-6649279a-5f67-47c2-94bf-442fd20b78e4 service nova] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:59:59.126820 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 01:59:59.146910 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:59.168644 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:59.183833 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:59.205323 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:59.206847 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 01:59:59.314992 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:59.327411 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "refresh_cache-64f1cde4-f11a-4da7-8bbc-aaf777432069" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:59:59.330748 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquired lock "refresh_cache-64f1cde4-f11a-4da7-8bbc-aaf777432069" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 01:59:59.331403 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 01:59:59.366221 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d1c9296b-f125-4a3b-b70f-464b20f3bebc req-2151ad2e-2e81-441b-9491-2c69bb5852f6 service nova] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Received event network-vif-unplugged-23851da2-f984-4946-af6d-2b652ff984e1 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:59.366221 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d1c9296b-f125-4a3b-b70f-464b20f3bebc req-2151ad2e-2e81-441b-9491-2c69bb5852f6 service nova] Acquiring lock "800e7287-2ec0-48a2-b959-d7fbcc1f3c10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 01:59:59.366551 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d1c9296b-f125-4a3b-b70f-464b20f3bebc req-2151ad2e-2e81-441b-9491-2c69bb5852f6 service nova] Lock "800e7287-2ec0-48a2-b959-d7fbcc1f3c10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 01:59:59.366551 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d1c9296b-f125-4a3b-b70f-464b20f3bebc req-2151ad2e-2e81-441b-9491-2c69bb5852f6 service nova] Lock "800e7287-2ec0-48a2-b959-d7fbcc1f3c10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 01:59:59.367103 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d1c9296b-f125-4a3b-b70f-464b20f3bebc req-2151ad2e-2e81-441b-9491-2c69bb5852f6 service nova] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] No waiting events found dispatching network-vif-unplugged-23851da2-f984-4946-af6d-2b652ff984e1 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 01:59:59.368627 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d1c9296b-f125-4a3b-b70f-464b20f3bebc req-2151ad2e-2e81-441b-9491-2c69bb5852f6 service nova] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Received event network-vif-unplugged-23851da2-f984-4946-af6d-2b652ff984e1 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 01:59:59.402127 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-05666866-e1c2-4630-a2ee-ed6a01ee758e req-f165f476-01e6-4734-af39-84f898bfaf05 service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Received event network-changed-3b1f76f9-cf49-4dea-b9a2-762c2ad220bf {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 01:59:59.402628 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-05666866-e1c2-4630-a2ee-ed6a01ee758e req-f165f476-01e6-4734-af39-84f898bfaf05 service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Refreshing instance network info cache due to event network-changed-3b1f76f9-cf49-4dea-b9a2-762c2ad220bf. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 01:59:59.402821 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-05666866-e1c2-4630-a2ee-ed6a01ee758e req-f165f476-01e6-4734-af39-84f898bfaf05 service nova] Acquiring lock "refresh_cache-64f1cde4-f11a-4da7-8bbc-aaf777432069" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 01:59:59.510243 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.99977704700018 future=<Future at 0x71c05853fd10 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 01:59:59.511921 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Instance destroyed successfully.
May 21 01:59:59.512478 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Lazy-loading 'resources' on Instance uuid cb319b5a-9797-421c-ad9d-2fd9a1aaba38 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 01:59:59.514163 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 01:59:59.591774 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8b33cd1d-5161-45c6-b138-71980cfd9dd6 req-6649279a-5f67-47c2-94bf-442fd20b78e4 service nova] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Detach interface failed, port_id=23851da2-f984-4946-af6d-2b652ff984e1, reason: Instance 800e7287-2ec0-48a2-b959-d7fbcc1f3c10 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 01:59:59.833555 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 01:59:59.863341 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:00.017582 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:59:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1810733260',display_name='tempest-DeleteServersTestJSON-server-1810733260',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-deleteserverstestjson-server-1810733260',id=21,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:59:45Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='73e8df58805f415fa39327f7f81e7852',ramdisk_id='',reservation_id='r-uchth4ca',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-411161592',owner_user_name='tempest-DeleteServersTestJSON-411161592-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:59:45Z,user_data=None,user_id='dc202b3265224b1186e34494436cb4b5',uuid=cb319b5a-9797-421c-ad9d-2fd9a1aaba38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20346b2b-b6d7-4a1a-a9fa-21aa6d702f17", "address": "fa:16:3e:b9:2c:dc", "network": {"id": "70208dc7-6706-4b4b-a35b-ad83c3826234", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1206266505-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73e8df58805f415fa39327f7f81e7852", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20346b2b-b6", "ovs_interfaceid": "20346b2b-b6d7-4a1a-a9fa-21aa6d702f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:00:00.018615 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Converting VIF {"id": "20346b2b-b6d7-4a1a-a9fa-21aa6d702f17", "address": "fa:16:3e:b9:2c:dc", "network": {"id": "70208dc7-6706-4b4b-a35b-ad83c3826234", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1206266505-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73e8df58805f415fa39327f7f81e7852", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20346b2b-b6", "ovs_interfaceid": "20346b2b-b6d7-4a1a-a9fa-21aa6d702f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:00:00.019293 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:2c:dc,bridge_name='br-int',has_traffic_filtering=True,id=20346b2b-b6d7-4a1a-a9fa-21aa6d702f17,network=Network(70208dc7-6706-4b4b-a35b-ad83c3826234),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20346b2b-b6') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:00:00.019572 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Took 1.57 seconds to deallocate network for instance.
May 21 02:00:00.022937 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:2c:dc,bridge_name='br-int',has_traffic_filtering=True,id=20346b2b-b6d7-4a1a-a9fa-21aa6d702f17,network=Network(70208dc7-6706-4b4b-a35b-ad83c3826234),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20346b2b-b6') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:00:00.023772 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:00.023957 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20346b2b-b6, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:00.025450 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:00.026336 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:00:00.028955 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:00.030897 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:00.031165 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=87a0c527-5b08-4734-88d2-0587de87abe2) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:00.032524 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:00.033200 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:00:00.036549 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:00.040407 np0000001127 nova-compute[98206]: INFO os_vif [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:2c:dc,bridge_name='br-int',has_traffic_filtering=True,id=20346b2b-b6d7-4a1a-a9fa-21aa6d702f17,network=Network(70208dc7-6706-4b4b-a35b-ad83c3826234),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20346b2b-b6')
May 21 02:00:00.048537 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:00:00.048873 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda', 'iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7cd2f86-88c0-4d0e-990a-73477eeafcda', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:00:00.049000 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:00:00.049381 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:00:00.049859 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda', 'iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7cd2f86-88c0-4d0e-990a-73477eeafcda', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:00:00.050086 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:00:00.063736 np0000001127 nova-compute[98206]: WARNING nova.volume.cinder [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Attachment cc856a04-548c-466d-80eb-0c84030431a1 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = cc856a04-548c-466d-80eb-0c84030431a1. (HTTP 404) (Request-ID: req-7b16d030-4084-4d53-81e8-ddf93f38fd49)
May 21 02:00:00.064509 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Took 0.04 seconds to detach 1 volumes for instance.
May 21 02:00:00.086898 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:00.086898 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:00.086898 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:00.086898 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:00.086898 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:00.086898 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:00.086898 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:00.086898 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:00.086898 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 02:00:00.086898 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 02:00:00.086898 np0000001127 nova-compute[98206]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda (non-flash)
May 21 02:00:00.086898 np0000001127 nova-compute[98206]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda (non-flash)
May 21 02:00:00.086898 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:00:00.087923 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:00.087923 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:00.087923 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:00.087923 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:00.087923 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:00.087923 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:00.087923 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:00.087923 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:00.087923 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 02:00:00.087923 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 02:00:00.087923 np0000001127 nova-compute[98206]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda (non-flash)
May 21 02:00:00.087923 np0000001127 nova-compute[98206]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda (non-flash)
May 21 02:00:00.087923 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:00:00.087923 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', '27'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6', '35'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', '41'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda', '45')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:00:00.087923 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda', '44')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:00:00.089563 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda', '45')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:00:00.090581 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c058566de0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda'): ({'sdp'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda'): ({'sdq'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:00:00.090806 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Removing multipathed devices sdq, sdp {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:00:00.091060 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Flush multipath device 3300000000eca1ff7 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:00:00.110077 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Updating instance_info_cache with network_info: [{"id": "29bf5645-d178-459e-b25f-1b1db9f87374", "address": "fa:16:3e:45:a2:37", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bf5645-d1", "ovs_interfaceid": "29bf5645-d178-459e-b25f-1b1db9f87374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:00:00.128953 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Remove SCSI device /dev/sdq with /sys/block/sdq/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:00:00.183955 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Remove SCSI device /dev/sdp with /sys/block/sdp/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:00:00.238912 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Checking to see if SCSI volumes sdq, sdp have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:00:00.239076 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] SCSI volumes sdq, sdp have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:00:00.240613 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Checking to see if device paths {'sdq', 'sdp'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:00:00.260018 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Device paths {'sdq', 'sdp'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:00:00.260211 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:00:00.274107 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:00.327056 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda, portal: 192.168.40.100,3260]
May 21 02:00:00.327056 np0000001127 nova-compute[98206]: Logout of [sid: 44, target: iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda, portal: 192.168.40.100,3260] successful.
May 21 02:00:00.327056 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:00.355319 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:00.368903 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:00.372452 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:00.404843 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda, portal: 192.168.50.100,3260]
May 21 02:00:00.404843 np0000001127 nova-compute[98206]: Logout of [sid: 45, target: iqn.2023-03.storpool.com:os--volume-e7cd2f86-88c0-4d0e-990a-73477eeafcda, portal: 192.168.50.100,3260] successful.
May 21 02:00:00.404843 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:00.430285 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:00.430561 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:00:00.430758 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] <== disconnect_volume: return (382ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:00:00.430827 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:00:00.431161 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Deleting instance files /opt/stack/data/nova/instances/cb319b5a-9797-421c-ad9d-2fd9a1aaba38_del
May 21 02:00:00.435087 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Deletion of /opt/stack/data/nova/instances/cb319b5a-9797-421c-ad9d-2fd9a1aaba38_del complete
May 21 02:00:00.554107 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:00:00.554107 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:00:00.570944 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:00.584880 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Updating instance_info_cache with network_info: [{"id": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "address": "fa:16:3e:12:66:8e", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1f76f9-cf", "ovs_interfaceid": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:00:00.612512 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Releasing lock "refresh_cache-66fe5d80-9012-44fe-9b82-1e993211ddf1" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:00:00.950364 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Took 1.82 seconds to destroy the instance on the hypervisor.
May 21 02:00:00.951153 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:00:00.952018 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:00:00.952130 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:00:00.952450 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:01.029480 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:01.058128 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:00:01.089501 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Releasing lock "refresh_cache-64f1cde4-f11a-4da7-8bbc-aaf777432069" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:00:01.089501 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:00:01.090832 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-05666866-e1c2-4630-a2ee-ed6a01ee758e req-f165f476-01e6-4734-af39-84f898bfaf05 service nova] Acquired lock "refresh_cache-64f1cde4-f11a-4da7-8bbc-aaf777432069" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:00:01.091420 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Creating image(s)
May 21 02:00:01.092623 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-05666866-e1c2-4630-a2ee-ed6a01ee758e req-f165f476-01e6-4734-af39-84f898bfaf05 service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Refreshing network info cache for port 3b1f76f9-cf49-4dea-b9a2-762c2ad220bf {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:00:01.093814 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "/opt/stack/data/nova/instances/64f1cde4-f11a-4da7-8bbc-aaf777432069/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:01.094176 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "/opt/stack/data/nova/instances/64f1cde4-f11a-4da7-8bbc-aaf777432069/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:01.095030 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "/opt/stack/data/nova/instances/64f1cde4-f11a-4da7-8bbc-aaf777432069/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:01.095241 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lazy-loading 'trusted_certs' on Instance uuid 64f1cde4-f11a-4da7-8bbc-aaf777432069 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:00:01.125445 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:00:01.141086 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:00:01.174187 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:01.251932 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:00:01.253345 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:00:01.271767 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:00:01.274455 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe9e:216', 'fe80::14d9:7bff:fe3b:f0dc', 'fe80::fc16:3eff:fee3:f7d2', 'fe80::6c2e:11ff:fea1:7eb7', 'fe80::fc16:3eff:fef8:14ac', 'fe80::c058:52ff:fed8:cd31', 'fe80::fc16:3eff:fe32:4418', 'fe80::fc16:3eff:fee6:5187', 'fe80::fc16:3eff:fe80:dd78', 'fe80::fc16:3eff:fe19:d5ae', 'fe80::fc16:3eff:fedb:3cf9', 'fe80::2040:23ff:febb:db06', 'fe80::fc16:3eff:fec9:a8b1', 'fe80::3003:9cff:fe70:ad4e', 'fe80::fc16:3eff:fe50:bfd8', 'fe80::fc16:3eff:fe23:65cb', 'fe80::fc16:3eff:fe76:c870', 'fe80::a403:4dff:fe5a:1b07'] 
May 21 02:00:01.274613 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:00:01.280825 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:00:01.280825 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:00:01.288817 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:01.508598 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f19c981c-70f4-41fe-b7f1-7a5bb6121b71 req-a222da1e-50ac-435c-aa38-281e4e188eef service nova] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Received event network-vif-unplugged-20346b2b-b6d7-4a1a-a9fa-21aa6d702f17 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:01.511260 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f19c981c-70f4-41fe-b7f1-7a5bb6121b71 req-a222da1e-50ac-435c-aa38-281e4e188eef service nova] Acquiring lock "cb319b5a-9797-421c-ad9d-2fd9a1aaba38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:01.511513 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f19c981c-70f4-41fe-b7f1-7a5bb6121b71 req-a222da1e-50ac-435c-aa38-281e4e188eef service nova] Lock "cb319b5a-9797-421c-ad9d-2fd9a1aaba38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:01.511700 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f19c981c-70f4-41fe-b7f1-7a5bb6121b71 req-a222da1e-50ac-435c-aa38-281e4e188eef service nova] Lock "cb319b5a-9797-421c-ad9d-2fd9a1aaba38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:01.512084 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f19c981c-70f4-41fe-b7f1-7a5bb6121b71 req-a222da1e-50ac-435c-aa38-281e4e188eef service nova] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] No waiting events found dispatching network-vif-unplugged-20346b2b-b6d7-4a1a-a9fa-21aa6d702f17 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:01.512084 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f19c981c-70f4-41fe-b7f1-7a5bb6121b71 req-a222da1e-50ac-435c-aa38-281e4e188eef service nova] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Received event network-vif-unplugged-20346b2b-b6d7-4a1a-a9fa-21aa6d702f17 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:00:01.512084 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f19c981c-70f4-41fe-b7f1-7a5bb6121b71 req-a222da1e-50ac-435c-aa38-281e4e188eef service nova] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Received event network-vif-unplugged-20346b2b-b6d7-4a1a-a9fa-21aa6d702f17 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:01.512283 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f19c981c-70f4-41fe-b7f1-7a5bb6121b71 req-a222da1e-50ac-435c-aa38-281e4e188eef service nova] Acquiring lock "cb319b5a-9797-421c-ad9d-2fd9a1aaba38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:01.512329 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f19c981c-70f4-41fe-b7f1-7a5bb6121b71 req-a222da1e-50ac-435c-aa38-281e4e188eef service nova] Lock "cb319b5a-9797-421c-ad9d-2fd9a1aaba38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:01.512613 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f19c981c-70f4-41fe-b7f1-7a5bb6121b71 req-a222da1e-50ac-435c-aa38-281e4e188eef service nova] Lock "cb319b5a-9797-421c-ad9d-2fd9a1aaba38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:01.512613 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f19c981c-70f4-41fe-b7f1-7a5bb6121b71 req-a222da1e-50ac-435c-aa38-281e4e188eef service nova] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] No waiting events found dispatching network-vif-unplugged-20346b2b-b6d7-4a1a-a9fa-21aa6d702f17 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:01.512857 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f19c981c-70f4-41fe-b7f1-7a5bb6121b71 req-a222da1e-50ac-435c-aa38-281e4e188eef service nova] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Received event network-vif-unplugged-20346b2b-b6d7-4a1a-a9fa-21aa6d702f17 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:00:01.569552 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.005s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:01.571119 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.998s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:01.572231 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:00:01.598353 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-05666866-e1c2-4630-a2ee-ed6a01ee758e req-f165f476-01e6-4734-af39-84f898bfaf05 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:01.605424 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Object Instance<64f1cde4-f11a-4da7-8bbc-aaf777432069> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:00:01.606420 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "1fdff60c8f60c986a510919159bc45db94cd4366" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:01.617505 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "1fdff60c8f60c986a510919159bc45db94cd4366" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.008s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:02.056915 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:00:02.092429 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:00:02.094728 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:00:02.094728 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:02.098536 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:02.347948 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd5b969d5a514d01bacfc7954a5ae4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83df9a84ffaa4398bdafbfbde079964d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:00:02.452743 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-05666866-e1c2-4630-a2ee-ed6a01ee758e req-f165f476-01e6-4734-af39-84f898bfaf05 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:02.572386 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Took 1.62 seconds to deallocate network for instance.
May 21 02:00:02.609737 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:00:02.683507 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Starting finish_migration {{(pid=98206) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 21 02:00:02.687050 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Instance directory exists: not creating {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 21 02:00:02.687050 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Creating image(s)
May 21 02:00:02.689751 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Did not create local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 21 02:00:02.689751 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Ensure instance console log exists: /opt/stack/data/nova/instances/66fe5d80-9012-44fe-9b82-1e993211ddf1/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:00:02.691522 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:02.691522 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:02.691522 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:02.693160 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Start _get_guest_xml network_info=[{"id": "29bf5645-d178-459e-b25f-1b1db9f87374", "address": "fa:16:3e:45:a2:37", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1391831945-network", "vif_mac": "fa:16:3e:45:a2:37"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bf5645-d1", "ovs_interfaceid": "29bf5645-d178-459e-b25f-1b1db9f87374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7721af1e-8f1d-4ffa-b905-045839f8645d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '66fe5d80-9012-44fe-9b82-1e993211ddf1', 'attached_at': '2026-05-21T02:00:01.000000', 'detached_at': '', 'volume_id': '7721af1e-8f1d-4ffa-b905-045839f8645d', 'serial': '7721af1e-8f1d-4ffa-b905-045839f8645d'}, 'delete_on_termination': True, 'attachment_id': '76131e99-6e94-4ff3-b724-26efecf2307e', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:00:02.700505 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:00:02.701768 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-1476667320', uuid='66fe5d80-9012-44fe-9b82-1e993211ddf1'), owner=OwnerMeta(userid='bbcd1a81252344dd804a4080571f8751', username='tempest-ServerActionsTestOtherA-1975191698-project-member', projectid='6a15fe7a70464159a778cffa4a36c36f', projectname='tempest-ServerActionsTestOtherA-1975191698'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "29bf5645-d178-459e-b25f-1b1db9f87374", "address": "fa:16:3e:45:a2:37", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1391831945-network", "vif_mac": "fa:16:3e:45:a2:37"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bf5645-d1", "ovs_interfaceid": "29bf5645-d178-459e-b25f-1b1db9f87374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328802.7008944) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:00:02.704727 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:00:02.704727 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:00:02.708321 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:00:02.708977 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:00:02.712777 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:00:02.713439 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:00:02.714180 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:00:02.715453 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:00:02.715635 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:00:02.715843 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:00:02.715980 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:00:02.716258 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:00:02.719519 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:00:02.719519 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:00:02.719519 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:00:02.719519 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:00:02.750191 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fe5d80-9012-44fe-9b82-1e993211ddf1/disk.config --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:02.825853 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-05666866-e1c2-4630-a2ee-ed6a01ee758e req-f165f476-01e6-4734-af39-84f898bfaf05 service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Updated VIF entry in instance network info cache for port 3b1f76f9-cf49-4dea-b9a2-762c2ad220bf. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:00:02.826800 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-05666866-e1c2-4630-a2ee-ed6a01ee758e req-f165f476-01e6-4734-af39-84f898bfaf05 service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Updating instance_info_cache with network_info: [{"id": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "address": "fa:16:3e:12:66:8e", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1f76f9-cf", "ovs_interfaceid": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:00:02.873768 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fe5d80-9012-44fe-9b82-1e993211ddf1/disk.config --force-share --output=json" returned: 0 in 0.124s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:02.874163 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "/opt/stack/data/nova/instances/66fe5d80-9012-44fe-9b82-1e993211ddf1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:02.874516 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "/opt/stack/data/nova/instances/66fe5d80-9012-44fe-9b82-1e993211ddf1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:02.875376 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "/opt/stack/data/nova/instances/66fe5d80-9012-44fe-9b82-1e993211ddf1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:02.875923 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:00:02.876458 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7721af1e-8f1d-4ffa-b905-045839f8645d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:00:02.876869 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:00:02.877543 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:00:02.877847 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7721af1e-8f1d-4ffa-b905-045839f8645d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:00:02.897171 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:00:02.899844 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:00:02.900948 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:00:02.901232 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:00:02.901943 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:00:02.902232 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:00:02.918967 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:00:02.918967 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:02.927305 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:00:02.927305 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:02.938618 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d] added
May 21 02:00:02.938618 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:00:02.938618 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:00:02.938618 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:00:02.938618 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:00:02.938618 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:00:02.938618 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:02.938618 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:00:02.938618 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0368(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:00:02.938618 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:00:02.948267 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d] added
May 21 02:00:02.948267 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:00:02.948267 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:00:02.948267 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:00:02.948267 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:00:02.948267 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:00:02.948267 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:02.948267 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:00:02.948667 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0461(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:00:02.948667 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:00:03.060442 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:00:03.061026 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:00:03.118907 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:00:03.190671 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Took 0.62 seconds to detach 1 volumes for instance.
May 21 02:00:03.341928 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-05666866-e1c2-4630-a2ee-ed6a01ee758e req-f165f476-01e6-4734-af39-84f898bfaf05 service nova] Releasing lock "refresh_cache-64f1cde4-f11a-4da7-8bbc-aaf777432069" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:00:03.353704 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:00:03.357522 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:00:03.357991 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fdff60c8f60c986a510919159bc45db94cd4366.part --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:03.385007 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Successfully created port: 6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:00:03.463264 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fdff60c8f60c986a510919159bc45db94cd4366.part --force-share --output=json" returned: 0 in 0.104s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:03.463264 np0000001127 nova-compute[98206]: DEBUG nova.virt.images [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] ac3ea09d-f213-4275-8c8d-1d15ec8aaeb5 was qcow2, converting to raw {{(pid=98206) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 21 02:00:03.463820 np0000001127 nova-compute[98206]: DEBUG nova.privsep.utils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 21 02:00:03.467004 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1fdff60c8f60c986a510919159bc45db94cd4366.part /opt/stack/data/nova/instances/_base/1fdff60c8f60c986a510919159bc45db94cd4366.converted {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:03.570395 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:00:03.600401 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-3b9fabda-f59b-4a64-81d5-b6030c44a785 req-94eac71a-2d6e-4685-bc39-674b18941904 service nova] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Received event network-vif-deleted-20346b2b-b6d7-4a1a-a9fa-21aa6d702f17 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:03.626942 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Booting with volume-backed-image 1545019a-a9af-4414-b299-e8f325be0886 at /dev/vda
May 21 02:00:03.697767 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:03.756432 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:03.841586 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1fdff60c8f60c986a510919159bc45db94cd4366.part /opt/stack/data/nova/instances/_base/1fdff60c8f60c986a510919159bc45db94cd4366.converted" returned: 0 in 0.377s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:03.856580 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fdff60c8f60c986a510919159bc45db94cd4366.converted --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:03.939381 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:00:03.949711 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:00:03.954158 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fdff60c8f60c986a510919159bc45db94cd4366.converted --force-share --output=json" returned: 0 in 0.098s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:00:03.957365 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:00:03.957365 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:03.960228 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "1fdff60c8f60c986a510919159bc45db94cd4366" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.343s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:03.960228 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:00:03.965868 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:00:03.968338 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fdff60c8f60c986a510919159bc45db94cd4366 --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:00:03.984981 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:00:03.984981 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:03.988537 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:04.002148 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:04.024301 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:04.024301 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:04.024301 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:04.024301 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:04.024301 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:04.024301 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:04.024301 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:04.024301 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:04.024301 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 02:00:04.024301 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 02:00:04.024301 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:00:04.024921 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:04.024921 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:04.024921 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:04.024921 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:04.024921 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:04.024921 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:04.024921 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:04.024921 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:04.024921 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 02:00:04.024921 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 02:00:04.024921 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:00:04.028982 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:04.028982 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:04.028982 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:04.028982 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:04.028982 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:04.028982 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:04.028982 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:04.028982 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:04.028982 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 02:00:04.028982 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 02:00:04.028982 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:00:04.029336 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:04.029336 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:04.029336 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:04.029336 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:04.029336 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:04.029336 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:04.029336 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:04.029336 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:04.029336 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 02:00:04.029336 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 02:00:04.029336 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:00:04.075277 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fdff60c8f60c986a510919159bc45db94cd4366 --force-share --output=json" returned: 0 in 0.107s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:04.076808 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "1fdff60c8f60c986a510919159bc45db94cd4366" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:04.077451 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "1fdff60c8f60c986a510919159bc45db94cd4366" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:04.078445 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:00:04.086180 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.516s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:04.088640 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.391s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:04.094904 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d, portal: 192.168.40.100,3260]
May 21 02:00:04.094904 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d, portal: 192.168.40.100,3260] successful.
May 21 02:00:04.094904 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:04.096453 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d, portal: 192.168.50.100,3260]
May 21 02:00:04.096453 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d, portal: 192.168.50.100,3260] successful.
May 21 02:00:04.096453 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:04.100012 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:00:04.103491 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fdff60c8f60c986a510919159bc45db94cd4366 --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:04.140299 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:04.141437 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:04.165252 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:04.165252 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:04.165252 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:04.165252 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:04.165252 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:04.165252 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:04.165252 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:04.165252 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:04.165252 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 02:00:04.165252 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 02:00:04.165252 np0000001127 nova-compute[98206]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:04.165252 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:04.165252 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:00:04.165993 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:04.165993 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:04.165993 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:04.165993 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:04.165993 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:04.165993 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:04.165993 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:04.165993 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:04.165993 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 02:00:04.165993 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 02:00:04.165993 np0000001127 nova-compute[98206]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:04.165993 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:04.165993 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:00:04.166502 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.267s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:00:04.166669 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:00:04.169824 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] HCTL ('7', '-', '-', 0) found on session 46 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:00:04.170292 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:00:04.176890 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Successfully updated port: 6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:00:04.182382 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:04.182382 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:04.182382 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:04.182382 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:04.182382 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:04.182382 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:04.182382 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:04.182382 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:04.182382 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 02:00:04.182382 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 02:00:04.182382 np0000001127 nova-compute[98206]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:04.182382 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:04.182382 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:00:04.182931 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:04.182931 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:04.182931 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:04.182931 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:04.182931 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:04.182931 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:04.182931 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:04.182931 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:04.182931 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 02:00:04.182931 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 02:00:04.182931 np0000001127 nova-compute[98206]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:04.182931 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:04.182931 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:00:04.183279 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.281s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:00:04.183361 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:00:04.184894 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] HCTL ('8', '-', '-', 0) found on session 47 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:00:04.185050 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:00:04.203796 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Searching for a device in session 46 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:00:04.203796 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7721af1e-8f1d-4ffa-b905-045839f8645d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:00:04.217311 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Searching for a device in session 47 and hctl ['8', '*', '*', 0] yield: None {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:00:04.218109 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Deleted allocations for instance 800e7287-2ec0-48a2-b959-d7fbcc1f3c10
May 21 02:00:04.223987 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fdff60c8f60c986a510919159bc45db94cd4366 --force-share --output=json" returned: 0 in 0.122s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:04.224350 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1fdff60c8f60c986a510919159bc45db94cd4366,backing_fmt=raw /opt/stack/data/nova/instances/64f1cde4-f11a-4da7-8bbc-aaf777432069/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:04.263710 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2f6c4126-3baa-4510-9187-06a37c4a66d6 req-87a96b20-7417-46ad-b89c-3c06c7aad525 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Received event network-changed-6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:04.264007 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2f6c4126-3baa-4510-9187-06a37c4a66d6 req-87a96b20-7417-46ad-b89c-3c06c7aad525 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Refreshing instance network info cache due to event network-changed-6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:00:04.264708 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2f6c4126-3baa-4510-9187-06a37c4a66d6 req-87a96b20-7417-46ad-b89c-3c06c7aad525 service nova] Acquiring lock "refresh_cache-61f5b839-7cd4-428d-8dc0-327effc695d8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:00:04.265079 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2f6c4126-3baa-4510-9187-06a37c4a66d6 req-87a96b20-7417-46ad-b89c-3c06c7aad525 service nova] Acquired lock "refresh_cache-61f5b839-7cd4-428d-8dc0-327effc695d8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:00:04.265079 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-2f6c4126-3baa-4510-9187-06a37c4a66d6 req-87a96b20-7417-46ad-b89c-3c06c7aad525 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Refreshing network info cache for port 6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:00:04.312210 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1fdff60c8f60c986a510919159bc45db94cd4366,backing_fmt=raw /opt/stack/data/nova/instances/64f1cde4-f11a-4da7-8bbc-aaf777432069/disk 1073741824" returned: 0 in 0.088s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:04.313691 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "1fdff60c8f60c986a510919159bc45db94cd4366" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:04.314044 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fdff60c8f60c986a510919159bc45db94cd4366 --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:04.436192 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fdff60c8f60c986a510919159bc45db94cd4366 --force-share --output=json" returned: 0 in 0.121s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:04.437682 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lazy-loading 'migration_context' on Instance uuid 64f1cde4-f11a-4da7-8bbc-aaf777432069 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:00:04.659550 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0006571229998826311 future=<Future at 0x71c0585b4050 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:00:04.660503 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Emitting event <LifecycleEvent: 1779328789.6586528, 07596a09-d614-48c6-849f-a306f65c7a5c => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:00:04.660830 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:00:04.661029 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=3.271957519999887 future=<Future at 0x71c05865c950 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:00:04.661803 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] VM Stopped (Lifecycle Event)
May 21 02:00:04.662724 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=3.270246648000011 future=<Future at 0x71c05865c950 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:00:04.681683 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "refresh_cache-61f5b839-7cd4-428d-8dc0-327effc695d8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:00:04.773399 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-2f6c4126-3baa-4510-9187-06a37c4a66d6 req-87a96b20-7417-46ad-b89c-3c06c7aad525 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:04.870905 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-2f6c4126-3baa-4510-9187-06a37c4a66d6 req-87a96b20-7417-46ad-b89c-3c06c7aad525 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:00:04.945503 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Object Instance<64f1cde4-f11a-4da7-8bbc-aaf777432069> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:00:04.945503 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Rebasing disk image.
May 21 02:00:04.945503 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:04.969601 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:00:04.970068 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:00:05.034119 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:05.057511 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.113s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:05.058024 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d -F raw /opt/stack/data/nova/instances/64f1cde4-f11a-4da7-8bbc-aaf777432069/disk {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:05.078588 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-2f6c4126-3baa-4510-9187-06a37c4a66d6 req-87a96b20-7417-46ad-b89c-3c06c7aad525 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:00:05.164959 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e2abb9d4-6ded-45c9-a97e-9241b06f5bf1 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 07596a09-d614-48c6-849f-a306f65c7a5c] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:00:05.213033 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Searching for a device in session 47 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:00:05.213370 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7721af1e-8f1d-4ffa-b905-045839f8645d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:00:05.231100 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5cb7c22a-edd9-4de7-8e2c-a21b8d5ab4c4 tempest-VolumesSnapshotTestJSON-315332802 tempest-VolumesSnapshotTestJSON-315332802-project-member] Lock "800e7287-2ec0-48a2-b959-d7fbcc1f3c10" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.723s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:05.480768 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:00:05.582745 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2f6c4126-3baa-4510-9187-06a37c4a66d6 req-87a96b20-7417-46ad-b89c-3c06c7aad525 service nova] Releasing lock "refresh_cache-61f5b839-7cd4-428d-8dc0-327effc695d8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:00:05.583410 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquired lock "refresh_cache-61f5b839-7cd4-428d-8dc0-327effc695d8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:00:05.583623 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:00:05.921125 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Found WWN 3300000007eb86ea1 for multipath device dm-0 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:00:05.921706 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.044s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:00:05.921832 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] <== connect_volume: return (3045ms) {'type': 'block', 'scsi_wwn': '3300000007eb86ea1', 'path': '/dev/dm-0', 'multipath_id': '3300000007eb86ea1'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:00:05.921989 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007eb86ea1', 'path': '/dev/dm-0', 'multipath_id': '3300000007eb86ea1'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:00:05.990518 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.899s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:06.065383 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Deleted allocations for instance cb319b5a-9797-421c-ad9d-2fd9a1aaba38
May 21 02:00:06.070833 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d -F raw /opt/stack/data/nova/instances/64f1cde4-f11a-4da7-8bbc-aaf777432069/disk" returned: 0 in 1.013s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:06.071991 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:00:06.071991 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Ensure instance console log exists: /opt/stack/data/nova/instances/64f1cde4-f11a-4da7-8bbc-aaf777432069/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:00:06.072411 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:06.072919 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:06.073113 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:06.075220 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Start _get_guest_xml network_info=[{"id": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "address": "fa:16:3e:12:66:8e", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1f76f9-cf", "ovs_interfaceid": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='ed462545b1e9a91ed234514ff9b78af3',container_format='bare',created_at=2026-05-21T01:59:32Z,direct_url=<?>,disk_format='qcow2',id=ac3ea09d-f213-4275-8c8d-1d15ec8aaeb5,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-826846662-shelved',owner='2e41dd931ff049868a61f52a251d1122',properties=ImageMetaProps,protected=<?>,size=54067200,status='active',tags=<?>,updated_at=2026-05-21T01:59:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:00:06.078460 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:00:06.080050 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-826846662', uuid='64f1cde4-f11a-4da7-8bbc-aaf777432069'), owner=OwnerMeta(userid='d91dda570ffb45489f81bd0c87e7fda6', username='tempest-AttachVolumeShelveTestJSON-826866539-project-member', projectid='2e41dd931ff049868a61f52a251d1122', projectname='tempest-AttachVolumeShelveTestJSON-826866539'), image=ImageMeta(id='ac3ea09d-f213-4275-8c8d-1d15ec8aaeb5', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "address": "fa:16:3e:12:66:8e", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1f76f9-cf", "ovs_interfaceid": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328806.079579) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:00:06.081329 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:00:06.081872 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:00:06.082811 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:00:06.082884 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:00:06.084068 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:00:06.084522 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='ed462545b1e9a91ed234514ff9b78af3',container_format='bare',created_at=2026-05-21T01:59:32Z,direct_url=<?>,disk_format='qcow2',id=ac3ea09d-f213-4275-8c8d-1d15ec8aaeb5,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-826846662-shelved',owner='2e41dd931ff049868a61f52a251d1122',properties=ImageMetaProps,protected=<?>,size=54067200,status='active',tags=<?>,updated_at=2026-05-21T01:59:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:00:06.085225 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:00:06.085403 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:00:06.088076 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:00:06.088187 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:00:06.088294 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:00:06.088707 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:00:06.088828 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:00:06.088940 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:00:06.089450 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:00:06.089450 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:00:06.089450 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lazy-loading 'vcpu_model' on Instance uuid 64f1cde4-f11a-4da7-8bbc-aaf777432069 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:00:06.154667 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:00:06.284537 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:06.310925 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:06.428988 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:59:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1476667320',display_name='tempest-ServerActionsTestOtherA-server-1476667320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001127',hostname='tempest-serveractionstestothera-server-1476667320',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxRidCAMyb/mDvqucBNL6o1pu4ohR9TfsTnx1DGEBK8Hs9Bxy4viDAtOuJAjHZZuWNRGwi0rwlQFKlYKc+oTj/M3U8o3nzcuoUHvHlwyO9ufXio2O1Y8v01hvWMmUCFbg==',key_name='tempest-keypair-631476445',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:59:39Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001127',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6a15fe7a70464159a778cffa4a36c36f',ramdisk_id='',reservation_id='r-szx080g8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1975191698',owner_user_name='tempest-ServerActionsTestOtherA-1975191698-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:59:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbcd1a81252344dd804a4080571f8751',uuid=66fe5d80-9012-44fe-9b82-1e993211ddf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29bf5645-d178-459e-b25f-1b1db9f87374", "address": "fa:16:3e:45:a2:37", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1391831945-network", "vif_mac": "fa:16:3e:45:a2:37"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bf5645-d1", "ovs_interfaceid": "29bf5645-d178-459e-b25f-1b1db9f87374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:00:06.429922 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Converting VIF {"id": "29bf5645-d178-459e-b25f-1b1db9f87374", "address": "fa:16:3e:45:a2:37", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1391831945-network", "vif_mac": "fa:16:3e:45:a2:37"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bf5645-d1", "ovs_interfaceid": "29bf5645-d178-459e-b25f-1b1db9f87374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:00:06.430198 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:a2:37,bridge_name='br-int',has_traffic_filtering=True,id=29bf5645-d178-459e-b25f-1b1db9f87374,network=Network(6d660724-85bf-45e3-895a-b9ce67043c30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29bf5645-d1') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:00:06.432212 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] End _get_guest_xml xml=<domain type="qemu">
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:   <uuid>66fe5d80-9012-44fe-9b82-1e993211ddf1</uuid>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:   <name>instance-00000012</name>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:   <memory>262144</memory>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:       <nova:name>tempest-ServerActionsTestOtherA-server-1476667320</nova:name>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:00:02</nova:creationTime>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.micro" id="84">
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:         <nova:memory>256</nova:memory>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:       <nova:image uuid="">
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:           <nova:property name="hw_machine_type">pc</nova:property>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:           <nova:property name="hw_video_model">virtio</nova:property>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:         <nova:user uuid="bbcd1a81252344dd804a4080571f8751">tempest-ServerActionsTestOtherA-1975191698-project-member</nova:user>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:         <nova:project uuid="6a15fe7a70464159a778cffa4a36c36f">tempest-ServerActionsTestOtherA-1975191698</nova:project>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:       <nova:root type="volume" uuid=""/>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:         <nova:port uuid="29bf5645-d178-459e-b25f-1b1db9f87374">
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:     <system>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:       <entry name="serial">66fe5d80-9012-44fe-9b82-1e993211ddf1</entry>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:       <entry name="uuid">66fe5d80-9012-44fe-9b82-1e993211ddf1</entry>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:     </system>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:   <os>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:   </os>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:   <features>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:   </features>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:   <devices>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/66fe5d80-9012-44fe-9b82-1e993211ddf1/disk.config"/>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:     </disk>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:       <alias name="ua-7721af1e-8f1d-4ffa-b905-045839f8645d"/>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-0"/>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:       <serial>7721af1e-8f1d-4ffa-b905-045839f8645d</serial>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:     </disk>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:45:a2:37"/>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:       <target dev="tap29bf5645-d1"/>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:     </interface>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/66fe5d80-9012-44fe-9b82-1e993211ddf1/console.log" append="off"/>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:     </serial>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:     <video>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:     </video>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:     </rng>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:   </devices>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]: </domain>
May 21 02:00:06.432212 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:00:06.435496 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:59:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1476667320',display_name='tempest-ServerActionsTestOtherA-server-1476667320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001127',hostname='tempest-serveractionstestothera-server-1476667320',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxRidCAMyb/mDvqucBNL6o1pu4ohR9TfsTnx1DGEBK8Hs9Bxy4viDAtOuJAjHZZuWNRGwi0rwlQFKlYKc+oTj/M3U8o3nzcuoUHvHlwyO9ufXio2O1Y8v01hvWMmUCFbg==',key_name='tempest-keypair-631476445',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:59:39Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001127',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6a15fe7a70464159a778cffa4a36c36f',ramdisk_id='',reservation_id='r-szx080g8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1975191698',owner_user_name='tempest-ServerActionsTestOtherA-1975191698-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:59:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbcd1a81252344dd804a4080571f8751',uuid=66fe5d80-9012-44fe-9b82-1e993211ddf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29bf5645-d178-459e-b25f-1b1db9f87374", "address": "fa:16:3e:45:a2:37", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1391831945-network", "vif_mac": "fa:16:3e:45:a2:37"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bf5645-d1", "ovs_interfaceid": "29bf5645-d178-459e-b25f-1b1db9f87374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:00:06.435496 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Converting VIF {"id": "29bf5645-d178-459e-b25f-1b1db9f87374", "address": "fa:16:3e:45:a2:37", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1391831945-network", "vif_mac": "fa:16:3e:45:a2:37"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bf5645-d1", "ovs_interfaceid": "29bf5645-d178-459e-b25f-1b1db9f87374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:00:06.435496 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:a2:37,bridge_name='br-int',has_traffic_filtering=True,id=29bf5645-d178-459e-b25f-1b1db9f87374,network=Network(6d660724-85bf-45e3-895a-b9ce67043c30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29bf5645-d1') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:00:06.435496 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:a2:37,bridge_name='br-int',has_traffic_filtering=True,id=29bf5645-d178-459e-b25f-1b1db9f87374,network=Network(6d660724-85bf-45e3-895a-b9ce67043c30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29bf5645-d1') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:00:06.435496 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:06.435496 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:06.435496 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:00:06.435496 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:06.435950 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1572cfb5-662c-5a3e-9797-e047b2421374', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:06.436463 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:06.437326 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:00:06.438198 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:06.440856 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:06.441044 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29bf5645-d1, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:06.441566 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap29bf5645-d1, col_values=(('qos', UUID('acd71d5c-8172-45bd-813b-172269cbbdc1')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:06.441628 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap29bf5645-d1, col_values=(('external_ids', {'iface-id': '29bf5645-d178-459e-b25f-1b1db9f87374', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:a2:37', 'vm-uuid': '66fe5d80-9012-44fe-9b82-1e993211ddf1'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:06.442771 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:06.444424 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:00:06.447064 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Updating instance_info_cache with network_info: [{"id": "6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20", "address": "fa:16:3e:7c:15:86", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c8ad0fa-79", "ovs_interfaceid": "6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:00:06.450131 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:06.450957 np0000001127 nova-compute[98206]: INFO os_vif [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:a2:37,bridge_name='br-int',has_traffic_filtering=True,id=29bf5645-d178-459e-b25f-1b1db9f87374,network=Network(6d660724-85bf-45e3-895a-b9ce67043c30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29bf5645-d1')
May 21 02:00:06.591691 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Object Instance<64f1cde4-f11a-4da7-8bbc-aaf777432069> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:00:06.603780 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-21T01:58:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-826846662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumeshelvetestjson-server-826846662',id=16,image_ref='ac3ea09d-f213-4275-8c8d-1d15ec8aaeb5',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1059394299',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:58:51Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2e41dd931ff049868a61f52a251d1122',ramdisk_id='',reservation_id='r-fbiukq5r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-826866539',owner_user_name='tempest-AttachVolumeShelveTestJSON-826866539-project-member',shelved_at='2026-05-21T01:59:40.547321',shelved_host='np0000001127',shelved_image_id='ac3ea09d-f213-4275-8c8d-1d15ec8aaeb5'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:59:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d91dda570ffb45489f81bd0c87e7fda6',uuid=64f1cde4-f11a-4da7-8bbc-aaf777432069,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "address": "fa:16:3e:12:66:8e", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1f76f9-cf", "ovs_interfaceid": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:00:06.604078 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Converting VIF {"id": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "address": "fa:16:3e:12:66:8e", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1f76f9-cf", "ovs_interfaceid": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:00:06.604451 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:66:8e,bridge_name='br-int',has_traffic_filtering=True,id=3b1f76f9-cf49-4dea-b9a2-762c2ad220bf,network=Network(084a1218-5c9f-4f1e-855b-53d284a5202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b1f76f9-cf') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:00:06.604958 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lazy-loading 'pci_devices' on Instance uuid 64f1cde4-f11a-4da7-8bbc-aaf777432069 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:00:06.949312 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Releasing lock "refresh_cache-61f5b839-7cd4-428d-8dc0-327effc695d8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:00:06.949584 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Instance network_info: |[{"id": "6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20", "address": "fa:16:3e:7c:15:86", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c8ad0fa-79", "ovs_interfaceid": "6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:00:07.074581 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3ec44c8d-61be-4f2a-800c-aef751e3e3d7 tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Lock "cb319b5a-9797-421c-ad9d-2fd9a1aaba38" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.458s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:07.106946 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Object Instance<64f1cde4-f11a-4da7-8bbc-aaf777432069> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:00:07.108208 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] End _get_guest_xml xml=<domain type="qemu">
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:   <uuid>64f1cde4-f11a-4da7-8bbc-aaf777432069</uuid>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:   <name>instance-00000010</name>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-826846662</nova:name>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:00:06</nova:creationTime>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:           <nova:property name="hw_machine_type">pc</nova:property>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:           <nova:property name="hw_video_model">virtio</nova:property>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:         <nova:user uuid="d91dda570ffb45489f81bd0c87e7fda6">tempest-AttachVolumeShelveTestJSON-826866539-project-member</nova:user>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:         <nova:project uuid="2e41dd931ff049868a61f52a251d1122">tempest-AttachVolumeShelveTestJSON-826866539</nova:project>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:         <nova:port uuid="3b1f76f9-cf49-4dea-b9a2-762c2ad220bf">
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:     <system>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:       <entry name="serial">64f1cde4-f11a-4da7-8bbc-aaf777432069</entry>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:       <entry name="uuid">64f1cde4-f11a-4da7-8bbc-aaf777432069</entry>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:     </system>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:   <os>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:   </os>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:   <features>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:   </features>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:   <devices>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/64f1cde4-f11a-4da7-8bbc-aaf777432069/disk"/>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:     </disk>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/64f1cde4-f11a-4da7-8bbc-aaf777432069/disk.config"/>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:     </disk>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:12:66:8e"/>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:       <target dev="tap3b1f76f9-cf"/>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:     </interface>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/64f1cde4-f11a-4da7-8bbc-aaf777432069/console.log" append="off"/>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:     </serial>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:     <video>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:     </video>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:     </rng>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:   </devices>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]: </domain>
May 21 02:00:07.108208 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:00:07.110289 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Preparing to wait for external event network-vif-plugged-3b1f76f9-cf49-4dea-b9a2-762c2ad220bf {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:00:07.110289 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "64f1cde4-f11a-4da7-8bbc-aaf777432069-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:07.110289 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "64f1cde4-f11a-4da7-8bbc-aaf777432069-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:07.110289 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "64f1cde4-f11a-4da7-8bbc-aaf777432069-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:07.110289 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-21T01:58:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-826846662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumeshelvetestjson-server-826846662',id=16,image_ref='ac3ea09d-f213-4275-8c8d-1d15ec8aaeb5',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1059394299',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:58:51Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2e41dd931ff049868a61f52a251d1122',ramdisk_id='',reservation_id='r-fbiukq5r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-826866539',owner_user_name='tempest-AttachVolumeShelveTestJSON-826866539-project-member',shelved_at='2026-05-21T01:59:40.547321',shelved_host='np0000001127',shelved_image_id='ac3ea09d-f213-4275-8c8d-1d15ec8aaeb5'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T01:59:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d91dda570ffb45489f81bd0c87e7fda6',uuid=64f1cde4-f11a-4da7-8bbc-aaf777432069,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "address": "fa:16:3e:12:66:8e", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1f76f9-cf", "ovs_interfaceid": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:00:07.110289 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Converting VIF {"id": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "address": "fa:16:3e:12:66:8e", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1f76f9-cf", "ovs_interfaceid": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:00:07.110729 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:66:8e,bridge_name='br-int',has_traffic_filtering=True,id=3b1f76f9-cf49-4dea-b9a2-762c2ad220bf,network=Network(084a1218-5c9f-4f1e-855b-53d284a5202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b1f76f9-cf') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:00:07.111005 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:66:8e,bridge_name='br-int',has_traffic_filtering=True,id=3b1f76f9-cf49-4dea-b9a2-762c2ad220bf,network=Network(084a1218-5c9f-4f1e-855b-53d284a5202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b1f76f9-cf') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:00:07.111429 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:07.111809 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:07.115917 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:00:07.117255 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:07.117549 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '08838d51-66a8-5094-828a-862c95438ce3', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:07.118443 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:07.119254 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:00:07.128344 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:07.130964 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:07.131211 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b1f76f9-cf, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:07.131651 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3b1f76f9-cf, col_values=(('qos', UUID('cd8dc0aa-b599-4150-a024-75667f2a4bb8')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:07.131842 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3b1f76f9-cf, col_values=(('external_ids', {'iface-id': '3b1f76f9-cf49-4dea-b9a2-762c2ad220bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:66:8e', 'vm-uuid': '64f1cde4-f11a-4da7-8bbc-aaf777432069'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:07.136811 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:07.138207 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:00:07.149485 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:07.150638 np0000001127 nova-compute[98206]: INFO os_vif [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:66:8e,bridge_name='br-int',has_traffic_filtering=True,id=3b1f76f9-cf49-4dea-b9a2-762c2ad220bf,network=Network(084a1218-5c9f-4f1e-855b-53d284a5202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b1f76f9-cf')
May 21 02:00:07.356000 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:00:07.370354 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:00:07.398061 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:07.449628 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:00:07.449864 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:00:07.458229 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:00:07.460412 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe9e:216', 'fe80::14d9:7bff:fe3b:f0dc', 'fe80::fc16:3eff:fee3:f7d2', 'fe80::6c2e:11ff:fea1:7eb7', 'fe80::fc16:3eff:fef8:14ac', 'fe80::c058:52ff:fed8:cd31', 'fe80::fc16:3eff:fe32:4418', 'fe80::fc16:3eff:fee6:5187', 'fe80::fc16:3eff:fe80:dd78', 'fe80::fc16:3eff:fe19:d5ae', 'fe80::fc16:3eff:fedb:3cf9', 'fe80::2040:23ff:febb:db06', 'fe80::fc16:3eff:fec9:a8b1', 'fe80::3003:9cff:fe70:ad4e', 'fe80::fc16:3eff:fe50:bfd8', 'fe80::fc16:3eff:fe23:65cb', 'fe80::fc16:3eff:fe76:c870', 'fe80::a403:4dff:fe5a:1b07'] 
May 21 02:00:07.460629 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:00:07.460807 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:00:07.461122 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:00:07.461645 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Updating existing volume attachment record: 9be66f95-802f-4017-b0d2-5cab6340cb42 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:00:07.933489 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0004954329999691254 future=<Future at 0x71c05865c950 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:00:07.933862 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:00:07.934001 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=4.43895389599993 future=<Future at 0x71c05853eea0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:00:07.934614 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Emitting event <LifecycleEvent: 1779328792.9328663, 66fe5d80-9012-44fe-9b82-1e993211ddf1 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:00:07.934836 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=4.438086839000107 future=<Future at 0x71c05853eea0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:00:07.936054 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] VM Stopped (Lifecycle Event)
May 21 02:00:07.976807 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:00:07.976943 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:00:07.977021 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] No VIF found with MAC fa:16:3e:45:a2:37, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:00:07.977524 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Using config drive
May 21 02:00:08.438888 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:00:08.458156 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:08.500514 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:08.593258 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:08.660457 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:08.668066 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:08.673037 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:00:08.673037 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:00:08.673037 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] No VIF found with MAC fa:16:3e:12:66:8e, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:00:08.673658 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Using config drive
May 21 02:00:08.800036 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-364a9003-560d-4b8f-a48a-1adff5e38f0f req-f0ae127d-d6cf-4f16-bbe5-ac563c8496b2 service nova] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Received event network-vif-plugged-29bf5645-d178-459e-b25f-1b1db9f87374 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:08.800936 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-364a9003-560d-4b8f-a48a-1adff5e38f0f req-f0ae127d-d6cf-4f16-bbe5-ac563c8496b2 service nova] Acquiring lock "66fe5d80-9012-44fe-9b82-1e993211ddf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:08.802601 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-364a9003-560d-4b8f-a48a-1adff5e38f0f req-f0ae127d-d6cf-4f16-bbe5-ac563c8496b2 service nova] Lock "66fe5d80-9012-44fe-9b82-1e993211ddf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:08.805172 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-364a9003-560d-4b8f-a48a-1adff5e38f0f req-f0ae127d-d6cf-4f16-bbe5-ac563c8496b2 service nova] Lock "66fe5d80-9012-44fe-9b82-1e993211ddf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:08.805751 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-364a9003-560d-4b8f-a48a-1adff5e38f0f req-f0ae127d-d6cf-4f16-bbe5-ac563c8496b2 service nova] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] No waiting events found dispatching network-vif-plugged-29bf5645-d178-459e-b25f-1b1db9f87374 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:08.805922 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-364a9003-560d-4b8f-a48a-1adff5e38f0f req-f0ae127d-d6cf-4f16-bbe5-ac563c8496b2 service nova] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Received unexpected event network-vif-plugged-29bf5645-d178-459e-b25f-1b1db9f87374 for instance with vm_state active and task_state resize_finish.
May 21 02:00:09.176175 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lazy-loading 'ec2_ids' on Instance uuid 64f1cde4-f11a-4da7-8bbc-aaf777432069 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:00:09.404334 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328809.4040012, 66fe5d80-9012-44fe-9b82-1e993211ddf1 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:00:09.405161 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Instance event wait completed in 0 seconds for  {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:00:09.406695 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] VM Resumed (Lifecycle Event)
May 21 02:00:09.409431 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Instance running successfully.
May 21 02:00:09.410875 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Failed to set time: agent not configured {{(pid=98206) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 21 02:00:09.411024 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8f69fd1e-9572-4457-b707-0fe9f30cbc94 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] finish_migration finished successfully. {{(pid=98206) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 21 02:00:09.621230 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:00:09.622556 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:00:09.622861 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Creating image(s)
May 21 02:00:09.623233 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Did not create local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 21 02:00:09.623392 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Ensure instance console log exists: /opt/stack/data/nova/instances/61f5b839-7cd4-428d-8dc0-327effc695d8/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:00:09.625358 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:09.625699 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:09.625857 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:09.626665 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Start _get_guest_xml network_info=[{"id": "6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20", "address": "fa:16:3e:7c:15:86", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c8ad0fa-79", "ovs_interfaceid": "6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53', 'iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8e307392-5cde-4d6a-a155-dfbc7af6ce53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '61f5b839-7cd4-428d-8dc0-327effc695d8', 'attached_at': '', 'detached_at': '', 'volume_id': '8e307392-5cde-4d6a-a155-dfbc7af6ce53', 'serial': '8e307392-5cde-4d6a-a155-dfbc7af6ce53'}, 'delete_on_termination': True, 'attachment_id': '9be66f95-802f-4017-b0d2-5cab6340cb42', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:00:09.628683 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:00:09.630203 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-2141638290', uuid='61f5b839-7cd4-428d-8dc0-327effc695d8'), owner=OwnerMeta(userid='bd5b969d5a514d01bacfc7954a5ae4ab', username='tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member', projectid='83df9a84ffaa4398bdafbfbde079964d', projectname='tempest-ServerBootFromVolumeStableRescueTest-260444396'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20", "address": "fa:16:3e:7c:15:86", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c8ad0fa-79", "ovs_interfaceid": "6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328809.6297956) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:00:09.631745 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:00:09.632117 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:00:09.632816 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:00:09.632996 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:00:09.634001 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:00:09.634521 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:00:09.634709 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:00:09.634822 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:00:09.634967 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:00:09.635146 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:00:09.635260 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:00:09.635430 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:00:09.635610 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:00:09.635947 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:00:09.635947 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:00:09.636010 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:00:09.657049 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:00:09.657451 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53', 'iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8e307392-5cde-4d6a-a155-dfbc7af6ce53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:00:09.657689 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:00:09.658043 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:00:09.658274 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53', 'iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8e307392-5cde-4d6a-a155-dfbc7af6ce53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:00:09.671230 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:00:09.671890 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:00:09.672565 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:00:09.672819 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:00:09.673383 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:00:09.673659 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:00:09.681089 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Object Instance<64f1cde4-f11a-4da7-8bbc-aaf777432069> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:00:09.681276 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lazy-loading 'keypairs' on Instance uuid 64f1cde4-f11a-4da7-8bbc-aaf777432069 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:00:09.690504 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:00:09.690504 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:09.698521 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:00:09.698521 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:09.712328 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53] added
May 21 02:00:09.712328 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:00:09.712328 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:00:09.712328 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:00:09.712328 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:00:09.712328 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:00:09.712328 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:09.712983 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:00:09.712983 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0392(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:00:09.713221 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:00:09.713874 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53] added
May 21 02:00:09.713874 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:00:09.713874 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:00:09.713874 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:00:09.713874 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:00:09.713874 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:00:09.713874 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:09.714141 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:00:09.714300 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0414(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:00:09.714418 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:00:09.908661 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:00:09.913348 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:00:10.183812 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Object Instance<64f1cde4-f11a-4da7-8bbc-aaf777432069> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:00:10.186564 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:10.210617 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:10.353672 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Creating config drive at /opt/stack/data/nova/instances/64f1cde4-f11a-4da7-8bbc-aaf777432069/disk.config
May 21 02:00:10.358616 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/64f1cde4-f11a-4da7-8bbc-aaf777432069/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp08xe13bg {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:10.415530 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 21 02:00:10.417989 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328810.4176965, 66fe5d80-9012-44fe-9b82-1e993211ddf1 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:00:10.418159 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] VM Started (Lifecycle Event)
May 21 02:00:10.424512 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/64f1cde4-f11a-4da7-8bbc-aaf777432069/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp08xe13bg" returned: 0 in 0.065s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:10.713760 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:00:10.715026 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:00:10.728044 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:00:10.728044 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:00:10.739263 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:00:10.739263 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:10.746697 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:10.753957 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:10.767988 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:10.767988 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:10.767988 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:10.767988 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:10.767988 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:10.767988 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:10.767988 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:10.767988 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:10.767988 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 02:00:10.767988 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 02:00:10.767988 np0000001127 nova-compute[98206]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:10.767988 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:10.767988 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:00:10.768481 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:10.768481 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:10.768481 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:10.768481 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:10.768481 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:10.768481 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:10.768481 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:10.768481 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:10.768481 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 02:00:10.768481 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 02:00:10.768481 np0000001127 nova-compute[98206]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:10.768481 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:10.768481 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:00:10.780725 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:10.780725 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:10.780725 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:10.780725 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:10.780725 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:10.780725 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:10.780725 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:10.780725 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:10.780725 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 02:00:10.780725 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 02:00:10.780725 np0000001127 nova-compute[98206]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:10.780725 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:10.780725 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:00:10.781141 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:10.781141 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:10.781141 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:10.781141 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:10.781141 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:10.781141 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:10.781141 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:10.781141 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:10.781141 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 02:00:10.781141 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 02:00:10.781141 np0000001127 nova-compute[98206]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:10.781141 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:10.781141 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:00:10.831314 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53, portal: 192.168.40.100,3260]
May 21 02:00:10.831314 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53, portal: 192.168.40.100,3260] successful.
May 21 02:00:10.831314 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:10.847448 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:10.857223 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53, portal: 192.168.50.100,3260]
May 21 02:00:10.857223 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53, portal: 192.168.50.100,3260] successful.
May 21 02:00:10.857223 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:10.873834 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:10.873834 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:10.873834 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:10.873834 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:10.873834 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:10.873834 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:10.873834 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:10.873834 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:10.873834 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 02:00:10.873834 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 02:00:10.873834 np0000001127 nova-compute[98206]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:10.873834 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:10.873834 np0000001127 nova-compute[98206]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:10.873834 np0000001127 nova-compute[98206]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:10.873834 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:00:10.873834 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:10.873834 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:10.873834 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:10.873834 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:10.873834 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:10.873834 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:10.873834 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:10.873834 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:10.873834 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 02:00:10.873834 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 02:00:10.873834 np0000001127 nova-compute[98206]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:10.873834 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:10.873834 np0000001127 nova-compute[98206]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:10.873834 np0000001127 nova-compute[98206]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:10.873834 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:00:10.880447 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.201s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:00:10.880447 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:00:10.880447 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:10.880447 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] HCTL ('19', '-', '-', 0) found on session 48 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:00:10.880447 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:00:10.905390 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Searching for a device in session 48 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:00:10.905390 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8e307392-5cde-4d6a-a155-dfbc7af6ce53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:00:10.908012 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:10.908012 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:10.908012 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:10.908012 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:10.908012 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:10.908012 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:10.908012 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:10.908012 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:10.908012 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 02:00:10.908012 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 02:00:10.908012 np0000001127 nova-compute[98206]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:10.908012 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:10.908012 np0000001127 nova-compute[98206]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:10.908012 np0000001127 nova-compute[98206]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:10.908012 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:00:10.908012 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:10.908012 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:10.908012 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:10.908012 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:10.908012 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:10.908012 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:10.908012 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:10.908012 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:10.908012 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 02:00:10.908012 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 02:00:10.908012 np0000001127 nova-compute[98206]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:10.908012 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:10.908012 np0000001127 nova-compute[98206]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:10.908012 np0000001127 nova-compute[98206]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:10.908012 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:00:10.909182 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.236s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:00:10.909182 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:00:10.910417 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] HCTL ('20', '-', '-', 0) found on session 49 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:00:10.910417 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:00:10.917760 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-51b63e96-52c1-4d43-9109-3cce85bb86cf req-5e2e241e-a2d6-493d-87c9-0df7e3ede2f6 service nova] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Received event network-vif-plugged-29bf5645-d178-459e-b25f-1b1db9f87374 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:10.917760 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-51b63e96-52c1-4d43-9109-3cce85bb86cf req-5e2e241e-a2d6-493d-87c9-0df7e3ede2f6 service nova] Acquiring lock "66fe5d80-9012-44fe-9b82-1e993211ddf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:10.917760 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-51b63e96-52c1-4d43-9109-3cce85bb86cf req-5e2e241e-a2d6-493d-87c9-0df7e3ede2f6 service nova] Lock "66fe5d80-9012-44fe-9b82-1e993211ddf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:10.917760 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-51b63e96-52c1-4d43-9109-3cce85bb86cf req-5e2e241e-a2d6-493d-87c9-0df7e3ede2f6 service nova] Lock "66fe5d80-9012-44fe-9b82-1e993211ddf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:10.917760 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-51b63e96-52c1-4d43-9109-3cce85bb86cf req-5e2e241e-a2d6-493d-87c9-0df7e3ede2f6 service nova] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] No waiting events found dispatching network-vif-plugged-29bf5645-d178-459e-b25f-1b1db9f87374 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:10.918079 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-51b63e96-52c1-4d43-9109-3cce85bb86cf req-5e2e241e-a2d6-493d-87c9-0df7e3ede2f6 service nova] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Received unexpected event network-vif-plugged-29bf5645-d178-459e-b25f-1b1db9f87374 for instance with vm_state resized and task_state None.
May 21 02:00:10.925207 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:00:10.933077 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Searching for a device in session 49 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:00:10.933077 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8e307392-5cde-4d6a-a155-dfbc7af6ce53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:00:10.946003 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:00:10.971475 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:11.006453 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:11.139211 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:11.287599 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:11.469535 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:11.471544 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:11.474985 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:11.482045 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-480c6251-26ab-4778-ab09-3207f444312a req-5776b539-8ef3-439f-8c42-0f3c796a404e service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Received event network-vif-plugged-3b1f76f9-cf49-4dea-b9a2-762c2ad220bf {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:11.482176 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-480c6251-26ab-4778-ab09-3207f444312a req-5776b539-8ef3-439f-8c42-0f3c796a404e service nova] Acquiring lock "64f1cde4-f11a-4da7-8bbc-aaf777432069-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:11.482316 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-480c6251-26ab-4778-ab09-3207f444312a req-5776b539-8ef3-439f-8c42-0f3c796a404e service nova] Lock "64f1cde4-f11a-4da7-8bbc-aaf777432069-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:11.482653 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-480c6251-26ab-4778-ab09-3207f444312a req-5776b539-8ef3-439f-8c42-0f3c796a404e service nova] Lock "64f1cde4-f11a-4da7-8bbc-aaf777432069-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:11.482653 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-480c6251-26ab-4778-ab09-3207f444312a req-5776b539-8ef3-439f-8c42-0f3c796a404e service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Processing event network-vif-plugged-3b1f76f9-cf49-4dea-b9a2-762c2ad220bf {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:00:11.504663 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:11.508935 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:11.673673 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:00:11.930515 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-79ef15e4-dfed-4fd5-b586-87363c2d44d0 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "66fe5d80-9012-44fe-9b82-1e993211ddf1" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:11.933083 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-79ef15e4-dfed-4fd5-b586-87363c2d44d0 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "66fe5d80-9012-44fe-9b82-1e993211ddf1" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:11.934777 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-79ef15e4-dfed-4fd5-b586-87363c2d44d0 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Going to confirm migration 1 {{(pid=98206) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 21 02:00:12.069669 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328812.0688844, 64f1cde4-f11a-4da7-8bbc-aaf777432069 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:00:12.069809 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:00:12.070053 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] VM Started (Lifecycle Event)
May 21 02:00:12.073354 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:00:12.078219 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Instance spawned successfully.
May 21 02:00:12.132794 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:12.374965 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0019456810000519908 future=<Future at 0x71c05853eea0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:00:12.375137 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:00:12.375137 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=2.1347102189999987 future=<Future at 0x71c05853fd10 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:00:12.376362 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=2.1346094220000396 future=<Future at 0x71c05853fd10 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:00:12.376362 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Emitting event <LifecycleEvent: 1779328797.3728466, 800e7287-2ec0-48a2-b959-d7fbcc1f3c10 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:00:12.376362 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] VM Stopped (Lifecycle Event)
May 21 02:00:12.441717 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-79ef15e4-dfed-4fd5-b586-87363c2d44d0 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:12.574488 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:00:12.581730 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:00:12.636437 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:00:12.686497 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-79ef15e4-dfed-4fd5-b586-87363c2d44d0 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:12.687515 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-79ef15e4-dfed-4fd5-b586-87363c2d44d0 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "refresh_cache-66fe5d80-9012-44fe-9b82-1e993211ddf1" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:00:12.687751 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-79ef15e4-dfed-4fd5-b586-87363c2d44d0 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquired lock "refresh_cache-66fe5d80-9012-44fe-9b82-1e993211ddf1" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:00:12.688646 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-79ef15e4-dfed-4fd5-b586-87363c2d44d0 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:00:12.689074 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-79ef15e4-dfed-4fd5-b586-87363c2d44d0 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lazy-loading 'info_cache' on Instance uuid 66fe5d80-9012-44fe-9b82-1e993211ddf1 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:00:12.696322 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Found WWN 33000000077b1ccd7 for multipath device dm-10 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:00:12.698069 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:00:12.698069 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '33000000077b1ccd7', 'path': '/dev/dm-10', 'multipath_id': '33000000077b1ccd7'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:00:12.698069 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000077b1ccd7', 'path': '/dev/dm-10', 'multipath_id': '33000000077b1ccd7'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:00:12.707904 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:12.880432 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e480aca8-ac72-42de-8b9f-e894b2511ef0 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 800e7287-2ec0-48a2-b959-d7fbcc1f3c10] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:00:13.084428 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:00:13.084902 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328813.0843165, 64f1cde4-f11a-4da7-8bbc-aaf777432069 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:00:13.084902 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] VM Paused (Lifecycle Event)
May 21 02:00:13.151420 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e11f3951-ee18-47a2-b996-a1d13e4dd117 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "64f1cde4-f11a-4da7-8bbc-aaf777432069" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 22.707s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:13.220505 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T01:59:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2141638290',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serverbootfromvolumestablerescuetest-server-2141638290',id=22,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83df9a84ffaa4398bdafbfbde079964d',ramdisk_id='',reservation_id='r-fiump4ea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-260444396',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:00:03Z,user_data=None,user_id='bd5b969d5a514d01bacfc7954a5ae4ab',uuid=61f5b839-7cd4-428d-8dc0-327effc695d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20", "address": "fa:16:3e:7c:15:86", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c8ad0fa-79", "ovs_interfaceid": "6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:00:13.220505 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Converting VIF {"id": "6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20", "address": "fa:16:3e:7c:15:86", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c8ad0fa-79", "ovs_interfaceid": "6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:00:13.220505 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:15:86,bridge_name='br-int',has_traffic_filtering=True,id=6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20,network=Network(b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c8ad0fa-79') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:00:13.220972 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lazy-loading 'pci_devices' on Instance uuid 61f5b839-7cd4-428d-8dc0-327effc695d8 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:00:13.556169 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b0e00565-ae76-47c3-8693-a421fe8364c4 req-9501c18b-9995-4324-b55b-ec16d408121e service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Received event network-vif-plugged-3b1f76f9-cf49-4dea-b9a2-762c2ad220bf {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:13.556400 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b0e00565-ae76-47c3-8693-a421fe8364c4 req-9501c18b-9995-4324-b55b-ec16d408121e service nova] Acquiring lock "64f1cde4-f11a-4da7-8bbc-aaf777432069-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:13.556716 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b0e00565-ae76-47c3-8693-a421fe8364c4 req-9501c18b-9995-4324-b55b-ec16d408121e service nova] Lock "64f1cde4-f11a-4da7-8bbc-aaf777432069-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:13.556906 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b0e00565-ae76-47c3-8693-a421fe8364c4 req-9501c18b-9995-4324-b55b-ec16d408121e service nova] Lock "64f1cde4-f11a-4da7-8bbc-aaf777432069-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:13.557076 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b0e00565-ae76-47c3-8693-a421fe8364c4 req-9501c18b-9995-4324-b55b-ec16d408121e service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] No waiting events found dispatching network-vif-plugged-3b1f76f9-cf49-4dea-b9a2-762c2ad220bf {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:13.557239 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-b0e00565-ae76-47c3-8693-a421fe8364c4 req-9501c18b-9995-4324-b55b-ec16d408121e service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Received unexpected event network-vif-plugged-3b1f76f9-cf49-4dea-b9a2-762c2ad220bf for instance with vm_state active and task_state None.
May 21 02:00:13.587420 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:00:13.590033 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328813.5891492, 64f1cde4-f11a-4da7-8bbc-aaf777432069 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:00:13.590033 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] VM Resumed (Lifecycle Event)
May 21 02:00:13.701130 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-79ef15e4-dfed-4fd5-b586-87363c2d44d0 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:13.726499 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] End _get_guest_xml xml=<domain type="qemu">
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:   <uuid>61f5b839-7cd4-428d-8dc0-327effc695d8</uuid>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:   <name>instance-00000016</name>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2141638290</nova:name>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:00:09</nova:creationTime>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:         <nova:user uuid="bd5b969d5a514d01bacfc7954a5ae4ab">tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member</nova:user>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:         <nova:project uuid="83df9a84ffaa4398bdafbfbde079964d">tempest-ServerBootFromVolumeStableRescueTest-260444396</nova:project>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:         <nova:port uuid="6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20">
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:     <system>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:       <entry name="serial">61f5b839-7cd4-428d-8dc0-327effc695d8</entry>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:       <entry name="uuid">61f5b839-7cd4-428d-8dc0-327effc695d8</entry>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:     </system>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:   <os>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:   </os>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:   <features>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:   </features>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:   <devices>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/61f5b839-7cd4-428d-8dc0-327effc695d8/disk.config"/>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:     </disk>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:       <alias name="ua-8e307392-5cde-4d6a-a155-dfbc7af6ce53"/>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-10"/>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:       <serial>8e307392-5cde-4d6a-a155-dfbc7af6ce53</serial>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:     </disk>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:7c:15:86"/>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:       <target dev="tap6c8ad0fa-79"/>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:     </interface>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/61f5b839-7cd4-428d-8dc0-327effc695d8/console.log" append="off"/>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:     </serial>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:     <video>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:     </video>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:     </rng>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:   </devices>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]: </domain>
May 21 02:00:13.726499 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:00:13.726499 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Preparing to wait for external event network-vif-plugged-6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:00:13.726499 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:13.726499 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:13.726499 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:13.728808 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T01:59:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2141638290',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serverbootfromvolumestablerescuetest-server-2141638290',id=22,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83df9a84ffaa4398bdafbfbde079964d',ramdisk_id='',reservation_id='r-fiump4ea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-260444396',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:00:03Z,user_data=None,user_id='bd5b969d5a514d01bacfc7954a5ae4ab',uuid=61f5b839-7cd4-428d-8dc0-327effc695d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20", "address": "fa:16:3e:7c:15:86", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c8ad0fa-79", "ovs_interfaceid": "6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:00:13.728808 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Converting VIF {"id": "6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20", "address": "fa:16:3e:7c:15:86", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c8ad0fa-79", "ovs_interfaceid": "6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:00:13.732493 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:15:86,bridge_name='br-int',has_traffic_filtering=True,id=6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20,network=Network(b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c8ad0fa-79') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:00:13.732493 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:15:86,bridge_name='br-int',has_traffic_filtering=True,id=6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20,network=Network(b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c8ad0fa-79') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:00:13.732493 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:13.732493 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:13.732493 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:00:13.732493 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:13.732493 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bf519af0-19ae-57f4-8f14-ed7da788c5b3', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:13.733178 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:13.734350 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:00:13.744673 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:13.744918 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c8ad0fa-79, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:13.745315 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6c8ad0fa-79, col_values=(('qos', UUID('d05358f8-a710-497b-89e1-2a604b1a310b')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:13.745535 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6c8ad0fa-79, col_values=(('external_ids', {'iface-id': '6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:15:86', 'vm-uuid': '61f5b839-7cd4-428d-8dc0-327effc695d8'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:13.747139 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:13.751714 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:00:13.753530 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:13.754606 np0000001127 nova-compute[98206]: INFO os_vif [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:15:86,bridge_name='br-int',has_traffic_filtering=True,id=6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20,network=Network(b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c8ad0fa-79')
May 21 02:00:14.092612 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:00:14.097681 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-79ef15e4-dfed-4fd5-b586-87363c2d44d0 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:14.099676 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:00:14.318101 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-79ef15e4-dfed-4fd5-b586-87363c2d44d0 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Updating instance_info_cache with network_info: [{"id": "29bf5645-d178-459e-b25f-1b1db9f87374", "address": "fa:16:3e:45:a2:37", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bf5645-d1", "ovs_interfaceid": "29bf5645-d178-459e-b25f-1b1db9f87374", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:00:14.510239 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.00036311599978944287 future=<Future at 0x71c05853fd10 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:00:14.514605 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:00:14.514605 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Emitting event <LifecycleEvent: 1779328799.5097718, cb319b5a-9797-421c-ad9d-2fd9a1aaba38 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:00:14.514605 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] VM Stopped (Lifecycle Event)
May 21 02:00:14.823597 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-79ef15e4-dfed-4fd5-b586-87363c2d44d0 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Releasing lock "refresh_cache-66fe5d80-9012-44fe-9b82-1e993211ddf1" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:00:14.823773 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-79ef15e4-dfed-4fd5-b586-87363c2d44d0 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lazy-loading 'migration_context' on Instance uuid 66fe5d80-9012-44fe-9b82-1e993211ddf1 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:00:15.015260 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: cb319b5a-9797-421c-ad9d-2fd9a1aaba38] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:00:15.290538 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:00:15.290959 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:00:15.290959 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] No VIF found with MAC fa:16:3e:7c:15:86, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:00:15.291393 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Using config drive
May 21 02:00:15.325068 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:15.326628 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-79ef15e4-dfed-4fd5-b586-87363c2d44d0 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Object Instance<66fe5d80-9012-44fe-9b82-1e993211ddf1> lazy-loaded attributes: info_cache,migration_context {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:00:15.327997 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-79ef15e4-dfed-4fd5-b586-87363c2d44d0 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:15.328135 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-79ef15e4-dfed-4fd5-b586-87363c2d44d0 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:15.743883 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:15.797634 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:16.052782 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Creating config drive at /opt/stack/data/nova/instances/61f5b839-7cd4-428d-8dc0-327effc695d8/disk.config
May 21 02:00:16.056646 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/61f5b839-7cd4-428d-8dc0-327effc695d8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2bxmiqn3 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:16.123092 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/61f5b839-7cd4-428d-8dc0-327effc695d8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2bxmiqn3" returned: 0 in 0.066s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:16.289710 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:16.521738 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-79ef15e4-dfed-4fd5-b586-87363c2d44d0 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:00:16.522108 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-79ef15e4-dfed-4fd5-b586-87363c2d44d0 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:00:16.665745 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:16.700423 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:16.705712 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:16.815446 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:16.872347 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:16.873916 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:17.026408 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-79ef15e4-dfed-4fd5-b586-87363c2d44d0 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:00:17.202977 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c0404f60-fc01-43d5-9050-340bc654b982 req-df19f71c-5fea-4b92-86e1-3e53f3655de5 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Received event network-vif-plugged-6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:17.202977 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c0404f60-fc01-43d5-9050-340bc654b982 req-df19f71c-5fea-4b92-86e1-3e53f3655de5 service nova] Acquiring lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:17.202977 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c0404f60-fc01-43d5-9050-340bc654b982 req-df19f71c-5fea-4b92-86e1-3e53f3655de5 service nova] Lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:17.202977 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c0404f60-fc01-43d5-9050-340bc654b982 req-df19f71c-5fea-4b92-86e1-3e53f3655de5 service nova] Lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:17.202977 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c0404f60-fc01-43d5-9050-340bc654b982 req-df19f71c-5fea-4b92-86e1-3e53f3655de5 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Processing event network-vif-plugged-6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:00:17.740667 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:00:17.742014 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328817.7409081, 61f5b839-7cd4-428d-8dc0-327effc695d8 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:00:17.742284 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] VM Started (Lifecycle Event)
May 21 02:00:17.750850 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:00:17.754303 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Instance spawned successfully.
May 21 02:00:17.754928 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:00:17.763691 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:18.045820 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-79ef15e4-dfed-4fd5-b586-87363c2d44d0 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.715s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:18.248137 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:00:18.255741 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:00:18.264430 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:00:18.264617 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:00:18.264973 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:00:18.265194 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:00:18.265450 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:00:18.265776 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:00:18.746580 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-79ef15e4-dfed-4fd5-b586-87363c2d44d0 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Deleted allocation for migration d91cd6ac-36a6-4061-bb3d-b315e844b573
May 21 02:00:18.754403 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:18.763019 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:00:18.763228 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328818.7630649, 61f5b839-7cd4-428d-8dc0-327effc695d8 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:00:18.763326 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] VM Paused (Lifecycle Event)
May 21 02:00:18.772849 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Took 9.15 seconds to spawn the instance on the hypervisor.
May 21 02:00:18.773232 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:00:19.259432 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-79ef15e4-dfed-4fd5-b586-87363c2d44d0 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "66fe5d80-9012-44fe-9b82-1e993211ddf1" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 7.327s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:19.267602 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:00:19.275548 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328819.2752104, 61f5b839-7cd4-428d-8dc0-327effc695d8 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:00:19.275752 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] VM Resumed (Lifecycle Event)
May 21 02:00:19.287123 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a444fc55-5c23-4628-8f85-564fd1b680e7 req-7786db49-655d-4a6b-87a9-312f2404f8dc service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Received event network-vif-plugged-6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:19.290127 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a444fc55-5c23-4628-8f85-564fd1b680e7 req-7786db49-655d-4a6b-87a9-312f2404f8dc service nova] Acquiring lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:19.290864 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a444fc55-5c23-4628-8f85-564fd1b680e7 req-7786db49-655d-4a6b-87a9-312f2404f8dc service nova] Lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:19.292822 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a444fc55-5c23-4628-8f85-564fd1b680e7 req-7786db49-655d-4a6b-87a9-312f2404f8dc service nova] Lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:19.292822 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a444fc55-5c23-4628-8f85-564fd1b680e7 req-7786db49-655d-4a6b-87a9-312f2404f8dc service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] No waiting events found dispatching network-vif-plugged-6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:19.292822 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-a444fc55-5c23-4628-8f85-564fd1b680e7 req-7786db49-655d-4a6b-87a9-312f2404f8dc service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Received unexpected event network-vif-plugged-6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 for instance with vm_state active and task_state None.
May 21 02:00:19.295823 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Took 26.02 seconds to build instance.
May 21 02:00:19.655844 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-b8d31afe-04c7-417e-95e6-06786662651c tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Get console output
May 21 02:00:19.735034 np0000001127 nova-compute[98206]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
May 21 02:00:19.780776 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:00:19.783036 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:00:19.797351 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "61f5b839-7cd4-428d-8dc0-327effc695d8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.537s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:21.292437 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:21.362616 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-ec392c94-c579-4aa0-a404-6bd996f32a3a req-31bb0e2a-b24e-4dd1-94d6-5d0bc8a23adc service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Received event network-changed-d99a2cf4-260b-4ca3-b72e-7db23358b831 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:21.362733 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-ec392c94-c579-4aa0-a404-6bd996f32a3a req-31bb0e2a-b24e-4dd1-94d6-5d0bc8a23adc service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Refreshing instance network info cache due to event network-changed-d99a2cf4-260b-4ca3-b72e-7db23358b831. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:00:21.363349 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ec392c94-c579-4aa0-a404-6bd996f32a3a req-31bb0e2a-b24e-4dd1-94d6-5d0bc8a23adc service nova] Acquiring lock "refresh_cache-a6839691-a7ec-4dea-bc39-a7e89c94cf4d" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:00:21.363349 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ec392c94-c579-4aa0-a404-6bd996f32a3a req-31bb0e2a-b24e-4dd1-94d6-5d0bc8a23adc service nova] Acquired lock "refresh_cache-a6839691-a7ec-4dea-bc39-a7e89c94cf4d" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:00:21.363349 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-ec392c94-c579-4aa0-a404-6bd996f32a3a req-31bb0e2a-b24e-4dd1-94d6-5d0bc8a23adc service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Refreshing network info cache for port d99a2cf4-260b-4ca3-b72e-7db23358b831 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:00:21.527183 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Rescuing
May 21 02:00:21.527330 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "refresh_cache-61f5b839-7cd4-428d-8dc0-327effc695d8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:00:21.527389 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquired lock "refresh_cache-61f5b839-7cd4-428d-8dc0-327effc695d8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:00:21.527559 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:00:21.794313 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c706a793-10ab-4f01-9eb0-2a46fa7e2161 req-46c56b15-cf7b-4e8d-8be3-49ee4e88ec60 service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Received event network-changed-d99a2cf4-260b-4ca3-b72e-7db23358b831 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:21.794313 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c706a793-10ab-4f01-9eb0-2a46fa7e2161 req-46c56b15-cf7b-4e8d-8be3-49ee4e88ec60 service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Refreshing instance network info cache due to event network-changed-d99a2cf4-260b-4ca3-b72e-7db23358b831. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:00:21.794313 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c706a793-10ab-4f01-9eb0-2a46fa7e2161 req-46c56b15-cf7b-4e8d-8be3-49ee4e88ec60 service nova] Acquiring lock "refresh_cache-a6839691-a7ec-4dea-bc39-a7e89c94cf4d" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:00:21.865333 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-ec392c94-c579-4aa0-a404-6bd996f32a3a req-31bb0e2a-b24e-4dd1-94d6-5d0bc8a23adc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:22.030069 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:22.286354 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-ec392c94-c579-4aa0-a404-6bd996f32a3a req-31bb0e2a-b24e-4dd1-94d6-5d0bc8a23adc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:22.461318 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:22.461836 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:22.493069 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-ec392c94-c579-4aa0-a404-6bd996f32a3a req-31bb0e2a-b24e-4dd1-94d6-5d0bc8a23adc service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Updated VIF entry in instance network info cache for port d99a2cf4-260b-4ca3-b72e-7db23358b831. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:00:22.493266 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-ec392c94-c579-4aa0-a404-6bd996f32a3a req-31bb0e2a-b24e-4dd1-94d6-5d0bc8a23adc service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Updating instance_info_cache with network_info: [{"id": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "address": "fa:16:3e:76:c8:70", "network": {"id": "7cdbc224-429f-49a6-86f3-307f51e53dfc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2078432126-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc797708a5a7400992765e41ee6ec260", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99a2cf4-26", "ovs_interfaceid": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:00:22.508038 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:22.656219 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Updating instance_info_cache with network_info: [{"id": "6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20", "address": "fa:16:3e:7c:15:86", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c8ad0fa-79", "ovs_interfaceid": "6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:00:22.967258 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Detaching volume 51b4adb6-eb47-40ee-a8ab-9a7ee5901253
May 21 02:00:22.998912 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ec392c94-c579-4aa0-a404-6bd996f32a3a req-31bb0e2a-b24e-4dd1-94d6-5d0bc8a23adc service nova] Releasing lock "refresh_cache-a6839691-a7ec-4dea-bc39-a7e89c94cf4d" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:00:22.999843 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c706a793-10ab-4f01-9eb0-2a46fa7e2161 req-46c56b15-cf7b-4e8d-8be3-49ee4e88ec60 service nova] Acquired lock "refresh_cache-a6839691-a7ec-4dea-bc39-a7e89c94cf4d" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:00:22.999989 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-c706a793-10ab-4f01-9eb0-2a46fa7e2161 req-46c56b15-cf7b-4e8d-8be3-49ee4e88ec60 service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Refreshing network info cache for port d99a2cf4-260b-4ca3-b72e-7db23358b831 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:00:23.032175 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Attempting to driver detach volume 51b4adb6-eb47-40ee-a8ab-9a7ee5901253 from mountpoint /dev/vdb
May 21 02:00:23.036005 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Found disk vdb by alias ua-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:00:23.037285 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Found disk vdb by alias ua-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:00:23.037514 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Attempting to detach device vdb from instance a6839691-a7ec-4dea-bc39-a7e89c94cf4d from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 02:00:23.038017 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:00:23.038017 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:00:23.038017 np0000001127 nova-compute[98206]:   <alias name="ua-51b4adb6-eb47-40ee-a8ab-9a7ee5901253"/>
May 21 02:00:23.038017 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-9"/>
May 21 02:00:23.038017 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:00:23.038017 np0000001127 nova-compute[98206]:   <serial>51b4adb6-eb47-40ee-a8ab-9a7ee5901253</serial>
May 21 02:00:23.038017 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 21 02:00:23.038017 np0000001127 nova-compute[98206]: </disk>
May 21 02:00:23.038017 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:00:23.049846 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Successfully detached device vdb from instance a6839691-a7ec-4dea-bc39-a7e89c94cf4d from the persistent domain config.
May 21 02:00:23.049991 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] (1/8): Attempting to detach device vdb with device alias ua-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 from instance a6839691-a7ec-4dea-bc39-a7e89c94cf4d from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 02:00:23.051013 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:00:23.051013 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:00:23.051013 np0000001127 nova-compute[98206]:   <alias name="ua-51b4adb6-eb47-40ee-a8ab-9a7ee5901253"/>
May 21 02:00:23.051013 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-9"/>
May 21 02:00:23.051013 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:00:23.051013 np0000001127 nova-compute[98206]:   <serial>51b4adb6-eb47-40ee-a8ab-9a7ee5901253</serial>
May 21 02:00:23.051013 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 21 02:00:23.051013 np0000001127 nova-compute[98206]: </disk>
May 21 02:00:23.051013 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:00:23.077342 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Acquiring lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:23.077651 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:23.158608 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Releasing lock "refresh_cache-61f5b839-7cd4-428d-8dc0-327effc695d8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:00:23.504578 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-c706a793-10ab-4f01-9eb0-2a46fa7e2161 req-46c56b15-cf7b-4e8d-8be3-49ee4e88ec60 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:23.588387 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:00:23.756575 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:23.773874 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:23.785643 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779328823.7850938, a6839691-a7ec-4dea-bc39-a7e89c94cf4d => ua-51b4adb6-eb47-40ee-a8ab-9a7ee5901253> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 02:00:23.786033 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 for instance a6839691-a7ec-4dea-bc39-a7e89c94cf4d {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 02:00:23.791723 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Successfully detached device vdb from instance a6839691-a7ec-4dea-bc39-a7e89c94cf4d from the live domain config.
May 21 02:00:23.794087 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:00:23.795253 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '51b4adb6-eb47-40ee-a8ab-9a7ee5901253', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:00:23.795253 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:00:23.796418 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:00:23.797079 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '51b4adb6-eb47-40ee-a8ab-9a7ee5901253', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:00:23.797285 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:00:23.846568 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:23.846568 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:23.846568 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:23.846568 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:23.846568 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:23.846568 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:23.846568 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:23.846568 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:23.846568 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 02:00:23.846568 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 02:00:23.846568 np0000001127 nova-compute[98206]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:23.846568 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:23.846568 np0000001127 nova-compute[98206]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:23.846568 np0000001127 nova-compute[98206]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:23.846568 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:00:23.847141 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:23.847141 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:23.847141 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:23.847141 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:23.847141 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:23.847141 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:23.847141 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:23.847141 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:23.847141 np0000001127 nova-compute[98206]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 02:00:23.847141 np0000001127 nova-compute[98206]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253 (non-flash)
May 21 02:00:23.847141 np0000001127 nova-compute[98206]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:23.847141 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:23.847141 np0000001127 nova-compute[98206]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:23.847141 np0000001127 nova-compute[98206]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:23.847141 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:00:23.847141 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', '27'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6', '35'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', '41'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53', '48'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53', '49')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:00:23.847141 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', '40')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:00:23.848783 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253', '41')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:00:23.851958 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c0585756c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253'): ({'sdk'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:00:23.852192 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Removing multipathed devices sdk, sdj {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:00:23.852436 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Flush multipath device 3300000009b658662 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:00:23.889355 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:00:23.935504 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:00:23.979234 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:00:23.979402 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:00:23.980974 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:00:23.997524 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:00:23.997772 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:00:24.011349 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-c706a793-10ab-4f01-9eb0-2a46fa7e2161 req-46c56b15-cf7b-4e8d-8be3-49ee4e88ec60 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:24.013830 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:24.051870 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253, portal: 192.168.40.100,3260]
May 21 02:00:24.051870 np0000001127 nova-compute[98206]: Logout of [sid: 40, target: iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253, portal: 192.168.40.100,3260] successful.
May 21 02:00:24.051870 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:24.082965 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:24.095986 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:24.140224 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253, portal: 192.168.50.100,3260]
May 21 02:00:24.140224 np0000001127 nova-compute[98206]: Logout of [sid: 41, target: iqn.2023-03.storpool.com:os--volume-51b4adb6-eb47-40ee-a8ab-9a7ee5901253, portal: 192.168.50.100,3260] successful.
May 21 02:00:24.140224 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:24.166990 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:24.167195 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:00:24.167298 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] <== disconnect_volume: return (372ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:00:24.167414 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:00:24.172873 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:24.173033 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:24.177998 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:00:24.178124 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Claim successful on node np0000001127
May 21 02:00:24.209613 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-c706a793-10ab-4f01-9eb0-2a46fa7e2161 req-46c56b15-cf7b-4e8d-8be3-49ee4e88ec60 service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Updated VIF entry in instance network info cache for port d99a2cf4-260b-4ca3-b72e-7db23358b831. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:00:24.209888 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-c706a793-10ab-4f01-9eb0-2a46fa7e2161 req-46c56b15-cf7b-4e8d-8be3-49ee4e88ec60 service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Updating instance_info_cache with network_info: [{"id": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "address": "fa:16:3e:76:c8:70", "network": {"id": "7cdbc224-429f-49a6-86f3-307f51e53dfc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2078432126-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc797708a5a7400992765e41ee6ec260", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99a2cf4-26", "ovs_interfaceid": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:00:24.712491 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c706a793-10ab-4f01-9eb0-2a46fa7e2161 req-46c56b15-cf7b-4e8d-8be3-49ee4e88ec60 service nova] Releasing lock "refresh_cache-a6839691-a7ec-4dea-bc39-a7e89c94cf4d" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:00:24.754544 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lazy-loading 'flavor' on Instance uuid a6839691-a7ec-4dea-bc39-a7e89c94cf4d {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:00:24.785210 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:24.788583 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:24.809366 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:24.984438 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:24.995711 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:25.045067 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-dc8657fc-8fbe-4eb4-8ce3-a09cb7c214a0 req-335c898e-270a-45ac-959c-889ca8136228 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Received event network-vif-unplugged-6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:25.045396 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-dc8657fc-8fbe-4eb4-8ce3-a09cb7c214a0 req-335c898e-270a-45ac-959c-889ca8136228 service nova] Acquiring lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:25.045792 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-dc8657fc-8fbe-4eb4-8ce3-a09cb7c214a0 req-335c898e-270a-45ac-959c-889ca8136228 service nova] Lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:25.045944 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-dc8657fc-8fbe-4eb4-8ce3-a09cb7c214a0 req-335c898e-270a-45ac-959c-889ca8136228 service nova] Lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:25.046122 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-dc8657fc-8fbe-4eb4-8ce3-a09cb7c214a0 req-335c898e-270a-45ac-959c-889ca8136228 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] No waiting events found dispatching network-vif-unplugged-6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:25.046270 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-dc8657fc-8fbe-4eb4-8ce3-a09cb7c214a0 req-335c898e-270a-45ac-959c-889ca8136228 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Received unexpected event network-vif-unplugged-6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 for instance with vm_state active and task_state rescuing.
May 21 02:00:25.143077 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999617911999849 future=<Future at 0x71c098395f70 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:00:25.144134 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.998897616000022 future=<Future at 0x71c098395f70 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:00:25.144134 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.99864214199988 future=<Future at 0x71c098395f70 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:00:25.146824 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Instance destroyed successfully.
May 21 02:00:25.147076 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lazy-loading 'numa_topology' on Instance uuid 61f5b839-7cd4-428d-8dc0-327effc695d8 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:00:25.657270 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Attempting a stable device rescue
May 21 02:00:25.761384 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=98206) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 21 02:00:25.762139 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:00:25.762763 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:00:25.764768 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bc762d6c-9e45-43e6-9775-c4d4289e5cad tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.303s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:25.768811 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Instance directory exists: not creating {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 21 02:00:25.768899 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Creating image(s)
May 21 02:00:25.769486 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "/opt/stack/data/nova/instances/61f5b839-7cd4-428d-8dc0-327effc695d8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:25.769685 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "/opt/stack/data/nova/instances/61f5b839-7cd4-428d-8dc0-327effc695d8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:25.770111 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "/opt/stack/data/nova/instances/61f5b839-7cd4-428d-8dc0-327effc695d8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:25.770606 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lazy-loading 'trusted_certs' on Instance uuid 61f5b839-7cd4-428d-8dc0-327effc695d8 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:00:26.022603 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:26.022933 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:26.024935 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:26.024935 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:26.024935 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:26.026905 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Terminating instance
May 21 02:00:26.267652 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:00:26.274297 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Object Instance<61f5b839-7cd4-428d-8dc0-327effc695d8> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:00:26.275060 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "a223a70d5a389c2648dc748db40573fdbf41d0b3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:26.275060 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "a223a70d5a389c2648dc748db40573fdbf41d0b3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:26.294635 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:26.530256 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:00:26.562708 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:26.567983 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:26.609061 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:26.635994 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:26.663206 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:26.760362 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:26.779393 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.606s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:26.779844 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:00:26.868270 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:26.886187 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:26.943942 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:26.946772 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:26.968229 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f79c6037-52c9-4613-a08d-2f0f0c69294b req-ef685332-0669-4d82-b795-97bd11056067 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-unplugged-71580ee4-3192-484a-9ee6-5096ac78a4ce {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:26.968916 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f79c6037-52c9-4613-a08d-2f0f0c69294b req-ef685332-0669-4d82-b795-97bd11056067 service nova] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:26.969187 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f79c6037-52c9-4613-a08d-2f0f0c69294b req-ef685332-0669-4d82-b795-97bd11056067 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:26.969360 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f79c6037-52c9-4613-a08d-2f0f0c69294b req-ef685332-0669-4d82-b795-97bd11056067 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:26.969660 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f79c6037-52c9-4613-a08d-2f0f0c69294b req-ef685332-0669-4d82-b795-97bd11056067 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] No waiting events found dispatching network-vif-unplugged-71580ee4-3192-484a-9ee6-5096ac78a4ce {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:26.969802 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f79c6037-52c9-4613-a08d-2f0f0c69294b req-ef685332-0669-4d82-b795-97bd11056067 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-unplugged-71580ee4-3192-484a-9ee6-5096ac78a4ce for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:00:26.972317 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:27.041042 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:27.049323 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:27.078914 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:27.136714 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:27.162883 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:00:27.169379 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:00:27.170415 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a223a70d5a389c2648dc748db40573fdbf41d0b3.part --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:27.227462 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:27.249429 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999574851000034 future=<Future at 0x71c05858d1f0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:00:27.266431 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-15035f95-07bb-4ff4-a197-37cc9fe0891c req-48c5d32d-f736-4206-bd9e-e6060b3a6213 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Received event network-vif-unplugged-6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:27.267832 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-15035f95-07bb-4ff4-a197-37cc9fe0891c req-48c5d32d-f736-4206-bd9e-e6060b3a6213 service nova] Acquiring lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:27.268777 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-15035f95-07bb-4ff4-a197-37cc9fe0891c req-48c5d32d-f736-4206-bd9e-e6060b3a6213 service nova] Lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:27.268777 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-15035f95-07bb-4ff4-a197-37cc9fe0891c req-48c5d32d-f736-4206-bd9e-e6060b3a6213 service nova] Lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:27.269488 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-15035f95-07bb-4ff4-a197-37cc9fe0891c req-48c5d32d-f736-4206-bd9e-e6060b3a6213 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] No waiting events found dispatching network-vif-unplugged-6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:27.269488 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-15035f95-07bb-4ff4-a197-37cc9fe0891c req-48c5d32d-f736-4206-bd9e-e6060b3a6213 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Received unexpected event network-vif-unplugged-6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 for instance with vm_state active and task_state rescuing.
May 21 02:00:27.269488 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-15035f95-07bb-4ff4-a197-37cc9fe0891c req-48c5d32d-f736-4206-bd9e-e6060b3a6213 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-unplugged-f99ceda9-fad6-4a73-af2a-c63d3d320e2f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:27.270444 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Instance destroyed successfully.
May 21 02:00:27.270922 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-15035f95-07bb-4ff4-a197-37cc9fe0891c req-48c5d32d-f736-4206-bd9e-e6060b3a6213 service nova] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:27.279549 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lazy-loading 'resources' on Instance uuid a4b3355b-92d6-4b36-8dad-6cb4b3c579a2 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:00:27.284648 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-15035f95-07bb-4ff4-a197-37cc9fe0891c req-48c5d32d-f736-4206-bd9e-e6060b3a6213 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:27.285825 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-15035f95-07bb-4ff4-a197-37cc9fe0891c req-48c5d32d-f736-4206-bd9e-e6060b3a6213 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.015s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:27.286128 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-15035f95-07bb-4ff4-a197-37cc9fe0891c req-48c5d32d-f736-4206-bd9e-e6060b3a6213 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] No waiting events found dispatching network-vif-unplugged-f99ceda9-fad6-4a73-af2a-c63d3d320e2f {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:27.286263 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-15035f95-07bb-4ff4-a197-37cc9fe0891c req-48c5d32d-f736-4206-bd9e-e6060b3a6213 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-unplugged-f99ceda9-fad6-4a73-af2a-c63d3d320e2f for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:00:27.291349 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:00:27.291349 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:00:27.291463 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:27.293068 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:27.308965 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a223a70d5a389c2648dc748db40573fdbf41d0b3.part --force-share --output=json" returned: 0 in 0.138s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:27.308965 np0000001127 nova-compute[98206]: DEBUG nova.virt.images [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] aeebd0e4-d7b6-4f0f-8a9a-5ad65bca2087 was qcow2, converting to raw {{(pid=98206) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 21 02:00:27.310611 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:27.313644 np0000001127 nova-compute[98206]: DEBUG nova.privsep.utils [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 21 02:00:27.313644 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a223a70d5a389c2648dc748db40573fdbf41d0b3.part /opt/stack/data/nova/instances/_base/a223a70d5a389c2648dc748db40573fdbf41d0b3.converted {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:27.346207 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-5610f141-b037-493e-afba-5ad60f55e94c req-eea44fe0-3264-48ef-a7f4-6958b6f59f1a service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-unplugged-9e74661c-8435-43a4-82d7-b7d757552d24 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:27.349366 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5610f141-b037-493e-afba-5ad60f55e94c req-eea44fe0-3264-48ef-a7f4-6958b6f59f1a service nova] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:27.351445 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5610f141-b037-493e-afba-5ad60f55e94c req-eea44fe0-3264-48ef-a7f4-6958b6f59f1a service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:27.351445 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5610f141-b037-493e-afba-5ad60f55e94c req-eea44fe0-3264-48ef-a7f4-6958b6f59f1a service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:27.351445 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-5610f141-b037-493e-afba-5ad60f55e94c req-eea44fe0-3264-48ef-a7f4-6958b6f59f1a service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] No waiting events found dispatching network-vif-unplugged-9e74661c-8435-43a4-82d7-b7d757552d24 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:27.351445 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-5610f141-b037-493e-afba-5ad60f55e94c req-eea44fe0-3264-48ef-a7f4-6958b6f59f1a service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-unplugged-9e74661c-8435-43a4-82d7-b7d757552d24 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:00:27.459953 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '45d8378885514dd79b666ba5f5352716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dde2f210a0e4debaa655c852b3621da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:00:27.483944 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a223a70d5a389c2648dc748db40573fdbf41d0b3.part /opt/stack/data/nova/instances/_base/a223a70d5a389c2648dc748db40573fdbf41d0b3.converted" returned: 0 in 0.172s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:27.493979 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a223a70d5a389c2648dc748db40573fdbf41d0b3.converted --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:27.612176 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a223a70d5a389c2648dc748db40573fdbf41d0b3.converted --force-share --output=json" returned: 0 in 0.118s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:27.612856 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "a223a70d5a389c2648dc748db40573fdbf41d0b3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.338s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:27.613351 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:00:27.617053 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:00:27.620626 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "a223a70d5a389c2648dc748db40573fdbf41d0b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:27.620880 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "a223a70d5a389c2648dc748db40573fdbf41d0b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:27.623955 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:00:27.626442 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:00:27.627831 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a223a70d5a389c2648dc748db40573fdbf41d0b3 --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:27.748029 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a223a70d5a389c2648dc748db40573fdbf41d0b3 --force-share --output=json" returned: 0 in 0.119s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:27.748029 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a223a70d5a389c2648dc748db40573fdbf41d0b3,backing_fmt=raw /opt/stack/data/nova/instances/61f5b839-7cd4-428d-8dc0-327effc695d8/disk.rescue {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:27.789410 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920193654',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-920193654',id=13,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj8xG3nqMprKxBLzehkwhGN33AYwwuQUWlcQ1BDSSIisfdbQN22oI+LOb499AbZ3PG8oEFQTNwey0tKs5r9Gc1kC6R76tIW1PhxpT/IYUNrOGb6wd7IJKgcO7Q871ucMw==',key_name='tempest-keypair-272806868',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:59:16Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fea6765f0d474e20a8cf4ce239d06576',ramdisk_id='',reservation_id='r-5gkaau5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306570717',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306570717-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:59:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcc45f6ca81d42fbb09ff1916bb11787',uuid=a4b3355b-92d6-4b36-8dad-6cb4b3c579a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f99ceda9-fad6-4a73-af2a-c63d3d320e2f", "address": "fa:16:3e:f8:14:ac", "network": {"id": "0ab35e13-b362-4576-91d1-569cb811b2d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1427614225-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf99ceda9-fa", "ovs_interfaceid": "f99ceda9-fad6-4a73-af2a-c63d3d320e2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:00:27.790036 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converting VIF {"id": "f99ceda9-fad6-4a73-af2a-c63d3d320e2f", "address": "fa:16:3e:f8:14:ac", "network": {"id": "0ab35e13-b362-4576-91d1-569cb811b2d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1427614225-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf99ceda9-fa", "ovs_interfaceid": "f99ceda9-fad6-4a73-af2a-c63d3d320e2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:00:27.795719 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:14:ac,bridge_name='br-int',has_traffic_filtering=True,id=f99ceda9-fad6-4a73-af2a-c63d3d320e2f,network=Network(0ab35e13-b362-4576-91d1-569cb811b2d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf99ceda9-fa') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:00:27.795719 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:14:ac,bridge_name='br-int',has_traffic_filtering=True,id=f99ceda9-fad6-4a73-af2a-c63d3d320e2f,network=Network(0ab35e13-b362-4576-91d1-569cb811b2d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf99ceda9-fa') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:00:27.798159 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:00:27.804992 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:27.805492 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf99ceda9-fa, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:27.811797 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:00:27.825128 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a223a70d5a389c2648dc748db40573fdbf41d0b3,backing_fmt=raw /opt/stack/data/nova/instances/61f5b839-7cd4-428d-8dc0-327effc695d8/disk.rescue" returned: 0 in 0.077s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:27.826613 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "a223a70d5a389c2648dc748db40573fdbf41d0b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:27.826613 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lazy-loading 'migration_context' on Instance uuid 61f5b839-7cd4-428d-8dc0-327effc695d8 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:00:27.851968 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:27.853318 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:27.854497 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a8f693c1-566e-4b4f-b2c9-870ac9315eb9) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:27.855261 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:00:27.898429 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:27.900982 np0000001127 nova-compute[98206]: INFO os_vif [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:14:ac,bridge_name='br-int',has_traffic_filtering=True,id=f99ceda9-fad6-4a73-af2a-c63d3d320e2f,network=Network(0ab35e13-b362-4576-91d1-569cb811b2d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf99ceda9-fa')
May 21 02:00:27.901925 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920193654',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-920193654',id=13,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj8xG3nqMprKxBLzehkwhGN33AYwwuQUWlcQ1BDSSIisfdbQN22oI+LOb499AbZ3PG8oEFQTNwey0tKs5r9Gc1kC6R76tIW1PhxpT/IYUNrOGb6wd7IJKgcO7Q871ucMw==',key_name='tempest-keypair-272806868',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:59:16Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fea6765f0d474e20a8cf4ce239d06576',ramdisk_id='',reservation_id='r-5gkaau5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306570717',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306570717-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:59:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcc45f6ca81d42fbb09ff1916bb11787',uuid=a4b3355b-92d6-4b36-8dad-6cb4b3c579a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71580ee4-3192-484a-9ee6-5096ac78a4ce", "address": "fa:16:3e:32:44:18", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71580ee4-31", "ovs_interfaceid": "71580ee4-3192-484a-9ee6-5096ac78a4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:00:27.902226 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converting VIF {"id": "71580ee4-3192-484a-9ee6-5096ac78a4ce", "address": "fa:16:3e:32:44:18", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71580ee4-31", "ovs_interfaceid": "71580ee4-3192-484a-9ee6-5096ac78a4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:00:27.902880 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:44:18,bridge_name='br-int',has_traffic_filtering=True,id=71580ee4-3192-484a-9ee6-5096ac78a4ce,network=Network(34d80d18-cae3-4477-a29e-164067d97021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap71580ee4-31') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:00:27.903164 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:44:18,bridge_name='br-int',has_traffic_filtering=True,id=71580ee4-3192-484a-9ee6-5096ac78a4ce,network=Network(34d80d18-cae3-4477-a29e-164067d97021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap71580ee4-31') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:00:27.907823 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:27.908121 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71580ee4-31, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:27.913615 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:00:27.951748 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:27.952713 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:27.952906 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=90340b3b-1291-4428-87f1-f23227b6582b) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:27.955751 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:27.956023 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:00:27.984675 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:27.989243 np0000001127 nova-compute[98206]: INFO os_vif [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:44:18,bridge_name='br-int',has_traffic_filtering=True,id=71580ee4-3192-484a-9ee6-5096ac78a4ce,network=Network(34d80d18-cae3-4477-a29e-164067d97021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap71580ee4-31')
May 21 02:00:27.990210 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920193654',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-920193654',id=13,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj8xG3nqMprKxBLzehkwhGN33AYwwuQUWlcQ1BDSSIisfdbQN22oI+LOb499AbZ3PG8oEFQTNwey0tKs5r9Gc1kC6R76tIW1PhxpT/IYUNrOGb6wd7IJKgcO7Q871ucMw==',key_name='tempest-keypair-272806868',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:59:16Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fea6765f0d474e20a8cf4ce239d06576',ramdisk_id='',reservation_id='r-5gkaau5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306570717',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306570717-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:59:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcc45f6ca81d42fbb09ff1916bb11787',uuid=a4b3355b-92d6-4b36-8dad-6cb4b3c579a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e74661c-8435-43a4-82d7-b7d757552d24", "address": "fa:16:3e:e6:51:87", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e74661c-84", "ovs_interfaceid": "9e74661c-8435-43a4-82d7-b7d757552d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:00:27.990409 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converting VIF {"id": "9e74661c-8435-43a4-82d7-b7d757552d24", "address": "fa:16:3e:e6:51:87", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e74661c-84", "ovs_interfaceid": "9e74661c-8435-43a4-82d7-b7d757552d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:00:27.992314 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:51:87,bridge_name='br-int',has_traffic_filtering=True,id=9e74661c-8435-43a4-82d7-b7d757552d24,network=Network(34d80d18-cae3-4477-a29e-164067d97021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9e74661c-84') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:00:27.992631 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:51:87,bridge_name='br-int',has_traffic_filtering=True,id=9e74661c-8435-43a4-82d7-b7d757552d24,network=Network(34d80d18-cae3-4477-a29e-164067d97021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9e74661c-84') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:00:27.994568 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:27.994736 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e74661c-84, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:27.997096 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:00:28.021679 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:28.023791 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:28.023791 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c2e74cf2-8957-4140-9935-0f11e2d13ad5) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:28.025089 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:00:28.050485 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:28.056034 np0000001127 nova-compute[98206]: INFO os_vif [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:51:87,bridge_name='br-int',has_traffic_filtering=True,id=9e74661c-8435-43a4-82d7-b7d757552d24,network=Network(34d80d18-cae3-4477-a29e-164067d97021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9e74661c-84')
May 21 02:00:28.056968 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920193654',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-920193654',id=13,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj8xG3nqMprKxBLzehkwhGN33AYwwuQUWlcQ1BDSSIisfdbQN22oI+LOb499AbZ3PG8oEFQTNwey0tKs5r9Gc1kC6R76tIW1PhxpT/IYUNrOGb6wd7IJKgcO7Q871ucMw==',key_name='tempest-keypair-272806868',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:59:16Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fea6765f0d474e20a8cf4ce239d06576',ramdisk_id='',reservation_id='r-5gkaau5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306570717',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306570717-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:59:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcc45f6ca81d42fbb09ff1916bb11787',uuid=a4b3355b-92d6-4b36-8dad-6cb4b3c579a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "407bbd3c-7537-4404-aaf5-a5ed533bb33b", "address": "fa:16:3e:80:dd:78", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap407bbd3c-75", "ovs_interfaceid": "407bbd3c-7537-4404-aaf5-a5ed533bb33b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:00:28.057208 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converting VIF {"id": "407bbd3c-7537-4404-aaf5-a5ed533bb33b", "address": "fa:16:3e:80:dd:78", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap407bbd3c-75", "ovs_interfaceid": "407bbd3c-7537-4404-aaf5-a5ed533bb33b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:00:28.057788 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:dd:78,bridge_name='br-int',has_traffic_filtering=True,id=407bbd3c-7537-4404-aaf5-a5ed533bb33b,network=Network(34d80d18-cae3-4477-a29e-164067d97021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap407bbd3c-75') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:00:28.057998 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:dd:78,bridge_name='br-int',has_traffic_filtering=True,id=407bbd3c-7537-4404-aaf5-a5ed533bb33b,network=Network(34d80d18-cae3-4477-a29e-164067d97021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap407bbd3c-75') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:00:28.060231 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:28.060495 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap407bbd3c-75, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:28.062237 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:28.063601 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:00:28.067189 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bd40c5ce-20f9-4d0e-9549-2b34e0c216e2 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:28.067392 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bd40c5ce-20f9-4d0e-9549-2b34e0c216e2 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:28.067607 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bd40c5ce-20f9-4d0e-9549-2b34e0c216e2 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:28.067746 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bd40c5ce-20f9-4d0e-9549-2b34e0c216e2 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:28.067855 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bd40c5ce-20f9-4d0e-9549-2b34e0c216e2 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:28.070711 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-bd40c5ce-20f9-4d0e-9549-2b34e0c216e2 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Terminating instance
May 21 02:00:28.084046 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:28.085178 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:28.085359 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=110dd18b-a9f2-4d5a-8e57-a56180043f65) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:28.086410 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:28.086831 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:00:28.108334 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:28.110266 np0000001127 nova-compute[98206]: INFO os_vif [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:dd:78,bridge_name='br-int',has_traffic_filtering=True,id=407bbd3c-7537-4404-aaf5-a5ed533bb33b,network=Network(34d80d18-cae3-4477-a29e-164067d97021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap407bbd3c-75')
May 21 02:00:28.110993 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920193654',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-920193654',id=13,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj8xG3nqMprKxBLzehkwhGN33AYwwuQUWlcQ1BDSSIisfdbQN22oI+LOb499AbZ3PG8oEFQTNwey0tKs5r9Gc1kC6R76tIW1PhxpT/IYUNrOGb6wd7IJKgcO7Q871ucMw==',key_name='tempest-keypair-272806868',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:59:16Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fea6765f0d474e20a8cf4ce239d06576',ramdisk_id='',reservation_id='r-5gkaau5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306570717',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306570717-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:59:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcc45f6ca81d42fbb09ff1916bb11787',uuid=a4b3355b-92d6-4b36-8dad-6cb4b3c579a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a350a027-1ffc-4539-a238-d98bbb9baeba", "address": "fa:16:3e:19:d5:ae", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa350a027-1f", "ovs_interfaceid": "a350a027-1ffc-4539-a238-d98bbb9baeba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:00:28.111225 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converting VIF {"id": "a350a027-1ffc-4539-a238-d98bbb9baeba", "address": "fa:16:3e:19:d5:ae", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa350a027-1f", "ovs_interfaceid": "a350a027-1ffc-4539-a238-d98bbb9baeba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:00:28.116062 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:d5:ae,bridge_name='br-int',has_traffic_filtering=True,id=a350a027-1ffc-4539-a238-d98bbb9baeba,network=Network(34d80d18-cae3-4477-a29e-164067d97021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa350a027-1f') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:00:28.116062 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:d5:ae,bridge_name='br-int',has_traffic_filtering=True,id=a350a027-1ffc-4539-a238-d98bbb9baeba,network=Network(34d80d18-cae3-4477-a29e-164067d97021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa350a027-1f') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:00:28.117885 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:28.118015 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa350a027-1f, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:28.120220 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:28.120954 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:00:28.136879 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:28.138227 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:28.138689 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ce65758-e9da-4f9b-84ea-b55b636a239c) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:28.140990 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:28.141839 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:00:28.159591 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:28.162526 np0000001127 nova-compute[98206]: INFO os_vif [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:d5:ae,bridge_name='br-int',has_traffic_filtering=True,id=a350a027-1ffc-4539-a238-d98bbb9baeba,network=Network(34d80d18-cae3-4477-a29e-164067d97021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa350a027-1f')
May 21 02:00:28.163435 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920193654',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-920193654',id=13,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj8xG3nqMprKxBLzehkwhGN33AYwwuQUWlcQ1BDSSIisfdbQN22oI+LOb499AbZ3PG8oEFQTNwey0tKs5r9Gc1kC6R76tIW1PhxpT/IYUNrOGb6wd7IJKgcO7Q871ucMw==',key_name='tempest-keypair-272806868',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:59:16Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fea6765f0d474e20a8cf4ce239d06576',ramdisk_id='',reservation_id='r-5gkaau5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306570717',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306570717-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:59:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcc45f6ca81d42fbb09ff1916bb11787',uuid=a4b3355b-92d6-4b36-8dad-6cb4b3c579a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58939f92-ac70-47fb-90c0-5f7bc2421c47", "address": "fa:16:3e:db:3c:f9", "network": {"id": "54c4e0a1-6a66-4891-94c3-c85fc5fe181c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2031114495", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58939f92-ac", "ovs_interfaceid": "58939f92-ac70-47fb-90c0-5f7bc2421c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:00:28.163939 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converting VIF {"id": "58939f92-ac70-47fb-90c0-5f7bc2421c47", "address": "fa:16:3e:db:3c:f9", "network": {"id": "54c4e0a1-6a66-4891-94c3-c85fc5fe181c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2031114495", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58939f92-ac", "ovs_interfaceid": "58939f92-ac70-47fb-90c0-5f7bc2421c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:00:28.164554 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:3c:f9,bridge_name='br-int',has_traffic_filtering=True,id=58939f92-ac70-47fb-90c0-5f7bc2421c47,network=Network(54c4e0a1-6a66-4891-94c3-c85fc5fe181c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58939f92-ac') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:00:28.164793 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:3c:f9,bridge_name='br-int',has_traffic_filtering=True,id=58939f92-ac70-47fb-90c0-5f7bc2421c47,network=Network(54c4e0a1-6a66-4891-94c3-c85fc5fe181c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58939f92-ac') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:00:28.166045 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:28.166045 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58939f92-ac, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:28.168657 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:00:28.181153 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:28.182196 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:28.182367 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5d16c0ec-c7e5-4b08-bd6c-0b9868e19e2e) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:28.183210 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:28.183863 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:00:28.197863 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:28.199969 np0000001127 nova-compute[98206]: INFO os_vif [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:3c:f9,bridge_name='br-int',has_traffic_filtering=True,id=58939f92-ac70-47fb-90c0-5f7bc2421c47,network=Network(54c4e0a1-6a66-4891-94c3-c85fc5fe181c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58939f92-ac')
May 21 02:00:28.200946 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920193654',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-device-tagging-server-920193654',id=13,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj8xG3nqMprKxBLzehkwhGN33AYwwuQUWlcQ1BDSSIisfdbQN22oI+LOb499AbZ3PG8oEFQTNwey0tKs5r9Gc1kC6R76tIW1PhxpT/IYUNrOGb6wd7IJKgcO7Q871ucMw==',key_name='tempest-keypair-272806868',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:59:16Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fea6765f0d474e20a8cf4ce239d06576',ramdisk_id='',reservation_id='r-5gkaau5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306570717',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306570717-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:59:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcc45f6ca81d42fbb09ff1916bb11787',uuid=a4b3355b-92d6-4b36-8dad-6cb4b3c579a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ac81609-4fab-4940-9313-6dd7160c7a9b", "address": "fa:16:3e:c9:a8:b1", "network": {"id": "54c4e0a1-6a66-4891-94c3-c85fc5fe181c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2031114495", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac81609-4f", "ovs_interfaceid": "1ac81609-4fab-4940-9313-6dd7160c7a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:00:28.201182 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converting VIF {"id": "1ac81609-4fab-4940-9313-6dd7160c7a9b", "address": "fa:16:3e:c9:a8:b1", "network": {"id": "54c4e0a1-6a66-4891-94c3-c85fc5fe181c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2031114495", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac81609-4f", "ovs_interfaceid": "1ac81609-4fab-4940-9313-6dd7160c7a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:00:28.201885 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:a8:b1,bridge_name='br-int',has_traffic_filtering=True,id=1ac81609-4fab-4940-9313-6dd7160c7a9b,network=Network(54c4e0a1-6a66-4891-94c3-c85fc5fe181c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ac81609-4f') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:00:28.202141 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:a8:b1,bridge_name='br-int',has_traffic_filtering=True,id=1ac81609-4fab-4940-9313-6dd7160c7a9b,network=Network(54c4e0a1-6a66-4891-94c3-c85fc5fe181c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ac81609-4f') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:00:28.203324 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:28.203647 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ac81609-4f, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:28.206061 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:28.206276 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:00:28.211573 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:28.212693 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:28.212928 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4edd0863-8ee4-489a-8777-dbe1c92b11b9) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:28.213959 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:00:28.220028 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:28.221849 np0000001127 nova-compute[98206]: INFO os_vif [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:a8:b1,bridge_name='br-int',has_traffic_filtering=True,id=1ac81609-4fab-4940-9313-6dd7160c7a9b,network=Network(54c4e0a1-6a66-4891-94c3-c85fc5fe181c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ac81609-4f')
May 21 02:00:28.224878 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:00:28.225286 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2', 'iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f8b13fac-25c3-40f9-8506-1236b8dc8fd2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:00:28.225537 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:00:28.225906 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:00:28.226281 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2', 'iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f8b13fac-25c3-40f9-8506-1236b8dc8fd2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:00:28.226570 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:00:28.269553 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:28.269553 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:28.269553 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:28.269553 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:28.269553 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:28.269553 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:28.269553 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:28.269553 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:28.269553 np0000001127 nova-compute[98206]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:28.269553 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:28.269553 np0000001127 nova-compute[98206]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:28.269553 np0000001127 nova-compute[98206]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:28.269553 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:00:28.269553 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:28.269553 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:28.269553 np0000001127 nova-compute[98206]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:28.269553 np0000001127 nova-compute[98206]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2 (non-flash)
May 21 02:00:28.269553 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:28.269553 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:28.269553 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:28.269553 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:28.269553 np0000001127 nova-compute[98206]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:28.269553 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:28.269553 np0000001127 nova-compute[98206]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:28.269553 np0000001127 nova-compute[98206]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:28.269553 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:00:28.269553 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', '27'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6', '35'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53', '48'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53', '49')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:00:28.269553 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2', '30')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:00:28.269553 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2', '31')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:00:28.269553 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c76e5c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2'): ({'sdi'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:00:28.269553 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Removing multipathed devices sdi, sdh {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:00:28.273187 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Flush multipath device 330000000347729e8 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:00:28.313047 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:00:28.321215 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:00:28.330102 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Object Instance<61f5b839-7cd4-428d-8dc0-327effc695d8> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:00:28.330102 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:00:28.330915 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Start _get_guest_xml network_info=[{"id": "6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20", "address": "fa:16:3e:7c:15:86", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "vif_mac": "fa:16:3e:7c:15:86"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c8ad0fa-79", "ovs_interfaceid": "6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'aeebd0e4-d7b6-4f0f-8a9a-5ad65bca2087', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53', 'iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8e307392-5cde-4d6a-a155-dfbc7af6ce53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, 'status': 'reserved', 'instance': '61f5b839-7cd4-428d-8dc0-327effc695d8', 'attached_at': '', 'detached_at': '', 'volume_id': '8e307392-5cde-4d6a-a155-dfbc7af6ce53', 'serial': '8e307392-5cde-4d6a-a155-dfbc7af6ce53'}, 'delete_on_termination': True, 'attachment_id': '9be66f95-802f-4017-b0d2-5cab6340cb42', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:00:28.331195 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lazy-loading 'resources' on Instance uuid 61f5b839-7cd4-428d-8dc0-327effc695d8 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:00:28.365188 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:00:28.393584 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Successfully created port: 1b938e0e-b319-49b6-a973-0e80c89b92e6 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:00:28.406569 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:00:28.406835 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:00:28.408775 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:00:28.427941 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:00:28.428330 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:00:28.442484 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:28.483281 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2, portal: 192.168.40.100,3260]
May 21 02:00:28.483281 np0000001127 nova-compute[98206]: Logout of [sid: 30, target: iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2, portal: 192.168.40.100,3260] successful.
May 21 02:00:28.483281 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:28.509301 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:28.522174 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:28.569059 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2, portal: 192.168.50.100,3260]
May 21 02:00:28.569059 np0000001127 nova-compute[98206]: Logout of [sid: 31, target: iqn.2023-03.storpool.com:os--volume-f8b13fac-25c3-40f9-8506-1236b8dc8fd2, portal: 192.168.50.100,3260] successful.
May 21 02:00:28.569059 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:28.577924 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-bd40c5ce-20f9-4d0e-9549-2b34e0c216e2 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:00:28.595717 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:28.596308 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:00:28.596398 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] <== disconnect_volume: return (370ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:00:28.597129 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:00:28.602083 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:00:28.602696 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6', 'iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5410bf8e-8978-4bf4-b8f9-592be340a6b6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:00:28.603029 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:00:28.603314 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:00:28.603698 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6', 'iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5410bf8e-8978-4bf4-b8f9-592be340a6b6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:00:28.603866 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:00:28.612838 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:28.615633 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:28.644126 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:28.644126 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:28.644126 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:28.644126 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:28.644126 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:28.644126 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:28.644126 np0000001127 nova-compute[98206]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:28.644126 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:28.644126 np0000001127 nova-compute[98206]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:28.644126 np0000001127 nova-compute[98206]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:28.644126 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:00:28.646146 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:28.646146 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:28.646146 np0000001127 nova-compute[98206]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:28.646146 np0000001127 nova-compute[98206]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6 (non-flash)
May 21 02:00:28.646146 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:28.646146 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:28.646146 np0000001127 nova-compute[98206]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:28.646146 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:28.646146 np0000001127 nova-compute[98206]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:28.646146 np0000001127 nova-compute[98206]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:28.646146 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:00:28.646146 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', '27'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6', '35'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53', '48'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53', '49')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:00:28.646146 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6', '34')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:00:28.654540 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6', '35')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:00:28.654540 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:28.654540 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c0587dbce0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6'): ({'sdm'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:00:28.654540 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Removing multipathed devices sdl, sdm {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:00:28.654540 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Flush multipath device 3300000009dd5ed90 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:00:28.654540 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:28.690556 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:28.690556 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:28.692576 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:00:28.730842 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:00:28.789000 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Checking to see if SCSI volumes sdl, sdm have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:00:28.789189 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] SCSI volumes sdl, sdm have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:00:28.790477 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Checking to see if device paths {'sdl', 'sdm'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:00:28.805156 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Device paths {'sdl', 'sdm'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:00:28.805357 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:00:28.818913 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Booting with volume b38b53ce-4cdb-4612-9475-9ea4e1b1205b at /dev/vda
May 21 02:00:28.823237 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:28.833890 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Object Instance<61f5b839-7cd4-428d-8dc0-327effc695d8> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:00:28.840827 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:00:28.842171 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-2141638290', uuid='61f5b839-7cd4-428d-8dc0-327effc695d8'), owner=OwnerMeta(userid='bd5b969d5a514d01bacfc7954a5ae4ab', username='tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member', projectid='83df9a84ffaa4398bdafbfbde079964d', projectname='tempest-ServerBootFromVolumeStableRescueTest-260444396'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20", "address": "fa:16:3e:7c:15:86", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "vif_mac": "fa:16:3e:7c:15:86"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c8ad0fa-79", "ovs_interfaceid": "6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328828.841732) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:00:28.845575 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:00:28.845575 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:00:28.845575 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:00:28.845575 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:00:28.846537 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:00:28.846861 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:00:28.846993 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:00:28.847082 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:00:28.847172 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:00:28.847232 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:00:28.847931 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:00:28.847931 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:00:28.847931 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:00:28.848309 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:00:28.848309 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:00:28.848309 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:00:28.848594 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lazy-loading 'vcpu_model' on Instance uuid 61f5b839-7cd4-428d-8dc0-327effc695d8 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:00:28.869555 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6, portal: 192.168.40.100,3260]
May 21 02:00:28.869555 np0000001127 nova-compute[98206]: Logout of [sid: 34, target: iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6, portal: 192.168.40.100,3260] successful.
May 21 02:00:28.869555 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:28.884586 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:00:28.893833 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:28.901250 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:00:28.913016 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:28.933076 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:28.961774 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.996448192999878 future=<Future at 0x71c07c5e9eb0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:00:28.970710 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6, portal: 192.168.50.100,3260]
May 21 02:00:28.970710 np0000001127 nova-compute[98206]: Logout of [sid: 35, target: iqn.2023-03.storpool.com:os--volume-5410bf8e-8978-4bf4-b8f9-592be340a6b6, portal: 192.168.50.100,3260] successful.
May 21 02:00:28.970710 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:28.971506 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Instance destroyed successfully.
May 21 02:00:28.974533 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-bd40c5ce-20f9-4d0e-9549-2b34e0c216e2 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lazy-loading 'resources' on Instance uuid a6839691-a7ec-4dea-bc39-a7e89c94cf4d {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:00:28.987828 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:00:28.988442 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:00:28.999628 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:29.001032 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:00:29.001200 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] <== disconnect_volume: return (398ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:00:29.001343 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:00:29.004997 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:00:29.006794 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe9e:216', 'fe80::14d9:7bff:fe3b:f0dc', 'fe80::fc16:3eff:fee3:f7d2', 'fe80::6c2e:11ff:fea1:7eb7', 'fe80::fc16:3eff:fe50:bfd8', 'fe80::fc16:3eff:fe23:65cb', 'fe80::fc16:3eff:fe45:a237', 'fe80::fc16:3eff:fe12:668e', 'fe80::c062:49ff:fe28:b40d'] 
May 21 02:00:29.007444 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:00:29.007687 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:00:29.008068 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:00:29.008543 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:00:29.008819 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566', 'iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f84e5871-8b85-40d8-af76-554e0f6ce566', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:00:29.009052 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Updating existing volume attachment record: fac28177-0770-4aa5-aab4-585439fbb1de {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:00:29.011734 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:00:29.012135 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:00:29.013117 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566', 'iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f84e5871-8b85-40d8-af76-554e0f6ce566', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:00:29.013117 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:00:29.050338 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:29.050338 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:29.050338 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:29.050338 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:29.050338 np0000001127 nova-compute[98206]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:29.050338 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:29.050338 np0000001127 nova-compute[98206]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:29.050338 np0000001127 nova-compute[98206]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:29.050338 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:00:29.050338 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:29.050338 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:29.050338 np0000001127 nova-compute[98206]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:29.050338 np0000001127 nova-compute[98206]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566 (non-flash)
May 21 02:00:29.050338 np0000001127 nova-compute[98206]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:29.050338 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:29.050338 np0000001127 nova-compute[98206]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:29.050338 np0000001127 nova-compute[98206]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:29.050338 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:00:29.050338 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', '27'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53', '48'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53', '49')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:00:29.050338 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566', '36')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:00:29.050338 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566', '37')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:00:29.051228 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c058639a80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566'): ({'sdg'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:00:29.051507 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Removing multipathed devices sdg, sdf {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:00:29.051781 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Flush multipath device 330000000753c49ce {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:00:29.068633 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b8bfa3bf-329d-41f7-b54f-8487692f7643 req-dc3b2093-8c91-4d20-9034-0e0366e6bd35 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-unplugged-71580ee4-3192-484a-9ee6-5096ac78a4ce {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:29.071068 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b8bfa3bf-329d-41f7-b54f-8487692f7643 req-dc3b2093-8c91-4d20-9034-0e0366e6bd35 service nova] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:29.071281 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b8bfa3bf-329d-41f7-b54f-8487692f7643 req-dc3b2093-8c91-4d20-9034-0e0366e6bd35 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:29.071569 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b8bfa3bf-329d-41f7-b54f-8487692f7643 req-dc3b2093-8c91-4d20-9034-0e0366e6bd35 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:29.071734 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b8bfa3bf-329d-41f7-b54f-8487692f7643 req-dc3b2093-8c91-4d20-9034-0e0366e6bd35 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] No waiting events found dispatching network-vif-unplugged-71580ee4-3192-484a-9ee6-5096ac78a4ce {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:29.071925 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b8bfa3bf-329d-41f7-b54f-8487692f7643 req-dc3b2093-8c91-4d20-9034-0e0366e6bd35 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-unplugged-71580ee4-3192-484a-9ee6-5096ac78a4ce for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:00:29.073133 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b8bfa3bf-329d-41f7-b54f-8487692f7643 req-dc3b2093-8c91-4d20-9034-0e0366e6bd35 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-unplugged-407bbd3c-7537-4404-aaf5-a5ed533bb33b {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:29.073684 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b8bfa3bf-329d-41f7-b54f-8487692f7643 req-dc3b2093-8c91-4d20-9034-0e0366e6bd35 service nova] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:29.074258 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b8bfa3bf-329d-41f7-b54f-8487692f7643 req-dc3b2093-8c91-4d20-9034-0e0366e6bd35 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:29.078760 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b8bfa3bf-329d-41f7-b54f-8487692f7643 req-dc3b2093-8c91-4d20-9034-0e0366e6bd35 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:29.078760 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b8bfa3bf-329d-41f7-b54f-8487692f7643 req-dc3b2093-8c91-4d20-9034-0e0366e6bd35 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] No waiting events found dispatching network-vif-unplugged-407bbd3c-7537-4404-aaf5-a5ed533bb33b {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:29.078760 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b8bfa3bf-329d-41f7-b54f-8487692f7643 req-dc3b2093-8c91-4d20-9034-0e0366e6bd35 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-unplugged-407bbd3c-7537-4404-aaf5-a5ed533bb33b for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:00:29.078760 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b8bfa3bf-329d-41f7-b54f-8487692f7643 req-dc3b2093-8c91-4d20-9034-0e0366e6bd35 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-unplugged-407bbd3c-7537-4404-aaf5-a5ed533bb33b {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:29.078760 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b8bfa3bf-329d-41f7-b54f-8487692f7643 req-dc3b2093-8c91-4d20-9034-0e0366e6bd35 service nova] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:29.078760 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b8bfa3bf-329d-41f7-b54f-8487692f7643 req-dc3b2093-8c91-4d20-9034-0e0366e6bd35 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:29.078760 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b8bfa3bf-329d-41f7-b54f-8487692f7643 req-dc3b2093-8c91-4d20-9034-0e0366e6bd35 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:29.078760 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b8bfa3bf-329d-41f7-b54f-8487692f7643 req-dc3b2093-8c91-4d20-9034-0e0366e6bd35 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] No waiting events found dispatching network-vif-unplugged-407bbd3c-7537-4404-aaf5-a5ed533bb33b {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:29.078760 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b8bfa3bf-329d-41f7-b54f-8487692f7643 req-dc3b2093-8c91-4d20-9034-0e0366e6bd35 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-unplugged-407bbd3c-7537-4404-aaf5-a5ed533bb33b for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:00:29.078760 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b8bfa3bf-329d-41f7-b54f-8487692f7643 req-dc3b2093-8c91-4d20-9034-0e0366e6bd35 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-unplugged-1ac81609-4fab-4940-9313-6dd7160c7a9b {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:29.078760 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b8bfa3bf-329d-41f7-b54f-8487692f7643 req-dc3b2093-8c91-4d20-9034-0e0366e6bd35 service nova] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:29.078760 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b8bfa3bf-329d-41f7-b54f-8487692f7643 req-dc3b2093-8c91-4d20-9034-0e0366e6bd35 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:29.078760 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b8bfa3bf-329d-41f7-b54f-8487692f7643 req-dc3b2093-8c91-4d20-9034-0e0366e6bd35 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:29.079246 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b8bfa3bf-329d-41f7-b54f-8487692f7643 req-dc3b2093-8c91-4d20-9034-0e0366e6bd35 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] No waiting events found dispatching network-vif-unplugged-1ac81609-4fab-4940-9313-6dd7160c7a9b {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:29.079392 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b8bfa3bf-329d-41f7-b54f-8487692f7643 req-dc3b2093-8c91-4d20-9034-0e0366e6bd35 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-unplugged-1ac81609-4fab-4940-9313-6dd7160c7a9b for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:00:29.079567 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b8bfa3bf-329d-41f7-b54f-8487692f7643 req-dc3b2093-8c91-4d20-9034-0e0366e6bd35 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-unplugged-1ac81609-4fab-4940-9313-6dd7160c7a9b {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:29.079812 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b8bfa3bf-329d-41f7-b54f-8487692f7643 req-dc3b2093-8c91-4d20-9034-0e0366e6bd35 service nova] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:29.080000 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b8bfa3bf-329d-41f7-b54f-8487692f7643 req-dc3b2093-8c91-4d20-9034-0e0366e6bd35 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:29.080390 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b8bfa3bf-329d-41f7-b54f-8487692f7643 req-dc3b2093-8c91-4d20-9034-0e0366e6bd35 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:29.080626 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b8bfa3bf-329d-41f7-b54f-8487692f7643 req-dc3b2093-8c91-4d20-9034-0e0366e6bd35 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] No waiting events found dispatching network-vif-unplugged-1ac81609-4fab-4940-9313-6dd7160c7a9b {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:29.080717 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b8bfa3bf-329d-41f7-b54f-8487692f7643 req-dc3b2093-8c91-4d20-9034-0e0366e6bd35 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-unplugged-1ac81609-4fab-4940-9313-6dd7160c7a9b for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:00:29.086357 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:00:29.134532 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:00:29.175091 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:00:29.175321 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:00:29.177169 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:00:29.190880 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:00:29.191173 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:00:29.205870 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:29.210187 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Successfully updated port: 1b938e0e-b319-49b6-a973-0e80c89b92e6 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:00:29.244836 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566, portal: 192.168.40.100,3260]
May 21 02:00:29.244836 np0000001127 nova-compute[98206]: Logout of [sid: 36, target: iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566, portal: 192.168.40.100,3260] successful.
May 21 02:00:29.244836 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:29.263214 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:29.280411 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:29.326876 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566, portal: 192.168.50.100,3260]
May 21 02:00:29.326876 np0000001127 nova-compute[98206]: Logout of [sid: 37, target: iqn.2023-03.storpool.com:os--volume-f84e5871-8b85-40d8-af76-554e0f6ce566, portal: 192.168.50.100,3260] successful.
May 21 02:00:29.326876 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:29.349183 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:29.349494 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:00:29.349653 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] <== disconnect_volume: return (340ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:00:29.349796 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:00:29.350617 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Object Instance<61f5b839-7cd4-428d-8dc0-327effc695d8> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:00:29.357998 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Deleting instance files /opt/stack/data/nova/instances/a4b3355b-92d6-4b36-8dad-6cb4b3c579a2_del
May 21 02:00:29.371016 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Deletion of /opt/stack/data/nova/instances/a4b3355b-92d6-4b36-8dad-6cb4b3c579a2_del complete
May 21 02:00:29.376977 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61f5b839-7cd4-428d-8dc0-327effc695d8/disk.config --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:29.400673 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-92d95a3f-3495-4a13-90b3-a3f3400ff05d req-164daa9b-3ae3-4458-9701-e7a4bde59a3e service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-unplugged-f99ceda9-fad6-4a73-af2a-c63d3d320e2f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:29.401079 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-92d95a3f-3495-4a13-90b3-a3f3400ff05d req-164daa9b-3ae3-4458-9701-e7a4bde59a3e service nova] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:29.401694 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-92d95a3f-3495-4a13-90b3-a3f3400ff05d req-164daa9b-3ae3-4458-9701-e7a4bde59a3e service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:29.405515 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-92d95a3f-3495-4a13-90b3-a3f3400ff05d req-164daa9b-3ae3-4458-9701-e7a4bde59a3e service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:29.406367 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-92d95a3f-3495-4a13-90b3-a3f3400ff05d req-164daa9b-3ae3-4458-9701-e7a4bde59a3e service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] No waiting events found dispatching network-vif-unplugged-f99ceda9-fad6-4a73-af2a-c63d3d320e2f {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:29.406613 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-92d95a3f-3495-4a13-90b3-a3f3400ff05d req-164daa9b-3ae3-4458-9701-e7a4bde59a3e service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-unplugged-f99ceda9-fad6-4a73-af2a-c63d3d320e2f for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:00:29.406760 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-92d95a3f-3495-4a13-90b3-a3f3400ff05d req-164daa9b-3ae3-4458-9701-e7a4bde59a3e service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-unplugged-58939f92-ac70-47fb-90c0-5f7bc2421c47 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:29.406932 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-92d95a3f-3495-4a13-90b3-a3f3400ff05d req-164daa9b-3ae3-4458-9701-e7a4bde59a3e service nova] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:29.407106 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-92d95a3f-3495-4a13-90b3-a3f3400ff05d req-164daa9b-3ae3-4458-9701-e7a4bde59a3e service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:29.407226 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-92d95a3f-3495-4a13-90b3-a3f3400ff05d req-164daa9b-3ae3-4458-9701-e7a4bde59a3e service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:29.407356 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-92d95a3f-3495-4a13-90b3-a3f3400ff05d req-164daa9b-3ae3-4458-9701-e7a4bde59a3e service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] No waiting events found dispatching network-vif-unplugged-58939f92-ac70-47fb-90c0-5f7bc2421c47 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:29.407514 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-92d95a3f-3495-4a13-90b3-a3f3400ff05d req-164daa9b-3ae3-4458-9701-e7a4bde59a3e service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-unplugged-58939f92-ac70-47fb-90c0-5f7bc2421c47 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:00:29.407879 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-92d95a3f-3495-4a13-90b3-a3f3400ff05d req-164daa9b-3ae3-4458-9701-e7a4bde59a3e service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-unplugged-58939f92-ac70-47fb-90c0-5f7bc2421c47 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:29.407879 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-92d95a3f-3495-4a13-90b3-a3f3400ff05d req-164daa9b-3ae3-4458-9701-e7a4bde59a3e service nova] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:29.407960 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-92d95a3f-3495-4a13-90b3-a3f3400ff05d req-164daa9b-3ae3-4458-9701-e7a4bde59a3e service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:29.408083 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-92d95a3f-3495-4a13-90b3-a3f3400ff05d req-164daa9b-3ae3-4458-9701-e7a4bde59a3e service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:29.408211 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-92d95a3f-3495-4a13-90b3-a3f3400ff05d req-164daa9b-3ae3-4458-9701-e7a4bde59a3e service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] No waiting events found dispatching network-vif-unplugged-58939f92-ac70-47fb-90c0-5f7bc2421c47 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:29.408344 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-92d95a3f-3495-4a13-90b3-a3f3400ff05d req-164daa9b-3ae3-4458-9701-e7a4bde59a3e service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-unplugged-58939f92-ac70-47fb-90c0-5f7bc2421c47 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:00:29.408518 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-92d95a3f-3495-4a13-90b3-a3f3400ff05d req-164daa9b-3ae3-4458-9701-e7a4bde59a3e service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-plugged-f99ceda9-fad6-4a73-af2a-c63d3d320e2f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:29.408672 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-92d95a3f-3495-4a13-90b3-a3f3400ff05d req-164daa9b-3ae3-4458-9701-e7a4bde59a3e service nova] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:29.408813 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-92d95a3f-3495-4a13-90b3-a3f3400ff05d req-164daa9b-3ae3-4458-9701-e7a4bde59a3e service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:29.408940 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-92d95a3f-3495-4a13-90b3-a3f3400ff05d req-164daa9b-3ae3-4458-9701-e7a4bde59a3e service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:29.409425 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-92d95a3f-3495-4a13-90b3-a3f3400ff05d req-164daa9b-3ae3-4458-9701-e7a4bde59a3e service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] No waiting events found dispatching network-vif-plugged-f99ceda9-fad6-4a73-af2a-c63d3d320e2f {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:29.409681 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-92d95a3f-3495-4a13-90b3-a3f3400ff05d req-164daa9b-3ae3-4458-9701-e7a4bde59a3e service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received unexpected event network-vif-plugged-f99ceda9-fad6-4a73-af2a-c63d3d320e2f for instance with vm_state active and task_state deleting.
May 21 02:00:29.409856 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-92d95a3f-3495-4a13-90b3-a3f3400ff05d req-164daa9b-3ae3-4458-9701-e7a4bde59a3e service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-plugged-f99ceda9-fad6-4a73-af2a-c63d3d320e2f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:29.410005 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-92d95a3f-3495-4a13-90b3-a3f3400ff05d req-164daa9b-3ae3-4458-9701-e7a4bde59a3e service nova] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:29.410158 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-92d95a3f-3495-4a13-90b3-a3f3400ff05d req-164daa9b-3ae3-4458-9701-e7a4bde59a3e service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:29.410274 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-92d95a3f-3495-4a13-90b3-a3f3400ff05d req-164daa9b-3ae3-4458-9701-e7a4bde59a3e service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:29.410388 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-92d95a3f-3495-4a13-90b3-a3f3400ff05d req-164daa9b-3ae3-4458-9701-e7a4bde59a3e service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] No waiting events found dispatching network-vif-plugged-f99ceda9-fad6-4a73-af2a-c63d3d320e2f {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:29.410540 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-92d95a3f-3495-4a13-90b3-a3f3400ff05d req-164daa9b-3ae3-4458-9701-e7a4bde59a3e service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received unexpected event network-vif-plugged-f99ceda9-fad6-4a73-af2a-c63d3d320e2f for instance with vm_state active and task_state deleting.
May 21 02:00:29.441711 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c48995da-fd61-4720-82d7-0779c9be6d25 req-d3dd8e0f-09d9-4243-aece-ed7179104aa6 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-unplugged-9e74661c-8435-43a4-82d7-b7d757552d24 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:29.441711 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c48995da-fd61-4720-82d7-0779c9be6d25 req-d3dd8e0f-09d9-4243-aece-ed7179104aa6 service nova] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:29.441711 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c48995da-fd61-4720-82d7-0779c9be6d25 req-d3dd8e0f-09d9-4243-aece-ed7179104aa6 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:29.441711 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c48995da-fd61-4720-82d7-0779c9be6d25 req-d3dd8e0f-09d9-4243-aece-ed7179104aa6 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:29.441711 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c48995da-fd61-4720-82d7-0779c9be6d25 req-d3dd8e0f-09d9-4243-aece-ed7179104aa6 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] No waiting events found dispatching network-vif-unplugged-9e74661c-8435-43a4-82d7-b7d757552d24 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:29.441711 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c48995da-fd61-4720-82d7-0779c9be6d25 req-d3dd8e0f-09d9-4243-aece-ed7179104aa6 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-unplugged-9e74661c-8435-43a4-82d7-b7d757552d24 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:00:29.442073 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c48995da-fd61-4720-82d7-0779c9be6d25 req-d3dd8e0f-09d9-4243-aece-ed7179104aa6 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-unplugged-a350a027-1ffc-4539-a238-d98bbb9baeba {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:29.442073 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c48995da-fd61-4720-82d7-0779c9be6d25 req-d3dd8e0f-09d9-4243-aece-ed7179104aa6 service nova] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:29.442073 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c48995da-fd61-4720-82d7-0779c9be6d25 req-d3dd8e0f-09d9-4243-aece-ed7179104aa6 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:29.442821 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c48995da-fd61-4720-82d7-0779c9be6d25 req-d3dd8e0f-09d9-4243-aece-ed7179104aa6 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:29.442821 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c48995da-fd61-4720-82d7-0779c9be6d25 req-d3dd8e0f-09d9-4243-aece-ed7179104aa6 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] No waiting events found dispatching network-vif-unplugged-a350a027-1ffc-4539-a238-d98bbb9baeba {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:29.442821 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c48995da-fd61-4720-82d7-0779c9be6d25 req-d3dd8e0f-09d9-4243-aece-ed7179104aa6 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-unplugged-a350a027-1ffc-4539-a238-d98bbb9baeba for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:00:29.442821 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c48995da-fd61-4720-82d7-0779c9be6d25 req-d3dd8e0f-09d9-4243-aece-ed7179104aa6 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-unplugged-a350a027-1ffc-4539-a238-d98bbb9baeba {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:29.442821 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c48995da-fd61-4720-82d7-0779c9be6d25 req-d3dd8e0f-09d9-4243-aece-ed7179104aa6 service nova] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:29.442821 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c48995da-fd61-4720-82d7-0779c9be6d25 req-d3dd8e0f-09d9-4243-aece-ed7179104aa6 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:29.445633 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c48995da-fd61-4720-82d7-0779c9be6d25 req-d3dd8e0f-09d9-4243-aece-ed7179104aa6 service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:29.447302 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c48995da-fd61-4720-82d7-0779c9be6d25 req-d3dd8e0f-09d9-4243-aece-ed7179104aa6 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] No waiting events found dispatching network-vif-unplugged-a350a027-1ffc-4539-a238-d98bbb9baeba {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:29.449269 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c48995da-fd61-4720-82d7-0779c9be6d25 req-d3dd8e0f-09d9-4243-aece-ed7179104aa6 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-unplugged-a350a027-1ffc-4539-a238-d98bbb9baeba for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:00:29.449269 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c48995da-fd61-4720-82d7-0779c9be6d25 req-d3dd8e0f-09d9-4243-aece-ed7179104aa6 service nova] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Received event network-changed-1b938e0e-b319-49b6-a973-0e80c89b92e6 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:29.449269 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c48995da-fd61-4720-82d7-0779c9be6d25 req-d3dd8e0f-09d9-4243-aece-ed7179104aa6 service nova] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Refreshing instance network info cache due to event network-changed-1b938e0e-b319-49b6-a973-0e80c89b92e6. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:00:29.449269 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c48995da-fd61-4720-82d7-0779c9be6d25 req-d3dd8e0f-09d9-4243-aece-ed7179104aa6 service nova] Acquiring lock "refresh_cache-44334b65-4382-4a2d-80f1-a1ae2cdfe1e8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:00:29.449269 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c48995da-fd61-4720-82d7-0779c9be6d25 req-d3dd8e0f-09d9-4243-aece-ed7179104aa6 service nova] Acquired lock "refresh_cache-44334b65-4382-4a2d-80f1-a1ae2cdfe1e8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:00:29.449269 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-c48995da-fd61-4720-82d7-0779c9be6d25 req-d3dd8e0f-09d9-4243-aece-ed7179104aa6 service nova] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Refreshing network info cache for port 1b938e0e-b319-49b6-a973-0e80c89b92e6 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:00:29.479075 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-bd40c5ce-20f9-4d0e-9549-2b34e0c216e2 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:58:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-715258350',display_name='tempest-TestMinimumBasicScenario-server-715258350',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testminimumbasicscenario-server-715258350',id=14,image_ref='a377f14f-f022-4902-8291-4e733e0a7be0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXVa1e4OFd0NMMgqm+4/xZwNI5dMebNPDeh14+7JZ91orpoik4qLtCbEUIRp2DSHHVcppNPspElPEIhYTAGUliS3RSE8t15WkhilyCcQF6xleusOu5YpLtoNfQpTRunwg==',key_name='tempest-TestMinimumBasicScenario-2026356756',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:58:47Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc797708a5a7400992765e41ee6ec260',ramdisk_id='',reservation_id='r-qn7g4mne',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a377f14f-f022-4902-8291-4e733e0a7be0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-654915677',owner_user_name='tempest-TestMinimumBasicScenario-654915677-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:59:42Z,user_data=None,user_id='44907638a40d4fb4ad9014b58dcd6bac',uuid=a6839691-a7ec-4dea-bc39-a7e89c94cf4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "address": "fa:16:3e:76:c8:70", "network": {"id": "7cdbc224-429f-49a6-86f3-307f51e53dfc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2078432126-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc797708a5a7400992765e41ee6ec260", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99a2cf4-26", "ovs_interfaceid": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:00:29.479333 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-bd40c5ce-20f9-4d0e-9549-2b34e0c216e2 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Converting VIF {"id": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "address": "fa:16:3e:76:c8:70", "network": {"id": "7cdbc224-429f-49a6-86f3-307f51e53dfc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2078432126-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc797708a5a7400992765e41ee6ec260", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99a2cf4-26", "ovs_interfaceid": "d99a2cf4-260b-4ca3-b72e-7db23358b831", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:00:29.480042 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-bd40c5ce-20f9-4d0e-9549-2b34e0c216e2 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:c8:70,bridge_name='br-int',has_traffic_filtering=True,id=d99a2cf4-260b-4ca3-b72e-7db23358b831,network=Network(7cdbc224-429f-49a6-86f3-307f51e53dfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99a2cf4-26') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:00:29.481889 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-bd40c5ce-20f9-4d0e-9549-2b34e0c216e2 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:c8:70,bridge_name='br-int',has_traffic_filtering=True,id=d99a2cf4-260b-4ca3-b72e-7db23358b831,network=Network(7cdbc224-429f-49a6-86f3-307f51e53dfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99a2cf4-26') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:00:29.485892 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:29.485892 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd99a2cf4-26, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:29.487048 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61f5b839-7cd4-428d-8dc0-327effc695d8/disk.config --force-share --output=json" returned: 0 in 0.110s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:29.488435 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "/opt/stack/data/nova/instances/61f5b839-7cd4-428d-8dc0-327effc695d8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:29.489507 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "/opt/stack/data/nova/instances/61f5b839-7cd4-428d-8dc0-327effc695d8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:29.489507 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "/opt/stack/data/nova/instances/61f5b839-7cd4-428d-8dc0-327effc695d8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:29.490204 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:00:29.490660 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:00:29.491014 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53', 'iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8e307392-5cde-4d6a-a155-dfbc7af6ce53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:00:29.491347 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:00:29.493139 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:00:29.493139 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53', 'iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8e307392-5cde-4d6a-a155-dfbc7af6ce53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:00:29.494294 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:29.499494 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:29.499652 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ef53af13-20c6-4c2c-8bd1-5ba16207d956) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:29.501208 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:00:29.508072 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:00:29.508299 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:00:29.508530 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:00:29.509218 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:29.509745 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:00:29.512673 np0000001127 nova-compute[98206]: INFO os_vif [None req-bd40c5ce-20f9-4d0e-9549-2b34e0c216e2 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:c8:70,bridge_name='br-int',has_traffic_filtering=True,id=d99a2cf4-260b-4ca3-b72e-7db23358b831,network=Network(7cdbc224-429f-49a6-86f3-307f51e53dfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99a2cf4-26')
May 21 02:00:29.513582 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:00:29.514287 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:00:29.514763 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-bd40c5ce-20f9-4d0e-9549-2b34e0c216e2 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Deleting instance files /opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d_del
May 21 02:00:29.517857 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-bd40c5ce-20f9-4d0e-9549-2b34e0c216e2 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Deletion of /opt/stack/data/nova/instances/a6839691-a7ec-4dea-bc39-a7e89c94cf4d_del complete
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.startup = automatic
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.session.scan = manual
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:00:29.525287 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:00:29.525287 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.startup = automatic
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.session.scan = manual
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:00:29.529963 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:00:29.529963 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:29.536420 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:29.542071 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:29.553917 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:29.553917 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:29.553917 np0000001127 nova-compute[98206]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:29.553917 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:29.553917 np0000001127 nova-compute[98206]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:29.553917 np0000001127 nova-compute[98206]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:29.553917 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:00:29.554233 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:29.554233 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:29.554233 np0000001127 nova-compute[98206]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:29.554233 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:29.554233 np0000001127 nova-compute[98206]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:29.554233 np0000001127 nova-compute[98206]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:29.554233 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:00:29.554379 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.046s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:00:29.554589 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:00:29.555199 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] HCTL ('19', '0', '0', 0) found on session 48 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:00:29.555316 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Scanning host 19 c: 0, t: 0, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:00:29.560361 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:29.560361 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:29.560361 np0000001127 nova-compute[98206]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:29.560361 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:29.560361 np0000001127 nova-compute[98206]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:29.560361 np0000001127 nova-compute[98206]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:29.560361 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:00:29.560361 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:29.560361 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:29.560361 np0000001127 nova-compute[98206]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:29.560361 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:29.560361 np0000001127 nova-compute[98206]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:29.560361 np0000001127 nova-compute[98206]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:29.560361 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:00:29.560959 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.048s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:00:29.560959 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:00:29.561418 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] HCTL ('20', '0', '0', 0) found on session 49 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:00:29.561418 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Scanning host 20 c: 0, t: 0, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:00:29.568810 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Searching for a device in session 48 and hctl ('19', '0', '0', 0) yield: sdn {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:00:29.568949 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8e307392-5cde-4d6a-a155-dfbc7af6ce53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:00:29.569718 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Searching for a device in session 49 and hctl ('20', '0', '0', 0) yield: sdo {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:00:29.569964 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8e307392-5cde-4d6a-a155-dfbc7af6ce53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:00:29.719947 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Acquiring lock "refresh_cache-44334b65-4382-4a2d-80f1-a1ae2cdfe1e8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:00:29.886138 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Took 3.36 seconds to destroy the instance on the hypervisor.
May 21 02:00:29.890098 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:00:29.890456 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:00:29.890693 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:00:29.891198 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:29.953495 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-c48995da-fd61-4720-82d7-0779c9be6d25 req-d3dd8e0f-09d9-4243-aece-ed7179104aa6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:30.029550 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-bd40c5ce-20f9-4d0e-9549-2b34e0c216e2 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Took 1.45 seconds to destroy the instance on the hypervisor.
May 21 02:00:30.037129 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-bd40c5ce-20f9-4d0e-9549-2b34e0c216e2 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:00:30.037530 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:00:30.037530 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:00:30.037743 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:30.043536 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-c48995da-fd61-4720-82d7-0779c9be6d25 req-d3dd8e0f-09d9-4243-aece-ed7179104aa6 service nova] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:00:30.139084 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:30.183953 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:30.309060 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-c48995da-fd61-4720-82d7-0779c9be6d25 req-d3dd8e0f-09d9-4243-aece-ed7179104aa6 service nova] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:00:30.519102 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:00:30.603203 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:30.811070 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c48995da-fd61-4720-82d7-0779c9be6d25 req-d3dd8e0f-09d9-4243-aece-ed7179104aa6 service nova] Releasing lock "refresh_cache-44334b65-4382-4a2d-80f1-a1ae2cdfe1e8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:00:30.812024 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Acquired lock "refresh_cache-44334b65-4382-4a2d-80f1-a1ae2cdfe1e8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:00:30.812284 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:00:30.921243 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:00:31.167713 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:00:31.168223 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:00:31.168534 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Creating image(s)
May 21 02:00:31.168856 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Did not create local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 21 02:00:31.169015 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Ensure instance console log exists: /opt/stack/data/nova/instances/44334b65-4382-4a2d-80f1-a1ae2cdfe1e8/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:00:31.169277 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:31.171252 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:31.171509 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:31.295914 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:31.424377 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:00:31.427107 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Took 1.39 seconds to deallocate network for instance.
May 21 02:00:31.503672 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8f984b1f-0023-4ac8-890b-2cd4d486e609 req-f6a1fcf5-1873-4027-aeb9-b1831f224b7a service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Received event network-vif-deleted-d99a2cf4-260b-4ca3-b72e-7db23358b831 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:31.510624 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-04f0c998-994a-49fc-b615-f9e0b3ac853b req-5f8f5f60-dfb5-475a-a31b-c4afc5d3d9ec service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-unplugged-f99ceda9-fad6-4a73-af2a-c63d3d320e2f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:31.510822 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-04f0c998-994a-49fc-b615-f9e0b3ac853b req-5f8f5f60-dfb5-475a-a31b-c4afc5d3d9ec service nova] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:31.511020 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-04f0c998-994a-49fc-b615-f9e0b3ac853b req-5f8f5f60-dfb5-475a-a31b-c4afc5d3d9ec service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:31.511183 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-04f0c998-994a-49fc-b615-f9e0b3ac853b req-5f8f5f60-dfb5-475a-a31b-c4afc5d3d9ec service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:31.511768 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-04f0c998-994a-49fc-b615-f9e0b3ac853b req-5f8f5f60-dfb5-475a-a31b-c4afc5d3d9ec service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] No waiting events found dispatching network-vif-unplugged-f99ceda9-fad6-4a73-af2a-c63d3d320e2f {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:31.512088 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-04f0c998-994a-49fc-b615-f9e0b3ac853b req-5f8f5f60-dfb5-475a-a31b-c4afc5d3d9ec service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-unplugged-f99ceda9-fad6-4a73-af2a-c63d3d320e2f for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:00:31.512088 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-04f0c998-994a-49fc-b615-f9e0b3ac853b req-5f8f5f60-dfb5-475a-a31b-c4afc5d3d9ec service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-unplugged-f99ceda9-fad6-4a73-af2a-c63d3d320e2f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:31.512309 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-04f0c998-994a-49fc-b615-f9e0b3ac853b req-5f8f5f60-dfb5-475a-a31b-c4afc5d3d9ec service nova] Acquiring lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:31.512550 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-04f0c998-994a-49fc-b615-f9e0b3ac853b req-5f8f5f60-dfb5-475a-a31b-c4afc5d3d9ec service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:31.512714 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-04f0c998-994a-49fc-b615-f9e0b3ac853b req-5f8f5f60-dfb5-475a-a31b-c4afc5d3d9ec service nova] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:31.512861 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-04f0c998-994a-49fc-b615-f9e0b3ac853b req-5f8f5f60-dfb5-475a-a31b-c4afc5d3d9ec service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] No waiting events found dispatching network-vif-unplugged-f99ceda9-fad6-4a73-af2a-c63d3d320e2f {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:31.513000 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-04f0c998-994a-49fc-b615-f9e0b3ac853b req-5f8f5f60-dfb5-475a-a31b-c4afc5d3d9ec service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-unplugged-f99ceda9-fad6-4a73-af2a-c63d3d320e2f for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:00:31.513136 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-04f0c998-994a-49fc-b615-f9e0b3ac853b req-5f8f5f60-dfb5-475a-a31b-c4afc5d3d9ec service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Received event network-vif-unplugged-d99a2cf4-260b-4ca3-b72e-7db23358b831 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:31.513407 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-04f0c998-994a-49fc-b615-f9e0b3ac853b req-5f8f5f60-dfb5-475a-a31b-c4afc5d3d9ec service nova] Acquiring lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:31.514397 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-04f0c998-994a-49fc-b615-f9e0b3ac853b req-5f8f5f60-dfb5-475a-a31b-c4afc5d3d9ec service nova] Lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:31.514650 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-04f0c998-994a-49fc-b615-f9e0b3ac853b req-5f8f5f60-dfb5-475a-a31b-c4afc5d3d9ec service nova] Lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:31.515184 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-04f0c998-994a-49fc-b615-f9e0b3ac853b req-5f8f5f60-dfb5-475a-a31b-c4afc5d3d9ec service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] No waiting events found dispatching network-vif-unplugged-d99a2cf4-260b-4ca3-b72e-7db23358b831 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:31.515551 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-04f0c998-994a-49fc-b615-f9e0b3ac853b req-5f8f5f60-dfb5-475a-a31b-c4afc5d3d9ec service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Received unexpected event network-vif-unplugged-d99a2cf4-260b-4ca3-b72e-7db23358b831 for instance with vm_state deleted and task_state None.
May 21 02:00:31.515668 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-04f0c998-994a-49fc-b615-f9e0b3ac853b req-5f8f5f60-dfb5-475a-a31b-c4afc5d3d9ec service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Received event network-vif-unplugged-d99a2cf4-260b-4ca3-b72e-7db23358b831 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:31.515816 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-04f0c998-994a-49fc-b615-f9e0b3ac853b req-5f8f5f60-dfb5-475a-a31b-c4afc5d3d9ec service nova] Acquiring lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:31.515951 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-04f0c998-994a-49fc-b615-f9e0b3ac853b req-5f8f5f60-dfb5-475a-a31b-c4afc5d3d9ec service nova] Lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:31.516043 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-04f0c998-994a-49fc-b615-f9e0b3ac853b req-5f8f5f60-dfb5-475a-a31b-c4afc5d3d9ec service nova] Lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:31.516135 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-04f0c998-994a-49fc-b615-f9e0b3ac853b req-5f8f5f60-dfb5-475a-a31b-c4afc5d3d9ec service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] No waiting events found dispatching network-vif-unplugged-d99a2cf4-260b-4ca3-b72e-7db23358b831 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:31.516233 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-04f0c998-994a-49fc-b615-f9e0b3ac853b req-5f8f5f60-dfb5-475a-a31b-c4afc5d3d9ec service nova] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Received unexpected event network-vif-unplugged-d99a2cf4-260b-4ca3-b72e-7db23358b831 for instance with vm_state deleted and task_state None.
May 21 02:00:31.539665 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Found WWN 33000000077b1ccd7 for multipath device dm-10 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:00:31.539915 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.048s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:00:31.540206 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] <== connect_volume: return (2048ms) {'type': 'block', 'scsi_wwn': '33000000077b1ccd7', 'path': '/dev/dm-10', 'multipath_id': '33000000077b1ccd7'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:00:31.540370 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000077b1ccd7', 'path': '/dev/dm-10', 'multipath_id': '33000000077b1ccd7'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:00:31.606778 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:31.762810 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Updating instance_info_cache with network_info: [{"id": "1b938e0e-b319-49b6-a973-0e80c89b92e6", "address": "fa:16:3e:bc:04:20", "network": {"id": "effc5fd0-bb6d-41a3-aa93-0b65d17db1d9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2119568761-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dde2f210a0e4debaa655c852b3621da", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b938e0e-b3", "ovs_interfaceid": "1b938e0e-b319-49b6-a973-0e80c89b92e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:00:31.935541 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bd40c5ce-20f9-4d0e-9549-2b34e0c216e2 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:31.936577 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bd40c5ce-20f9-4d0e-9549-2b34e0c216e2 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:32.046297 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:59:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2141638290',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serverbootfromvolumestablerescuetest-server-2141638290',id=22,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:00:18Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83df9a84ffaa4398bdafbfbde079964d',ramdisk_id='',reservation_id='r-fiump4ea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-260444396',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:00:19Z,user_data=None,user_id='bd5b969d5a514d01bacfc7954a5ae4ab',uuid=61f5b839-7cd4-428d-8dc0-327effc695d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20", "address": "fa:16:3e:7c:15:86", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "vif_mac": "fa:16:3e:7c:15:86"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c8ad0fa-79", "ovs_interfaceid": "6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:00:32.046717 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Converting VIF {"id": "6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20", "address": "fa:16:3e:7c:15:86", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "vif_mac": "fa:16:3e:7c:15:86"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c8ad0fa-79", "ovs_interfaceid": "6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:00:32.047068 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:15:86,bridge_name='br-int',has_traffic_filtering=True,id=6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20,network=Network(b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c8ad0fa-79') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:00:32.047813 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lazy-loading 'pci_devices' on Instance uuid 61f5b839-7cd4-428d-8dc0-327effc695d8 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:00:32.265684 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Releasing lock "refresh_cache-44334b65-4382-4a2d-80f1-a1ae2cdfe1e8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:00:32.266077 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Instance network_info: |[{"id": "1b938e0e-b319-49b6-a973-0e80c89b92e6", "address": "fa:16:3e:bc:04:20", "network": {"id": "effc5fd0-bb6d-41a3-aa93-0b65d17db1d9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2119568761-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dde2f210a0e4debaa655c852b3621da", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b938e0e-b3", "ovs_interfaceid": "1b938e0e-b319-49b6-a973-0e80c89b92e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:00:32.267487 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Start _get_guest_xml network_info=[{"id": "1b938e0e-b319-49b6-a973-0e80c89b92e6", "address": "fa:16:3e:bc:04:20", "network": {"id": "effc5fd0-bb6d-41a3-aa93-0b65d17db1d9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2119568761-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dde2f210a0e4debaa655c852b3621da", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b938e0e-b3", "ovs_interfaceid": "1b938e0e-b319-49b6-a973-0e80c89b92e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '44334b65-4382-4a2d-80f1-a1ae2cdfe1e8', 'attached_at': '', 'detached_at': '', 'volume_id': 'b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'serial': 'b38b53ce-4cdb-4612-9475-9ea4e1b1205b'}, 'delete_on_termination': True, 'attachment_id': 'fac28177-0770-4aa5-aab4-585439fbb1de', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:00:32.271205 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:00:32.275678 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-1227980448', uuid='44334b65-4382-4a2d-80f1-a1ae2cdfe1e8'), owner=OwnerMeta(userid='45d8378885514dd79b666ba5f5352716', username='tempest-ServerActionsV293TestJSON-2031447781-project-member', projectid='9dde2f210a0e4debaa655c852b3621da', projectname='tempest-ServerActionsV293TestJSON-2031447781'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1b938e0e-b319-49b6-a973-0e80c89b92e6", "address": "fa:16:3e:bc:04:20", "network": {"id": "effc5fd0-bb6d-41a3-aa93-0b65d17db1d9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2119568761-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dde2f210a0e4debaa655c852b3621da", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b938e0e-b3", "ovs_interfaceid": "1b938e0e-b319-49b6-a973-0e80c89b92e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328832.2724946) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:00:32.277239 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:00:32.277729 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:00:32.285134 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:00:32.285134 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:00:32.285134 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:00:32.285134 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:00:32.285134 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:00:32.285134 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:00:32.285134 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:00:32.285134 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:00:32.285134 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:00:32.285134 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:00:32.285134 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:00:32.285134 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:00:32.285134 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:00:32.285134 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:00:32.294274 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:00:32.294874 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:00:32.295089 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:00:32.295431 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:00:32.295750 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:00:32.308831 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:00:32.309507 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:00:32.310054 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:00:32.310284 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:00:32.310714 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:00:32.310951 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:00:32.326251 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:00:32.326251 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:32.335848 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:00:32.335848 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:32.344648 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b] added
May 21 02:00:32.344648 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:00:32.344648 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:00:32.344648 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:00:32.344648 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:00:32.344648 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:00:32.344648 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:32.344951 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:00:32.345427 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0348(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:00:32.345427 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:00:32.348902 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b] added
May 21 02:00:32.348902 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:00:32.348902 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:00:32.348902 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:00:32.348902 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:00:32.348902 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:00:32.348902 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:32.349339 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:00:32.349339 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0383(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:00:32.349504 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:00:32.544886 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:32.552424 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Object Instance<61f5b839-7cd4-428d-8dc0-327effc695d8> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:00:32.553656 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] End _get_guest_xml xml=<domain type="qemu">
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:   <uuid>61f5b839-7cd4-428d-8dc0-327effc695d8</uuid>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:   <name>instance-00000016</name>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2141638290</nova:name>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:00:28</nova:creationTime>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:           <nova:property name="hw_machine_type">pc</nova:property>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:           <nova:property name="hw_video_model">virtio</nova:property>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:         <nova:user uuid="bd5b969d5a514d01bacfc7954a5ae4ab">tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member</nova:user>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:         <nova:project uuid="83df9a84ffaa4398bdafbfbde079964d">tempest-ServerBootFromVolumeStableRescueTest-260444396</nova:project>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:         <nova:port uuid="6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20">
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:     <system>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:       <entry name="serial">61f5b839-7cd4-428d-8dc0-327effc695d8</entry>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:       <entry name="uuid">61f5b839-7cd4-428d-8dc0-327effc695d8</entry>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:     </system>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:   <os>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:   </os>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:   <features>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:   </features>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:   <devices>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/61f5b839-7cd4-428d-8dc0-327effc695d8/disk.config"/>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:     </disk>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:       <alias name="ua-8e307392-5cde-4d6a-a155-dfbc7af6ce53"/>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-10"/>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:       <serial>8e307392-5cde-4d6a-a155-dfbc7af6ce53</serial>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:     </disk>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/61f5b839-7cd4-428d-8dc0-327effc695d8/disk.rescue"/>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:       <target dev="vdb" bus="virtio"/>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:       <boot order="1"/>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:     </disk>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:7c:15:86"/>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:       <target dev="tap6c8ad0fa-79"/>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:     </interface>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/61f5b839-7cd4-428d-8dc0-327effc695d8/console.log" append="off"/>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:     </serial>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:     <video>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:     </video>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:     </rng>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:   </devices>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]: </domain>
May 21 02:00:32.553656 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:00:32.561261 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Instance destroyed successfully.
May 21 02:00:32.627737 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bd40c5ce-20f9-4d0e-9549-2b34e0c216e2 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:00:32.628327 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-bd40c5ce-20f9-4d0e-9549-2b34e0c216e2 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:00:33.131592 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-bd40c5ce-20f9-4d0e-9549-2b34e0c216e2 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:00:33.346665 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:00:33.350998 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:00:33.364280 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:00:33.364280 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:00:33.371284 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:00:33.371284 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:33.379185 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:33.394498 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:33.397672 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:33.397672 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:33.397672 np0000001127 nova-compute[98206]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:33.397672 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:33.397672 np0000001127 nova-compute[98206]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:33.397672 np0000001127 nova-compute[98206]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:33.397672 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:00:33.397903 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:33.397903 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:33.397903 np0000001127 nova-compute[98206]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:33.397903 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:33.397903 np0000001127 nova-compute[98206]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:33.397903 np0000001127 nova-compute[98206]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:33.397903 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:00:33.408206 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:33.408206 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:33.408206 np0000001127 nova-compute[98206]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:33.408206 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:33.408206 np0000001127 nova-compute[98206]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:33.408206 np0000001127 nova-compute[98206]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:33.408206 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:00:33.408557 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:33.408557 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:33.408557 np0000001127 nova-compute[98206]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:33.408557 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:33.408557 np0000001127 nova-compute[98206]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:33.408557 np0000001127 nova-compute[98206]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:33.408557 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:00:33.450704 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b, portal: 192.168.40.100,3260]
May 21 02:00:33.450704 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b, portal: 192.168.40.100,3260] successful.
May 21 02:00:33.450704 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:33.457240 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b, portal: 192.168.50.100,3260]
May 21 02:00:33.457240 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b, portal: 192.168.50.100,3260] successful.
May 21 02:00:33.457240 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:33.466245 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:33.471160 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:33.482993 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:33.482993 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:33.482993 np0000001127 nova-compute[98206]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:33.482993 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:33.482993 np0000001127 nova-compute[98206]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:33.482993 np0000001127 nova-compute[98206]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:33.482993 np0000001127 nova-compute[98206]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:00:33.482993 np0000001127 nova-compute[98206]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:00:33.482993 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:00:33.483385 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:33.483385 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:33.483385 np0000001127 nova-compute[98206]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:33.483385 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:33.483385 np0000001127 nova-compute[98206]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:33.483385 np0000001127 nova-compute[98206]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:33.483385 np0000001127 nova-compute[98206]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:00:33.483385 np0000001127 nova-compute[98206]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:00:33.483385 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:00:33.483385 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.173s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:00:33.483728 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:00:33.484440 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] HCTL ('12', '-', '-', 0) found on session 51 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:00:33.484440 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:00:33.491168 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:33.491168 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:33.491168 np0000001127 nova-compute[98206]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:33.491168 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:33.491168 np0000001127 nova-compute[98206]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:33.491168 np0000001127 nova-compute[98206]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:33.491168 np0000001127 nova-compute[98206]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:00:33.491168 np0000001127 nova-compute[98206]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:00:33.491168 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:00:33.491168 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:33.491168 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:33.491168 np0000001127 nova-compute[98206]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:33.491168 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:33.491168 np0000001127 nova-compute[98206]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:33.491168 np0000001127 nova-compute[98206]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:33.491168 np0000001127 nova-compute[98206]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:00:33.491168 np0000001127 nova-compute[98206]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:00:33.491168 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:00:33.491630 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.181s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:00:33.491630 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:00:33.492332 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] HCTL ('11', '-', '-', 0) found on session 50 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:00:33.492424 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:00:33.501235 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Searching for a device in session 51 and hctl ['12', '*', '*', 0] yield: None {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:00:33.513530 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Searching for a device in session 50 and hctl ['11', '*', '*', 0] yield: sdg {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:00:33.513530 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:00:33.591120 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c8352aba-98d2-4023-8498-23be616c2f1e req-1db7c2c5-d74a-4df7-bf88-c8d01dfcc244 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-deleted-a350a027-1ffc-4539-a238-d98bbb9baeba {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:33.591413 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-c8352aba-98d2-4023-8498-23be616c2f1e req-1db7c2c5-d74a-4df7-bf88-c8d01dfcc244 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Neutron deleted interface a350a027-1ffc-4539-a238-d98bbb9baeba; detaching it from the instance and deleting it from the info cache
May 21 02:00:33.591827 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-c8352aba-98d2-4023-8498-23be616c2f1e req-1db7c2c5-d74a-4df7-bf88-c8d01dfcc244 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Updating instance_info_cache with network_info: [{"id": "f99ceda9-fad6-4a73-af2a-c63d3d320e2f", "address": "fa:16:3e:f8:14:ac", "network": {"id": "0ab35e13-b362-4576-91d1-569cb811b2d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1427614225-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf99ceda9-fa", "ovs_interfaceid": "f99ceda9-fad6-4a73-af2a-c63d3d320e2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71580ee4-3192-484a-9ee6-5096ac78a4ce", "address": "fa:16:3e:32:44:18", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71580ee4-31", "ovs_interfaceid": "71580ee4-3192-484a-9ee6-5096ac78a4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9e74661c-8435-43a4-82d7-b7d757552d24", "address": "fa:16:3e:e6:51:87", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e74661c-84", "ovs_interfaceid": "9e74661c-8435-43a4-82d7-b7d757552d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "407bbd3c-7537-4404-aaf5-a5ed533bb33b", "address": "fa:16:3e:80:dd:78", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap407bbd3c-75", "ovs_interfaceid": "407bbd3c-7537-4404-aaf5-a5ed533bb33b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58939f92-ac70-47fb-90c0-5f7bc2421c47", "address": "fa:16:3e:db:3c:f9", "network": {"id": "54c4e0a1-6a66-4891-94c3-c85fc5fe181c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2031114495", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58939f92-ac", "ovs_interfaceid": "58939f92-ac70-47fb-90c0-5f7bc2421c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1ac81609-4fab-4940-9313-6dd7160c7a9b", "address": "fa:16:3e:c9:a8:b1", "network": {"id": "54c4e0a1-6a66-4891-94c3-c85fc5fe181c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2031114495", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac81609-4f", "ovs_interfaceid": "1ac81609-4fab-4940-9313-6dd7160c7a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:00:33.644821 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bd40c5ce-20f9-4d0e-9549-2b34e0c216e2 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.708s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:33.705447 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-af837383-bb9e-4265-a8b7-184e42f28e22 req-8c42403c-f70d-4a7a-adc7-15b28659d94c service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-deleted-407bbd3c-7537-4404-aaf5-a5ed533bb33b {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:33.705447 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-af837383-bb9e-4265-a8b7-184e42f28e22 req-8c42403c-f70d-4a7a-adc7-15b28659d94c service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Neutron deleted interface 407bbd3c-7537-4404-aaf5-a5ed533bb33b; detaching it from the instance and deleting it from the info cache
May 21 02:00:33.708776 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-af837383-bb9e-4265-a8b7-184e42f28e22 req-8c42403c-f70d-4a7a-adc7-15b28659d94c service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Updating instance_info_cache with network_info: [{"id": "f99ceda9-fad6-4a73-af2a-c63d3d320e2f", "address": "fa:16:3e:f8:14:ac", "network": {"id": "0ab35e13-b362-4576-91d1-569cb811b2d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1427614225-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf99ceda9-fa", "ovs_interfaceid": "f99ceda9-fad6-4a73-af2a-c63d3d320e2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71580ee4-3192-484a-9ee6-5096ac78a4ce", "address": "fa:16:3e:32:44:18", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71580ee4-31", "ovs_interfaceid": "71580ee4-3192-484a-9ee6-5096ac78a4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9e74661c-8435-43a4-82d7-b7d757552d24", "address": "fa:16:3e:e6:51:87", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e74661c-84", "ovs_interfaceid": "9e74661c-8435-43a4-82d7-b7d757552d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "58939f92-ac70-47fb-90c0-5f7bc2421c47", "address": "fa:16:3e:db:3c:f9", "network": {"id": "54c4e0a1-6a66-4891-94c3-c85fc5fe181c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2031114495", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58939f92-ac", "ovs_interfaceid": "58939f92-ac70-47fb-90c0-5f7bc2421c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1ac81609-4fab-4940-9313-6dd7160c7a9b", "address": "fa:16:3e:c9:a8:b1", "network": {"id": "54c4e0a1-6a66-4891-94c3-c85fc5fe181c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2031114495", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac81609-4f", "ovs_interfaceid": "1ac81609-4fab-4940-9313-6dd7160c7a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:00:33.754646 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-bd40c5ce-20f9-4d0e-9549-2b34e0c216e2 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Deleted allocations for instance a6839691-a7ec-4dea-bc39-a7e89c94cf4d
May 21 02:00:34.091808 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:00:34.091943 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:00:34.092062 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:00:34.092161 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] No VIF found with MAC fa:16:3e:7c:15:86, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:00:34.092753 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Using config drive
May 21 02:00:34.100043 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c8352aba-98d2-4023-8498-23be616c2f1e req-1db7c2c5-d74a-4df7-bf88-c8d01dfcc244 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Detach interface failed, port_id=a350a027-1ffc-4539-a238-d98bbb9baeba, reason: Instance a4b3355b-92d6-4b36-8dad-6cb4b3c579a2 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:00:34.100174 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c8352aba-98d2-4023-8498-23be616c2f1e req-1db7c2c5-d74a-4df7-bf88-c8d01dfcc244 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-deleted-1ac81609-4fab-4940-9313-6dd7160c7a9b {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:34.100286 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-c8352aba-98d2-4023-8498-23be616c2f1e req-1db7c2c5-d74a-4df7-bf88-c8d01dfcc244 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Neutron deleted interface 1ac81609-4fab-4940-9313-6dd7160c7a9b; detaching it from the instance and deleting it from the info cache
May 21 02:00:34.100604 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-c8352aba-98d2-4023-8498-23be616c2f1e req-1db7c2c5-d74a-4df7-bf88-c8d01dfcc244 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Updating instance_info_cache with network_info: [{"id": "f99ceda9-fad6-4a73-af2a-c63d3d320e2f", "address": "fa:16:3e:f8:14:ac", "network": {"id": "0ab35e13-b362-4576-91d1-569cb811b2d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1427614225-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf99ceda9-fa", "ovs_interfaceid": "f99ceda9-fad6-4a73-af2a-c63d3d320e2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71580ee4-3192-484a-9ee6-5096ac78a4ce", "address": "fa:16:3e:32:44:18", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71580ee4-31", "ovs_interfaceid": "71580ee4-3192-484a-9ee6-5096ac78a4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9e74661c-8435-43a4-82d7-b7d757552d24", "address": "fa:16:3e:e6:51:87", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e74661c-84", "ovs_interfaceid": "9e74661c-8435-43a4-82d7-b7d757552d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "407bbd3c-7537-4404-aaf5-a5ed533bb33b", "address": "fa:16:3e:80:dd:78", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap407bbd3c-75", "ovs_interfaceid": "407bbd3c-7537-4404-aaf5-a5ed533bb33b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58939f92-ac70-47fb-90c0-5f7bc2421c47", "address": "fa:16:3e:db:3c:f9", "network": {"id": "54c4e0a1-6a66-4891-94c3-c85fc5fe181c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2031114495", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58939f92-ac", "ovs_interfaceid": "58939f92-ac70-47fb-90c0-5f7bc2421c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:00:34.212516 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-af837383-bb9e-4265-a8b7-184e42f28e22 req-8c42403c-f70d-4a7a-adc7-15b28659d94c service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Detach interface failed, port_id=407bbd3c-7537-4404-aaf5-a5ed533bb33b, reason: Instance a4b3355b-92d6-4b36-8dad-6cb4b3c579a2 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:00:34.482048 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:00:34.501349 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Searching for a device in session 51 and hctl ['12', '*', '*', 0] yield: sdf {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:00:34.501560 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:00:34.501985 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:34.596334 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lazy-loading 'ec2_ids' on Instance uuid 61f5b839-7cd4-428d-8dc0-327effc695d8 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:00:34.605073 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c8352aba-98d2-4023-8498-23be616c2f1e req-1db7c2c5-d74a-4df7-bf88-c8d01dfcc244 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Detach interface failed, port_id=1ac81609-4fab-4940-9313-6dd7160c7a9b, reason: Instance a4b3355b-92d6-4b36-8dad-6cb4b3c579a2 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:00:34.605409 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c8352aba-98d2-4023-8498-23be616c2f1e req-1db7c2c5-d74a-4df7-bf88-c8d01dfcc244 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-deleted-f99ceda9-fad6-4a73-af2a-c63d3d320e2f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:34.605487 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-c8352aba-98d2-4023-8498-23be616c2f1e req-1db7c2c5-d74a-4df7-bf88-c8d01dfcc244 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Neutron deleted interface f99ceda9-fad6-4a73-af2a-c63d3d320e2f; detaching it from the instance and deleting it from the info cache
May 21 02:00:34.605867 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-c8352aba-98d2-4023-8498-23be616c2f1e req-1db7c2c5-d74a-4df7-bf88-c8d01dfcc244 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Updating instance_info_cache with network_info: [{"id": "71580ee4-3192-484a-9ee6-5096ac78a4ce", "address": "fa:16:3e:32:44:18", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71580ee4-31", "ovs_interfaceid": "71580ee4-3192-484a-9ee6-5096ac78a4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9e74661c-8435-43a4-82d7-b7d757552d24", "address": "fa:16:3e:e6:51:87", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e74661c-84", "ovs_interfaceid": "9e74661c-8435-43a4-82d7-b7d757552d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "407bbd3c-7537-4404-aaf5-a5ed533bb33b", "address": "fa:16:3e:80:dd:78", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap407bbd3c-75", "ovs_interfaceid": "407bbd3c-7537-4404-aaf5-a5ed533bb33b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58939f92-ac70-47fb-90c0-5f7bc2421c47", "address": "fa:16:3e:db:3c:f9", "network": {"id": "54c4e0a1-6a66-4891-94c3-c85fc5fe181c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2031114495", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58939f92-ac", "ovs_interfaceid": "58939f92-ac70-47fb-90c0-5f7bc2421c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:00:34.763739 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bd40c5ce-20f9-4d0e-9549-2b34e0c216e2 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "a6839691-a7ec-4dea-bc39-a7e89c94cf4d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.696s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:34.984563 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Took 5.09 seconds to deallocate network for instance.
May 21 02:00:35.100801 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Object Instance<61f5b839-7cd4-428d-8dc0-327effc695d8> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:00:35.101392 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lazy-loading 'keypairs' on Instance uuid 61f5b839-7cd4-428d-8dc0-327effc695d8 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:00:35.109837 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c8352aba-98d2-4023-8498-23be616c2f1e req-1db7c2c5-d74a-4df7-bf88-c8d01dfcc244 service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Detach interface failed, port_id=f99ceda9-fad6-4a73-af2a-c63d3d320e2f, reason: Instance a4b3355b-92d6-4b36-8dad-6cb4b3c579a2 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:00:35.328815 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Found WWN 330000000c2b561bb for multipath device dm-2 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:00:35.329301 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:00:35.329301 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '330000000c2b561bb', 'path': '/dev/dm-2', 'multipath_id': '330000000c2b561bb'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:00:35.329665 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c2b561bb', 'path': '/dev/dm-2', 'multipath_id': '330000000c2b561bb'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:00:35.610425 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Object Instance<61f5b839-7cd4-428d-8dc0-327effc695d8> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:00:35.614374 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:35.668189 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2c96a65b-47a4-4d26-9242-d319fc691f61 req-3c93da07-c5d6-4549-92ab-7c679ce17a2d service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Received event network-vif-deleted-58939f92-ac70-47fb-90c0-5f7bc2421c47 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:35.668731 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-2c96a65b-47a4-4d26-9242-d319fc691f61 req-3c93da07-c5d6-4549-92ab-7c679ce17a2d service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Neutron deleted interface 58939f92-ac70-47fb-90c0-5f7bc2421c47; detaching it from the instance and deleting it from the info cache
May 21 02:00:35.668950 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-2c96a65b-47a4-4d26-9242-d319fc691f61 req-3c93da07-c5d6-4549-92ab-7c679ce17a2d service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Updating instance_info_cache with network_info: [{"id": "71580ee4-3192-484a-9ee6-5096ac78a4ce", "address": "fa:16:3e:32:44:18", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71580ee4-31", "ovs_interfaceid": "71580ee4-3192-484a-9ee6-5096ac78a4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9e74661c-8435-43a4-82d7-b7d757552d24", "address": "fa:16:3e:e6:51:87", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e74661c-84", "ovs_interfaceid": "9e74661c-8435-43a4-82d7-b7d757552d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "407bbd3c-7537-4404-aaf5-a5ed533bb33b", "address": "fa:16:3e:80:dd:78", "network": {"id": "34d80d18-cae3-4477-a29e-164067d97021", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961251826", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fea6765f0d474e20a8cf4ce239d06576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap407bbd3c-75", "ovs_interfaceid": "407bbd3c-7537-4404-aaf5-a5ed533bb33b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:00:35.777900 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Creating config drive at /opt/stack/data/nova/instances/61f5b839-7cd4-428d-8dc0-327effc695d8/disk.config.rescue
May 21 02:00:35.782885 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/61f5b839-7cd4-428d-8dc0-327effc695d8/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpirku1wxq {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:35.837118 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:00:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1227980448',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serveractionsv293testjson-server-1227980448',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdSLsNf05ft6B/PkgYJEgNxCPaotlaC+SYwLSyQfqbTHXXe3gCjns78xO/QDQw3uXc0vYQiJCLA0+VzLHhxlUHFht+sbUG63daZBfxAE+WcylLxkwBu6nkTH7iMalcD6A==',key_name='tempest-keypair-121683660',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dde2f210a0e4debaa655c852b3621da',ramdisk_id='',reservation_id='r-3sc7d1ev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-2031447781',owner_user_name='tempest-ServerActionsV293TestJSON-2031447781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:00:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45d8378885514dd79b666ba5f5352716',uuid=44334b65-4382-4a2d-80f1-a1ae2cdfe1e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b938e0e-b319-49b6-a973-0e80c89b92e6", "address": "fa:16:3e:bc:04:20", "network": {"id": "effc5fd0-bb6d-41a3-aa93-0b65d17db1d9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2119568761-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dde2f210a0e4debaa655c852b3621da", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b938e0e-b3", "ovs_interfaceid": "1b938e0e-b319-49b6-a973-0e80c89b92e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:00:35.837326 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Converting VIF {"id": "1b938e0e-b319-49b6-a973-0e80c89b92e6", "address": "fa:16:3e:bc:04:20", "network": {"id": "effc5fd0-bb6d-41a3-aa93-0b65d17db1d9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2119568761-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dde2f210a0e4debaa655c852b3621da", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b938e0e-b3", "ovs_interfaceid": "1b938e0e-b319-49b6-a973-0e80c89b92e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:00:35.838236 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:04:20,bridge_name='br-int',has_traffic_filtering=True,id=1b938e0e-b319-49b6-a973-0e80c89b92e6,network=Network(effc5fd0-bb6d-41a3-aa93-0b65d17db1d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b938e0e-b3') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:00:35.839147 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lazy-loading 'pci_devices' on Instance uuid 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:00:35.845412 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/61f5b839-7cd4-428d-8dc0-327effc695d8/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpirku1wxq" returned: 0 in 0.062s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:36.070330 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:36.177043 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2c96a65b-47a4-4d26-9242-d319fc691f61 req-3c93da07-c5d6-4549-92ab-7c679ce17a2d service nova] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Detach interface failed, port_id=58939f92-ac70-47fb-90c0-5f7bc2421c47, reason: Instance a4b3355b-92d6-4b36-8dad-6cb4b3c579a2 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:00:36.301090 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:36.346514 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] End _get_guest_xml xml=<domain type="qemu">
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:   <uuid>44334b65-4382-4a2d-80f1-a1ae2cdfe1e8</uuid>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:   <name>instance-00000017</name>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1227980448</nova:name>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:00:32</nova:creationTime>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:       <nova:image uuid="">
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:         <nova:user uuid="45d8378885514dd79b666ba5f5352716">tempest-ServerActionsV293TestJSON-2031447781-project-member</nova:user>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:         <nova:project uuid="9dde2f210a0e4debaa655c852b3621da">tempest-ServerActionsV293TestJSON-2031447781</nova:project>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:       <nova:root type="volume" uuid=""/>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:         <nova:port uuid="1b938e0e-b319-49b6-a973-0e80c89b92e6">
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:     <system>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:       <entry name="serial">44334b65-4382-4a2d-80f1-a1ae2cdfe1e8</entry>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:       <entry name="uuid">44334b65-4382-4a2d-80f1-a1ae2cdfe1e8</entry>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:     </system>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:   <os>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:   </os>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:   <features>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:   </features>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:   <devices>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/44334b65-4382-4a2d-80f1-a1ae2cdfe1e8/disk.config"/>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:     </disk>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:       <alias name="ua-b38b53ce-4cdb-4612-9475-9ea4e1b1205b"/>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-2"/>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:       <serial>b38b53ce-4cdb-4612-9475-9ea4e1b1205b</serial>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:     </disk>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:bc:04:20"/>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:       <target dev="tap1b938e0e-b3"/>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:     </interface>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/44334b65-4382-4a2d-80f1-a1ae2cdfe1e8/console.log" append="off"/>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:     </serial>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:     <video>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:     </video>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:     </rng>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:   </devices>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]: </domain>
May 21 02:00:36.346514 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:00:36.346514 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Preparing to wait for external event network-vif-plugged-1b938e0e-b319-49b6-a973-0e80c89b92e6 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:00:36.346514 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Acquiring lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:36.346514 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:36.346514 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:36.351274 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:00:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1227980448',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serveractionsv293testjson-server-1227980448',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdSLsNf05ft6B/PkgYJEgNxCPaotlaC+SYwLSyQfqbTHXXe3gCjns78xO/QDQw3uXc0vYQiJCLA0+VzLHhxlUHFht+sbUG63daZBfxAE+WcylLxkwBu6nkTH7iMalcD6A==',key_name='tempest-keypair-121683660',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dde2f210a0e4debaa655c852b3621da',ramdisk_id='',reservation_id='r-3sc7d1ev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-2031447781',owner_user_name='tempest-ServerActionsV293TestJSON-2031447781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:00:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45d8378885514dd79b666ba5f5352716',uuid=44334b65-4382-4a2d-80f1-a1ae2cdfe1e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b938e0e-b319-49b6-a973-0e80c89b92e6", "address": "fa:16:3e:bc:04:20", "network": {"id": "effc5fd0-bb6d-41a3-aa93-0b65d17db1d9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2119568761-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dde2f210a0e4debaa655c852b3621da", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b938e0e-b3", "ovs_interfaceid": "1b938e0e-b319-49b6-a973-0e80c89b92e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:00:36.351274 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Converting VIF {"id": "1b938e0e-b319-49b6-a973-0e80c89b92e6", "address": "fa:16:3e:bc:04:20", "network": {"id": "effc5fd0-bb6d-41a3-aa93-0b65d17db1d9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2119568761-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dde2f210a0e4debaa655c852b3621da", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b938e0e-b3", "ovs_interfaceid": "1b938e0e-b319-49b6-a973-0e80c89b92e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:00:36.352688 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:04:20,bridge_name='br-int',has_traffic_filtering=True,id=1b938e0e-b319-49b6-a973-0e80c89b92e6,network=Network(effc5fd0-bb6d-41a3-aa93-0b65d17db1d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b938e0e-b3') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:00:36.352688 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:04:20,bridge_name='br-int',has_traffic_filtering=True,id=1b938e0e-b319-49b6-a973-0e80c89b92e6,network=Network(effc5fd0-bb6d-41a3-aa93-0b65d17db1d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b938e0e-b3') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:00:36.353022 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:36.353400 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:36.353699 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:00:36.358063 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:36.358063 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b7a3a121-bf88-5241-b88c-a927bc8bbdbd', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:36.358063 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:36.359018 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:00:36.366086 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:36.369324 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:36.372062 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b938e0e-b3, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:36.373934 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1b938e0e-b3, col_values=(('qos', UUID('b1d21ede-04cc-4d17-b54b-9fcf3bc21c4b')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:36.374947 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1b938e0e-b3, col_values=(('external_ids', {'iface-id': '1b938e0e-b319-49b6-a973-0e80c89b92e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:04:20', 'vm-uuid': '44334b65-4382-4a2d-80f1-a1ae2cdfe1e8'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:36.376454 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:36.378631 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:00:36.396200 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:36.396773 np0000001127 nova-compute[98206]: INFO os_vif [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:04:20,bridge_name='br-int',has_traffic_filtering=True,id=1b938e0e-b319-49b6-a973-0e80c89b92e6,network=Network(effc5fd0-bb6d-41a3-aa93-0b65d17db1d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b938e0e-b3')
May 21 02:00:36.430768 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:36.541356 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:36.614535 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:36.622182 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:36.718832 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Took 1.73 seconds to detach 3 volumes for instance.
May 21 02:00:37.228925 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:37.228925 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:37.495044 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Removed pending STOPPED event for 61f5b839-7cd4-428d-8dc0-327effc695d8 due to new event <LifecycleEvent: 1779328837.4945872, 61f5b839-7cd4-428d-8dc0-327effc695d8 => Resumed> {{(pid=98206) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 21 02:00:37.495394 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328837.4945872, 61f5b839-7cd4-428d-8dc0-327effc695d8 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:00:37.495447 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] VM Resumed (Lifecycle Event)
May 21 02:00:37.498667 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-0e9eb360-6529-4210-878c-9567e3c94611 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:00:37.775031 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:00:37.775433 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:00:37.929028 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:00:37.929778 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:00:37.930026 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] No VIF found with MAC fa:16:3e:bc:04:20, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:00:37.930620 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Using config drive
May 21 02:00:37.998365 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:00:38.002131 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:00:38.279110 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:00:38.440517 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:38.448806 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:38.506403 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328838.505964, 61f5b839-7cd4-428d-8dc0-327effc695d8 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:00:38.506834 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] VM Started (Lifecycle Event)
May 21 02:00:38.616685 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Creating config drive at /opt/stack/data/nova/instances/44334b65-4382-4a2d-80f1-a1ae2cdfe1e8/disk.config
May 21 02:00:38.621814 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/44334b65-4382-4a2d-80f1-a1ae2cdfe1e8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqik0nd9h {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:38.683839 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/44334b65-4382-4a2d-80f1-a1ae2cdfe1e8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqik0nd9h" returned: 0 in 0.062s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:38.793039 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.564s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:38.877817 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Deleted allocations for instance a4b3355b-92d6-4b36-8dad-6cb4b3c579a2
May 21 02:00:39.010633 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:00:39.013879 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:00:39.093230 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-2286629d-a06b-4d16-8855-d3c11e920733 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Unrescuing
May 21 02:00:39.093485 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-2286629d-a06b-4d16-8855-d3c11e920733 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "refresh_cache-61f5b839-7cd4-428d-8dc0-327effc695d8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:00:39.093628 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-2286629d-a06b-4d16-8855-d3c11e920733 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquired lock "refresh_cache-61f5b839-7cd4-428d-8dc0-327effc695d8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:00:39.093780 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-2286629d-a06b-4d16-8855-d3c11e920733 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:00:39.174962 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:39.205835 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:39.334084 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:39.449866 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-5d337ba4-8254-4c81-9f8c-3a854cd7118d req-1af6e80f-8b22-41b3-a63a-9186649bf6fc service nova] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Received event network-vif-plugged-1b938e0e-b319-49b6-a973-0e80c89b92e6 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:39.449866 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5d337ba4-8254-4c81-9f8c-3a854cd7118d req-1af6e80f-8b22-41b3-a63a-9186649bf6fc service nova] Acquiring lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:39.449866 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5d337ba4-8254-4c81-9f8c-3a854cd7118d req-1af6e80f-8b22-41b3-a63a-9186649bf6fc service nova] Lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:39.449866 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5d337ba4-8254-4c81-9f8c-3a854cd7118d req-1af6e80f-8b22-41b3-a63a-9186649bf6fc service nova] Lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:39.449866 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-5d337ba4-8254-4c81-9f8c-3a854cd7118d req-1af6e80f-8b22-41b3-a63a-9186649bf6fc service nova] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Processing event network-vif-plugged-1b938e0e-b319-49b6-a973-0e80c89b92e6 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:00:39.516881 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 21 02:00:39.526398 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d1f2537c-8c38-40cf-a0d0-12ef9fc41bb1 req-814bd7ac-923d-47e5-bd3e-2b61fea195b6 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Received event network-vif-plugged-6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:39.527610 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d1f2537c-8c38-40cf-a0d0-12ef9fc41bb1 req-814bd7ac-923d-47e5-bd3e-2b61fea195b6 service nova] Acquiring lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:39.527841 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d1f2537c-8c38-40cf-a0d0-12ef9fc41bb1 req-814bd7ac-923d-47e5-bd3e-2b61fea195b6 service nova] Lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:39.527841 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d1f2537c-8c38-40cf-a0d0-12ef9fc41bb1 req-814bd7ac-923d-47e5-bd3e-2b61fea195b6 service nova] Lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:39.528111 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d1f2537c-8c38-40cf-a0d0-12ef9fc41bb1 req-814bd7ac-923d-47e5-bd3e-2b61fea195b6 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] No waiting events found dispatching network-vif-plugged-6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:39.530538 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-d1f2537c-8c38-40cf-a0d0-12ef9fc41bb1 req-814bd7ac-923d-47e5-bd3e-2b61fea195b6 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Received unexpected event network-vif-plugged-6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 for instance with vm_state rescued and task_state unrescuing.
May 21 02:00:39.597540 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-2286629d-a06b-4d16-8855-d3c11e920733 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:39.616646 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:39.620042 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:39.623455 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:39.647374 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:39.891862 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-34b3e0e5-5aea-4c1a-afa0-1381380399ab tempest-TaggedBootDevicesTest_v242-1306570717 tempest-TaggedBootDevicesTest_v242-1306570717-project-member] Lock "a4b3355b-92d6-4b36-8dad-6cb4b3c579a2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.869s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:40.144195 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.000376702000039586 future=<Future at 0x71c098395f70 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:00:40.144195 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:00:40.144195 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=2.1055090510001264 future=<Future at 0x71c05858d1f0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:00:40.144195 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=2.1054077930000403 future=<Future at 0x71c05858d1f0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:00:40.333626 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-2286629d-a06b-4d16-8855-d3c11e920733 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:40.359505 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:00:40.360793 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328840.3605425, 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:00:40.360942 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] VM Started (Lifecycle Event)
May 21 02:00:40.368835 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:00:40.379253 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Instance spawned successfully.
May 21 02:00:40.379730 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:00:40.429056 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "e9edec14-452b-46fe-89c6-849ece08f527" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:40.429261 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "e9edec14-452b-46fe-89c6-849ece08f527" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:40.707981 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-2286629d-a06b-4d16-8855-d3c11e920733 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Updating instance_info_cache with network_info: [{"id": "6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20", "address": "fa:16:3e:7c:15:86", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c8ad0fa-79", "ovs_interfaceid": "6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:00:40.865993 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:00:40.869061 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:00:40.893461 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:00:40.893461 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:00:40.893461 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:00:40.893461 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:00:40.893461 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:00:40.893461 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:00:40.931912 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:00:41.211181 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-2286629d-a06b-4d16-8855-d3c11e920733 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Releasing lock "refresh_cache-61f5b839-7cd4-428d-8dc0-327effc695d8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:00:41.212763 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-2286629d-a06b-4d16-8855-d3c11e920733 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lazy-loading 'flavor' on Instance uuid 61f5b839-7cd4-428d-8dc0-327effc695d8 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:00:41.301619 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:41.372360 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:00:41.372635 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328841.3724418, 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:00:41.372747 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] VM Paused (Lifecycle Event)
May 21 02:00:41.377557 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:41.403643 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Took 10.24 seconds to spawn the instance on the hypervisor.
May 21 02:00:41.404277 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:00:41.532350 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-166f746b-a41e-47ac-bd4c-fa43bf0ded08 req-24725245-5451-474e-b6f0-af20616dd238 service nova] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Received event network-vif-plugged-1b938e0e-b319-49b6-a973-0e80c89b92e6 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:41.532625 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-166f746b-a41e-47ac-bd4c-fa43bf0ded08 req-24725245-5451-474e-b6f0-af20616dd238 service nova] Acquiring lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:41.539436 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-166f746b-a41e-47ac-bd4c-fa43bf0ded08 req-24725245-5451-474e-b6f0-af20616dd238 service nova] Lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:41.540601 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:41.541757 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-166f746b-a41e-47ac-bd4c-fa43bf0ded08 req-24725245-5451-474e-b6f0-af20616dd238 service nova] Lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:41.542003 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-166f746b-a41e-47ac-bd4c-fa43bf0ded08 req-24725245-5451-474e-b6f0-af20616dd238 service nova] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] No waiting events found dispatching network-vif-plugged-1b938e0e-b319-49b6-a973-0e80c89b92e6 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:41.543267 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:41.543514 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-166f746b-a41e-47ac-bd4c-fa43bf0ded08 req-24725245-5451-474e-b6f0-af20616dd238 service nova] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Received unexpected event network-vif-plugged-1b938e0e-b319-49b6-a973-0e80c89b92e6 for instance with vm_state active and task_state None.
May 21 02:00:41.548036 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:00:41.548180 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Claim successful on node np0000001127
May 21 02:00:41.619392 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-badc8677-0e2a-4b01-b7d8-3f14ce538a23 req-944fc36e-5e7c-43e3-8de9-0c85f8a75414 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Received event network-vif-plugged-6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:41.619392 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-badc8677-0e2a-4b01-b7d8-3f14ce538a23 req-944fc36e-5e7c-43e3-8de9-0c85f8a75414 service nova] Acquiring lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:41.619392 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-badc8677-0e2a-4b01-b7d8-3f14ce538a23 req-944fc36e-5e7c-43e3-8de9-0c85f8a75414 service nova] Lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:41.619392 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-badc8677-0e2a-4b01-b7d8-3f14ce538a23 req-944fc36e-5e7c-43e3-8de9-0c85f8a75414 service nova] Lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:41.619392 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-badc8677-0e2a-4b01-b7d8-3f14ce538a23 req-944fc36e-5e7c-43e3-8de9-0c85f8a75414 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] No waiting events found dispatching network-vif-plugged-6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:41.619392 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-badc8677-0e2a-4b01-b7d8-3f14ce538a23 req-944fc36e-5e7c-43e3-8de9-0c85f8a75414 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Received unexpected event network-vif-plugged-6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 for instance with vm_state rescued and task_state unrescuing.
May 21 02:00:41.746540 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:41.753392 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:41.782868 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:41.875512 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:00:41.881037 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328841.8803315, 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:00:41.881037 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] VM Resumed (Lifecycle Event)
May 21 02:00:41.925811 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Took 17.82 seconds to build instance.
May 21 02:00:41.964152 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:42.048245 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:42.055482 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:42.125679 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Instance destroyed successfully.
May 21 02:00:42.126848 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-2286629d-a06b-4d16-8855-d3c11e920733 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lazy-loading 'numa_topology' on Instance uuid 61f5b839-7cd4-428d-8dc0-327effc695d8 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:00:42.250276 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0014122820000466163 future=<Future at 0x71c05858d1f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:00:42.250419 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:00:42.251175 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=1.7075598659998832 future=<Future at 0x71c07c5e9eb0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:00:42.251175 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=1.7073059849999481 future=<Future at 0x71c07c5e9eb0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:00:42.251455 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Emitting event <LifecycleEvent: 1779328827.248707, a4b3355b-92d6-4b36-8dad-6cb4b3c579a2 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:00:42.251692 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] VM Stopped (Lifecycle Event)
May 21 02:00:42.384605 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:00:42.389235 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:00:42.428145 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.350s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:42.552858 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:00:42.553882 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.12 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:00:42.633576 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-2286629d-a06b-4d16-8855-d3c11e920733 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Object Instance<61f5b839-7cd4-428d-8dc0-327effc695d8> lazy-loaded attributes: flavor,numa_topology {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:00:42.755422 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7cb1fa4c-5c40-4f48-9ae9-4ff4548bf11a tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: a4b3355b-92d6-4b36-8dad-6cb4b3c579a2] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:00:42.892223 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.99973702300008 future=<Future at 0x71c05856deb0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:00:43.013391 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "4f1b10cb-b101-4ef4-9f68-54bf1c6c68da" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:43.013391 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "4f1b10cb-b101-4ef4-9f68-54bf1c6c68da" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:43.115060 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:00:43.115335 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:00:43.126617 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:43.155098 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:43.257639 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:43.287314 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:43.288244 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:43.515505 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:00:43.618551 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:00:43.677240 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:00:43.710950 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0c408918-6f0b-4c91-a761-29cb6e4358fd req-61f1ed65-f761-4f96-ac3e-5f7e185062a2 service nova] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Received event network-changed-1b938e0e-b319-49b6-a973-0e80c89b92e6 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:43.710950 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0c408918-6f0b-4c91-a761-29cb6e4358fd req-61f1ed65-f761-4f96-ac3e-5f7e185062a2 service nova] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Refreshing instance network info cache due to event network-changed-1b938e0e-b319-49b6-a973-0e80c89b92e6. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:00:43.711259 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0c408918-6f0b-4c91-a761-29cb6e4358fd req-61f1ed65-f761-4f96-ac3e-5f7e185062a2 service nova] Acquiring lock "refresh_cache-44334b65-4382-4a2d-80f1-a1ae2cdfe1e8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:00:43.711259 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0c408918-6f0b-4c91-a761-29cb6e4358fd req-61f1ed65-f761-4f96-ac3e-5f7e185062a2 service nova] Acquired lock "refresh_cache-44334b65-4382-4a2d-80f1-a1ae2cdfe1e8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:00:43.711359 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-0c408918-6f0b-4c91-a761-29cb6e4358fd req-61f1ed65-f761-4f96-ac3e-5f7e185062a2 service nova] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Refreshing network info cache for port 1b938e0e-b319-49b6-a973-0e80c89b92e6 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:00:43.958783 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0003973899999891728 future=<Future at 0x71c07c5e9eb0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:00:43.958783 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:00:43.959256 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=13.93299091100016 future=<Future at 0x71c05856deb0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:00:43.959256 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=13.932897347000107 future=<Future at 0x71c05856deb0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:00:43.961042 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] Emitting event <LifecycleEvent: 1779328828.9579484, a6839691-a7ec-4dea-bc39-a7e89c94cf4d => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:00:43.961042 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] VM Stopped (Lifecycle Event)
May 21 02:00:44.077738 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:44.127431 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.586s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:44.128622 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Removed pending STOPPED event for 61f5b839-7cd4-428d-8dc0-327effc695d8 due to new event <LifecycleEvent: 1779328844.1274579, 61f5b839-7cd4-428d-8dc0-327effc695d8 => Resumed> {{(pid=98206) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 21 02:00:44.128953 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328844.1274579, 61f5b839-7cd4-428d-8dc0-327effc695d8 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:00:44.129305 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:00:44.131650 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.051s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:44.132500 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] VM Resumed (Lifecycle Event)
May 21 02:00:44.133760 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-2286629d-a06b-4d16-8855-d3c11e920733 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:00:44.136161 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:00:44.136344 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Claim successful on node np0000001127
May 21 02:00:44.184958 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:44.215644 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-0c408918-6f0b-4c91-a761-29cb6e4358fd req-61f1ed65-f761-4f96-ac3e-5f7e185062a2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:44.465242 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-de1dbdb6-c3ff-4330-bfd1-6ac57b3e8a4d tempest-DeleteServersTestJSON-411161592 tempest-DeleteServersTestJSON-411161592-project-member] [instance: a6839691-a7ec-4dea-bc39-a7e89c94cf4d] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:00:44.637030 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:00:44.637727 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:00:44.640203 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:44.640203 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:44.646123 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:00:44.662821 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:00:44.685418 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-0c408918-6f0b-4c91-a761-29cb6e4358fd req-61f1ed65-f761-4f96-ac3e-5f7e185062a2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:44.784080 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '44907638a40d4fb4ad9014b58dcd6bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc797708a5a7400992765e41ee6ec260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:00:44.887178 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-0c408918-6f0b-4c91-a761-29cb6e4358fd req-61f1ed65-f761-4f96-ac3e-5f7e185062a2 service nova] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Updated VIF entry in instance network info cache for port 1b938e0e-b319-49b6-a973-0e80c89b92e6. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:00:44.887672 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-0c408918-6f0b-4c91-a761-29cb6e4358fd req-61f1ed65-f761-4f96-ac3e-5f7e185062a2 service nova] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Updating instance_info_cache with network_info: [{"id": "1b938e0e-b319-49b6-a973-0e80c89b92e6", "address": "fa:16:3e:bc:04:20", "network": {"id": "effc5fd0-bb6d-41a3-aa93-0b65d17db1d9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2119568761-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dde2f210a0e4debaa655c852b3621da", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b938e0e-b3", "ovs_interfaceid": "1b938e0e-b319-49b6-a973-0e80c89b92e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:00:45.160315 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:00:45.167245 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328845.1668718, 61f5b839-7cd4-428d-8dc0-327effc695d8 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:00:45.167341 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] VM Started (Lifecycle Event)
May 21 02:00:45.303238 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Successfully created port: cbfb2d9f-c55f-4f12-8b0c-ce07a987798a {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:00:45.390695 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0c408918-6f0b-4c91-a761-29cb6e4358fd req-61f1ed65-f761-4f96-ac3e-5f7e185062a2 service nova] Releasing lock "refresh_cache-44334b65-4382-4a2d-80f1-a1ae2cdfe1e8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:00:45.662687 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:00:45.676969 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:00:45.685716 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:00:45.797120 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:00:45.797333 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:00:45.933705 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "61f5b839-7cd4-428d-8dc0-327effc695d8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:45.933914 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "61f5b839-7cd4-428d-8dc0-327effc695d8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:45.934137 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:45.934517 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:45.934517 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:45.936709 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Terminating instance
May 21 02:00:45.952280 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Successfully updated port: cbfb2d9f-c55f-4f12-8b0c-ce07a987798a {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:00:46.010726 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-277aeef7-f1a6-4b05-8164-d9acefec35ab req-8c22d20c-6cd8-4f2f-8cc8-74b5424d7b25 service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Received event network-changed-cbfb2d9f-c55f-4f12-8b0c-ce07a987798a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:46.011252 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-277aeef7-f1a6-4b05-8164-d9acefec35ab req-8c22d20c-6cd8-4f2f-8cc8-74b5424d7b25 service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Refreshing instance network info cache due to event network-changed-cbfb2d9f-c55f-4f12-8b0c-ce07a987798a. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:00:46.011906 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-277aeef7-f1a6-4b05-8164-d9acefec35ab req-8c22d20c-6cd8-4f2f-8cc8-74b5424d7b25 service nova] Acquiring lock "refresh_cache-e9edec14-452b-46fe-89c6-849ece08f527" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:00:46.012083 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-277aeef7-f1a6-4b05-8164-d9acefec35ab req-8c22d20c-6cd8-4f2f-8cc8-74b5424d7b25 service nova] Acquired lock "refresh_cache-e9edec14-452b-46fe-89c6-849ece08f527" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:00:46.012249 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-277aeef7-f1a6-4b05-8164-d9acefec35ab req-8c22d20c-6cd8-4f2f-8cc8-74b5424d7b25 service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Refreshing network info cache for port cbfb2d9f-c55f-4f12-8b0c-ce07a987798a {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:00:46.191568 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] During sync_power_state the instance has a pending task (deleting). Skip.
May 21 02:00:46.300775 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:00:46.307821 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:46.378253 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:46.441462 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:00:46.456161 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "refresh_cache-e9edec14-452b-46fe-89c6-849ece08f527" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:00:46.467045 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:46.470033 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:46.494707 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:46.514572 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-277aeef7-f1a6-4b05-8164-d9acefec35ab req-8c22d20c-6cd8-4f2f-8cc8-74b5424d7b25 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:46.613220 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-277aeef7-f1a6-4b05-8164-d9acefec35ab req-8c22d20c-6cd8-4f2f-8cc8-74b5424d7b25 service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:00:46.645154 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:46.651572 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:46.680804 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:00:46.682112 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:00:46.682373 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Creating image(s)
May 21 02:00:46.683052 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "/opt/stack/data/nova/instances/e9edec14-452b-46fe-89c6-849ece08f527/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:46.683281 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "/opt/stack/data/nova/instances/e9edec14-452b-46fe-89c6-849ece08f527/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:46.683832 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "/opt/stack/data/nova/instances/e9edec14-452b-46fe-89c6-849ece08f527/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:46.684121 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "32a781b708816c028fe997ee5a75208d5a59986f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:46.684994 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "32a781b708816c028fe997ee5a75208d5a59986f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:46.779460 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.99971390099995 future=<Future at 0x71c07c31fb60 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:00:46.781008 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Instance destroyed successfully.
May 21 02:00:46.781516 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lazy-loading 'resources' on Instance uuid 61f5b839-7cd4-428d-8dc0-327effc695d8 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:00:46.811322 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.683s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:46.812352 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 2.627s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:46.814685 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:00:46.816332 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:46.816580 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Auditing locally available compute resources for np0000001127 (node: np0000001127) {{(pid=98206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 21 02:00:46.852679 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-277aeef7-f1a6-4b05-8164-d9acefec35ab req-8c22d20c-6cd8-4f2f-8cc8-74b5424d7b25 service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:00:47.171804 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d94a8f81-6363-4b93-8ad1-7917d6e6903f req-e5d7cdc9-8d2b-44f7-8d9e-fc535a7341e6 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Received event network-vif-unplugged-6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:47.176107 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d94a8f81-6363-4b93-8ad1-7917d6e6903f req-e5d7cdc9-8d2b-44f7-8d9e-fc535a7341e6 service nova] Acquiring lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:47.176350 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d94a8f81-6363-4b93-8ad1-7917d6e6903f req-e5d7cdc9-8d2b-44f7-8d9e-fc535a7341e6 service nova] Lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:47.176606 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d94a8f81-6363-4b93-8ad1-7917d6e6903f req-e5d7cdc9-8d2b-44f7-8d9e-fc535a7341e6 service nova] Lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:47.176882 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d94a8f81-6363-4b93-8ad1-7917d6e6903f req-e5d7cdc9-8d2b-44f7-8d9e-fc535a7341e6 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] No waiting events found dispatching network-vif-unplugged-6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:47.177912 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d94a8f81-6363-4b93-8ad1-7917d6e6903f req-e5d7cdc9-8d2b-44f7-8d9e-fc535a7341e6 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Received event network-vif-unplugged-6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:00:47.286944 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:59:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2141638290',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serverbootfromvolumestablerescuetest-server-2141638290',id=22,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:00:37Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83df9a84ffaa4398bdafbfbde079964d',ramdisk_id='',reservation_id='r-fiump4ea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-260444396',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:00:44Z,user_data=None,user_id='bd5b969d5a514d01bacfc7954a5ae4ab',uuid=61f5b839-7cd4-428d-8dc0-327effc695d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20", "address": "fa:16:3e:7c:15:86", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c8ad0fa-79", "ovs_interfaceid": "6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:00:47.286944 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Converting VIF {"id": "6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20", "address": "fa:16:3e:7c:15:86", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c8ad0fa-79", "ovs_interfaceid": "6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:00:47.286944 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:15:86,bridge_name='br-int',has_traffic_filtering=True,id=6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20,network=Network(b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c8ad0fa-79') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:00:47.286944 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:15:86,bridge_name='br-int',has_traffic_filtering=True,id=6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20,network=Network(b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c8ad0fa-79') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:00:47.290142 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:47.290610 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c8ad0fa-79, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:47.294326 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:00:47.295233 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:47.295539 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d05358f8-a710-497b-89e1-2a604b1a310b) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:47.296881 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:47.296881 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:00:47.297229 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:47.299619 np0000001127 nova-compute[98206]: INFO os_vif [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:15:86,bridge_name='br-int',has_traffic_filtering=True,id=6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20,network=Network(b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c8ad0fa-79')
May 21 02:00:47.303010 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:00:47.305322 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53', 'iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8e307392-5cde-4d6a-a155-dfbc7af6ce53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:00:47.305322 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:00:47.308695 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:00:47.309244 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53', 'iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8e307392-5cde-4d6a-a155-dfbc7af6ce53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:00:47.310186 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:00:47.323516 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:00:47.324765 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:00:47.324765 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:47.324765 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:47.352597 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:47.352597 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:47.352597 np0000001127 nova-compute[98206]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:47.352597 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:47.352597 np0000001127 nova-compute[98206]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:47.352597 np0000001127 nova-compute[98206]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:47.352597 np0000001127 nova-compute[98206]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:00:47.352597 np0000001127 nova-compute[98206]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:00:47.352597 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:00:47.352887 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:47.352887 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:00:47.352887 np0000001127 nova-compute[98206]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:47.352887 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:00:47.352887 np0000001127 nova-compute[98206]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:47.352887 np0000001127 nova-compute[98206]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53 (non-flash)
May 21 02:00:47.352887 np0000001127 nova-compute[98206]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:00:47.352887 np0000001127 nova-compute[98206]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:00:47.352887 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:00:47.352887 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', '27'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53', '48'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', '50'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', '51')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:00:47.353105 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53', '48')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:00:47.354940 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53', '49')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:00:47.357209 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c058638540>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53'): ({'sdn'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53'): ({'sdo'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:00:47.357759 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-277aeef7-f1a6-4b05-8164-d9acefec35ab req-8c22d20c-6cd8-4f2f-8cc8-74b5424d7b25 service nova] Releasing lock "refresh_cache-e9edec14-452b-46fe-89c6-849ece08f527" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:00:47.358874 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Removing multipathed devices sdo, sdn {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:00:47.358874 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquired lock "refresh_cache-e9edec14-452b-46fe-89c6-849ece08f527" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:00:47.358874 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:00:47.360714 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Flush multipath device 33000000077b1ccd7 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:00:47.417849 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:00:47.470890 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:00:47.484408 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0efcbc1b88f49989c9f6b6a7439f2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177bec65268546d2b899e09989183b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:00:47.491463 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:00:47.493797 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:00:47.494004 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32a781b708816c028fe997ee5a75208d5a59986f.part --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:47.519831 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Checking to see if SCSI volumes sdo, sdn have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:00:47.520459 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] SCSI volumes sdo, sdn have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:00:47.523949 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Checking to see if device paths {'sdo', 'sdn'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:00:47.537865 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Device paths {'sdo', 'sdn'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:00:47.538287 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:00:47.557554 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:47.604058 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53, portal: 192.168.40.100,3260]
May 21 02:00:47.604058 np0000001127 nova-compute[98206]: Logout of [sid: 48, target: iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53, portal: 192.168.40.100,3260] successful.
May 21 02:00:47.604058 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:47.609236 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32a781b708816c028fe997ee5a75208d5a59986f.part --force-share --output=json" returned: 0 in 0.115s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:47.609942 np0000001127 nova-compute[98206]: DEBUG nova.virt.images [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] 41a1695f-68f2-46f8-b08c-5f00f72ff20f was qcow2, converting to raw {{(pid=98206) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 21 02:00:47.610671 np0000001127 nova-compute[98206]: DEBUG nova.privsep.utils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 21 02:00:47.610951 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/32a781b708816c028fe997ee5a75208d5a59986f.part /opt/stack/data/nova/instances/_base/32a781b708816c028fe997ee5a75208d5a59986f.converted {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:47.629987 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:47.647828 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:47.695936 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53, portal: 192.168.50.100,3260]
May 21 02:00:47.695936 np0000001127 nova-compute[98206]: Logout of [sid: 49, target: iqn.2023-03.storpool.com:os--volume-8e307392-5cde-4d6a-a155-dfbc7af6ce53, portal: 192.168.50.100,3260] successful.
May 21 02:00:47.695936 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:47.717776 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:00:47.719202 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.412s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:00:47.719576 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] <== disconnect_volume: return (414ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:00:47.719951 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:00:47.720720 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Deleting instance files /opt/stack/data/nova/instances/61f5b839-7cd4-428d-8dc0-327effc695d8_del
May 21 02:00:47.721576 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Deletion of /opt/stack/data/nova/instances/61f5b839-7cd4-428d-8dc0-327effc695d8_del complete
May 21 02:00:47.829546 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:00:47.898978 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:47.976100 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/32a781b708816c028fe997ee5a75208d5a59986f.part /opt/stack/data/nova/instances/_base/32a781b708816c028fe997ee5a75208d5a59986f.converted" returned: 0 in 0.365s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:47.984759 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32a781b708816c028fe997ee5a75208d5a59986f.converted --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:48.029498 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:48.029829 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:48.062584 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:00:48.095910 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:48.103388 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32a781b708816c028fe997ee5a75208d5a59986f.converted --force-share --output=json" returned: 0 in 0.120s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:48.104093 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "32a781b708816c028fe997ee5a75208d5a59986f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.419s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:48.104643 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:00:48.110770 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:00:48.114995 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32a781b708816c028fe997ee5a75208d5a59986f --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:48.162058 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:48.169123 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:00:48.173938 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:00:48.176876 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:00:48.179029 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c48501b-d03d-40bc-aef5-450fa580bd69/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:48.231219 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32a781b708816c028fe997ee5a75208d5a59986f --force-share --output=json" returned: 0 in 0.117s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:48.231947 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "32a781b708816c028fe997ee5a75208d5a59986f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:48.233038 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "32a781b708816c028fe997ee5a75208d5a59986f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:48.233786 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:00:48.236460 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:00:48.236802 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32a781b708816c028fe997ee5a75208d5a59986f --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:48.255751 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Took 1.81 seconds to destroy the instance on the hypervisor.
May 21 02:00:48.257067 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:00:48.258131 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:00:48.258449 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:00:48.259912 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:48.288835 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c48501b-d03d-40bc-aef5-450fa580bd69/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:48.289268 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c48501b-d03d-40bc-aef5-450fa580bd69/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:48.337315 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:00:48.345438 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32a781b708816c028fe997ee5a75208d5a59986f --force-share --output=json" returned: 0 in 0.108s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:48.347854 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/32a781b708816c028fe997ee5a75208d5a59986f,backing_fmt=raw /opt/stack/data/nova/instances/e9edec14-452b-46fe-89c6-849ece08f527/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:48.379632 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:48.407370 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c48501b-d03d-40bc-aef5-450fa580bd69/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:48.410772 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Error from libvirt while getting description of instance-00000016: [Error Code 42] Domain not found: no domain with matching uuid '61f5b839-7cd4-428d-8dc0-327effc695d8' (instance-00000016): libvirt.libvirtError: Domain not found: no domain with matching uuid '61f5b839-7cd4-428d-8dc0-327effc695d8' (instance-00000016)
May 21 02:00:48.415620 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d75ff65-b688-4387-89e3-70567e569682/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:48.433075 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/32a781b708816c028fe997ee5a75208d5a59986f,backing_fmt=raw /opt/stack/data/nova/instances/e9edec14-452b-46fe-89c6-849ece08f527/disk 1073741824" returned: 0 in 0.083s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:48.435051 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "32a781b708816c028fe997ee5a75208d5a59986f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:48.437041 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32a781b708816c028fe997ee5a75208d5a59986f --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:48.471376 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:48.541001 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d75ff65-b688-4387-89e3-70567e569682/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:48.541753 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d75ff65-b688-4387-89e3-70567e569682/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:48.569996 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32a781b708816c028fe997ee5a75208d5a59986f --force-share --output=json" returned: 0 in 0.132s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:48.571622 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e9edec14-452b-46fe-89c6-849ece08f527/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:00:48.572160 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9edec14-452b-46fe-89c6-849ece08f527/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:48.666926 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d75ff65-b688-4387-89e3-70567e569682/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:48.673123 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64f1cde4-f11a-4da7-8bbc-aaf777432069/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:48.692527 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9edec14-452b-46fe-89c6-849ece08f527/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:48.694980 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Cannot resize image /opt/stack/data/nova/instances/e9edec14-452b-46fe-89c6-849ece08f527/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:00:48.698081 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:00:48.698081 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Ensure instance console log exists: /opt/stack/data/nova/instances/e9edec14-452b-46fe-89c6-849ece08f527/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:00:48.699802 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:48.702510 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:48.702510 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:48.712848 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Successfully created port: 9a94bce6-2a69-438d-aa6e-d41ddef4d13e {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:00:48.798823 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64f1cde4-f11a-4da7-8bbc-aaf777432069/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:48.799427 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64f1cde4-f11a-4da7-8bbc-aaf777432069/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:48.834627 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-fdc85943-dd45-4fae-8981-441b7d24d82e req-4288a802-d76b-41d0-a889-d11f1d11c790 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Received event network-vif-deleted-6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:48.834627 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-fdc85943-dd45-4fae-8981-441b7d24d82e req-4288a802-d76b-41d0-a889-d11f1d11c790 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Neutron deleted interface 6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20; detaching it from the instance and deleting it from the info cache
May 21 02:00:48.834627 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-fdc85943-dd45-4fae-8981-441b7d24d82e req-4288a802-d76b-41d0-a889-d11f1d11c790 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:00:48.857044 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Updating instance_info_cache with network_info: [{"id": "cbfb2d9f-c55f-4f12-8b0c-ce07a987798a", "address": "fa:16:3e:35:27:d3", "network": {"id": "7cdbc224-429f-49a6-86f3-307f51e53dfc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2078432126-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc797708a5a7400992765e41ee6ec260", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbfb2d9f-c5", "ovs_interfaceid": "cbfb2d9f-c55f-4f12-8b0c-ce07a987798a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:00:48.918580 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64f1cde4-f11a-4da7-8bbc-aaf777432069/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:48.923563 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:00:48.924611 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:48.968252 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "env LANG=C uptime" returned: 0 in 0.043s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:48.968812 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Hypervisor/Node resource view: name=np0000001127 free_ram=12676MB free_disk=74.15382766723633GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 21 02:00:48.969397 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:48.969765 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:49.258486 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:00:49.263827 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1c2cae4d-fb63-4185-804a-5fdace2f2b36 req-95bcf197-d83d-4654-bb7a-de1d6ae5a087 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Received event network-vif-unplugged-6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:49.266572 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1c2cae4d-fb63-4185-804a-5fdace2f2b36 req-95bcf197-d83d-4654-bb7a-de1d6ae5a087 service nova] Acquiring lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:49.267414 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1c2cae4d-fb63-4185-804a-5fdace2f2b36 req-95bcf197-d83d-4654-bb7a-de1d6ae5a087 service nova] Lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:49.267621 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1c2cae4d-fb63-4185-804a-5fdace2f2b36 req-95bcf197-d83d-4654-bb7a-de1d6ae5a087 service nova] Lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:49.267789 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1c2cae4d-fb63-4185-804a-5fdace2f2b36 req-95bcf197-d83d-4654-bb7a-de1d6ae5a087 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] No waiting events found dispatching network-vif-unplugged-6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:49.268051 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1c2cae4d-fb63-4185-804a-5fdace2f2b36 req-95bcf197-d83d-4654-bb7a-de1d6ae5a087 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Received event network-vif-unplugged-6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:00:49.268051 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1c2cae4d-fb63-4185-804a-5fdace2f2b36 req-95bcf197-d83d-4654-bb7a-de1d6ae5a087 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Received event network-vif-plugged-6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:49.268660 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1c2cae4d-fb63-4185-804a-5fdace2f2b36 req-95bcf197-d83d-4654-bb7a-de1d6ae5a087 service nova] Acquiring lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:49.268660 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1c2cae4d-fb63-4185-804a-5fdace2f2b36 req-95bcf197-d83d-4654-bb7a-de1d6ae5a087 service nova] Lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:49.268660 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1c2cae4d-fb63-4185-804a-5fdace2f2b36 req-95bcf197-d83d-4654-bb7a-de1d6ae5a087 service nova] Lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:49.268660 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1c2cae4d-fb63-4185-804a-5fdace2f2b36 req-95bcf197-d83d-4654-bb7a-de1d6ae5a087 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] No waiting events found dispatching network-vif-plugged-6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:49.268986 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-1c2cae4d-fb63-4185-804a-5fdace2f2b36 req-95bcf197-d83d-4654-bb7a-de1d6ae5a087 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Received unexpected event network-vif-plugged-6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 for instance with vm_state active and task_state deleting.
May 21 02:00:49.268986 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1c2cae4d-fb63-4185-804a-5fdace2f2b36 req-95bcf197-d83d-4654-bb7a-de1d6ae5a087 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Received event network-vif-plugged-6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:49.268986 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1c2cae4d-fb63-4185-804a-5fdace2f2b36 req-95bcf197-d83d-4654-bb7a-de1d6ae5a087 service nova] Acquiring lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:49.269103 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1c2cae4d-fb63-4185-804a-5fdace2f2b36 req-95bcf197-d83d-4654-bb7a-de1d6ae5a087 service nova] Lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:49.269711 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1c2cae4d-fb63-4185-804a-5fdace2f2b36 req-95bcf197-d83d-4654-bb7a-de1d6ae5a087 service nova] Lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:49.269711 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1c2cae4d-fb63-4185-804a-5fdace2f2b36 req-95bcf197-d83d-4654-bb7a-de1d6ae5a087 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] No waiting events found dispatching network-vif-plugged-6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:49.269711 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-1c2cae4d-fb63-4185-804a-5fdace2f2b36 req-95bcf197-d83d-4654-bb7a-de1d6ae5a087 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Received unexpected event network-vif-plugged-6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 for instance with vm_state active and task_state deleting.
May 21 02:00:49.269711 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1c2cae4d-fb63-4185-804a-5fdace2f2b36 req-95bcf197-d83d-4654-bb7a-de1d6ae5a087 service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Received event network-vif-unplugged-cbfb2d9f-c55f-4f12-8b0c-ce07a987798a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:49.269711 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1c2cae4d-fb63-4185-804a-5fdace2f2b36 req-95bcf197-d83d-4654-bb7a-de1d6ae5a087 service nova] Acquiring lock "e9edec14-452b-46fe-89c6-849ece08f527-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:49.271026 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1c2cae4d-fb63-4185-804a-5fdace2f2b36 req-95bcf197-d83d-4654-bb7a-de1d6ae5a087 service nova] Lock "e9edec14-452b-46fe-89c6-849ece08f527-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:49.271026 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1c2cae4d-fb63-4185-804a-5fdace2f2b36 req-95bcf197-d83d-4654-bb7a-de1d6ae5a087 service nova] Lock "e9edec14-452b-46fe-89c6-849ece08f527-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:49.271026 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1c2cae4d-fb63-4185-804a-5fdace2f2b36 req-95bcf197-d83d-4654-bb7a-de1d6ae5a087 service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] No waiting events found dispatching network-vif-unplugged-cbfb2d9f-c55f-4f12-8b0c-ce07a987798a {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:49.271026 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-1c2cae4d-fb63-4185-804a-5fdace2f2b36 req-95bcf197-d83d-4654-bb7a-de1d6ae5a087 service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Received unexpected event network-vif-unplugged-cbfb2d9f-c55f-4f12-8b0c-ce07a987798a for instance with vm_state building and task_state spawning.
May 21 02:00:49.271026 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1c2cae4d-fb63-4185-804a-5fdace2f2b36 req-95bcf197-d83d-4654-bb7a-de1d6ae5a087 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Received event network-vif-unplugged-6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:49.271026 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1c2cae4d-fb63-4185-804a-5fdace2f2b36 req-95bcf197-d83d-4654-bb7a-de1d6ae5a087 service nova] Acquiring lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:49.271026 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1c2cae4d-fb63-4185-804a-5fdace2f2b36 req-95bcf197-d83d-4654-bb7a-de1d6ae5a087 service nova] Lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:49.271026 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1c2cae4d-fb63-4185-804a-5fdace2f2b36 req-95bcf197-d83d-4654-bb7a-de1d6ae5a087 service nova] Lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:49.271490 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1c2cae4d-fb63-4185-804a-5fdace2f2b36 req-95bcf197-d83d-4654-bb7a-de1d6ae5a087 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] No waiting events found dispatching network-vif-unplugged-6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:49.271490 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1c2cae4d-fb63-4185-804a-5fdace2f2b36 req-95bcf197-d83d-4654-bb7a-de1d6ae5a087 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Received event network-vif-unplugged-6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:00:49.271490 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1c2cae4d-fb63-4185-804a-5fdace2f2b36 req-95bcf197-d83d-4654-bb7a-de1d6ae5a087 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Received event network-vif-unplugged-6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:49.271490 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1c2cae4d-fb63-4185-804a-5fdace2f2b36 req-95bcf197-d83d-4654-bb7a-de1d6ae5a087 service nova] Acquiring lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:49.271717 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1c2cae4d-fb63-4185-804a-5fdace2f2b36 req-95bcf197-d83d-4654-bb7a-de1d6ae5a087 service nova] Lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:49.271717 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1c2cae4d-fb63-4185-804a-5fdace2f2b36 req-95bcf197-d83d-4654-bb7a-de1d6ae5a087 service nova] Lock "61f5b839-7cd4-428d-8dc0-327effc695d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:49.271808 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1c2cae4d-fb63-4185-804a-5fdace2f2b36 req-95bcf197-d83d-4654-bb7a-de1d6ae5a087 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] No waiting events found dispatching network-vif-unplugged-6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:49.273708 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1c2cae4d-fb63-4185-804a-5fdace2f2b36 req-95bcf197-d83d-4654-bb7a-de1d6ae5a087 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Received event network-vif-unplugged-6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:00:49.339999 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-fdc85943-dd45-4fae-8981-441b7d24d82e req-4288a802-d76b-41d0-a889-d11f1d11c790 service nova] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Detach interface failed, port_id=6c8ad0fa-79b2-4fd6-bfe0-d07d52c21a20, reason: Instance 61f5b839-7cd4-428d-8dc0-327effc695d8 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:00:49.361211 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:00:49.363294 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Releasing lock "refresh_cache-e9edec14-452b-46fe-89c6-849ece08f527" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:00:49.363943 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:00:49.364309 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Instance network_info: |[{"id": "cbfb2d9f-c55f-4f12-8b0c-ce07a987798a", "address": "fa:16:3e:35:27:d3", "network": {"id": "7cdbc224-429f-49a6-86f3-307f51e53dfc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2078432126-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc797708a5a7400992765e41ee6ec260", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbfb2d9f-c5", "ovs_interfaceid": "cbfb2d9f-c55f-4f12-8b0c-ce07a987798a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:00:49.367049 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Start _get_guest_xml network_info=[{"id": "cbfb2d9f-c55f-4f12-8b0c-ce07a987798a", "address": "fa:16:3e:35:27:d3", "network": {"id": "7cdbc224-429f-49a6-86f3-307f51e53dfc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2078432126-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc797708a5a7400992765e41ee6ec260", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbfb2d9f-c5", "ovs_interfaceid": "cbfb2d9f-c55f-4f12-8b0c-ce07a987798a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T02:00:37Z,direct_url=<?>,disk_format='qcow2',id=41a1695f-68f2-46f8-b08c-5f00f72ff20f,min_disk=0,min_ram=0,name='tempest-scenario-img--1536141372',owner='dc797708a5a7400992765e41ee6ec260',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T02:00:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '41a1695f-68f2-46f8-b08c-5f00f72ff20f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:00:49.368513 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Creating image(s)
May 21 02:00:49.368513 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "/opt/stack/data/nova/instances/4f1b10cb-b101-4ef4-9f68-54bf1c6c68da/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:49.368513 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "/opt/stack/data/nova/instances/4f1b10cb-b101-4ef4-9f68-54bf1c6c68da/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:49.371783 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "/opt/stack/data/nova/instances/4f1b10cb-b101-4ef4-9f68-54bf1c6c68da/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:49.372443 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:00:49.373889 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:00:49.378719 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:00:49.381201 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='41a1695f-68f2-46f8-b08c-5f00f72ff20f', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-1354277369', uuid='e9edec14-452b-46fe-89c6-849ece08f527'), owner=OwnerMeta(userid='44907638a40d4fb4ad9014b58dcd6bac', username='tempest-TestMinimumBasicScenario-654915677-project-member', projectid='dc797708a5a7400992765e41ee6ec260', projectname='tempest-TestMinimumBasicScenario-654915677'), image=ImageMeta(id='41a1695f-68f2-46f8-b08c-5f00f72ff20f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cbfb2d9f-c55f-4f12-8b0c-ce07a987798a", "address": "fa:16:3e:35:27:d3", "network": {"id": "7cdbc224-429f-49a6-86f3-307f51e53dfc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2078432126-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc797708a5a7400992765e41ee6ec260", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbfb2d9f-c5", "ovs_interfaceid": "cbfb2d9f-c55f-4f12-8b0c-ce07a987798a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328849.3783567) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:00:49.381460 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:49.400540 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:00:49.400540 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:00:49.401695 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:00:49.402119 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:00:49.410406 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Successfully updated port: 9a94bce6-2a69-438d-aa6e-d41ddef4d13e {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:00:49.415879 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:00:49.417599 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T02:00:37Z,direct_url=<?>,disk_format='qcow2',id=41a1695f-68f2-46f8-b08c-5f00f72ff20f,min_disk=0,min_ram=0,name='tempest-scenario-img--1536141372',owner='dc797708a5a7400992765e41ee6ec260',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T02:00:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:00:49.417599 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:00:49.417904 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:00:49.418081 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:00:49.418209 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:00:49.418588 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:00:49.418588 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:00:49.420270 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:00:49.420270 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:00:49.420270 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:00:49.420270 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:00:49.434788 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:00:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1354277369',display_name='tempest-TestMinimumBasicScenario-server-1354277369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testminimumbasicscenario-server-1354277369',id=24,image_ref='41a1695f-68f2-46f8-b08c-5f00f72ff20f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABV9lNaOhondv4xWx9wwSxSHVWgf5JuuPr9fZX2s2MH/Tlh7xaawDHT7UiG92Tc0vR5wdYJjAAzBJ/YMnZKMPntBKnarmw7az3moOe+v2n6BgBwpX6SabCrQhdyNeWBrw==',key_name='tempest-TestMinimumBasicScenario-934850333',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc797708a5a7400992765e41ee6ec260',ramdisk_id='',reservation_id='r-17aa4tur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='41a1695f-68f2-46f8-b08c-5f00f72ff20f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-654915677',owner_user_name='tempest-TestMinimumBasicScenario-654915677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:00:46Z,user_data=None,user_id='44907638a40d4fb4ad9014b58dcd6bac',uuid=e9edec14-452b-46fe-89c6-849ece08f527,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbfb2d9f-c55f-4f12-8b0c-ce07a987798a", "address": "fa:16:3e:35:27:d3", "network": {"id": "7cdbc224-429f-49a6-86f3-307f51e53dfc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2078432126-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc797708a5a7400992765e41ee6ec260", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbfb2d9f-c5", "ovs_interfaceid": "cbfb2d9f-c55f-4f12-8b0c-ce07a987798a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:00:49.435049 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Converting VIF {"id": "cbfb2d9f-c55f-4f12-8b0c-ce07a987798a", "address": "fa:16:3e:35:27:d3", "network": {"id": "7cdbc224-429f-49a6-86f3-307f51e53dfc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2078432126-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc797708a5a7400992765e41ee6ec260", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbfb2d9f-c5", "ovs_interfaceid": "cbfb2d9f-c55f-4f12-8b0c-ce07a987798a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:00:49.435719 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:27:d3,bridge_name='br-int',has_traffic_filtering=True,id=cbfb2d9f-c55f-4f12-8b0c-ce07a987798a,network=Network(7cdbc224-429f-49a6-86f3-307f51e53dfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbfb2d9f-c5') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:00:49.436586 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lazy-loading 'pci_devices' on Instance uuid e9edec14-452b-46fe-89c6-849ece08f527 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:00:49.493450 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.112s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:49.493959 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:49.494507 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:49.495070 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:00:49.499966 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:00:49.500739 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:49.595575 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.095s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:49.596034 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/4f1b10cb-b101-4ef4-9f68-54bf1c6c68da/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:49.667268 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/4f1b10cb-b101-4ef4-9f68-54bf1c6c68da/disk 1073741824" returned: 0 in 0.071s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:49.668013 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.174s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:49.668339 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:49.762140 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Took 1.50 seconds to deallocate network for instance.
May 21 02:00:49.768366 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.100s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:49.768624 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4f1b10cb-b101-4ef4-9f68-54bf1c6c68da/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:00:49.769835 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1b10cb-b101-4ef4-9f68-54bf1c6c68da/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:49.884916 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1b10cb-b101-4ef4-9f68-54bf1c6c68da/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:49.886450 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Cannot resize image /opt/stack/data/nova/instances/4f1b10cb-b101-4ef4-9f68-54bf1c6c68da/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:00:49.886450 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:00:49.886450 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Ensure instance console log exists: /opt/stack/data/nova/instances/4f1b10cb-b101-4ef4-9f68-54bf1c6c68da/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:00:49.886450 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:49.886450 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:49.886690 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:49.929160 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "refresh_cache-4f1b10cb-b101-4ef4-9f68-54bf1c6c68da" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:00:49.929319 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquired lock "refresh_cache-4f1b10cb-b101-4ef4-9f68-54bf1c6c68da" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:00:49.929461 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:00:49.940109 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] End _get_guest_xml xml=<domain type="qemu">
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:   <uuid>e9edec14-452b-46fe-89c6-849ece08f527</uuid>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:   <name>instance-00000018</name>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:       <nova:name>tempest-TestMinimumBasicScenario-server-1354277369</nova:name>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:00:49</nova:creationTime>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:       <nova:image uuid="41a1695f-68f2-46f8-b08c-5f00f72ff20f">
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:         <nova:properties/>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:         <nova:user uuid="44907638a40d4fb4ad9014b58dcd6bac">tempest-TestMinimumBasicScenario-654915677-project-member</nova:user>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:         <nova:project uuid="dc797708a5a7400992765e41ee6ec260">tempest-TestMinimumBasicScenario-654915677</nova:project>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="41a1695f-68f2-46f8-b08c-5f00f72ff20f"/>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:         <nova:port uuid="cbfb2d9f-c55f-4f12-8b0c-ce07a987798a">
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:     <system>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:       <entry name="serial">e9edec14-452b-46fe-89c6-849ece08f527</entry>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:       <entry name="uuid">e9edec14-452b-46fe-89c6-849ece08f527</entry>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:     </system>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:   <os>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:   </os>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:   <features>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:   </features>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:   <devices>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/e9edec14-452b-46fe-89c6-849ece08f527/disk"/>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:     </disk>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/e9edec14-452b-46fe-89c6-849ece08f527/disk.config"/>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:     </disk>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:35:27:d3"/>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:       <target dev="tapcbfb2d9f-c5"/>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:     </interface>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/e9edec14-452b-46fe-89c6-849ece08f527/console.log" append="off"/>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:     </serial>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:     <video>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:     </video>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:     </rng>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:   </devices>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]: </domain>
May 21 02:00:49.940109 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:00:49.945986 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Preparing to wait for external event network-vif-plugged-cbfb2d9f-c55f-4f12-8b0c-ce07a987798a {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:00:49.945986 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "e9edec14-452b-46fe-89c6-849ece08f527-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:49.945986 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "e9edec14-452b-46fe-89c6-849ece08f527-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:49.945986 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "e9edec14-452b-46fe-89c6-849ece08f527-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:49.945986 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:00:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1354277369',display_name='tempest-TestMinimumBasicScenario-server-1354277369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testminimumbasicscenario-server-1354277369',id=24,image_ref='41a1695f-68f2-46f8-b08c-5f00f72ff20f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABV9lNaOhondv4xWx9wwSxSHVWgf5JuuPr9fZX2s2MH/Tlh7xaawDHT7UiG92Tc0vR5wdYJjAAzBJ/YMnZKMPntBKnarmw7az3moOe+v2n6BgBwpX6SabCrQhdyNeWBrw==',key_name='tempest-TestMinimumBasicScenario-934850333',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc797708a5a7400992765e41ee6ec260',ramdisk_id='',reservation_id='r-17aa4tur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='41a1695f-68f2-46f8-b08c-5f00f72ff20f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-654915677',owner_user_name='tempest-TestMinimumBasicScenario-654915677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:00:46Z,user_data=None,user_id='44907638a40d4fb4ad9014b58dcd6bac',uuid=e9edec14-452b-46fe-89c6-849ece08f527,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbfb2d9f-c55f-4f12-8b0c-ce07a987798a", "address": "fa:16:3e:35:27:d3", "network": {"id": "7cdbc224-429f-49a6-86f3-307f51e53dfc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2078432126-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc797708a5a7400992765e41ee6ec260", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbfb2d9f-c5", "ovs_interfaceid": "cbfb2d9f-c55f-4f12-8b0c-ce07a987798a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:00:49.945986 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Converting VIF {"id": "cbfb2d9f-c55f-4f12-8b0c-ce07a987798a", "address": "fa:16:3e:35:27:d3", "network": {"id": "7cdbc224-429f-49a6-86f3-307f51e53dfc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2078432126-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc797708a5a7400992765e41ee6ec260", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbfb2d9f-c5", "ovs_interfaceid": "cbfb2d9f-c55f-4f12-8b0c-ce07a987798a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:00:49.945986 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:27:d3,bridge_name='br-int',has_traffic_filtering=True,id=cbfb2d9f-c55f-4f12-8b0c-ce07a987798a,network=Network(7cdbc224-429f-49a6-86f3-307f51e53dfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbfb2d9f-c5') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:00:49.945986 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:27:d3,bridge_name='br-int',has_traffic_filtering=True,id=cbfb2d9f-c55f-4f12-8b0c-ce07a987798a,network=Network(7cdbc224-429f-49a6-86f3-307f51e53dfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbfb2d9f-c5') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:00:49.948509 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:49.948509 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:49.949639 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:00:49.950042 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:49.950328 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b681d4e2-5119-55b6-b1b0-381d25d9d3f9', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:49.951190 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:49.952393 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:00:49.954012 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:49.955673 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:49.956016 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcbfb2d9f-c5, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:49.956778 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcbfb2d9f-c5, col_values=(('qos', UUID('4aa37314-6e6a-4000-b904-57c05fef675e')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:49.958273 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcbfb2d9f-c5, col_values=(('external_ids', {'iface-id': 'cbfb2d9f-c55f-4f12-8b0c-ce07a987798a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:27:d3', 'vm-uuid': 'e9edec14-452b-46fe-89c6-849ece08f527'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:49.958273 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:49.959381 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:00:49.965303 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:49.967934 np0000001127 nova-compute[98206]: INFO os_vif [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:27:d3,bridge_name='br-int',has_traffic_filtering=True,id=cbfb2d9f-c55f-4f12-8b0c-ce07a987798a,network=Network(7cdbc224-429f-49a6-86f3-307f51e53dfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbfb2d9f-c5')
May 21 02:00:50.061950 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 29a124ee-2b8c-4f44-8f91-8dd11ac78b52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:00:50.062109 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 0d75ff65-b688-4387-89e3-70567e569682 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:00:50.062805 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 392bbdc4-beaa-4c44-93f5-3a76f331ceb0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:00:50.062930 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 6c48501b-d03d-40bc-aef5-450fa580bd69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:00:50.063042 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 66fe5d80-9012-44fe-9b82-1e993211ddf1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:00:50.063146 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 64f1cde4-f11a-4da7-8bbc-aaf777432069 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:00:50.063246 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 61f5b839-7cd4-428d-8dc0-327effc695d8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:00:50.063327 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:00:50.063405 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance e9edec14-452b-46fe-89c6-849ece08f527 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:00:50.063508 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:00:50.063700 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 21 02:00:50.067894 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Final resource view: name=np0000001127 phys_ram=24030MB used_ram=2496MB phys_disk=95GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:00:48 up 31 min,  2 users,  load average: 9.86, 7.01, 3.56\n', 'num_instances': '10', 'num_vm_active': '8', 'num_task_None': '7', 'num_os_type_None': '10', 'num_proj_6a15fe7a70464159a778cffa4a36c36f': '2', 'io_workload': '2', 'num_proj_83df9a84ffaa4398bdafbfbde079964d': '4', 'num_proj_9dde2f210a0e4debaa655c852b3621da': '1', 'num_vm_building': '2', 'num_task_spawning': '2', 'num_proj_dc797708a5a7400992765e41ee6ec260': '1', 'num_proj_177bec65268546d2b899e09989183b6e': '1', 'num_proj_2e41dd931ff049868a61f52a251d1122': '1', 'num_task_deleting': '1'} {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 21 02:00:50.232458 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fd99e1c7-b143-43fc-8624-32e159a32c83 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "64f1cde4-f11a-4da7-8bbc-aaf777432069" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:50.232703 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fd99e1c7-b143-43fc-8624-32e159a32c83 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "64f1cde4-f11a-4da7-8bbc-aaf777432069" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:50.232844 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fd99e1c7-b143-43fc-8624-32e159a32c83 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "64f1cde4-f11a-4da7-8bbc-aaf777432069-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:50.232955 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fd99e1c7-b143-43fc-8624-32e159a32c83 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "64f1cde4-f11a-4da7-8bbc-aaf777432069-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:50.233069 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fd99e1c7-b143-43fc-8624-32e159a32c83 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "64f1cde4-f11a-4da7-8bbc-aaf777432069-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:50.235260 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-fd99e1c7-b143-43fc-8624-32e159a32c83 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Terminating instance
May 21 02:00:50.365064 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Took 0.60 seconds to detach 1 volumes for instance.
May 21 02:00:50.367909 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Deleting volume: 8e307392-5cde-4d6a-a155-dfbc7af6ce53 {{(pid=98206) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 21 02:00:50.552736 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:00:50.661409 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:50.729491 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:00:50.729852 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:00:50.738546 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-fd99e1c7-b143-43fc-8624-32e159a32c83 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:00:50.771392 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:50.774845 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:50.797868 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:50.798577 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:50.834886 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:50.924423 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-4f240084-f1ec-4db3-adbb-5b795658d17c req-36381d1e-6286-4933-b90a-fa9409a550b0 service nova] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Received event network-changed-9a94bce6-2a69-438d-aa6e-d41ddef4d13e {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:50.925283 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-4f240084-f1ec-4db3-adbb-5b795658d17c req-36381d1e-6286-4933-b90a-fa9409a550b0 service nova] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Refreshing instance network info cache due to event network-changed-9a94bce6-2a69-438d-aa6e-d41ddef4d13e. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:00:50.925437 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4f240084-f1ec-4db3-adbb-5b795658d17c req-36381d1e-6286-4933-b90a-fa9409a550b0 service nova] Acquiring lock "refresh_cache-4f1b10cb-b101-4ef4-9f68-54bf1c6c68da" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:00:50.927490 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:50.930645 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:51.084172 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999602823000032 future=<Future at 0x71c0983bd460 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:00:51.085064 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Instance destroyed successfully.
May 21 02:00:51.085645 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-fd99e1c7-b143-43fc-8624-32e159a32c83 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lazy-loading 'resources' on Instance uuid 64f1cde4-f11a-4da7-8bbc-aaf777432069 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:00:51.233291 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:00:51.264699 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Updating instance_info_cache with network_info: [{"id": "9a94bce6-2a69-438d-aa6e-d41ddef4d13e", "address": "fa:16:3e:02:b4:9e", "network": {"id": "38d66f09-c738-4e79-9aeb-12e87e29f568", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-447420743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "177bec65268546d2b899e09989183b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a94bce6-2a", "ovs_interfaceid": "9a94bce6-2a69-438d-aa6e-d41ddef4d13e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:00:51.283687 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f0af5aa0-3a02-4bee-b0d2-2e9dbc6eeb77 req-42873b59-014b-4eaf-b109-df48769c6ff0 service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Received event network-vif-unplugged-3b1f76f9-cf49-4dea-b9a2-762c2ad220bf {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:51.283687 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f0af5aa0-3a02-4bee-b0d2-2e9dbc6eeb77 req-42873b59-014b-4eaf-b109-df48769c6ff0 service nova] Acquiring lock "64f1cde4-f11a-4da7-8bbc-aaf777432069-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:51.285261 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f0af5aa0-3a02-4bee-b0d2-2e9dbc6eeb77 req-42873b59-014b-4eaf-b109-df48769c6ff0 service nova] Lock "64f1cde4-f11a-4da7-8bbc-aaf777432069-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:51.288995 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f0af5aa0-3a02-4bee-b0d2-2e9dbc6eeb77 req-42873b59-014b-4eaf-b109-df48769c6ff0 service nova] Lock "64f1cde4-f11a-4da7-8bbc-aaf777432069-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:51.288995 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f0af5aa0-3a02-4bee-b0d2-2e9dbc6eeb77 req-42873b59-014b-4eaf-b109-df48769c6ff0 service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] No waiting events found dispatching network-vif-unplugged-3b1f76f9-cf49-4dea-b9a2-762c2ad220bf {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:51.288995 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f0af5aa0-3a02-4bee-b0d2-2e9dbc6eeb77 req-42873b59-014b-4eaf-b109-df48769c6ff0 service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Received event network-vif-unplugged-3b1f76f9-cf49-4dea-b9a2-762c2ad220bf for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:00:51.305043 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:51.488943 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:00:51.489438 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:00:51.489438 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] No VIF found with MAC fa:16:3e:35:27:d3, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:00:51.489888 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Using config drive
May 21 02:00:51.588367 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-fd99e1c7-b143-43fc-8624-32e159a32c83 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-21T01:58:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-826846662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumeshelvetestjson-server-826846662',id=16,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKP9TmPgal987nAj8h88D1Bmcj2I422T9n2Tj8WjCd1Om2bcKH0baNEdUw3HbpQOVs38hbin/FqToAhhAhLP26z0i0oQr4Z8Ka0Fy18AshY/UNiFwP9hn8pglGsErkHX4w==',key_name='tempest-keypair-1059394299',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:00:12Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e41dd931ff049868a61f52a251d1122',ramdisk_id='',reservation_id='r-fbiukq5r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-826866539',owner_user_name='tempest-AttachVolumeShelveTestJSON-826866539-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:00:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d91dda570ffb45489f81bd0c87e7fda6',uuid=64f1cde4-f11a-4da7-8bbc-aaf777432069,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "address": "fa:16:3e:12:66:8e", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1f76f9-cf", "ovs_interfaceid": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:00:51.589875 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-fd99e1c7-b143-43fc-8624-32e159a32c83 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Converting VIF {"id": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "address": "fa:16:3e:12:66:8e", "network": {"id": "084a1218-5c9f-4f1e-855b-53d284a5202b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555950798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e41dd931ff049868a61f52a251d1122", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1f76f9-cf", "ovs_interfaceid": "3b1f76f9-cf49-4dea-b9a2-762c2ad220bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:00:51.590501 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-fd99e1c7-b143-43fc-8624-32e159a32c83 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:66:8e,bridge_name='br-int',has_traffic_filtering=True,id=3b1f76f9-cf49-4dea-b9a2-762c2ad220bf,network=Network(084a1218-5c9f-4f1e-855b-53d284a5202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b1f76f9-cf') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:00:51.590772 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-fd99e1c7-b143-43fc-8624-32e159a32c83 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:66:8e,bridge_name='br-int',has_traffic_filtering=True,id=3b1f76f9-cf49-4dea-b9a2-762c2ad220bf,network=Network(084a1218-5c9f-4f1e-855b-53d284a5202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b1f76f9-cf') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:00:51.592751 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:51.592751 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b1f76f9-cf, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:51.595014 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:51.595014 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:00:51.605659 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:51.607076 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:51.607949 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cd8dc0aa-b599-4150-a024-75667f2a4bb8) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:51.609234 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:51.609234 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:00:51.620430 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:51.621883 np0000001127 nova-compute[98206]: INFO os_vif [None req-fd99e1c7-b143-43fc-8624-32e159a32c83 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:66:8e,bridge_name='br-int',has_traffic_filtering=True,id=3b1f76f9-cf49-4dea-b9a2-762c2ad220bf,network=Network(084a1218-5c9f-4f1e-855b-53d284a5202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b1f76f9-cf')
May 21 02:00:51.622207 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-fd99e1c7-b143-43fc-8624-32e159a32c83 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Deleting instance files /opt/stack/data/nova/instances/64f1cde4-f11a-4da7-8bbc-aaf777432069_del
May 21 02:00:51.629872 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-fd99e1c7-b143-43fc-8624-32e159a32c83 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Deletion of /opt/stack/data/nova/instances/64f1cde4-f11a-4da7-8bbc-aaf777432069_del complete
May 21 02:00:51.742634 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Compute_service record updated for np0000001127:np0000001127 {{(pid=98206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 21 02:00:51.742794 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.773s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:51.743050 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.812s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:51.743205 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:00:51.766140 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Releasing lock "refresh_cache-4f1b10cb-b101-4ef4-9f68-54bf1c6c68da" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:00:51.770813 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Instance network_info: |[{"id": "9a94bce6-2a69-438d-aa6e-d41ddef4d13e", "address": "fa:16:3e:02:b4:9e", "network": {"id": "38d66f09-c738-4e79-9aeb-12e87e29f568", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-447420743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "177bec65268546d2b899e09989183b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a94bce6-2a", "ovs_interfaceid": "9a94bce6-2a69-438d-aa6e-d41ddef4d13e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:00:51.770813 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4f240084-f1ec-4db3-adbb-5b795658d17c req-36381d1e-6286-4933-b90a-fa9409a550b0 service nova] Acquired lock "refresh_cache-4f1b10cb-b101-4ef4-9f68-54bf1c6c68da" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:00:51.770813 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-4f240084-f1ec-4db3-adbb-5b795658d17c req-36381d1e-6286-4933-b90a-fa9409a550b0 service nova] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Refreshing network info cache for port 9a94bce6-2a69-438d-aa6e-d41ddef4d13e {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:00:51.770813 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Start _get_guest_xml network_info=[{"id": "9a94bce6-2a69-438d-aa6e-d41ddef4d13e", "address": "fa:16:3e:02:b4:9e", "network": {"id": "38d66f09-c738-4e79-9aeb-12e87e29f568", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-447420743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "177bec65268546d2b899e09989183b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a94bce6-2a", "ovs_interfaceid": "9a94bce6-2a69-438d-aa6e-d41ddef4d13e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:00:51.777299 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:00:51.778781 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1779327587', uuid='4f1b10cb-b101-4ef4-9f68-54bf1c6c68da'), owner=OwnerMeta(userid='c0efcbc1b88f49989c9f6b6a7439f2c4', username='tempest-TestEncryptedCinderVolumes-991116896-project-member', projectid='177bec65268546d2b899e09989183b6e', projectname='tempest-TestEncryptedCinderVolumes-991116896'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9a94bce6-2a69-438d-aa6e-d41ddef4d13e", "address": "fa:16:3e:02:b4:9e", "network": {"id": "38d66f09-c738-4e79-9aeb-12e87e29f568", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-447420743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "177bec65268546d2b899e09989183b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a94bce6-2a", "ovs_interfaceid": "9a94bce6-2a69-438d-aa6e-d41ddef4d13e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328851.7782722) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:00:51.779962 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:00:51.780358 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:00:51.781233 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:00:51.781454 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:00:51.782402 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:00:51.782805 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:00:51.783067 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:00:51.783124 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:00:51.783305 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:00:51.783566 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:00:51.783850 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:00:51.784047 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:00:51.785400 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:00:51.785790 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:00:51.785955 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:00:51.786149 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:00:51.801683 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:00:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1779327587',display_name='tempest-TestEncryptedCinderVolumes-server-1779327587',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testencryptedcindervolumes-server-1779327587',id=25,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/hDqZkMajg3N/N4Ygb3hHFWCbrrX7jB2xTtn4M5janHb3yRzu8QOW0iBqMvpy5+6Wf5pau7rYMtKkAJyxmnZZ3SUFF6mpjcHbMND9BG0/76jIfmHdktnbmtYGBnQAVyw==',key_name='tempest-keypair-916059594',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='177bec65268546d2b899e09989183b6e',ramdisk_id='',reservation_id='r-3ynirpnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-991116896',owner_user_name='tempest-TestEncryptedCinderVolumes-991116896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:00:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0efcbc1b88f49989c9f6b6a7439f2c4',uuid=4f1b10cb-b101-4ef4-9f68-54bf1c6c68da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a94bce6-2a69-438d-aa6e-d41ddef4d13e", "address": "fa:16:3e:02:b4:9e", "network": {"id": "38d66f09-c738-4e79-9aeb-12e87e29f568", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-447420743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "177bec65268546d2b899e09989183b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a94bce6-2a", "ovs_interfaceid": "9a94bce6-2a69-438d-aa6e-d41ddef4d13e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:00:51.801930 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Converting VIF {"id": "9a94bce6-2a69-438d-aa6e-d41ddef4d13e", "address": "fa:16:3e:02:b4:9e", "network": {"id": "38d66f09-c738-4e79-9aeb-12e87e29f568", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-447420743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "177bec65268546d2b899e09989183b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a94bce6-2a", "ovs_interfaceid": "9a94bce6-2a69-438d-aa6e-d41ddef4d13e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:00:51.802455 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:b4:9e,bridge_name='br-int',has_traffic_filtering=True,id=9a94bce6-2a69-438d-aa6e-d41ddef4d13e,network=Network(38d66f09-c738-4e79-9aeb-12e87e29f568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a94bce6-2a') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:00:51.802942 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:00:51.995638 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:52.143001 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Creating config drive at /opt/stack/data/nova/instances/e9edec14-452b-46fe-89c6-849ece08f527/disk.config
May 21 02:00:52.151002 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-fd99e1c7-b143-43fc-8624-32e159a32c83 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Took 1.41 seconds to destroy the instance on the hypervisor.
May 21 02:00:52.151742 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e9edec14-452b-46fe-89c6-849ece08f527/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbi_fmfhh {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:52.151962 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-fd99e1c7-b143-43fc-8624-32e159a32c83 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:00:52.180179 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:00:52.180492 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:00:52.181328 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:52.241012 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e9edec14-452b-46fe-89c6-849ece08f527/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbi_fmfhh" returned: 0 in 0.090s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:52.263004 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:52.274486 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-4f240084-f1ec-4db3-adbb-5b795658d17c req-36381d1e-6286-4933-b90a-fa9409a550b0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:52.289200 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:52.307498 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] End _get_guest_xml xml=<domain type="qemu">
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:   <uuid>4f1b10cb-b101-4ef4-9f68-54bf1c6c68da</uuid>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:   <name>instance-00000019</name>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1779327587</nova:name>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:00:51</nova:creationTime>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:         <nova:user uuid="c0efcbc1b88f49989c9f6b6a7439f2c4">tempest-TestEncryptedCinderVolumes-991116896-project-member</nova:user>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:         <nova:project uuid="177bec65268546d2b899e09989183b6e">tempest-TestEncryptedCinderVolumes-991116896</nova:project>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:         <nova:port uuid="9a94bce6-2a69-438d-aa6e-d41ddef4d13e">
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:     <system>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:       <entry name="serial">4f1b10cb-b101-4ef4-9f68-54bf1c6c68da</entry>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:       <entry name="uuid">4f1b10cb-b101-4ef4-9f68-54bf1c6c68da</entry>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:     </system>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:   <os>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:   </os>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:   <features>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:   </features>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:   <devices>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/4f1b10cb-b101-4ef4-9f68-54bf1c6c68da/disk"/>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:     </disk>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/4f1b10cb-b101-4ef4-9f68-54bf1c6c68da/disk.config"/>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:     </disk>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:02:b4:9e"/>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:       <target dev="tap9a94bce6-2a"/>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:     </interface>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/4f1b10cb-b101-4ef4-9f68-54bf1c6c68da/console.log" append="off"/>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:     </serial>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:     <video>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:     </video>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:     </rng>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:   </devices>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]: </domain>
May 21 02:00:52.307498 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:00:52.307498 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Preparing to wait for external event network-vif-plugged-9a94bce6-2a69-438d-aa6e-d41ddef4d13e {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:00:52.307498 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "4f1b10cb-b101-4ef4-9f68-54bf1c6c68da-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:52.307498 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "4f1b10cb-b101-4ef4-9f68-54bf1c6c68da-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:52.312429 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "4f1b10cb-b101-4ef4-9f68-54bf1c6c68da-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:52.312429 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:00:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1779327587',display_name='tempest-TestEncryptedCinderVolumes-server-1779327587',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testencryptedcindervolumes-server-1779327587',id=25,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/hDqZkMajg3N/N4Ygb3hHFWCbrrX7jB2xTtn4M5janHb3yRzu8QOW0iBqMvpy5+6Wf5pau7rYMtKkAJyxmnZZ3SUFF6mpjcHbMND9BG0/76jIfmHdktnbmtYGBnQAVyw==',key_name='tempest-keypair-916059594',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='177bec65268546d2b899e09989183b6e',ramdisk_id='',reservation_id='r-3ynirpnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-991116896',owner_user_name='tempest-TestEncryptedCinderVolumes-991116896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:00:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0efcbc1b88f49989c9f6b6a7439f2c4',uuid=4f1b10cb-b101-4ef4-9f68-54bf1c6c68da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a94bce6-2a69-438d-aa6e-d41ddef4d13e", "address": "fa:16:3e:02:b4:9e", "network": {"id": "38d66f09-c738-4e79-9aeb-12e87e29f568", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-447420743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "177bec65268546d2b899e09989183b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a94bce6-2a", "ovs_interfaceid": "9a94bce6-2a69-438d-aa6e-d41ddef4d13e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:00:52.312429 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Converting VIF {"id": "9a94bce6-2a69-438d-aa6e-d41ddef4d13e", "address": "fa:16:3e:02:b4:9e", "network": {"id": "38d66f09-c738-4e79-9aeb-12e87e29f568", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-447420743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "177bec65268546d2b899e09989183b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a94bce6-2a", "ovs_interfaceid": "9a94bce6-2a69-438d-aa6e-d41ddef4d13e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:00:52.312800 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:b4:9e,bridge_name='br-int',has_traffic_filtering=True,id=9a94bce6-2a69-438d-aa6e-d41ddef4d13e,network=Network(38d66f09-c738-4e79-9aeb-12e87e29f568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a94bce6-2a') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:00:52.313047 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:b4:9e,bridge_name='br-int',has_traffic_filtering=True,id=9a94bce6-2a69-438d-aa6e-d41ddef4d13e,network=Network(38d66f09-c738-4e79-9aeb-12e87e29f568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a94bce6-2a') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:00:52.315360 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:52.315360 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:52.315360 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:00:52.318213 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:52.318213 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dd7fd419-582a-559f-bc0b-cf1ec17ac728', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:52.318948 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:52.319981 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:00:52.326637 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:52.335124 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:52.335124 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a94bce6-2a, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:52.335124 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9a94bce6-2a, col_values=(('qos', UUID('c5095cfe-f25f-45b6-b920-4eba62bde1ff')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:52.335124 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9a94bce6-2a, col_values=(('external_ids', {'iface-id': '9a94bce6-2a69-438d-aa6e-d41ddef4d13e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:b4:9e', 'vm-uuid': '4f1b10cb-b101-4ef4-9f68-54bf1c6c68da'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:52.337174 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:00:52.348618 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:52.350504 np0000001127 nova-compute[98206]: INFO os_vif [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:b4:9e,bridge_name='br-int',has_traffic_filtering=True,id=9a94bce6-2a69-438d-aa6e-d41ddef4d13e,network=Network(38d66f09-c738-4e79-9aeb-12e87e29f568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a94bce6-2a')
May 21 02:00:52.494057 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:00:52.494057 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:00:52.817592 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:52.856131 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:52.877756 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-4f240084-f1ec-4db3-adbb-5b795658d17c req-36381d1e-6286-4933-b90a-fa9409a550b0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:52.928768 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1f8841a9-714e-4158-859a-19b75f958ac1 req-88cb3059-2835-4607-9498-30b82f18f177 service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Received event network-vif-deleted-3b1f76f9-cf49-4dea-b9a2-762c2ad220bf {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:52.930130 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-1f8841a9-714e-4158-859a-19b75f958ac1 req-88cb3059-2835-4607-9498-30b82f18f177 service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Neutron deleted interface 3b1f76f9-cf49-4dea-b9a2-762c2ad220bf; detaching it from the instance and deleting it from the info cache
May 21 02:00:52.930130 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-1f8841a9-714e-4158-859a-19b75f958ac1 req-88cb3059-2835-4607-9498-30b82f18f177 service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:00:52.969817 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:52.998880 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:00:53.218284 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-4f240084-f1ec-4db3-adbb-5b795658d17c req-36381d1e-6286-4933-b90a-fa9409a550b0 service nova] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Updated VIF entry in instance network info cache for port 9a94bce6-2a69-438d-aa6e-d41ddef4d13e. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:00:53.218530 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-4f240084-f1ec-4db3-adbb-5b795658d17c req-36381d1e-6286-4933-b90a-fa9409a550b0 service nova] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Updating instance_info_cache with network_info: [{"id": "9a94bce6-2a69-438d-aa6e-d41ddef4d13e", "address": "fa:16:3e:02:b4:9e", "network": {"id": "38d66f09-c738-4e79-9aeb-12e87e29f568", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-447420743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "177bec65268546d2b899e09989183b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a94bce6-2a", "ovs_interfaceid": "9a94bce6-2a69-438d-aa6e-d41ddef4d13e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:00:53.243963 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:53.252770 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:53.260388 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:53.285846 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:53.293758 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:53.355739 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-56d57682-82ff-401a-9729-b5dccbe05ec4 req-21ac68f9-4ba6-4a80-a85e-0fe3fdfb88d6 service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Received event network-vif-unplugged-3b1f76f9-cf49-4dea-b9a2-762c2ad220bf {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:53.356400 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-56d57682-82ff-401a-9729-b5dccbe05ec4 req-21ac68f9-4ba6-4a80-a85e-0fe3fdfb88d6 service nova] Acquiring lock "64f1cde4-f11a-4da7-8bbc-aaf777432069-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:53.357067 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-56d57682-82ff-401a-9729-b5dccbe05ec4 req-21ac68f9-4ba6-4a80-a85e-0fe3fdfb88d6 service nova] Lock "64f1cde4-f11a-4da7-8bbc-aaf777432069-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:53.357332 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-56d57682-82ff-401a-9729-b5dccbe05ec4 req-21ac68f9-4ba6-4a80-a85e-0fe3fdfb88d6 service nova] Lock "64f1cde4-f11a-4da7-8bbc-aaf777432069-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:53.357601 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-56d57682-82ff-401a-9729-b5dccbe05ec4 req-21ac68f9-4ba6-4a80-a85e-0fe3fdfb88d6 service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] No waiting events found dispatching network-vif-unplugged-3b1f76f9-cf49-4dea-b9a2-762c2ad220bf {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:53.358075 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-56d57682-82ff-401a-9729-b5dccbe05ec4 req-21ac68f9-4ba6-4a80-a85e-0fe3fdfb88d6 service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Received event network-vif-unplugged-3b1f76f9-cf49-4dea-b9a2-762c2ad220bf for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:00:53.366542 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:00:53.438153 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1f8841a9-714e-4158-859a-19b75f958ac1 req-88cb3059-2835-4607-9498-30b82f18f177 service nova] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Detach interface failed, port_id=3b1f76f9-cf49-4dea-b9a2-762c2ad220bf, reason: Instance 64f1cde4-f11a-4da7-8bbc-aaf777432069 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:00:53.507280 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.764s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:53.611813 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Deleted allocations for instance 61f5b839-7cd4-428d-8dc0-327effc695d8
May 21 02:00:53.721443 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4f240084-f1ec-4db3-adbb-5b795658d17c req-36381d1e-6286-4933-b90a-fa9409a550b0 service nova] Releasing lock "refresh_cache-4f1b10cb-b101-4ef4-9f68-54bf1c6c68da" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:00:53.742921 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:00:53.743930 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:00:53.743930 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:00:53.745451 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:00:53.746957 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:00:53.746957 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:00:53.747102 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:00:53.747268 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 21 02:00:53.747638 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 51.93 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:00:53.869009 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Took 1.69 seconds to deallocate network for instance.
May 21 02:00:53.890220 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:00:53.890492 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:00:53.890683 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] No VIF found with MAC fa:16:3e:02:b4:9e, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:00:53.891295 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Using config drive
May 21 02:00:54.084562 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328854.084101, e9edec14-452b-46fe-89c6-849ece08f527 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:00:54.084777 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e9edec14-452b-46fe-89c6-849ece08f527] VM Started (Lifecycle Event)
May 21 02:00:54.379257 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fd99e1c7-b143-43fc-8624-32e159a32c83 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:54.379399 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fd99e1c7-b143-43fc-8624-32e159a32c83 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:54.402547 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:54.590579 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:00:54.595699 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328854.5943086, e9edec14-452b-46fe-89c6-849ece08f527 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:00:54.595872 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e9edec14-452b-46fe-89c6-849ece08f527] VM Paused (Lifecycle Event)
May 21 02:00:54.626297 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dccf187c-9540-4cce-af75-131054d81326 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "61f5b839-7cd4-428d-8dc0-327effc695d8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.691s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:54.743575 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Creating config drive at /opt/stack/data/nova/instances/4f1b10cb-b101-4ef4-9f68-54bf1c6c68da/disk.config
May 21 02:00:54.745707 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:54.750398 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4f1b10cb-b101-4ef4-9f68-54bf1c6c68da/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmprqoig0nm {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:00:54.835843 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4f1b10cb-b101-4ef4-9f68-54bf1c6c68da/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmprqoig0nm" returned: 0 in 0.085s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:00:55.104556 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:00:55.113521 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:00:55.129870 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-fd99e1c7-b143-43fc-8624-32e159a32c83 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:00:55.129870 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-fd99e1c7-b143-43fc-8624-32e159a32c83 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:00:55.185726 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-094fa029-f206-4000-93b6-c6cfaeb136f5 req-85bd5742-990e-463d-b765-f8d322fd5a92 service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Received event network-vif-plugged-cbfb2d9f-c55f-4f12-8b0c-ce07a987798a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:55.185726 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-094fa029-f206-4000-93b6-c6cfaeb136f5 req-85bd5742-990e-463d-b765-f8d322fd5a92 service nova] Acquiring lock "e9edec14-452b-46fe-89c6-849ece08f527-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:55.185726 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-094fa029-f206-4000-93b6-c6cfaeb136f5 req-85bd5742-990e-463d-b765-f8d322fd5a92 service nova] Lock "e9edec14-452b-46fe-89c6-849ece08f527-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:55.185726 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-094fa029-f206-4000-93b6-c6cfaeb136f5 req-85bd5742-990e-463d-b765-f8d322fd5a92 service nova] Lock "e9edec14-452b-46fe-89c6-849ece08f527-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:55.185726 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-094fa029-f206-4000-93b6-c6cfaeb136f5 req-85bd5742-990e-463d-b765-f8d322fd5a92 service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Processing event network-vif-plugged-cbfb2d9f-c55f-4f12-8b0c-ce07a987798a {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:00:55.185726 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-094fa029-f206-4000-93b6-c6cfaeb136f5 req-85bd5742-990e-463d-b765-f8d322fd5a92 service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Received event network-vif-plugged-cbfb2d9f-c55f-4f12-8b0c-ce07a987798a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:55.185726 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-094fa029-f206-4000-93b6-c6cfaeb136f5 req-85bd5742-990e-463d-b765-f8d322fd5a92 service nova] Acquiring lock "e9edec14-452b-46fe-89c6-849ece08f527-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:55.186039 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:00:55.190781 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-094fa029-f206-4000-93b6-c6cfaeb136f5 req-85bd5742-990e-463d-b765-f8d322fd5a92 service nova] Lock "e9edec14-452b-46fe-89c6-849ece08f527-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:55.190781 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-094fa029-f206-4000-93b6-c6cfaeb136f5 req-85bd5742-990e-463d-b765-f8d322fd5a92 service nova] Lock "e9edec14-452b-46fe-89c6-849ece08f527-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:55.190781 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-094fa029-f206-4000-93b6-c6cfaeb136f5 req-85bd5742-990e-463d-b765-f8d322fd5a92 service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] No waiting events found dispatching network-vif-plugged-cbfb2d9f-c55f-4f12-8b0c-ce07a987798a {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:55.190781 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-094fa029-f206-4000-93b6-c6cfaeb136f5 req-85bd5742-990e-463d-b765-f8d322fd5a92 service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Received unexpected event network-vif-plugged-cbfb2d9f-c55f-4f12-8b0c-ce07a987798a for instance with vm_state building and task_state spawning.
May 21 02:00:55.198147 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:00:55.202678 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Instance spawned successfully.
May 21 02:00:55.203227 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:00:55.440524 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:55.472742 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:55.609342 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:55.610089 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a28ce2a6-75bb-4570-a5e4-87f540a3085d tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "6c48501b-d03d-40bc-aef5-450fa580bd69" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:55.610984 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a28ce2a6-75bb-4570-a5e4-87f540a3085d tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "6c48501b-d03d-40bc-aef5-450fa580bd69" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:55.611334 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a28ce2a6-75bb-4570-a5e4-87f540a3085d tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "6c48501b-d03d-40bc-aef5-450fa580bd69-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:55.611568 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a28ce2a6-75bb-4570-a5e4-87f540a3085d tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "6c48501b-d03d-40bc-aef5-450fa580bd69-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:55.611673 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a28ce2a6-75bb-4570-a5e4-87f540a3085d tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "6c48501b-d03d-40bc-aef5-450fa580bd69-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:55.614226 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-a28ce2a6-75bb-4570-a5e4-87f540a3085d tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Terminating instance
May 21 02:00:55.621700 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e9edec14-452b-46fe-89c6-849ece08f527] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:00:55.621700 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328855.6201172, e9edec14-452b-46fe-89c6-849ece08f527 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:00:55.621700 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e9edec14-452b-46fe-89c6-849ece08f527] VM Resumed (Lifecycle Event)
May 21 02:00:55.635908 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-fd99e1c7-b143-43fc-8624-32e159a32c83 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:00:55.714267 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:00:55.714489 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:00:55.714876 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:00:55.715327 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:00:55.715550 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:00:55.715882 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:00:55.870419 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:55.876600 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:55.897960 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:56.124403 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-a28ce2a6-75bb-4570-a5e4-87f540a3085d tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:00:56.125914 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:00:56.128787 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:00:56.146768 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fd99e1c7-b143-43fc-8624-32e159a32c83 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.767s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:56.157436 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:56.177692 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:56.223222 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Took 9.54 seconds to spawn the instance on the hypervisor.
May 21 02:00:56.224688 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:00:56.275498 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-fd99e1c7-b143-43fc-8624-32e159a32c83 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Deleted allocations for instance 64f1cde4-f11a-4da7-8bbc-aaf777432069
May 21 02:00:56.308591 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:56.375816 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:56.385855 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:56.471207 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:56.484050 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:56.508937 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Instance destroyed successfully.
May 21 02:00:56.509751 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-a28ce2a6-75bb-4570-a5e4-87f540a3085d tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lazy-loading 'resources' on Instance uuid 6c48501b-d03d-40bc-aef5-450fa580bd69 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:00:56.608036 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-16797e8b-48da-4b80-8eb6-d3e90c99d7b5 req-acfaf530-df29-41d2-bf15-a2e070c6dedd service nova] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Received event network-vif-unplugged-3356c6b8-bf6b-43aa-bb09-491a7b40115f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:56.608235 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-16797e8b-48da-4b80-8eb6-d3e90c99d7b5 req-acfaf530-df29-41d2-bf15-a2e070c6dedd service nova] Acquiring lock "6c48501b-d03d-40bc-aef5-450fa580bd69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:56.608559 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-16797e8b-48da-4b80-8eb6-d3e90c99d7b5 req-acfaf530-df29-41d2-bf15-a2e070c6dedd service nova] Lock "6c48501b-d03d-40bc-aef5-450fa580bd69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:56.608986 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-16797e8b-48da-4b80-8eb6-d3e90c99d7b5 req-acfaf530-df29-41d2-bf15-a2e070c6dedd service nova] Lock "6c48501b-d03d-40bc-aef5-450fa580bd69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:56.609182 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-16797e8b-48da-4b80-8eb6-d3e90c99d7b5 req-acfaf530-df29-41d2-bf15-a2e070c6dedd service nova] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] No waiting events found dispatching network-vif-unplugged-3356c6b8-bf6b-43aa-bb09-491a7b40115f {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:56.609332 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-16797e8b-48da-4b80-8eb6-d3e90c99d7b5 req-acfaf530-df29-41d2-bf15-a2e070c6dedd service nova] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Received event network-vif-unplugged-3356c6b8-bf6b-43aa-bb09-491a7b40115f for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:00:56.634717 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e9edec14-452b-46fe-89c6-849ece08f527] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:00:56.634717 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999795179000103 future=<Future at 0x71c09830b320 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:00:56.716967 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328856.7165744, 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:00:56.717209 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] VM Started (Lifecycle Event)
May 21 02:00:56.752556 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Took 15.30 seconds to build instance.
May 21 02:00:57.015604 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-a28ce2a6-75bb-4570-a5e4-87f540a3085d tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:59:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-215292592',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serverbootfromvolumestablerescuetest-server-215292592',id=20,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:59:41Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83df9a84ffaa4398bdafbfbde079964d',ramdisk_id='',reservation_id='r-3r9rd7o1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-260444396',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:59:50Z,user_data=None,user_id='bd5b969d5a514d01bacfc7954a5ae4ab',uuid=6c48501b-d03d-40bc-aef5-450fa580bd69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3356c6b8-bf6b-43aa-bb09-491a7b40115f", "address": "fa:16:3e:23:65:cb", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3356c6b8-bf", "ovs_interfaceid": "3356c6b8-bf6b-43aa-bb09-491a7b40115f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:00:57.015864 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-a28ce2a6-75bb-4570-a5e4-87f540a3085d tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Converting VIF {"id": "3356c6b8-bf6b-43aa-bb09-491a7b40115f", "address": "fa:16:3e:23:65:cb", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3356c6b8-bf", "ovs_interfaceid": "3356c6b8-bf6b-43aa-bb09-491a7b40115f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:00:57.016684 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-a28ce2a6-75bb-4570-a5e4-87f540a3085d tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:65:cb,bridge_name='br-int',has_traffic_filtering=True,id=3356c6b8-bf6b-43aa-bb09-491a7b40115f,network=Network(b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3356c6b8-bf') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:00:57.016977 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-a28ce2a6-75bb-4570-a5e4-87f540a3085d tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:65:cb,bridge_name='br-int',has_traffic_filtering=True,id=3356c6b8-bf6b-43aa-bb09-491a7b40115f,network=Network(b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3356c6b8-bf') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:00:57.018987 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:57.019398 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3356c6b8-bf, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:57.020721 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:57.023395 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:00:57.024342 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:57.024717 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1e9f8d40-5c43-44a3-aea7-c43c7b9fc580) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:00:57.025590 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:57.026093 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:00:57.026966 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:57.029673 np0000001127 nova-compute[98206]: INFO os_vif [None req-a28ce2a6-75bb-4570-a5e4-87f540a3085d tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:65:cb,bridge_name='br-int',has_traffic_filtering=True,id=3356c6b8-bf6b-43aa-bb09-491a7b40115f,network=Network(b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3356c6b8-bf')
May 21 02:00:57.030111 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-a28ce2a6-75bb-4570-a5e4-87f540a3085d tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Deleting instance files /opt/stack/data/nova/instances/6c48501b-d03d-40bc-aef5-450fa580bd69_del
May 21 02:00:57.031152 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-a28ce2a6-75bb-4570-a5e4-87f540a3085d tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Deletion of /opt/stack/data/nova/instances/6c48501b-d03d-40bc-aef5-450fa580bd69_del complete
May 21 02:00:57.222120 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:00:57.225424 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328857.2242286, 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:00:57.225424 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] VM Paused (Lifecycle Event)
May 21 02:00:57.254145 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-aad77896-0bab-4261-9e86-f9f6048424a7 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "e9edec14-452b-46fe-89c6-849ece08f527" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.825s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:57.288556 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fd99e1c7-b143-43fc-8624-32e159a32c83 tempest-AttachVolumeShelveTestJSON-826866539 tempest-AttachVolumeShelveTestJSON-826866539-project-member] Lock "64f1cde4-f11a-4da7-8bbc-aaf777432069" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.056s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:57.537881 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-a28ce2a6-75bb-4570-a5e4-87f540a3085d tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Took 1.41 seconds to destroy the instance on the hypervisor.
May 21 02:00:57.540213 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-a28ce2a6-75bb-4570-a5e4-87f540a3085d tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:00:57.540881 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:00:57.541041 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:00:57.541382 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:57.655622 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:57.728962 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:00:57.731582 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:00:57.891682 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:00:57.898748 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.006793560999994952 future=<Future at 0x71c05856deb0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:00:57.899203 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:00:57.899554 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=3.87959959900013 future=<Future at 0x71c07c31fb60 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:00:57.899663 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=3.87947989700001 future=<Future at 0x71c07c31fb60 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:00:58.235035 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:00:59.098982 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0190d16b-26a6-4960-bdd5-6a7c46115a41 req-9baa781a-ffad-4ead-8499-d1253478b4ec service nova] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Received event network-vif-unplugged-3356c6b8-bf6b-43aa-bb09-491a7b40115f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:59.099379 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0190d16b-26a6-4960-bdd5-6a7c46115a41 req-9baa781a-ffad-4ead-8499-d1253478b4ec service nova] Acquiring lock "6c48501b-d03d-40bc-aef5-450fa580bd69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:00:59.099379 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0190d16b-26a6-4960-bdd5-6a7c46115a41 req-9baa781a-ffad-4ead-8499-d1253478b4ec service nova] Lock "6c48501b-d03d-40bc-aef5-450fa580bd69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:00:59.099379 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0190d16b-26a6-4960-bdd5-6a7c46115a41 req-9baa781a-ffad-4ead-8499-d1253478b4ec service nova] Lock "6c48501b-d03d-40bc-aef5-450fa580bd69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:00:59.099679 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0190d16b-26a6-4960-bdd5-6a7c46115a41 req-9baa781a-ffad-4ead-8499-d1253478b4ec service nova] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] No waiting events found dispatching network-vif-unplugged-3356c6b8-bf6b-43aa-bb09-491a7b40115f {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:00:59.099679 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0190d16b-26a6-4960-bdd5-6a7c46115a41 req-9baa781a-ffad-4ead-8499-d1253478b4ec service nova] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Received event network-vif-unplugged-3356c6b8-bf6b-43aa-bb09-491a7b40115f for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:00:59.137307 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:00:59.338673 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-03e063dc-52dc-4532-8193-78eecb14ec85 req-28852c0a-0b51-469c-95d4-45b9dc3574f1 service nova] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Received event network-vif-deleted-3356c6b8-bf6b-43aa-bb09-491a7b40115f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:00:59.338673 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-03e063dc-52dc-4532-8193-78eecb14ec85 req-28852c0a-0b51-469c-95d4-45b9dc3574f1 service nova] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Neutron deleted interface 3356c6b8-bf6b-43aa-bb09-491a7b40115f; detaching it from the instance and deleting it from the info cache
May 21 02:00:59.338673 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-03e063dc-52dc-4532-8193-78eecb14ec85 req-28852c0a-0b51-469c-95d4-45b9dc3574f1 service nova] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:00:59.489243 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:00:59.843483 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-03e063dc-52dc-4532-8193-78eecb14ec85 req-28852c0a-0b51-469c-95d4-45b9dc3574f1 service nova] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Detach interface failed, port_id=3356c6b8-bf6b-43aa-bb09-491a7b40115f, reason: Instance 6c48501b-d03d-40bc-aef5-450fa580bd69 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:00:59.994806 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Took 2.45 seconds to deallocate network for instance.
May 21 02:01:00.321425 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:00.507735 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a28ce2a6-75bb-4570-a5e4-87f540a3085d tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:00.507916 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a28ce2a6-75bb-4570-a5e4-87f540a3085d tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:01.151069 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a28ce2a6-75bb-4570-a5e4-87f540a3085d tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:01:01.152921 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-a28ce2a6-75bb-4570-a5e4-87f540a3085d tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:01:01.174450 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-406e0ed8-4fd6-4f90-956f-0f34e6adea3d req-c1462c75-26fe-4870-b3bc-179f27c0e69c service nova] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Received event network-vif-plugged-9a94bce6-2a69-438d-aa6e-d41ddef4d13e {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:01:01.176427 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-406e0ed8-4fd6-4f90-956f-0f34e6adea3d req-c1462c75-26fe-4870-b3bc-179f27c0e69c service nova] Acquiring lock "4f1b10cb-b101-4ef4-9f68-54bf1c6c68da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:01.177018 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-406e0ed8-4fd6-4f90-956f-0f34e6adea3d req-c1462c75-26fe-4870-b3bc-179f27c0e69c service nova] Lock "4f1b10cb-b101-4ef4-9f68-54bf1c6c68da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:01.177018 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-406e0ed8-4fd6-4f90-956f-0f34e6adea3d req-c1462c75-26fe-4870-b3bc-179f27c0e69c service nova] Lock "4f1b10cb-b101-4ef4-9f68-54bf1c6c68da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:01.177179 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-406e0ed8-4fd6-4f90-956f-0f34e6adea3d req-c1462c75-26fe-4870-b3bc-179f27c0e69c service nova] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Processing event network-vif-plugged-9a94bce6-2a69-438d-aa6e-d41ddef4d13e {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:01:01.178443 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Instance event wait completed in 4 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:01:01.184097 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:01:01.190636 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328861.1882243, 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:01:01.192077 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] VM Resumed (Lifecycle Event)
May 21 02:01:01.194274 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Instance spawned successfully.
May 21 02:01:01.195981 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:01:01.304249 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:01.309634 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:01.655054 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-a28ce2a6-75bb-4570-a5e4-87f540a3085d tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:01:01.705599 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:01:01.707674 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:01:01.707821 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:01:01.708049 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:01:01.708254 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:01:01.708601 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:01:01.708751 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:01:01.711248 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:01:01.779644 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.00045722999993813573 future=<Future at 0x71c07c31fb60 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:01:01.779782 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:01:01.779942 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=4.3035733110000365 future=<Future at 0x71c0983bd460 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:01:01.780879 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Emitting event <LifecycleEvent: 1779328846.77908, 61f5b839-7cd4-428d-8dc0-327effc695d8 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:01:01.781862 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=4.302420483000105 future=<Future at 0x71c0983bd460 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:01:01.782422 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] VM Stopped (Lifecycle Event)
May 21 02:01:02.026915 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:02.166079 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a28ce2a6-75bb-4570-a5e4-87f540a3085d tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.658s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:02.214262 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:01:02.215856 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Took 12.85 seconds to spawn the instance on the hypervisor.
May 21 02:01:02.216663 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:01:02.270265 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-a28ce2a6-75bb-4570-a5e4-87f540a3085d tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Deleted allocations for instance 6c48501b-d03d-40bc-aef5-450fa580bd69
May 21 02:01:02.289531 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 61f5b839-7cd4-428d-8dc0-327effc695d8] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:01:02.729255 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Took 18.71 seconds to build instance.
May 21 02:01:02.776409 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "e9edec14-452b-46fe-89c6-849ece08f527" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:02.776409 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "e9edec14-452b-46fe-89c6-849ece08f527" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:03.230880 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "4f1b10cb-b101-4ef4-9f68-54bf1c6c68da" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.218s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:03.285926 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lazy-loading 'flavor' on Instance uuid e9edec14-452b-46fe-89c6-849ece08f527 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:01:03.291005 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a28ce2a6-75bb-4570-a5e4-87f540a3085d tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "6c48501b-d03d-40bc-aef5-450fa580bd69" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.681s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:03.791706 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bec16861-3a84-40f9-87b1-74d9c62ace87 req-c3c47e29-7d41-4309-8115-685a2bde0aa1 service nova] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Received event network-vif-plugged-9a94bce6-2a69-438d-aa6e-d41ddef4d13e {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:01:03.800991 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bec16861-3a84-40f9-87b1-74d9c62ace87 req-c3c47e29-7d41-4309-8115-685a2bde0aa1 service nova] Acquiring lock "4f1b10cb-b101-4ef4-9f68-54bf1c6c68da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:03.804513 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bec16861-3a84-40f9-87b1-74d9c62ace87 req-c3c47e29-7d41-4309-8115-685a2bde0aa1 service nova] Lock "4f1b10cb-b101-4ef4-9f68-54bf1c6c68da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:03.804513 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bec16861-3a84-40f9-87b1-74d9c62ace87 req-c3c47e29-7d41-4309-8115-685a2bde0aa1 service nova] Lock "4f1b10cb-b101-4ef4-9f68-54bf1c6c68da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:03.804513 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bec16861-3a84-40f9-87b1-74d9c62ace87 req-c3c47e29-7d41-4309-8115-685a2bde0aa1 service nova] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] No waiting events found dispatching network-vif-plugged-9a94bce6-2a69-438d-aa6e-d41ddef4d13e {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:01:03.804513 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-bec16861-3a84-40f9-87b1-74d9c62ace87 req-c3c47e29-7d41-4309-8115-685a2bde0aa1 service nova] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Received unexpected event network-vif-plugged-9a94bce6-2a69-438d-aa6e-d41ddef4d13e for instance with vm_state active and task_state None.
May 21 02:01:04.303060 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "e9edec14-452b-46fe-89c6-849ece08f527" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.528s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:04.722247 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:04.722247 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:04.722525 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:04.722903 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:04.722903 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:04.727218 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Terminating instance
May 21 02:01:04.997220 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:05.166014 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:01:05.237501 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:01:05.262873 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:05.269046 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:05.296895 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:05.454874 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "e9edec14-452b-46fe-89c6-849ece08f527" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:05.454874 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "e9edec14-452b-46fe-89c6-849ece08f527" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:05.454874 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Attaching volume c5a59eca-d594-4eb2-9205-c45ac58af0f6 to /dev/vdb
May 21 02:01:05.498502 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:05.505820 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:05.534136 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:01:05.548667 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:01:05.585612 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Acquiring lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:05.585895 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:05.588047 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:05.588266 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:05.606799 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:05.619771 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999211067000033 future=<Future at 0x71c0585b5ee0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:01:05.628283 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Instance destroyed successfully.
May 21 02:01:05.629874 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lazy-loading 'resources' on Instance uuid 392bbdc4-beaa-4c44-93f5-3a76f331ceb0 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:01:05.639800 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:01:05.645177 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:01:05.654028 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:01:05.657294 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe9e:216', 'fe80::14d9:7bff:fe3b:f0dc', 'fe80::fc16:3eff:fee3:f7d2', 'fe80::6c2e:11ff:fea1:7eb7', 'fe80::fc16:3eff:fe45:a237', 'fe80::fc16:3eff:febc:420', 'fe80::f8e2:1cff:fe30:95ec', 'fe80::fc16:3eff:fe35:27d3', 'fe80::a403:4dff:fe5a:1b07', 'fe80::fc16:3eff:fe02:b49e', 'fe80::f819:cdff:fe2b:de28'] 
May 21 02:01:05.657294 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:01:05.658176 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:01:05.658460 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:01:05.658945 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Updating existing volume attachment record: fcc2d940-ba83-4042-97d0-39b1b0bee7dd {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:01:05.880344 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-fed09e60-8e99-4a9a-b598-d487b4f3df48 req-03ff6f1d-6190-4b6c-99be-806e590fa7f0 service nova] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Received event network-changed-9a94bce6-2a69-438d-aa6e-d41ddef4d13e {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:01:05.880344 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-fed09e60-8e99-4a9a-b598-d487b4f3df48 req-03ff6f1d-6190-4b6c-99be-806e590fa7f0 service nova] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Refreshing instance network info cache due to event network-changed-9a94bce6-2a69-438d-aa6e-d41ddef4d13e. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:01:05.880344 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fed09e60-8e99-4a9a-b598-d487b4f3df48 req-03ff6f1d-6190-4b6c-99be-806e590fa7f0 service nova] Acquiring lock "refresh_cache-4f1b10cb-b101-4ef4-9f68-54bf1c6c68da" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:01:05.880344 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fed09e60-8e99-4a9a-b598-d487b4f3df48 req-03ff6f1d-6190-4b6c-99be-806e590fa7f0 service nova] Acquired lock "refresh_cache-4f1b10cb-b101-4ef4-9f68-54bf1c6c68da" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:01:05.880344 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-fed09e60-8e99-4a9a-b598-d487b4f3df48 req-03ff6f1d-6190-4b6c-99be-806e590fa7f0 service nova] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Refreshing network info cache for port 9a94bce6-2a69-438d-aa6e-d41ddef4d13e {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:01:06.084039 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0005029659998854186 future=<Future at 0x71c0983bd460 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:01:06.085372 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:01:06.085372 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=5.550095650000003 future=<Future at 0x71c09830b320 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:01:06.087207 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Emitting event <LifecycleEvent: 1779328851.083416, 64f1cde4-f11a-4da7-8bbc-aaf777432069 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:01:06.087401 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=5.547030246000077 future=<Future at 0x71c09830b320 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:01:06.087607 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] VM Stopped (Lifecycle Event)
May 21 02:01:06.089850 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:01:06.134244 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:58:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1558814074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serverbootfromvolumestablerescuetest-server-1558814074',id=15,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:59:14Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83df9a84ffaa4398bdafbfbde079964d',ramdisk_id='',reservation_id='r-cgn40wpx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-260444396',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:59:22Z,user_data=None,user_id='bd5b969d5a514d01bacfc7954a5ae4ab',uuid=392bbdc4-beaa-4c44-93f5-3a76f331ceb0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44670b22-c758-456b-a200-f0323baea57f", "address": "fa:16:3e:50:bf:d8", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap44670b22-c7", "ovs_interfaceid": "44670b22-c758-456b-a200-f0323baea57f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:01:06.134799 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Converting VIF {"id": "44670b22-c758-456b-a200-f0323baea57f", "address": "fa:16:3e:50:bf:d8", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap44670b22-c7", "ovs_interfaceid": "44670b22-c758-456b-a200-f0323baea57f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:01:06.135370 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:bf:d8,bridge_name='br-int',has_traffic_filtering=True,id=44670b22-c758-456b-a200-f0323baea57f,network=Network(b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44670b22-c7') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:01:06.139685 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:bf:d8,bridge_name='br-int',has_traffic_filtering=True,id=44670b22-c758-456b-a200-f0323baea57f,network=Network(b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44670b22-c7') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:01:06.144022 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:06.144022 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap44670b22-c7, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:01:06.145451 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:06.146680 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:01:06.161153 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-5da28f2c-1772-40b4-80e3-be6264bb5516 req-ccef3129-389e-4d31-b7c6-4ebea14f7723 service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Received event network-vif-unplugged-44670b22-c758-456b-a200-f0323baea57f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:01:06.161310 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5da28f2c-1772-40b4-80e3-be6264bb5516 req-ccef3129-389e-4d31-b7c6-4ebea14f7723 service nova] Acquiring lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:06.163206 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5da28f2c-1772-40b4-80e3-be6264bb5516 req-ccef3129-389e-4d31-b7c6-4ebea14f7723 service nova] Lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:06.163206 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5da28f2c-1772-40b4-80e3-be6264bb5516 req-ccef3129-389e-4d31-b7c6-4ebea14f7723 service nova] Lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:06.163320 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-5da28f2c-1772-40b4-80e3-be6264bb5516 req-ccef3129-389e-4d31-b7c6-4ebea14f7723 service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] No waiting events found dispatching network-vif-unplugged-44670b22-c758-456b-a200-f0323baea57f {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:01:06.163433 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-5da28f2c-1772-40b4-80e3-be6264bb5516 req-ccef3129-389e-4d31-b7c6-4ebea14f7723 service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Received event network-vif-unplugged-44670b22-c758-456b-a200-f0323baea57f for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:01:06.179913 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:06.182788 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:06.183030 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=54ede111-c478-4f64-b8d6-feb2cfde58c8) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:01:06.184751 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:06.185603 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:01:06.186537 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:06.189454 np0000001127 nova-compute[98206]: INFO os_vif [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:bf:d8,bridge_name='br-int',has_traffic_filtering=True,id=44670b22-c758-456b-a200-f0323baea57f,network=Network(b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44670b22-c7')
May 21 02:01:06.191852 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:01:06.192063 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '69f8ed84-393f-414e-9868-ac8c3126b175', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:01:06.192388 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:01:06.193069 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:01:06.193527 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '69f8ed84-393f-414e-9868-ac8c3126b175', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:01:06.193766 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:01:06.235575 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:01:06.235575 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:01:06.235575 np0000001127 nova-compute[98206]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:06.235575 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:06.235575 np0000001127 nova-compute[98206]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:01:06.235575 np0000001127 nova-compute[98206]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:01:06.235575 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:01:06.235575 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsi session list stdout=tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:01:06.235575 np0000001127 nova-compute[98206]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175 (non-flash)
May 21 02:01:06.235575 np0000001127 nova-compute[98206]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:06.235575 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:06.235575 np0000001127 nova-compute[98206]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:01:06.235575 np0000001127 nova-compute[98206]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:01:06.235575 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:01:06.236040 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', '27'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', '50'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', '51')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:01:06.236163 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', '27')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:01:06.239653 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175', '26')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:01:06.239888 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c547d80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175'): ({'sdd'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:01:06.240136 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Removing multipathed devices sde, sdd {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:01:06.241414 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Flush multipath device 330000000e3a8a7be {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:01:06.265379 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:01:06.265379 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6', 'iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c5a59eca-d594-4eb2-9205-c45ac58af0f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:01:06.265814 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:01:06.276578 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:01:06.311681 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:06.327203 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:01:06.376546 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:01:06.378274 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:01:06.381865 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:01:06.384436 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-fed09e60-8e99-4a9a-b598-d487b4f3df48 req-03ff6f1d-6190-4b6c-99be-806e590fa7f0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:06.398893 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:01:06.399192 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:01:06.412712 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:06.444063 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175, portal: 192.168.40.100,3260]
May 21 02:01:06.444063 np0000001127 nova-compute[98206]: Logout of [sid: 27, target: iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175, portal: 192.168.40.100,3260] successful.
May 21 02:01:06.444063 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:06.469556 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:06.482352 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:06.513693 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175, portal: 192.168.50.100,3260]
May 21 02:01:06.513693 np0000001127 nova-compute[98206]: Logout of [sid: 26, target: iqn.2023-03.storpool.com:os--volume-69f8ed84-393f-414e-9868-ac8c3126b175, portal: 192.168.50.100,3260] successful.
May 21 02:01:06.513693 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:06.529790 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:06.530059 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:01:06.530303 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] <== disconnect_volume: return (337ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:01:06.531524 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:01:06.531850 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Deleting instance files /opt/stack/data/nova/instances/392bbdc4-beaa-4c44-93f5-3a76f331ceb0_del
May 21 02:01:06.532164 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.267s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:01:06.532896 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6', 'iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c5a59eca-d594-4eb2-9205-c45ac58af0f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:01:06.534425 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Deletion of /opt/stack/data/nova/instances/392bbdc4-beaa-4c44-93f5-3a76f331ceb0_del complete
May 21 02:01:06.545835 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:01:06.547405 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:01:06.547748 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:01:06.547881 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:01:06.548302 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:01:06.548501 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:01:06.559360 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:01:06.559360 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:06.564842 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:01:06.564842 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:06.572609 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6] added
May 21 02:01:06.572609 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:01:06.572609 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:01:06.572609 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:01:06.572609 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:01:06.572609 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:01:06.572609 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:06.572908 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:01:06.573299 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0253(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:01:06.573632 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:01:06.579026 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6] added
May 21 02:01:06.579026 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:01:06.579026 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:01:06.579026 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:01:06.579026 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:01:06.579026 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:01:06.579026 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:06.579354 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:01:06.579587 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.031(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:01:06.579756 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:01:06.597282 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d662b22b-7612-47e6-94c9-5bc7ea6ad1e8 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 64f1cde4-f11a-4da7-8bbc-aaf777432069] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:01:06.713206 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:06.714073 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:06.726306 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:01:06.729491 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Claim successful on node np0000001127
May 21 02:01:06.889979 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-fed09e60-8e99-4a9a-b598-d487b4f3df48 req-03ff6f1d-6190-4b6c-99be-806e590fa7f0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:07.045875 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Took 1.81 seconds to destroy the instance on the hypervisor.
May 21 02:01:07.046984 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:01:07.047332 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:01:07.047429 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:01:07.047687 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:07.202847 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-fed09e60-8e99-4a9a-b598-d487b4f3df48 req-03ff6f1d-6190-4b6c-99be-806e590fa7f0 service nova] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Updated VIF entry in instance network info cache for port 9a94bce6-2a69-438d-aa6e-d41ddef4d13e. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:01:07.202847 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-fed09e60-8e99-4a9a-b598-d487b4f3df48 req-03ff6f1d-6190-4b6c-99be-806e590fa7f0 service nova] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Updating instance_info_cache with network_info: [{"id": "9a94bce6-2a69-438d-aa6e-d41ddef4d13e", "address": "fa:16:3e:02:b4:9e", "network": {"id": "38d66f09-c738-4e79-9aeb-12e87e29f568", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-447420743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "177bec65268546d2b899e09989183b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a94bce6-2a", "ovs_interfaceid": "9a94bce6-2a69-438d-aa6e-d41ddef4d13e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:01:07.204753 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:07.574589 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:01:07.581527 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:01:07.592720 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:01:07.592720 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:01:07.601923 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:01:07.601923 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:07.611956 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:07.626584 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:07.640346 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:07.640346 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:07.640346 np0000001127 nova-compute[98206]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:01:07.640346 np0000001127 nova-compute[98206]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:01:07.640346 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:01:07.640971 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:07.640971 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:07.640971 np0000001127 nova-compute[98206]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:01:07.640971 np0000001127 nova-compute[98206]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:01:07.640971 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:01:07.651960 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:07.651960 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:07.651960 np0000001127 nova-compute[98206]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:01:07.651960 np0000001127 nova-compute[98206]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:01:07.651960 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:01:07.652195 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:07.652195 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:07.652195 np0000001127 nova-compute[98206]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:01:07.652195 np0000001127 nova-compute[98206]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:01:07.652195 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:01:07.700632 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6, portal: 192.168.40.100,3260]
May 21 02:01:07.700632 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6, portal: 192.168.40.100,3260] successful.
May 21 02:01:07.700632 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:07.707858 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fed09e60-8e99-4a9a-b598-d487b4f3df48 req-03ff6f1d-6190-4b6c-99be-806e590fa7f0 service nova] Releasing lock "refresh_cache-4f1b10cb-b101-4ef4-9f68-54bf1c6c68da" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:01:07.712968 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6, portal: 192.168.50.100,3260]
May 21 02:01:07.712968 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6, portal: 192.168.50.100,3260] successful.
May 21 02:01:07.712968 np0000001127 nova-compute[98206]:  stderr=iscsiadm: could not read session targetname: 5
May 21 02:01:07.712968 np0000001127 nova-compute[98206]: iscsiadm: could not find session info for session52
May 21 02:01:07.712968 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:07.721593 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:07.731219 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:07.744617 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:07.744617 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:07.744617 np0000001127 nova-compute[98206]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:01:07.744617 np0000001127 nova-compute[98206]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:01:07.744617 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:07.744617 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:07.744617 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:01:07.744879 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:07.744879 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:07.744879 np0000001127 nova-compute[98206]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:01:07.744879 np0000001127 nova-compute[98206]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:01:07.744879 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:07.744879 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:07.744879 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:01:07.745493 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.197s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:01:07.748614 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:01:07.750241 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] HCTL ('9', '-', '-', 0) found on session 52 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:01:07.750241 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:01:07.766647 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:07.766647 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:07.766647 np0000001127 nova-compute[98206]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:01:07.766647 np0000001127 nova-compute[98206]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:01:07.766647 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:07.766647 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:07.766647 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:01:07.766647 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:07.766647 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:07.766647 np0000001127 nova-compute[98206]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:01:07.766647 np0000001127 nova-compute[98206]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:01:07.766647 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:07.766647 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:07.766647 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:01:07.766647 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.216s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:01:07.766647 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:01:07.766647 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] HCTL ('10', '-', '-', 0) found on session 53 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:01:07.766647 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:01:07.774622 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Searching for a device in session 52 and hctl ['9', '*', '*', 0] yield: None {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:01:07.801986 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Searching for a device in session 53 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:01:07.801986 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c5a59eca-d594-4eb2-9205-c45ac58af0f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:01:07.998461 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:01:08.236028 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1dedb890-ed40-4297-81a0-74605d59c98f req-b874531d-bb25-4089-a411-08c14e538695 service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Received event network-vif-unplugged-44670b22-c758-456b-a200-f0323baea57f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:01:08.239488 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1dedb890-ed40-4297-81a0-74605d59c98f req-b874531d-bb25-4089-a411-08c14e538695 service nova] Acquiring lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:08.240129 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1dedb890-ed40-4297-81a0-74605d59c98f req-b874531d-bb25-4089-a411-08c14e538695 service nova] Lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:08.240858 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1dedb890-ed40-4297-81a0-74605d59c98f req-b874531d-bb25-4089-a411-08c14e538695 service nova] Lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:08.241021 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1dedb890-ed40-4297-81a0-74605d59c98f req-b874531d-bb25-4089-a411-08c14e538695 service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] No waiting events found dispatching network-vif-unplugged-44670b22-c758-456b-a200-f0323baea57f {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:01:08.241582 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1dedb890-ed40-4297-81a0-74605d59c98f req-b874531d-bb25-4089-a411-08c14e538695 service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Received event network-vif-unplugged-44670b22-c758-456b-a200-f0323baea57f for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:01:08.241582 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1dedb890-ed40-4297-81a0-74605d59c98f req-b874531d-bb25-4089-a411-08c14e538695 service nova] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Received event network-vif-deleted-44670b22-c758-456b-a200-f0323baea57f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:01:08.359301 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:01:08.359630 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:01:08.502490 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Took 1.45 seconds to deallocate network for instance.
May 21 02:01:08.775246 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Searching for a device in session 52 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:01:08.775408 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c5a59eca-d594-4eb2-9205-c45ac58af0f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:01:08.863202 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:01:09.082692 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Took 0.58 seconds to detach 1 volumes for instance.
May 21 02:01:09.084857 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Deleting volume: 69f8ed84-393f-414e-9868-ac8c3126b175 {{(pid=98206) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 21 02:01:09.369928 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.656s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:09.370356 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:01:09.568736 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Found WWN 330000000f03a3ba9 for multipath device dm-1 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:01:09.569112 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:01:09.569334 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] <== connect_volume: return (3303ms) {'type': 'block', 'scsi_wwn': '330000000f03a3ba9', 'path': '/dev/dm-1', 'multipath_id': '330000000f03a3ba9'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:01:09.569504 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f03a3ba9', 'path': '/dev/dm-1', 'multipath_id': '330000000f03a3ba9'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:01:09.572424 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lazy-loading 'flavor' on Instance uuid e9edec14-452b-46fe-89c6-849ece08f527 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:01:09.648516 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:09.648656 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:09.879938 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:01:09.879938 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:01:09.879938 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:09.879938 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:10.003926 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9c4b29ba15854339bc78b55da0b300da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513057b933ef4779a2e885ae526782b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:01:10.075630 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Attempting to attach volume c5a59eca-d594-4eb2-9205-c45ac58af0f6 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 02:01:10.079323 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] attach device xml: <disk type="block" device="disk">
May 21 02:01:10.079323 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:01:10.079323 np0000001127 nova-compute[98206]:   <alias name="ua-c5a59eca-d594-4eb2-9205-c45ac58af0f6"/>
May 21 02:01:10.079323 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-1"/>
May 21 02:01:10.079323 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:01:10.079323 np0000001127 nova-compute[98206]:   <serial>c5a59eca-d594-4eb2-9205-c45ac58af0f6</serial>
May 21 02:01:10.079323 np0000001127 nova-compute[98206]: </disk>
May 21 02:01:10.079323 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 02:01:10.199378 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:01:10.199645 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:01:10.384000 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:01:10.566761 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Successfully created port: 76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:01:10.704200 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:01:10.889571 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:01:11.185326 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:11.217325 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.569s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:11.278879 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Successfully updated port: 76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:01:11.281116 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Deleted allocations for instance 392bbdc4-beaa-4c44-93f5-3a76f331ceb0
May 21 02:01:11.314719 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:11.357588 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e74fe52e-1e83-4eab-a222-37f379cfddad req-df123121-2f6b-41e0-b0bf-6b7c114751ed service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Received event network-changed-76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:01:11.357779 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e74fe52e-1e83-4eab-a222-37f379cfddad req-df123121-2f6b-41e0-b0bf-6b7c114751ed service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Refreshing instance network info cache due to event network-changed-76516875-8b8a-41f5-9a3f-b76d4c3cc02a. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:01:11.358028 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e74fe52e-1e83-4eab-a222-37f379cfddad req-df123121-2f6b-41e0-b0bf-6b7c114751ed service nova] Acquiring lock "refresh_cache-e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:01:11.358173 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e74fe52e-1e83-4eab-a222-37f379cfddad req-df123121-2f6b-41e0-b0bf-6b7c114751ed service nova] Acquired lock "refresh_cache-e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:01:11.358450 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-e74fe52e-1e83-4eab-a222-37f379cfddad req-df123121-2f6b-41e0-b0bf-6b7c114751ed service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Refreshing network info cache for port 76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:01:11.571296 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:11.634968 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0004166969999914727 future=<Future at 0x71c09830b320 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:01:11.634968 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:01:11.635162 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=8.983575194999958 future=<Future at 0x71c0585b5ee0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:01:11.635162 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=8.983491408999953 future=<Future at 0x71c0585b5ee0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:01:11.635648 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Emitting event <LifecycleEvent: 1779328856.6343536, 6c48501b-d03d-40bc-aef5-450fa580bd69 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:01:11.635806 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] VM Stopped (Lifecycle Event)
May 21 02:01:11.763152 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:01:11.763152 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:01:11.763152 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:01:11.763152 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] No VIF found with MAC fa:16:3e:35:27:d3, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:01:11.784396 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Acquiring lock "refresh_cache-e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:01:11.864506 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-e74fe52e-1e83-4eab-a222-37f379cfddad req-df123121-2f6b-41e0-b0bf-6b7c114751ed service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:11.900126 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:01:11.901422 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:01:11.901643 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Creating image(s)
May 21 02:01:11.902539 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Acquiring lock "/opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:11.902539 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "/opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:11.905427 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "/opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:11.909959 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:01:11.920149 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:01:11.922348 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:11.960356 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-e74fe52e-1e83-4eab-a222-37f379cfddad req-df123121-2f6b-41e0-b0bf-6b7c114751ed service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:01:12.043722 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.123s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:12.044151 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:12.044657 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:12.045116 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:01:12.048106 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:01:12.048500 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:12.139547 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 6c48501b-d03d-40bc-aef5-450fa580bd69] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:01:12.140201 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.091s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:12.141386 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:12.175826 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-e74fe52e-1e83-4eab-a222-37f379cfddad req-df123121-2f6b-41e0-b0bf-6b7c114751ed service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:01:12.205718 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk 1073741824" returned: 0 in 0.065s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:12.206232 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.161s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:12.206671 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:12.295438 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-baf12ed5-48f2-461e-a64b-056fc2f30f84 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "392bbdc4-beaa-4c44-93f5-3a76f331ceb0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.572s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:12.330759 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.124s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:12.331162 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:01:12.331453 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:12.448551 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:12.450642 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Cannot resize image /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:01:12.452071 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:01:12.453888 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Ensure instance console log exists: /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:01:12.454367 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:12.454559 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:12.455121 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:12.679798 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e74fe52e-1e83-4eab-a222-37f379cfddad req-df123121-2f6b-41e0-b0bf-6b7c114751ed service nova] Releasing lock "refresh_cache-e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:01:12.682084 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Acquired lock "refresh_cache-e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:01:12.682320 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:01:13.129137 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-00ad94fe-ed71-41d2-ab2a-278181bc9157 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "0d75ff65-b688-4387-89e3-70567e569682" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:13.132197 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-00ad94fe-ed71-41d2-ab2a-278181bc9157 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "0d75ff65-b688-4387-89e3-70567e569682" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:13.132197 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-00ad94fe-ed71-41d2-ab2a-278181bc9157 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "0d75ff65-b688-4387-89e3-70567e569682-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:13.132197 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-00ad94fe-ed71-41d2-ab2a-278181bc9157 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "0d75ff65-b688-4387-89e3-70567e569682-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:13.132197 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-00ad94fe-ed71-41d2-ab2a-278181bc9157 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "0d75ff65-b688-4387-89e3-70567e569682-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:13.135214 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-00ad94fe-ed71-41d2-ab2a-278181bc9157 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Terminating instance
May 21 02:01:13.265226 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:01:13.376713 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-95d65112-71de-4625-99ef-025dac3c37ea tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "e9edec14-452b-46fe-89c6-849ece08f527" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.922s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:13.439123 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:13.588167 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Updating instance_info_cache with network_info: [{"id": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "address": "fa:16:3e:92:96:ee", "network": {"id": "acd0fbfa-f6d3-457c-a46f-cb55a0527d2b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-127865059-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "513057b933ef4779a2e885ae526782b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516875-8b", "ovs_interfaceid": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:01:13.640423 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-00ad94fe-ed71-41d2-ab2a-278181bc9157 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:01:13.707150 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:13.711168 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:13.738369 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:13.742187 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:13.774645 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:14.009637 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999671741000157 future=<Future at 0x71c0982e9460 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:01:14.012637 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Instance destroyed successfully.
May 21 02:01:14.012637 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-00ad94fe-ed71-41d2-ab2a-278181bc9157 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lazy-loading 'resources' on Instance uuid 0d75ff65-b688-4387-89e3-70567e569682 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:01:14.090458 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Releasing lock "refresh_cache-e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:01:14.092581 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Instance network_info: |[{"id": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "address": "fa:16:3e:92:96:ee", "network": {"id": "acd0fbfa-f6d3-457c-a46f-cb55a0527d2b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-127865059-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "513057b933ef4779a2e885ae526782b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516875-8b", "ovs_interfaceid": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:01:14.095209 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Start _get_guest_xml network_info=[{"id": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "address": "fa:16:3e:92:96:ee", "network": {"id": "acd0fbfa-f6d3-457c-a46f-cb55a0527d2b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-127865059-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "513057b933ef4779a2e885ae526782b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516875-8b", "ovs_interfaceid": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:01:14.101862 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:01:14.101862 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-381884727', uuid='e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2'), owner=OwnerMeta(userid='9c4b29ba15854339bc78b55da0b300da', username='tempest-ServerActionsTestOtherB-1655903174-project-member', projectid='513057b933ef4779a2e885ae526782b9', projectname='tempest-ServerActionsTestOtherB-1655903174'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "address": "fa:16:3e:92:96:ee", "network": {"id": "acd0fbfa-f6d3-457c-a46f-cb55a0527d2b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-127865059-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "513057b933ef4779a2e885ae526782b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516875-8b", "ovs_interfaceid": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328874.1011999) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:01:14.103186 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:01:14.103721 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:01:14.104732 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:01:14.106485 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:01:14.106485 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:01:14.106721 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:01:14.107037 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:01:14.107238 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:01:14.107482 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:01:14.107701 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:01:14.107902 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:01:14.108173 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:01:14.108379 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:01:14.108628 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:01:14.112279 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:01:14.112798 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:01:14.129503 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:01:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-381884727',display_name='tempest-ServerActionsTestOtherB-server-381884727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serveractionstestotherb-server-381884727',id=26,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLe1NRJOlGeHTlYSJiaM3PGrlo+7H9agLjrz4WfSrLuMOzPRjsAs6TJ8fG0Jtb2QDKUpaM4oEEkqECJm++HadkTr0S3iHGop0JxrI6HPofsIchSwvm0vHW+elldzycD14Q==',key_name='tempest-keypair-1287891018',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='513057b933ef4779a2e885ae526782b9',ramdisk_id='',reservation_id='r-xyowjbmv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1655903174',owner_user_name='tempest-ServerActionsTestOtherB-1655903174-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:01:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c4b29ba15854339bc78b55da0b300da',uuid=e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "address": "fa:16:3e:92:96:ee", "network": {"id": "acd0fbfa-f6d3-457c-a46f-cb55a0527d2b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-127865059-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "513057b933ef4779a2e885ae526782b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516875-8b", "ovs_interfaceid": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:01:14.129730 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Converting VIF {"id": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "address": "fa:16:3e:92:96:ee", "network": {"id": "acd0fbfa-f6d3-457c-a46f-cb55a0527d2b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-127865059-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "513057b933ef4779a2e885ae526782b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516875-8b", "ovs_interfaceid": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:01:14.130697 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:96:ee,bridge_name='br-int',has_traffic_filtering=True,id=76516875-8b8a-41f5-9a3f-b76d4c3cc02a,network=Network(acd0fbfa-f6d3-457c-a46f-cb55a0527d2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76516875-8b') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:01:14.131189 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lazy-loading 'pci_devices' on Instance uuid e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:01:14.514983 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-00ad94fe-ed71-41d2-ab2a-278181bc9157 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:58:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-598493742',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serverbootfromvolumestablerescuetest-server-598493742',id=12,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:58:21Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83df9a84ffaa4398bdafbfbde079964d',ramdisk_id='',reservation_id='r-m28dtruh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-260444396',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:58:31Z,user_data=None,user_id='bd5b969d5a514d01bacfc7954a5ae4ab',uuid=0d75ff65-b688-4387-89e3-70567e569682,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43f9f40a-cc12-40f7-8311-7fcb01148125", "address": "fa:16:3e:e3:f7:d2", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f9f40a-cc", "ovs_interfaceid": "43f9f40a-cc12-40f7-8311-7fcb01148125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:01:14.515350 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-00ad94fe-ed71-41d2-ab2a-278181bc9157 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Converting VIF {"id": "43f9f40a-cc12-40f7-8311-7fcb01148125", "address": "fa:16:3e:e3:f7:d2", "network": {"id": "b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208851288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83df9a84ffaa4398bdafbfbde079964d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f9f40a-cc", "ovs_interfaceid": "43f9f40a-cc12-40f7-8311-7fcb01148125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:01:14.516776 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-00ad94fe-ed71-41d2-ab2a-278181bc9157 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:f7:d2,bridge_name='br-int',has_traffic_filtering=True,id=43f9f40a-cc12-40f7-8311-7fcb01148125,network=Network(b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43f9f40a-cc') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:01:14.517071 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-00ad94fe-ed71-41d2-ab2a-278181bc9157 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:f7:d2,bridge_name='br-int',has_traffic_filtering=True,id=43f9f40a-cc12-40f7-8311-7fcb01148125,network=Network(b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43f9f40a-cc') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:01:14.527577 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:14.527899 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43f9f40a-cc, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:01:14.544306 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:14.545690 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:14.546396 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:01:14.548973 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:14.549821 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:14.550062 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=caba2666-b889-4131-b29d-82b5863c7071) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:01:14.551523 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:14.552526 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:01:14.554185 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:14.559668 np0000001127 nova-compute[98206]: INFO os_vif [None req-00ad94fe-ed71-41d2-ab2a-278181bc9157 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:f7:d2,bridge_name='br-int',has_traffic_filtering=True,id=43f9f40a-cc12-40f7-8311-7fcb01148125,network=Network(b4f7e4d2-e0bf-4abe-b785-63ce8e1899aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43f9f40a-cc')
May 21 02:01:14.559668 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-00ad94fe-ed71-41d2-ab2a-278181bc9157 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Deleting instance files /opt/stack/data/nova/instances/0d75ff65-b688-4387-89e3-70567e569682_del
May 21 02:01:14.563270 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-00ad94fe-ed71-41d2-ab2a-278181bc9157 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Deletion of /opt/stack/data/nova/instances/0d75ff65-b688-4387-89e3-70567e569682_del complete
May 21 02:01:14.635676 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] End _get_guest_xml xml=<domain type="qemu">
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:   <uuid>e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2</uuid>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:   <name>instance-0000001a</name>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:       <nova:name>tempest-ServerActionsTestOtherB-server-381884727</nova:name>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:01:14</nova:creationTime>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:         <nova:user uuid="9c4b29ba15854339bc78b55da0b300da">tempest-ServerActionsTestOtherB-1655903174-project-member</nova:user>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:         <nova:project uuid="513057b933ef4779a2e885ae526782b9">tempest-ServerActionsTestOtherB-1655903174</nova:project>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:         <nova:port uuid="76516875-8b8a-41f5-9a3f-b76d4c3cc02a">
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:     <system>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:       <entry name="serial">e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2</entry>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:       <entry name="uuid">e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2</entry>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:     </system>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:   <os>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:   </os>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:   <features>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:   </features>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:   <devices>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk"/>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:     </disk>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk.config"/>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:     </disk>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:92:96:ee"/>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:       <target dev="tap76516875-8b"/>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:     </interface>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/console.log" append="off"/>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:     </serial>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:     <video>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:     </video>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:     </rng>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:   </devices>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]: </domain>
May 21 02:01:14.635676 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:01:14.640034 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Preparing to wait for external event network-vif-plugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:01:14.640034 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Acquiring lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:14.640034 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:14.640034 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:14.640034 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:01:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-381884727',display_name='tempest-ServerActionsTestOtherB-server-381884727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serveractionstestotherb-server-381884727',id=26,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLe1NRJOlGeHTlYSJiaM3PGrlo+7H9agLjrz4WfSrLuMOzPRjsAs6TJ8fG0Jtb2QDKUpaM4oEEkqECJm++HadkTr0S3iHGop0JxrI6HPofsIchSwvm0vHW+elldzycD14Q==',key_name='tempest-keypair-1287891018',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='513057b933ef4779a2e885ae526782b9',ramdisk_id='',reservation_id='r-xyowjbmv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1655903174',owner_user_name='tempest-ServerActionsTestOtherB-1655903174-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:01:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c4b29ba15854339bc78b55da0b300da',uuid=e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "address": "fa:16:3e:92:96:ee", "network": {"id": "acd0fbfa-f6d3-457c-a46f-cb55a0527d2b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-127865059-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "513057b933ef4779a2e885ae526782b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516875-8b", "ovs_interfaceid": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:01:14.640034 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Converting VIF {"id": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "address": "fa:16:3e:92:96:ee", "network": {"id": "acd0fbfa-f6d3-457c-a46f-cb55a0527d2b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-127865059-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "513057b933ef4779a2e885ae526782b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516875-8b", "ovs_interfaceid": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:01:14.640034 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:96:ee,bridge_name='br-int',has_traffic_filtering=True,id=76516875-8b8a-41f5-9a3f-b76d4c3cc02a,network=Network(acd0fbfa-f6d3-457c-a46f-cb55a0527d2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76516875-8b') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:01:14.640034 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:96:ee,bridge_name='br-int',has_traffic_filtering=True,id=76516875-8b8a-41f5-9a3f-b76d4c3cc02a,network=Network(acd0fbfa-f6d3-457c-a46f-cb55a0527d2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76516875-8b') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:01:14.640034 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:14.640034 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:01:14.640034 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:01:14.640526 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:14.640526 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4093fd26-78b5-56da-b11c-c4d3b41edf68', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:01:14.641685 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:14.642708 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:01:14.643721 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:14.647507 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:14.647507 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76516875-8b, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:01:14.647872 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap76516875-8b, col_values=(('qos', UUID('d6f2141a-3d2f-4cb5-b161-20f2312ba424')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:01:14.648663 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap76516875-8b, col_values=(('external_ids', {'iface-id': '76516875-8b8a-41f5-9a3f-b76d4c3cc02a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:96:ee', 'vm-uuid': 'e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:01:14.650849 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:01:14.659131 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:14.660596 np0000001127 nova-compute[98206]: INFO os_vif [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:96:ee,bridge_name='br-int',has_traffic_filtering=True,id=76516875-8b8a-41f5-9a3f-b76d4c3cc02a,network=Network(acd0fbfa-f6d3-457c-a46f-cb55a0527d2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76516875-8b')
May 21 02:01:15.073510 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-00ad94fe-ed71-41d2-ab2a-278181bc9157 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Took 1.43 seconds to destroy the instance on the hypervisor.
May 21 02:01:15.074015 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-00ad94fe-ed71-41d2-ab2a-278181bc9157 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:01:15.074730 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:01:15.074730 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 0d75ff65-b688-4387-89e3-70567e569682] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:01:15.074730 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:15.192074 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:15.628642 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-af10a796-ad1a-4e24-8da6-f8b680f5a821 req-d327ea0e-1b8d-43a8-9e79-46fe03429a52 service nova] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Received event network-vif-deleted-43f9f40a-cc12-40f7-8311-7fcb01148125 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:01:15.630939 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-af10a796-ad1a-4e24-8da6-f8b680f5a821 req-d327ea0e-1b8d-43a8-9e79-46fe03429a52 service nova] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Neutron deleted interface 43f9f40a-cc12-40f7-8311-7fcb01148125; detaching it from the instance and deleting it from the info cache
May 21 02:01:15.630939 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-af10a796-ad1a-4e24-8da6-f8b680f5a821 req-d327ea0e-1b8d-43a8-9e79-46fe03429a52 service nova] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:01:16.000070 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:01:16.056791 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-015c879a-7b3f-40dd-8730-751a513870d3 req-50c3980d-92b5-4a95-977b-ac303d199d42 service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Received event network-changed-cbfb2d9f-c55f-4f12-8b0c-ce07a987798a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:01:16.056791 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-015c879a-7b3f-40dd-8730-751a513870d3 req-50c3980d-92b5-4a95-977b-ac303d199d42 service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Refreshing instance network info cache due to event network-changed-cbfb2d9f-c55f-4f12-8b0c-ce07a987798a. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:01:16.056791 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-015c879a-7b3f-40dd-8730-751a513870d3 req-50c3980d-92b5-4a95-977b-ac303d199d42 service nova] Acquiring lock "refresh_cache-e9edec14-452b-46fe-89c6-849ece08f527" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:01:16.056791 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-015c879a-7b3f-40dd-8730-751a513870d3 req-50c3980d-92b5-4a95-977b-ac303d199d42 service nova] Acquired lock "refresh_cache-e9edec14-452b-46fe-89c6-849ece08f527" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:01:16.056791 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-015c879a-7b3f-40dd-8730-751a513870d3 req-50c3980d-92b5-4a95-977b-ac303d199d42 service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Refreshing network info cache for port cbfb2d9f-c55f-4f12-8b0c-ce07a987798a {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:01:16.134219 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-af10a796-ad1a-4e24-8da6-f8b680f5a821 req-d327ea0e-1b8d-43a8-9e79-46fe03429a52 service nova] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Detach interface failed, port_id=43f9f40a-cc12-40f7-8311-7fcb01148125, reason: Instance 0d75ff65-b688-4387-89e3-70567e569682 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:01:16.194115 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:01:16.194284 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:01:16.194426 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] No VIF found with MAC fa:16:3e:92:96:ee, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:01:16.195015 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Using config drive
May 21 02:01:16.316492 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:16.506044 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Took 1.43 seconds to deallocate network for instance.
May 21 02:01:16.560112 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-015c879a-7b3f-40dd-8730-751a513870d3 req-50c3980d-92b5-4a95-977b-ac303d199d42 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:16.705518 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:16.916837 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Creating config drive at /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk.config
May 21 02:01:16.926900 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmph3kv6w60 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:17.001516 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmph3kv6w60" returned: 0 in 0.074s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:17.017443 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-00ad94fe-ed71-41d2-ab2a-278181bc9157 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:17.018087 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-00ad94fe-ed71-41d2-ab2a-278181bc9157 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:17.128707 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-015c879a-7b3f-40dd-8730-751a513870d3 req-50c3980d-92b5-4a95-977b-ac303d199d42 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:17.330483 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-015c879a-7b3f-40dd-8730-751a513870d3 req-50c3980d-92b5-4a95-977b-ac303d199d42 service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Updated VIF entry in instance network info cache for port cbfb2d9f-c55f-4f12-8b0c-ce07a987798a. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:01:17.331065 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-015c879a-7b3f-40dd-8730-751a513870d3 req-50c3980d-92b5-4a95-977b-ac303d199d42 service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Updating instance_info_cache with network_info: [{"id": "cbfb2d9f-c55f-4f12-8b0c-ce07a987798a", "address": "fa:16:3e:35:27:d3", "network": {"id": "7cdbc224-429f-49a6-86f3-307f51e53dfc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2078432126-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc797708a5a7400992765e41ee6ec260", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbfb2d9f-c5", "ovs_interfaceid": "cbfb2d9f-c55f-4f12-8b0c-ce07a987798a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:01:17.466582 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:17.497821 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:17.500294 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:17.517066 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-00ad94fe-ed71-41d2-ab2a-278181bc9157 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:01:17.517744 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-00ad94fe-ed71-41d2-ab2a-278181bc9157 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:01:17.593995 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:17.780567 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "df1fb869-23ef-48e0-b609-ce91c2540c2e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:17.780567 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:17.833919 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-015c879a-7b3f-40dd-8730-751a513870d3 req-50c3980d-92b5-4a95-977b-ac303d199d42 service nova] Releasing lock "refresh_cache-e9edec14-452b-46fe-89c6-849ece08f527" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:01:17.940801 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:17.943210 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:17.947793 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:17.972403 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:17.974297 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:18.022734 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-00ad94fe-ed71-41d2-ab2a-278181bc9157 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:01:18.220463 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6acaafe4-6d1c-4261-8d74-c20c20ebad2d req-e60a7abe-c3c0-4ff9-86b9-b16f10fa5feb service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Received event network-vif-plugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:01:18.220799 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6acaafe4-6d1c-4261-8d74-c20c20ebad2d req-e60a7abe-c3c0-4ff9-86b9-b16f10fa5feb service nova] Acquiring lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:18.221323 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6acaafe4-6d1c-4261-8d74-c20c20ebad2d req-e60a7abe-c3c0-4ff9-86b9-b16f10fa5feb service nova] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:18.221323 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6acaafe4-6d1c-4261-8d74-c20c20ebad2d req-e60a7abe-c3c0-4ff9-86b9-b16f10fa5feb service nova] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:18.221719 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6acaafe4-6d1c-4261-8d74-c20c20ebad2d req-e60a7abe-c3c0-4ff9-86b9-b16f10fa5feb service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Processing event network-vif-plugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:01:18.287102 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:01:18.536924 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-00ad94fe-ed71-41d2-ab2a-278181bc9157 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.519s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:18.560039 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328878.5595052, e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:01:18.560499 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:01:18.560499 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] VM Started (Lifecycle Event)
May 21 02:01:18.565378 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:01:18.569162 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Instance spawned successfully.
May 21 02:01:18.570365 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:01:18.669541 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-00ad94fe-ed71-41d2-ab2a-278181bc9157 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Deleted allocations for instance 0d75ff65-b688-4387-89e3-70567e569682
May 21 02:01:18.806512 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-369eea3c-672c-4924-8216-f07b5813818c req-cdc445f0-a2b0-4751-920d-0e61b6d7bfe7 service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Received event network-changed-cbfb2d9f-c55f-4f12-8b0c-ce07a987798a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:01:18.806512 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-369eea3c-672c-4924-8216-f07b5813818c req-cdc445f0-a2b0-4751-920d-0e61b6d7bfe7 service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Refreshing instance network info cache due to event network-changed-cbfb2d9f-c55f-4f12-8b0c-ce07a987798a. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:01:18.806512 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-369eea3c-672c-4924-8216-f07b5813818c req-cdc445f0-a2b0-4751-920d-0e61b6d7bfe7 service nova] Acquiring lock "refresh_cache-e9edec14-452b-46fe-89c6-849ece08f527" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:01:18.806512 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-369eea3c-672c-4924-8216-f07b5813818c req-cdc445f0-a2b0-4751-920d-0e61b6d7bfe7 service nova] Acquired lock "refresh_cache-e9edec14-452b-46fe-89c6-849ece08f527" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:01:18.806512 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-369eea3c-672c-4924-8216-f07b5813818c req-cdc445f0-a2b0-4751-920d-0e61b6d7bfe7 service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Refreshing network info cache for port cbfb2d9f-c55f-4f12-8b0c-ce07a987798a {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:01:18.859438 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:18.859782 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:18.865243 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:01:18.865810 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Claim successful on node np0000001127
May 21 02:01:19.067647 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:01:19.068877 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:01:19.078925 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:01:19.079057 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:01:19.079360 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:01:19.079651 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:01:19.079985 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:01:19.080339 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:01:19.290839 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-369eea3c-672c-4924-8216-f07b5813818c req-cdc445f0-a2b0-4751-920d-0e61b6d7bfe7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:19.332283 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Acquiring lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:19.332617 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:19.571524 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:01:19.571971 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328879.5715854, e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:01:19.571971 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] VM Paused (Lifecycle Event)
May 21 02:01:19.587821 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Took 7.69 seconds to spawn the instance on the hypervisor.
May 21 02:01:19.587996 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:01:19.651097 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:19.680343 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-00ad94fe-ed71-41d2-ab2a-278181bc9157 tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Lock "0d75ff65-b688-4387-89e3-70567e569682" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.550s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:19.705388 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-369eea3c-672c-4924-8216-f07b5813818c req-cdc445f0-a2b0-4751-920d-0e61b6d7bfe7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:19.837549 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:01:19.851984 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-369eea3c-672c-4924-8216-f07b5813818c req-cdc445f0-a2b0-4751-920d-0e61b6d7bfe7 service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Updated VIF entry in instance network info cache for port cbfb2d9f-c55f-4f12-8b0c-ce07a987798a. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:01:19.852290 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-369eea3c-672c-4924-8216-f07b5813818c req-cdc445f0-a2b0-4751-920d-0e61b6d7bfe7 service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Updating instance_info_cache with network_info: [{"id": "cbfb2d9f-c55f-4f12-8b0c-ce07a987798a", "address": "fa:16:3e:35:27:d3", "network": {"id": "7cdbc224-429f-49a6-86f3-307f51e53dfc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2078432126-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc797708a5a7400992765e41ee6ec260", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbfb2d9f-c5", "ovs_interfaceid": "cbfb2d9f-c55f-4f12-8b0c-ce07a987798a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:01:20.073987 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:01:20.075733 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328880.0755274, e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:01:20.075862 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] VM Resumed (Lifecycle Event)
May 21 02:01:20.096446 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Took 13.49 seconds to build instance.
May 21 02:01:20.292279 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8921c221-e45d-489e-89e8-b2477a723b59 req-ed972dac-dca2-42a9-8878-82bb0a145146 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Received event network-vif-plugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:01:20.292484 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8921c221-e45d-489e-89e8-b2477a723b59 req-ed972dac-dca2-42a9-8878-82bb0a145146 service nova] Acquiring lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:20.292633 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8921c221-e45d-489e-89e8-b2477a723b59 req-ed972dac-dca2-42a9-8878-82bb0a145146 service nova] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:20.292741 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8921c221-e45d-489e-89e8-b2477a723b59 req-ed972dac-dca2-42a9-8878-82bb0a145146 service nova] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:20.292843 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8921c221-e45d-489e-89e8-b2477a723b59 req-ed972dac-dca2-42a9-8878-82bb0a145146 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] No waiting events found dispatching network-vif-plugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:01:20.292980 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-8921c221-e45d-489e-89e8-b2477a723b59 req-ed972dac-dca2-42a9-8878-82bb0a145146 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Received unexpected event network-vif-plugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a for instance with vm_state active and task_state None.
May 21 02:01:20.346245 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:01:20.346416 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:01:20.354359 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-369eea3c-672c-4924-8216-f07b5813818c req-cdc445f0-a2b0-4751-920d-0e61b6d7bfe7 service nova] Releasing lock "refresh_cache-e9edec14-452b-46fe-89c6-849ece08f527" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:01:20.385634 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:20.578138 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:01:20.582210 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:01:20.600016 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.014s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:20.619251 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0005561939999552123 future=<Future at 0x71c0585b5ee0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:01:20.619490 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:01:20.619568 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=8.389737475000175 future=<Future at 0x71c0982e9460 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:01:20.619737 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=8.389597805999983 future=<Future at 0x71c0982e9460 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:01:20.620102 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Emitting event <LifecycleEvent: 1779328865.618489, 392bbdc4-beaa-4c44-93f5-3a76f331ceb0 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:01:20.620262 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] VM Stopped (Lifecycle Event)
May 21 02:01:20.848845 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:01:21.125447 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-897da0a5-7c00-42bd-8ea4-47f81048efec tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: 392bbdc4-beaa-4c44-93f5-3a76f331ceb0] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:01:21.318267 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:21.360102 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.500s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:21.365487 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.975s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:21.366163 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:01:21.372059 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:01:21.372229 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Claim successful on node np0000001127
May 21 02:01:21.889308 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:01:21.895599 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:01:21.895599 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:21.895599 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:21.940257 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:21.979569 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '640fad0f3dfe4ee99b04c12c2b8fd9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80cee8643f34f6685ff7fb42920afc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:01:22.377391 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0d4f17ea-412f-4ca3-88ea-e80a0f9f9b46 req-096455e3-2977-47bf-8db3-554aed04f7c4 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Received event network-changed-76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:01:22.377544 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0d4f17ea-412f-4ca3-88ea-e80a0f9f9b46 req-096455e3-2977-47bf-8db3-554aed04f7c4 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Refreshing instance network info cache due to event network-changed-76516875-8b8a-41f5-9a3f-b76d4c3cc02a. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:01:22.377670 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0d4f17ea-412f-4ca3-88ea-e80a0f9f9b46 req-096455e3-2977-47bf-8db3-554aed04f7c4 service nova] Acquiring lock "refresh_cache-e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:01:22.377755 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0d4f17ea-412f-4ca3-88ea-e80a0f9f9b46 req-096455e3-2977-47bf-8db3-554aed04f7c4 service nova] Acquired lock "refresh_cache-e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:01:22.377858 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-0d4f17ea-412f-4ca3-88ea-e80a0f9f9b46 req-096455e3-2977-47bf-8db3-554aed04f7c4 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Refreshing network info cache for port 76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:01:22.382251 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:01:22.558639 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Successfully created port: 397001b0-550b-43bb-8c99-269fa0d710bb {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:01:22.879726 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-0d4f17ea-412f-4ca3-88ea-e80a0f9f9b46 req-096455e3-2977-47bf-8db3-554aed04f7c4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:22.885542 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:01:22.978957 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:01:22.979320 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:01:23.357279 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-0d4f17ea-412f-4ca3-88ea-e80a0f9f9b46 req-096455e3-2977-47bf-8db3-554aed04f7c4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:23.388983 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Successfully updated port: 397001b0-550b-43bb-8c99-269fa0d710bb {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:01:23.461019 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e26d70d8-ab7b-413a-8be0-a6209e19562d req-d982df99-1417-4c12-adb5-d65aec501a8b service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Received event network-changed-397001b0-550b-43bb-8c99-269fa0d710bb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:01:23.461229 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e26d70d8-ab7b-413a-8be0-a6209e19562d req-d982df99-1417-4c12-adb5-d65aec501a8b service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Refreshing instance network info cache due to event network-changed-397001b0-550b-43bb-8c99-269fa0d710bb. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:01:23.461436 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e26d70d8-ab7b-413a-8be0-a6209e19562d req-d982df99-1417-4c12-adb5-d65aec501a8b service nova] Acquiring lock "refresh_cache-df1fb869-23ef-48e0-b609-ce91c2540c2e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:01:23.461594 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e26d70d8-ab7b-413a-8be0-a6209e19562d req-d982df99-1417-4c12-adb5-d65aec501a8b service nova] Acquired lock "refresh_cache-df1fb869-23ef-48e0-b609-ce91c2540c2e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:01:23.461721 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-e26d70d8-ab7b-413a-8be0-a6209e19562d req-d982df99-1417-4c12-adb5-d65aec501a8b service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Refreshing network info cache for port 397001b0-550b-43bb-8c99-269fa0d710bb {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:01:23.482635 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:01:23.518240 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-0d4f17ea-412f-4ca3-88ea-e80a0f9f9b46 req-096455e3-2977-47bf-8db3-554aed04f7c4 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Updated VIF entry in instance network info cache for port 76516875-8b8a-41f5-9a3f-b76d4c3cc02a. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:01:23.518535 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-0d4f17ea-412f-4ca3-88ea-e80a0f9f9b46 req-096455e3-2977-47bf-8db3-554aed04f7c4 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Updating instance_info_cache with network_info: [{"id": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "address": "fa:16:3e:92:96:ee", "network": {"id": "acd0fbfa-f6d3-457c-a46f-cb55a0527d2b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-127865059-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "513057b933ef4779a2e885ae526782b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516875-8b", "ovs_interfaceid": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:01:23.891725 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "refresh_cache-df1fb869-23ef-48e0-b609-ce91c2540c2e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:01:23.898263 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:01:23.899091 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:01:23.899325 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Creating image(s)
May 21 02:01:23.899758 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "/opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:23.899884 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "/opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:23.900319 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "/opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:23.900759 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:01:23.903524 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:01:23.904584 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:23.965197 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-e26d70d8-ab7b-413a-8be0-a6209e19562d req-d982df99-1417-4c12-adb5-d65aec501a8b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:23.990206 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.630s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:23.991058 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:01:24.003064 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.098s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:24.003595 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:24.007859 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:24.012160 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:01:24.019024 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:01:24.019454 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:24.065608 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0d4f17ea-412f-4ca3-88ea-e80a0f9f9b46 req-096455e3-2977-47bf-8db3-554aed04f7c4 service nova] Releasing lock "refresh_cache-e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:01:24.136541 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-e26d70d8-ab7b-413a-8be0-a6209e19562d req-d982df99-1417-4c12-adb5-d65aec501a8b service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:01:24.151184 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.132s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:24.151916 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:24.235519 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk 1073741824" returned: 0 in 0.083s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:24.236074 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:24.236484 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:24.290056 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Rebuilding instance
May 21 02:01:24.348356 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.112s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:24.349634 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Checking if we can resize image /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:01:24.349634 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:24.391978 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-e26d70d8-ab7b-413a-8be0-a6209e19562d req-d982df99-1417-4c12-adb5-d65aec501a8b service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:01:24.479710 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:24.480298 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Cannot resize image /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:01:24.480631 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:01:24.480793 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Ensure instance console log exists: /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:01:24.481218 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:24.481443 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:24.481594 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:24.499659 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:01:24.500060 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:01:24.500517 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:24.500879 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:24.565880 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:01:24.624327 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c14700a43e7e4c5eb6bbbbb14a135387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb7bdb5c7bbb4465b12c92ffdd425114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:01:24.653049 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:24.895687 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e26d70d8-ab7b-413a-8be0-a6209e19562d req-d982df99-1417-4c12-adb5-d65aec501a8b service nova] Releasing lock "refresh_cache-df1fb869-23ef-48e0-b609-ce91c2540c2e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:01:24.896520 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquired lock "refresh_cache-df1fb869-23ef-48e0-b609-ce91c2540c2e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:01:24.896715 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:01:25.003539 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:01:25.214930 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Successfully created port: c0e8bfdd-1ce7-47c4-a730-362b39289635 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:01:25.498402 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:01:25.507440 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:01:25.619198 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:25.645144 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:25.651100 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:25.679085 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:25.681925 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:25.841571 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:25.866147 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Successfully updated port: c0e8bfdd-1ce7-47c4-a730-362b39289635 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:01:25.893866 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8e7ac740-8a65-420d-abba-275d0b2ba354 req-447aa7b1-71e8-40b1-a0e3-6753a036b671 service nova] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Received event network-vif-unplugged-1b938e0e-b319-49b6-a973-0e80c89b92e6 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:01:25.894328 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8e7ac740-8a65-420d-abba-275d0b2ba354 req-447aa7b1-71e8-40b1-a0e3-6753a036b671 service nova] Acquiring lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:25.894552 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8e7ac740-8a65-420d-abba-275d0b2ba354 req-447aa7b1-71e8-40b1-a0e3-6753a036b671 service nova] Lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:25.894715 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8e7ac740-8a65-420d-abba-275d0b2ba354 req-447aa7b1-71e8-40b1-a0e3-6753a036b671 service nova] Lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:25.894901 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8e7ac740-8a65-420d-abba-275d0b2ba354 req-447aa7b1-71e8-40b1-a0e3-6753a036b671 service nova] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] No waiting events found dispatching network-vif-unplugged-1b938e0e-b319-49b6-a973-0e80c89b92e6 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:01:25.895070 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-8e7ac740-8a65-420d-abba-275d0b2ba354 req-447aa7b1-71e8-40b1-a0e3-6753a036b671 service nova] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Received unexpected event network-vif-unplugged-1b938e0e-b319-49b6-a973-0e80c89b92e6 for instance with vm_state active and task_state rebuilding.
May 21 02:01:25.944869 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.99957956000003 future=<Future at 0x71c07c50b1a0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:01:25.950963 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Instance destroyed successfully.
May 21 02:01:25.972050 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Instance destroyed successfully.
May 21 02:01:25.972050 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:00:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-692094759',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serveractionsv293testjson-server-1227980448',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdSLsNf05ft6B/PkgYJEgNxCPaotlaC+SYwLSyQfqbTHXXe3gCjns78xO/QDQw3uXc0vYQiJCLA0+VzLHhxlUHFht+sbUG63daZBfxAE+WcylLxkwBu6nkTH7iMalcD6A==',key_name='tempest-keypair-121683660',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:00:41Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9dde2f210a0e4debaa655c852b3621da',ramdisk_id='',reservation_id='r-3sc7d1ev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fea37df7-c5b0-431e-9e55-09d856a51ff9',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2031447781',owner_user_name='tempest-ServerActionsV293TestJSON-2031447781-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:01:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45d8378885514dd79b666ba5f5352716',uuid=44334b65-4382-4a2d-80f1-a1ae2cdfe1e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b938e0e-b319-49b6-a973-0e80c89b92e6", "address": "fa:16:3e:bc:04:20", "network": {"id": "effc5fd0-bb6d-41a3-aa93-0b65d17db1d9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2119568761-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dde2f210a0e4debaa655c852b3621da", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b938e0e-b3", "ovs_interfaceid": "1b938e0e-b319-49b6-a973-0e80c89b92e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:01:25.972050 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Converting VIF {"id": "1b938e0e-b319-49b6-a973-0e80c89b92e6", "address": "fa:16:3e:bc:04:20", "network": {"id": "effc5fd0-bb6d-41a3-aa93-0b65d17db1d9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2119568761-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dde2f210a0e4debaa655c852b3621da", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b938e0e-b3", "ovs_interfaceid": "1b938e0e-b319-49b6-a973-0e80c89b92e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:01:25.972584 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:04:20,bridge_name='br-int',has_traffic_filtering=True,id=1b938e0e-b319-49b6-a973-0e80c89b92e6,network=Network(effc5fd0-bb6d-41a3-aa93-0b65d17db1d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b938e0e-b3') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:01:25.973079 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:04:20,bridge_name='br-int',has_traffic_filtering=True,id=1b938e0e-b319-49b6-a973-0e80c89b92e6,network=Network(effc5fd0-bb6d-41a3-aa93-0b65d17db1d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b938e0e-b3') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:01:25.976317 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:25.978530 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b938e0e-b3, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:01:25.979787 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:25.981553 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:01:25.982202 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:25.982336 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b1d21ede-04cc-4d17-b54b-9fcf3bc21c4b) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:01:25.983850 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:25.989320 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:01:25.991287 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:25.994204 np0000001127 nova-compute[98206]: INFO os_vif [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:04:20,bridge_name='br-int',has_traffic_filtering=True,id=1b938e0e-b319-49b6-a973-0e80c89b92e6,network=Network(effc5fd0-bb6d-41a3-aa93-0b65d17db1d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b938e0e-b3')
May 21 02:01:25.998819 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:01:25.999175 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:01:25.999368 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:01:26.001447 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:01:26.001845 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:01:26.002211 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:01:26.013661 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Booting with volume e6372443-59c0-4c3c-93a4-2dc76f1369e4 at /dev/vda
May 21 02:01:26.048504 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:26.048504 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:26.048504 np0000001127 nova-compute[98206]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:01:26.048504 np0000001127 nova-compute[98206]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:01:26.048504 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:26.048504 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:26.048504 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:01:26.049252 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:26.049252 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:26.049252 np0000001127 nova-compute[98206]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:01:26.049252 np0000001127 nova-compute[98206]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:01:26.049252 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:26.049252 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:26.049252 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:01:26.050127 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', '50'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', '51'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6', '52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6', '53')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:01:26.050127 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', '51')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:01:26.051619 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', '50')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:01:26.053510 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c514720>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b'): ({'sdg'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:01:26.053753 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Removing multipathed devices sdg, sdf {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:01:26.054626 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Flush multipath device 330000000c2b561bb {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:01:26.100404 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:01:26.119850 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:01:26.144672 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:26.179492 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Updating instance_info_cache with network_info: [{"id": "397001b0-550b-43bb-8c99-269fa0d710bb", "address": "fa:16:3e:f4:b7:59", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397001b0-55", "ovs_interfaceid": "397001b0-550b-43bb-8c99-269fa0d710bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:01:26.200365 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:01:26.201273 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:01:26.212930 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:01:26.214636 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe9e:216', 'fe80::14d9:7bff:fe3b:f0dc', 'fe80::fc16:3eff:fe45:a237', 'fe80::fc16:3eff:fe35:27d3', 'fe80::a403:4dff:fe5a:1b07', 'fe80::fc16:3eff:fe02:b49e', 'fe80::f819:cdff:fe2b:de28', 'fe80::fc16:3eff:fe92:96ee', 'fe80::9c51:adff:febc:e222'] 
May 21 02:01:26.214829 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:01:26.214996 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:01:26.215300 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:01:26.215582 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Updating existing volume attachment record: 620f380a-af1d-4a73-b9a5-2a6cb4a6ed4d {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:01:26.320795 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:26.369401 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Acquiring lock "refresh_cache-23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:01:26.369401 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Acquired lock "refresh_cache-23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:01:26.370029 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:01:26.683619 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Releasing lock "refresh_cache-df1fb869-23ef-48e0-b609-ce91c2540c2e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:01:26.683818 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Instance network_info: |[{"id": "397001b0-550b-43bb-8c99-269fa0d710bb", "address": "fa:16:3e:f4:b7:59", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397001b0-55", "ovs_interfaceid": "397001b0-550b-43bb-8c99-269fa0d710bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:01:26.687131 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Start _get_guest_xml network_info=[{"id": "397001b0-550b-43bb-8c99-269fa0d710bb", "address": "fa:16:3e:f4:b7:59", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397001b0-55", "ovs_interfaceid": "397001b0-550b-43bb-8c99-269fa0d710bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:01:26.691345 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:01:26.693105 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-1160366387', uuid='df1fb869-23ef-48e0-b609-ce91c2540c2e'), owner=OwnerMeta(userid='640fad0f3dfe4ee99b04c12c2b8fd9dd', username='tempest-AttachVolumeTestJSON-2050140136-project-member', projectid='e80cee8643f34f6685ff7fb42920afc3', projectname='tempest-AttachVolumeTestJSON-2050140136'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "397001b0-550b-43bb-8c99-269fa0d710bb", "address": "fa:16:3e:f4:b7:59", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397001b0-55", "ovs_interfaceid": "397001b0-550b-43bb-8c99-269fa0d710bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328886.6925974) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:01:26.694318 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:01:26.694717 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:01:26.695935 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:01:26.695935 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:01:26.697302 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:01:26.697727 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:01:26.698663 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:01:26.698663 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:01:26.700403 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:01:26.700403 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:01:26.700403 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:01:26.700403 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:01:26.700735 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:01:26.700735 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:01:26.700864 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:01:26.701086 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:01:26.716724 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:01:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1160366387',display_name='tempest-AttachVolumeTestJSON-server-1160366387',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumetestjson-server-1160366387',id=27,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAujiHJsmhJMgEmRnWv5ymFbZbTAYncvgq9NsMeC8MiZ8la1gTOga8PrdaHkWknChauf3EhimnVrbr35Cl923XBy1BnVqXrs2rMVao3ITr2vCMWLpWOxbYc5JhA+8oEsw==',key_name='tempest-keypair-1825862747',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e80cee8643f34f6685ff7fb42920afc3',ramdisk_id='',reservation_id='r-td2yddno',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2050140136',owner_user_name='tempest-AttachVolumeTestJSON-2050140136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:01:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='640fad0f3dfe4ee99b04c12c2b8fd9dd',uuid=df1fb869-23ef-48e0-b609-ce91c2540c2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "397001b0-550b-43bb-8c99-269fa0d710bb", "address": "fa:16:3e:f4:b7:59", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397001b0-55", "ovs_interfaceid": "397001b0-550b-43bb-8c99-269fa0d710bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:01:26.716967 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Converting VIF {"id": "397001b0-550b-43bb-8c99-269fa0d710bb", "address": "fa:16:3e:f4:b7:59", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397001b0-55", "ovs_interfaceid": "397001b0-550b-43bb-8c99-269fa0d710bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:01:26.717773 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:b7:59,bridge_name='br-int',has_traffic_filtering=True,id=397001b0-550b-43bb-8c99-269fa0d710bb,network=Network(70a21e20-dfdf-49b9-bfd2-75a1f49c8a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397001b0-55') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:01:26.718458 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lazy-loading 'pci_devices' on Instance uuid df1fb869-23ef-48e0-b609-ce91c2540c2e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:01:26.912227 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:26.997582 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:01:27.222261 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] End _get_guest_xml xml=<domain type="qemu">
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:   <uuid>df1fb869-23ef-48e0-b609-ce91c2540c2e</uuid>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:   <name>instance-0000001b</name>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:       <nova:name>tempest-AttachVolumeTestJSON-server-1160366387</nova:name>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:01:26</nova:creationTime>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:         <nova:user uuid="640fad0f3dfe4ee99b04c12c2b8fd9dd">tempest-AttachVolumeTestJSON-2050140136-project-member</nova:user>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:         <nova:project uuid="e80cee8643f34f6685ff7fb42920afc3">tempest-AttachVolumeTestJSON-2050140136</nova:project>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:         <nova:port uuid="397001b0-550b-43bb-8c99-269fa0d710bb">
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:     <system>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:       <entry name="serial">df1fb869-23ef-48e0-b609-ce91c2540c2e</entry>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:       <entry name="uuid">df1fb869-23ef-48e0-b609-ce91c2540c2e</entry>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:     </system>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:   <os>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:   </os>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:   <features>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:   </features>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:   <devices>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk"/>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:     </disk>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk.config"/>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:     </disk>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:f4:b7:59"/>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:       <target dev="tap397001b0-55"/>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:     </interface>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/console.log" append="off"/>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:     </serial>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:     <video>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:     </video>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:     </rng>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:   </devices>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]: </domain>
May 21 02:01:27.222261 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:01:27.224353 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Preparing to wait for external event network-vif-plugged-397001b0-550b-43bb-8c99-269fa0d710bb {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:01:27.224353 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:27.224353 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:27.224353 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:27.224353 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:01:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1160366387',display_name='tempest-AttachVolumeTestJSON-server-1160366387',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumetestjson-server-1160366387',id=27,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAujiHJsmhJMgEmRnWv5ymFbZbTAYncvgq9NsMeC8MiZ8la1gTOga8PrdaHkWknChauf3EhimnVrbr35Cl923XBy1BnVqXrs2rMVao3ITr2vCMWLpWOxbYc5JhA+8oEsw==',key_name='tempest-keypair-1825862747',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e80cee8643f34f6685ff7fb42920afc3',ramdisk_id='',reservation_id='r-td2yddno',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2050140136',owner_user_name='tempest-AttachVolumeTestJSON-2050140136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:01:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='640fad0f3dfe4ee99b04c12c2b8fd9dd',uuid=df1fb869-23ef-48e0-b609-ce91c2540c2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "397001b0-550b-43bb-8c99-269fa0d710bb", "address": "fa:16:3e:f4:b7:59", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397001b0-55", "ovs_interfaceid": "397001b0-550b-43bb-8c99-269fa0d710bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:01:27.224353 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Converting VIF {"id": "397001b0-550b-43bb-8c99-269fa0d710bb", "address": "fa:16:3e:f4:b7:59", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397001b0-55", "ovs_interfaceid": "397001b0-550b-43bb-8c99-269fa0d710bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:01:27.224808 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:b7:59,bridge_name='br-int',has_traffic_filtering=True,id=397001b0-550b-43bb-8c99-269fa0d710bb,network=Network(70a21e20-dfdf-49b9-bfd2-75a1f49c8a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397001b0-55') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:01:27.225094 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:b7:59,bridge_name='br-int',has_traffic_filtering=True,id=397001b0-550b-43bb-8c99-269fa0d710bb,network=Network(70a21e20-dfdf-49b9-bfd2-75a1f49c8a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397001b0-55') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:01:27.225478 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:27.225746 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:01:27.225993 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:01:27.226847 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:27.227017 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '45865939-732d-5f56-85d7-bdddcc19598a', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:01:27.229606 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:27.232103 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:27.233503 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:01:27.238904 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:27.239097 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap397001b0-55, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:01:27.239561 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap397001b0-55, col_values=(('qos', UUID('42a5e9e3-127c-4bcf-b46b-b07c8266cd69')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:01:27.239782 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap397001b0-55, col_values=(('external_ids', {'iface-id': '397001b0-550b-43bb-8c99-269fa0d710bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:b7:59', 'vm-uuid': 'df1fb869-23ef-48e0-b609-ce91c2540c2e'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:01:27.240834 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:27.242518 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:01:27.251115 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:27.251115 np0000001127 nova-compute[98206]: INFO os_vif [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:b7:59,bridge_name='br-int',has_traffic_filtering=True,id=397001b0-550b-43bb-8c99-269fa0d710bb,network=Network(70a21e20-dfdf-49b9-bfd2-75a1f49c8a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397001b0-55')
May 21 02:01:27.386871 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Updating instance_info_cache with network_info: [{"id": "c0e8bfdd-1ce7-47c4-a730-362b39289635", "address": "fa:16:3e:41:22:0a", "network": {"id": "101a7f52-26cc-4331-b0f1-02b8c890fb35", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1092866296-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb7bdb5c7bbb4465b12c92ffdd425114", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0e8bfdd-1c", "ovs_interfaceid": "c0e8bfdd-1ce7-47c4-a730-362b39289635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:01:27.888999 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Releasing lock "refresh_cache-23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:01:27.889241 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Instance network_info: |[{"id": "c0e8bfdd-1ce7-47c4-a730-362b39289635", "address": "fa:16:3e:41:22:0a", "network": {"id": "101a7f52-26cc-4331-b0f1-02b8c890fb35", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1092866296-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb7bdb5c7bbb4465b12c92ffdd425114", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0e8bfdd-1c", "ovs_interfaceid": "c0e8bfdd-1ce7-47c4-a730-362b39289635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:01:27.958039 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-343ce8b6-e188-4060-bfe4-40a84dacb908 req-fb247d4d-25c2-4e41-8e54-932665caab05 service nova] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Received event network-changed-c0e8bfdd-1ce7-47c4-a730-362b39289635 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:01:27.958198 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-343ce8b6-e188-4060-bfe4-40a84dacb908 req-fb247d4d-25c2-4e41-8e54-932665caab05 service nova] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Refreshing instance network info cache due to event network-changed-c0e8bfdd-1ce7-47c4-a730-362b39289635. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:01:27.958437 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-343ce8b6-e188-4060-bfe4-40a84dacb908 req-fb247d4d-25c2-4e41-8e54-932665caab05 service nova] Acquiring lock "refresh_cache-23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:01:27.958566 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-343ce8b6-e188-4060-bfe4-40a84dacb908 req-fb247d4d-25c2-4e41-8e54-932665caab05 service nova] Acquired lock "refresh_cache-23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:01:27.958842 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-343ce8b6-e188-4060-bfe4-40a84dacb908 req-fb247d4d-25c2-4e41-8e54-932665caab05 service nova] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Refreshing network info cache for port c0e8bfdd-1ce7-47c4-a730-362b39289635 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:01:28.329491 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:01:28.329491 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:01:28.329491 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Creating image(s)
May 21 02:01:28.329491 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Did not create local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 21 02:01:28.329491 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Ensure instance console log exists: /opt/stack/data/nova/instances/23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:01:28.329491 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:28.329491 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:28.330387 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:28.330803 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Start _get_guest_xml network_info=[{"id": "c0e8bfdd-1ce7-47c4-a730-362b39289635", "address": "fa:16:3e:41:22:0a", "network": {"id": "101a7f52-26cc-4331-b0f1-02b8c890fb35", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1092866296-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb7bdb5c7bbb4465b12c92ffdd425114", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0e8bfdd-1c", "ovs_interfaceid": "c0e8bfdd-1ce7-47c4-a730-362b39289635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6372443-59c0-4c3c-93a4-2dc76f1369e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a', 'attached_at': '', 'detached_at': '', 'volume_id': 'e6372443-59c0-4c3c-93a4-2dc76f1369e4', 'serial': 'e6372443-59c0-4c3c-93a4-2dc76f1369e4'}, 'delete_on_termination': False, 'attachment_id': '620f380a-af1d-4a73-b9a5-2a6cb4a6ed4d', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:01:28.335812 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:01:28.336983 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestInstancesWithCinderVolumes-server-2131771438', uuid='23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a'), owner=OwnerMeta(userid='c14700a43e7e4c5eb6bbbbb14a135387', username='tempest-TestInstancesWithCinderVolumes-1975993015-project-member', projectid='cb7bdb5c7bbb4465b12c92ffdd425114', projectname='tempest-TestInstancesWithCinderVolumes-1975993015'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c0e8bfdd-1ce7-47c4-a730-362b39289635", "address": "fa:16:3e:41:22:0a", "network": {"id": "101a7f52-26cc-4331-b0f1-02b8c890fb35", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1092866296-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb7bdb5c7bbb4465b12c92ffdd425114", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0e8bfdd-1c", "ovs_interfaceid": "c0e8bfdd-1ce7-47c4-a730-362b39289635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328888.3366382) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:01:28.338074 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:01:28.339044 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:01:28.339949 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:01:28.340140 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:01:28.341013 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:01:28.341354 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:01:28.341556 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:01:28.341655 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:01:28.341768 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:01:28.341849 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:01:28.341949 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:01:28.342080 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:01:28.342168 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:01:28.342298 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:01:28.342396 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:01:28.342529 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:01:28.353630 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:01:28.353630 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6372443-59c0-4c3c-93a4-2dc76f1369e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:01:28.353630 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:01:28.460851 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-343ce8b6-e188-4060-bfe4-40a84dacb908 req-fb247d4d-25c2-4e41-8e54-932665caab05 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:28.736615 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-343ce8b6-e188-4060-bfe4-40a84dacb908 req-fb247d4d-25c2-4e41-8e54-932665caab05 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:28.766257 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:01:28.766492 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:01:28.766604 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] No VIF found with MAC fa:16:3e:f4:b7:59, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:01:28.767122 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Using config drive
May 21 02:01:28.875239 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-343ce8b6-e188-4060-bfe4-40a84dacb908 req-fb247d4d-25c2-4e41-8e54-932665caab05 service nova] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Updated VIF entry in instance network info cache for port c0e8bfdd-1ce7-47c4-a730-362b39289635. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:01:28.875497 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-343ce8b6-e188-4060-bfe4-40a84dacb908 req-fb247d4d-25c2-4e41-8e54-932665caab05 service nova] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Updating instance_info_cache with network_info: [{"id": "c0e8bfdd-1ce7-47c4-a730-362b39289635", "address": "fa:16:3e:41:22:0a", "network": {"id": "101a7f52-26cc-4331-b0f1-02b8c890fb35", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1092866296-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb7bdb5c7bbb4465b12c92ffdd425114", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0e8bfdd-1c", "ovs_interfaceid": "c0e8bfdd-1ce7-47c4-a730-362b39289635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:01:28.950013 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:29.010010 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0005024539998430555 future=<Future at 0x71c0982e9460 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:01:29.010355 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Emitting event <LifecycleEvent: 1779328874.009155, 0d75ff65-b688-4387-89e3-70567e569682 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:01:29.011578 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:01:29.011804 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] VM Stopped (Lifecycle Event)
May 21 02:01:29.015596 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=11.92873452699996 future=<Future at 0x71c07c50b1a0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:01:29.015683 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=11.928614274999973 future=<Future at 0x71c07c50b1a0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:01:29.279494 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:29.381497 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-343ce8b6-e188-4060-bfe4-40a84dacb908 req-fb247d4d-25c2-4e41-8e54-932665caab05 service nova] Releasing lock "refresh_cache-23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:01:29.381497 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-343ce8b6-e188-4060-bfe4-40a84dacb908 req-fb247d4d-25c2-4e41-8e54-932665caab05 service nova] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Received event network-vif-unplugged-1b938e0e-b319-49b6-a973-0e80c89b92e6 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:01:29.381497 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-343ce8b6-e188-4060-bfe4-40a84dacb908 req-fb247d4d-25c2-4e41-8e54-932665caab05 service nova] Acquiring lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:29.381497 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-343ce8b6-e188-4060-bfe4-40a84dacb908 req-fb247d4d-25c2-4e41-8e54-932665caab05 service nova] Lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:29.381497 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-343ce8b6-e188-4060-bfe4-40a84dacb908 req-fb247d4d-25c2-4e41-8e54-932665caab05 service nova] Lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:29.381497 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-343ce8b6-e188-4060-bfe4-40a84dacb908 req-fb247d4d-25c2-4e41-8e54-932665caab05 service nova] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] No waiting events found dispatching network-vif-unplugged-1b938e0e-b319-49b6-a973-0e80c89b92e6 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:01:29.381497 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-343ce8b6-e188-4060-bfe4-40a84dacb908 req-fb247d4d-25c2-4e41-8e54-932665caab05 service nova] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Received unexpected event network-vif-unplugged-1b938e0e-b319-49b6-a973-0e80c89b92e6 for instance with vm_state active and task_state rebuilding.
May 21 02:01:29.459270 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Creating config drive at /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk.config
May 21 02:01:29.466492 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2xqthnqz {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:29.515902 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-205bb4b7-4ea7-4022-891b-aec6b6307c61 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 0d75ff65-b688-4387-89e3-70567e569682] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:01:29.537017 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2xqthnqz" returned: 0 in 0.072s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:30.014316 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:30.042576 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:30.044763 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:30.141493 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:30.365329 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:30.367386 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:30.369521 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:30.370783 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:30.396332 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:30.922573 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328890.9217765, df1fb869-23ef-48e0-b609-ce91c2540c2e => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:01:30.922573 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] VM Started (Lifecycle Event)
May 21 02:01:30.967225 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "e158490e-746e-4c3b-924e-9aceed1662d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:30.967225 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "e158490e-746e-4c3b-924e-9aceed1662d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:31.054504 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5fb193fa-ee6b-495e-8349-7388e87127ec tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "e9edec14-452b-46fe-89c6-849ece08f527" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:31.054504 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5fb193fa-ee6b-495e-8349-7388e87127ec tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "e9edec14-452b-46fe-89c6-849ece08f527" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:31.054504 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-5fb193fa-ee6b-495e-8349-7388e87127ec tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Rebooting instance
May 21 02:01:31.323162 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:31.424996 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:01:31.426928 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328891.4266503, df1fb869-23ef-48e0-b609-ce91c2540c2e => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:01:31.427080 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] VM Paused (Lifecycle Event)
May 21 02:01:31.469073 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:01:31.626073 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5fb193fa-ee6b-495e-8349-7388e87127ec tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "refresh_cache-e9edec14-452b-46fe-89c6-849ece08f527" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:01:31.626276 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5fb193fa-ee6b-495e-8349-7388e87127ec tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquired lock "refresh_cache-e9edec14-452b-46fe-89c6-849ece08f527" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:01:31.626475 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-5fb193fa-ee6b-495e-8349-7388e87127ec tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:01:31.783780 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "e95baab0-2c43-4653-b7ae-b9d8920aba33" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:31.784594 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "e95baab0-2c43-4653-b7ae-b9d8920aba33" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:31.929492 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:01:31.934145 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:01:32.031897 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:32.031897 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:32.034879 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:01:32.035426 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Claim successful on node np0000001127
May 21 02:01:32.130099 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-5fb193fa-ee6b-495e-8349-7388e87127ec tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:32.257735 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:32.285977 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:01:32.439002 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:01:32.488411 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-5fb193fa-ee6b-495e-8349-7388e87127ec tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:32.623200 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-5fb193fa-ee6b-495e-8349-7388e87127ec tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Updating instance_info_cache with network_info: [{"id": "cbfb2d9f-c55f-4f12-8b0c-ce07a987798a", "address": "fa:16:3e:35:27:d3", "network": {"id": "7cdbc224-429f-49a6-86f3-307f51e53dfc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2078432126-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc797708a5a7400992765e41ee6ec260", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbfb2d9f-c5", "ovs_interfaceid": "cbfb2d9f-c55f-4f12-8b0c-ce07a987798a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:01:32.837551 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:33.127735 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5fb193fa-ee6b-495e-8349-7388e87127ec tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Releasing lock "refresh_cache-e9edec14-452b-46fe-89c6-849ece08f527" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:01:33.575059 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:01:33.575403 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:01:33.631288 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-5fb193fa-ee6b-495e-8349-7388e87127ec tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:01:34.078240 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:01:34.585141 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.553s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:34.585685 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.748s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:34.585888 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:01:34.597040 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:01:34.597237 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Claim successful on node np0000001127
May 21 02:01:34.781768 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d978817d-31c8-4d9d-b6ff-d85d44761e38 req-b14d5a85-fb9d-418a-9f34-916d44a78e69 service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Received event network-vif-plugged-397001b0-550b-43bb-8c99-269fa0d710bb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:01:34.783484 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d978817d-31c8-4d9d-b6ff-d85d44761e38 req-b14d5a85-fb9d-418a-9f34-916d44a78e69 service nova] Acquiring lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:34.783484 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d978817d-31c8-4d9d-b6ff-d85d44761e38 req-b14d5a85-fb9d-418a-9f34-916d44a78e69 service nova] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:34.783484 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d978817d-31c8-4d9d-b6ff-d85d44761e38 req-b14d5a85-fb9d-418a-9f34-916d44a78e69 service nova] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:34.783484 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d978817d-31c8-4d9d-b6ff-d85d44761e38 req-b14d5a85-fb9d-418a-9f34-916d44a78e69 service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Processing event network-vif-plugged-397001b0-550b-43bb-8c99-269fa0d710bb {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:01:34.784058 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Instance event wait completed in 3 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:01:34.792115 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328894.7914555, df1fb869-23ef-48e0-b609-ce91c2540c2e => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:01:34.792423 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:01:34.794535 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] VM Resumed (Lifecycle Event)
May 21 02:01:34.799760 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Instance spawned successfully.
May 21 02:01:34.799760 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:01:35.104936 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:01:35.104936 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:01:35.105269 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:35.105457 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:35.190928 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8b5074a8e47b444cb19c7dcf761ac2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87eb25eb23724c49b5bdbc462a1f36bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:01:35.295723 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:01:35.297949 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:01:35.304768 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:01:35.305063 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:01:35.305417 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:01:35.307493 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:01:35.307493 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:01:35.307493 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:01:35.605125 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:01:35.716669 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Successfully created port: 0298cd31-6bbc-4653-a4ac-8d9b5def1753 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:01:35.805382 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:01:35.814633 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Took 11.92 seconds to spawn the instance on the hypervisor.
May 21 02:01:35.815075 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:01:36.108804 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:01:36.246140 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:01:36.246434 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:01:36.327310 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:36.329671 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Took 17.54 seconds to build instance.
May 21 02:01:36.420334 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Successfully updated port: 0298cd31-6bbc-4653-a4ac-8d9b5def1753 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:01:36.750077 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:01:36.832587 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.051s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:36.862164 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6081dead-af3f-4ec6-b6b2-f7d22326683e req-785000d9-2cd1-4274-8c35-f172b60905e0 service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Received event network-vif-plugged-397001b0-550b-43bb-8c99-269fa0d710bb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:01:36.862378 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6081dead-af3f-4ec6-b6b2-f7d22326683e req-785000d9-2cd1-4274-8c35-f172b60905e0 service nova] Acquiring lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:36.862582 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6081dead-af3f-4ec6-b6b2-f7d22326683e req-785000d9-2cd1-4274-8c35-f172b60905e0 service nova] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:36.862715 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6081dead-af3f-4ec6-b6b2-f7d22326683e req-785000d9-2cd1-4274-8c35-f172b60905e0 service nova] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:36.862864 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6081dead-af3f-4ec6-b6b2-f7d22326683e req-785000d9-2cd1-4274-8c35-f172b60905e0 service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] No waiting events found dispatching network-vif-plugged-397001b0-550b-43bb-8c99-269fa0d710bb {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:01:36.863019 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-6081dead-af3f-4ec6-b6b2-f7d22326683e req-785000d9-2cd1-4274-8c35-f172b60905e0 service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Received unexpected event network-vif-plugged-397001b0-550b-43bb-8c99-269fa0d710bb for instance with vm_state active and task_state None.
May 21 02:01:36.863156 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6081dead-af3f-4ec6-b6b2-f7d22326683e req-785000d9-2cd1-4274-8c35-f172b60905e0 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Received event network-changed-0298cd31-6bbc-4653-a4ac-8d9b5def1753 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:01:36.863391 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6081dead-af3f-4ec6-b6b2-f7d22326683e req-785000d9-2cd1-4274-8c35-f172b60905e0 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Refreshing instance network info cache due to event network-changed-0298cd31-6bbc-4653-a4ac-8d9b5def1753. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:01:36.863522 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6081dead-af3f-4ec6-b6b2-f7d22326683e req-785000d9-2cd1-4274-8c35-f172b60905e0 service nova] Acquiring lock "refresh_cache-e158490e-746e-4c3b-924e-9aceed1662d0" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:01:36.863622 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6081dead-af3f-4ec6-b6b2-f7d22326683e req-785000d9-2cd1-4274-8c35-f172b60905e0 service nova] Acquired lock "refresh_cache-e158490e-746e-4c3b-924e-9aceed1662d0" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:01:36.864152 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-6081dead-af3f-4ec6-b6b2-f7d22326683e req-785000d9-2cd1-4274-8c35-f172b60905e0 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Refreshing network info cache for port 0298cd31-6bbc-4653-a4ac-8d9b5def1753 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:01:36.922390 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "refresh_cache-e158490e-746e-4c3b-924e-9aceed1662d0" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:01:37.095790 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:37.099016 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:37.120947 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:01:37.126192 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:01:37.126192 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Creating image(s)
May 21 02:01:37.126192 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "/opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:37.126192 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "/opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:37.126192 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "/opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:37.127347 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:01:37.131535 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:37.135171 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:01:37.138197 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:37.161951 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:37.260177 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.675s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:37.263960 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:01:37.271125 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:37.272371 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.135s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:37.273007 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:37.273653 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:37.274525 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:01:37.280019 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:01:37.280617 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:37.366865 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-6081dead-af3f-4ec6-b6b2-f7d22326683e req-785000d9-2cd1-4274-8c35-f172b60905e0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:37.412143 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.131s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:37.412724 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:37.439120 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:37.444687 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:37.485501 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999395188000108 future=<Future at 0x71c0585c9b20 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:01:37.501002 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/disk 1073741824" returned: 0 in 0.088s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:37.501814 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:37.502530 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:37.532272 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-6081dead-af3f-4ec6-b6b2-f7d22326683e req-785000d9-2cd1-4274-8c35-f172b60905e0 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:01:37.621106 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.118s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:37.623123 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:01:37.623455 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:37.664221 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-5fb193fa-ee6b-495e-8349-7388e87127ec tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Instance shutdown successfully.
May 21 02:01:37.728078 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:37.728692 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Cannot resize image /opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:01:37.728992 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:01:37.729222 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Ensure instance console log exists: /opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:01:37.730172 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:37.730412 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:37.730556 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:37.763703 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-6081dead-af3f-4ec6-b6b2-f7d22326683e req-785000d9-2cd1-4274-8c35-f172b60905e0 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:01:37.779497 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:01:37.779497 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:01:37.779760 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:37.780125 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:37.890316 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8b5074a8e47b444cb19c7dcf761ac2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87eb25eb23724c49b5bdbc462a1f36bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:01:37.991190 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a3827cc0-13ca-4be5-9e3b-68b02b6687c7 req-ad031895-1f4b-4e6e-ac68-96b5deb539f6 service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Received event network-changed-397001b0-550b-43bb-8c99-269fa0d710bb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:01:37.993272 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a3827cc0-13ca-4be5-9e3b-68b02b6687c7 req-ad031895-1f4b-4e6e-ac68-96b5deb539f6 service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Refreshing instance network info cache due to event network-changed-397001b0-550b-43bb-8c99-269fa0d710bb. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:01:37.993272 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a3827cc0-13ca-4be5-9e3b-68b02b6687c7 req-ad031895-1f4b-4e6e-ac68-96b5deb539f6 service nova] Acquiring lock "refresh_cache-df1fb869-23ef-48e0-b609-ce91c2540c2e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:01:37.993272 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a3827cc0-13ca-4be5-9e3b-68b02b6687c7 req-ad031895-1f4b-4e6e-ac68-96b5deb539f6 service nova] Acquired lock "refresh_cache-df1fb869-23ef-48e0-b609-ce91c2540c2e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:01:37.993527 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-a3827cc0-13ca-4be5-9e3b-68b02b6687c7 req-ad031895-1f4b-4e6e-ac68-96b5deb539f6 service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Refreshing network info cache for port 397001b0-550b-43bb-8c99-269fa0d710bb {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:01:38.197786 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:38.225989 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:38.267574 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6081dead-af3f-4ec6-b6b2-f7d22326683e req-785000d9-2cd1-4274-8c35-f172b60905e0 service nova] Releasing lock "refresh_cache-e158490e-746e-4c3b-924e-9aceed1662d0" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:01:38.269199 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquired lock "refresh_cache-e158490e-746e-4c3b-924e-9aceed1662d0" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:01:38.269199 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:01:38.283906 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:01:38.319083 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:38.465000 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Successfully created port: 3b74538b-3b3e-42f5-8f10-612c9d85b221 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:01:38.497213 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-a3827cc0-13ca-4be5-9e3b-68b02b6687c7 req-ad031895-1f4b-4e6e-ac68-96b5deb539f6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:38.641276 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:38.653547 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:38.684578 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:38.791735 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:01:38.895611 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:01:38.972222 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8576e534-e457-4fd4-89d9-3afcaaa6a51a req-b437fe73-60e8-43b7-aad3-de73fbe70adb service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Received event network-vif-unplugged-cbfb2d9f-c55f-4f12-8b0c-ce07a987798a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:01:38.972610 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8576e534-e457-4fd4-89d9-3afcaaa6a51a req-b437fe73-60e8-43b7-aad3-de73fbe70adb service nova] Acquiring lock "e9edec14-452b-46fe-89c6-849ece08f527-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:38.972694 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8576e534-e457-4fd4-89d9-3afcaaa6a51a req-b437fe73-60e8-43b7-aad3-de73fbe70adb service nova] Lock "e9edec14-452b-46fe-89c6-849ece08f527-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:38.973005 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8576e534-e457-4fd4-89d9-3afcaaa6a51a req-b437fe73-60e8-43b7-aad3-de73fbe70adb service nova] Lock "e9edec14-452b-46fe-89c6-849ece08f527-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:38.973084 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8576e534-e457-4fd4-89d9-3afcaaa6a51a req-b437fe73-60e8-43b7-aad3-de73fbe70adb service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] No waiting events found dispatching network-vif-unplugged-cbfb2d9f-c55f-4f12-8b0c-ce07a987798a {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:01:38.973259 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-8576e534-e457-4fd4-89d9-3afcaaa6a51a req-b437fe73-60e8-43b7-aad3-de73fbe70adb service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Received unexpected event network-vif-unplugged-cbfb2d9f-c55f-4f12-8b0c-ce07a987798a for instance with vm_state active and task_state reboot_started.
May 21 02:01:38.973383 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8576e534-e457-4fd4-89d9-3afcaaa6a51a req-b437fe73-60e8-43b7-aad3-de73fbe70adb service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Received event network-vif-unplugged-cbfb2d9f-c55f-4f12-8b0c-ce07a987798a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:01:38.974115 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8576e534-e457-4fd4-89d9-3afcaaa6a51a req-b437fe73-60e8-43b7-aad3-de73fbe70adb service nova] Acquiring lock "e9edec14-452b-46fe-89c6-849ece08f527-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:38.974315 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8576e534-e457-4fd4-89d9-3afcaaa6a51a req-b437fe73-60e8-43b7-aad3-de73fbe70adb service nova] Lock "e9edec14-452b-46fe-89c6-849ece08f527-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:38.974485 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8576e534-e457-4fd4-89d9-3afcaaa6a51a req-b437fe73-60e8-43b7-aad3-de73fbe70adb service nova] Lock "e9edec14-452b-46fe-89c6-849ece08f527-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:38.975281 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8576e534-e457-4fd4-89d9-3afcaaa6a51a req-b437fe73-60e8-43b7-aad3-de73fbe70adb service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] No waiting events found dispatching network-vif-unplugged-cbfb2d9f-c55f-4f12-8b0c-ce07a987798a {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:01:38.976201 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-8576e534-e457-4fd4-89d9-3afcaaa6a51a req-b437fe73-60e8-43b7-aad3-de73fbe70adb service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Received unexpected event network-vif-unplugged-cbfb2d9f-c55f-4f12-8b0c-ce07a987798a for instance with vm_state active and task_state reboot_started.
May 21 02:01:38.976201 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8576e534-e457-4fd4-89d9-3afcaaa6a51a req-b437fe73-60e8-43b7-aad3-de73fbe70adb service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Received event network-vif-plugged-cbfb2d9f-c55f-4f12-8b0c-ce07a987798a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:01:38.977240 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8576e534-e457-4fd4-89d9-3afcaaa6a51a req-b437fe73-60e8-43b7-aad3-de73fbe70adb service nova] Acquiring lock "e9edec14-452b-46fe-89c6-849ece08f527-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:38.977240 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8576e534-e457-4fd4-89d9-3afcaaa6a51a req-b437fe73-60e8-43b7-aad3-de73fbe70adb service nova] Lock "e9edec14-452b-46fe-89c6-849ece08f527-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:38.977240 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8576e534-e457-4fd4-89d9-3afcaaa6a51a req-b437fe73-60e8-43b7-aad3-de73fbe70adb service nova] Lock "e9edec14-452b-46fe-89c6-849ece08f527-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:38.977569 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8576e534-e457-4fd4-89d9-3afcaaa6a51a req-b437fe73-60e8-43b7-aad3-de73fbe70adb service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] No waiting events found dispatching network-vif-plugged-cbfb2d9f-c55f-4f12-8b0c-ce07a987798a {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:01:38.977569 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-8576e534-e457-4fd4-89d9-3afcaaa6a51a req-b437fe73-60e8-43b7-aad3-de73fbe70adb service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Received unexpected event network-vif-plugged-cbfb2d9f-c55f-4f12-8b0c-ce07a987798a for instance with vm_state active and task_state reboot_started.
May 21 02:01:38.977907 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8576e534-e457-4fd4-89d9-3afcaaa6a51a req-b437fe73-60e8-43b7-aad3-de73fbe70adb service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Received event network-vif-plugged-cbfb2d9f-c55f-4f12-8b0c-ce07a987798a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:01:38.977907 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8576e534-e457-4fd4-89d9-3afcaaa6a51a req-b437fe73-60e8-43b7-aad3-de73fbe70adb service nova] Acquiring lock "e9edec14-452b-46fe-89c6-849ece08f527-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:38.978830 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8576e534-e457-4fd4-89d9-3afcaaa6a51a req-b437fe73-60e8-43b7-aad3-de73fbe70adb service nova] Lock "e9edec14-452b-46fe-89c6-849ece08f527-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:38.980125 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8576e534-e457-4fd4-89d9-3afcaaa6a51a req-b437fe73-60e8-43b7-aad3-de73fbe70adb service nova] Lock "e9edec14-452b-46fe-89c6-849ece08f527-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:38.981734 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8576e534-e457-4fd4-89d9-3afcaaa6a51a req-b437fe73-60e8-43b7-aad3-de73fbe70adb service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] No waiting events found dispatching network-vif-plugged-cbfb2d9f-c55f-4f12-8b0c-ce07a987798a {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:01:38.982067 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-8576e534-e457-4fd4-89d9-3afcaaa6a51a req-b437fe73-60e8-43b7-aad3-de73fbe70adb service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Received unexpected event network-vif-plugged-cbfb2d9f-c55f-4f12-8b0c-ce07a987798a for instance with vm_state active and task_state reboot_started.
May 21 02:01:39.121720 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-a3827cc0-13ca-4be5-9e3b-68b02b6687c7 req-ad031895-1f4b-4e6e-ac68-96b5deb539f6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:39.145505 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:39.208299 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Successfully updated port: 3b74538b-3b3e-42f5-8f10-612c9d85b221 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:01:39.304653 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Removed pending STOPPED event for e9edec14-452b-46fe-89c6-849ece08f527 due to new event <LifecycleEvent: 1779328899.3041887, e9edec14-452b-46fe-89c6-849ece08f527 => Resumed> {{(pid=98206) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 21 02:01:39.304855 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328899.3041887, e9edec14-452b-46fe-89c6-849ece08f527 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:01:39.304986 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e9edec14-452b-46fe-89c6-849ece08f527] VM Resumed (Lifecycle Event)
May 21 02:01:39.318260 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-a3827cc0-13ca-4be5-9e3b-68b02b6687c7 req-ad031895-1f4b-4e6e-ac68-96b5deb539f6 service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Updated VIF entry in instance network info cache for port 397001b0-550b-43bb-8c99-269fa0d710bb. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:01:39.318919 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-a3827cc0-13ca-4be5-9e3b-68b02b6687c7 req-ad031895-1f4b-4e6e-ac68-96b5deb539f6 service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Updating instance_info_cache with network_info: [{"id": "397001b0-550b-43bb-8c99-269fa0d710bb", "address": "fa:16:3e:f4:b7:59", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397001b0-55", "ovs_interfaceid": "397001b0-550b-43bb-8c99-269fa0d710bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:01:39.330833 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Instance running successfully.
May 21 02:01:39.331191 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-5fb193fa-ee6b-495e-8349-7388e87127ec tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Instance soft rebooted successfully.
May 21 02:01:39.331393 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-5fb193fa-ee6b-495e-8349-7388e87127ec tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:01:39.344587 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Updating instance_info_cache with network_info: [{"id": "0298cd31-6bbc-4653-a4ac-8d9b5def1753", "address": "fa:16:3e:60:a6:12", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0298cd31-6b", "ovs_interfaceid": "0298cd31-6bbc-4653-a4ac-8d9b5def1753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:01:39.711821 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "refresh_cache-e95baab0-2c43-4653-b7ae-b9d8920aba33" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:01:39.712021 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquired lock "refresh_cache-e95baab0-2c43-4653-b7ae-b9d8920aba33" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:01:39.712101 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:01:39.824256 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:01:39.826347 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:01:39.829031 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a3827cc0-13ca-4be5-9e3b-68b02b6687c7 req-ad031895-1f4b-4e6e-ac68-96b5deb539f6 service nova] Releasing lock "refresh_cache-df1fb869-23ef-48e0-b609-ce91c2540c2e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:01:39.830840 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:01:39.835359 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:01:39.837320 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Creating image(s)
May 21 02:01:39.837320 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "/opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:39.837320 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "/opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:39.839164 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "/opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:39.839590 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5fb193fa-ee6b-495e-8349-7388e87127ec tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "e9edec14-452b-46fe-89c6-849ece08f527" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.786s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:39.841426 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:01:39.848131 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:01:39.850781 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Releasing lock "refresh_cache-e158490e-746e-4c3b-924e-9aceed1662d0" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:01:39.851451 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Instance network_info: |[{"id": "0298cd31-6bbc-4653-a4ac-8d9b5def1753", "address": "fa:16:3e:60:a6:12", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0298cd31-6b", "ovs_interfaceid": "0298cd31-6bbc-4653-a4ac-8d9b5def1753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:01:39.853970 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Start _get_guest_xml network_info=[{"id": "0298cd31-6bbc-4653-a4ac-8d9b5def1753", "address": "fa:16:3e:60:a6:12", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0298cd31-6b", "ovs_interfaceid": "0298cd31-6bbc-4653-a4ac-8d9b5def1753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:01:39.854902 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:39.873684 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:01:39.876918 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1853847854', uuid='e158490e-746e-4c3b-924e-9aceed1662d0'), owner=OwnerMeta(userid='8b5074a8e47b444cb19c7dcf761ac2ae', username='tempest-ServerRescueNegativeTestJSON-1108613901-project-member', projectid='87eb25eb23724c49b5bdbc462a1f36bc', projectname='tempest-ServerRescueNegativeTestJSON-1108613901'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0298cd31-6bbc-4653-a4ac-8d9b5def1753", "address": "fa:16:3e:60:a6:12", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0298cd31-6b", "ovs_interfaceid": "0298cd31-6bbc-4653-a4ac-8d9b5def1753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328899.875969) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:01:39.879259 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:01:39.879690 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:01:39.881320 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:01:39.881484 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:01:39.882815 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:01:39.883280 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:01:39.883486 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:01:39.883657 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:01:39.883828 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:01:39.883970 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:01:39.884066 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:01:39.884318 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:01:39.884431 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:01:39.884646 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:01:39.884759 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:01:39.884937 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:01:39.901876 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:01:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1853847854',display_name='tempest-ServerRescueNegativeTestJSON-server-1853847854',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serverrescuenegativetestjson-server-1853847854',id=29,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87eb25eb23724c49b5bdbc462a1f36bc',ramdisk_id='',reservation_id='r-bkabzv7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1108613901',owner_user_name='tempest-ServerRescueNegativeTestJSON-1108613901-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:01:36Z,user_data=None,user_id='8b5074a8e47b444cb19c7dcf761ac2ae',uuid=e158490e-746e-4c3b-924e-9aceed1662d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0298cd31-6bbc-4653-a4ac-8d9b5def1753", "address": "fa:16:3e:60:a6:12", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0298cd31-6b", "ovs_interfaceid": "0298cd31-6bbc-4653-a4ac-8d9b5def1753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:01:39.902152 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Converting VIF {"id": "0298cd31-6bbc-4653-a4ac-8d9b5def1753", "address": "fa:16:3e:60:a6:12", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0298cd31-6b", "ovs_interfaceid": "0298cd31-6bbc-4653-a4ac-8d9b5def1753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:01:39.903046 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:a6:12,bridge_name='br-int',has_traffic_filtering=True,id=0298cd31-6bbc-4653-a4ac-8d9b5def1753,network=Network(b8fcc592-f44d-440d-b1f1-c57714291c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0298cd31-6b') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:01:39.904014 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lazy-loading 'pci_devices' on Instance uuid e158490e-746e-4c3b-924e-9aceed1662d0 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:01:39.950001 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.096s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:39.953656 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:39.953656 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:39.953656 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:01:39.956187 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:01:39.956805 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:40.062036 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.105s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:40.064211 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-3d6cd02b-5649-4b22-8370-97826c59e837 req-9ac7b9b6-955b-4bb2-8767-12876afeef75 service nova] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Received event network-changed-3b74538b-3b3e-42f5-8f10-612c9d85b221 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:01:40.064406 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-3d6cd02b-5649-4b22-8370-97826c59e837 req-9ac7b9b6-955b-4bb2-8767-12876afeef75 service nova] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Refreshing instance network info cache due to event network-changed-3b74538b-3b3e-42f5-8f10-612c9d85b221. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:01:40.064866 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-3d6cd02b-5649-4b22-8370-97826c59e837 req-9ac7b9b6-955b-4bb2-8767-12876afeef75 service nova] Acquiring lock "refresh_cache-e95baab0-2c43-4653-b7ae-b9d8920aba33" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:01:40.065590 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:40.133099 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk 1073741824" returned: 0 in 0.067s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:40.136489 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.183s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:40.136489 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:40.230069 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.095s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:40.233491 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:01:40.233491 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:40.297459 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:01:40.327427 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:40.328405 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Cannot resize image /opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:01:40.329021 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:01:40.329394 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Ensure instance console log exists: /opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:01:40.330438 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328900.330111, e9edec14-452b-46fe-89c6-849ece08f527 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:01:40.331423 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e9edec14-452b-46fe-89c6-849ece08f527] VM Started (Lifecycle Event)
May 21 02:01:40.337586 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:40.338234 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:40.338837 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:40.407986 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] End _get_guest_xml xml=<domain type="qemu">
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:   <uuid>e158490e-746e-4c3b-924e-9aceed1662d0</uuid>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:   <name>instance-0000001d</name>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1853847854</nova:name>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:01:39</nova:creationTime>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:         <nova:user uuid="8b5074a8e47b444cb19c7dcf761ac2ae">tempest-ServerRescueNegativeTestJSON-1108613901-project-member</nova:user>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:         <nova:project uuid="87eb25eb23724c49b5bdbc462a1f36bc">tempest-ServerRescueNegativeTestJSON-1108613901</nova:project>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:         <nova:port uuid="0298cd31-6bbc-4653-a4ac-8d9b5def1753">
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:     <system>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:       <entry name="serial">e158490e-746e-4c3b-924e-9aceed1662d0</entry>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:       <entry name="uuid">e158490e-746e-4c3b-924e-9aceed1662d0</entry>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:     </system>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:   <os>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:   </os>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:   <features>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:   </features>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:   <devices>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/disk"/>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:     </disk>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/disk.config"/>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:     </disk>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:60:a6:12"/>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:       <target dev="tap0298cd31-6b"/>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:     </interface>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/console.log" append="off"/>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:     </serial>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:     <video>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:     </video>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:     </rng>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:   </devices>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]: </domain>
May 21 02:01:40.407986 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:01:40.410314 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Preparing to wait for external event network-vif-plugged-0298cd31-6bbc-4653-a4ac-8d9b5def1753 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:01:40.410314 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:40.410314 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:40.410314 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:40.410314 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:01:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1853847854',display_name='tempest-ServerRescueNegativeTestJSON-server-1853847854',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serverrescuenegativetestjson-server-1853847854',id=29,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87eb25eb23724c49b5bdbc462a1f36bc',ramdisk_id='',reservation_id='r-bkabzv7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1108613901',owner_user_name='tempest-ServerRescueNegativeTestJSON-1108613901-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:01:36Z,user_data=None,user_id='8b5074a8e47b444cb19c7dcf761ac2ae',uuid=e158490e-746e-4c3b-924e-9aceed1662d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0298cd31-6bbc-4653-a4ac-8d9b5def1753", "address": "fa:16:3e:60:a6:12", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0298cd31-6b", "ovs_interfaceid": "0298cd31-6bbc-4653-a4ac-8d9b5def1753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:01:40.410314 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Converting VIF {"id": "0298cd31-6bbc-4653-a4ac-8d9b5def1753", "address": "fa:16:3e:60:a6:12", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0298cd31-6b", "ovs_interfaceid": "0298cd31-6bbc-4653-a4ac-8d9b5def1753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:01:40.411698 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:a6:12,bridge_name='br-int',has_traffic_filtering=True,id=0298cd31-6bbc-4653-a4ac-8d9b5def1753,network=Network(b8fcc592-f44d-440d-b1f1-c57714291c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0298cd31-6b') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:01:40.411698 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:a6:12,bridge_name='br-int',has_traffic_filtering=True,id=0298cd31-6bbc-4653-a4ac-8d9b5def1753,network=Network(b8fcc592-f44d-440d-b1f1-c57714291c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0298cd31-6b') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:01:40.411698 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:40.411899 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:01:40.412068 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:01:40.413097 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:40.413257 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a7932325-917f-592d-8312-401da79f992d', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:01:40.414081 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:40.415064 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:40.415338 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:01:40.415820 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:40.418861 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:40.419082 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0298cd31-6b, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:01:40.419433 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0298cd31-6b, col_values=(('qos', UUID('616eefe1-1121-48b6-b08d-6d1d374204c1')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:01:40.419651 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0298cd31-6b, col_values=(('external_ids', {'iface-id': '0298cd31-6bbc-4653-a4ac-8d9b5def1753', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:a6:12', 'vm-uuid': 'e158490e-746e-4c3b-924e-9aceed1662d0'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:01:40.422788 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:01:40.429865 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:40.431210 np0000001127 nova-compute[98206]: INFO os_vif [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:a6:12,bridge_name='br-int',has_traffic_filtering=True,id=0298cd31-6bbc-4653-a4ac-8d9b5def1753,network=Network(b8fcc592-f44d-440d-b1f1-c57714291c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0298cd31-6b')
May 21 02:01:40.461792 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:40.637404 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Updating instance_info_cache with network_info: [{"id": "3b74538b-3b3e-42f5-8f10-612c9d85b221", "address": "fa:16:3e:2b:20:c8", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b74538b-3b", "ovs_interfaceid": "3b74538b-3b3e-42f5-8f10-612c9d85b221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:01:40.839279 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:01:40.841282 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:01:40.944817 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.00042362900012449245 future=<Future at 0x71c07c50b1a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:01:40.945317 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Emitting event <LifecycleEvent: 1779328885.9442427, 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:01:40.945544 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:01:40.945668 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] VM Stopped (Lifecycle Event)
May 21 02:01:40.946671 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=11.535816132000036 future=<Future at 0x71c0585c9b20 state=cancelled>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:01:40.947059 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=11.535529460000134 future=<Future at 0x71c0585c9b20 state=cancelled>) was cancelled while queued, skipping {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:01:40.947059 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:01:41.139342 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Releasing lock "refresh_cache-e95baab0-2c43-4653-b7ae-b9d8920aba33" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:01:41.139628 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Instance network_info: |[{"id": "3b74538b-3b3e-42f5-8f10-612c9d85b221", "address": "fa:16:3e:2b:20:c8", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b74538b-3b", "ovs_interfaceid": "3b74538b-3b3e-42f5-8f10-612c9d85b221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:01:41.139917 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-3d6cd02b-5649-4b22-8370-97826c59e837 req-9ac7b9b6-955b-4bb2-8767-12876afeef75 service nova] Acquired lock "refresh_cache-e95baab0-2c43-4653-b7ae-b9d8920aba33" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:01:41.140102 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-3d6cd02b-5649-4b22-8370-97826c59e837 req-9ac7b9b6-955b-4bb2-8767-12876afeef75 service nova] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Refreshing network info cache for port 3b74538b-3b3e-42f5-8f10-612c9d85b221 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:01:41.142642 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Start _get_guest_xml network_info=[{"id": "3b74538b-3b3e-42f5-8f10-612c9d85b221", "address": "fa:16:3e:2b:20:c8", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b74538b-3b", "ovs_interfaceid": "3b74538b-3b3e-42f5-8f10-612c9d85b221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:01:41.150403 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:01:41.150403 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1443229473', uuid='e95baab0-2c43-4653-b7ae-b9d8920aba33'), owner=OwnerMeta(userid='8b5074a8e47b444cb19c7dcf761ac2ae', username='tempest-ServerRescueNegativeTestJSON-1108613901-project-member', projectid='87eb25eb23724c49b5bdbc462a1f36bc', projectname='tempest-ServerRescueNegativeTestJSON-1108613901'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3b74538b-3b3e-42f5-8f10-612c9d85b221", "address": "fa:16:3e:2b:20:c8", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b74538b-3b", "ovs_interfaceid": "3b74538b-3b3e-42f5-8f10-612c9d85b221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328901.1498785) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:01:41.151791 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:01:41.152516 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:01:41.153537 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:01:41.153828 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:01:41.154869 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:01:41.155307 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:01:41.156122 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:01:41.156122 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:01:41.156122 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:01:41.156122 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:01:41.156122 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:01:41.156122 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:01:41.156515 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:01:41.156818 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:01:41.157038 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:01:41.160488 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:01:41.168375 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:01:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1443229473',display_name='tempest-ServerRescueNegativeTestJSON-server-1443229473',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serverrescuenegativetestjson-server-1443229473',id=30,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87eb25eb23724c49b5bdbc462a1f36bc',ramdisk_id='',reservation_id='r-6i2xtfgb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1108613901',owner_user_name='tempest-ServerRescueNegativeTestJSON-1108613901-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:01:39Z,user_data=None,user_id='8b5074a8e47b444cb19c7dcf761ac2ae',uuid=e95baab0-2c43-4653-b7ae-b9d8920aba33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b74538b-3b3e-42f5-8f10-612c9d85b221", "address": "fa:16:3e:2b:20:c8", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b74538b-3b", "ovs_interfaceid": "3b74538b-3b3e-42f5-8f10-612c9d85b221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:01:41.168917 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Converting VIF {"id": "3b74538b-3b3e-42f5-8f10-612c9d85b221", "address": "fa:16:3e:2b:20:c8", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b74538b-3b", "ovs_interfaceid": "3b74538b-3b3e-42f5-8f10-612c9d85b221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:01:41.169543 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:20:c8,bridge_name='br-int',has_traffic_filtering=True,id=3b74538b-3b3e-42f5-8f10-612c9d85b221,network=Network(b8fcc592-f44d-440d-b1f1-c57714291c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b74538b-3b') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:01:41.170876 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lazy-loading 'pci_devices' on Instance uuid e95baab0-2c43-4653-b7ae-b9d8920aba33 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:01:41.327155 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:41.448367 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:01:41.450002 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: rebuilding, current DB power_state: 1, VM power_state: 4 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:01:41.643627 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-3d6cd02b-5649-4b22-8370-97826c59e837 req-9ac7b9b6-955b-4bb2-8767-12876afeef75 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:41.673215 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] End _get_guest_xml xml=<domain type="qemu">
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:   <uuid>e95baab0-2c43-4653-b7ae-b9d8920aba33</uuid>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:   <name>instance-0000001e</name>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1443229473</nova:name>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:01:41</nova:creationTime>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:         <nova:user uuid="8b5074a8e47b444cb19c7dcf761ac2ae">tempest-ServerRescueNegativeTestJSON-1108613901-project-member</nova:user>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:         <nova:project uuid="87eb25eb23724c49b5bdbc462a1f36bc">tempest-ServerRescueNegativeTestJSON-1108613901</nova:project>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:         <nova:port uuid="3b74538b-3b3e-42f5-8f10-612c9d85b221">
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:     <system>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:       <entry name="serial">e95baab0-2c43-4653-b7ae-b9d8920aba33</entry>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:       <entry name="uuid">e95baab0-2c43-4653-b7ae-b9d8920aba33</entry>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:     </system>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:   <os>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:   </os>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:   <features>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:   </features>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:   <devices>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk"/>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:     </disk>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk.config"/>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:     </disk>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:2b:20:c8"/>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:       <target dev="tap3b74538b-3b"/>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:     </interface>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/console.log" append="off"/>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:     </serial>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:     <video>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:     </video>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:     </rng>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:   </devices>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]: </domain>
May 21 02:01:41.673215 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:01:41.678622 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Preparing to wait for external event network-vif-plugged-3b74538b-3b3e-42f5-8f10-612c9d85b221 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:01:41.678622 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "e95baab0-2c43-4653-b7ae-b9d8920aba33-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:41.678622 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "e95baab0-2c43-4653-b7ae-b9d8920aba33-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:41.678622 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "e95baab0-2c43-4653-b7ae-b9d8920aba33-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:41.678622 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:01:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1443229473',display_name='tempest-ServerRescueNegativeTestJSON-server-1443229473',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serverrescuenegativetestjson-server-1443229473',id=30,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87eb25eb23724c49b5bdbc462a1f36bc',ramdisk_id='',reservation_id='r-6i2xtfgb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1108613901',owner_user_name='tempest-ServerRescueNegativeTestJSON-1108613901-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:01:39Z,user_data=None,user_id='8b5074a8e47b444cb19c7dcf761ac2ae',uuid=e95baab0-2c43-4653-b7ae-b9d8920aba33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b74538b-3b3e-42f5-8f10-612c9d85b221", "address": "fa:16:3e:2b:20:c8", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b74538b-3b", "ovs_interfaceid": "3b74538b-3b3e-42f5-8f10-612c9d85b221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:01:41.678622 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Converting VIF {"id": "3b74538b-3b3e-42f5-8f10-612c9d85b221", "address": "fa:16:3e:2b:20:c8", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b74538b-3b", "ovs_interfaceid": "3b74538b-3b3e-42f5-8f10-612c9d85b221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:01:41.678622 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:20:c8,bridge_name='br-int',has_traffic_filtering=True,id=3b74538b-3b3e-42f5-8f10-612c9d85b221,network=Network(b8fcc592-f44d-440d-b1f1-c57714291c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b74538b-3b') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:01:41.678622 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:20:c8,bridge_name='br-int',has_traffic_filtering=True,id=3b74538b-3b3e-42f5-8f10-612c9d85b221,network=Network(b8fcc592-f44d-440d-b1f1-c57714291c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b74538b-3b') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:01:41.679239 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:41.679239 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:01:41.679239 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:01:41.680288 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:41.680458 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3f615370-3eb5-5c02-bd93-ea06d7cf9258', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:01:41.682305 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:01:41.688228 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:41.690860 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:41.690860 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b74538b-3b, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:01:41.691213 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3b74538b-3b, col_values=(('qos', UUID('73c9202c-ac0b-4a37-a59b-f237c3888cbc')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:01:41.691401 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3b74538b-3b, col_values=(('external_ids', {'iface-id': '3b74538b-3b3e-42f5-8f10-612c9d85b221', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:20:c8', 'vm-uuid': 'e95baab0-2c43-4653-b7ae-b9d8920aba33'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:01:41.693914 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:01:41.708092 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:41.709439 np0000001127 nova-compute[98206]: INFO os_vif [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:20:c8,bridge_name='br-int',has_traffic_filtering=True,id=3b74538b-3b3e-42f5-8f10-612c9d85b221,network=Network(b8fcc592-f44d-440d-b1f1-c57714291c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b74538b-3b')
May 21 02:01:41.730437 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "4f1b10cb-b101-4ef4-9f68-54bf1c6c68da" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:41.731168 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "4f1b10cb-b101-4ef4-9f68-54bf1c6c68da" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:41.952937 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] During sync_power_state the instance has a pending task (rebuilding). Skip.
May 21 02:01:41.960890 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:01:41.961039 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:01:41.961269 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] No VIF found with MAC fa:16:3e:60:a6:12, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:01:41.961827 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Using config drive
May 21 02:01:42.001813 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-3d6cd02b-5649-4b22-8370-97826c59e837 req-9ac7b9b6-955b-4bb2-8767-12876afeef75 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:42.140562 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-3d6cd02b-5649-4b22-8370-97826c59e837 req-9ac7b9b6-955b-4bb2-8767-12876afeef75 service nova] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Updated VIF entry in instance network info cache for port 3b74538b-3b3e-42f5-8f10-612c9d85b221. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:01:42.140911 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-3d6cd02b-5649-4b22-8370-97826c59e837 req-9ac7b9b6-955b-4bb2-8767-12876afeef75 service nova] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Updating instance_info_cache with network_info: [{"id": "3b74538b-3b3e-42f5-8f10-612c9d85b221", "address": "fa:16:3e:2b:20:c8", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b74538b-3b", "ovs_interfaceid": "3b74538b-3b3e-42f5-8f10-612c9d85b221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:01:42.235442 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lazy-loading 'flavor' on Instance uuid 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:01:42.468717 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:42.621208 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Creating config drive at /opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/disk.config
May 21 02:01:42.626456 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphf4gzm9b {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:42.646452 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-3d6cd02b-5649-4b22-8370-97826c59e837 req-9ac7b9b6-955b-4bb2-8767-12876afeef75 service nova] Releasing lock "refresh_cache-e95baab0-2c43-4653-b7ae-b9d8920aba33" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:01:42.691491 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphf4gzm9b" returned: 0 in 0.065s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:43.185422 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:43.218784 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:43.232739 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:01:43.233844 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:01:43.233844 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] No VIF found with MAC fa:16:3e:2b:20:c8, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:01:43.233844 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Using config drive
May 21 02:01:43.241703 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "4f1b10cb-b101-4ef4-9f68-54bf1c6c68da" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:43.324740 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:43.423748 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7c66d843-f87e-4548-8c46-54776b4f8c70 req-f5642a99-723b-41cc-a897-4ead284c9421 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Received event network-vif-plugged-0298cd31-6bbc-4653-a4ac-8d9b5def1753 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:01:43.425328 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7c66d843-f87e-4548-8c46-54776b4f8c70 req-f5642a99-723b-41cc-a897-4ead284c9421 service nova] Acquiring lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:43.426246 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7c66d843-f87e-4548-8c46-54776b4f8c70 req-f5642a99-723b-41cc-a897-4ead284c9421 service nova] Lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:43.430697 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7c66d843-f87e-4548-8c46-54776b4f8c70 req-f5642a99-723b-41cc-a897-4ead284c9421 service nova] Lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:43.431060 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7c66d843-f87e-4548-8c46-54776b4f8c70 req-f5642a99-723b-41cc-a897-4ead284c9421 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Processing event network-vif-plugged-0298cd31-6bbc-4653-a4ac-8d9b5def1753 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:01:43.596403 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:43.603305 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:43.605635 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:43.633428 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:43.740152 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:43.910854 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Creating config drive at /opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk.config
May 21 02:01:43.915953 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7rl2txxb {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:43.965253 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7rl2txxb" returned: 0 in 0.049s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:44.188091 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328904.1875143, e158490e-746e-4c3b-924e-9aceed1662d0 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:01:44.188662 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] VM Started (Lifecycle Event)
May 21 02:01:44.190288 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:01:44.198750 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:01:44.202030 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Instance spawned successfully.
May 21 02:01:44.202593 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:01:44.354528 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "4f1b10cb-b101-4ef4-9f68-54bf1c6c68da" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:44.354528 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "4f1b10cb-b101-4ef4-9f68-54bf1c6c68da" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:44.354528 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Attaching volume de372a77-2a1d-4c74-8c0e-051c45ddb3f4 to /dev/vdb
May 21 02:01:44.421150 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:01:44.437607 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:01:44.469039 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:44.479174 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:44.503252 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:44.540245 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:01:44.540660 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:01:44.554498 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:01:44.554498 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe9e:216', 'fe80::14d9:7bff:fe3b:f0dc', 'fe80::fc16:3eff:fe45:a237', 'fe80::fc16:3eff:fe02:b49e', 'fe80::f819:cdff:fe2b:de28', 'fe80::fc16:3eff:fe92:96ee', 'fe80::9c51:adff:febc:e222', 'fe80::fc16:3eff:fef4:b759', 'fe80::40b3:49ff:feb3:3b55', 'fe80::fc16:3eff:fe35:27d3', 'fe80::a403:4dff:fe5a:1b07', 'fe80::fc16:3eff:fe60:a612', 'fe80::789a:c1ff:fe89:a024', 'fe80::fc16:3eff:fe2b:20c8'] 
May 21 02:01:44.554873 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:01:44.554958 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:01:44.555370 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:01:44.555982 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Updating existing volume attachment record: da8e66d3-98f9-4ce5-8955-09ed7a8e29dc {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:01:44.628208 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:44.694396 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:01:44.698520 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:44.698774 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:01:44.716334 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:01:44.716519 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:01:44.717050 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:01:44.717388 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:01:44.717893 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:01:44.718268 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:01:44.744396 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bc05079b-5cd4-45e2-a295-08bdb5e74d24 req-111c62f3-2484-42ea-b8c8-ce69bedef6e7 service nova] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Received event network-vif-plugged-3b74538b-3b3e-42f5-8f10-612c9d85b221 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:01:44.744396 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bc05079b-5cd4-45e2-a295-08bdb5e74d24 req-111c62f3-2484-42ea-b8c8-ce69bedef6e7 service nova] Acquiring lock "e95baab0-2c43-4653-b7ae-b9d8920aba33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:44.744396 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bc05079b-5cd4-45e2-a295-08bdb5e74d24 req-111c62f3-2484-42ea-b8c8-ce69bedef6e7 service nova] Lock "e95baab0-2c43-4653-b7ae-b9d8920aba33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:44.744622 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bc05079b-5cd4-45e2-a295-08bdb5e74d24 req-111c62f3-2484-42ea-b8c8-ce69bedef6e7 service nova] Lock "e95baab0-2c43-4653-b7ae-b9d8920aba33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:44.745714 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bc05079b-5cd4-45e2-a295-08bdb5e74d24 req-111c62f3-2484-42ea-b8c8-ce69bedef6e7 service nova] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Processing event network-vif-plugged-3b74538b-3b3e-42f5-8f10-612c9d85b221 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:01:45.178560 np0000001127 nova-compute[98206]: DEBUG os_brick.encryptors [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'plain'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4', 'iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'de372a77-2a1d-4c74-8c0e-051c45ddb3f4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '4f1b10cb-b101-4ef4-9f68-54bf1c6c68da', 'attached_at': '', 'detached_at': '', 'volume_id': 'de372a77-2a1d-4c74-8c0e-051c45ddb3f4', 'serial': 'de372a77-2a1d-4c74-8c0e-051c45ddb3f4'} {{(pid=98206) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 21 02:01:45.180177 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:01:45.180632 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4', 'iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'de372a77-2a1d-4c74-8c0e-051c45ddb3f4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:01:45.180853 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:01:45.203032 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:01:45.203622 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328905.2031612, e158490e-746e-4c3b-924e-9aceed1662d0 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:01:45.203622 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] VM Paused (Lifecycle Event)
May 21 02:01:45.224305 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Took 8.10 seconds to spawn the instance on the hypervisor.
May 21 02:01:45.224846 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:01:45.461597 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:01:45.464775 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:01:45.469027 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Instance spawned successfully.
May 21 02:01:45.469548 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:01:45.501043 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-25e8e627-c0f8-49d2-bf6f-81a3507210f8 req-34ac5f65-c406-4b16-b440-07a0673851f6 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Received event network-vif-plugged-0298cd31-6bbc-4653-a4ac-8d9b5def1753 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:01:45.501288 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-25e8e627-c0f8-49d2-bf6f-81a3507210f8 req-34ac5f65-c406-4b16-b440-07a0673851f6 service nova] Acquiring lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:45.501510 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-25e8e627-c0f8-49d2-bf6f-81a3507210f8 req-34ac5f65-c406-4b16-b440-07a0673851f6 service nova] Lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:45.501702 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-25e8e627-c0f8-49d2-bf6f-81a3507210f8 req-34ac5f65-c406-4b16-b440-07a0673851f6 service nova] Lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:45.501867 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-25e8e627-c0f8-49d2-bf6f-81a3507210f8 req-34ac5f65-c406-4b16-b440-07a0673851f6 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] No waiting events found dispatching network-vif-plugged-0298cd31-6bbc-4653-a4ac-8d9b5def1753 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:01:45.502121 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-25e8e627-c0f8-49d2-bf6f-81a3507210f8 req-34ac5f65-c406-4b16-b440-07a0673851f6 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Received unexpected event network-vif-plugged-0298cd31-6bbc-4653-a4ac-8d9b5def1753 for instance with vm_state active and task_state None.
May 21 02:01:45.676061 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:01:45.676298 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:01:45.676427 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 21 02:01:45.676615 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:01:45.706776 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:01:45.708170 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328905.70786, e158490e-746e-4c3b-924e-9aceed1662d0 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:01:45.708439 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] VM Resumed (Lifecycle Event)
May 21 02:01:45.737215 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Took 13.76 seconds to build instance.
May 21 02:01:45.975455 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:01:45.975605 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:01:45.975908 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:01:45.976159 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:01:45.976432 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:01:45.976659 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:01:46.084532 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:01:46.131566 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:01:46.180832 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:46.181089 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:46.181247 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:46.181385 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Auditing locally available compute resources for np0000001127 (node: np0000001127) {{(pid=98206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 21 02:01:46.190173 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:01:46.190355 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:01:46.191494 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:01:46.204248 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:01:46.204732 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:01:46.210877 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:01:46.214149 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:01:46.218773 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:46.239393 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1b932e87-55ce-469e-becc-b99d1a05310c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "e158490e-746e-4c3b-924e-9aceed1662d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.272s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:46.259286 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b, portal: 192.168.40.100,3260]
May 21 02:01:46.259286 np0000001127 nova-compute[98206]: Logout of [sid: 51, target: iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b, portal: 192.168.40.100,3260] successful.
May 21 02:01:46.259286 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:46.280497 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:46.296864 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:46.330026 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b, portal: 192.168.50.100,3260]
May 21 02:01:46.330026 np0000001127 nova-compute[98206]: Logout of [sid: 50, target: iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b, portal: 192.168.50.100,3260] successful.
May 21 02:01:46.330026 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:46.330626 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:46.347346 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:46.347709 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 20.346s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:01:46.347984 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] <== disconnect_volume: return (20348ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:01:46.348198 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:01:46.348592 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Deleting instance files /opt/stack/data/nova/instances/44334b65-4382-4a2d-80f1-a1ae2cdfe1e8_del
May 21 02:01:46.349298 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Deletion of /opt/stack/data/nova/instances/44334b65-4382-4a2d-80f1-a1ae2cdfe1e8_del complete
May 21 02:01:46.352045 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 17.998s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:01:46.352565 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6372443-59c0-4c3c-93a4-2dc76f1369e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:01:46.367871 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:01:46.368561 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:01:46.369557 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:01:46.369969 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:01:46.370444 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:01:46.370744 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:01:46.384929 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:01:46.384929 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:46.391876 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:01:46.391876 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:46.403718 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4] added
May 21 02:01:46.403718 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:01:46.403718 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:01:46.403718 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:01:46.403718 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:01:46.403718 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:01:46.403718 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:46.403718 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:01:46.404093 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0343(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:01:46.404093 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:01:46.412962 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4] added
May 21 02:01:46.412962 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:01:46.412962 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:01:46.412962 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:01:46.412962 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:01:46.412962 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:01:46.412962 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:46.413256 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:01:46.413377 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0426(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:01:46.413560 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:01:46.488514 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Took 6.66 seconds to spawn the instance on the hypervisor.
May 21 02:01:46.488642 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:01:46.693095 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:46.718865 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328906.7185013, e95baab0-2c43-4653-b7ae-b9d8920aba33 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:01:46.719040 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] VM Started (Lifecycle Event)
May 21 02:01:46.808153 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-aeb0ce41-4d74-435d-9938-f8e80caf9c47 req-a7f069b8-8fa3-4ae8-aad0-3520915eebbc service nova] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Received event network-vif-plugged-3b74538b-3b3e-42f5-8f10-612c9d85b221 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:01:46.808312 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-aeb0ce41-4d74-435d-9938-f8e80caf9c47 req-a7f069b8-8fa3-4ae8-aad0-3520915eebbc service nova] Acquiring lock "e95baab0-2c43-4653-b7ae-b9d8920aba33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:46.809592 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-aeb0ce41-4d74-435d-9938-f8e80caf9c47 req-a7f069b8-8fa3-4ae8-aad0-3520915eebbc service nova] Lock "e95baab0-2c43-4653-b7ae-b9d8920aba33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:46.809891 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-aeb0ce41-4d74-435d-9938-f8e80caf9c47 req-a7f069b8-8fa3-4ae8-aad0-3520915eebbc service nova] Lock "e95baab0-2c43-4653-b7ae-b9d8920aba33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:46.810081 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-aeb0ce41-4d74-435d-9938-f8e80caf9c47 req-a7f069b8-8fa3-4ae8-aad0-3520915eebbc service nova] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] No waiting events found dispatching network-vif-plugged-3b74538b-3b3e-42f5-8f10-612c9d85b221 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:01:46.810247 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-aeb0ce41-4d74-435d-9938-f8e80caf9c47 req-a7f069b8-8fa3-4ae8-aad0-3520915eebbc service nova] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Received unexpected event network-vif-plugged-3b74538b-3b3e-42f5-8f10-612c9d85b221 for instance with vm_state active and task_state None.
May 21 02:01:46.945860 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8 could not be found.
May 21 02:01:46.946895 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:01:46.947239 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:01:46.947425 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:01:46.997949 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Took 14.21 seconds to build instance.
May 21 02:01:47.221818 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:01:47.228380 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:01:47.230451 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:47.333019 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:47.333555 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:47.404974 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:01:47.414352 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:01:47.426812 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:01:47.426812 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:47.435228 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:47.440124 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9edec14-452b-46fe-89c6-849ece08f527/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:01:47.458580 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:01:47.458580 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:47.463388 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:47.472773 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:47.481316 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:47.481316 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:47.481316 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:47.481316 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:47.481316 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:01:47.481316 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:47.481316 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:47.481316 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:47.481316 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:47.481316 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:01:47.489713 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:47.489713 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:47.489713 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:47.489713 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:47.489713 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:01:47.490057 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:47.490057 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:47.490057 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:47.490057 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:47.490057 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:01:47.500173 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "e95baab0-2c43-4653-b7ae-b9d8920aba33" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.716s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:47.516367 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4, portal: 192.168.40.100,3260]
May 21 02:01:47.516367 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4, portal: 192.168.40.100,3260] successful.
May 21 02:01:47.516367 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:47.529306 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:47.538002 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4, portal: 192.168.50.100,3260]
May 21 02:01:47.538002 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4, portal: 192.168.50.100,3260] successful.
May 21 02:01:47.538002 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:47.542524 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9edec14-452b-46fe-89c6-849ece08f527/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:47.542524 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9edec14-452b-46fe-89c6-849ece08f527/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:47.560161 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:47.560161 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:47.560161 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:47.560161 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:47.560161 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:01:47.560161 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:01:47.560161 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:01:47.562714 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:47.562714 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:47.562714 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:47.562714 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:47.562714 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:01:47.562714 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:01:47.562714 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:01:47.563543 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.195s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:01:47.563826 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:01:47.565059 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] HCTL ('11', '-', '-', 0) found on session 56 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:01:47.565267 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:01:47.565675 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:47.587006 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Searching for a device in session 56 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:01:47.587006 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6372443-59c0-4c3c-93a4-2dc76f1369e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:01:47.588801 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:47.588801 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:47.588801 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:47.588801 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:47.588801 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:01:47.588801 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:01:47.588801 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:01:47.588801 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:47.588801 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:47.588801 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:47.588801 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:47.588801 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:01:47.588801 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:01:47.588801 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:01:47.589220 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.219s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:01:47.589318 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:01:47.590219 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] HCTL ('12', '-', '-', 0) found on session 57 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:01:47.590373 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:01:47.616190 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Searching for a device in session 57 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:01:47.616190 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e6372443-59c0-4c3c-93a4-2dc76f1369e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:01:47.650525 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9edec14-452b-46fe-89c6-849ece08f527/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:47.650525 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:01:47.652257 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:47.744447 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328907.742949, e95baab0-2c43-4653-b7ae-b9d8920aba33 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:01:47.745019 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] VM Paused (Lifecycle Event)
May 21 02:01:47.761235 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:47.762189 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:47.879043 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:47.885324 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:01:47.891353 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1b10cb-b101-4ef4-9f68-54bf1c6c68da/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:48.009809 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1b10cb-b101-4ef4-9f68-54bf1c6c68da/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:48.010337 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1b10cb-b101-4ef4-9f68-54bf1c6c68da/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:48.109063 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1b10cb-b101-4ef4-9f68-54bf1c6c68da/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:48.113230 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Error from libvirt while getting description of instance-00000017: [Error Code 42] Domain not found: no domain with matching uuid '44334b65-4382-4a2d-80f1-a1ae2cdfe1e8' (instance-00000017): libvirt.libvirtError: Domain not found: no domain with matching uuid '44334b65-4382-4a2d-80f1-a1ae2cdfe1e8' (instance-00000017)
May 21 02:01:48.117114 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:48.227565 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:48.228169 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:48.252614 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:01:48.261667 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328908.2584395, e95baab0-2c43-4653-b7ae-b9d8920aba33 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:01:48.261667 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] VM Resumed (Lifecycle Event)
May 21 02:01:48.322742 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:48.325493 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:48.371904 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:01:48.434870 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:48.435893 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:48.536894 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:48.542460 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:48.554767 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Rescuing
May 21 02:01:48.555336 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "refresh_cache-e95baab0-2c43-4653-b7ae-b9d8920aba33" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:01:48.555480 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquired lock "refresh_cache-e95baab0-2c43-4653-b7ae-b9d8920aba33" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:01:48.555834 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:01:48.642522 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:48.643270 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:48.750519 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:48.754092 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:01:48.755564 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:48.771763 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:01:48.775448 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:01:48.805953 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "env LANG=C uptime" returned: 0 in 0.050s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:48.806530 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Hypervisor/Node resource view: name=np0000001127 free_ram=12457MB free_disk=74.09971618652344GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 21 02:01:48.806774 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:48.807078 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:49.061874 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:49.278992 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] During sync_power_state the instance has a pending task (rescuing). Skip.
May 21 02:01:49.386967 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:49.391728 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Found WWN 33000000041b69012 for multipath device dm-2 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:01:49.391728 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:01:49.391728 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] <== connect_volume: return (21037ms) {'type': 'block', 'scsi_wwn': '33000000041b69012', 'path': '/dev/dm-2', 'multipath_id': '33000000041b69012'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:01:49.391728 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000041b69012', 'path': '/dev/dm-2', 'multipath_id': '33000000041b69012'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:01:49.392984 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 4.212s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:01:49.392984 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4', 'iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'de372a77-2a1d-4c74-8c0e-051c45ddb3f4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:01:49.409767 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:01:49.410726 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:01:49.411391 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:01:49.411716 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:01:49.412516 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:01:49.412736 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:01:49.428244 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:01:49.428244 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:49.440070 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:01:49.440070 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:49.440373 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4] added
May 21 02:01:49.440373 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:01:49.440373 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:01:49.440373 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:01:49.440373 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:01:49.440373 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:01:49.440373 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:49.441018 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:01:49.441277 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0296(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:01:49.441502 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:01:49.453884 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4] added
May 21 02:01:49.453884 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:01:49.453884 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:01:49.453884 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:01:49.453884 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:01:49.453884 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:01:49.453884 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:49.454176 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:01:49.454249 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0415(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:01:49.454558 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:01:49.539931 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Updating instance_info_cache with network_info: [{"id": "3b74538b-3b3e-42f5-8f10-612c9d85b221", "address": "fa:16:3e:2b:20:c8", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b74538b-3b", "ovs_interfaceid": "3b74538b-3b3e-42f5-8f10-612c9d85b221", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:01:49.889107 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 29a124ee-2b8c-4f44-8f91-8dd11ac78b52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:01:49.889237 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 66fe5d80-9012-44fe-9b82-1e993211ddf1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:01:49.889337 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:01:49.889538 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance e9edec14-452b-46fe-89c6-849ece08f527 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:01:49.889667 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:01:49.889766 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:01:49.889869 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance df1fb869-23ef-48e0-b609-ce91c2540c2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:01:49.889971 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:01:49.890068 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance e158490e-746e-4c3b-924e-9aceed1662d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:01:49.890153 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance e95baab0-2c43-4653-b7ae-b9d8920aba33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:01:49.890389 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 21 02:01:49.890554 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Final resource view: name=np0000001127 phys_ram=24030MB used_ram=2496MB phys_disk=95GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:01:48 up 32 min,  2 users,  load average: 9.45, 7.43, 3.92\n', 'num_instances': '10', 'num_vm_active': '9', 'num_task_None': '7', 'num_os_type_None': '10', 'num_proj_6a15fe7a70464159a778cffa4a36c36f': '2', 'io_workload': '3', 'num_proj_dc797708a5a7400992765e41ee6ec260': '1', 'num_proj_177bec65268546d2b899e09989183b6e': '1', 'num_proj_513057b933ef4779a2e885ae526782b9': '1', 'num_proj_e80cee8643f34f6685ff7fb42920afc3': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_cb7bdb5c7bbb4465b12c92ffdd425114': '1', 'num_proj_87eb25eb23724c49b5bdbc462a1f36bc': '2', 'num_task_rescuing': '1', 'num_task_rebuilding': '1', 'num_proj_9dde2f210a0e4debaa655c852b3621da': '1'} {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 21 02:01:49.907774 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:01:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-2131771438',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testinstanceswithcindervolumes-server-2131771438',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2S6OkiVrrHfIqcpMEoA7FR3RHfcqi608TQs8IzVfXaDmpk0TGAbpW5WuJYdw49uIjsxViMzQYBEsjLt9OsVnNhNpokb32+C+Gg5x5HpNTJmss66tY7o5HzUCYkKowI4w==',key_name='tempest-TestInstancesWithCinderVolumes-314392276',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb7bdb5c7bbb4465b12c92ffdd425114',ramdisk_id='',reservation_id='r-0csmfz12',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestInstancesWithCinderVolumes-1975993015',owner_user_name='tempest-TestInstancesWithCinderVolumes-1975993015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:01:26Z,user_data=None,user_id='c14700a43e7e4c5eb6bbbbb14a135387',uuid=23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0e8bfdd-1ce7-47c4-a730-362b39289635", "address": "fa:16:3e:41:22:0a", "network": {"id": "101a7f52-26cc-4331-b0f1-02b8c890fb35", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1092866296-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb7bdb5c7bbb4465b12c92ffdd425114", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0e8bfdd-1c", "ovs_interfaceid": "c0e8bfdd-1ce7-47c4-a730-362b39289635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:01:49.907774 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Converting VIF {"id": "c0e8bfdd-1ce7-47c4-a730-362b39289635", "address": "fa:16:3e:41:22:0a", "network": {"id": "101a7f52-26cc-4331-b0f1-02b8c890fb35", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1092866296-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb7bdb5c7bbb4465b12c92ffdd425114", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0e8bfdd-1c", "ovs_interfaceid": "c0e8bfdd-1ce7-47c4-a730-362b39289635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:01:49.907774 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:22:0a,bridge_name='br-int',has_traffic_filtering=True,id=c0e8bfdd-1ce7-47c4-a730-362b39289635,network=Network(101a7f52-26cc-4331-b0f1-02b8c890fb35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0e8bfdd-1c') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:01:49.907774 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lazy-loading 'pci_devices' on Instance uuid 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:01:50.042124 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Releasing lock "refresh_cache-e95baab0-2c43-4653-b7ae-b9d8920aba33" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:01:50.412491 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] End _get_guest_xml xml=<domain type="qemu">
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:   <uuid>23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a</uuid>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:   <name>instance-0000001c</name>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:       <nova:name>tempest-TestInstancesWithCinderVolumes-server-2131771438</nova:name>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:01:28</nova:creationTime>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:       <nova:image uuid="">
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:         <nova:properties/>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:         <nova:user uuid="c14700a43e7e4c5eb6bbbbb14a135387">tempest-TestInstancesWithCinderVolumes-1975993015-project-member</nova:user>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:         <nova:project uuid="cb7bdb5c7bbb4465b12c92ffdd425114">tempest-TestInstancesWithCinderVolumes-1975993015</nova:project>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:       <nova:root type="volume" uuid=""/>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:         <nova:port uuid="c0e8bfdd-1ce7-47c4-a730-362b39289635">
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:     <system>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:       <entry name="serial">23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a</entry>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:       <entry name="uuid">23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a</entry>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:     </system>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:   <os>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:   </os>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:   <features>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:   </features>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:   <devices>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a/disk.config"/>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:     </disk>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:       <alias name="ua-e6372443-59c0-4c3c-93a4-2dc76f1369e4"/>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-2"/>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:       <serial>e6372443-59c0-4c3c-93a4-2dc76f1369e4</serial>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:     </disk>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:41:22:0a"/>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:       <target dev="tapc0e8bfdd-1c"/>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:     </interface>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a/console.log" append="off"/>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:     </serial>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:     <video>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:     </video>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:     </rng>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:   </devices>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]: </domain>
May 21 02:01:50.412491 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:01:50.412491 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Preparing to wait for external event network-vif-plugged-c0e8bfdd-1ce7-47c4-a730-362b39289635 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:01:50.412491 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Acquiring lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:50.412491 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:50.412491 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:50.412491 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:01:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-2131771438',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testinstanceswithcindervolumes-server-2131771438',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2S6OkiVrrHfIqcpMEoA7FR3RHfcqi608TQs8IzVfXaDmpk0TGAbpW5WuJYdw49uIjsxViMzQYBEsjLt9OsVnNhNpokb32+C+Gg5x5HpNTJmss66tY7o5HzUCYkKowI4w==',key_name='tempest-TestInstancesWithCinderVolumes-314392276',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb7bdb5c7bbb4465b12c92ffdd425114',ramdisk_id='',reservation_id='r-0csmfz12',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestInstancesWithCinderVolumes-1975993015',owner_user_name='tempest-TestInstancesWithCinderVolumes-1975993015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:01:26Z,user_data=None,user_id='c14700a43e7e4c5eb6bbbbb14a135387',uuid=23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0e8bfdd-1ce7-47c4-a730-362b39289635", "address": "fa:16:3e:41:22:0a", "network": {"id": "101a7f52-26cc-4331-b0f1-02b8c890fb35", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1092866296-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb7bdb5c7bbb4465b12c92ffdd425114", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0e8bfdd-1c", "ovs_interfaceid": "c0e8bfdd-1ce7-47c4-a730-362b39289635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:01:50.412491 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Converting VIF {"id": "c0e8bfdd-1ce7-47c4-a730-362b39289635", "address": "fa:16:3e:41:22:0a", "network": {"id": "101a7f52-26cc-4331-b0f1-02b8c890fb35", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1092866296-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb7bdb5c7bbb4465b12c92ffdd425114", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0e8bfdd-1c", "ovs_interfaceid": "c0e8bfdd-1ce7-47c4-a730-362b39289635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:01:50.415923 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:22:0a,bridge_name='br-int',has_traffic_filtering=True,id=c0e8bfdd-1ce7-47c4-a730-362b39289635,network=Network(101a7f52-26cc-4331-b0f1-02b8c890fb35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0e8bfdd-1c') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:01:50.415923 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:22:0a,bridge_name='br-int',has_traffic_filtering=True,id=c0e8bfdd-1ce7-47c4-a730-362b39289635,network=Network(101a7f52-26cc-4331-b0f1-02b8c890fb35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0e8bfdd-1c') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:01:50.416673 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:50.416805 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:01:50.417195 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:01:50.418522 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:50.418787 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '52ed8caf-84b4-5d36-b5f6-5a7a0eee732e', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:01:50.420123 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:50.421660 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:01:50.427055 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:50.427320 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0e8bfdd-1c, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:01:50.427745 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc0e8bfdd-1c, col_values=(('qos', UUID('4a3ea9aa-9c10-4edf-89fe-82423dec2daf')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:01:50.427911 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc0e8bfdd-1c, col_values=(('external_ids', {'iface-id': 'c0e8bfdd-1ce7-47c4-a730-362b39289635', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:22:0a', 'vm-uuid': '23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:01:50.430743 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:01:50.437761 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:50.438982 np0000001127 nova-compute[98206]: INFO os_vif [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:22:0a,bridge_name='br-int',has_traffic_filtering=True,id=c0e8bfdd-1ce7-47c4-a730-362b39289635,network=Network(101a7f52-26cc-4331-b0f1-02b8c890fb35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0e8bfdd-1c')
May 21 02:01:50.442034 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:01:50.454969 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:01:50.456808 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:01:50.456808 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:01:50.473715 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:01:50.473715 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:50.482729 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:50.489526 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:50.503126 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:50.503126 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:50.503126 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:50.503126 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:50.503126 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:01:50.503126 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:01:50.503126 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:01:50.504081 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:50.504081 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:50.504081 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:50.504081 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:50.504081 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:01:50.504081 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:01:50.504081 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:01:50.512593 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:50.512593 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:50.512593 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:50.512593 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:50.512593 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:01:50.512593 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:01:50.512593 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:01:50.512815 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:50.512815 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:50.512815 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:50.512815 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:50.512815 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:01:50.512815 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:01:50.512815 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:01:50.560812 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4, portal: 192.168.50.100,3260]
May 21 02:01:50.560812 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4, portal: 192.168.50.100,3260] successful.
May 21 02:01:50.560812 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:50.564061 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:01:50.564292 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:01:50.572715 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4, portal: 192.168.40.100,3260]
May 21 02:01:50.572715 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4, portal: 192.168.40.100,3260] successful.
May 21 02:01:50.572715 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:50.579289 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:50.591108 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:50.603838 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:50.603838 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:50.603838 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:50.603838 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:50.603838 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:01:50.603838 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:01:50.603838 np0000001127 nova-compute[98206]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4 (non-flash)
May 21 02:01:50.603838 np0000001127 nova-compute[98206]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4 (non-flash)
May 21 02:01:50.603838 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:01:50.604326 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:50.604326 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:50.604326 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:50.604326 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:50.604326 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:01:50.604326 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:01:50.604326 np0000001127 nova-compute[98206]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4 (non-flash)
May 21 02:01:50.604326 np0000001127 nova-compute[98206]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4 (non-flash)
May 21 02:01:50.604326 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:01:50.604326 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.192s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:01:50.604757 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:01:50.605938 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] HCTL ('13', '-', '-', 0) found on session 58 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:01:50.606076 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:01:50.616636 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:50.616636 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:50.616636 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:50.616636 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:50.616636 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:01:50.616636 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:01:50.616636 np0000001127 nova-compute[98206]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4 (non-flash)
May 21 02:01:50.616636 np0000001127 nova-compute[98206]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4 (non-flash)
May 21 02:01:50.616636 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:01:50.618495 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:50.618495 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:50.618495 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:50.618495 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:50.618495 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:01:50.618495 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:01:50.618495 np0000001127 nova-compute[98206]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4 (non-flash)
May 21 02:01:50.618495 np0000001127 nova-compute[98206]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4 (non-flash)
May 21 02:01:50.618495 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:01:50.618495 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.207s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:01:50.618495 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:01:50.620212 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] HCTL ('14', '-', '-', 0) found on session 59 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:01:50.620212 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:01:50.627742 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Searching for a device in session 58 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:01:50.628009 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'de372a77-2a1d-4c74-8c0e-051c45ddb3f4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:01:50.642237 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Searching for a device in session 59 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:01:50.642237 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'de372a77-2a1d-4c74-8c0e-051c45ddb3f4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:01:51.067130 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:01:51.334746 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:51.416403 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:01:51.574831 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Compute_service record updated for np0000001127:np0000001127 {{(pid=98206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 21 02:01:51.575164 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.768s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:51.575593 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:01:51.698519 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:51.701380 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:51.725210 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:51.869516 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-851640ed-5741-48b5-9620-2f8a053da84d req-973add47-400e-408d-bc0c-c649ba21d23e service nova] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Received event network-vif-unplugged-3b74538b-3b3e-42f5-8f10-612c9d85b221 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:01:51.869516 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-851640ed-5741-48b5-9620-2f8a053da84d req-973add47-400e-408d-bc0c-c649ba21d23e service nova] Acquiring lock "e95baab0-2c43-4653-b7ae-b9d8920aba33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:51.869516 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-851640ed-5741-48b5-9620-2f8a053da84d req-973add47-400e-408d-bc0c-c649ba21d23e service nova] Lock "e95baab0-2c43-4653-b7ae-b9d8920aba33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:51.869516 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-851640ed-5741-48b5-9620-2f8a053da84d req-973add47-400e-408d-bc0c-c649ba21d23e service nova] Lock "e95baab0-2c43-4653-b7ae-b9d8920aba33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:51.869516 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-851640ed-5741-48b5-9620-2f8a053da84d req-973add47-400e-408d-bc0c-c649ba21d23e service nova] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] No waiting events found dispatching network-vif-unplugged-3b74538b-3b3e-42f5-8f10-612c9d85b221 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:01:51.869939 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-851640ed-5741-48b5-9620-2f8a053da84d req-973add47-400e-408d-bc0c-c649ba21d23e service nova] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Received unexpected event network-vif-unplugged-3b74538b-3b3e-42f5-8f10-612c9d85b221 for instance with vm_state active and task_state rescuing.
May 21 02:01:51.890343 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:51.901656 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:51.974320 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:01:51.974505 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:01:51.975028 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] No VIF found with MAC fa:16:3e:41:22:0a, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:01:51.975819 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Using config drive
May 21 02:01:52.044436 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.99967866299994 future=<Future at 0x71c0584dfdd0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:01:52.045410 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.99909976999993 future=<Future at 0x71c0584dfdd0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:01:52.045410 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.998974226999962 future=<Future at 0x71c0584dfdd0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:01:52.047705 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Instance destroyed successfully.
May 21 02:01:52.048994 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lazy-loading 'numa_topology' on Instance uuid e95baab0-2c43-4653-b7ae-b9d8920aba33 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:01:52.433486 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Found WWN 33000000040b9d491 for multipath device dm-5 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:01:52.434017 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:01:52.434744 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 5.487s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:01:52.435229 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:01:52.435427 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:01:52.438837 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] <== connect_volume: return (7258ms) {'type': 'block', 'scsi_wwn': '33000000040b9d491', 'path': '/dev/disk/by-id/os-brick+dev+dm-5', 'multipath_id': '33000000040b9d491'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:01:52.439066 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000040b9d491', 'path': '/dev/disk/by-id/os-brick+dev+dm-5', 'multipath_id': '33000000040b9d491'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:01:52.440751 np0000001127 nova-compute[98206]: WARNING stevedore.named [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 21 02:01:52.441007 np0000001127 nova-compute[98206]: WARNING castellan.key_manager [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 21 02:01:52.444311 np0000001127 nova-compute[98206]: WARNING nova.keymgr.conf_key_mgr [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 21 02:01:52.445498 np0000001127 nova-compute[98206]: DEBUG os_brick.encryptors [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Using volume encryptor '<os_brick.encryptors.cryptsetup.CryptsetupEncryptor object at 0x71c0584e66c0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4', 'iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'de372a77-2a1d-4c74-8c0e-051c45ddb3f4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-5'}, 'status': 'reserved', 'instance': '4f1b10cb-b101-4ef4-9f68-54bf1c6c68da', 'attached_at': '', 'detached_at': '', 'volume_id': 'de372a77-2a1d-4c74-8c0e-051c45ddb3f4', 'serial': 'de372a77-2a1d-4c74-8c0e-051c45ddb3f4'} {{(pid=98206) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 21 02:01:52.446677 np0000001127 nova-compute[98206]: WARNING os_brick.encryptors.cryptsetup [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Deprecated: The plain CryptsetupEncryptor is deprecated and will be removed in a future release. Existing users are encouraged to retype any existing volumes using this encryptor to the 'luks' LuksEncryptor or 'luks2' Luks2Encryptor encryptors as soon as possible.
May 21 02:01:52.447055 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=98206) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 21 02:01:52.447055 np0000001127 nova-compute[98206]: DEBUG os_brick.encryptors.cryptsetup [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] opening encrypted volume /dev/dm-5 {{(pid=98206) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/cryptsetup.py:104}}
May 21 02:01:52.466070 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:52.466070 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:52.466070 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:52.466070 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:52.466070 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:01:52.466070 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:01:52.466070 np0000001127 nova-compute[98206]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4 (non-flash)
May 21 02:01:52.466070 np0000001127 nova-compute[98206]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4 (non-flash)
May 21 02:01:52.466070 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:01:52.466353 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:52.466353 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:52.466353 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:52.466353 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:52.466353 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:01:52.466353 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:01:52.466353 np0000001127 nova-compute[98206]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4 (non-flash)
May 21 02:01:52.466353 np0000001127 nova-compute[98206]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4 (non-flash)
May 21 02:01:52.466353 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:01:52.466511 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6', '52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6', '53'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', '56'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4', '58'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4', '59')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:01:52.466855 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b, 0): [] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:01:52.466855 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b') {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 21 02:01:52.466855 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b, 0): [] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:01:52.467153 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b') {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 21 02:01:52.467153 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c058575800>, {}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:01:52.467820 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Disconnecting from: [] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:01:52.468158 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.034s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:01:52.468316 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] <== disconnect_volume: return (5520ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:01:52.468754 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:01:52.484302 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:52.555243 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Attempting rescue
May 21 02:01:52.557162 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98206) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 21 02:01:52.564301 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Instance directory exists: not creating {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 21 02:01:52.564301 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Creating image(s)
May 21 02:01:52.564581 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "/opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:52.564663 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "/opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:52.565214 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "/opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:52.565775 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lazy-loading 'trusted_certs' on Instance uuid e95baab0-2c43-4653-b7ae-b9d8920aba33 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:01:52.574927 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lazy-loading 'flavor' on Instance uuid 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:01:52.576919 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:01:52.577981 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:01:52.578412 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:01:52.579256 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:01:52.579660 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:01:52.580095 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.10 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:01:52.650486 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Creating config drive at /opt/stack/data/nova/instances/23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a/disk.config
May 21 02:01:52.653936 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpevsh56nv {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:52.702921 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpevsh56nv" returned: 0 in 0.049s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:53.074530 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Object Instance<e95baab0-2c43-4653-b7ae-b9d8920aba33> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:01:53.075400 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:01:53.078071 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:01:53.079165 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:53.081464 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Attempting to attach volume de372a77-2a1d-4c74-8c0e-051c45ddb3f4 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 02:01:53.081838 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:53.082151 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:01:53.084446 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:01:53.084752 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:53.100582 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] attach device xml: <disk type="block" device="disk">
May 21 02:01:53.100582 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:01:53.100582 np0000001127 nova-compute[98206]:   <alias name="ua-de372a77-2a1d-4c74-8c0e-051c45ddb3f4"/>
May 21 02:01:53.100582 np0000001127 nova-compute[98206]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-5"/>
May 21 02:01:53.100582 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:01:53.100582 np0000001127 nova-compute[98206]:   <serial>de372a77-2a1d-4c74-8c0e-051c45ddb3f4</serial>
May 21 02:01:53.100582 np0000001127 nova-compute[98206]: </disk>
May 21 02:01:53.100582 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 02:01:53.149559 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:53.173518 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.088s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:53.173518 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk.rescue {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:53.189942 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:53.231327 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk.rescue" returned: 0 in 0.058s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:53.233622 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.150s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:53.233622 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lazy-loading 'migration_context' on Instance uuid e95baab0-2c43-4653-b7ae-b9d8920aba33 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:01:53.392078 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:53.555324 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:53.565569 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:53.568786 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:53.599600 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:53.682100 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Preparing to wait for external event volume-reimaged-b38b53ce-4cdb-4612-9475-9ea4e1b1205b {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:01:53.682271 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Acquiring lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:53.682359 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:53.684952 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:53.735504 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Object Instance<e95baab0-2c43-4653-b7ae-b9d8920aba33> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:01:53.735504 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:01:53.736366 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Start _get_guest_xml network_info=[{"id": "3b74538b-3b3e-42f5-8f10-612c9d85b221", "address": "fa:16:3e:2b:20:c8", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "vif_mac": "fa:16:3e:2b:20:c8"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b74538b-3b", "ovs_interfaceid": "3b74538b-3b3e-42f5-8f10-612c9d85b221", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1545019a-a9af-4414-b299-e8f325be0886', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:01:53.737083 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lazy-loading 'resources' on Instance uuid e95baab0-2c43-4653-b7ae-b9d8920aba33 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:01:53.962009 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-05c140e6-e86a-4599-a3b2-248b724bbfed req-4ea515ed-de71-44f4-81e9-95c03d212ea6 service nova] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Received event network-vif-unplugged-3b74538b-3b3e-42f5-8f10-612c9d85b221 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:01:53.962009 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-05c140e6-e86a-4599-a3b2-248b724bbfed req-4ea515ed-de71-44f4-81e9-95c03d212ea6 service nova] Acquiring lock "e95baab0-2c43-4653-b7ae-b9d8920aba33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:53.962631 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-05c140e6-e86a-4599-a3b2-248b724bbfed req-4ea515ed-de71-44f4-81e9-95c03d212ea6 service nova] Lock "e95baab0-2c43-4653-b7ae-b9d8920aba33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:53.962844 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-05c140e6-e86a-4599-a3b2-248b724bbfed req-4ea515ed-de71-44f4-81e9-95c03d212ea6 service nova] Lock "e95baab0-2c43-4653-b7ae-b9d8920aba33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:53.963121 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-05c140e6-e86a-4599-a3b2-248b724bbfed req-4ea515ed-de71-44f4-81e9-95c03d212ea6 service nova] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] No waiting events found dispatching network-vif-unplugged-3b74538b-3b3e-42f5-8f10-612c9d85b221 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:01:53.963121 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-05c140e6-e86a-4599-a3b2-248b724bbfed req-4ea515ed-de71-44f4-81e9-95c03d212ea6 service nova] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Received unexpected event network-vif-unplugged-3b74538b-3b3e-42f5-8f10-612c9d85b221 for instance with vm_state active and task_state rescuing.
May 21 02:01:53.963224 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-05c140e6-e86a-4599-a3b2-248b724bbfed req-4ea515ed-de71-44f4-81e9-95c03d212ea6 service nova] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Received event network-vif-plugged-c0e8bfdd-1ce7-47c4-a730-362b39289635 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:01:53.963568 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-05c140e6-e86a-4599-a3b2-248b724bbfed req-4ea515ed-de71-44f4-81e9-95c03d212ea6 service nova] Acquiring lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:53.963568 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-05c140e6-e86a-4599-a3b2-248b724bbfed req-4ea515ed-de71-44f4-81e9-95c03d212ea6 service nova] Lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:53.966332 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-05c140e6-e86a-4599-a3b2-248b724bbfed req-4ea515ed-de71-44f4-81e9-95c03d212ea6 service nova] Lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:53.966332 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-05c140e6-e86a-4599-a3b2-248b724bbfed req-4ea515ed-de71-44f4-81e9-95c03d212ea6 service nova] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Processing event network-vif-plugged-c0e8bfdd-1ce7-47c4-a730-362b39289635 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:01:53.966332 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-05c140e6-e86a-4599-a3b2-248b724bbfed req-4ea515ed-de71-44f4-81e9-95c03d212ea6 service nova] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Received event network-vif-plugged-c0e8bfdd-1ce7-47c4-a730-362b39289635 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:01:53.966332 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-05c140e6-e86a-4599-a3b2-248b724bbfed req-4ea515ed-de71-44f4-81e9-95c03d212ea6 service nova] Acquiring lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:53.966332 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-05c140e6-e86a-4599-a3b2-248b724bbfed req-4ea515ed-de71-44f4-81e9-95c03d212ea6 service nova] Lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:53.966332 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-05c140e6-e86a-4599-a3b2-248b724bbfed req-4ea515ed-de71-44f4-81e9-95c03d212ea6 service nova] Lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:53.966332 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-05c140e6-e86a-4599-a3b2-248b724bbfed req-4ea515ed-de71-44f4-81e9-95c03d212ea6 service nova] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] No waiting events found dispatching network-vif-plugged-c0e8bfdd-1ce7-47c4-a730-362b39289635 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:01:53.966332 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-05c140e6-e86a-4599-a3b2-248b724bbfed req-4ea515ed-de71-44f4-81e9-95c03d212ea6 service nova] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Received unexpected event network-vif-plugged-c0e8bfdd-1ce7-47c4-a730-362b39289635 for instance with vm_state building and task_state spawning.
May 21 02:01:54.240508 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Object Instance<e95baab0-2c43-4653-b7ae-b9d8920aba33> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:01:54.246879 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:01:54.248963 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1443229473', uuid='e95baab0-2c43-4653-b7ae-b9d8920aba33'), owner=OwnerMeta(userid='8b5074a8e47b444cb19c7dcf761ac2ae', username='tempest-ServerRescueNegativeTestJSON-1108613901-project-member', projectid='87eb25eb23724c49b5bdbc462a1f36bc', projectname='tempest-ServerRescueNegativeTestJSON-1108613901'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3b74538b-3b3e-42f5-8f10-612c9d85b221", "address": "fa:16:3e:2b:20:c8", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "vif_mac": "fa:16:3e:2b:20:c8"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b74538b-3b", "ovs_interfaceid": "3b74538b-3b3e-42f5-8f10-612c9d85b221", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328914.2483447) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:01:54.251421 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:01:54.251869 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:01:54.254072 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:01:54.255312 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:01:54.256632 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:01:54.256992 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:01:54.257270 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:01:54.258214 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:01:54.258586 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:01:54.258930 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:01:54.259137 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:01:54.259392 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:01:54.259517 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:01:54.259672 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:01:54.259857 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:01:54.259964 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:01:54.260167 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lazy-loading 'vcpu_model' on Instance uuid e95baab0-2c43-4653-b7ae-b9d8920aba33 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:01:54.445491 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328914.4449723, 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:01:54.445947 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] VM Started (Lifecycle Event)
May 21 02:01:54.447742 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:01:54.451585 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:01:54.454793 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Instance spawned successfully.
May 21 02:01:54.455302 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:01:54.762904 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Object Instance<e95baab0-2c43-4653-b7ae-b9d8920aba33> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:01:54.780049 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:01:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1443229473',display_name='tempest-ServerRescueNegativeTestJSON-server-1443229473',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serverrescuenegativetestjson-server-1443229473',id=30,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:01:46Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87eb25eb23724c49b5bdbc462a1f36bc',ramdisk_id='',reservation_id='r-6i2xtfgb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1108613901',owner_user_name='tempest-ServerRescueNegativeTestJSON-1108613901-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:01:47Z,user_data=None,user_id='8b5074a8e47b444cb19c7dcf761ac2ae',uuid=e95baab0-2c43-4653-b7ae-b9d8920aba33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b74538b-3b3e-42f5-8f10-612c9d85b221", "address": "fa:16:3e:2b:20:c8", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "vif_mac": "fa:16:3e:2b:20:c8"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b74538b-3b", "ovs_interfaceid": "3b74538b-3b3e-42f5-8f10-612c9d85b221", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:01:54.780278 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Converting VIF {"id": "3b74538b-3b3e-42f5-8f10-612c9d85b221", "address": "fa:16:3e:2b:20:c8", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "vif_mac": "fa:16:3e:2b:20:c8"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b74538b-3b", "ovs_interfaceid": "3b74538b-3b3e-42f5-8f10-612c9d85b221", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:01:54.780955 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:20:c8,bridge_name='br-int',has_traffic_filtering=True,id=3b74538b-3b3e-42f5-8f10-612c9d85b221,network=Network(b8fcc592-f44d-440d-b1f1-c57714291c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b74538b-3b') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:01:54.782050 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lazy-loading 'pci_devices' on Instance uuid e95baab0-2c43-4653-b7ae-b9d8920aba33 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:01:54.804445 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:01:54.804655 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:01:54.804704 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:01:54.804974 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] No VIF found with MAC fa:16:3e:02:b4:9e, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:01:54.949290 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:01:54.954379 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:01:54.965665 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:01:54.965924 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:01:54.966877 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:01:54.967152 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:01:54.967767 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:01:54.968023 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:01:55.284803 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Object Instance<e95baab0-2c43-4653-b7ae-b9d8920aba33> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:01:55.285796 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] End _get_guest_xml xml=<domain type="qemu">
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:   <uuid>e95baab0-2c43-4653-b7ae-b9d8920aba33</uuid>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:   <name>instance-0000001e</name>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1443229473</nova:name>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:01:54</nova:creationTime>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:           <nova:property name="hw_machine_type">pc</nova:property>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:           <nova:property name="hw_video_model">virtio</nova:property>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:         <nova:user uuid="8b5074a8e47b444cb19c7dcf761ac2ae">tempest-ServerRescueNegativeTestJSON-1108613901-project-member</nova:user>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:         <nova:project uuid="87eb25eb23724c49b5bdbc462a1f36bc">tempest-ServerRescueNegativeTestJSON-1108613901</nova:project>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:         <nova:port uuid="3b74538b-3b3e-42f5-8f10-612c9d85b221">
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:     <system>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:       <entry name="serial">e95baab0-2c43-4653-b7ae-b9d8920aba33</entry>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:       <entry name="uuid">e95baab0-2c43-4653-b7ae-b9d8920aba33</entry>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:     </system>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:   <os>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:   </os>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:   <features>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:   </features>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:   <devices>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk.rescue"/>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:     </disk>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk"/>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:       <target dev="vdb" bus="virtio"/>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:     </disk>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk.config.rescue"/>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:     </disk>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:2b:20:c8"/>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:       <target dev="tap3b74538b-3b"/>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:     </interface>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/console.log" append="off"/>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:     </serial>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:     <video>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:     </video>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:     </rng>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:   </devices>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]: </domain>
May 21 02:01:55.285796 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:01:55.292514 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Instance destroyed successfully.
May 21 02:01:55.432281 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:55.458611 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:01:55.458611 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328915.4580104, 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:01:55.458611 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] VM Paused (Lifecycle Event)
May 21 02:01:55.475115 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Took 27.15 seconds to spawn the instance on the hypervisor.
May 21 02:01:55.476796 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:01:55.962277 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:01:55.965715 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328915.9653683, 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:01:55.965923 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] VM Resumed (Lifecycle Event)
May 21 02:01:55.993507 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Took 35.65 seconds to build instance.
May 21 02:01:56.336789 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:56.404013 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b377b4fa-af3b-4dc1-b31c-81a9b9233f9a tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "4f1b10cb-b101-4ef4-9f68-54bf1c6c68da" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.051s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:56.468350 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:01:56.470167 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:01:56.496061 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4a6a92e5-4d4a-407e-9440-9b12cf163fb2 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 37.163s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:56.812618 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:01:56.812820 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:01:56.812925 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:01:56.813091 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] No VIF found with MAC fa:16:3e:2b:20:c8, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:01:56.813553 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Using config drive
May 21 02:01:57.316227 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lazy-loading 'ec2_ids' on Instance uuid e95baab0-2c43-4653-b7ae-b9d8920aba33 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:01:57.528961 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "4f1b10cb-b101-4ef4-9f68-54bf1c6c68da" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:57.528961 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "4f1b10cb-b101-4ef4-9f68-54bf1c6c68da" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:57.557673 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-31f3a2bc-d6ae-43c0-a2a7-57a9b03c2c3f req-ccaf9598-9298-4efc-ba27-45f706d24594 service nova] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Received event network-changed-c0e8bfdd-1ce7-47c4-a730-362b39289635 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:01:57.557894 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-31f3a2bc-d6ae-43c0-a2a7-57a9b03c2c3f req-ccaf9598-9298-4efc-ba27-45f706d24594 service nova] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Refreshing instance network info cache due to event network-changed-c0e8bfdd-1ce7-47c4-a730-362b39289635. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:01:57.558020 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-31f3a2bc-d6ae-43c0-a2a7-57a9b03c2c3f req-ccaf9598-9298-4efc-ba27-45f706d24594 service nova] Acquiring lock "refresh_cache-23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:01:57.558126 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-31f3a2bc-d6ae-43c0-a2a7-57a9b03c2c3f req-ccaf9598-9298-4efc-ba27-45f706d24594 service nova] Acquired lock "refresh_cache-23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:01:57.558238 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-31f3a2bc-d6ae-43c0-a2a7-57a9b03c2c3f req-ccaf9598-9298-4efc-ba27-45f706d24594 service nova] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Refreshing network info cache for port c0e8bfdd-1ce7-47c4-a730-362b39289635 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:01:57.820604 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Object Instance<e95baab0-2c43-4653-b7ae-b9d8920aba33> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:01:57.820850 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lazy-loading 'keypairs' on Instance uuid e95baab0-2c43-4653-b7ae-b9d8920aba33 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:01:58.033641 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Detaching volume de372a77-2a1d-4c74-8c0e-051c45ddb3f4
May 21 02:01:58.071075 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-31f3a2bc-d6ae-43c0-a2a7-57a9b03c2c3f req-ccaf9598-9298-4efc-ba27-45f706d24594 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:58.093721 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Attempting to driver detach volume de372a77-2a1d-4c74-8c0e-051c45ddb3f4 from mountpoint /dev/vdb
May 21 02:01:58.151724 np0000001127 nova-compute[98206]: DEBUG os_brick.encryptors [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'plain'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4', 'iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'de372a77-2a1d-4c74-8c0e-051c45ddb3f4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-5'}, 'status': 'reserved', 'instance': '4f1b10cb-b101-4ef4-9f68-54bf1c6c68da', 'attached_at': '', 'detached_at': '', 'volume_id': 'de372a77-2a1d-4c74-8c0e-051c45ddb3f4', 'serial': 'de372a77-2a1d-4c74-8c0e-051c45ddb3f4'} {{(pid=98206) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 21 02:01:58.158698 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Found disk vdb by alias ua-de372a77-2a1d-4c74-8c0e-051c45ddb3f4 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:01:58.160574 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Found disk vdb by alias ua-de372a77-2a1d-4c74-8c0e-051c45ddb3f4 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:01:58.161525 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Attempting to detach device vdb from instance 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 02:01:58.162000 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:01:58.162000 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:01:58.162000 np0000001127 nova-compute[98206]:   <alias name="ua-de372a77-2a1d-4c74-8c0e-051c45ddb3f4"/>
May 21 02:01:58.162000 np0000001127 nova-compute[98206]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-5"/>
May 21 02:01:58.162000 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:01:58.162000 np0000001127 nova-compute[98206]:   <serial>de372a77-2a1d-4c74-8c0e-051c45ddb3f4</serial>
May 21 02:01:58.162000 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:01:58.162000 np0000001127 nova-compute[98206]: </disk>
May 21 02:01:58.162000 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:01:58.170855 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Successfully detached device vdb from instance 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da from the persistent domain config.
May 21 02:01:58.171136 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] (1/8): Attempting to detach device vdb with device alias ua-de372a77-2a1d-4c74-8c0e-051c45ddb3f4 from instance 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 02:01:58.171434 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:01:58.171434 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:01:58.171434 np0000001127 nova-compute[98206]:   <alias name="ua-de372a77-2a1d-4c74-8c0e-051c45ddb3f4"/>
May 21 02:01:58.171434 np0000001127 nova-compute[98206]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-5"/>
May 21 02:01:58.171434 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:01:58.171434 np0000001127 nova-compute[98206]:   <serial>de372a77-2a1d-4c74-8c0e-051c45ddb3f4</serial>
May 21 02:01:58.171434 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:01:58.171434 np0000001127 nova-compute[98206]: </disk>
May 21 02:01:58.171434 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:01:58.324519 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Object Instance<e95baab0-2c43-4653-b7ae-b9d8920aba33> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:01:58.331294 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:58.527918 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Creating config drive at /opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk.config.rescue
May 21 02:01:58.539555 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0yj8k3g5 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:01:58.580526 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-31f3a2bc-d6ae-43c0-a2a7-57a9b03c2c3f req-ccaf9598-9298-4efc-ba27-45f706d24594 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:01:58.615785 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0yj8k3g5" returned: 0 in 0.076s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:01:58.782834 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-31f3a2bc-d6ae-43c0-a2a7-57a9b03c2c3f req-ccaf9598-9298-4efc-ba27-45f706d24594 service nova] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Updated VIF entry in instance network info cache for port c0e8bfdd-1ce7-47c4-a730-362b39289635. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:01:58.783234 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-31f3a2bc-d6ae-43c0-a2a7-57a9b03c2c3f req-ccaf9598-9298-4efc-ba27-45f706d24594 service nova] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Updating instance_info_cache with network_info: [{"id": "c0e8bfdd-1ce7-47c4-a730-362b39289635", "address": "fa:16:3e:41:22:0a", "network": {"id": "101a7f52-26cc-4331-b0f1-02b8c890fb35", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1092866296-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb7bdb5c7bbb4465b12c92ffdd425114", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0e8bfdd-1c", "ovs_interfaceid": "c0e8bfdd-1ce7-47c4-a730-362b39289635", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:01:59.117052 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779328919.1165104, 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da => ua-de372a77-2a1d-4c74-8c0e-051c45ddb3f4> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 02:01:59.118866 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-de372a77-2a1d-4c74-8c0e-051c45ddb3f4 for instance 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 02:01:59.131005 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Successfully detached device vdb from instance 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da from the live domain config.
May 21 02:01:59.137026 np0000001127 nova-compute[98206]: WARNING stevedore.named [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 21 02:01:59.137533 np0000001127 nova-compute[98206]: WARNING castellan.key_manager [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 21 02:01:59.137533 np0000001127 nova-compute[98206]: WARNING nova.keymgr.conf_key_mgr [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 21 02:01:59.137994 np0000001127 nova-compute[98206]: DEBUG os_brick.encryptors [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Using volume encryptor '<os_brick.encryptors.cryptsetup.CryptsetupEncryptor object at 0x71c05864b0e0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4', 'iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'de372a77-2a1d-4c74-8c0e-051c45ddb3f4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-5'}, 'status': 'reserved', 'instance': '4f1b10cb-b101-4ef4-9f68-54bf1c6c68da', 'attached_at': '', 'detached_at': '', 'volume_id': 'de372a77-2a1d-4c74-8c0e-051c45ddb3f4', 'serial': 'de372a77-2a1d-4c74-8c0e-051c45ddb3f4'} {{(pid=98206) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 21 02:01:59.138300 np0000001127 nova-compute[98206]: DEBUG os_brick.encryptors.cryptsetup [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] closing encrypted volume /dev/dm-7 {{(pid=98206) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/cryptsetup.py:153}}
May 21 02:01:59.165840 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:01:59.166173 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4', 'iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'de372a77-2a1d-4c74-8c0e-051c45ddb3f4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:01:59.166352 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:01:59.166900 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:01:59.167175 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4', 'iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'de372a77-2a1d-4c74-8c0e-051c45ddb3f4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:01:59.167308 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:01:59.201088 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:59.201088 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:59.201088 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:59.201088 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:59.201088 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:01:59.201088 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:01:59.201088 np0000001127 nova-compute[98206]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4 (non-flash)
May 21 02:01:59.201088 np0000001127 nova-compute[98206]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4 (non-flash)
May 21 02:01:59.201088 np0000001127 nova-compute[98206]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:01:59.201088 np0000001127 nova-compute[98206]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:01:59.201088 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:01:59.201390 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:59.201390 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:01:59.201390 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:59.201390 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:01:59.201390 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:01:59.201390 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:01:59.201390 np0000001127 nova-compute[98206]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4 (non-flash)
May 21 02:01:59.201390 np0000001127 nova-compute[98206]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4 (non-flash)
May 21 02:01:59.201390 np0000001127 nova-compute[98206]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:01:59.201390 np0000001127 nova-compute[98206]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:01:59.201390 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:01:59.201595 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6', '52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6', '53'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', '56'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4', '58'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4', '59'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', '60'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', '61')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:01:59.201654 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4', '59')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:01:59.203153 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4', '58')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:01:59.204370 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c058405120>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4'): ({'sdh'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:01:59.204599 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Removing multipathed devices sdi, sdh {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:01:59.204871 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Flush multipath device 33000000040b9d491 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:01:59.239499 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:01:59.277748 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:59.289417 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-31f3a2bc-d6ae-43c0-a2a7-57a9b03c2c3f req-ccaf9598-9298-4efc-ba27-45f706d24594 service nova] Releasing lock "refresh_cache-23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:01:59.291736 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:01:59.307357 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:59.332058 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:01:59.332628 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:01:59.334845 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:01:59.348500 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:01:59.348831 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:01:59.369101 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:59.380251 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:59.415628 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4, portal: 192.168.40.100,3260]
May 21 02:01:59.415628 np0000001127 nova-compute[98206]: Logout of [sid: 59, target: iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4, portal: 192.168.40.100,3260] successful.
May 21 02:01:59.415628 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:59.437761 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:59.455111 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:59.491186 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:59.492455 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:01:59.500263 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4, portal: 192.168.50.100,3260]
May 21 02:01:59.500263 np0000001127 nova-compute[98206]: Logout of [sid: 58, target: iqn.2023-03.storpool.com:os--volume-de372a77-2a1d-4c74-8c0e-051c45ddb3f4, portal: 192.168.50.100,3260] successful.
May 21 02:01:59.500263 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:59.526798 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:01:59.530802 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:01:59.532275 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] <== disconnect_volume: return (364ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:01:59.532275 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:01:59.841143 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bdb94f42-f89b-47c4-8ba7-5f15bdb22287 req-456b1d6f-8fb4-4312-bb8c-bc91b2b8b612 service nova] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Received event network-vif-plugged-3b74538b-3b3e-42f5-8f10-612c9d85b221 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:01:59.843617 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bdb94f42-f89b-47c4-8ba7-5f15bdb22287 req-456b1d6f-8fb4-4312-bb8c-bc91b2b8b612 service nova] Acquiring lock "e95baab0-2c43-4653-b7ae-b9d8920aba33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:59.844904 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bdb94f42-f89b-47c4-8ba7-5f15bdb22287 req-456b1d6f-8fb4-4312-bb8c-bc91b2b8b612 service nova] Lock "e95baab0-2c43-4653-b7ae-b9d8920aba33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:01:59.845117 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bdb94f42-f89b-47c4-8ba7-5f15bdb22287 req-456b1d6f-8fb4-4312-bb8c-bc91b2b8b612 service nova] Lock "e95baab0-2c43-4653-b7ae-b9d8920aba33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:01:59.845359 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bdb94f42-f89b-47c4-8ba7-5f15bdb22287 req-456b1d6f-8fb4-4312-bb8c-bc91b2b8b612 service nova] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] No waiting events found dispatching network-vif-plugged-3b74538b-3b3e-42f5-8f10-612c9d85b221 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:01:59.845629 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-bdb94f42-f89b-47c4-8ba7-5f15bdb22287 req-456b1d6f-8fb4-4312-bb8c-bc91b2b8b612 service nova] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Received unexpected event network-vif-plugged-3b74538b-3b3e-42f5-8f10-612c9d85b221 for instance with vm_state active and task_state rescuing.
May 21 02:01:59.944791 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Acquiring lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:01:59.946984 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:00.115055 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lazy-loading 'flavor' on Instance uuid 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:00.433880 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:00.438753 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Removed pending STOPPED event for e95baab0-2c43-4653-b7ae-b9d8920aba33 due to new event <LifecycleEvent: 1779328920.4382532, e95baab0-2c43-4653-b7ae-b9d8920aba33 => Resumed> {{(pid=98206) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 21 02:02:00.442785 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328920.4382532, e95baab0-2c43-4653-b7ae-b9d8920aba33 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:02:00.442785 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] VM Resumed (Lifecycle Event)
May 21 02:02:00.445439 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-8823007f-ee7a-44ea-b1f4-7edfa7e84623 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:02:00.454052 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lazy-loading 'flavor' on Instance uuid e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:00.950601 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:02:00.961096 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:02:01.123372 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e223ed4b-77ac-4705-8b70-243be839cfc9 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "4f1b10cb-b101-4ef4-9f68-54bf1c6c68da" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.595s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:01.339853 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:01.461584 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.516s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:01.466774 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328921.4646778, e95baab0-2c43-4653-b7ae-b9d8920aba33 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:02:01.466774 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] VM Started (Lifecycle Event)
May 21 02:02:01.684558 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 req-0cef39c1-c74b-451b-bf90-a74292a875c7 service nova] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Received event volume-reimaged-b38b53ce-4cdb-4612-9475-9ea4e1b1205b {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:01.684558 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 req-0cef39c1-c74b-451b-bf90-a74292a875c7 service nova] Acquiring lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:01.684558 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 req-0cef39c1-c74b-451b-bf90-a74292a875c7 service nova] Lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:01.684558 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 req-0cef39c1-c74b-451b-bf90-a74292a875c7 service nova] Lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:01.684558 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 req-0cef39c1-c74b-451b-bf90-a74292a875c7 service nova] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Processing event volume-reimaged-b38b53ce-4cdb-4612-9475-9ea4e1b1205b {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:02:01.685023 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Instance event wait completed in 7 seconds for volume-reimaged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:02:01.927706 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2e7afc7d-fbbe-4237-a417-87303969bb00 req-07e07cc7-b638-4310-a577-0cf9a13de75d service nova] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Received event network-changed-c0e8bfdd-1ce7-47c4-a730-362b39289635 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:01.927706 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2e7afc7d-fbbe-4237-a417-87303969bb00 req-07e07cc7-b638-4310-a577-0cf9a13de75d service nova] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Refreshing instance network info cache due to event network-changed-c0e8bfdd-1ce7-47c4-a730-362b39289635. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:02:01.927936 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2e7afc7d-fbbe-4237-a417-87303969bb00 req-07e07cc7-b638-4310-a577-0cf9a13de75d service nova] Acquiring lock "refresh_cache-23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:02:01.928053 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2e7afc7d-fbbe-4237-a417-87303969bb00 req-07e07cc7-b638-4310-a577-0cf9a13de75d service nova] Acquired lock "refresh_cache-23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:02:01.928185 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-2e7afc7d-fbbe-4237-a417-87303969bb00 req-07e07cc7-b638-4310-a577-0cf9a13de75d service nova] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Refreshing network info cache for port c0e8bfdd-1ce7-47c4-a730-362b39289635 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:02:01.968058 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:02:01.970824 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:02:02.113086 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f9837fa4-7f4c-4f66-8992-dd88a634c2b0 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "4f1b10cb-b101-4ef4-9f68-54bf1c6c68da" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:02.113308 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f9837fa4-7f4c-4f66-8992-dd88a634c2b0 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "4f1b10cb-b101-4ef4-9f68-54bf1c6c68da" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:02.113544 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f9837fa4-7f4c-4f66-8992-dd88a634c2b0 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "4f1b10cb-b101-4ef4-9f68-54bf1c6c68da-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:02.113726 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f9837fa4-7f4c-4f66-8992-dd88a634c2b0 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "4f1b10cb-b101-4ef4-9f68-54bf1c6c68da-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:02.113864 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f9837fa4-7f4c-4f66-8992-dd88a634c2b0 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "4f1b10cb-b101-4ef4-9f68-54bf1c6c68da-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:02.116268 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-f9837fa4-7f4c-4f66-8992-dd88a634c2b0 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Terminating instance
May 21 02:02:02.189674 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Booting with volume b38b53ce-4cdb-4612-9475-9ea4e1b1205b at /dev/vda
May 21 02:02:02.235320 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:02:02.249795 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:02:02.274088 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:02.314398 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:02:02.314774 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:02:02.324391 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:02:02.325905 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe9e:216', 'fe80::14d9:7bff:fe3b:f0dc', 'fe80::fc16:3eff:fe45:a237', 'fe80::fc16:3eff:fe02:b49e', 'fe80::f819:cdff:fe2b:de28', 'fe80::fc16:3eff:fe92:96ee', 'fe80::9c51:adff:febc:e222', 'fe80::fc16:3eff:fef4:b759', 'fe80::40b3:49ff:feb3:3b55', 'fe80::fc16:3eff:fe35:27d3', 'fe80::a403:4dff:fe5a:1b07', 'fe80::fc16:3eff:fe60:a612', 'fe80::789a:c1ff:fe89:a024', 'fe80::fc16:3eff:fe41:220a', 'fe80::3c32:60ff:fe45:d447', 'fe80::fc16:3eff:fe2b:20c8'] 
May 21 02:02:02.326005 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:02:02.326105 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:02:02.326319 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] <== get_connector_properties: return (90ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:02:02.326551 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Updating existing volume attachment record: f4590f95-3ee6-4493-a25b-e398e61af030 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:02:02.431307 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-2e7afc7d-fbbe-4237-a417-87303969bb00 req-07e07cc7-b638-4310-a577-0cf9a13de75d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:02.597238 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Acquiring lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:02.598208 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:02.598439 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Attaching volume 0fe98eab-6f95-43f2-9f8a-a4dc45525665 to /dev/vdb
May 21 02:02:02.620011 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-f9837fa4-7f4c-4f66-8992-dd88a634c2b0 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:02:02.653299 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:02.658706 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:02.682178 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:02.684643 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:02:02.694070 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:02.711575 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:02:02.724641 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:02.758287 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:02.807773 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:02:02.808899 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:02:02.819040 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:02:02.821792 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe9e:216', 'fe80::14d9:7bff:fe3b:f0dc', 'fe80::fc16:3eff:fe45:a237', 'fe80::fc16:3eff:fe92:96ee', 'fe80::9c51:adff:febc:e222', 'fe80::fc16:3eff:fef4:b759', 'fe80::40b3:49ff:feb3:3b55', 'fe80::fc16:3eff:fe35:27d3', 'fe80::a403:4dff:fe5a:1b07', 'fe80::fc16:3eff:fe60:a612', 'fe80::789a:c1ff:fe89:a024', 'fe80::fc16:3eff:fe41:220a', 'fe80::3c32:60ff:fe45:d447', 'fe80::fc16:3eff:fe2b:20c8'] 
May 21 02:02:02.823670 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:02:02.823670 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:02:02.823670 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:02:02.823670 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Updating existing volume attachment record: 2511dc1b-d902-48ef-bcc4-5431bdaf9a6b {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:02:02.951187 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-2e7afc7d-fbbe-4237-a417-87303969bb00 req-07e07cc7-b638-4310-a577-0cf9a13de75d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:02.998456 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:03.010052 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:03.036068 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.99964633400009 future=<Future at 0x71c058452600 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:02:03.048210 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Instance destroyed successfully.
May 21 02:02:03.052625 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-f9837fa4-7f4c-4f66-8992-dd88a634c2b0 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lazy-loading 'resources' on Instance uuid 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:03.190602 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-2e7afc7d-fbbe-4237-a417-87303969bb00 req-07e07cc7-b638-4310-a577-0cf9a13de75d service nova] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Updated VIF entry in instance network info cache for port c0e8bfdd-1ce7-47c4-a730-362b39289635. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:02:03.190957 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-2e7afc7d-fbbe-4237-a417-87303969bb00 req-07e07cc7-b638-4310-a577-0cf9a13de75d service nova] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Updating instance_info_cache with network_info: [{"id": "c0e8bfdd-1ce7-47c4-a730-362b39289635", "address": "fa:16:3e:41:22:0a", "network": {"id": "101a7f52-26cc-4331-b0f1-02b8c890fb35", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1092866296-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb7bdb5c7bbb4465b12c92ffdd425114", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0e8bfdd-1c", "ovs_interfaceid": "c0e8bfdd-1ce7-47c4-a730-362b39289635", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:02:03.219795 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Rescuing
May 21 02:02:03.220118 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "refresh_cache-e158490e-746e-4c3b-924e-9aceed1662d0" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:02:03.220310 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquired lock "refresh_cache-e158490e-746e-4c3b-924e-9aceed1662d0" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:02:03.220584 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:02:03.409437 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:02:03.409912 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:02:03.410088 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:02:03.410562 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:02:03.410810 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:02:03.427052 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:02:03.430292 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:02:03.430292 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:02:03.430292 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:02:03.430292 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:02:03.430292 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:02:03.443008 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:02:03.443008 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:03.452681 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:02:03.452681 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:03.461495 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665] added
May 21 02:02:03.461495 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:02:03.461495 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:02:03.461495 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:02:03.461495 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:02:03.461495 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:02:03.461495 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:03.461961 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:02:03.462450 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0323(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:02:03.462450 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:02:03.466870 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665] added
May 21 02:02:03.466870 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:02:03.466870 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:02:03.466870 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:02:03.466870 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:02:03.466870 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:02:03.466870 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:03.468014 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:02:03.468579 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0396(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:02:03.468752 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:02:03.559200 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-f9837fa4-7f4c-4f66-8992-dd88a634c2b0 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:00:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1779327587',display_name='tempest-TestEncryptedCinderVolumes-server-1779327587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testencryptedcindervolumes-server-1779327587',id=25,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/hDqZkMajg3N/N4Ygb3hHFWCbrrX7jB2xTtn4M5janHb3yRzu8QOW0iBqMvpy5+6Wf5pau7rYMtKkAJyxmnZZ3SUFF6mpjcHbMND9BG0/76jIfmHdktnbmtYGBnQAVyw==',key_name='tempest-keypair-916059594',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:01:02Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='177bec65268546d2b899e09989183b6e',ramdisk_id='',reservation_id='r-3ynirpnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-991116896',owner_user_name='tempest-TestEncryptedCinderVolumes-991116896-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:01:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0efcbc1b88f49989c9f6b6a7439f2c4',uuid=4f1b10cb-b101-4ef4-9f68-54bf1c6c68da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a94bce6-2a69-438d-aa6e-d41ddef4d13e", "address": "fa:16:3e:02:b4:9e", "network": {"id": "38d66f09-c738-4e79-9aeb-12e87e29f568", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-447420743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "177bec65268546d2b899e09989183b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a94bce6-2a", "ovs_interfaceid": "9a94bce6-2a69-438d-aa6e-d41ddef4d13e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:02:03.559698 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-f9837fa4-7f4c-4f66-8992-dd88a634c2b0 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Converting VIF {"id": "9a94bce6-2a69-438d-aa6e-d41ddef4d13e", "address": "fa:16:3e:02:b4:9e", "network": {"id": "38d66f09-c738-4e79-9aeb-12e87e29f568", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-447420743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "177bec65268546d2b899e09989183b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a94bce6-2a", "ovs_interfaceid": "9a94bce6-2a69-438d-aa6e-d41ddef4d13e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:02:03.560198 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-f9837fa4-7f4c-4f66-8992-dd88a634c2b0 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:b4:9e,bridge_name='br-int',has_traffic_filtering=True,id=9a94bce6-2a69-438d-aa6e-d41ddef4d13e,network=Network(38d66f09-c738-4e79-9aeb-12e87e29f568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a94bce6-2a') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:02:03.560685 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-f9837fa4-7f4c-4f66-8992-dd88a634c2b0 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:b4:9e,bridge_name='br-int',has_traffic_filtering=True,id=9a94bce6-2a69-438d-aa6e-d41ddef4d13e,network=Network(38d66f09-c738-4e79-9aeb-12e87e29f568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a94bce6-2a') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:02:03.562536 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:03.563035 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a94bce6-2a, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:03.564373 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:03.565725 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:02:03.566187 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:03.567187 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:03.567421 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c5095cfe-f25f-45b6-b920-4eba62bde1ff) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:03.568185 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:03.568807 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:02:03.569069 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:03.571171 np0000001127 nova-compute[98206]: INFO os_vif [None req-f9837fa4-7f4c-4f66-8992-dd88a634c2b0 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:b4:9e,bridge_name='br-int',has_traffic_filtering=True,id=9a94bce6-2a69-438d-aa6e-d41ddef4d13e,network=Network(38d66f09-c738-4e79-9aeb-12e87e29f568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a94bce6-2a')
May 21 02:02:03.571670 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-f9837fa4-7f4c-4f66-8992-dd88a634c2b0 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Deleting instance files /opt/stack/data/nova/instances/4f1b10cb-b101-4ef4-9f68-54bf1c6c68da_del
May 21 02:02:03.572549 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-f9837fa4-7f4c-4f66-8992-dd88a634c2b0 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Deletion of /opt/stack/data/nova/instances/4f1b10cb-b101-4ef4-9f68-54bf1c6c68da_del complete
May 21 02:02:03.693778 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2e7afc7d-fbbe-4237-a417-87303969bb00 req-07e07cc7-b638-4310-a577-0cf9a13de75d service nova] Releasing lock "refresh_cache-23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:02:03.694319 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2e7afc7d-fbbe-4237-a417-87303969bb00 req-07e07cc7-b638-4310-a577-0cf9a13de75d service nova] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Received event network-vif-plugged-3b74538b-3b3e-42f5-8f10-612c9d85b221 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:03.694366 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2e7afc7d-fbbe-4237-a417-87303969bb00 req-07e07cc7-b638-4310-a577-0cf9a13de75d service nova] Acquiring lock "e95baab0-2c43-4653-b7ae-b9d8920aba33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:03.694591 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2e7afc7d-fbbe-4237-a417-87303969bb00 req-07e07cc7-b638-4310-a577-0cf9a13de75d service nova] Lock "e95baab0-2c43-4653-b7ae-b9d8920aba33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:03.694744 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2e7afc7d-fbbe-4237-a417-87303969bb00 req-07e07cc7-b638-4310-a577-0cf9a13de75d service nova] Lock "e95baab0-2c43-4653-b7ae-b9d8920aba33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:03.694900 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2e7afc7d-fbbe-4237-a417-87303969bb00 req-07e07cc7-b638-4310-a577-0cf9a13de75d service nova] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] No waiting events found dispatching network-vif-plugged-3b74538b-3b3e-42f5-8f10-612c9d85b221 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:02:03.695092 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-2e7afc7d-fbbe-4237-a417-87303969bb00 req-07e07cc7-b638-4310-a577-0cf9a13de75d service nova] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Received unexpected event network-vif-plugged-3b74538b-3b3e-42f5-8f10-612c9d85b221 for instance with vm_state rescued and task_state None.
May 21 02:02:03.724239 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:03.997080 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a5f570bd-2359-4a24-8683-d03e8270574a req-eedc05f8-b1ab-4102-9847-12a8ecec480b service nova] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Received event network-vif-unplugged-9a94bce6-2a69-438d-aa6e-d41ddef4d13e {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:03.998791 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a5f570bd-2359-4a24-8683-d03e8270574a req-eedc05f8-b1ab-4102-9847-12a8ecec480b service nova] Acquiring lock "4f1b10cb-b101-4ef4-9f68-54bf1c6c68da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:03.998945 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a5f570bd-2359-4a24-8683-d03e8270574a req-eedc05f8-b1ab-4102-9847-12a8ecec480b service nova] Lock "4f1b10cb-b101-4ef4-9f68-54bf1c6c68da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:03.999079 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a5f570bd-2359-4a24-8683-d03e8270574a req-eedc05f8-b1ab-4102-9847-12a8ecec480b service nova] Lock "4f1b10cb-b101-4ef4-9f68-54bf1c6c68da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:03.999239 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a5f570bd-2359-4a24-8683-d03e8270574a req-eedc05f8-b1ab-4102-9847-12a8ecec480b service nova] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] No waiting events found dispatching network-vif-unplugged-9a94bce6-2a69-438d-aa6e-d41ddef4d13e {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:02:03.999326 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a5f570bd-2359-4a24-8683-d03e8270574a req-eedc05f8-b1ab-4102-9847-12a8ecec480b service nova] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Received event network-vif-unplugged-9a94bce6-2a69-438d-aa6e-d41ddef4d13e for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:02:03.999443 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a5f570bd-2359-4a24-8683-d03e8270574a req-eedc05f8-b1ab-4102-9847-12a8ecec480b service nova] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Received event network-vif-unplugged-9a94bce6-2a69-438d-aa6e-d41ddef4d13e {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:03.999932 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a5f570bd-2359-4a24-8683-d03e8270574a req-eedc05f8-b1ab-4102-9847-12a8ecec480b service nova] Acquiring lock "4f1b10cb-b101-4ef4-9f68-54bf1c6c68da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:04.000076 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a5f570bd-2359-4a24-8683-d03e8270574a req-eedc05f8-b1ab-4102-9847-12a8ecec480b service nova] Lock "4f1b10cb-b101-4ef4-9f68-54bf1c6c68da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:04.000235 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a5f570bd-2359-4a24-8683-d03e8270574a req-eedc05f8-b1ab-4102-9847-12a8ecec480b service nova] Lock "4f1b10cb-b101-4ef4-9f68-54bf1c6c68da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:04.000278 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a5f570bd-2359-4a24-8683-d03e8270574a req-eedc05f8-b1ab-4102-9847-12a8ecec480b service nova] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] No waiting events found dispatching network-vif-unplugged-9a94bce6-2a69-438d-aa6e-d41ddef4d13e {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:02:04.000426 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a5f570bd-2359-4a24-8683-d03e8270574a req-eedc05f8-b1ab-4102-9847-12a8ecec480b service nova] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Received event network-vif-unplugged-9a94bce6-2a69-438d-aa6e-d41ddef4d13e for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:02:04.079943 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-f9837fa4-7f4c-4f66-8992-dd88a634c2b0 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Took 1.46 seconds to destroy the instance on the hypervisor.
May 21 02:02:04.080701 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-f9837fa4-7f4c-4f66-8992-dd88a634c2b0 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:02:04.080890 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:02:04.080992 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:02:04.081242 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:04.103991 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:04.230862 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:04.308328 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Updating instance_info_cache with network_info: [{"id": "0298cd31-6bbc-4653-a4ac-8d9b5def1753", "address": "fa:16:3e:60:a6:12", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0298cd31-6b", "ovs_interfaceid": "0298cd31-6bbc-4653-a4ac-8d9b5def1753", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:02:04.463157 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:02:04.469370 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:02:04.481209 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:02:04.481209 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Creating image(s)
May 21 02:02:04.481209 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Did not create local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 21 02:02:04.481209 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Ensure instance console log exists: /opt/stack/data/nova/instances/44334b65-4382-4a2d-80f1-a1ae2cdfe1e8/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:02:04.483134 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:04.483134 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:04.483134 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:04.483134 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Start _get_guest_xml network_info=[{"id": "1b938e0e-b319-49b6-a973-0e80c89b92e6", "address": "fa:16:3e:bc:04:20", "network": {"id": "effc5fd0-bb6d-41a3-aa93-0b65d17db1d9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2119568761-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dde2f210a0e4debaa655c852b3621da", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b938e0e-b3", "ovs_interfaceid": "1b938e0e-b319-49b6-a973-0e80c89b92e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-21T01:53:03Z,direct_url=<?>,disk_format='qcow2',id=fea37df7-c5b0-431e-9e55-09d856a51ff9,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-21T01:53:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '44334b65-4382-4a2d-80f1-a1ae2cdfe1e8', 'attached_at': '', 'detached_at': '', 'volume_id': 'b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'serial': 'b38b53ce-4cdb-4612-9475-9ea4e1b1205b'}, 'delete_on_termination': True, 'attachment_id': 'f4590f95-3ee6-4493-a25b-e398e61af030', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:02:04.487934 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
May 21 02:02:04.487934 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='fea37df7-c5b0-431e-9e55-09d856a51ff9', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-692094759', uuid='44334b65-4382-4a2d-80f1-a1ae2cdfe1e8'), owner=OwnerMeta(userid='45d8378885514dd79b666ba5f5352716', username='tempest-ServerActionsV293TestJSON-2031447781-project-member', projectid='9dde2f210a0e4debaa655c852b3621da', projectname='tempest-ServerActionsV293TestJSON-2031447781'), image=ImageMeta(id='', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1b938e0e-b319-49b6-a973-0e80c89b92e6", "address": "fa:16:3e:bc:04:20", "network": {"id": "effc5fd0-bb6d-41a3-aa93-0b65d17db1d9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2119568761-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dde2f210a0e4debaa655c852b3621da", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b938e0e-b3", "ovs_interfaceid": "1b938e0e-b319-49b6-a973-0e80c89b92e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328924.4872484) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:02:04.489097 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:02:04.489097 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:02:04.492765 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:02:04.492765 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:04.500119 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:02:04.500119 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:02:04.500119 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:02:04.500119 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:02:04.500119 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:02:04.500119 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-21T01:53:03Z,direct_url=<?>,disk_format='qcow2',id=fea37df7-c5b0-431e-9e55-09d856a51ff9,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-21T01:53:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:02:04.500119 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:02:04.500119 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:02:04.500119 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:02:04.500830 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:02:04.501330 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:02:04.501728 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:02:04.501956 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:02:04.502175 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:02:04.502384 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:02:04.502662 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:02:04.502936 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lazy-loading 'vcpu_model' on Instance uuid 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:04.511006 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:04.524626 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:04.535593 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:04.535593 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:04.535593 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:04.535593 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:04.535593 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:04.535593 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:04.535593 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:02:04.535593 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:04.535593 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:04.535593 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:04.535593 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:04.535593 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:04.535593 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:04.535593 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:02:04.548255 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:04.548255 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:04.548255 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:04.548255 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:04.548255 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:04.548255 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:04.548255 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:02:04.548613 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:04.548613 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:04.548613 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:04.548613 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:04.548613 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:04.548613 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:04.548613 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:02:04.590343 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665, portal: 192.168.50.100,3260]
May 21 02:02:04.590343 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665, portal: 192.168.50.100,3260] successful.
May 21 02:02:04.590343 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:04.608187 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:04.616202 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665, portal: 192.168.40.100,3260]
May 21 02:02:04.616202 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665, portal: 192.168.40.100,3260] successful.
May 21 02:02:04.616202 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:04.632568 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:04.632568 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:04.632568 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:04.632568 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:04.632568 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:04.632568 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:04.632568 np0000001127 nova-compute[98206]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:04.632568 np0000001127 nova-compute[98206]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:04.632568 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:02:04.633009 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:04.633009 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:04.633009 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:04.633009 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:04.633009 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:04.633009 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:04.633009 np0000001127 nova-compute[98206]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:04.633009 np0000001127 nova-compute[98206]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:04.633009 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:02:04.633190 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.204s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:02:04.633249 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:02:04.634121 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] HCTL ('13', '-', '-', 0) found on session 62 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:02:04.634246 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:02:04.635239 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:04.654297 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Searching for a device in session 62 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:02:04.656886 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:02:04.662458 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:04.662458 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:04.662458 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:04.662458 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:04.662458 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:04.662458 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:04.662458 np0000001127 nova-compute[98206]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:04.662458 np0000001127 nova-compute[98206]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:04.662458 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:02:04.662458 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:04.662458 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:04.662458 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:04.662458 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:04.662458 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:04.662458 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:04.662458 np0000001127 nova-compute[98206]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:04.662458 np0000001127 nova-compute[98206]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:04.662458 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:02:04.662458 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.232s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:02:04.662458 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:02:04.662458 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] HCTL ('14', '-', '-', 0) found on session 63 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:02:04.662458 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:02:04.689912 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Searching for a device in session 63 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:02:04.689912 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:02:04.812957 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Releasing lock "refresh_cache-e158490e-746e-4c3b-924e-9aceed1662d0" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:02:04.923446 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-668291b1-23a8-4d70-9acf-b528ecec0696 req-b14042c1-481e-46f0-a6e9-1cad504140fe service nova] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Received event network-vif-deleted-9a94bce6-2a69-438d-aa6e-d41ddef4d13e {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:04.923446 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-668291b1-23a8-4d70-9acf-b528ecec0696 req-b14042c1-481e-46f0-a6e9-1cad504140fe service nova] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Neutron deleted interface 9a94bce6-2a69-438d-aa6e-d41ddef4d13e; detaching it from the instance and deleting it from the info cache
May 21 02:02:04.923446 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-668291b1-23a8-4d70-9acf-b528ecec0696 req-b14042c1-481e-46f0-a6e9-1cad504140fe service nova] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:02:05.019102 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:02:05.019347 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:02:05.019481 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:02:05.350089 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:02:05.428668 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-668291b1-23a8-4d70-9acf-b528ecec0696 req-b14042c1-481e-46f0-a6e9-1cad504140fe service nova] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Detach interface failed, port_id=9a94bce6-2a69-438d-aa6e-d41ddef4d13e, reason: Instance 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:02:05.430074 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:02:05.852163 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Took 1.77 seconds to deallocate network for instance.
May 21 02:02:06.344629 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:06.359503 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f9837fa4-7f4c-4f66-8992-dd88a634c2b0 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:06.360027 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f9837fa4-7f4c-4f66-8992-dd88a634c2b0 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:06.446402 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Found WWN 3300000006680ae0e for multipath device dm-5 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:02:06.447730 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:02:06.447730 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '3300000006680ae0e', 'path': '/dev/dm-5', 'multipath_id': '3300000006680ae0e'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:02:06.447730 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006680ae0e', 'path': '/dev/dm-5', 'multipath_id': '3300000006680ae0e'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:02:06.448008 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.428s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:02:06.448089 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:02:06.449918 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lazy-loading 'flavor' on Instance uuid e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:06.461232 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:02:06.462054 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:02:06.462646 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:02:06.462893 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:02:06.463513 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:02:06.463513 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:02:06.480961 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:02:06.480961 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:06.484840 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:02:06.484840 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:06.497844 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b] added
May 21 02:02:06.497844 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:02:06.497844 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:02:06.497844 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:02:06.497844 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:02:06.497844 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:02:06.497844 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:06.500966 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:02:06.500966 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0368(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:02:06.500966 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:02:06.501384 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:06.506424 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b] added
May 21 02:02:06.506424 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:02:06.506424 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:02:06.506424 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:02:06.506424 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:02:06.506424 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:02:06.506424 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:06.506424 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:02:06.506424 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0433(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:02:06.506424 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:02:06.525995 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:06.720725 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:06.732935 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:06.815249 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:06.832153 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:06.841661 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:06.863312 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999576445000002 future=<Future at 0x71c07c50bb00 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:02:06.865583 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Instance destroyed successfully.
May 21 02:02:06.867051 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lazy-loading 'numa_topology' on Instance uuid e158490e-746e-4c3b-924e-9aceed1662d0 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:06.955017 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Attempting to attach volume 0fe98eab-6f95-43f2-9f8a-a4dc45525665 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 02:02:06.959091 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] attach device xml: <disk type="block" device="disk">
May 21 02:02:06.959091 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:02:06.959091 np0000001127 nova-compute[98206]:   <alias name="ua-0fe98eab-6f95-43f2-9f8a-a4dc45525665"/>
May 21 02:02:06.959091 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-5"/>
May 21 02:02:06.959091 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:02:06.959091 np0000001127 nova-compute[98206]:   <serial>0fe98eab-6f95-43f2-9f8a-a4dc45525665</serial>
May 21 02:02:06.959091 np0000001127 nova-compute[98206]: </disk>
May 21 02:02:06.959091 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 02:02:07.014939 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-4617454d-70b3-43ec-9472-b42814cdd9e5 req-c82d3780-9a23-4dd2-9df4-6c772c504a21 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Received event network-vif-unplugged-0298cd31-6bbc-4653-a4ac-8d9b5def1753 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:07.016460 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4617454d-70b3-43ec-9472-b42814cdd9e5 req-c82d3780-9a23-4dd2-9df4-6c772c504a21 service nova] Acquiring lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:07.016729 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4617454d-70b3-43ec-9472-b42814cdd9e5 req-c82d3780-9a23-4dd2-9df4-6c772c504a21 service nova] Lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:07.016924 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4617454d-70b3-43ec-9472-b42814cdd9e5 req-c82d3780-9a23-4dd2-9df4-6c772c504a21 service nova] Lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:07.017134 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-4617454d-70b3-43ec-9472-b42814cdd9e5 req-c82d3780-9a23-4dd2-9df4-6c772c504a21 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] No waiting events found dispatching network-vif-unplugged-0298cd31-6bbc-4653-a4ac-8d9b5def1753 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:02:07.017349 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-4617454d-70b3-43ec-9472-b42814cdd9e5 req-c82d3780-9a23-4dd2-9df4-6c772c504a21 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Received unexpected event network-vif-unplugged-0298cd31-6bbc-4653-a4ac-8d9b5def1753 for instance with vm_state active and task_state rescuing.
May 21 02:02:07.017538 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-4617454d-70b3-43ec-9472-b42814cdd9e5 req-c82d3780-9a23-4dd2-9df4-6c772c504a21 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Received event network-vif-unplugged-0298cd31-6bbc-4653-a4ac-8d9b5def1753 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:07.017895 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4617454d-70b3-43ec-9472-b42814cdd9e5 req-c82d3780-9a23-4dd2-9df4-6c772c504a21 service nova] Acquiring lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:07.018171 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4617454d-70b3-43ec-9472-b42814cdd9e5 req-c82d3780-9a23-4dd2-9df4-6c772c504a21 service nova] Lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:07.018355 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4617454d-70b3-43ec-9472-b42814cdd9e5 req-c82d3780-9a23-4dd2-9df4-6c772c504a21 service nova] Lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:07.018885 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-4617454d-70b3-43ec-9472-b42814cdd9e5 req-c82d3780-9a23-4dd2-9df4-6c772c504a21 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] No waiting events found dispatching network-vif-unplugged-0298cd31-6bbc-4653-a4ac-8d9b5def1753 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:02:07.018885 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-4617454d-70b3-43ec-9472-b42814cdd9e5 req-c82d3780-9a23-4dd2-9df4-6c772c504a21 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Received unexpected event network-vif-unplugged-0298cd31-6bbc-4653-a4ac-8d9b5def1753 for instance with vm_state active and task_state rescuing.
May 21 02:02:07.044552 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.00040279099994222634 future=<Future at 0x71c0584dfdd0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:02:07.044693 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:02:07.044941 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=10.990868036999927 future=<Future at 0x71c058452600 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:02:07.044941 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=10.990765377000116 future=<Future at 0x71c058452600 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:02:07.061381 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f9837fa4-7f4c-4f66-8992-dd88a634c2b0 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:02:07.061610 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-f9837fa4-7f4c-4f66-8992-dd88a634c2b0 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:02:07.371235 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Attempting rescue
May 21 02:02:07.371835 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98206) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 21 02:02:07.377008 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Instance directory exists: not creating {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 21 02:02:07.377166 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Creating image(s)
May 21 02:02:07.377999 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "/opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:07.378325 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "/opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:07.378989 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "/opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:07.379168 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lazy-loading 'trusted_certs' on Instance uuid e158490e-746e-4c3b-924e-9aceed1662d0 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:07.501257 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:02:07.507149 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:02:07.520266 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:02:07.520266 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:02:07.531504 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:02:07.531504 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:07.538123 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:07.547702 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:07.562874 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:07.562874 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:07.562874 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:07.562874 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:07.562874 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:07.562874 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:07.562874 np0000001127 nova-compute[98206]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:07.562874 np0000001127 nova-compute[98206]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:07.562874 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:02:07.563234 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:07.563234 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:07.563234 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:07.563234 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:07.563234 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:07.563234 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:07.563234 np0000001127 nova-compute[98206]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:07.563234 np0000001127 nova-compute[98206]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:07.563234 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:02:07.566186 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-f9837fa4-7f4c-4f66-8992-dd88a634c2b0 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:02:07.573913 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:07.573913 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:07.573913 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:07.573913 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:07.573913 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:07.573913 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:07.573913 np0000001127 nova-compute[98206]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:07.573913 np0000001127 nova-compute[98206]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:07.573913 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:02:07.573913 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:07.573913 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:07.573913 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:07.573913 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:07.573913 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:07.573913 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:07.573913 np0000001127 nova-compute[98206]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:07.573913 np0000001127 nova-compute[98206]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:07.573913 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:02:07.619149 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b, portal: 192.168.50.100,3260]
May 21 02:02:07.619149 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b, portal: 192.168.50.100,3260] successful.
May 21 02:02:07.619149 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:07.628602 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b, portal: 192.168.40.100,3260]
May 21 02:02:07.628602 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b, portal: 192.168.40.100,3260] successful.
May 21 02:02:07.628602 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:07.638820 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:07.644793 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:07.666127 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:07.666127 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:07.666127 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:07.666127 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:07.666127 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:07.666127 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:07.666127 np0000001127 nova-compute[98206]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:07.666127 np0000001127 nova-compute[98206]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:07.666127 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:07.666127 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:07.666127 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:02:07.666747 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:07.666747 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:07.666747 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:07.666747 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:07.666747 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:07.666747 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:07.666747 np0000001127 nova-compute[98206]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:07.666747 np0000001127 nova-compute[98206]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:07.666747 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:07.666747 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:07.666747 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:02:07.666747 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.203s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:02:07.666747 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:02:07.668100 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] HCTL ('15', '-', '-', 0) found on session 64 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:02:07.668195 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:02:07.673506 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:07.673506 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:07.673506 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:07.673506 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:07.673506 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:07.673506 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:07.673506 np0000001127 nova-compute[98206]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:07.673506 np0000001127 nova-compute[98206]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:07.673506 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:07.673506 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:07.673506 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:02:07.673974 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:07.673974 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:07.673974 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:07.673974 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:07.673974 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:07.673974 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:07.673974 np0000001127 nova-compute[98206]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:07.673974 np0000001127 nova-compute[98206]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:07.673974 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:07.673974 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:07.673974 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:02:07.673974 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.211s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:02:07.674325 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:02:07.675678 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] HCTL ('16', '-', '-', 0) found on session 65 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:02:07.676099 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:02:07.693352 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Searching for a device in session 64 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:02:07.700275 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:02:07.700275 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Searching for a device in session 65 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:02:07.700275 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:02:07.887166 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Object Instance<e158490e-746e-4c3b-924e-9aceed1662d0> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:02:07.888001 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:02:07.892069 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:02:07.895740 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:07.895968 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:07.896233 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:02:07.906214 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:02:07.907820 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:08.039747 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.133s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:08.040364 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/disk.rescue {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:08.079265 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f9837fa4-7f4c-4f66-8992-dd88a634c2b0 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.718s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:08.115579 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/disk.rescue" returned: 0 in 0.072s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:08.115579 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:08.115579 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lazy-loading 'migration_context' on Instance uuid e158490e-746e-4c3b-924e-9aceed1662d0 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:08.173972 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-f9837fa4-7f4c-4f66-8992-dd88a634c2b0 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Deleted allocations for instance 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da
May 21 02:02:08.463984 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:02:08.569160 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:08.621288 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Object Instance<e158490e-746e-4c3b-924e-9aceed1662d0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:02:08.621288 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:02:08.621288 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Start _get_guest_xml network_info=[{"id": "0298cd31-6bbc-4653-a4ac-8d9b5def1753", "address": "fa:16:3e:60:a6:12", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "vif_mac": "fa:16:3e:60:a6:12"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0298cd31-6b", "ovs_interfaceid": "0298cd31-6bbc-4653-a4ac-8d9b5def1753", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1545019a-a9af-4414-b299-e8f325be0886', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:02:08.621288 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lazy-loading 'resources' on Instance uuid e158490e-746e-4c3b-924e-9aceed1662d0 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:08.656644 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:02:08.656760 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:02:08.656936 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:02:08.657016 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] No VIF found with MAC fa:16:3e:92:96:ee, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:02:09.123179 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Object Instance<e158490e-746e-4c3b-924e-9aceed1662d0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:02:09.126265 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:02:09.126779 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1853847854', uuid='e158490e-746e-4c3b-924e-9aceed1662d0'), owner=OwnerMeta(userid='8b5074a8e47b444cb19c7dcf761ac2ae', username='tempest-ServerRescueNegativeTestJSON-1108613901-project-member', projectid='87eb25eb23724c49b5bdbc462a1f36bc', projectname='tempest-ServerRescueNegativeTestJSON-1108613901'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0298cd31-6bbc-4653-a4ac-8d9b5def1753", "address": "fa:16:3e:60:a6:12", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "vif_mac": "fa:16:3e:60:a6:12"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0298cd31-6b", "ovs_interfaceid": "0298cd31-6bbc-4653-a4ac-8d9b5def1753", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328929.1260836) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:02:09.128164 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:02:09.128826 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:02:09.130265 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:02:09.130265 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:02:09.131200 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:02:09.131711 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:02:09.132072 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:02:09.132284 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:02:09.132724 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:02:09.132724 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:02:09.132901 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:02:09.133887 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:02:09.133887 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:02:09.133887 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:02:09.133887 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:02:09.133887 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:02:09.134282 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lazy-loading 'vcpu_model' on Instance uuid e158490e-746e-4c3b-924e-9aceed1662d0 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:09.186415 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f9837fa4-7f4c-4f66-8992-dd88a634c2b0 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "4f1b10cb-b101-4ef4-9f68-54bf1c6c68da" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.073s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:09.486880 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Found WWN 330000000c2b561bb for multipath device dm-7 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:02:09.487394 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:02:09.487710 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] <== connect_volume: return (4467ms) {'type': 'block', 'scsi_wwn': '330000000c2b561bb', 'path': '/dev/dm-7', 'multipath_id': '330000000c2b561bb'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:02:09.487932 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c2b561bb', 'path': '/dev/dm-7', 'multipath_id': '330000000c2b561bb'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:02:09.638515 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Object Instance<e158490e-746e-4c3b-924e-9aceed1662d0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:02:09.649547 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:01:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1853847854',display_name='tempest-ServerRescueNegativeTestJSON-server-1853847854',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serverrescuenegativetestjson-server-1853847854',id=29,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:01:45Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87eb25eb23724c49b5bdbc462a1f36bc',ramdisk_id='',reservation_id='r-bkabzv7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1108613901',owner_user_name='tempest-ServerRescueNegativeTestJSON-1108613901-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:01:45Z,user_data=None,user_id='8b5074a8e47b444cb19c7dcf761ac2ae',uuid=e158490e-746e-4c3b-924e-9aceed1662d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0298cd31-6bbc-4653-a4ac-8d9b5def1753", "address": "fa:16:3e:60:a6:12", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "vif_mac": "fa:16:3e:60:a6:12"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0298cd31-6b", "ovs_interfaceid": "0298cd31-6bbc-4653-a4ac-8d9b5def1753", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:02:09.650319 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Converting VIF {"id": "0298cd31-6bbc-4653-a4ac-8d9b5def1753", "address": "fa:16:3e:60:a6:12", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "vif_mac": "fa:16:3e:60:a6:12"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0298cd31-6b", "ovs_interfaceid": "0298cd31-6bbc-4653-a4ac-8d9b5def1753", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:02:09.651057 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:a6:12,bridge_name='br-int',has_traffic_filtering=True,id=0298cd31-6bbc-4653-a4ac-8d9b5def1753,network=Network(b8fcc592-f44d-440d-b1f1-c57714291c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0298cd31-6b') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:02:09.652056 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lazy-loading 'pci_devices' on Instance uuid e158490e-746e-4c3b-924e-9aceed1662d0 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:09.997673 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-21T02:00:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-692094759',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serveractionsv293testjson-server-1227980448',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdSLsNf05ft6B/PkgYJEgNxCPaotlaC+SYwLSyQfqbTHXXe3gCjns78xO/QDQw3uXc0vYQiJCLA0+VzLHhxlUHFht+sbUG63daZBfxAE+WcylLxkwBu6nkTH7iMalcD6A==',key_name='tempest-keypair-121683660',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:00:41Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9dde2f210a0e4debaa655c852b3621da',ramdisk_id='',reservation_id='r-3sc7d1ev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='fea37df7-c5b0-431e-9e55-09d856a51ff9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2031447781',owner_user_name='tempest-ServerActionsV293TestJSON-2031447781-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:02:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45d8378885514dd79b666ba5f5352716',uuid=44334b65-4382-4a2d-80f1-a1ae2cdfe1e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b938e0e-b319-49b6-a973-0e80c89b92e6", "address": "fa:16:3e:bc:04:20", "network": {"id": "effc5fd0-bb6d-41a3-aa93-0b65d17db1d9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2119568761-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dde2f210a0e4debaa655c852b3621da", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b938e0e-b3", "ovs_interfaceid": "1b938e0e-b319-49b6-a973-0e80c89b92e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:02:09.997906 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Converting VIF {"id": "1b938e0e-b319-49b6-a973-0e80c89b92e6", "address": "fa:16:3e:bc:04:20", "network": {"id": "effc5fd0-bb6d-41a3-aa93-0b65d17db1d9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2119568761-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dde2f210a0e4debaa655c852b3621da", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b938e0e-b3", "ovs_interfaceid": "1b938e0e-b319-49b6-a973-0e80c89b92e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:02:09.999056 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:04:20,bridge_name='br-int',has_traffic_filtering=True,id=1b938e0e-b319-49b6-a973-0e80c89b92e6,network=Network(effc5fd0-bb6d-41a3-aa93-0b65d17db1d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b938e0e-b3') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:02:10.001515 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] End _get_guest_xml xml=<domain type="qemu">
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:   <uuid>44334b65-4382-4a2d-80f1-a1ae2cdfe1e8</uuid>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:   <name>instance-00000017</name>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:       <nova:name>tempest-ServerActionsV293TestJSON-server-692094759</nova:name>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:02:04</nova:creationTime>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:       <nova:image uuid="fea37df7-c5b0-431e-9e55-09d856a51ff9">
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:         <nova:user uuid="45d8378885514dd79b666ba5f5352716">tempest-ServerActionsV293TestJSON-2031447781-project-member</nova:user>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:         <nova:project uuid="9dde2f210a0e4debaa655c852b3621da">tempest-ServerActionsV293TestJSON-2031447781</nova:project>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:       <nova:root type="volume" uuid="fea37df7-c5b0-431e-9e55-09d856a51ff9"/>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:         <nova:port uuid="1b938e0e-b319-49b6-a973-0e80c89b92e6">
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:     <system>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:       <entry name="serial">44334b65-4382-4a2d-80f1-a1ae2cdfe1e8</entry>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:       <entry name="uuid">44334b65-4382-4a2d-80f1-a1ae2cdfe1e8</entry>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:     </system>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:   <os>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:   </os>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:   <features>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:   </features>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:   <devices>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/44334b65-4382-4a2d-80f1-a1ae2cdfe1e8/disk.config"/>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:     </disk>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:       <alias name="ua-b38b53ce-4cdb-4612-9475-9ea4e1b1205b"/>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-7"/>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:       <serial>b38b53ce-4cdb-4612-9475-9ea4e1b1205b</serial>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:     </disk>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:bc:04:20"/>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:       <target dev="tap1b938e0e-b3"/>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:     </interface>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/44334b65-4382-4a2d-80f1-a1ae2cdfe1e8/console.log" append="off"/>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:     </serial>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:     <video>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:     </video>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:     </rng>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:   </devices>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]: </domain>
May 21 02:02:10.001515 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:02:10.006324 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-21T02:00:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-692094759',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serveractionsv293testjson-server-1227980448',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdSLsNf05ft6B/PkgYJEgNxCPaotlaC+SYwLSyQfqbTHXXe3gCjns78xO/QDQw3uXc0vYQiJCLA0+VzLHhxlUHFht+sbUG63daZBfxAE+WcylLxkwBu6nkTH7iMalcD6A==',key_name='tempest-keypair-121683660',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:00:41Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9dde2f210a0e4debaa655c852b3621da',ramdisk_id='',reservation_id='r-3sc7d1ev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='fea37df7-c5b0-431e-9e55-09d856a51ff9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2031447781',owner_user_name='tempest-ServerActionsV293TestJSON-2031447781-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:02:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45d8378885514dd79b666ba5f5352716',uuid=44334b65-4382-4a2d-80f1-a1ae2cdfe1e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b938e0e-b319-49b6-a973-0e80c89b92e6", "address": "fa:16:3e:bc:04:20", "network": {"id": "effc5fd0-bb6d-41a3-aa93-0b65d17db1d9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2119568761-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dde2f210a0e4debaa655c852b3621da", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b938e0e-b3", "ovs_interfaceid": "1b938e0e-b319-49b6-a973-0e80c89b92e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:02:10.006324 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Converting VIF {"id": "1b938e0e-b319-49b6-a973-0e80c89b92e6", "address": "fa:16:3e:bc:04:20", "network": {"id": "effc5fd0-bb6d-41a3-aa93-0b65d17db1d9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2119568761-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dde2f210a0e4debaa655c852b3621da", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b938e0e-b3", "ovs_interfaceid": "1b938e0e-b319-49b6-a973-0e80c89b92e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:02:10.006324 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:04:20,bridge_name='br-int',has_traffic_filtering=True,id=1b938e0e-b319-49b6-a973-0e80c89b92e6,network=Network(effc5fd0-bb6d-41a3-aa93-0b65d17db1d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b938e0e-b3') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:02:10.006324 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:04:20,bridge_name='br-int',has_traffic_filtering=True,id=1b938e0e-b319-49b6-a973-0e80c89b92e6,network=Network(effc5fd0-bb6d-41a3-aa93-0b65d17db1d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b938e0e-b3') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:02:10.006324 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:10.007158 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:10.007158 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:02:10.008596 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:10.008853 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b7a3a121-bf88-5241-b88c-a927bc8bbdbd', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:10.011112 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:10.012199 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:02:10.017182 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:10.019574 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:10.019745 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b938e0e-b3, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:10.020129 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1b938e0e-b3, col_values=(('qos', UUID('d3c53508-7739-4fa3-894e-a59c316959dd')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:10.020303 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1b938e0e-b3, col_values=(('external_ids', {'iface-id': '1b938e0e-b319-49b6-a973-0e80c89b92e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:04:20', 'vm-uuid': '44334b65-4382-4a2d-80f1-a1ae2cdfe1e8'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:10.022705 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:10.022705 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:02:10.033351 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:10.033831 np0000001127 nova-compute[98206]: INFO os_vif [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:04:20,bridge_name='br-int',has_traffic_filtering=True,id=1b938e0e-b319-49b6-a973-0e80c89b92e6,network=Network(effc5fd0-bb6d-41a3-aa93-0b65d17db1d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b938e0e-b3')
May 21 02:02:10.153999 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Object Instance<e158490e-746e-4c3b-924e-9aceed1662d0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:02:10.155198 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] End _get_guest_xml xml=<domain type="qemu">
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:   <uuid>e158490e-746e-4c3b-924e-9aceed1662d0</uuid>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:   <name>instance-0000001d</name>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1853847854</nova:name>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:02:09</nova:creationTime>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:           <nova:property name="hw_machine_type">pc</nova:property>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:           <nova:property name="hw_video_model">virtio</nova:property>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:         <nova:user uuid="8b5074a8e47b444cb19c7dcf761ac2ae">tempest-ServerRescueNegativeTestJSON-1108613901-project-member</nova:user>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:         <nova:project uuid="87eb25eb23724c49b5bdbc462a1f36bc">tempest-ServerRescueNegativeTestJSON-1108613901</nova:project>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:         <nova:port uuid="0298cd31-6bbc-4653-a4ac-8d9b5def1753">
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:     <system>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:       <entry name="serial">e158490e-746e-4c3b-924e-9aceed1662d0</entry>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:       <entry name="uuid">e158490e-746e-4c3b-924e-9aceed1662d0</entry>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:     </system>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:   <os>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:   </os>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:   <features>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:   </features>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:   <devices>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/disk.rescue"/>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:     </disk>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/disk"/>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:       <target dev="vdb" bus="virtio"/>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:     </disk>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/disk.config.rescue"/>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:     </disk>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:60:a6:12"/>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:       <target dev="tap0298cd31-6b"/>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:     </interface>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/console.log" append="off"/>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:     </serial>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:     <video>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:     </video>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:     </rng>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:   </devices>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]: </domain>
May 21 02:02:10.155198 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:02:10.162412 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Instance destroyed successfully.
May 21 02:02:10.231434 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-6bad93e8-fe9a-4a71-babe-32d2701fee55 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.633s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:11.346515 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:11.564183 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:02:11.564367 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:02:11.564701 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] No VIF found with MAC fa:16:3e:bc:04:20, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:02:11.565303 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Using config drive
May 21 02:02:11.710492 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:02:11.710492 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:02:11.710492 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:02:11.710492 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] No VIF found with MAC fa:16:3e:60:a6:12, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:02:11.710492 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Using config drive
May 21 02:02:11.890381 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Stashing vm_state: active {{(pid=98206) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 21 02:02:12.068083 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lazy-loading 'ec2_ids' on Instance uuid 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:12.214558 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lazy-loading 'ec2_ids' on Instance uuid e158490e-746e-4c3b-924e-9aceed1662d0 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:12.447218 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:12.447797 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:12.572099 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Object Instance<44334b65-4382-4a2d-80f1-a1ae2cdfe1e8> lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:02:12.572323 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lazy-loading 'keypairs' on Instance uuid 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:12.716417 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Object Instance<e158490e-746e-4c3b-924e-9aceed1662d0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:02:12.718021 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lazy-loading 'keypairs' on Instance uuid e158490e-746e-4c3b-924e-9aceed1662d0 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:12.954327 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:02:12.954549 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Claim successful on node np0000001127
May 21 02:02:13.075385 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Object Instance<44334b65-4382-4a2d-80f1-a1ae2cdfe1e8> lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:02:13.078758 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError
May 21 02:02:13.205097 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Creating config drive at /opt/stack/data/nova/instances/44334b65-4382-4a2d-80f1-a1ae2cdfe1e8/disk.config
May 21 02:02:13.209025 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/44334b65-4382-4a2d-80f1-a1ae2cdfe1e8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpiaesy4dt {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:13.227497 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Object Instance<e158490e-746e-4c3b-924e-9aceed1662d0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:02:13.228955 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:13.279701 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/44334b65-4382-4a2d-80f1-a1ae2cdfe1e8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpiaesy4dt" returned: 0 in 0.071s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:13.366081 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Creating config drive at /opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/disk.config.rescue
May 21 02:02:13.369306 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpw2rm3cbo {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:13.417949 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpw2rm3cbo" returned: 0 in 0.048s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:13.462836 np0000001127 nova-compute[98206]: INFO nova.compute.resource_tracker [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Updating resource usage from migration 68a1999a-d208-4f5f-aa8b-7dececf06b79
May 21 02:02:13.662704 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:13.662984 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:13.838378 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:13.878686 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:14.050920 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-3ae65efc-07d4-4391-9e87-a0a5755335e3 req-aebd1d5d-64c9-4d33-aa8d-8c51fc63ff81 service nova] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Received event network-vif-plugged-1b938e0e-b319-49b6-a973-0e80c89b92e6 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:14.051161 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-3ae65efc-07d4-4391-9e87-a0a5755335e3 req-aebd1d5d-64c9-4d33-aa8d-8c51fc63ff81 service nova] Acquiring lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:14.051419 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-3ae65efc-07d4-4391-9e87-a0a5755335e3 req-aebd1d5d-64c9-4d33-aa8d-8c51fc63ff81 service nova] Lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:14.051547 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-3ae65efc-07d4-4391-9e87-a0a5755335e3 req-aebd1d5d-64c9-4d33-aa8d-8c51fc63ff81 service nova] Lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:14.052906 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-3ae65efc-07d4-4391-9e87-a0a5755335e3 req-aebd1d5d-64c9-4d33-aa8d-8c51fc63ff81 service nova] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] No waiting events found dispatching network-vif-plugged-1b938e0e-b319-49b6-a973-0e80c89b92e6 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:02:14.052906 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-3ae65efc-07d4-4391-9e87-a0a5755335e3 req-aebd1d5d-64c9-4d33-aa8d-8c51fc63ff81 service nova] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Received unexpected event network-vif-plugged-1b938e0e-b319-49b6-a973-0e80c89b92e6 for instance with vm_state active and task_state rebuild_spawning.
May 21 02:02:14.102965 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:14.169178 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:02:14.181192 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:02:14.181323 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:02:14.261063 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:14.267904 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:14.270561 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:14.294286 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:14.297752 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:14.399750 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:14.429699 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:14.532798 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:14.595786 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:14.597191 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:14.640453 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-670ca079-a059-4ca6-8b2a-cd11f0fe0da8 req-04942c9f-f306-4e99-9bc4-fd64e1c2f006 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Received event network-vif-plugged-0298cd31-6bbc-4653-a4ac-8d9b5def1753 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:14.640995 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-670ca079-a059-4ca6-8b2a-cd11f0fe0da8 req-04942c9f-f306-4e99-9bc4-fd64e1c2f006 service nova] Acquiring lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:14.641174 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-670ca079-a059-4ca6-8b2a-cd11f0fe0da8 req-04942c9f-f306-4e99-9bc4-fd64e1c2f006 service nova] Lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:14.641321 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-670ca079-a059-4ca6-8b2a-cd11f0fe0da8 req-04942c9f-f306-4e99-9bc4-fd64e1c2f006 service nova] Lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:14.641435 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-670ca079-a059-4ca6-8b2a-cd11f0fe0da8 req-04942c9f-f306-4e99-9bc4-fd64e1c2f006 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] No waiting events found dispatching network-vif-plugged-0298cd31-6bbc-4653-a4ac-8d9b5def1753 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:02:14.641636 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-670ca079-a059-4ca6-8b2a-cd11f0fe0da8 req-04942c9f-f306-4e99-9bc4-fd64e1c2f006 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Received unexpected event network-vif-plugged-0298cd31-6bbc-4653-a4ac-8d9b5def1753 for instance with vm_state active and task_state rescuing.
May 21 02:02:14.685852 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:02:14.725303 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:15.022451 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:15.194297 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.747s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:15.195640 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.469s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:15.195901 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Migrating
May 21 02:02:15.196142 np0000001127 nova-compute[98206]: DEBUG nova.compute.rpcapi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98206) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 21 02:02:15.207311 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:02:15.208303 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Claim successful on node np0000001127
May 21 02:02:15.224228 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328935.2237399, 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:02:15.224390 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] VM Resumed (Lifecycle Event)
May 21 02:02:15.227084 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Instance event wait completed in 0 seconds for  {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:02:15.227674 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:02:15.230017 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Instance spawned successfully.
May 21 02:02:15.230300 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:02:15.285487 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-5d87e08c-0e26-4347-b707-05ae98eacb70 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:02:15.721327 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Acquiring lock "refresh_cache-e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:02:15.723993 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Acquired lock "refresh_cache-e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:02:15.724143 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:02:15.727293 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:02:15.733680 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:02:15.744277 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:02:15.744675 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:02:15.745009 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:02:15.745234 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:02:15.745538 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:02:15.745774 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:02:16.137608 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "df1fb869-23ef-48e0-b609-ce91c2540c2e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:16.138308 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:16.145034 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e70408f9-0af2-4831-86a7-0d7be611dcc1 req-b91585e1-d1b7-482c-8dcd-3e7e25ca847a service nova] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Received event network-vif-plugged-1b938e0e-b319-49b6-a973-0e80c89b92e6 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:16.145435 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e70408f9-0af2-4831-86a7-0d7be611dcc1 req-b91585e1-d1b7-482c-8dcd-3e7e25ca847a service nova] Acquiring lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:16.145765 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e70408f9-0af2-4831-86a7-0d7be611dcc1 req-b91585e1-d1b7-482c-8dcd-3e7e25ca847a service nova] Lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:16.146139 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e70408f9-0af2-4831-86a7-0d7be611dcc1 req-b91585e1-d1b7-482c-8dcd-3e7e25ca847a service nova] Lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:16.146274 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e70408f9-0af2-4831-86a7-0d7be611dcc1 req-b91585e1-d1b7-482c-8dcd-3e7e25ca847a service nova] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] No waiting events found dispatching network-vif-plugged-1b938e0e-b319-49b6-a973-0e80c89b92e6 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:02:16.146377 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-e70408f9-0af2-4831-86a7-0d7be611dcc1 req-b91585e1-d1b7-482c-8dcd-3e7e25ca847a service nova] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Received unexpected event network-vif-plugged-1b938e0e-b319-49b6-a973-0e80c89b92e6 for instance with vm_state active and task_state rebuild_spawning.
May 21 02:02:16.226561 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:16.242487 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
May 21 02:02:16.242666 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328936.242488, 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:02:16.242786 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] VM Started (Lifecycle Event)
May 21 02:02:16.251616 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:02:16.351710 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9a151643-7318-4fbf-b34d-14c8f8fa3da6 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Unrescuing
May 21 02:02:16.353035 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9a151643-7318-4fbf-b34d-14c8f8fa3da6 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "refresh_cache-e158490e-746e-4c3b-924e-9aceed1662d0" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:02:16.353139 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9a151643-7318-4fbf-b34d-14c8f8fa3da6 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquired lock "refresh_cache-e158490e-746e-4c3b-924e-9aceed1662d0" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:02:16.353465 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-9a151643-7318-4fbf-b34d-14c8f8fa3da6 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:02:16.359821 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:16.644489 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lazy-loading 'flavor' on Instance uuid df1fb869-23ef-48e0-b609-ce91c2540c2e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:16.674811 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:16.749794 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:02:16.752581 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:02:16.764335 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:16.824943 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b2456e1e-5a88-4883-b56c-175441da2304 req-5bfd0f86-4662-47ed-a38b-f72e523ff3e1 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Received event network-vif-plugged-0298cd31-6bbc-4653-a4ac-8d9b5def1753 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:16.827522 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b2456e1e-5a88-4883-b56c-175441da2304 req-5bfd0f86-4662-47ed-a38b-f72e523ff3e1 service nova] Acquiring lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:16.827522 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b2456e1e-5a88-4883-b56c-175441da2304 req-5bfd0f86-4662-47ed-a38b-f72e523ff3e1 service nova] Lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:16.827522 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b2456e1e-5a88-4883-b56c-175441da2304 req-5bfd0f86-4662-47ed-a38b-f72e523ff3e1 service nova] Lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:16.827522 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b2456e1e-5a88-4883-b56c-175441da2304 req-5bfd0f86-4662-47ed-a38b-f72e523ff3e1 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] No waiting events found dispatching network-vif-plugged-0298cd31-6bbc-4653-a4ac-8d9b5def1753 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:02:16.827932 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-b2456e1e-5a88-4883-b56c-175441da2304 req-5bfd0f86-4662-47ed-a38b-f72e523ff3e1 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Received unexpected event network-vif-plugged-0298cd31-6bbc-4653-a4ac-8d9b5def1753 for instance with vm_state rescued and task_state unrescuing.
May 21 02:02:16.848098 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Updating instance_info_cache with network_info: [{"id": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "address": "fa:16:3e:92:96:ee", "network": {"id": "acd0fbfa-f6d3-457c-a46f-cb55a0527d2b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-127865059-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "513057b933ef4779a2e885ae526782b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516875-8b", "ovs_interfaceid": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:02:16.859070 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-9a151643-7318-4fbf-b34d-14c8f8fa3da6 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:17.008185 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:02:17.008185 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:02:17.254325 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-9a151643-7318-4fbf-b34d-14c8f8fa3da6 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:17.264171 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Removed pending STOPPED event for e158490e-746e-4c3b-924e-9aceed1662d0 due to new event <LifecycleEvent: 1779328937.263766, e158490e-746e-4c3b-924e-9aceed1662d0 => Resumed> {{(pid=98206) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 21 02:02:17.264294 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328937.263766, e158490e-746e-4c3b-924e-9aceed1662d0 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:02:17.264348 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] VM Resumed (Lifecycle Event)
May 21 02:02:17.352636 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Releasing lock "refresh_cache-e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:02:17.391490 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-13db3a2b-4767-478e-96b9-f0ccc1539b38 req-9b655750-d64f-4573-89fa-10be2e0c2d71 service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Received event network-changed-cbfb2d9f-c55f-4f12-8b0c-ce07a987798a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:17.394032 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-13db3a2b-4767-478e-96b9-f0ccc1539b38 req-9b655750-d64f-4573-89fa-10be2e0c2d71 service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Refreshing instance network info cache due to event network-changed-cbfb2d9f-c55f-4f12-8b0c-ce07a987798a. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:02:17.394032 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-13db3a2b-4767-478e-96b9-f0ccc1539b38 req-9b655750-d64f-4573-89fa-10be2e0c2d71 service nova] Acquiring lock "refresh_cache-e9edec14-452b-46fe-89c6-849ece08f527" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:02:17.394032 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-13db3a2b-4767-478e-96b9-f0ccc1539b38 req-9b655750-d64f-4573-89fa-10be2e0c2d71 service nova] Acquired lock "refresh_cache-e9edec14-452b-46fe-89c6-849ece08f527" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:02:17.394032 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-13db3a2b-4767-478e-96b9-f0ccc1539b38 req-9b655750-d64f-4573-89fa-10be2e0c2d71 service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Refreshing network info cache for port cbfb2d9f-c55f-4f12-8b0c-ce07a987798a {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:02:17.418825 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-9a151643-7318-4fbf-b34d-14c8f8fa3da6 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Updating instance_info_cache with network_info: [{"id": "0298cd31-6bbc-4653-a4ac-8d9b5def1753", "address": "fa:16:3e:60:a6:12", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0298cd31-6b", "ovs_interfaceid": "0298cd31-6bbc-4653-a4ac-8d9b5def1753", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:02:17.510775 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:02:17.654899 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.517s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:17.767959 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:02:17.768371 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:02:17.897098 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-13db3a2b-4767-478e-96b9-f0ccc1539b38 req-9b655750-d64f-4573-89fa-10be2e0c2d71 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:17.921166 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9a151643-7318-4fbf-b34d-14c8f8fa3da6 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Releasing lock "refresh_cache-e158490e-746e-4c3b-924e-9aceed1662d0" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:02:17.921651 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-9a151643-7318-4fbf-b34d-14c8f8fa3da6 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lazy-loading 'flavor' on Instance uuid e158490e-746e-4c3b-924e-9aceed1662d0 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:18.023291 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.829s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:18.023846 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:02:18.027132 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 1.263s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:18.027244 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Trying to apply a migration context that does not seem to be set for this instance {{(pid=98206) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}}
May 21 02:02:18.036239 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.00042822599993996846 future=<Future at 0x71c058452600 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:02:18.036239 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:02:18.036383 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=3.8263141330000963 future=<Future at 0x71c07c50bb00 state=cancelled>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:02:18.036535 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=3.826243792000014 future=<Future at 0x71c07c50bb00 state=cancelled>) was cancelled while queued, skipping {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:02:18.036535 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:02:18.037440 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Emitting event <LifecycleEvent: 1779328923.0355961, 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:02:18.037440 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] VM Stopped (Lifecycle Event)
May 21 02:02:18.254915 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-13db3a2b-4767-478e-96b9-f0ccc1539b38 req-9b655750-d64f-4573-89fa-10be2e0c2d71 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:18.271318 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 21 02:02:18.271611 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328938.2713978, e158490e-746e-4c3b-924e-9aceed1662d0 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:02:18.271785 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] VM Started (Lifecycle Event)
May 21 02:02:18.444240 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "e9edec14-452b-46fe-89c6-849ece08f527" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:18.444431 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "e9edec14-452b-46fe-89c6-849ece08f527" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:18.457221 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:18.482018 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:18.517068 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-13db3a2b-4767-478e-96b9-f0ccc1539b38 req-9b655750-d64f-4573-89fa-10be2e0c2d71 service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Updated VIF entry in instance network info cache for port cbfb2d9f-c55f-4f12-8b0c-ce07a987798a. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:02:18.517330 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-13db3a2b-4767-478e-96b9-f0ccc1539b38 req-9b655750-d64f-4573-89fa-10be2e0c2d71 service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Updating instance_info_cache with network_info: [{"id": "cbfb2d9f-c55f-4f12-8b0c-ce07a987798a", "address": "fa:16:3e:35:27:d3", "network": {"id": "7cdbc224-429f-49a6-86f3-307f51e53dfc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2078432126-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc797708a5a7400992765e41ee6ec260", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbfb2d9f-c5", "ovs_interfaceid": "cbfb2d9f-c55f-4f12-8b0c-ce07a987798a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:02:18.541368 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-5a4c50e5-b6c2-48ce-890a-4811787b602d tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 4f1b10cb-b101-4ef4-9f68-54bf1c6c68da] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:02:18.543215 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:02:18.544321 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:02:18.544321 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:18.544321 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:18.661418 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0efcbc1b88f49989c9f6b6a7439f2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177bec65268546d2b899e09989183b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:02:18.664607 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:18.668805 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:18.774780 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:02:18.834625 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.99968175999993 future=<Future at 0x71c07c7a9670 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:02:18.835198 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.99929446200008 future=<Future at 0x71c07c7a9670 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:02:18.835944 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.998341355000093 future=<Future at 0x71c07c7a9670 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:02:18.836219 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "df1fb869-23ef-48e0-b609-ce91c2540c2e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:18.836512 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:18.836866 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Attaching volume 8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 to /dev/vdb
May 21 02:02:18.846341 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Instance destroyed successfully.
May 21 02:02:18.847068 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-9a151643-7318-4fbf-b34d-14c8f8fa3da6 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lazy-loading 'numa_topology' on Instance uuid e158490e-746e-4c3b-924e-9aceed1662d0 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:18.871875 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Starting migrate_disk_and_power_off {{(pid=98206) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 21 02:02:18.906462 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-5a053d10-db0d-4c4b-86a9-2ff36a5ed6f2 req-e729d33c-9ce9-4f09-ac21-57e08f2536d5 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Received event network-vif-unplugged-0298cd31-6bbc-4653-a4ac-8d9b5def1753 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:18.914703 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5a053d10-db0d-4c4b-86a9-2ff36a5ed6f2 req-e729d33c-9ce9-4f09-ac21-57e08f2536d5 service nova] Acquiring lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:18.915070 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5a053d10-db0d-4c4b-86a9-2ff36a5ed6f2 req-e729d33c-9ce9-4f09-ac21-57e08f2536d5 service nova] Lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:18.915907 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:18.917245 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5a053d10-db0d-4c4b-86a9-2ff36a5ed6f2 req-e729d33c-9ce9-4f09-ac21-57e08f2536d5 service nova] Lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:18.917892 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-5a053d10-db0d-4c4b-86a9-2ff36a5ed6f2 req-e729d33c-9ce9-4f09-ac21-57e08f2536d5 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] No waiting events found dispatching network-vif-unplugged-0298cd31-6bbc-4653-a4ac-8d9b5def1753 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:02:18.917892 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-5a053d10-db0d-4c4b-86a9-2ff36a5ed6f2 req-e729d33c-9ce9-4f09-ac21-57e08f2536d5 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Received unexpected event network-vif-unplugged-0298cd31-6bbc-4653-a4ac-8d9b5def1753 for instance with vm_state rescued and task_state unrescuing.
May 21 02:02:18.918032 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-5a053d10-db0d-4c4b-86a9-2ff36a5ed6f2 req-e729d33c-9ce9-4f09-ac21-57e08f2536d5 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Received event network-vif-unplugged-0298cd31-6bbc-4653-a4ac-8d9b5def1753 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:18.918209 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5a053d10-db0d-4c4b-86a9-2ff36a5ed6f2 req-e729d33c-9ce9-4f09-ac21-57e08f2536d5 service nova] Acquiring lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:18.918362 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5a053d10-db0d-4c4b-86a9-2ff36a5ed6f2 req-e729d33c-9ce9-4f09-ac21-57e08f2536d5 service nova] Lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:18.918835 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5a053d10-db0d-4c4b-86a9-2ff36a5ed6f2 req-e729d33c-9ce9-4f09-ac21-57e08f2536d5 service nova] Lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:18.918928 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-5a053d10-db0d-4c4b-86a9-2ff36a5ed6f2 req-e729d33c-9ce9-4f09-ac21-57e08f2536d5 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] No waiting events found dispatching network-vif-unplugged-0298cd31-6bbc-4653-a4ac-8d9b5def1753 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:02:18.919120 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-5a053d10-db0d-4c4b-86a9-2ff36a5ed6f2 req-e729d33c-9ce9-4f09-ac21-57e08f2536d5 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Received unexpected event network-vif-unplugged-0298cd31-6bbc-4653-a4ac-8d9b5def1753 for instance with vm_state rescued and task_state unrescuing.
May 21 02:02:18.921576 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:02:18.928117 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:18.934705 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:18.940287 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:02:18.948814 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Detaching volume c5a59eca-d594-4eb2-9205-c45ac58af0f6
May 21 02:02:18.953575 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:18.965041 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:18.971113 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:19.021548 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-13db3a2b-4767-478e-96b9-f0ccc1539b38 req-9b655750-d64f-4573-89fa-10be2e0c2d71 service nova] Releasing lock "refresh_cache-e9edec14-452b-46fe-89c6-849ece08f527" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:02:19.028596 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:02:19.029612 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:02:19.037917 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Attempting to driver detach volume c5a59eca-d594-4eb2-9205-c45ac58af0f6 from mountpoint /dev/vdb
May 21 02:02:19.041584 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:02:19.041584 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe9e:216', 'fe80::14d9:7bff:fe3b:f0dc', 'fe80::fc16:3eff:fe45:a237', 'fe80::fc16:3eff:fef4:b759', 'fe80::40b3:49ff:feb3:3b55', 'fe80::fc16:3eff:fe35:27d3', 'fe80::a403:4dff:fe5a:1b07', 'fe80::789a:c1ff:fe89:a024', 'fe80::fc16:3eff:fe41:220a', 'fe80::3c32:60ff:fe45:d447', 'fe80::fc16:3eff:fe2b:20c8', 'fe80::fc16:3eff:febc:420', 'fe80::f8e2:1cff:fe30:95ec'] 
May 21 02:02:19.041584 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:02:19.041584 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:02:19.043223 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:02:19.043628 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Updating existing volume attachment record: 27a92abd-ff2b-4dad-bb64-587a1fd1083f {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:02:19.047342 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:02:19.050679 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d379a756-f29a-4c05-ad65-8ca4cdc3b043 tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.023s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:19.064018 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Found disk vdb by alias ua-c5a59eca-d594-4eb2-9205-c45ac58af0f6 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:02:19.067357 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Found disk vdb by alias ua-c5a59eca-d594-4eb2-9205-c45ac58af0f6 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:02:19.067559 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Attempting to detach device vdb from instance e9edec14-452b-46fe-89c6-849ece08f527 from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 02:02:19.068253 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:02:19.068253 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:02:19.068253 np0000001127 nova-compute[98206]:   <alias name="ua-c5a59eca-d594-4eb2-9205-c45ac58af0f6"/>
May 21 02:02:19.068253 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-1"/>
May 21 02:02:19.068253 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:02:19.068253 np0000001127 nova-compute[98206]:   <serial>c5a59eca-d594-4eb2-9205-c45ac58af0f6</serial>
May 21 02:02:19.068253 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:02:19.068253 np0000001127 nova-compute[98206]: </disk>
May 21 02:02:19.068253 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:02:19.081658 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Successfully detached device vdb from instance e9edec14-452b-46fe-89c6-849ece08f527 from the persistent domain config.
May 21 02:02:19.081658 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] (1/8): Attempting to detach device vdb with device alias ua-c5a59eca-d594-4eb2-9205-c45ac58af0f6 from instance e9edec14-452b-46fe-89c6-849ece08f527 from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 02:02:19.082270 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:02:19.082270 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:02:19.082270 np0000001127 nova-compute[98206]:   <alias name="ua-c5a59eca-d594-4eb2-9205-c45ac58af0f6"/>
May 21 02:02:19.082270 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-1"/>
May 21 02:02:19.082270 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:02:19.082270 np0000001127 nova-compute[98206]:   <serial>c5a59eca-d594-4eb2-9205-c45ac58af0f6</serial>
May 21 02:02:19.082270 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:02:19.082270 np0000001127 nova-compute[98206]: </disk>
May 21 02:02:19.082270 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:02:19.171357 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0738dd05-f923-4459-a74a-af76b9e9b33a req-196beaba-8479-4a74-b0a7-8d5f49b31a63 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Received event network-vif-unplugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:19.171606 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0738dd05-f923-4459-a74a-af76b9e9b33a req-196beaba-8479-4a74-b0a7-8d5f49b31a63 service nova] Acquiring lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:19.171849 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0738dd05-f923-4459-a74a-af76b9e9b33a req-196beaba-8479-4a74-b0a7-8d5f49b31a63 service nova] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:19.172032 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0738dd05-f923-4459-a74a-af76b9e9b33a req-196beaba-8479-4a74-b0a7-8d5f49b31a63 service nova] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:19.184249 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0738dd05-f923-4459-a74a-af76b9e9b33a req-196beaba-8479-4a74-b0a7-8d5f49b31a63 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] No waiting events found dispatching network-vif-unplugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:02:19.184249 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-0738dd05-f923-4459-a74a-af76b9e9b33a req-196beaba-8479-4a74-b0a7-8d5f49b31a63 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Received unexpected event network-vif-unplugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a for instance with vm_state active and task_state resize_migrating.
May 21 02:02:19.253067 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.99953048899988 future=<Future at 0x71c07c5eb680 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:02:19.263004 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Instance destroyed successfully.
May 21 02:02:19.264866 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:01:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-381884727',display_name='tempest-ServerActionsTestOtherB-server-381884727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serveractionstestotherb-server-381884727',id=26,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLe1NRJOlGeHTlYSJiaM3PGrlo+7H9agLjrz4WfSrLuMOzPRjsAs6TJ8fG0Jtb2QDKUpaM4oEEkqECJm++HadkTr0S3iHGop0JxrI6HPofsIchSwvm0vHW+elldzycD14Q==',key_name='tempest-keypair-1287891018',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:01:19Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='513057b933ef4779a2e885ae526782b9',ramdisk_id='',reservation_id='r-xyowjbmv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1655903174',owner_user_name='tempest-ServerActionsTestOtherB-1655903174-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:02:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c4b29ba15854339bc78b55da0b300da',uuid=e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "address": "fa:16:3e:92:96:ee", "network": {"id": "acd0fbfa-f6d3-457c-a46f-cb55a0527d2b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-127865059-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-127865059-network", "vif_mac": "fa:16:3e:92:96:ee"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "513057b933ef4779a2e885ae526782b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516875-8b", "ovs_interfaceid": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:02:19.265098 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Converting VIF {"id": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "address": "fa:16:3e:92:96:ee", "network": {"id": "acd0fbfa-f6d3-457c-a46f-cb55a0527d2b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-127865059-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-127865059-network", "vif_mac": "fa:16:3e:92:96:ee"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "513057b933ef4779a2e885ae526782b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516875-8b", "ovs_interfaceid": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:02:19.265880 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:96:ee,bridge_name='br-int',has_traffic_filtering=True,id=76516875-8b8a-41f5-9a3f-b76d4c3cc02a,network=Network(acd0fbfa-f6d3-457c-a46f-cb55a0527d2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76516875-8b') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:02:19.266167 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:96:ee,bridge_name='br-int',has_traffic_filtering=True,id=76516875-8b8a-41f5-9a3f-b76d4c3cc02a,network=Network(acd0fbfa-f6d3-457c-a46f-cb55a0527d2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76516875-8b') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:02:19.272056 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:19.272569 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76516875-8b, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:19.274641 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:19.275362 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:19.275910 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:02:19.283845 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:19.286656 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:19.286825 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d6f2141a-3d2f-4cb5-b161-20f2312ba424) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:19.288183 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:19.288740 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:02:19.296563 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:19.301022 np0000001127 nova-compute[98206]: INFO os_vif [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:96:ee,bridge_name='br-int',has_traffic_filtering=True,id=76516875-8b8a-41f5-9a3f-b76d4c3cc02a,network=Network(acd0fbfa-f6d3-457c-a46f-cb55a0527d2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76516875-8b')
May 21 02:02:19.303002 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:02:19.303322 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:02:19.303552 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:02:19.304486 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:02:19.304821 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:02:19.304981 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:02:19.345867 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:19.345867 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:19.345867 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:19.345867 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:19.345867 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:19.345867 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:19.345867 np0000001127 nova-compute[98206]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:19.345867 np0000001127 nova-compute[98206]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:19.345867 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:19.345867 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:19.345867 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:02:19.348889 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:19.348889 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:19.348889 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:19.348889 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:19.348889 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:19.348889 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:19.348889 np0000001127 nova-compute[98206]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:19.348889 np0000001127 nova-compute[98206]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:19.348889 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:19.348889 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:19.348889 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:02:19.348889 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6', '52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6', '53'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', '56'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', '62'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', '63'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', '64'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', '65')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:02:19.348889 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', '63')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:02:19.349531 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-9a151643-7318-4fbf-b34d-14c8f8fa3da6 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Object Instance<e158490e-746e-4c3b-924e-9aceed1662d0> lazy-loaded attributes: flavor,numa_topology {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:02:19.352176 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', '62')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:02:19.354713 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c058465da0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665'): ({'sdh'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:02:19.354713 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Removing multipathed devices sdi, sdh {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:02:19.354913 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Flush multipath device 3300000006680ae0e {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:02:19.391736 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:02:19.412460 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Successfully created port: fe51ab3c-f522-4909-912f-0ff45fd331b9 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:02:19.439125 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:02:19.486330 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:02:19.486330 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:02:19.489893 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d4b23c78-0852-4b38-b47c-a9147c5f6507 req-8dec5097-15b7-4760-855c-83cf63eb6b22 service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Received event network-changed-cbfb2d9f-c55f-4f12-8b0c-ce07a987798a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:19.490242 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d4b23c78-0852-4b38-b47c-a9147c5f6507 req-8dec5097-15b7-4760-855c-83cf63eb6b22 service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Refreshing instance network info cache due to event network-changed-cbfb2d9f-c55f-4f12-8b0c-ce07a987798a. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:02:19.490577 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d4b23c78-0852-4b38-b47c-a9147c5f6507 req-8dec5097-15b7-4760-855c-83cf63eb6b22 service nova] Acquiring lock "refresh_cache-e9edec14-452b-46fe-89c6-849ece08f527" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:02:19.491149 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:02:19.491149 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d4b23c78-0852-4b38-b47c-a9147c5f6507 req-8dec5097-15b7-4760-855c-83cf63eb6b22 service nova] Acquired lock "refresh_cache-e9edec14-452b-46fe-89c6-849ece08f527" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:02:19.491462 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-d4b23c78-0852-4b38-b47c-a9147c5f6507 req-8dec5097-15b7-4760-855c-83cf63eb6b22 service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Refreshing network info cache for port cbfb2d9f-c55f-4f12-8b0c-ce07a987798a {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:02:19.505499 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:02:19.506204 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:02:19.520320 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:19.557339 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:02:19.560531 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665, portal: 192.168.40.100,3260]
May 21 02:02:19.560531 np0000001127 nova-compute[98206]: Logout of [sid: 63, target: iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665, portal: 192.168.40.100,3260] successful.
May 21 02:02:19.560531 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:19.581186 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:19.592734 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:19.628521 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:02:19.628874 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:02:19.629007 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:02:19.631643 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665, portal: 192.168.50.100,3260]
May 21 02:02:19.631643 np0000001127 nova-compute[98206]: Logout of [sid: 62, target: iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665, portal: 192.168.50.100,3260] successful.
May 21 02:02:19.631643 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:19.653802 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:19.653802 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:02:19.653802 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] <== disconnect_volume: return (349ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:02:19.653802 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:02:19.654028 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.025s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:02:19.654262 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:02:19.662454 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:19.676380 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:02:19.684861 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:02:19.686452 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.011s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:02:19.688143 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:02:19.688578 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:02:19.688816 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:02:19.703170 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:02:19.703170 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:19.710832 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:02:19.710832 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:19.726724 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0] added
May 21 02:02:19.726724 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:02:19.726724 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:02:19.726724 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:02:19.726724 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:02:19.726724 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:02:19.726724 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:19.727249 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:02:19.727249 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0405(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:02:19.727249 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:02:19.730951 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0] added
May 21 02:02:19.730951 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:02:19.730951 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:02:19.730951 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:02:19.730951 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:02:19.730951 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:02:19.730951 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:19.731485 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:02:19.731485 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0425(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:02:19.731614 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:02:19.762487 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779328939.7620316, e9edec14-452b-46fe-89c6-849ece08f527 => ua-c5a59eca-d594-4eb2-9205-c45ac58af0f6> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 02:02:19.766967 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-c5a59eca-d594-4eb2-9205-c45ac58af0f6 for instance e9edec14-452b-46fe-89c6-849ece08f527 {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 02:02:19.772072 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:19.772727 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Successfully detached device vdb from instance e9edec14-452b-46fe-89c6-849ece08f527 from the live domain config.
May 21 02:02:19.773896 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:19.795545 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:02:19.796383 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6', 'iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c5a59eca-d594-4eb2-9205-c45ac58af0f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:02:19.796693 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:02:19.893151 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:19.893640 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:02:19.894246 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2_resize/disk /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:19.994902 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-d4b23c78-0852-4b38-b47c-a9147c5f6507 req-8dec5097-15b7-4760-855c-83cf63eb6b22 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:20.006032 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:20.030109 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] CMD "cp -r /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2_resize/disk /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk" returned: 0 in 0.136s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:20.030864 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:20.031247 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:20.032159 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2_resize/disk.config /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk.config {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:20.078005 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Successfully updated port: fe51ab3c-f522-4909-912f-0ff45fd331b9 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:02:20.091844 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] CMD "cp -r /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2_resize/disk.config /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk.config" returned: 0 in 0.060s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:20.092271 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2_resize/disk.info /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk.info {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:20.155342 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:20.162686 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] CMD "cp -r /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2_resize/disk.info /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk.info" returned: 0 in 0.068s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:20.225151 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:20.226983 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:20.484322 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-d4b23c78-0852-4b38-b47c-a9147c5f6507 req-8dec5097-15b7-4760-855c-83cf63eb6b22 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:20.594071 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:02:20.596538 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "refresh_cache-f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:02:20.597610 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:02:20.597610 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquired lock "refresh_cache-f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:02:20.597610 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:02:20.599325 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Creating image(s)
May 21 02:02:20.601836 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "/opt/stack/data/nova/instances/f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:20.601836 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "/opt/stack/data/nova/instances/f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:20.601836 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "/opt/stack/data/nova/instances/f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:20.602103 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:02:20.606258 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:02:20.609658 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:20.695001 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-d4b23c78-0852-4b38-b47c-a9147c5f6507 req-8dec5097-15b7-4760-855c-83cf63eb6b22 service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Updated VIF entry in instance network info cache for port cbfb2d9f-c55f-4f12-8b0c-ce07a987798a. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:02:20.695566 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-d4b23c78-0852-4b38-b47c-a9147c5f6507 req-8dec5097-15b7-4760-855c-83cf63eb6b22 service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Updating instance_info_cache with network_info: [{"id": "cbfb2d9f-c55f-4f12-8b0c-ce07a987798a", "address": "fa:16:3e:35:27:d3", "network": {"id": "7cdbc224-429f-49a6-86f3-307f51e53dfc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2078432126-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc797708a5a7400992765e41ee6ec260", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbfb2d9f-c5", "ovs_interfaceid": "cbfb2d9f-c55f-4f12-8b0c-ce07a987798a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:02:20.720439 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.111s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:20.721227 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:20.721375 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:20.721885 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:02:20.725813 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:02:20.726383 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:20.743970 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:02:20.746066 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:02:20.761626 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:02:20.761626 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:02:20.773683 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:02:20.773683 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:20.786753 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:20.794498 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:20.808960 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:20.808960 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:20.808960 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:20.808960 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:20.808960 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:20.808960 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:20.808960 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:20.808960 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:20.808960 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:02:20.809774 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:20.809774 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:20.809774 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:20.809774 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:20.809774 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:20.809774 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:20.809774 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:20.809774 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:20.809774 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:02:20.819163 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:20.819163 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:20.819163 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:20.819163 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:20.819163 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:20.819163 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:20.819163 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:20.819163 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:20.819163 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:02:20.819588 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:20.819588 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:20.819588 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:20.819588 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:20.819588 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:20.819588 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:20.819588 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:20.819588 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:20.819588 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:02:20.848162 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.122s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:20.849029 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:20.874530 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0, portal: 192.168.50.100,3260]
May 21 02:02:20.874530 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0, portal: 192.168.50.100,3260] successful.
May 21 02:02:20.874530 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:20.887591 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0, portal: 192.168.40.100,3260]
May 21 02:02:20.887591 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0, portal: 192.168.40.100,3260] successful.
May 21 02:02:20.887591 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:20.895361 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:20.918258 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:20.933381 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:20.933381 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:20.933381 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:20.933381 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:20.933381 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:20.933381 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:20.933381 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:20.933381 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:20.933381 np0000001127 nova-compute[98206]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:20.933381 np0000001127 nova-compute[98206]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:20.933381 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:02:20.934701 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:20.934701 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:20.934701 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:20.934701 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:20.934701 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:20.934701 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:20.934701 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:20.934701 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:20.934701 np0000001127 nova-compute[98206]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:20.934701 np0000001127 nova-compute[98206]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:20.934701 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:02:20.935572 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.247s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:02:20.935572 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:02:20.935980 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80/disk 1073741824" returned: 0 in 0.087s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:20.936382 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:20.936842 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:20.951939 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:20.951939 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:20.951939 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:20.951939 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:20.951939 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:20.951939 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:20.951939 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:20.951939 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:20.951939 np0000001127 nova-compute[98206]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:20.951939 np0000001127 nova-compute[98206]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:20.951939 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:02:20.952595 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:20.952595 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:20.952595 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:20.952595 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:20.952595 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:20.952595 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:20.952595 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:20.952595 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:20.952595 np0000001127 nova-compute[98206]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:20.952595 np0000001127 nova-compute[98206]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:20.952595 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:02:20.953407 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.267s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:02:20.954187 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:02:20.955385 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] HCTL ('13', '-', '-', 0) found on session 66 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:02:20.955606 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:02:20.958252 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] HCTL ('14', '-', '-', 0) found on session 67 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:02:20.958429 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:02:20.991845 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Searching for a device in session 66 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:02:20.991845 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:02:20.992702 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Searching for a device in session 67 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:02:20.993919 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:02:21.014770 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-4b1a1754-3098-4c4d-bd31-a2e9acc21f99 req-35f9b6b2-096e-4e5c-a3be-07ce1fd3ada6 service nova] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Received event network-changed-fe51ab3c-f522-4909-912f-0ff45fd331b9 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:21.016320 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-4b1a1754-3098-4c4d-bd31-a2e9acc21f99 req-35f9b6b2-096e-4e5c-a3be-07ce1fd3ada6 service nova] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Refreshing instance network info cache due to event network-changed-fe51ab3c-f522-4909-912f-0ff45fd331b9. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:02:21.016320 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4b1a1754-3098-4c4d-bd31-a2e9acc21f99 req-35f9b6b2-096e-4e5c-a3be-07ce1fd3ada6 service nova] Acquiring lock "refresh_cache-f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:02:21.063258 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.126s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:21.064847 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:02:21.066525 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:21.120785 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Removed pending STOPPED event for e158490e-746e-4c3b-924e-9aceed1662d0 due to new event <LifecycleEvent: 1779328941.1189263, e158490e-746e-4c3b-924e-9aceed1662d0 => Resumed> {{(pid=98206) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 21 02:02:21.123266 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328941.1189263, e158490e-746e-4c3b-924e-9aceed1662d0 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:02:21.123266 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] VM Resumed (Lifecycle Event)
May 21 02:02:21.128547 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9a151643-7318-4fbf-b34d-14c8f8fa3da6 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:02:21.200794 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d4b23c78-0852-4b38-b47c-a9147c5f6507 req-8dec5097-15b7-4760-855c-83cf63eb6b22 service nova] Releasing lock "refresh_cache-e9edec14-452b-46fe-89c6-849ece08f527" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:02:21.206377 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:21.208264 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Cannot resize image /opt/stack/data/nova/instances/f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:02:21.208720 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:02:21.211888 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:02:21.215297 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Ensure instance console log exists: /opt/stack/data/nova/instances/f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:02:21.216486 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:21.217609 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:21.217609 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:21.258297 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-177bb195-2e33-4b09-a7ca-b35d53154a90 req-fa153591-bc1d-4b77-83c3-f2d0f26edd31 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Received event network-vif-unplugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:21.258621 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-177bb195-2e33-4b09-a7ca-b35d53154a90 req-fa153591-bc1d-4b77-83c3-f2d0f26edd31 service nova] Acquiring lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:21.264175 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-177bb195-2e33-4b09-a7ca-b35d53154a90 req-fa153591-bc1d-4b77-83c3-f2d0f26edd31 service nova] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:21.264445 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-177bb195-2e33-4b09-a7ca-b35d53154a90 req-fa153591-bc1d-4b77-83c3-f2d0f26edd31 service nova] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:21.264655 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-177bb195-2e33-4b09-a7ca-b35d53154a90 req-fa153591-bc1d-4b77-83c3-f2d0f26edd31 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] No waiting events found dispatching network-vif-unplugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:02:21.264832 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-177bb195-2e33-4b09-a7ca-b35d53154a90 req-fa153591-bc1d-4b77-83c3-f2d0f26edd31 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Received unexpected event network-vif-unplugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a for instance with vm_state active and task_state resize_migrating.
May 21 02:02:21.362718 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:21.391310 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:21.393540 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:21.393858 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:21.488274 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Port 76516875-8b8a-41f5-9a3f-b76d4c3cc02a binding to destination host np0000001127 is already ACTIVE {{(pid=98206) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3211}}
May 21 02:02:21.558129 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Updating instance_info_cache with network_info: [{"id": "fe51ab3c-f522-4909-912f-0ff45fd331b9", "address": "fa:16:3e:59:b4:d0", "network": {"id": "38d66f09-c738-4e79-9aeb-12e87e29f568", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-447420743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "177bec65268546d2b899e09989183b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe51ab3c-f5", "ovs_interfaceid": "fe51ab3c-f522-4909-912f-0ff45fd331b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:02:21.628181 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:02:21.630227 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:02:21.687008 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:02:22.060594 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Releasing lock "refresh_cache-f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:02:22.061042 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Instance network_info: |[{"id": "fe51ab3c-f522-4909-912f-0ff45fd331b9", "address": "fa:16:3e:59:b4:d0", "network": {"id": "38d66f09-c738-4e79-9aeb-12e87e29f568", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-447420743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "177bec65268546d2b899e09989183b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe51ab3c-f5", "ovs_interfaceid": "fe51ab3c-f522-4909-912f-0ff45fd331b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:02:22.061551 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4b1a1754-3098-4c4d-bd31-a2e9acc21f99 req-35f9b6b2-096e-4e5c-a3be-07ce1fd3ada6 service nova] Acquired lock "refresh_cache-f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:02:22.061815 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-4b1a1754-3098-4c4d-bd31-a2e9acc21f99 req-35f9b6b2-096e-4e5c-a3be-07ce1fd3ada6 service nova] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Refreshing network info cache for port fe51ab3c-f522-4909-912f-0ff45fd331b9 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:02:22.065114 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Start _get_guest_xml network_info=[{"id": "fe51ab3c-f522-4909-912f-0ff45fd331b9", "address": "fa:16:3e:59:b4:d0", "network": {"id": "38d66f09-c738-4e79-9aeb-12e87e29f568", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-447420743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "177bec65268546d2b899e09989183b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe51ab3c-f5", "ovs_interfaceid": "fe51ab3c-f522-4909-912f-0ff45fd331b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:02:22.067836 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:02:22.069283 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1467423404', uuid='f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80'), owner=OwnerMeta(userid='c0efcbc1b88f49989c9f6b6a7439f2c4', username='tempest-TestEncryptedCinderVolumes-991116896-project-member', projectid='177bec65268546d2b899e09989183b6e', projectname='tempest-TestEncryptedCinderVolumes-991116896'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fe51ab3c-f522-4909-912f-0ff45fd331b9", "address": "fa:16:3e:59:b4:d0", "network": {"id": "38d66f09-c738-4e79-9aeb-12e87e29f568", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-447420743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "177bec65268546d2b899e09989183b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe51ab3c-f5", "ovs_interfaceid": "fe51ab3c-f522-4909-912f-0ff45fd331b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328942.068888) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:02:22.070505 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:02:22.071870 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:02:22.072458 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:02:22.072826 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:02:22.074073 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:02:22.074609 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:02:22.075032 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:02:22.075104 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:02:22.075272 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:02:22.075420 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:02:22.075834 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:02:22.075834 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:02:22.076287 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:02:22.076287 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:02:22.076415 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:02:22.076611 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:02:22.088134 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:02:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1467423404',display_name='tempest-TestEncryptedCinderVolumes-server-1467423404',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testencryptedcindervolumes-server-1467423404',id=31,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM6WR2DOYy/d7/xyZL4MwGC+7U4T14LZmtisTSWfALbAAji373atkb2fHTxPyq8LcgoIYQKL1p95NjhGrWTxF60KiYQkDlHCTfcYKgQqHoE8wmm7LAYOYH6x0LGCOFmMyw==',key_name='tempest-keypair-999591050',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='177bec65268546d2b899e09989183b6e',ramdisk_id='',reservation_id='r-2nv25p31',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-991116896',owner_user_name='tempest-TestEncryptedCinderVolumes-991116896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:02:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0efcbc1b88f49989c9f6b6a7439f2c4',uuid=f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe51ab3c-f522-4909-912f-0ff45fd331b9", "address": "fa:16:3e:59:b4:d0", "network": {"id": "38d66f09-c738-4e79-9aeb-12e87e29f568", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-447420743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "177bec65268546d2b899e09989183b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe51ab3c-f5", "ovs_interfaceid": "fe51ab3c-f522-4909-912f-0ff45fd331b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:02:22.088528 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Converting VIF {"id": "fe51ab3c-f522-4909-912f-0ff45fd331b9", "address": "fa:16:3e:59:b4:d0", "network": {"id": "38d66f09-c738-4e79-9aeb-12e87e29f568", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-447420743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "177bec65268546d2b899e09989183b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe51ab3c-f5", "ovs_interfaceid": "fe51ab3c-f522-4909-912f-0ff45fd331b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:02:22.089121 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:b4:d0,bridge_name='br-int',has_traffic_filtering=True,id=fe51ab3c-f522-4909-912f-0ff45fd331b9,network=Network(38d66f09-c738-4e79-9aeb-12e87e29f568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe51ab3c-f5') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:02:22.089770 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lazy-loading 'pci_devices' on Instance uuid f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:22.133076 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328942.1327252, e158490e-746e-4c3b-924e-9aceed1662d0 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:02:22.133272 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] VM Started (Lifecycle Event)
May 21 02:02:22.497596 np0000001127 nova-compute[98206]: DEBUG nova.compute.rpcapi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98206) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 21 02:02:22.519052 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Acquiring lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:22.519052 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:22.519052 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:22.567362 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-4b1a1754-3098-4c4d-bd31-a2e9acc21f99 req-35f9b6b2-096e-4e5c-a3be-07ce1fd3ada6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:22.594076 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] End _get_guest_xml xml=<domain type="qemu">
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:   <uuid>f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80</uuid>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:   <name>instance-0000001f</name>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1467423404</nova:name>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:02:22</nova:creationTime>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:         <nova:user uuid="c0efcbc1b88f49989c9f6b6a7439f2c4">tempest-TestEncryptedCinderVolumes-991116896-project-member</nova:user>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:         <nova:project uuid="177bec65268546d2b899e09989183b6e">tempest-TestEncryptedCinderVolumes-991116896</nova:project>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:         <nova:port uuid="fe51ab3c-f522-4909-912f-0ff45fd331b9">
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:     <system>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:       <entry name="serial">f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80</entry>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:       <entry name="uuid">f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80</entry>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:     </system>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:   <os>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:   </os>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:   <features>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:   </features>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:   <devices>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80/disk"/>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:     </disk>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80/disk.config"/>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:     </disk>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:59:b4:d0"/>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:       <target dev="tapfe51ab3c-f5"/>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:     </interface>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80/console.log" append="off"/>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:     </serial>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:     <video>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:     </video>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:     </rng>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:   </devices>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]: </domain>
May 21 02:02:22.594076 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:02:22.596949 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Preparing to wait for external event network-vif-plugged-fe51ab3c-f522-4909-912f-0ff45fd331b9 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:02:22.596949 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:22.596949 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:22.596949 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:22.596949 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:02:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1467423404',display_name='tempest-TestEncryptedCinderVolumes-server-1467423404',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testencryptedcindervolumes-server-1467423404',id=31,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM6WR2DOYy/d7/xyZL4MwGC+7U4T14LZmtisTSWfALbAAji373atkb2fHTxPyq8LcgoIYQKL1p95NjhGrWTxF60KiYQkDlHCTfcYKgQqHoE8wmm7LAYOYH6x0LGCOFmMyw==',key_name='tempest-keypair-999591050',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='177bec65268546d2b899e09989183b6e',ramdisk_id='',reservation_id='r-2nv25p31',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-991116896',owner_user_name='tempest-TestEncryptedCinderVolumes-991116896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:02:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0efcbc1b88f49989c9f6b6a7439f2c4',uuid=f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe51ab3c-f522-4909-912f-0ff45fd331b9", "address": "fa:16:3e:59:b4:d0", "network": {"id": "38d66f09-c738-4e79-9aeb-12e87e29f568", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-447420743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "177bec65268546d2b899e09989183b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe51ab3c-f5", "ovs_interfaceid": "fe51ab3c-f522-4909-912f-0ff45fd331b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:02:22.599820 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Converting VIF {"id": "fe51ab3c-f522-4909-912f-0ff45fd331b9", "address": "fa:16:3e:59:b4:d0", "network": {"id": "38d66f09-c738-4e79-9aeb-12e87e29f568", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-447420743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "177bec65268546d2b899e09989183b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe51ab3c-f5", "ovs_interfaceid": "fe51ab3c-f522-4909-912f-0ff45fd331b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:02:22.599820 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:b4:d0,bridge_name='br-int',has_traffic_filtering=True,id=fe51ab3c-f522-4909-912f-0ff45fd331b9,network=Network(38d66f09-c738-4e79-9aeb-12e87e29f568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe51ab3c-f5') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:02:22.599820 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:b4:d0,bridge_name='br-int',has_traffic_filtering=True,id=fe51ab3c-f522-4909-912f-0ff45fd331b9,network=Network(38d66f09-c738-4e79-9aeb-12e87e29f568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe51ab3c-f5') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:02:22.600616 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:22.600971 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:22.601339 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:02:22.603072 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:22.603304 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2ccdb46f-342a-5ef2-9285-17dbe04dfba6', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:22.606841 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:22.607187 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:02:22.609802 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:22.612786 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:22.613003 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe51ab3c-f5, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:22.615783 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe51ab3c-f5, col_values=(('qos', UUID('74af7423-1ef6-4562-9739-baf836f002c3')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:22.616077 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe51ab3c-f5, col_values=(('external_ids', {'iface-id': 'fe51ab3c-f522-4909-912f-0ff45fd331b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:b4:d0', 'vm-uuid': 'f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:22.617695 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:22.618939 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:02:22.624109 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:22.626022 np0000001127 nova-compute[98206]: INFO os_vif [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:b4:d0,bridge_name='br-int',has_traffic_filtering=True,id=fe51ab3c-f522-4909-912f-0ff45fd331b9,network=Network(38d66f09-c738-4e79-9aeb-12e87e29f568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe51ab3c-f5')
May 21 02:02:22.636221 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:02:22.638674 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:02:22.707915 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Found WWN 33000000066d115e2 for multipath device dm-5 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:02:22.708533 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.054s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:02:22.708533 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] <== connect_volume: return (3079ms) {'type': 'block', 'scsi_wwn': '33000000066d115e2', 'path': '/dev/dm-5', 'multipath_id': '33000000066d115e2'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:02:22.708740 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000066d115e2', 'path': '/dev/dm-5', 'multipath_id': '33000000066d115e2'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:02:22.710211 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.914s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:02:22.710672 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6', 'iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c5a59eca-d594-4eb2-9205-c45ac58af0f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:02:22.710886 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:02:22.721449 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lazy-loading 'flavor' on Instance uuid df1fb869-23ef-48e0-b609-ce91c2540c2e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:22.755290 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:22.755290 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:22.755290 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:22.755290 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:22.755290 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:22.755290 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:22.755290 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:22.755290 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:22.755290 np0000001127 nova-compute[98206]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:22.755290 np0000001127 nova-compute[98206]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:22.755290 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:02:22.756161 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:22.756161 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:22.756161 np0000001127 nova-compute[98206]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:22.756161 np0000001127 nova-compute[98206]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6 (non-flash)
May 21 02:02:22.756161 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:22.756161 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:22.756161 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:22.756161 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:22.756161 np0000001127 nova-compute[98206]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:22.756161 np0000001127 nova-compute[98206]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:22.756161 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:02:22.756161 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6', '52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6', '53'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', '56'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', '64'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', '65'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', '66'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', '67')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:02:22.756787 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6', '52')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:02:22.758008 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6', '53')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:02:22.759059 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c058406a20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6'): ({'sde'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:02:22.759340 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Removing multipathed devices sdd, sde {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:02:22.759609 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Flush multipath device 330000000f03a3ba9 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:02:22.802887 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:02:22.853640 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:02:22.895255 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:02:22.895534 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:02:22.897191 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:02:22.911138 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:02:22.913834 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:02:22.926278 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:22.970637 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6, portal: 192.168.40.100,3260]
May 21 02:02:22.970637 np0000001127 nova-compute[98206]: Logout of [sid: 52, target: iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6, portal: 192.168.40.100,3260] successful.
May 21 02:02:22.970637 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:22.995687 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-4b1a1754-3098-4c4d-bd31-a2e9acc21f99 req-35f9b6b2-096e-4e5c-a3be-07ce1fd3ada6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:23.001349 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:23.014492 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:23.057264 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6, portal: 192.168.50.100,3260]
May 21 02:02:23.057264 np0000001127 nova-compute[98206]: Logout of [sid: 53, target: iqn.2023-03.storpool.com:os--volume-c5a59eca-d594-4eb2-9205-c45ac58af0f6, portal: 192.168.50.100,3260] successful.
May 21 02:02:23.057264 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:23.076501 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:23.076874 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:02:23.077160 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] <== disconnect_volume: return (3280ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:02:23.077223 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:02:23.187146 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-4b1a1754-3098-4c4d-bd31-a2e9acc21f99 req-35f9b6b2-096e-4e5c-a3be-07ce1fd3ada6 service nova] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Updated VIF entry in instance network info cache for port fe51ab3c-f522-4909-912f-0ff45fd331b9. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:02:23.187596 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-4b1a1754-3098-4c4d-bd31-a2e9acc21f99 req-35f9b6b2-096e-4e5c-a3be-07ce1fd3ada6 service nova] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Updating instance_info_cache with network_info: [{"id": "fe51ab3c-f522-4909-912f-0ff45fd331b9", "address": "fa:16:3e:59:b4:d0", "network": {"id": "38d66f09-c738-4e79-9aeb-12e87e29f568", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-447420743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "177bec65268546d2b899e09989183b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe51ab3c-f5", "ovs_interfaceid": "fe51ab3c-f522-4909-912f-0ff45fd331b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:02:23.226556 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Attempting to attach volume 8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 02:02:23.228776 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] attach device xml: <disk type="block" device="disk">
May 21 02:02:23.228776 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:02:23.228776 np0000001127 nova-compute[98206]:   <alias name="ua-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0"/>
May 21 02:02:23.228776 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-5"/>
May 21 02:02:23.228776 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:02:23.228776 np0000001127 nova-compute[98206]:   <serial>8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0</serial>
May 21 02:02:23.228776 np0000001127 nova-compute[98206]: </disk>
May 21 02:02:23.228776 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 02:02:23.529397 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:23.592139 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Acquiring lock "refresh_cache-e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:02:23.592294 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Acquired lock "refresh_cache-e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:02:23.592422 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:02:23.663762 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lazy-loading 'flavor' on Instance uuid e9edec14-452b-46fe-89c6-849ece08f527 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:23.689920 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4b1a1754-3098-4c4d-bd31-a2e9acc21f99 req-35f9b6b2-096e-4e5c-a3be-07ce1fd3ada6 service nova] Releasing lock "refresh_cache-f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:02:23.690189 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-4b1a1754-3098-4c4d-bd31-a2e9acc21f99 req-35f9b6b2-096e-4e5c-a3be-07ce1fd3ada6 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Received event network-vif-plugged-0298cd31-6bbc-4653-a4ac-8d9b5def1753 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:23.690420 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4b1a1754-3098-4c4d-bd31-a2e9acc21f99 req-35f9b6b2-096e-4e5c-a3be-07ce1fd3ada6 service nova] Acquiring lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:23.690638 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4b1a1754-3098-4c4d-bd31-a2e9acc21f99 req-35f9b6b2-096e-4e5c-a3be-07ce1fd3ada6 service nova] Lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:23.690904 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4b1a1754-3098-4c4d-bd31-a2e9acc21f99 req-35f9b6b2-096e-4e5c-a3be-07ce1fd3ada6 service nova] Lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:23.690904 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-4b1a1754-3098-4c4d-bd31-a2e9acc21f99 req-35f9b6b2-096e-4e5c-a3be-07ce1fd3ada6 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] No waiting events found dispatching network-vif-plugged-0298cd31-6bbc-4653-a4ac-8d9b5def1753 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:02:23.691029 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-4b1a1754-3098-4c4d-bd31-a2e9acc21f99 req-35f9b6b2-096e-4e5c-a3be-07ce1fd3ada6 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Received unexpected event network-vif-plugged-0298cd31-6bbc-4653-a4ac-8d9b5def1753 for instance with vm_state rescued and task_state unrescuing.
May 21 02:02:23.692082 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-4b1a1754-3098-4c4d-bd31-a2e9acc21f99 req-35f9b6b2-096e-4e5c-a3be-07ce1fd3ada6 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Received event network-vif-plugged-0298cd31-6bbc-4653-a4ac-8d9b5def1753 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:23.692082 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4b1a1754-3098-4c4d-bd31-a2e9acc21f99 req-35f9b6b2-096e-4e5c-a3be-07ce1fd3ada6 service nova] Acquiring lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:23.692082 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4b1a1754-3098-4c4d-bd31-a2e9acc21f99 req-35f9b6b2-096e-4e5c-a3be-07ce1fd3ada6 service nova] Lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:23.692082 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4b1a1754-3098-4c4d-bd31-a2e9acc21f99 req-35f9b6b2-096e-4e5c-a3be-07ce1fd3ada6 service nova] Lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:23.692082 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-4b1a1754-3098-4c4d-bd31-a2e9acc21f99 req-35f9b6b2-096e-4e5c-a3be-07ce1fd3ada6 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] No waiting events found dispatching network-vif-plugged-0298cd31-6bbc-4653-a4ac-8d9b5def1753 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:02:23.692082 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-4b1a1754-3098-4c4d-bd31-a2e9acc21f99 req-35f9b6b2-096e-4e5c-a3be-07ce1fd3ada6 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Received unexpected event network-vif-plugged-0298cd31-6bbc-4653-a4ac-8d9b5def1753 for instance with vm_state rescued and task_state unrescuing.
May 21 02:02:24.097234 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:24.149012 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:02:24.149012 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:02:24.149012 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] No VIF found with MAC fa:16:3e:59:b4:d0, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:02:24.149502 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Using config drive
May 21 02:02:24.491450 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:24.639363 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Updating instance_info_cache with network_info: [{"id": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "address": "fa:16:3e:92:96:ee", "network": {"id": "acd0fbfa-f6d3-457c-a46f-cb55a0527d2b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-127865059-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "513057b933ef4779a2e885ae526782b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516875-8b", "ovs_interfaceid": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:02:24.656396 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:24.673215 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1595ea36-6c27-44af-9e37-f401fb8d6d65 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "e9edec14-452b-46fe-89c6-849ece08f527" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.229s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:24.807051 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Creating config drive at /opt/stack/data/nova/instances/f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80/disk.config
May 21 02:02:24.815100 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1ajvroaw {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:24.883755 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1ajvroaw" returned: 0 in 0.068s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:24.912492 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:02:24.912492 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:02:24.912492 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:02:24.912492 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] No VIF found with MAC fa:16:3e:f4:b7:59, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:02:25.143268 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Releasing lock "refresh_cache-e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:02:25.370162 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:25.401037 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:25.520634 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:25.661729 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:02:25.678692 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:02:25.707203 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:25.738077 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1a4dc69f-cfe2-4301-9d94-9c66fd95ae07 req-aa5a5101-2ffc-432c-a0ff-f58ad48804cc service nova] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Received event network-vif-plugged-fe51ab3c-f522-4909-912f-0ff45fd331b9 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:25.738627 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1a4dc69f-cfe2-4301-9d94-9c66fd95ae07 req-aa5a5101-2ffc-432c-a0ff-f58ad48804cc service nova] Acquiring lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:25.739505 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1a4dc69f-cfe2-4301-9d94-9c66fd95ae07 req-aa5a5101-2ffc-432c-a0ff-f58ad48804cc service nova] Lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:25.739777 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1a4dc69f-cfe2-4301-9d94-9c66fd95ae07 req-aa5a5101-2ffc-432c-a0ff-f58ad48804cc service nova] Lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:25.739937 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1a4dc69f-cfe2-4301-9d94-9c66fd95ae07 req-aa5a5101-2ffc-432c-a0ff-f58ad48804cc service nova] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Processing event network-vif-plugged-fe51ab3c-f522-4909-912f-0ff45fd331b9 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:02:25.773827 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:02:25.774535 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:02:25.784706 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:02:25.786583 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe9e:216', 'fe80::14d9:7bff:fe3b:f0dc', 'fe80::fc16:3eff:fe45:a237', 'fe80::fc16:3eff:fef4:b759', 'fe80::40b3:49ff:feb3:3b55', 'fe80::fc16:3eff:fe35:27d3', 'fe80::a403:4dff:fe5a:1b07', 'fe80::789a:c1ff:fe89:a024', 'fe80::fc16:3eff:fe41:220a', 'fe80::3c32:60ff:fe45:d447', 'fe80::fc16:3eff:fe2b:20c8', 'fe80::fc16:3eff:febc:420', 'fe80::f8e2:1cff:fe30:95ec', 'fe80::fc16:3eff:fe60:a612', 'fe80::fc16:3eff:fe59:b4d0', 'fe80::f819:cdff:fe2b:de28'] 
May 21 02:02:25.787405 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:02:25.787405 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:02:25.787405 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:02:25.806824 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:25.810557 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:25.816142 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:25.841354 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:26.174531 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a40cdc2a-320d-4c84-8a8f-025944f66bb1 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "e9edec14-452b-46fe-89c6-849ece08f527" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:26.174988 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a40cdc2a-320d-4c84-8a8f-025944f66bb1 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "e9edec14-452b-46fe-89c6-849ece08f527" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:26.174988 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a40cdc2a-320d-4c84-8a8f-025944f66bb1 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "e9edec14-452b-46fe-89c6-849ece08f527-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:26.175095 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a40cdc2a-320d-4c84-8a8f-025944f66bb1 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "e9edec14-452b-46fe-89c6-849ece08f527-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:26.175230 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a40cdc2a-320d-4c84-8a8f-025944f66bb1 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "e9edec14-452b-46fe-89c6-849ece08f527-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:26.182112 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-a40cdc2a-320d-4c84-8a8f-025944f66bb1 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Terminating instance
May 21 02:02:26.366509 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:26.450661 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328946.4501615, f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:02:26.452110 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:02:26.452441 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] VM Started (Lifecycle Event)
May 21 02:02:26.455723 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:02:26.458147 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Instance spawned successfully.
May 21 02:02:26.458577 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:02:26.496944 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-63ce4617-9a15-41f8-bca2-30a7c9eda866 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.660s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:26.678129 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "8948a19b-9e7e-448d-b782-be58020b5320" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:26.678399 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "8948a19b-9e7e-448d-b782-be58020b5320" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:26.685788 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-a40cdc2a-320d-4c84-8a8f-025944f66bb1 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:02:26.732184 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:26.762807 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:26.768155 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:26.793321 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:26.794551 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:26.955043 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-11d0856d-2f5e-426a-a718-c839de882b5a req-78cfdba9-aeb8-4b8f-9107-dc52601710bf service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Received event network-vif-unplugged-cbfb2d9f-c55f-4f12-8b0c-ce07a987798a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:26.955220 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-11d0856d-2f5e-426a-a718-c839de882b5a req-78cfdba9-aeb8-4b8f-9107-dc52601710bf service nova] Acquiring lock "e9edec14-452b-46fe-89c6-849ece08f527-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:26.955426 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-11d0856d-2f5e-426a-a718-c839de882b5a req-78cfdba9-aeb8-4b8f-9107-dc52601710bf service nova] Lock "e9edec14-452b-46fe-89c6-849ece08f527-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:26.955426 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-11d0856d-2f5e-426a-a718-c839de882b5a req-78cfdba9-aeb8-4b8f-9107-dc52601710bf service nova] Lock "e9edec14-452b-46fe-89c6-849ece08f527-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:26.955589 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-11d0856d-2f5e-426a-a718-c839de882b5a req-78cfdba9-aeb8-4b8f-9107-dc52601710bf service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] No waiting events found dispatching network-vif-unplugged-cbfb2d9f-c55f-4f12-8b0c-ce07a987798a {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:02:26.955650 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-11d0856d-2f5e-426a-a718-c839de882b5a req-78cfdba9-aeb8-4b8f-9107-dc52601710bf service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Received event network-vif-unplugged-cbfb2d9f-c55f-4f12-8b0c-ce07a987798a for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:02:26.957147 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:02:26.962514 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Starting finish_migration {{(pid=98206) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 21 02:02:26.966720 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:02:26.969268 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Instance directory exists: not creating {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 21 02:02:26.969268 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Creating image(s)
May 21 02:02:26.974380 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:26.998131 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:02:26.998131 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:02:27.000432 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:02:27.000843 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:02:27.001302 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:02:27.002503 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:02:27.013352 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:27.023481 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:27.049968 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Instance destroyed successfully.
May 21 02:02:27.050546 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-a40cdc2a-320d-4c84-8a8f-025944f66bb1 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lazy-loading 'resources' on Instance uuid e9edec14-452b-46fe-89c6-849ece08f527 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:27.078822 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.104s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:27.079404 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:02:27.079816 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:27.181113 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:02:27.224146 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:27.226283 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Cannot resize image /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:02:27.474560 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:02:27.475051 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328947.4747932, f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:02:27.475206 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] VM Paused (Lifecycle Event)
May 21 02:02:27.525306 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Took 6.93 seconds to spawn the instance on the hypervisor.
May 21 02:02:27.526717 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:02:27.557228 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-a40cdc2a-320d-4c84-8a8f-025944f66bb1 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:00:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1354277369',display_name='tempest-TestMinimumBasicScenario-server-1354277369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testminimumbasicscenario-server-1354277369',id=24,image_ref='41a1695f-68f2-46f8-b08c-5f00f72ff20f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABV9lNaOhondv4xWx9wwSxSHVWgf5JuuPr9fZX2s2MH/Tlh7xaawDHT7UiG92Tc0vR5wdYJjAAzBJ/YMnZKMPntBKnarmw7az3moOe+v2n6BgBwpX6SabCrQhdyNeWBrw==',key_name='tempest-TestMinimumBasicScenario-934850333',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:00:56Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc797708a5a7400992765e41ee6ec260',ramdisk_id='',reservation_id='r-17aa4tur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='41a1695f-68f2-46f8-b08c-5f00f72ff20f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-654915677',owner_user_name='tempest-TestMinimumBasicScenario-654915677-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:01:39Z,user_data=None,user_id='44907638a40d4fb4ad9014b58dcd6bac',uuid=e9edec14-452b-46fe-89c6-849ece08f527,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cbfb2d9f-c55f-4f12-8b0c-ce07a987798a", "address": "fa:16:3e:35:27:d3", "network": {"id": "7cdbc224-429f-49a6-86f3-307f51e53dfc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2078432126-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc797708a5a7400992765e41ee6ec260", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbfb2d9f-c5", "ovs_interfaceid": "cbfb2d9f-c55f-4f12-8b0c-ce07a987798a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:02:27.557228 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-a40cdc2a-320d-4c84-8a8f-025944f66bb1 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Converting VIF {"id": "cbfb2d9f-c55f-4f12-8b0c-ce07a987798a", "address": "fa:16:3e:35:27:d3", "network": {"id": "7cdbc224-429f-49a6-86f3-307f51e53dfc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2078432126-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc797708a5a7400992765e41ee6ec260", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbfb2d9f-c5", "ovs_interfaceid": "cbfb2d9f-c55f-4f12-8b0c-ce07a987798a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:02:27.557867 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-a40cdc2a-320d-4c84-8a8f-025944f66bb1 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:27:d3,bridge_name='br-int',has_traffic_filtering=True,id=cbfb2d9f-c55f-4f12-8b0c-ce07a987798a,network=Network(7cdbc224-429f-49a6-86f3-307f51e53dfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbfb2d9f-c5') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:02:27.558328 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-a40cdc2a-320d-4c84-8a8f-025944f66bb1 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:27:d3,bridge_name='br-int',has_traffic_filtering=True,id=cbfb2d9f-c55f-4f12-8b0c-ce07a987798a,network=Network(7cdbc224-429f-49a6-86f3-307f51e53dfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbfb2d9f-c5') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:02:27.560605 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:27.561188 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcbfb2d9f-c5, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:27.562726 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:27.563606 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:02:27.567549 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:27.568862 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:27.569041 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4aa37314-6e6a-4000-b904-57c05fef675e) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:27.570268 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:27.570763 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:02:27.571328 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:27.574439 np0000001127 nova-compute[98206]: INFO os_vif [None req-a40cdc2a-320d-4c84-8a8f-025944f66bb1 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:27:d3,bridge_name='br-int',has_traffic_filtering=True,id=cbfb2d9f-c55f-4f12-8b0c-ce07a987798a,network=Network(7cdbc224-429f-49a6-86f3-307f51e53dfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbfb2d9f-c5')
May 21 02:02:27.574862 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-a40cdc2a-320d-4c84-8a8f-025944f66bb1 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Deleting instance files /opt/stack/data/nova/instances/e9edec14-452b-46fe-89c6-849ece08f527_del
May 21 02:02:27.575846 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-a40cdc2a-320d-4c84-8a8f-025944f66bb1 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Deletion of /opt/stack/data/nova/instances/e9edec14-452b-46fe-89c6-849ece08f527_del complete
May 21 02:02:27.715624 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c64228ea-ffd5-45e8-9d57-1858e1d269b0 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "df1fb869-23ef-48e0-b609-ce91c2540c2e" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:27.715862 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c64228ea-ffd5-45e8-9d57-1858e1d269b0 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:27.715969 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-c64228ea-ffd5-45e8-9d57-1858e1d269b0 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:02:27.717779 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-c64228ea-ffd5-45e8-9d57-1858e1d269b0 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98206) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 21 02:02:27.718172 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-c64228ea-ffd5-45e8-9d57-1858e1d269b0 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lazy-loading 'flavor' on Instance uuid df1fb869-23ef-48e0-b609-ce91c2540c2e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:27.730578 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Did not create local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 21 02:02:27.730578 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Ensure instance console log exists: /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:02:27.730578 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:27.730578 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:27.730578 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:27.733400 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Start _get_guest_xml network_info=[{"id": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "address": "fa:16:3e:92:96:ee", "network": {"id": "acd0fbfa-f6d3-457c-a46f-cb55a0527d2b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-127865059-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-127865059-network", "vif_mac": "fa:16:3e:92:96:ee"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "513057b933ef4779a2e885ae526782b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516875-8b", "ovs_interfaceid": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2', 'attached_at': '2026-05-21T02:02:26.000000', 'detached_at': '', 'volume_id': '0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'serial': '0fe98eab-6f95-43f2-9f8a-a4dc45525665'}, 'delete_on_termination': False, 'attachment_id': '67a0ec5b-4a7f-4596-bd6c-2e950672ccd3', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:02:27.738499 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:02:27.739833 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-381884727', uuid='e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2'), owner=OwnerMeta(userid='9c4b29ba15854339bc78b55da0b300da', username='tempest-ServerActionsTestOtherB-1655903174-project-member', projectid='513057b933ef4779a2e885ae526782b9', projectname='tempest-ServerActionsTestOtherB-1655903174'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "address": "fa:16:3e:92:96:ee", "network": {"id": "acd0fbfa-f6d3-457c-a46f-cb55a0527d2b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-127865059-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-127865059-network", "vif_mac": "fa:16:3e:92:96:ee"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "513057b933ef4779a2e885ae526782b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516875-8b", "ovs_interfaceid": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328947.7389157) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:02:27.742497 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:02:27.742497 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:02:27.743856 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:02:27.744542 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:02:27.746612 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:02:27.748015 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:02:27.748015 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:02:27.748015 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:02:27.748015 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:02:27.749613 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:02:27.749613 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:02:27.749613 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:02:27.749613 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:02:27.749613 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:02:27.749613 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:02:27.749613 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:02:27.764009 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:27.767492 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:27.771222 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:02:27.771387 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Claim successful on node np0000001127
May 21 02:02:27.780010 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk.config --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:27.824864 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-85ca6184-f163-4735-8d11-d1d54378d107 req-18e3b251-2ce9-4411-b903-eabc5094000e service nova] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Received event network-vif-plugged-fe51ab3c-f522-4909-912f-0ff45fd331b9 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:27.825581 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-85ca6184-f163-4735-8d11-d1d54378d107 req-18e3b251-2ce9-4411-b903-eabc5094000e service nova] Acquiring lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:27.826066 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-85ca6184-f163-4735-8d11-d1d54378d107 req-18e3b251-2ce9-4411-b903-eabc5094000e service nova] Lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:27.826285 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-85ca6184-f163-4735-8d11-d1d54378d107 req-18e3b251-2ce9-4411-b903-eabc5094000e service nova] Lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:27.826460 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-85ca6184-f163-4735-8d11-d1d54378d107 req-18e3b251-2ce9-4411-b903-eabc5094000e service nova] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] No waiting events found dispatching network-vif-plugged-fe51ab3c-f522-4909-912f-0ff45fd331b9 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:02:27.826648 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-85ca6184-f163-4735-8d11-d1d54378d107 req-18e3b251-2ce9-4411-b903-eabc5094000e service nova] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Received unexpected event network-vif-plugged-fe51ab3c-f522-4909-912f-0ff45fd331b9 for instance with vm_state active and task_state None.
May 21 02:02:27.892839 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk.config --force-share --output=json" returned: 0 in 0.113s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:27.895751 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Acquiring lock "/opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:27.895751 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "/opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:27.895751 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "/opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:27.895751 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:02:27.895751 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:02:27.897038 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:02:27.897701 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:02:27.898432 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:02:27.913787 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:02:27.914155 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:02:27.914408 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:02:27.915253 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:02:27.915906 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:02:27.916126 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:02:27.927533 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:02:27.927533 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:27.935593 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:02:27.935593 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:27.943786 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665] added
May 21 02:02:27.943786 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:02:27.943786 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:02:27.943786 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:02:27.943786 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:02:27.943786 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:02:27.943786 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:27.945583 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:02:27.945583 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0298(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:02:27.945583 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:02:27.946866 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665] added
May 21 02:02:27.946866 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:02:27.946866 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:02:27.946866 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:02:27.946866 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:02:27.946866 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:02:27.946866 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:27.947596 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:02:27.947596 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0311(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:02:27.947596 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:02:27.978414 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:02:27.982328 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328947.9818797, f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:02:27.982565 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] VM Resumed (Lifecycle Event)
May 21 02:02:28.043125 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Took 13.37 seconds to build instance.
May 21 02:02:28.085035 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-a40cdc2a-320d-4c84-8a8f-025944f66bb1 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Took 1.40 seconds to destroy the instance on the hypervisor.
May 21 02:02:28.086183 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-a40cdc2a-320d-4c84-8a8f-025944f66bb1 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:02:28.086540 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:02:28.086540 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: e9edec14-452b-46fe-89c6-849ece08f527] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:02:28.087797 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:28.226026 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:28.487658 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:02:28.492067 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:02:28.546553 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-df420aaf-8a70-4c2f-b779-f9c454ef56ce tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.883s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:28.757823 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:28.761959 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:28.790504 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:28.797500 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:28.829051 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:28.829383 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:28.945324 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:02:28.947785 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:02:28.970786 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:02:28.970786 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:02:28.982524 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:02:28.982524 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:28.993330 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:28.995596 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999640834000047 future=<Future at 0x71c07c5392e0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:02:29.006383 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:02:29.013166 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:29.026663 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:29.026663 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:29.026663 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:29.026663 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:29.026663 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:29.026663 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:29.026663 np0000001127 nova-compute[98206]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:29.026663 np0000001127 nova-compute[98206]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:29.026663 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:02:29.026663 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:29.026663 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:29.026663 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:29.026663 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:29.026663 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:29.026663 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:29.026663 np0000001127 nova-compute[98206]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:29.026663 np0000001127 nova-compute[98206]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:29.026663 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:02:29.038680 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:29.038680 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:29.038680 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:29.038680 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:29.038680 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:29.038680 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:29.038680 np0000001127 nova-compute[98206]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:29.038680 np0000001127 nova-compute[98206]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:29.038680 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:02:29.038680 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:29.038680 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:29.038680 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:29.038680 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:29.038680 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:29.038680 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:29.038680 np0000001127 nova-compute[98206]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:29.038680 np0000001127 nova-compute[98206]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:29.038680 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:02:29.098509 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665, portal: 192.168.40.100,3260]
May 21 02:02:29.098509 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665, portal: 192.168.40.100,3260] successful.
May 21 02:02:29.098509 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:29.104677 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665, portal: 192.168.50.100,3260]
May 21 02:02:29.104677 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665, portal: 192.168.50.100,3260] successful.
May 21 02:02:29.104677 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:29.119899 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:29.133039 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:29.144284 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999710022000045 future=<Future at 0x71c07c7d75f0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:02:29.146763 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Instance destroyed successfully.
May 21 02:02:29.147152 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-c64228ea-ffd5-45e8-9d57-1858e1d269b0 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lazy-loading 'numa_topology' on Instance uuid df1fb869-23ef-48e0-b609-ce91c2540c2e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:29.149772 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:29.149772 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:29.149772 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:29.149772 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:29.149772 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:29.149772 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:29.149772 np0000001127 nova-compute[98206]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:29.149772 np0000001127 nova-compute[98206]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:29.149772 np0000001127 nova-compute[98206]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:29.149772 np0000001127 nova-compute[98206]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:29.149772 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:02:29.150155 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:29.150155 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:29.150155 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:29.150155 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:29.150155 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:29.150155 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:29.150155 np0000001127 nova-compute[98206]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:29.150155 np0000001127 nova-compute[98206]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:29.150155 np0000001127 nova-compute[98206]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:29.150155 np0000001127 nova-compute[98206]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:29.150155 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:02:29.150485 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.236s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:02:29.150485 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:02:29.154028 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] HCTL ('9', '-', '-', 0) found on session 68 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:02:29.161856 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:02:29.174196 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c58c3777-19de-40be-8c64-4020bbf5000e req-26129ac5-5f10-4abe-b399-50ac693bdcee service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Received event network-vif-unplugged-cbfb2d9f-c55f-4f12-8b0c-ce07a987798a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:29.174429 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c58c3777-19de-40be-8c64-4020bbf5000e req-26129ac5-5f10-4abe-b399-50ac693bdcee service nova] Acquiring lock "e9edec14-452b-46fe-89c6-849ece08f527-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:29.174681 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c58c3777-19de-40be-8c64-4020bbf5000e req-26129ac5-5f10-4abe-b399-50ac693bdcee service nova] Lock "e9edec14-452b-46fe-89c6-849ece08f527-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:29.176953 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c58c3777-19de-40be-8c64-4020bbf5000e req-26129ac5-5f10-4abe-b399-50ac693bdcee service nova] Lock "e9edec14-452b-46fe-89c6-849ece08f527-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:29.178364 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c58c3777-19de-40be-8c64-4020bbf5000e req-26129ac5-5f10-4abe-b399-50ac693bdcee service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] No waiting events found dispatching network-vif-unplugged-cbfb2d9f-c55f-4f12-8b0c-ce07a987798a {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:02:29.179969 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c58c3777-19de-40be-8c64-4020bbf5000e req-26129ac5-5f10-4abe-b399-50ac693bdcee service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Received event network-vif-unplugged-cbfb2d9f-c55f-4f12-8b0c-ce07a987798a for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:02:29.179969 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c58c3777-19de-40be-8c64-4020bbf5000e req-26129ac5-5f10-4abe-b399-50ac693bdcee service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Received event network-vif-unplugged-397001b0-550b-43bb-8c99-269fa0d710bb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:29.179969 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c58c3777-19de-40be-8c64-4020bbf5000e req-26129ac5-5f10-4abe-b399-50ac693bdcee service nova] Acquiring lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:29.179969 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c58c3777-19de-40be-8c64-4020bbf5000e req-26129ac5-5f10-4abe-b399-50ac693bdcee service nova] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:29.179969 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c58c3777-19de-40be-8c64-4020bbf5000e req-26129ac5-5f10-4abe-b399-50ac693bdcee service nova] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:29.180252 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c58c3777-19de-40be-8c64-4020bbf5000e req-26129ac5-5f10-4abe-b399-50ac693bdcee service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] No waiting events found dispatching network-vif-unplugged-397001b0-550b-43bb-8c99-269fa0d710bb {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:02:29.180252 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-c58c3777-19de-40be-8c64-4020bbf5000e req-26129ac5-5f10-4abe-b399-50ac693bdcee service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Received unexpected event network-vif-unplugged-397001b0-550b-43bb-8c99-269fa0d710bb for instance with vm_state active and task_state powering-off.
May 21 02:02:29.181145 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:29.181145 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:29.181145 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:29.181145 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:29.181145 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:29.181145 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:29.181145 np0000001127 nova-compute[98206]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:29.181145 np0000001127 nova-compute[98206]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:29.181145 np0000001127 nova-compute[98206]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:29.181145 np0000001127 nova-compute[98206]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:29.181145 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:02:29.181977 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:29.181977 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:29.181977 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:29.181977 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:29.181977 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:29.181977 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:29.181977 np0000001127 nova-compute[98206]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:29.181977 np0000001127 nova-compute[98206]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:29.181977 np0000001127 nova-compute[98206]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:29.181977 np0000001127 nova-compute[98206]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:29.181977 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:02:29.183660 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.267s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:02:29.183660 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:02:29.198172 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Searching for a device in session 68 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:02:29.198172 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:02:29.198172 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] HCTL ('10', '-', '-', 0) found on session 69 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:02:29.198172 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:02:29.224858 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Searching for a device in session 69 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:02:29.225081 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:02:29.513880 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Took 1.43 seconds to deallocate network for instance.
May 21 02:02:29.652961 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-c64228ea-ffd5-45e8-9d57-1858e1d269b0 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Object Instance<df1fb869-23ef-48e0-b609-ce91c2540c2e> lazy-loaded attributes: flavor,numa_topology {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:02:29.652961 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-c64228ea-ffd5-45e8-9d57-1858e1d269b0 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:02:29.758429 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:02:29.758898 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:02:29.887004 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-be9d471d-4bfc-4179-8d9a-76e876072cbb req-15068aa5-a872-44ca-8fb0-c9c30931c83c service nova] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Received event network-vif-deleted-cbfb2d9f-c55f-4f12-8b0c-ce07a987798a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:29.917565 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:02:30.022135 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a40cdc2a-320d-4c84-8a8f-025944f66bb1 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:30.164837 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c64228ea-ffd5-45e8-9d57-1858e1d269b0 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.448s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:30.261934 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:02:30.669690 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lazy-loading 'flavor' on Instance uuid df1fb869-23ef-48e0-b609-ce91c2540c2e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:30.773607 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.007s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:30.773994 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:02:30.776618 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a40cdc2a-320d-4c84-8a8f-025944f66bb1 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.754s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:30.938679 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Found WWN 3300000006680ae0e for multipath device dm-1 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:02:30.938988 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:02:30.939209 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] <== connect_volume: return (3043ms) {'type': 'block', 'scsi_wwn': '3300000006680ae0e', 'path': '/dev/dm-1', 'multipath_id': '3300000006680ae0e'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:02:30.939341 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006680ae0e', 'path': '/dev/dm-1', 'multipath_id': '3300000006680ae0e'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:02:31.175741 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "refresh_cache-df1fb869-23ef-48e0-b609-ce91c2540c2e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:02:31.175916 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquired lock "refresh_cache-df1fb869-23ef-48e0-b609-ce91c2540c2e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:02:31.176093 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:02:31.176279 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lazy-loading 'info_cache' on Instance uuid df1fb869-23ef-48e0-b609-ce91c2540c2e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:31.258005 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b92c6dea-bdf0-4533-88b8-b82e59b1211a req-6010e50b-13d8-4466-80ed-2bce9cfb47eb service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Received event network-vif-unplugged-397001b0-550b-43bb-8c99-269fa0d710bb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:31.259067 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b92c6dea-bdf0-4533-88b8-b82e59b1211a req-6010e50b-13d8-4466-80ed-2bce9cfb47eb service nova] Acquiring lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:31.260656 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b92c6dea-bdf0-4533-88b8-b82e59b1211a req-6010e50b-13d8-4466-80ed-2bce9cfb47eb service nova] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:31.260656 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b92c6dea-bdf0-4533-88b8-b82e59b1211a req-6010e50b-13d8-4466-80ed-2bce9cfb47eb service nova] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:31.260656 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b92c6dea-bdf0-4533-88b8-b82e59b1211a req-6010e50b-13d8-4466-80ed-2bce9cfb47eb service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] No waiting events found dispatching network-vif-unplugged-397001b0-550b-43bb-8c99-269fa0d710bb {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:02:31.260656 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-b92c6dea-bdf0-4533-88b8-b82e59b1211a req-6010e50b-13d8-4466-80ed-2bce9cfb47eb service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Received unexpected event network-vif-unplugged-397001b0-550b-43bb-8c99-269fa0d710bb for instance with vm_state stopped and task_state powering-on.
May 21 02:02:31.260656 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b92c6dea-bdf0-4533-88b8-b82e59b1211a req-6010e50b-13d8-4466-80ed-2bce9cfb47eb service nova] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Received event network-changed-fe51ab3c-f522-4909-912f-0ff45fd331b9 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:31.260656 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b92c6dea-bdf0-4533-88b8-b82e59b1211a req-6010e50b-13d8-4466-80ed-2bce9cfb47eb service nova] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Refreshing instance network info cache due to event network-changed-fe51ab3c-f522-4909-912f-0ff45fd331b9. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:02:31.260656 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b92c6dea-bdf0-4533-88b8-b82e59b1211a req-6010e50b-13d8-4466-80ed-2bce9cfb47eb service nova] Acquiring lock "refresh_cache-f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:02:31.260861 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b92c6dea-bdf0-4533-88b8-b82e59b1211a req-6010e50b-13d8-4466-80ed-2bce9cfb47eb service nova] Acquired lock "refresh_cache-f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:02:31.261545 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-b92c6dea-bdf0-4533-88b8-b82e59b1211a req-6010e50b-13d8-4466-80ed-2bce9cfb47eb service nova] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Refreshing network info cache for port fe51ab3c-f522-4909-912f-0ff45fd331b9 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:02:31.284463 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:02:31.284675 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:02:31.285221 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:31.285638 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:31.368367 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:31.407247 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8b5074a8e47b444cb19c7dcf761ac2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87eb25eb23724c49b5bdbc462a1f36bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:02:31.445732 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:01:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-381884727',display_name='tempest-ServerActionsTestOtherB-server-381884727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001127',hostname='tempest-serveractionstestotherb-server-381884727',id=26,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLe1NRJOlGeHTlYSJiaM3PGrlo+7H9agLjrz4WfSrLuMOzPRjsAs6TJ8fG0Jtb2QDKUpaM4oEEkqECJm++HadkTr0S3iHGop0JxrI6HPofsIchSwvm0vHW+elldzycD14Q==',key_name='tempest-keypair-1287891018',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:01:19Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001127',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='513057b933ef4779a2e885ae526782b9',ramdisk_id='',reservation_id='r-xyowjbmv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1655903174',owner_user_name='tempest-ServerActionsTestOtherB-1655903174-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:02:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c4b29ba15854339bc78b55da0b300da',uuid=e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "address": "fa:16:3e:92:96:ee", "network": {"id": "acd0fbfa-f6d3-457c-a46f-cb55a0527d2b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-127865059-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-127865059-network", "vif_mac": "fa:16:3e:92:96:ee"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "513057b933ef4779a2e885ae526782b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516875-8b", "ovs_interfaceid": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:02:31.445992 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Converting VIF {"id": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "address": "fa:16:3e:92:96:ee", "network": {"id": "acd0fbfa-f6d3-457c-a46f-cb55a0527d2b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-127865059-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-127865059-network", "vif_mac": "fa:16:3e:92:96:ee"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "513057b933ef4779a2e885ae526782b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516875-8b", "ovs_interfaceid": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:02:31.447918 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:96:ee,bridge_name='br-int',has_traffic_filtering=True,id=76516875-8b8a-41f5-9a3f-b76d4c3cc02a,network=Network(acd0fbfa-f6d3-457c-a46f-cb55a0527d2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76516875-8b') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:02:31.452148 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] End _get_guest_xml xml=<domain type="qemu">
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:   <uuid>e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2</uuid>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:   <name>instance-0000001a</name>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:   <memory>262144</memory>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:       <nova:name>tempest-ServerActionsTestOtherB-server-381884727</nova:name>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:02:27</nova:creationTime>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.micro" id="84">
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:         <nova:memory>256</nova:memory>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:           <nova:property name="hw_machine_type">pc</nova:property>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:           <nova:property name="hw_video_model">virtio</nova:property>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:         <nova:user uuid="9c4b29ba15854339bc78b55da0b300da">tempest-ServerActionsTestOtherB-1655903174-project-member</nova:user>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:         <nova:project uuid="513057b933ef4779a2e885ae526782b9">tempest-ServerActionsTestOtherB-1655903174</nova:project>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:         <nova:port uuid="76516875-8b8a-41f5-9a3f-b76d4c3cc02a">
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:     <system>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:       <entry name="serial">e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2</entry>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:       <entry name="uuid">e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2</entry>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:     </system>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:   <os>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:   </os>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:   <features>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:   </features>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:   <devices>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk"/>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:     </disk>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk.config"/>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:     </disk>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:       <alias name="ua-0fe98eab-6f95-43f2-9f8a-a4dc45525665"/>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-1"/>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:       <target dev="vdb" bus="virtio"/>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:       <serial>0fe98eab-6f95-43f2-9f8a-a4dc45525665</serial>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:     </disk>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:92:96:ee"/>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:       <target dev="tap76516875-8b"/>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:     </interface>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/console.log" append="off"/>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:     </serial>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:     <video>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:     </video>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:     </rng>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:   </devices>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]: </domain>
May 21 02:02:31.452148 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:02:31.455998 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:01:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-381884727',display_name='tempest-ServerActionsTestOtherB-server-381884727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001127',hostname='tempest-serveractionstestotherb-server-381884727',id=26,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLe1NRJOlGeHTlYSJiaM3PGrlo+7H9agLjrz4WfSrLuMOzPRjsAs6TJ8fG0Jtb2QDKUpaM4oEEkqECJm++HadkTr0S3iHGop0JxrI6HPofsIchSwvm0vHW+elldzycD14Q==',key_name='tempest-keypair-1287891018',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:01:19Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001127',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='513057b933ef4779a2e885ae526782b9',ramdisk_id='',reservation_id='r-xyowjbmv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1655903174',owner_user_name='tempest-ServerActionsTestOtherB-1655903174-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:02:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c4b29ba15854339bc78b55da0b300da',uuid=e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "address": "fa:16:3e:92:96:ee", "network": {"id": "acd0fbfa-f6d3-457c-a46f-cb55a0527d2b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-127865059-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-127865059-network", "vif_mac": "fa:16:3e:92:96:ee"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "513057b933ef4779a2e885ae526782b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516875-8b", "ovs_interfaceid": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:02:31.455998 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Converting VIF {"id": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "address": "fa:16:3e:92:96:ee", "network": {"id": "acd0fbfa-f6d3-457c-a46f-cb55a0527d2b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-127865059-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-127865059-network", "vif_mac": "fa:16:3e:92:96:ee"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "513057b933ef4779a2e885ae526782b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516875-8b", "ovs_interfaceid": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:02:31.455998 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:96:ee,bridge_name='br-int',has_traffic_filtering=True,id=76516875-8b8a-41f5-9a3f-b76d4c3cc02a,network=Network(acd0fbfa-f6d3-457c-a46f-cb55a0527d2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76516875-8b') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:02:31.455998 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:96:ee,bridge_name='br-int',has_traffic_filtering=True,id=76516875-8b8a-41f5-9a3f-b76d4c3cc02a,network=Network(acd0fbfa-f6d3-457c-a46f-cb55a0527d2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76516875-8b') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:02:31.455998 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:31.455998 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:31.455998 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:02:31.456565 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:31.456565 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4093fd26-78b5-56da-b11c-c4d3b41edf68', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:31.457586 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:31.458531 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:02:31.465456 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:31.469713 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:31.469713 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76516875-8b, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:31.469713 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap76516875-8b, col_values=(('qos', UUID('6be26e3c-2ba9-4463-8d62-b5b9edb1574b')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:31.469969 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap76516875-8b, col_values=(('external_ids', {'iface-id': '76516875-8b8a-41f5-9a3f-b76d4c3cc02a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:96:ee', 'vm-uuid': 'e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:31.472013 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:31.474980 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:02:31.485831 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:31.487053 np0000001127 nova-compute[98206]: INFO os_vif [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:96:ee,bridge_name='br-int',has_traffic_filtering=True,id=76516875-8b8a-41f5-9a3f-b76d4c3cc02a,network=Network(acd0fbfa-f6d3-457c-a46f-cb55a0527d2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76516875-8b')
May 21 02:02:31.558909 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a40cdc2a-320d-4c84-8a8f-025944f66bb1 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:02:31.559100 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-a40cdc2a-320d-4c84-8a8f-025944f66bb1 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:02:31.679400 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Object Instance<df1fb869-23ef-48e0-b609-ce91c2540c2e> lazy-loaded attributes: flavor,info_cache {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:02:31.764801 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-b92c6dea-bdf0-4533-88b8-b82e59b1211a req-6010e50b-13d8-4466-80ed-2bce9cfb47eb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:31.794393 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:02:32.041493 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Successfully created port: 9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:02:32.063492 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-a40cdc2a-320d-4c84-8a8f-025944f66bb1 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:02:32.182097 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:32.239888 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-b92c6dea-bdf0-4533-88b8-b82e59b1211a req-6010e50b-13d8-4466-80ed-2bce9cfb47eb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:32.298217 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:02:32.411331 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-b92c6dea-bdf0-4533-88b8-b82e59b1211a req-6010e50b-13d8-4466-80ed-2bce9cfb47eb service nova] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Updated VIF entry in instance network info cache for port fe51ab3c-f522-4909-912f-0ff45fd331b9. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:02:32.411655 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-b92c6dea-bdf0-4533-88b8-b82e59b1211a req-6010e50b-13d8-4466-80ed-2bce9cfb47eb service nova] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Updating instance_info_cache with network_info: [{"id": "fe51ab3c-f522-4909-912f-0ff45fd331b9", "address": "fa:16:3e:59:b4:d0", "network": {"id": "38d66f09-c738-4e79-9aeb-12e87e29f568", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-447420743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "177bec65268546d2b899e09989183b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe51ab3c-f5", "ovs_interfaceid": "fe51ab3c-f522-4909-912f-0ff45fd331b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:02:32.574368 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:32.586525 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a40cdc2a-320d-4c84-8a8f-025944f66bb1 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.810s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:32.679235 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-a40cdc2a-320d-4c84-8a8f-025944f66bb1 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Deleted allocations for instance e9edec14-452b-46fe-89c6-849ece08f527
May 21 02:02:32.702742 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Successfully updated port: 9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:02:32.758506 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-4354a056-614d-49a5-94f5-ab3654a24e98 req-36ed1f5c-6742-4d1e-b859-c9473792bf32 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Received event network-changed-9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:32.758506 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-4354a056-614d-49a5-94f5-ab3654a24e98 req-36ed1f5c-6742-4d1e-b859-c9473792bf32 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Refreshing instance network info cache due to event network-changed-9089f785-707f-4bb7-ac00-927fe747fcc5. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:02:32.758506 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4354a056-614d-49a5-94f5-ab3654a24e98 req-36ed1f5c-6742-4d1e-b859-c9473792bf32 service nova] Acquiring lock "refresh_cache-8948a19b-9e7e-448d-b782-be58020b5320" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:02:32.758506 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4354a056-614d-49a5-94f5-ab3654a24e98 req-36ed1f5c-6742-4d1e-b859-c9473792bf32 service nova] Acquired lock "refresh_cache-8948a19b-9e7e-448d-b782-be58020b5320" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:02:32.758931 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-4354a056-614d-49a5-94f5-ab3654a24e98 req-36ed1f5c-6742-4d1e-b859-c9473792bf32 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Refreshing network info cache for port 9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:02:32.803713 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Updating instance_info_cache with network_info: [{"id": "397001b0-550b-43bb-8c99-269fa0d710bb", "address": "fa:16:3e:f4:b7:59", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397001b0-55", "ovs_interfaceid": "397001b0-550b-43bb-8c99-269fa0d710bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:02:32.913805 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b92c6dea-bdf0-4533-88b8-b82e59b1211a req-6010e50b-13d8-4466-80ed-2bce9cfb47eb service nova] Releasing lock "refresh_cache-f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:02:33.025552 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:02:33.025729 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:02:33.025852 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:02:33.025947 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] No VIF found with MAC fa:16:3e:92:96:ee, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:02:33.026522 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Using config drive
May 21 02:02:33.214678 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "refresh_cache-8948a19b-9e7e-448d-b782-be58020b5320" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:02:33.261845 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-4354a056-614d-49a5-94f5-ab3654a24e98 req-36ed1f5c-6742-4d1e-b859-c9473792bf32 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:33.314495 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:02:33.314495 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Releasing lock "refresh_cache-df1fb869-23ef-48e0-b609-ce91c2540c2e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:02:33.315495 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:02:33.316784 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Creating image(s)
May 21 02:02:33.317633 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "/opt/stack/data/nova/instances/8948a19b-9e7e-448d-b782-be58020b5320/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:33.317775 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "/opt/stack/data/nova/instances/8948a19b-9e7e-448d-b782-be58020b5320/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:33.319108 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "/opt/stack/data/nova/instances/8948a19b-9e7e-448d-b782-be58020b5320/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:33.322490 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:02:33.324044 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:02:33.325450 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:33.350144 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-4354a056-614d-49a5-94f5-ab3654a24e98 req-36ed1f5c-6742-4d1e-b859-c9473792bf32 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:02:33.446677 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.121s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:33.449534 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:33.449534 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:33.449534 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:02:33.452732 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:02:33.453305 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:33.539999 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-4354a056-614d-49a5-94f5-ab3654a24e98 req-36ed1f5c-6742-4d1e-b859-c9473792bf32 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:02:33.566906 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.113s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:33.568744 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/8948a19b-9e7e-448d-b782-be58020b5320/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:33.580305 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:33.611650 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:33.612067 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:33.632822 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/8948a19b-9e7e-448d-b782-be58020b5320/disk 1073741824" returned: 0 in 0.065s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:33.635547 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.186s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:33.635547 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:33.700213 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a40cdc2a-320d-4c84-8a8f-025944f66bb1 tempest-TestMinimumBasicScenario-654915677 tempest-TestMinimumBasicScenario-654915677-project-member] Lock "e9edec14-452b-46fe-89c6-849ece08f527" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.525s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:33.725453 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:33.764925 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.130s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:33.765754 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8948a19b-9e7e-448d-b782-be58020b5320/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:02:33.765985 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8948a19b-9e7e-448d-b782-be58020b5320/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:33.835304 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0008160649999808811 future=<Future at 0x71c07c7a9670 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:02:33.835304 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:02:33.835591 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=0.4168448509999507 future=<Future at 0x71c07c5eb680 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:02:33.835591 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=0.41670974999988175 future=<Future at 0x71c07c5eb680 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:02:33.873865 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8948a19b-9e7e-448d-b782-be58020b5320/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:33.875795 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Cannot resize image /opt/stack/data/nova/instances/8948a19b-9e7e-448d-b782-be58020b5320/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:02:33.876275 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:02:33.877506 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Ensure instance console log exists: /opt/stack/data/nova/instances/8948a19b-9e7e-448d-b782-be58020b5320/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:02:33.877506 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:33.877506 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:33.877506 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:33.962913 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:33.972316 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:33.974276 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:34.000298 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:34.007496 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:34.043159 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4354a056-614d-49a5-94f5-ab3654a24e98 req-36ed1f5c-6742-4d1e-b859-c9473792bf32 service nova] Releasing lock "refresh_cache-8948a19b-9e7e-448d-b782-be58020b5320" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:02:34.043753 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquired lock "refresh_cache-8948a19b-9e7e-448d-b782-be58020b5320" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:02:34.043912 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:02:34.253114 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.00047700700019959186 future=<Future at 0x71c07c5eb680 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:02:34.255499 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Emitting event <LifecycleEvent: 1779328939.2522168, e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:02:34.255499 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] VM Stopped (Lifecycle Event)
May 21 02:02:34.255499 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:02:34.255499 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=9.739803104000202 future=<Future at 0x71c07c5392e0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:02:34.255774 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=9.739427037000041 future=<Future at 0x71c07c5392e0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:02:34.334835 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Instance destroyed successfully.
May 21 02:02:34.335217 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lazy-loading 'numa_topology' on Instance uuid df1fb869-23ef-48e0-b609-ce91c2540c2e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:34.440782 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Removed pending STOPPED event for e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2 due to new event <LifecycleEvent: 1779328954.440342, e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2 => Resumed> {{(pid=98206) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 21 02:02:34.440977 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328954.440342, e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:02:34.441205 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] VM Resumed (Lifecycle Event)
May 21 02:02:34.445619 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Instance event wait completed in 0 seconds for  {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:02:34.448307 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Instance running successfully.
May 21 02:02:34.450315 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Failed to set time: agent not configured {{(pid=98206) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 21 02:02:34.450315 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-069759a7-4102-429b-b401-aba749dc8873 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] finish_migration finished successfully. {{(pid=98206) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 21 02:02:34.621092 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:02:34.757915 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:02:34.790495 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:34.837161 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Object Instance<df1fb869-23ef-48e0-b609-ce91c2540c2e> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:02:34.837488 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lazy-loading 'resources' on Instance uuid df1fb869-23ef-48e0-b609-ce91c2540c2e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:34.865997 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-48e2a046-7620-4932-aa41-b6cdd7130b93 req-63ade85d-4d28-4463-823d-f8533d2418f3 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Received event network-vif-plugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:34.866707 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-48e2a046-7620-4932-aa41-b6cdd7130b93 req-63ade85d-4d28-4463-823d-f8533d2418f3 service nova] Acquiring lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:34.866911 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-48e2a046-7620-4932-aa41-b6cdd7130b93 req-63ade85d-4d28-4463-823d-f8533d2418f3 service nova] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:34.867094 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-48e2a046-7620-4932-aa41-b6cdd7130b93 req-63ade85d-4d28-4463-823d-f8533d2418f3 service nova] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:34.867324 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-48e2a046-7620-4932-aa41-b6cdd7130b93 req-63ade85d-4d28-4463-823d-f8533d2418f3 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] No waiting events found dispatching network-vif-plugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:02:34.867537 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-48e2a046-7620-4932-aa41-b6cdd7130b93 req-63ade85d-4d28-4463-823d-f8533d2418f3 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Received unexpected event network-vif-plugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a for instance with vm_state active and task_state resize_finish.
May 21 02:02:34.867723 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-48e2a046-7620-4932-aa41-b6cdd7130b93 req-63ade85d-4d28-4463-823d-f8533d2418f3 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Received event network-vif-plugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:34.867910 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-48e2a046-7620-4932-aa41-b6cdd7130b93 req-63ade85d-4d28-4463-823d-f8533d2418f3 service nova] Acquiring lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:34.870709 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-48e2a046-7620-4932-aa41-b6cdd7130b93 req-63ade85d-4d28-4463-823d-f8533d2418f3 service nova] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:34.870924 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-48e2a046-7620-4932-aa41-b6cdd7130b93 req-63ade85d-4d28-4463-823d-f8533d2418f3 service nova] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:34.871174 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-48e2a046-7620-4932-aa41-b6cdd7130b93 req-63ade85d-4d28-4463-823d-f8533d2418f3 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] No waiting events found dispatching network-vif-plugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:02:34.871356 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-48e2a046-7620-4932-aa41-b6cdd7130b93 req-63ade85d-4d28-4463-823d-f8533d2418f3 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Received unexpected event network-vif-plugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a for instance with vm_state active and task_state resize_finish.
May 21 02:02:34.945229 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:02:34.951287 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Updating instance_info_cache with network_info: [{"id": "9089f785-707f-4bb7-ac00-927fe747fcc5", "address": "fa:16:3e:27:71:42", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9089f785-70", "ovs_interfaceid": "9089f785-707f-4bb7-ac00-927fe747fcc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:02:34.953349 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:02:35.342394 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Object Instance<df1fb869-23ef-48e0-b609-ce91c2540c2e> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:02:35.343181 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:01:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1160366387',display_name='tempest-AttachVolumeTestJSON-server-1160366387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumetestjson-server-1160366387',id=27,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAujiHJsmhJMgEmRnWv5ymFbZbTAYncvgq9NsMeC8MiZ8la1gTOga8PrdaHkWknChauf3EhimnVrbr35Cl923XBy1BnVqXrs2rMVao3ITr2vCMWLpWOxbYc5JhA+8oEsw==',key_name='tempest-keypair-1825862747',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:01:35Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e80cee8643f34f6685ff7fb42920afc3',ramdisk_id='',reservation_id='r-td2yddno',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2050140136',owner_user_name='tempest-AttachVolumeTestJSON-2050140136-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:02:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='640fad0f3dfe4ee99b04c12c2b8fd9dd',uuid=df1fb869-23ef-48e0-b609-ce91c2540c2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "397001b0-550b-43bb-8c99-269fa0d710bb", "address": "fa:16:3e:f4:b7:59", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397001b0-55", "ovs_interfaceid": "397001b0-550b-43bb-8c99-269fa0d710bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:02:35.343397 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Converting VIF {"id": "397001b0-550b-43bb-8c99-269fa0d710bb", "address": "fa:16:3e:f4:b7:59", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397001b0-55", "ovs_interfaceid": "397001b0-550b-43bb-8c99-269fa0d710bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:02:35.344035 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:b7:59,bridge_name='br-int',has_traffic_filtering=True,id=397001b0-550b-43bb-8c99-269fa0d710bb,network=Network(70a21e20-dfdf-49b9-bfd2-75a1f49c8a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397001b0-55') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:02:35.344568 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:b7:59,bridge_name='br-int',has_traffic_filtering=True,id=397001b0-550b-43bb-8c99-269fa0d710bb,network=Network(70a21e20-dfdf-49b9-bfd2-75a1f49c8a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397001b0-55') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:02:35.346934 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:35.347243 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap397001b0-55, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:35.348394 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:35.351166 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:02:35.354115 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:35.354382 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=42a5e9e3-127c-4bcf-b46b-b07c8266cd69) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:35.355583 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:35.355954 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:02:35.356412 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:35.358619 np0000001127 nova-compute[98206]: INFO os_vif [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:b7:59,bridge_name='br-int',has_traffic_filtering=True,id=397001b0-550b-43bb-8c99-269fa0d710bb,network=Network(70a21e20-dfdf-49b9-bfd2-75a1f49c8a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397001b0-55')
May 21 02:02:35.359747 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:02:35.360199 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:02:35.360385 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:02:35.360836 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:02:35.361230 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:02:35.361424 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:02:35.391579 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:35.391579 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:35.391579 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:35.391579 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:35.391579 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:35.391579 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:35.391579 np0000001127 nova-compute[98206]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:35.391579 np0000001127 nova-compute[98206]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:35.391579 np0000001127 nova-compute[98206]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:35.391579 np0000001127 nova-compute[98206]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:35.391579 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:02:35.391922 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:35.391922 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:35.391922 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:35.391922 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:35.391922 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:35.391922 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:35.391922 np0000001127 nova-compute[98206]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:35.391922 np0000001127 nova-compute[98206]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:35.391922 np0000001127 nova-compute[98206]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:35.391922 np0000001127 nova-compute[98206]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:35.391922 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:02:35.391922 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', '56'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', '64'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', '65'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', '66'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', '69')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:02:35.392266 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', '67')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:02:35.394253 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', '66')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:02:35.394253 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c73e840>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0'): ({'sdh'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:02:35.394620 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Removing multipathed devices sdi, sdh {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:02:35.394785 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Flush multipath device 33000000066d115e2 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:02:35.435550 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:02:35.452772 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Releasing lock "refresh_cache-8948a19b-9e7e-448d-b782-be58020b5320" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:02:35.453076 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Instance network_info: |[{"id": "9089f785-707f-4bb7-ac00-927fe747fcc5", "address": "fa:16:3e:27:71:42", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9089f785-70", "ovs_interfaceid": "9089f785-707f-4bb7-ac00-927fe747fcc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:02:35.454723 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Start _get_guest_xml network_info=[{"id": "9089f785-707f-4bb7-ac00-927fe747fcc5", "address": "fa:16:3e:27:71:42", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9089f785-70", "ovs_interfaceid": "9089f785-707f-4bb7-ac00-927fe747fcc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:02:35.456240 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 21 02:02:35.456478 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328955.4562454, e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:02:35.456611 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] VM Started (Lifecycle Event)
May 21 02:02:35.463240 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:02:35.463240 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-211968432', uuid='8948a19b-9e7e-448d-b782-be58020b5320'), owner=OwnerMeta(userid='8b5074a8e47b444cb19c7dcf761ac2ae', username='tempest-ServerRescueNegativeTestJSON-1108613901-project-member', projectid='87eb25eb23724c49b5bdbc462a1f36bc', projectname='tempest-ServerRescueNegativeTestJSON-1108613901'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9089f785-707f-4bb7-ac00-927fe747fcc5", "address": "fa:16:3e:27:71:42", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9089f785-70", "ovs_interfaceid": "9089f785-707f-4bb7-ac00-927fe747fcc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328955.4623778) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:02:35.465404 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:02:35.466295 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:02:35.469910 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:02:35.469910 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:02:35.469910 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:02:35.469910 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:02:35.469910 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:02:35.469910 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:02:35.469910 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:02:35.469910 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:02:35.469910 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:02:35.470359 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:02:35.470359 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:02:35.470359 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:02:35.470535 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:02:35.470672 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:02:35.482257 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:02:35.489917 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:02:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-211968432',display_name='tempest-ServerRescueNegativeTestJSON-server-211968432',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serverrescuenegativetestjson-server-211968432',id=32,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFx9wnklHgIW/7mX/mDP0Acf71gIHeOJ42Z6/jd1Qb5TRL5dzkGcgjJOewbr4VJwvfK5/AZfylhiEzVdL+ykfazuitFbm4WyjJZfeHI3do3V/FnUZD7DAaZ4ri/2MlV9dQ==',key_name='tempest-keypair-1008477287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87eb25eb23724c49b5bdbc462a1f36bc',ramdisk_id='',reservation_id='r-0isusuuj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1108613901',owner_user_name='tempest-ServerRescueNegativeTestJSON-1108613901-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:02:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b5074a8e47b444cb19c7dcf761ac2ae',uuid=8948a19b-9e7e-448d-b782-be58020b5320,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9089f785-707f-4bb7-ac00-927fe747fcc5", "address": "fa:16:3e:27:71:42", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9089f785-70", "ovs_interfaceid": "9089f785-707f-4bb7-ac00-927fe747fcc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:02:35.490091 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Converting VIF {"id": "9089f785-707f-4bb7-ac00-927fe747fcc5", "address": "fa:16:3e:27:71:42", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9089f785-70", "ovs_interfaceid": "9089f785-707f-4bb7-ac00-927fe747fcc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:02:35.490688 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:71:42,bridge_name='br-int',has_traffic_filtering=True,id=9089f785-707f-4bb7-ac00-927fe747fcc5,network=Network(b8fcc592-f44d-440d-b1f1-c57714291c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9089f785-70') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:02:35.491344 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lazy-loading 'pci_devices' on Instance uuid 8948a19b-9e7e-448d-b782-be58020b5320 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:35.531088 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:02:35.531255 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:02:35.533839 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:02:35.548385 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:02:35.548686 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:02:35.559298 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:35.595258 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0, portal: 192.168.40.100,3260]
May 21 02:02:35.595258 np0000001127 nova-compute[98206]: Logout of [sid: 67, target: iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0, portal: 192.168.40.100,3260] successful.
May 21 02:02:35.595258 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:35.621404 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:35.637162 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:35.676822 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 66, target: iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0, portal: 192.168.50.100,3260]
May 21 02:02:35.676822 np0000001127 nova-compute[98206]: Logout of [sid: 66, target: iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0, portal: 192.168.50.100,3260] successful.
May 21 02:02:35.676822 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:35.699498 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:35.699836 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:02:35.700022 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] <== disconnect_volume: return (339ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:02:35.700205 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:02:35.706457 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Start _get_guest_xml network_info=[{"id": "397001b0-550b-43bb-8c99-269fa0d710bb", "address": "fa:16:3e:f4:b7:59", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397001b0-55", "ovs_interfaceid": "397001b0-550b-43bb-8c99-269fa0d710bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, 'status': 'reserved', 'instance': 'df1fb869-23ef-48e0-b609-ce91c2540c2e', 'attached_at': '', 'detached_at': '', 'volume_id': '8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', 'serial': '8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0'}, 'delete_on_termination': False, 'attachment_id': '27a92abd-ff2b-4dad-bb64-587a1fd1083f', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:02:35.708480 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:02:35.709681 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-1160366387', uuid='df1fb869-23ef-48e0-b609-ce91c2540c2e'), owner=OwnerMeta(userid='640fad0f3dfe4ee99b04c12c2b8fd9dd', username='tempest-AttachVolumeTestJSON-2050140136-project-member', projectid='e80cee8643f34f6685ff7fb42920afc3', projectname='tempest-AttachVolumeTestJSON-2050140136'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "397001b0-550b-43bb-8c99-269fa0d710bb", "address": "fa:16:3e:f4:b7:59", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397001b0-55", "ovs_interfaceid": "397001b0-550b-43bb-8c99-269fa0d710bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328955.7093601) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:02:35.710872 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:02:35.711327 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:02:35.712126 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:02:35.712405 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:02:35.714851 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:02:35.715163 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:02:35.715374 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:02:35.715433 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:02:35.715570 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:02:35.715693 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:02:35.715784 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:02:35.715923 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:02:35.716035 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:02:35.716147 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:02:35.716246 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:02:35.716370 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:02:35.716510 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lazy-loading 'vcpu_model' on Instance uuid df1fb869-23ef-48e0-b609-ce91c2540c2e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:35.959768 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:02:35.964401 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:02:35.994724 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] End _get_guest_xml xml=<domain type="qemu">
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:   <uuid>8948a19b-9e7e-448d-b782-be58020b5320</uuid>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:   <name>instance-00000020</name>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-211968432</nova:name>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:02:35</nova:creationTime>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:         <nova:user uuid="8b5074a8e47b444cb19c7dcf761ac2ae">tempest-ServerRescueNegativeTestJSON-1108613901-project-member</nova:user>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:         <nova:project uuid="87eb25eb23724c49b5bdbc462a1f36bc">tempest-ServerRescueNegativeTestJSON-1108613901</nova:project>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:         <nova:port uuid="9089f785-707f-4bb7-ac00-927fe747fcc5">
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:     <system>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:       <entry name="serial">8948a19b-9e7e-448d-b782-be58020b5320</entry>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:       <entry name="uuid">8948a19b-9e7e-448d-b782-be58020b5320</entry>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:     </system>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:   <os>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:   </os>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:   <features>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:   </features>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:   <devices>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/8948a19b-9e7e-448d-b782-be58020b5320/disk"/>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:     </disk>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/8948a19b-9e7e-448d-b782-be58020b5320/disk.config"/>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:     </disk>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:27:71:42"/>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:       <target dev="tap9089f785-70"/>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:     </interface>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/8948a19b-9e7e-448d-b782-be58020b5320/console.log" append="off"/>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:     </serial>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:     <video>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:     </video>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:     </rng>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:   </devices>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]: </domain>
May 21 02:02:35.994724 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:02:35.998781 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Preparing to wait for external event network-vif-plugged-9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:02:35.998781 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "8948a19b-9e7e-448d-b782-be58020b5320-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:35.998781 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "8948a19b-9e7e-448d-b782-be58020b5320-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:35.998781 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "8948a19b-9e7e-448d-b782-be58020b5320-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:35.998781 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:02:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-211968432',display_name='tempest-ServerRescueNegativeTestJSON-server-211968432',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serverrescuenegativetestjson-server-211968432',id=32,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFx9wnklHgIW/7mX/mDP0Acf71gIHeOJ42Z6/jd1Qb5TRL5dzkGcgjJOewbr4VJwvfK5/AZfylhiEzVdL+ykfazuitFbm4WyjJZfeHI3do3V/FnUZD7DAaZ4ri/2MlV9dQ==',key_name='tempest-keypair-1008477287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87eb25eb23724c49b5bdbc462a1f36bc',ramdisk_id='',reservation_id='r-0isusuuj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1108613901',owner_user_name='tempest-ServerRescueNegativeTestJSON-1108613901-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:02:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b5074a8e47b444cb19c7dcf761ac2ae',uuid=8948a19b-9e7e-448d-b782-be58020b5320,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9089f785-707f-4bb7-ac00-927fe747fcc5", "address": "fa:16:3e:27:71:42", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9089f785-70", "ovs_interfaceid": "9089f785-707f-4bb7-ac00-927fe747fcc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:02:35.998781 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Converting VIF {"id": "9089f785-707f-4bb7-ac00-927fe747fcc5", "address": "fa:16:3e:27:71:42", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9089f785-70", "ovs_interfaceid": "9089f785-707f-4bb7-ac00-927fe747fcc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:02:35.998781 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:71:42,bridge_name='br-int',has_traffic_filtering=True,id=9089f785-707f-4bb7-ac00-927fe747fcc5,network=Network(b8fcc592-f44d-440d-b1f1-c57714291c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9089f785-70') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:02:35.998781 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:71:42,bridge_name='br-int',has_traffic_filtering=True,id=9089f785-707f-4bb7-ac00-927fe747fcc5,network=Network(b8fcc592-f44d-440d-b1f1-c57714291c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9089f785-70') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:02:35.998781 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:35.998781 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:35.998781 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:02:36.002263 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:36.002839 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fba1de57-643a-5abd-b141-465b84579eb2', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:36.005939 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:02:36.007798 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:36.007980 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9089f785-70, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:36.009802 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9089f785-70, col_values=(('qos', UUID('47a5a9ce-7603-48d9-b521-a941f92d8441')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:36.010027 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9089f785-70, col_values=(('external_ids', {'iface-id': '9089f785-707f-4bb7-ac00-927fe747fcc5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:71:42', 'vm-uuid': '8948a19b-9e7e-448d-b782-be58020b5320'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:36.011078 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:36.012876 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:02:36.017780 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:36.019085 np0000001127 nova-compute[98206]: INFO os_vif [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:71:42,bridge_name='br-int',has_traffic_filtering=True,id=9089f785-707f-4bb7-ac00-927fe747fcc5,network=Network(b8fcc592-f44d-440d-b1f1-c57714291c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9089f785-70')
May 21 02:02:36.221032 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Object Instance<df1fb869-23ef-48e0-b609-ce91c2540c2e> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:02:36.238461 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk.config --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:36.348965 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk.config --force-share --output=json" returned: 0 in 0.110s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:36.350005 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "/opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:36.350005 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "/opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:36.350798 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "/opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:36.351390 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:02:36.351940 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:02:36.352179 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:02:36.354656 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:02:36.355383 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:02:36.372634 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:02:36.374648 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:02:36.374648 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:02:36.375181 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:36.379410 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:02:36.379410 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:02:36.379576 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:02:36.391558 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:02:36.391558 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:36.405267 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:02:36.405267 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:36.412237 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0] added
May 21 02:02:36.412237 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:02:36.412237 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:02:36.412237 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:02:36.412237 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:02:36.412237 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:02:36.412237 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:36.412237 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:02:36.412237 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0375(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:02:36.412714 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:02:36.420539 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0] added
May 21 02:02:36.420539 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:02:36.420539 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:02:36.420539 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:02:36.420539 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:02:36.420539 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:02:36.420539 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:36.420781 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:02:36.420964 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0414(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:02:36.421165 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:02:36.635867 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:36.764519 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:36.764883 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:36.765116 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:36.864271 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Port 76516875-8b8a-41f5-9a3f-b76d4c3cc02a binding to destination host np0000001127 is already ACTIVE {{(pid=98206) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3211}}
May 21 02:02:36.864492 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Acquiring lock "refresh_cache-e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:02:36.864660 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Acquired lock "refresh_cache-e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:02:36.864830 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:02:37.110952 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Acquiring lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:37.110952 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:37.367264 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:37.412784 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:02:37.423555 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:02:37.429031 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:02:37.429031 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:02:37.446511 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:02:37.446511 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:37.450571 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:37.472331 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:37.478227 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:37.478227 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:37.478227 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:37.478227 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:37.478227 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:37.478227 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:37.478227 np0000001127 nova-compute[98206]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:37.478227 np0000001127 nova-compute[98206]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:37.478227 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:02:37.479364 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:37.479364 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:37.479364 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:37.479364 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:37.479364 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:37.479364 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:37.479364 np0000001127 nova-compute[98206]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:37.479364 np0000001127 nova-compute[98206]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:37.479364 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:02:37.501529 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:37.501529 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:37.501529 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:37.501529 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:37.501529 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:37.501529 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:37.501529 np0000001127 nova-compute[98206]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:37.501529 np0000001127 nova-compute[98206]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:37.501529 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:02:37.501529 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:37.501529 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:37.501529 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:37.501529 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:37.501529 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:37.501529 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:37.501529 np0000001127 nova-compute[98206]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:37.501529 np0000001127 nova-compute[98206]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:37.501529 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:02:37.543847 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:02:37.544486 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:02:37.544486 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] No VIF found with MAC fa:16:3e:27:71:42, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:02:37.544768 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Using config drive
May 21 02:02:37.555314 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0, portal: 192.168.40.100,3260]
May 21 02:02:37.555314 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0, portal: 192.168.40.100,3260] successful.
May 21 02:02:37.555314 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:37.562888 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0, portal: 192.168.50.100,3260]
May 21 02:02:37.562888 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0, portal: 192.168.50.100,3260] successful.
May 21 02:02:37.562888 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:37.569241 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:37.579551 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:37.591504 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:37.591504 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:37.591504 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:37.591504 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:37.591504 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:37.591504 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:37.591504 np0000001127 nova-compute[98206]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:37.591504 np0000001127 nova-compute[98206]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:37.591504 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:37.591504 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:37.591504 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:02:37.592071 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:37.592071 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:37.592071 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:37.592071 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:37.592071 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:37.592071 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:37.592071 np0000001127 nova-compute[98206]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:37.592071 np0000001127 nova-compute[98206]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:37.592071 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:37.592071 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:37.592071 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:02:37.593039 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.219s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:02:37.593337 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:02:37.594720 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] HCTL ('13', '-', '-', 0) found on session 70 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:02:37.594999 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:02:37.603207 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:37.603207 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:37.603207 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:37.603207 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:37.603207 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:37.603207 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:37.603207 np0000001127 nova-compute[98206]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:37.603207 np0000001127 nova-compute[98206]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:37.603207 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:37.603207 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:37.603207 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:02:37.603207 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:37.603207 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:37.603207 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:37.603207 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:37.603207 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:37.603207 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:37.603207 np0000001127 nova-compute[98206]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:37.603207 np0000001127 nova-compute[98206]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:37.603207 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:37.603207 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:37.603207 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:02:37.603207 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.223s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:02:37.603207 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:02:37.604968 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] HCTL ('14', '-', '-', 0) found on session 71 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:02:37.604968 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:02:37.615300 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lazy-loading 'flavor' on Instance uuid 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:37.654816 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Searching for a device in session 70 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:02:37.654816 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:02:37.656683 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Searching for a device in session 71 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:02:37.656683 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:02:37.834679 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:38.022391 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Updating instance_info_cache with network_info: [{"id": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "address": "fa:16:3e:92:96:ee", "network": {"id": "acd0fbfa-f6d3-457c-a46f-cb55a0527d2b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-127865059-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "513057b933ef4779a2e885ae526782b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516875-8b", "ovs_interfaceid": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:02:38.050701 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:38.208879 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Creating config drive at /opt/stack/data/nova/instances/8948a19b-9e7e-448d-b782-be58020b5320/disk.config
May 21 02:02:38.215177 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8948a19b-9e7e-448d-b782-be58020b5320/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpu375qfzi {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:38.292004 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8948a19b-9e7e-448d-b782-be58020b5320/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpu375qfzi" returned: 0 in 0.076s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:38.380587 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:02:38.524847 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Releasing lock "refresh_cache-e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:02:38.627102 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.517s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:38.787600 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:38.816358 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:38.912990 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:38.998339 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:38.999689 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:39.032804 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Creating tmpfile /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/tmpuo8x2xg3 to verify with other compute node that the instance is on the same shared storage. {{(pid=98206) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:10552}}
May 21 02:02:39.033065 np0000001127 nova-compute[98206]: DEBUG nova.compute.rpcapi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98206) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 21 02:02:39.405854 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:39.414676 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Found WWN 33000000066d115e2 for multipath device dm-5 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:02:39.414676 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.062s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:02:39.414676 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] <== connect_volume: return (3062ms) {'type': 'block', 'scsi_wwn': '33000000066d115e2', 'path': '/dev/dm-5', 'multipath_id': '33000000066d115e2'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:02:39.414676 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000066d115e2', 'path': '/dev/dm-5', 'multipath_id': '33000000066d115e2'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:02:39.427280 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-227cf9eb-973d-4161-8016-6777e97f9d7d req-5934e76f-a7d3-4ce2-a8cd-618215bb89c2 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Received event network-vif-plugged-9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:39.427280 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-227cf9eb-973d-4161-8016-6777e97f9d7d req-5934e76f-a7d3-4ce2-a8cd-618215bb89c2 service nova] Acquiring lock "8948a19b-9e7e-448d-b782-be58020b5320-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:39.427280 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-227cf9eb-973d-4161-8016-6777e97f9d7d req-5934e76f-a7d3-4ce2-a8cd-618215bb89c2 service nova] Lock "8948a19b-9e7e-448d-b782-be58020b5320-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:39.427596 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-227cf9eb-973d-4161-8016-6777e97f9d7d req-5934e76f-a7d3-4ce2-a8cd-618215bb89c2 service nova] Lock "8948a19b-9e7e-448d-b782-be58020b5320-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:39.427704 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-227cf9eb-973d-4161-8016-6777e97f9d7d req-5934e76f-a7d3-4ce2-a8cd-618215bb89c2 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Processing event network-vif-plugged-9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:02:39.558526 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:39.563229 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:39.580783 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:39.587421 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:39.615751 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:39.749626 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Acquiring lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:39.749792 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:39.749949 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Attaching volume 78aacfe6-62ec-4fa1-8213-fc77ced5281f to /dev/vdb
May 21 02:02:39.775651 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-56c6fe29-af49-4210-84fc-d8d157cef471 req-c430a6d6-8a95-49ee-b9d5-4e37c4686ac4 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Received event network-vif-unplugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:39.776673 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-56c6fe29-af49-4210-84fc-d8d157cef471 req-c430a6d6-8a95-49ee-b9d5-4e37c4686ac4 service nova] Acquiring lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:39.780619 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-56c6fe29-af49-4210-84fc-d8d157cef471 req-c430a6d6-8a95-49ee-b9d5-4e37c4686ac4 service nova] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:39.784142 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-56c6fe29-af49-4210-84fc-d8d157cef471 req-c430a6d6-8a95-49ee-b9d5-4e37c4686ac4 service nova] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.008s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:39.784142 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-56c6fe29-af49-4210-84fc-d8d157cef471 req-c430a6d6-8a95-49ee-b9d5-4e37c4686ac4 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] No waiting events found dispatching network-vif-unplugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:02:39.784284 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-56c6fe29-af49-4210-84fc-d8d157cef471 req-c430a6d6-8a95-49ee-b9d5-4e37c4686ac4 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Received unexpected event network-vif-unplugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a for instance with vm_state resized and task_state resize_reverting.
May 21 02:02:39.814359 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:02:39.830772 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:02:39.863845 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:39.883554 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:39.918012 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:39.924364 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:39.935526 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:01:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1160366387',display_name='tempest-AttachVolumeTestJSON-server-1160366387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumetestjson-server-1160366387',id=27,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAujiHJsmhJMgEmRnWv5ymFbZbTAYncvgq9NsMeC8MiZ8la1gTOga8PrdaHkWknChauf3EhimnVrbr35Cl923XBy1BnVqXrs2rMVao3ITr2vCMWLpWOxbYc5JhA+8oEsw==',key_name='tempest-keypair-1825862747',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:01:35Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e80cee8643f34f6685ff7fb42920afc3',ramdisk_id='',reservation_id='r-td2yddno',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2050140136',owner_user_name='tempest-AttachVolumeTestJSON-2050140136-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:02:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='640fad0f3dfe4ee99b04c12c2b8fd9dd',uuid=df1fb869-23ef-48e0-b609-ce91c2540c2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "397001b0-550b-43bb-8c99-269fa0d710bb", "address": "fa:16:3e:f4:b7:59", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397001b0-55", "ovs_interfaceid": "397001b0-550b-43bb-8c99-269fa0d710bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:02:39.938739 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Converting VIF {"id": "397001b0-550b-43bb-8c99-269fa0d710bb", "address": "fa:16:3e:f4:b7:59", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397001b0-55", "ovs_interfaceid": "397001b0-550b-43bb-8c99-269fa0d710bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:02:39.941310 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:b7:59,bridge_name='br-int',has_traffic_filtering=True,id=397001b0-550b-43bb-8c99-269fa0d710bb,network=Network(70a21e20-dfdf-49b9-bfd2-75a1f49c8a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397001b0-55') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:02:39.943660 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lazy-loading 'pci_devices' on Instance uuid df1fb869-23ef-48e0-b609-ce91c2540c2e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:39.952033 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328959.9515088, 8948a19b-9e7e-448d-b782-be58020b5320 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:02:39.952608 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] VM Started (Lifecycle Event)
May 21 02:02:39.957034 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:39.957892 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:02:39.962839 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:02:39.963042 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:02:39.964533 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:02:39.974786 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Instance destroyed successfully.
May 21 02:02:39.974786 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lazy-loading 'resources' on Instance uuid e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:39.977074 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Instance spawned successfully.
May 21 02:02:39.977529 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:02:39.989511 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:02:39.992051 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe9e:216', 'fe80::14d9:7bff:fe3b:f0dc', 'fe80::fc16:3eff:fe45:a237', 'fe80::789a:c1ff:fe89:a024', 'fe80::fc16:3eff:fe41:220a', 'fe80::3c32:60ff:fe45:d447', 'fe80::fc16:3eff:fe2b:20c8', 'fe80::fc16:3eff:febc:420', 'fe80::f8e2:1cff:fe30:95ec', 'fe80::fc16:3eff:fe60:a612', 'fe80::fc16:3eff:fe59:b4d0', 'fe80::f819:cdff:fe2b:de28', 'fe80::fc16:3eff:fe27:7142'] 
May 21 02:02:39.992373 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:02:39.992373 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:02:39.992897 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] <== get_connector_properties: return (179ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:02:39.992897 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Updating existing volume attachment record: 487f344c-e113-466f-a5ce-cbf7a8d6d6c4 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:02:40.341240 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:40.351022 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:40.357584 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:40.383706 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:40.389825 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:40.462769 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Object Instance<df1fb869-23ef-48e0-b609-ce91c2540c2e> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:02:40.463948 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] End _get_guest_xml xml=<domain type="qemu">
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:   <uuid>df1fb869-23ef-48e0-b609-ce91c2540c2e</uuid>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:   <name>instance-0000001b</name>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:       <nova:name>tempest-AttachVolumeTestJSON-server-1160366387</nova:name>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:02:35</nova:creationTime>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:           <nova:property name="hw_machine_type">pc</nova:property>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:           <nova:property name="hw_video_model">virtio</nova:property>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:         <nova:user uuid="640fad0f3dfe4ee99b04c12c2b8fd9dd">tempest-AttachVolumeTestJSON-2050140136-project-member</nova:user>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:         <nova:project uuid="e80cee8643f34f6685ff7fb42920afc3">tempest-AttachVolumeTestJSON-2050140136</nova:project>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:         <nova:port uuid="397001b0-550b-43bb-8c99-269fa0d710bb">
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:     <system>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:       <entry name="serial">df1fb869-23ef-48e0-b609-ce91c2540c2e</entry>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:       <entry name="uuid">df1fb869-23ef-48e0-b609-ce91c2540c2e</entry>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:     </system>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:   <os>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:   </os>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:   <features>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:   </features>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:   <devices>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk"/>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:     </disk>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk.config"/>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:     </disk>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:       <alias name="ua-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0"/>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-5"/>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:       <target dev="vdb" bus="virtio"/>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:       <serial>8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0</serial>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:     </disk>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:f4:b7:59"/>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:       <target dev="tap397001b0-55"/>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:     </interface>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/console.log" append="off"/>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:     </serial>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:     <video>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:     </video>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:     </rng>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:   </devices>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]: </domain>
May 21 02:02:40.463948 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:02:40.468581 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:40.492501 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:01:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-381884727',display_name='tempest-ServerActionsTestOtherB-server-381884727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001127',hostname='tempest-serveractionstestotherb-server-381884727',id=26,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLe1NRJOlGeHTlYSJiaM3PGrlo+7H9agLjrz4WfSrLuMOzPRjsAs6TJ8fG0Jtb2QDKUpaM4oEEkqECJm++HadkTr0S3iHGop0JxrI6HPofsIchSwvm0vHW+elldzycD14Q==',key_name='tempest-keypair-1287891018',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:02:35Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=Flavor(12),node='np0000001127',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='513057b933ef4779a2e885ae526782b9',ramdisk_id='',reservation_id='r-xyowjbmv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1655903174',owner_user_name='tempest-ServerActionsTestOtherB-1655903174-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:02:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c4b29ba15854339bc78b55da0b300da',uuid=e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "address": "fa:16:3e:92:96:ee", "network": {"id": "acd0fbfa-f6d3-457c-a46f-cb55a0527d2b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-127865059-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "513057b933ef4779a2e885ae526782b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516875-8b", "ovs_interfaceid": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:02:40.497914 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Converting VIF {"id": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "address": "fa:16:3e:92:96:ee", "network": {"id": "acd0fbfa-f6d3-457c-a46f-cb55a0527d2b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-127865059-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "513057b933ef4779a2e885ae526782b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516875-8b", "ovs_interfaceid": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:02:40.499276 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:96:ee,bridge_name='br-int',has_traffic_filtering=True,id=76516875-8b8a-41f5-9a3f-b76d4c3cc02a,network=Network(acd0fbfa-f6d3-457c-a46f-cb55a0527d2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76516875-8b') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:02:40.499894 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:02:40.500918 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:96:ee,bridge_name='br-int',has_traffic_filtering=True,id=76516875-8b8a-41f5-9a3f-b76d4c3cc02a,network=Network(acd0fbfa-f6d3-457c-a46f-cb55a0527d2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76516875-8b') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:02:40.507136 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:40.508843 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76516875-8b, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:40.514529 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:02:40.514950 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:02:40.519798 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:02:40.536507 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:02:40.543656 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:02:40.545578 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:02:40.548018 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:02:40.548221 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:02:40.553675 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:40.553675 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:40.557247 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6be26e3c-2ba9-4463-8d62-b5b9edb1574b) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:40.560938 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:40.562045 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:02:40.576708 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:40.577236 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:40.584799 np0000001127 nova-compute[98206]: INFO os_vif [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:96:ee,bridge_name='br-int',has_traffic_filtering=True,id=76516875-8b8a-41f5-9a3f-b76d4c3cc02a,network=Network(acd0fbfa-f6d3-457c-a46f-cb55a0527d2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76516875-8b')
May 21 02:02:40.591919 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:02:40.594046 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:02:40.594046 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:02:40.596136 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:02:40.596136 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:02:40.596136 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:02:40.603246 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:40.604807 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:40.624199 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:02:40.628791 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f', 'iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '78aacfe6-62ec-4fa1-8213-fc77ced5281f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:02:40.631920 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:02:40.651750 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:40.651750 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:40.651750 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:40.651750 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:40.651750 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:40.651750 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:40.651750 np0000001127 nova-compute[98206]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:40.651750 np0000001127 nova-compute[98206]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:40.651750 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:40.651750 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:40.651750 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:02:40.652297 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:40.652297 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:40.652297 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:40.652297 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:40.652297 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:40.652297 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:40.652297 np0000001127 nova-compute[98206]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:40.652297 np0000001127 nova-compute[98206]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:40.652297 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:40.652297 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:40.652297 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:02:40.652297 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', '56'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', '64'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', '65'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', '69'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', '70'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', '71')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:02:40.652839 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', '68')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:02:40.654308 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', '69')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:02:40.656784 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c058464fe0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665'): ({'sde'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:02:40.657376 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Removing multipathed devices sdd, sde {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:02:40.657775 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Flush multipath device 3300000006680ae0e {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:02:40.695323 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:02:40.737309 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:40.738024 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:02:40.738742 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lazy-loading 'trusted_certs' on Instance uuid df1fb869-23ef-48e0-b609-ce91c2540c2e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:40.747914 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:02:40.804328 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:02:40.804550 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:02:40.807197 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:02:40.818341 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:02:40.818608 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:02:40.836452 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:40.871878 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665, portal: 192.168.40.100,3260]
May 21 02:02:40.871878 np0000001127 nova-compute[98206]: Logout of [sid: 68, target: iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665, portal: 192.168.40.100,3260] successful.
May 21 02:02:40.871878 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:40.892361 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:40.910839 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:40.954502 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665, portal: 192.168.50.100,3260]
May 21 02:02:40.954502 np0000001127 nova-compute[98206]: Logout of [sid: 69, target: iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665, portal: 192.168.50.100,3260] successful.
May 21 02:02:40.954502 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:40.972429 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:40.972750 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:02:40.973080 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] <== disconnect_volume: return (379ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:02:40.973383 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:02:40.974134 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.345s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:02:40.974489 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f', 'iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '78aacfe6-62ec-4fa1-8213-fc77ced5281f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:02:40.989881 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:02:40.993234 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:02:40.996566 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.007s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:02:40.997104 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:02:40.997934 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:02:40.998181 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:02:41.009632 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:02:41.009632 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:41.019780 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:02:41.019780 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:41.028697 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f] added
May 21 02:02:41.028697 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:02:41.028697 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:02:41.028697 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:02:41.028697 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:02:41.028697 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:02:41.028697 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:41.028987 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:02:41.029100 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.032(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:02:41.029277 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:02:41.036861 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f] added
May 21 02:02:41.036861 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:02:41.036861 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:02:41.036861 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:02:41.036861 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:02:41.036861 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:02:41.036861 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:41.037108 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:02:41.037221 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.039(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:02:41.037963 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:02:41.038321 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:02:41.038824 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328961.038447, 8948a19b-9e7e-448d-b782-be58020b5320 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:02:41.038906 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] VM Paused (Lifecycle Event)
May 21 02:02:41.061548 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Took 7.75 seconds to spawn the instance on the hypervisor.
May 21 02:02:41.061751 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:02:41.246230 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Object Instance<df1fb869-23ef-48e0-b609-ce91c2540c2e> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:02:41.246673 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:41.351775 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.105s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:41.355526 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Checking if we can resize image /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:02:41.355526 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:41.389011 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:41.459977 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:41.460422 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Cannot resize image /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:02:41.460657 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lazy-loading 'migration_context' on Instance uuid df1fb869-23ef-48e0-b609-ce91c2540c2e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:41.519513 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-ef1c8802-15fe-4e10-981b-81d9c7354da4 req-d71a301a-8e7c-470d-8e1e-9d90b077fa99 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Received event network-vif-plugged-9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:41.520444 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ef1c8802-15fe-4e10-981b-81d9c7354da4 req-d71a301a-8e7c-470d-8e1e-9d90b077fa99 service nova] Acquiring lock "8948a19b-9e7e-448d-b782-be58020b5320-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:41.520675 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ef1c8802-15fe-4e10-981b-81d9c7354da4 req-d71a301a-8e7c-470d-8e1e-9d90b077fa99 service nova] Lock "8948a19b-9e7e-448d-b782-be58020b5320-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:41.520845 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ef1c8802-15fe-4e10-981b-81d9c7354da4 req-d71a301a-8e7c-470d-8e1e-9d90b077fa99 service nova] Lock "8948a19b-9e7e-448d-b782-be58020b5320-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:41.521021 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-ef1c8802-15fe-4e10-981b-81d9c7354da4 req-d71a301a-8e7c-470d-8e1e-9d90b077fa99 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] No waiting events found dispatching network-vif-plugged-9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:02:41.521183 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-ef1c8802-15fe-4e10-981b-81d9c7354da4 req-d71a301a-8e7c-470d-8e1e-9d90b077fa99 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Received unexpected event network-vif-plugged-9089f785-707f-4bb7-ac00-927fe747fcc5 for instance with vm_state active and task_state None.
May 21 02:02:41.541439 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:02:41.546128 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.99979646199995 future=<Future at 0x71c07c3744d0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:02:41.546128 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328961.5459096, 8948a19b-9e7e-448d-b782-be58020b5320 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:02:41.546262 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] VM Resumed (Lifecycle Event)
May 21 02:02:41.583813 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Took 13.89 seconds to build instance.
May 21 02:02:41.676664 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:02:41.864205 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-985eeea6-6fdd-49cb-b4b3-16ecd9a55c1d req-37821387-8dc3-4b39-b619-e4f86f684a24 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Received event network-vif-unplugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:41.864406 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-985eeea6-6fdd-49cb-b4b3-16ecd9a55c1d req-37821387-8dc3-4b39-b619-e4f86f684a24 service nova] Acquiring lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:41.864712 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-985eeea6-6fdd-49cb-b4b3-16ecd9a55c1d req-37821387-8dc3-4b39-b619-e4f86f684a24 service nova] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:41.864766 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-985eeea6-6fdd-49cb-b4b3-16ecd9a55c1d req-37821387-8dc3-4b39-b619-e4f86f684a24 service nova] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:41.864874 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-985eeea6-6fdd-49cb-b4b3-16ecd9a55c1d req-37821387-8dc3-4b39-b619-e4f86f684a24 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] No waiting events found dispatching network-vif-unplugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:02:41.867835 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-985eeea6-6fdd-49cb-b4b3-16ecd9a55c1d req-37821387-8dc3-4b39-b619-e4f86f684a24 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Received unexpected event network-vif-unplugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a for instance with vm_state resized and task_state resize_reverting.
May 21 02:02:41.867835 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-985eeea6-6fdd-49cb-b4b3-16ecd9a55c1d req-37821387-8dc3-4b39-b619-e4f86f684a24 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Received event network-vif-plugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:41.867835 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-985eeea6-6fdd-49cb-b4b3-16ecd9a55c1d req-37821387-8dc3-4b39-b619-e4f86f684a24 service nova] Acquiring lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:41.867835 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-985eeea6-6fdd-49cb-b4b3-16ecd9a55c1d req-37821387-8dc3-4b39-b619-e4f86f684a24 service nova] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:41.867835 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-985eeea6-6fdd-49cb-b4b3-16ecd9a55c1d req-37821387-8dc3-4b39-b619-e4f86f684a24 service nova] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:41.867835 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-985eeea6-6fdd-49cb-b4b3-16ecd9a55c1d req-37821387-8dc3-4b39-b619-e4f86f684a24 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] No waiting events found dispatching network-vif-plugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:02:41.867835 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-985eeea6-6fdd-49cb-b4b3-16ecd9a55c1d req-37821387-8dc3-4b39-b619-e4f86f684a24 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Received unexpected event network-vif-plugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a for instance with vm_state resized and task_state resize_reverting.
May 21 02:02:41.867835 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-985eeea6-6fdd-49cb-b4b3-16ecd9a55c1d req-37821387-8dc3-4b39-b619-e4f86f684a24 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Received event network-vif-plugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:41.867835 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-985eeea6-6fdd-49cb-b4b3-16ecd9a55c1d req-37821387-8dc3-4b39-b619-e4f86f684a24 service nova] Acquiring lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:41.869780 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-985eeea6-6fdd-49cb-b4b3-16ecd9a55c1d req-37821387-8dc3-4b39-b619-e4f86f684a24 service nova] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:41.869780 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-985eeea6-6fdd-49cb-b4b3-16ecd9a55c1d req-37821387-8dc3-4b39-b619-e4f86f684a24 service nova] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:41.869780 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-985eeea6-6fdd-49cb-b4b3-16ecd9a55c1d req-37821387-8dc3-4b39-b619-e4f86f684a24 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] No waiting events found dispatching network-vif-plugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:02:41.869780 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-985eeea6-6fdd-49cb-b4b3-16ecd9a55c1d req-37821387-8dc3-4b39-b619-e4f86f684a24 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Received unexpected event network-vif-plugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a for instance with vm_state resized and task_state resize_reverting.
May 21 02:02:41.869780 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-985eeea6-6fdd-49cb-b4b3-16ecd9a55c1d req-37821387-8dc3-4b39-b619-e4f86f684a24 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Received event network-vif-unplugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:41.869780 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-985eeea6-6fdd-49cb-b4b3-16ecd9a55c1d req-37821387-8dc3-4b39-b619-e4f86f684a24 service nova] Acquiring lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:41.869780 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-985eeea6-6fdd-49cb-b4b3-16ecd9a55c1d req-37821387-8dc3-4b39-b619-e4f86f684a24 service nova] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:41.870336 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-985eeea6-6fdd-49cb-b4b3-16ecd9a55c1d req-37821387-8dc3-4b39-b619-e4f86f684a24 service nova] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:41.870621 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-985eeea6-6fdd-49cb-b4b3-16ecd9a55c1d req-37821387-8dc3-4b39-b619-e4f86f684a24 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] No waiting events found dispatching network-vif-unplugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:02:41.870868 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-985eeea6-6fdd-49cb-b4b3-16ecd9a55c1d req-37821387-8dc3-4b39-b619-e4f86f684a24 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Received unexpected event network-vif-unplugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a for instance with vm_state resized and task_state resize_reverting.
May 21 02:02:41.871125 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-985eeea6-6fdd-49cb-b4b3-16ecd9a55c1d req-37821387-8dc3-4b39-b619-e4f86f684a24 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Received event network-vif-unplugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:41.871383 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-985eeea6-6fdd-49cb-b4b3-16ecd9a55c1d req-37821387-8dc3-4b39-b619-e4f86f684a24 service nova] Acquiring lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:41.871639 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-985eeea6-6fdd-49cb-b4b3-16ecd9a55c1d req-37821387-8dc3-4b39-b619-e4f86f684a24 service nova] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:41.871805 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-985eeea6-6fdd-49cb-b4b3-16ecd9a55c1d req-37821387-8dc3-4b39-b619-e4f86f684a24 service nova] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:41.872029 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-985eeea6-6fdd-49cb-b4b3-16ecd9a55c1d req-37821387-8dc3-4b39-b619-e4f86f684a24 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] No waiting events found dispatching network-vif-unplugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:02:41.872246 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-985eeea6-6fdd-49cb-b4b3-16ecd9a55c1d req-37821387-8dc3-4b39-b619-e4f86f684a24 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Received unexpected event network-vif-unplugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a for instance with vm_state resized and task_state resize_reverting.
May 21 02:02:41.963317 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Object Instance<df1fb869-23ef-48e0-b609-ce91c2540c2e> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:02:41.964547 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:01:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1160366387',display_name='tempest-AttachVolumeTestJSON-server-1160366387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumetestjson-server-1160366387',id=27,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAujiHJsmhJMgEmRnWv5ymFbZbTAYncvgq9NsMeC8MiZ8la1gTOga8PrdaHkWknChauf3EhimnVrbr35Cl923XBy1BnVqXrs2rMVao3ITr2vCMWLpWOxbYc5JhA+8oEsw==',key_name='tempest-keypair-1825862747',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:01:35Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='e80cee8643f34f6685ff7fb42920afc3',ramdisk_id='',reservation_id='r-td2yddno',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2050140136',owner_user_name='tempest-AttachVolumeTestJSON-2050140136-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:02:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='640fad0f3dfe4ee99b04c12c2b8fd9dd',uuid=df1fb869-23ef-48e0-b609-ce91c2540c2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "397001b0-550b-43bb-8c99-269fa0d710bb", "address": "fa:16:3e:f4:b7:59", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397001b0-55", "ovs_interfaceid": "397001b0-550b-43bb-8c99-269fa0d710bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:02:41.965129 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Converting VIF {"id": "397001b0-550b-43bb-8c99-269fa0d710bb", "address": "fa:16:3e:f4:b7:59", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397001b0-55", "ovs_interfaceid": "397001b0-550b-43bb-8c99-269fa0d710bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:02:41.965990 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:b7:59,bridge_name='br-int',has_traffic_filtering=True,id=397001b0-550b-43bb-8c99-269fa0d710bb,network=Network(70a21e20-dfdf-49b9-bfd2-75a1f49c8a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397001b0-55') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:02:41.966320 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:b7:59,bridge_name='br-int',has_traffic_filtering=True,id=397001b0-550b-43bb-8c99-269fa0d710bb,network=Network(70a21e20-dfdf-49b9-bfd2-75a1f49c8a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397001b0-55') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:02:41.966674 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:41.966930 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:41.967283 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:02:41.968364 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:41.968704 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '45865939-732d-5f56-85d7-bdddcc19598a', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:41.970056 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:41.971497 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:02:41.973608 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:41.973930 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap397001b0-55, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:41.974435 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap397001b0-55, col_values=(('qos', UUID('0845bbc5-fbc0-4cdf-aa3c-817cf15510c5')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:41.974757 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap397001b0-55, col_values=(('external_ids', {'iface-id': '397001b0-550b-43bb-8c99-269fa0d710bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:b7:59', 'vm-uuid': 'df1fb869-23ef-48e0-b609-ce91c2540c2e'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:41.975905 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:41.977529 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:02:41.983857 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:41.985072 np0000001127 nova-compute[98206]: INFO os_vif [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:b7:59,bridge_name='br-int',has_traffic_filtering=True,id=397001b0-550b-43bb-8c99-269fa0d710bb,network=Network(70a21e20-dfdf-49b9-bfd2-75a1f49c8a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397001b0-55')
May 21 02:02:42.029870 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:02:42.039017 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:02:42.048835 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:02:42.052108 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:02:42.052108 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:02:42.059024 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:02:42.059024 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:42.063582 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:02:42.072016 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:42.076965 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:42.085970 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-73534cd3-ecce-403e-a100-afd9ec74a99f tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "8948a19b-9e7e-448d-b782-be58020b5320" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.407s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:42.096014 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:42.096014 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:42.096014 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:42.096014 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:42.096014 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:42.096014 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:42.096014 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:42.096014 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:42.096014 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:02:42.096390 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:42.096390 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:42.096390 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:42.096390 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:42.096390 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:42.096390 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:42.096390 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:42.096390 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:42.096390 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:02:42.103527 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:42.103527 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:42.103527 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:42.103527 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:42.103527 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:42.103527 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:42.103527 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:42.103527 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:42.103527 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:02:42.103527 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:42.103527 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:42.103527 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:42.103527 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:42.103527 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:42.103527 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:42.103527 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:42.103527 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:42.103527 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:02:42.141015 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f, portal: 192.168.40.100,3260]
May 21 02:02:42.141015 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f, portal: 192.168.40.100,3260] successful.
May 21 02:02:42.141015 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:42.150536 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f, portal: 192.168.50.100,3260]
May 21 02:02:42.150536 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f, portal: 192.168.50.100,3260] successful.
May 21 02:02:42.150536 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:42.152097 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:42.152327 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:42.161627 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:42.168850 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:42.180483 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.87 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:02:42.183277 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:42.183277 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:42.183277 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:42.183277 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:42.183277 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:42.183277 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:42.183277 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:42.183277 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:42.183277 np0000001127 nova-compute[98206]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:42.183277 np0000001127 nova-compute[98206]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:42.183277 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:02:42.185835 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:42.185835 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:42.185835 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:42.185835 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:42.185835 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:42.185835 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:42.185835 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:42.185835 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:42.185835 np0000001127 nova-compute[98206]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:42.185835 np0000001127 nova-compute[98206]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:42.185835 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:02:42.185835 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.188s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:02:42.185835 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:02:42.185835 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] HCTL ('9', '-', '-', 0) found on session 72 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:02:42.185835 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:02:42.192005 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:42.192005 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:42.192005 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:42.192005 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:42.192005 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:42.192005 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:42.192005 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:42.192005 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:42.192005 np0000001127 nova-compute[98206]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:42.192005 np0000001127 nova-compute[98206]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:42.192005 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:02:42.192005 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:42.192005 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:42.192005 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:42.192005 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:42.192005 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:42.192005 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:42.192005 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:42.192005 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:42.192005 np0000001127 nova-compute[98206]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:42.192005 np0000001127 nova-compute[98206]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:42.192005 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:02:42.192005 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.193s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:02:42.192005 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:02:42.192005 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] HCTL ('10', '-', '-', 0) found on session 73 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:02:42.192832 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:02:42.205397 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Searching for a device in session 72 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:02:42.205611 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '78aacfe6-62ec-4fa1-8213-fc77ced5281f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:02:42.213193 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Searching for a device in session 73 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:02:42.215117 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '78aacfe6-62ec-4fa1-8213-fc77ced5281f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:02:42.529441 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:42.549983 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:42.649060 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:42.656521 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lazy-loading 'migration_context' on Instance uuid e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:42.927571 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:42.932567 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:42.936594 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:42.949284 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b2a4aedb-e8be-403f-86f4-e64333fe949a req-6813a575-45cf-464c-80fe-a6c0c2a16a08 service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Received event network-vif-plugged-397001b0-550b-43bb-8c99-269fa0d710bb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:42.949284 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b2a4aedb-e8be-403f-86f4-e64333fe949a req-6813a575-45cf-464c-80fe-a6c0c2a16a08 service nova] Acquiring lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:42.949284 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b2a4aedb-e8be-403f-86f4-e64333fe949a req-6813a575-45cf-464c-80fe-a6c0c2a16a08 service nova] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:42.949284 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b2a4aedb-e8be-403f-86f4-e64333fe949a req-6813a575-45cf-464c-80fe-a6c0c2a16a08 service nova] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:42.949284 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b2a4aedb-e8be-403f-86f4-e64333fe949a req-6813a575-45cf-464c-80fe-a6c0c2a16a08 service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] No waiting events found dispatching network-vif-plugged-397001b0-550b-43bb-8c99-269fa0d710bb {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:02:42.949874 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-b2a4aedb-e8be-403f-86f4-e64333fe949a req-6813a575-45cf-464c-80fe-a6c0c2a16a08 service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Received unexpected event network-vif-plugged-397001b0-550b-43bb-8c99-269fa0d710bb for instance with vm_state stopped and task_state powering-on.
May 21 02:02:42.962982 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:42.994530 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:02:43.055406 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:02:43.057059 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.62 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:02:43.159112 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Object Instance<e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2> lazy-loaded attributes: resources,migration_context {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:02:43.582931 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Removed pending STOPPED event for df1fb869-23ef-48e0-b609-ce91c2540c2e due to new event <LifecycleEvent: 1779328963.5807598, df1fb869-23ef-48e0-b609-ce91c2540c2e => Resumed> {{(pid=98206) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 21 02:02:43.582931 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328963.5807598, df1fb869-23ef-48e0-b609-ce91c2540c2e => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:02:43.582931 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] VM Resumed (Lifecycle Event)
May 21 02:02:43.583935 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Instance event wait completed in 0 seconds for  {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:02:43.588656 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Instance rebooted successfully.
May 21 02:02:43.864256 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:02:43.864487 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:02:43.999170 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.002875934999792662 future=<Future at 0x71c07c5392e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:02:44.000687 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Emitting event <LifecycleEvent: 1779328948.9951375, e9edec14-452b-46fe-89c6-849ece08f527 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:02:44.001026 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:02:44.001084 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=0.1428635889999441 future=<Future at 0x71c07c7d75f0 state=cancelled>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:02:44.001188 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=0.142746150999983 future=<Future at 0x71c07c7d75f0 state=cancelled>) was cancelled while queued, skipping {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:02:44.001242 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:02:44.001334 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=12.544307602000117 future=<Future at 0x71c07c3744d0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:02:44.001387 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=12.544239695999977 future=<Future at 0x71c07c3744d0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:02:44.002002 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] VM Stopped (Lifecycle Event)
May 21 02:02:44.014397 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Found WWN 3300000000e0699ba for multipath device dm-1 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:02:44.015429 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:02:44.015748 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] <== connect_volume: return (3386ms) {'type': 'block', 'scsi_wwn': '3300000000e0699ba', 'path': '/dev/dm-1', 'multipath_id': '3300000000e0699ba'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:02:44.016564 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000e0699ba', 'path': '/dev/dm-1', 'multipath_id': '3300000000e0699ba'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:02:44.021683 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lazy-loading 'flavor' on Instance uuid 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:44.086961 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:02:44.091078 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:02:44.367678 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:02:44.504675 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: e9edec14-452b-46fe-89c6-849ece08f527] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:02:44.524144 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Attempting to attach volume 78aacfe6-62ec-4fa1-8213-fc77ced5281f with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 02:02:44.525254 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] attach device xml: <disk type="block" device="disk">
May 21 02:02:44.525254 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:02:44.525254 np0000001127 nova-compute[98206]:   <alias name="ua-78aacfe6-62ec-4fa1-8213-fc77ced5281f"/>
May 21 02:02:44.525254 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-1"/>
May 21 02:02:44.525254 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:02:44.525254 np0000001127 nova-compute[98206]:   <serial>78aacfe6-62ec-4fa1-8213-fc77ced5281f</serial>
May 21 02:02:44.525254 np0000001127 nova-compute[98206]: </disk>
May 21 02:02:44.525254 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 02:02:44.595439 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] During sync_power_state the instance has a pending task (powering-on). Skip.
May 21 02:02:44.597796 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328964.596201, df1fb869-23ef-48e0-b609-ce91c2540c2e => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:02:44.597796 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] VM Started (Lifecycle Event)
May 21 02:02:44.678814 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:02:44.679022 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Cleaning up deleted instances {{(pid=98206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}
May 21 02:02:44.717910 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:45.047012 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8816ab92-ee36-4faa-bd60-a8f1ae30a201 req-4ab60a77-c8b1-417e-ae3a-37dd6f8f2880 service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Received event network-vif-plugged-397001b0-550b-43bb-8c99-269fa0d710bb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:45.047239 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8816ab92-ee36-4faa-bd60-a8f1ae30a201 req-4ab60a77-c8b1-417e-ae3a-37dd6f8f2880 service nova] Acquiring lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:45.047394 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8816ab92-ee36-4faa-bd60-a8f1ae30a201 req-4ab60a77-c8b1-417e-ae3a-37dd6f8f2880 service nova] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:45.047541 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8816ab92-ee36-4faa-bd60-a8f1ae30a201 req-4ab60a77-c8b1-417e-ae3a-37dd6f8f2880 service nova] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:45.047677 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8816ab92-ee36-4faa-bd60-a8f1ae30a201 req-4ab60a77-c8b1-417e-ae3a-37dd6f8f2880 service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] No waiting events found dispatching network-vif-plugged-397001b0-550b-43bb-8c99-269fa0d710bb {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:02:45.047856 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-8816ab92-ee36-4faa-bd60-a8f1ae30a201 req-4ab60a77-c8b1-417e-ae3a-37dd6f8f2880 service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Received unexpected event network-vif-plugged-397001b0-550b-43bb-8c99-269fa0d710bb for instance with vm_state stopped and task_state powering-on.
May 21 02:02:45.047997 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8816ab92-ee36-4faa-bd60-a8f1ae30a201 req-4ab60a77-c8b1-417e-ae3a-37dd6f8f2880 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Received event network-changed-9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:45.048155 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8816ab92-ee36-4faa-bd60-a8f1ae30a201 req-4ab60a77-c8b1-417e-ae3a-37dd6f8f2880 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Refreshing instance network info cache due to event network-changed-9089f785-707f-4bb7-ac00-927fe747fcc5. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:02:45.048658 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8816ab92-ee36-4faa-bd60-a8f1ae30a201 req-4ab60a77-c8b1-417e-ae3a-37dd6f8f2880 service nova] Acquiring lock "refresh_cache-8948a19b-9e7e-448d-b782-be58020b5320" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:02:45.048658 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8816ab92-ee36-4faa-bd60-a8f1ae30a201 req-4ab60a77-c8b1-417e-ae3a-37dd6f8f2880 service nova] Acquired lock "refresh_cache-8948a19b-9e7e-448d-b782-be58020b5320" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:02:45.049907 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-8816ab92-ee36-4faa-bd60-a8f1ae30a201 req-4ab60a77-c8b1-417e-ae3a-37dd6f8f2880 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Refreshing network info cache for port 9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:02:45.101012 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:02:45.101349 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:02:45.101349 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:02:45.101349 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] No VIF found with MAC fa:16:3e:f4:b7:59, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:02:45.102600 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-18d21eb8-3222-44bd-ab54-e527ef348719 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:02:45.103591 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:02:45.111806 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:02:45.185485 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] There are 0 instances to clean {{(pid=98206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12092}}
May 21 02:02:45.186747 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:02:45.383640 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 3.231s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:45.383929 np0000001127 nova-compute[98206]: DEBUG nova.compute.rpcapi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98206) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 21 02:02:45.552793 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-8816ab92-ee36-4faa-bd60-a8f1ae30a201 req-4ab60a77-c8b1-417e-ae3a-37dd6f8f2880 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:45.615717 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] During sync_power_state the instance has a pending task (powering-on). Skip.
May 21 02:02:46.029496 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-8816ab92-ee36-4faa-bd60-a8f1ae30a201 req-4ab60a77-c8b1-417e-ae3a-37dd6f8f2880 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:46.232600 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:02:46.234393 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:02:46.235065 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-8816ab92-ee36-4faa-bd60-a8f1ae30a201 req-4ab60a77-c8b1-417e-ae3a-37dd6f8f2880 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Updated VIF entry in instance network info cache for port 9089f785-707f-4bb7-ac00-927fe747fcc5. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:02:46.235603 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:02:46.235789 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-8816ab92-ee36-4faa-bd60-a8f1ae30a201 req-4ab60a77-c8b1-417e-ae3a-37dd6f8f2880 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Updating instance_info_cache with network_info: [{"id": "9089f785-707f-4bb7-ac00-927fe747fcc5", "address": "fa:16:3e:27:71:42", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9089f785-70", "ovs_interfaceid": "9089f785-707f-4bb7-ac00-927fe747fcc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:02:46.237026 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] No VIF found with MAC fa:16:3e:41:22:0a, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:02:46.391490 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:46.632826 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:46.743336 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8816ab92-ee36-4faa-bd60-a8f1ae30a201 req-4ab60a77-c8b1-417e-ae3a-37dd6f8f2880 service nova] Releasing lock "refresh_cache-8948a19b-9e7e-448d-b782-be58020b5320" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:02:46.962586 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Swapping old allocation on dict_keys(['a0b7bd56-5a70-4557-8cfd-9f933f412754']) held by migration 68a1999a-d208-4f5f-aa8b-7dececf06b79 for instance
May 21 02:02:46.984007 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:47.061561 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Overwriting current allocation {'allocations': {'a0b7bd56-5a70-4557-8cfd-9f933f412754': {'resources': {'VCPU': 1, 'MEMORY_MB': 256, 'DISK_GB': 1}, 'generation': 41}}, 'project_id': '513057b933ef4779a2e885ae526782b9', 'user_id': '9c4b29ba15854339bc78b55da0b300da', 'consumer_generation': 1} on consumer e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2 {{(pid=98206) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2036}}
May 21 02:02:47.153327 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:47.183906 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:02:47.184546 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.49 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:02:47.281096 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Acquiring lock "refresh_cache-e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:02:47.281431 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Acquired lock "refresh_cache-e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:02:47.281639 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:02:47.675985 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:02:47.676560 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:02:47.676710 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:02:47.676801 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 21 02:02:47.677009 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:02:47.784182 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:47.819150 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29192aeb-24a7-4d38-8b3d-f75436ba6416 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.069s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:48.182663 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:48.186850 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:48.186987 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:48.187399 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:48.187399 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Auditing locally available compute resources for np0000001127 (node: np0000001127) {{(pid=98206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 21 02:02:48.367761 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Updating instance_info_cache with network_info: [{"id": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "address": "fa:16:3e:92:96:ee", "network": {"id": "acd0fbfa-f6d3-457c-a46f-cb55a0527d2b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-127865059-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "513057b933ef4779a2e885ae526782b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516875-8b", "ovs_interfaceid": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:02:48.869932 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Releasing lock "refresh_cache-e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:02:48.870726 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:02:48.884032 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:02:48.911017 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:48.956663 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:02:48.957011 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:02:48.966882 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:02:48.969506 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe9e:216', 'fe80::14d9:7bff:fe3b:f0dc', 'fe80::fc16:3eff:fe45:a237', 'fe80::789a:c1ff:fe89:a024', 'fe80::fc16:3eff:fe41:220a', 'fe80::3c32:60ff:fe45:d447', 'fe80::fc16:3eff:fe2b:20c8', 'fe80::fc16:3eff:febc:420', 'fe80::f8e2:1cff:fe30:95ec', 'fe80::fc16:3eff:fe60:a612', 'fe80::fc16:3eff:fe59:b4d0', 'fe80::f819:cdff:fe2b:de28', 'fe80::fc16:3eff:fe27:7142', 'fe80::fc16:3eff:fef4:b759', 'fe80::40b3:49ff:feb3:3b55'] 
May 21 02:02:48.969676 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:02:48.969828 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:02:48.970153 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] <== get_connector_properties: return (99ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:02:49.121291 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Acquiring lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:49.121789 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:49.239571 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:02:49.240194 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:02:49.241699 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:49.341065 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:49.341662 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:49.439757 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:49.445595 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:49.566965 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:49.567451 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:49.632550 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lazy-loading 'flavor' on Instance uuid 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:49.692000 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:49.692626 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:02:49.696790 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:02:49.698789 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:49.796521 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:49.797283 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:49.894130 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:49.898090 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-7 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:02:49.899459 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8948a19b-9e7e-448d-b782-be58020b5320/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:50.010931 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8948a19b-9e7e-448d-b782-be58020b5320/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:50.014568 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8948a19b-9e7e-448d-b782-be58020b5320/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:50.028162 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:50.094499 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Starting finish_revert_migration {{(pid=98206) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12932}}
May 21 02:02:50.117040 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Start _get_guest_xml network_info=[{"id": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "address": "fa:16:3e:92:96:ee", "network": {"id": "acd0fbfa-f6d3-457c-a46f-cb55a0527d2b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-127865059-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "513057b933ef4779a2e885ae526782b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516875-8b", "ovs_interfaceid": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2', 'attached_at': '2026-05-21T02:02:49.000000', 'detached_at': '', 'volume_id': '0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'serial': '0fe98eab-6f95-43f2-9f8a-a4dc45525665'}, 'delete_on_termination': False, 'attachment_id': 'b5fa39b0-4410-435c-8cb3-f0d121acc65b', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:02:50.119483 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:02:50.121651 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-381884727', uuid='e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2'), owner=OwnerMeta(userid='9c4b29ba15854339bc78b55da0b300da', username='tempest-ServerActionsTestOtherB-1655903174-project-member', projectid='513057b933ef4779a2e885ae526782b9', projectname='tempest-ServerActionsTestOtherB-1655903174'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "address": "fa:16:3e:92:96:ee", "network": {"id": "acd0fbfa-f6d3-457c-a46f-cb55a0527d2b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-127865059-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "513057b933ef4779a2e885ae526782b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516875-8b", "ovs_interfaceid": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328970.1210582) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:02:50.124298 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:02:50.124773 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:02:50.125707 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:02:50.125998 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:02:50.127317 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:02:50.127739 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:02:50.127922 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:02:50.128057 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:02:50.128239 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:02:50.128484 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:02:50.128778 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:02:50.129401 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:02:50.129401 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:02:50.129401 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:02:50.129625 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:02:50.129625 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:02:50.129830 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lazy-loading 'vcpu_model' on Instance uuid e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:50.131707 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8948a19b-9e7e-448d-b782-be58020b5320/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:50.137666 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk.rescue --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:50.239105 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk.rescue --force-share --output=json" returned: 0 in 0.101s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:50.242453 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk.rescue --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:50.342672 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk.rescue --force-share --output=json" returned: 0 in 0.102s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:50.343586 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:50.444006 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:50.445139 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:50.544276 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:50.550796 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:50.649987 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:50.650762 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:50.671912 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.549s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:50.679422 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk.config --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:50.751481 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:50.756249 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:02:50.758203 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:50.813837 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "env LANG=C uptime" returned: 0 in 0.056s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:50.814494 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk.config --force-share --output=json" returned: 0 in 0.135s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:02:50.817558 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Acquiring lock "/opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:50.817558 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Hypervisor/Node resource view: name=np0000001127 free_ram=11754MB free_disk=74.00720596313477GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 21 02:02:50.817797 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "/opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:50.818381 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "/opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:50.819341 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:02:50.819901 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:50.820618 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:02:50.820711 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:02:50.821270 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:02:50.821586 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:02:50.822381 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:50.838349 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:02:50.839090 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:02:50.843514 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:02:50.843514 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:02:50.843514 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:02:50.843514 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:02:50.865488 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:02:50.865488 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:50.872424 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:02:50.872424 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:50.878935 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665] added
May 21 02:02:50.878935 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:02:50.878935 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:02:50.878935 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:02:50.878935 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:02:50.878935 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:02:50.878935 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:50.879197 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:02:50.879531 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0374(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:02:50.879757 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:02:50.884207 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665] added
May 21 02:02:50.884207 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:02:50.884207 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:02:50.884207 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:02:50.884207 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:02:50.884207 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:02:50.884207 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:50.884448 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:02:50.884708 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0436(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:02:50.884846 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:02:51.392502 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:51.724403 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Acquiring lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:51.724748 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:51.725730 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Attaching volume 710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 to /dev/vdc
May 21 02:02:51.781810 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:02:51.795166 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:02:51.818753 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:02:51.877126 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:02:51.877512 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:02:51.882006 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:02:51.885932 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:02:51.891649 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:02:51.896963 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe9e:216', 'fe80::14d9:7bff:fe3b:f0dc', 'fe80::fc16:3eff:fe45:a237', 'fe80::789a:c1ff:fe89:a024', 'fe80::fc16:3eff:fe41:220a', 'fe80::3c32:60ff:fe45:d447', 'fe80::fc16:3eff:fe2b:20c8', 'fe80::fc16:3eff:febc:420', 'fe80::f8e2:1cff:fe30:95ec', 'fe80::fc16:3eff:fe60:a612', 'fe80::fc16:3eff:fe59:b4d0', 'fe80::f819:cdff:fe2b:de28', 'fe80::fc16:3eff:fe27:7142', 'fe80::fc16:3eff:fef4:b759', 'fe80::40b3:49ff:feb3:3b55'] 
May 21 02:02:51.897222 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:02:51.897444 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:02:51.897806 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:02:51.898129 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Updating existing volume attachment record: ba95b3be-cdad-4314-a1c1-7ee0add551ba {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:02:51.905251 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:02:51.905251 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:02:51.910896 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:02:51.910896 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:51.919781 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:51.923043 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 29a124ee-2b8c-4f44-8f91-8dd11ac78b52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:02:51.923175 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 66fe5d80-9012-44fe-9b82-1e993211ddf1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:02:51.923269 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:02:51.923739 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance df1fb869-23ef-48e0-b609-ce91c2540c2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:02:51.923846 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:02:51.923935 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance e158490e-746e-4c3b-924e-9aceed1662d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:02:51.924043 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance e95baab0-2c43-4653-b7ae-b9d8920aba33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:02:51.924172 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:02:51.924293 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:02:51.924398 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 8948a19b-9e7e-448d-b782-be58020b5320 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:02:51.924616 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 21 02:02:51.924741 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Final resource view: name=np0000001127 phys_ram=24030MB used_ram=2496MB phys_disk=95GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:02:50 up 33 min,  2 users,  load average: 9.44, 7.78, 4.28\n', 'num_instances': '10', 'num_vm_active': '8', 'num_task_None': '9', 'num_os_type_None': '10', 'num_proj_6a15fe7a70464159a778cffa4a36c36f': '2', 'io_workload': '0', 'num_vm_resized': '1', 'num_task_resize_reverting': '1', 'num_proj_513057b933ef4779a2e885ae526782b9': '1', 'num_proj_e80cee8643f34f6685ff7fb42920afc3': '1', 'num_proj_cb7bdb5c7bbb4465b12c92ffdd425114': '1', 'num_proj_87eb25eb23724c49b5bdbc462a1f36bc': '3', 'num_vm_rescued': '1', 'num_proj_177bec65268546d2b899e09989183b6e': '1', 'num_proj_9dde2f210a0e4debaa655c852b3621da': '1'} {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 21 02:02:51.930438 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:51.943594 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:51.943594 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:51.943594 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:51.943594 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:51.943594 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:51.943594 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:51.943594 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:51.943594 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:51.943594 np0000001127 nova-compute[98206]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:51.943594 np0000001127 nova-compute[98206]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:51.943594 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:02:51.944193 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:51.944193 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:51.944193 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:51.944193 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:51.944193 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:51.944193 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:51.944193 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:51.944193 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:51.944193 np0000001127 nova-compute[98206]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:51.944193 np0000001127 nova-compute[98206]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:51.944193 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:02:51.958977 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:51.958977 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:51.958977 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:51.958977 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:51.958977 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:51.958977 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:51.958977 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:51.958977 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:51.958977 np0000001127 nova-compute[98206]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:51.958977 np0000001127 nova-compute[98206]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:51.958977 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:02:51.958977 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:51.958977 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:51.958977 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:51.958977 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:51.958977 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:51.958977 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:51.958977 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:51.958977 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:51.958977 np0000001127 nova-compute[98206]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:51.958977 np0000001127 nova-compute[98206]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:51.958977 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:02:51.992801 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:51.994874 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665, portal: 192.168.40.100,3260]
May 21 02:02:51.994874 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665, portal: 192.168.40.100,3260] successful.
May 21 02:02:51.994874 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:52.006978 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:52.017243 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665, portal: 192.168.50.100,3260]
May 21 02:02:52.017243 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665, portal: 192.168.50.100,3260] successful.
May 21 02:02:52.017243 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:52.030335 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:52.031714 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:52.031714 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:52.031714 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:52.031714 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:52.031714 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:52.031714 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:52.031714 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:52.031714 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:52.031714 np0000001127 nova-compute[98206]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:52.031714 np0000001127 nova-compute[98206]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:52.031714 np0000001127 nova-compute[98206]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:52.031714 np0000001127 nova-compute[98206]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:52.031714 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:02:52.032129 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:52.032129 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:52.032129 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:52.032129 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:52.032129 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:52.032129 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:52.032129 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:52.032129 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:52.032129 np0000001127 nova-compute[98206]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:52.032129 np0000001127 nova-compute[98206]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:52.032129 np0000001127 nova-compute[98206]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:52.032129 np0000001127 nova-compute[98206]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:52.032129 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:02:52.032648 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.191s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:02:52.032648 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:02:52.036501 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] HCTL ('17', '-', '-', 0) found on session 74 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:02:52.036637 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:02:52.052724 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Searching for a device in session 74 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:02:52.052954 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:02:52.054609 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:52.054609 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:52.054609 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:52.054609 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:52.054609 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:52.054609 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:52.054609 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:52.054609 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:52.054609 np0000001127 nova-compute[98206]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:52.054609 np0000001127 nova-compute[98206]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:52.054609 np0000001127 nova-compute[98206]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:52.054609 np0000001127 nova-compute[98206]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:52.054609 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:02:52.054988 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:52.054988 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:52.054988 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:52.054988 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:52.054988 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:52.054988 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:52.054988 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:52.054988 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:52.054988 np0000001127 nova-compute[98206]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:52.054988 np0000001127 nova-compute[98206]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:52.054988 np0000001127 nova-compute[98206]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:52.054988 np0000001127 nova-compute[98206]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:52.054988 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:02:52.055607 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.215s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:02:52.055607 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:02:52.056687 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] HCTL ('18', '-', '-', 0) found on session 75 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:02:52.056790 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:02:52.072626 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Searching for a device in session 75 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:02:52.074033 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:02:52.230801 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:52.470040 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:02:52.472266 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8', 'iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '710ab2b4-9ee4-4904-b5c2-088ae02f0fe8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:02:52.472419 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:02:52.551876 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:02:52.552197 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:02:52.841371 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:02:53.055817 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:02:53.563359 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Compute_service record updated for np0000001127:np0000001127 {{(pid=98206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 21 02:02:53.564045 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.743s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:53.564388 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:02:53.564579 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98206) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12121}}
May 21 02:02:53.863101 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Found WWN 3300000006680ae0e for multipath device dm-11 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:02:53.863492 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:02:53.864403 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] <== connect_volume: return (3042ms) {'type': 'block', 'scsi_wwn': '3300000006680ae0e', 'path': '/dev/dm-11', 'multipath_id': '3300000006680ae0e'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:02:53.864403 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006680ae0e', 'path': '/dev/dm-11', 'multipath_id': '3300000006680ae0e'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:02:53.864403 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.392s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:02:53.864614 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8', 'iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '710ab2b4-9ee4-4904-b5c2-088ae02f0fe8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:02:53.881295 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:02:53.881543 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:02:53.881783 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:02:53.883738 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:02:53.885486 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:02:53.885486 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:02:53.897077 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:02:53.897077 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:53.907026 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:02:53.907026 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:53.919564 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8] added
May 21 02:02:53.919564 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:02:53.919564 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:02:53.919564 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:02:53.919564 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:02:53.919564 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:02:53.919564 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:53.919564 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:02:53.919564 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0374(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:02:53.919564 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:02:53.925015 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8] added
May 21 02:02:53.925015 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:02:53.925015 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:02:53.925015 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:02:53.925015 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:02:53.925015 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:02:53.925015 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:53.925694 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:02:53.925694 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0408(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:02:53.925694 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:02:54.066924 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:02:54.294943 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Acquiring lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:54.295095 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:54.295265 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Acquiring lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:54.295388 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:54.295508 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:54.297874 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Terminating instance
May 21 02:02:54.374311 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:01:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-381884727',display_name='tempest-ServerActionsTestOtherB-server-381884727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serveractionstestotherb-server-381884727',id=26,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLe1NRJOlGeHTlYSJiaM3PGrlo+7H9agLjrz4WfSrLuMOzPRjsAs6TJ8fG0Jtb2QDKUpaM4oEEkqECJm++HadkTr0S3iHGop0JxrI6HPofsIchSwvm0vHW+elldzycD14Q==',key_name='tempest-keypair-1287891018',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:02:35Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001127',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='513057b933ef4779a2e885ae526782b9',ramdisk_id='',reservation_id='r-xyowjbmv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1655903174',owner_user_name='tempest-ServerActionsTestOtherB-1655903174-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:02:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c4b29ba15854339bc78b55da0b300da',uuid=e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "address": "fa:16:3e:92:96:ee", "network": {"id": "acd0fbfa-f6d3-457c-a46f-cb55a0527d2b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-127865059-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "513057b933ef4779a2e885ae526782b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516875-8b", "ovs_interfaceid": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:02:54.374600 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Converting VIF {"id": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "address": "fa:16:3e:92:96:ee", "network": {"id": "acd0fbfa-f6d3-457c-a46f-cb55a0527d2b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-127865059-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "513057b933ef4779a2e885ae526782b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516875-8b", "ovs_interfaceid": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:02:54.375198 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:96:ee,bridge_name='br-int',has_traffic_filtering=True,id=76516875-8b8a-41f5-9a3f-b76d4c3cc02a,network=Network(acd0fbfa-f6d3-457c-a46f-cb55a0527d2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76516875-8b') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:02:54.381218 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] End _get_guest_xml xml=<domain type="qemu">
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:   <uuid>e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2</uuid>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:   <name>instance-0000001a</name>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:       <nova:name>tempest-ServerActionsTestOtherB-server-381884727</nova:name>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:02:50</nova:creationTime>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:           <nova:property name="hw_machine_type">pc</nova:property>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:           <nova:property name="hw_video_model">virtio</nova:property>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:         <nova:user uuid="9c4b29ba15854339bc78b55da0b300da">tempest-ServerActionsTestOtherB-1655903174-project-member</nova:user>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:         <nova:project uuid="513057b933ef4779a2e885ae526782b9">tempest-ServerActionsTestOtherB-1655903174</nova:project>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:         <nova:port uuid="76516875-8b8a-41f5-9a3f-b76d4c3cc02a">
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:     <system>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:       <entry name="serial">e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2</entry>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:       <entry name="uuid">e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2</entry>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:     </system>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:   <os>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:   </os>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:   <features>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:   </features>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:   <devices>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk"/>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:     </disk>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/disk.config"/>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:     </disk>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:       <alias name="ua-0fe98eab-6f95-43f2-9f8a-a4dc45525665"/>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-11"/>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:       <target dev="vdb" bus="virtio"/>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:       <serial>0fe98eab-6f95-43f2-9f8a-a4dc45525665</serial>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:     </disk>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:92:96:ee"/>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:       <target dev="tap76516875-8b"/>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:     </interface>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2/console.log" append="off"/>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:     </serial>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:     <video>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:     </video>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:     </rng>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:   </devices>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]: </domain>
May 21 02:02:54.381218 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:02:54.384014 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Preparing to wait for external event network-vif-plugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:02:54.384014 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Acquiring lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:54.384014 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:54.384014 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:54.384014 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:01:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-381884727',display_name='tempest-ServerActionsTestOtherB-server-381884727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serveractionstestotherb-server-381884727',id=26,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLe1NRJOlGeHTlYSJiaM3PGrlo+7H9agLjrz4WfSrLuMOzPRjsAs6TJ8fG0Jtb2QDKUpaM4oEEkqECJm++HadkTr0S3iHGop0JxrI6HPofsIchSwvm0vHW+elldzycD14Q==',key_name='tempest-keypair-1287891018',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:02:35Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001127',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='513057b933ef4779a2e885ae526782b9',ramdisk_id='',reservation_id='r-xyowjbmv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1655903174',owner_user_name='tempest-ServerActionsTestOtherB-1655903174-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:02:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c4b29ba15854339bc78b55da0b300da',uuid=e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "address": "fa:16:3e:92:96:ee", "network": {"id": "acd0fbfa-f6d3-457c-a46f-cb55a0527d2b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-127865059-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "513057b933ef4779a2e885ae526782b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516875-8b", "ovs_interfaceid": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:02:54.386855 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Converting VIF {"id": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "address": "fa:16:3e:92:96:ee", "network": {"id": "acd0fbfa-f6d3-457c-a46f-cb55a0527d2b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-127865059-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "513057b933ef4779a2e885ae526782b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516875-8b", "ovs_interfaceid": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:02:54.386855 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:96:ee,bridge_name='br-int',has_traffic_filtering=True,id=76516875-8b8a-41f5-9a3f-b76d4c3cc02a,network=Network(acd0fbfa-f6d3-457c-a46f-cb55a0527d2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76516875-8b') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:02:54.386855 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:96:ee,bridge_name='br-int',has_traffic_filtering=True,id=76516875-8b8a-41f5-9a3f-b76d4c3cc02a,network=Network(acd0fbfa-f6d3-457c-a46f-cb55a0527d2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76516875-8b') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:02:54.386855 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:54.386855 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:54.387423 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:02:54.388202 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:54.388508 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4093fd26-78b5-56da-b11c-c4d3b41edf68', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:54.390862 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:54.391844 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:02:54.391950 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:54.396596 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:54.396909 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76516875-8b, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:54.397355 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap76516875-8b, col_values=(('qos', UUID('2dea3b8e-8f68-48fc-ab64-04c7e4a6173a')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:54.397608 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap76516875-8b, col_values=(('external_ids', {'iface-id': '76516875-8b8a-41f5-9a3f-b76d4c3cc02a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:96:ee', 'vm-uuid': 'e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:54.398781 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:54.399913 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:02:54.406570 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:54.407876 np0000001127 nova-compute[98206]: INFO os_vif [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:96:ee,bridge_name='br-int',has_traffic_filtering=True,id=76516875-8b8a-41f5-9a3f-b76d4c3cc02a,network=Network(acd0fbfa-f6d3-457c-a46f-cb55a0527d2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76516875-8b')
May 21 02:02:54.801669 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:02:54.839545 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:54.844862 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:54.867916 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:54.873837 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:54.904281 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:54.920936 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:02:54.926181 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:02:54.943885 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:02:54.943885 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:54.950751 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:02:54.952865 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:02:54.952865 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:54.973924 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:54.975300 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:54.977344 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:55.005711 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:55.005711 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:55.005711 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:55.005711 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:55.005711 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:55.005711 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:55.005711 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:55.005711 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:55.005711 np0000001127 nova-compute[98206]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:55.005711 np0000001127 nova-compute[98206]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:55.005711 np0000001127 nova-compute[98206]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:55.005711 np0000001127 nova-compute[98206]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:55.005711 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:02:55.005711 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:55.005711 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:55.005711 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:55.005711 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:55.005711 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:55.005711 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:55.005711 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:55.005711 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:55.005711 np0000001127 nova-compute[98206]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:55.005711 np0000001127 nova-compute[98206]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:55.005711 np0000001127 nova-compute[98206]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:55.005711 np0000001127 nova-compute[98206]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:55.005711 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:02:55.014508 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:55.014508 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:55.014508 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:55.014508 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:55.014508 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:55.014508 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:55.014508 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:55.014508 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:55.014508 np0000001127 nova-compute[98206]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:55.014508 np0000001127 nova-compute[98206]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:55.014508 np0000001127 nova-compute[98206]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:55.014508 np0000001127 nova-compute[98206]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:55.014508 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:02:55.014508 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:55.014508 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:55.014508 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:55.014508 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:55.014508 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:55.014508 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:55.014508 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:55.014508 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:55.014508 np0000001127 nova-compute[98206]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:55.014508 np0000001127 nova-compute[98206]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:55.014508 np0000001127 nova-compute[98206]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:55.014508 np0000001127 nova-compute[98206]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:55.014508 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:02:55.067020 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:02:55.067771 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:02:55.068442 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:02:55.069008 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 52.61 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:02:55.079116 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8, portal: 192.168.40.100,3260]
May 21 02:02:55.079116 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8, portal: 192.168.40.100,3260] successful.
May 21 02:02:55.079116 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:55.089056 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8, portal: 192.168.50.100,3260]
May 21 02:02:55.089056 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8, portal: 192.168.50.100,3260] successful.
May 21 02:02:55.089056 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:55.106788 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e93a0280-7cc3-4f3d-ad6f-73b761b52a80 req-1bf245ad-1984-492f-92d0-0ed128d32567 service nova] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Received event network-vif-unplugged-1b938e0e-b319-49b6-a973-0e80c89b92e6 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:55.110946 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:55.113205 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e93a0280-7cc3-4f3d-ad6f-73b761b52a80 req-1bf245ad-1984-492f-92d0-0ed128d32567 service nova] Acquiring lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:55.114363 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e93a0280-7cc3-4f3d-ad6f-73b761b52a80 req-1bf245ad-1984-492f-92d0-0ed128d32567 service nova] Lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:55.115631 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e93a0280-7cc3-4f3d-ad6f-73b761b52a80 req-1bf245ad-1984-492f-92d0-0ed128d32567 service nova] Lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:55.117274 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e93a0280-7cc3-4f3d-ad6f-73b761b52a80 req-1bf245ad-1984-492f-92d0-0ed128d32567 service nova] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] No waiting events found dispatching network-vif-unplugged-1b938e0e-b319-49b6-a973-0e80c89b92e6 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:02:55.117545 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e93a0280-7cc3-4f3d-ad6f-73b761b52a80 req-1bf245ad-1984-492f-92d0-0ed128d32567 service nova] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Received event network-vif-unplugged-1b938e0e-b319-49b6-a973-0e80c89b92e6 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:02:55.118461 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:55.119764 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:55.140360 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:55.140360 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:55.140360 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:55.140360 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:55.140360 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:55.140360 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:55.140360 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:55.140360 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:55.140360 np0000001127 nova-compute[98206]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:55.140360 np0000001127 nova-compute[98206]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:55.140360 np0000001127 nova-compute[98206]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:55.140360 np0000001127 nova-compute[98206]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:55.140360 np0000001127 nova-compute[98206]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:02:55.140360 np0000001127 nova-compute[98206]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:02:55.140360 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:02:55.140942 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:55.140942 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:55.140942 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:55.140942 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:55.140942 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:55.140942 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:55.140942 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:55.140942 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:55.140942 np0000001127 nova-compute[98206]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:55.140942 np0000001127 nova-compute[98206]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:55.140942 np0000001127 nova-compute[98206]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:55.140942 np0000001127 nova-compute[98206]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:55.140942 np0000001127 nova-compute[98206]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:02:55.140942 np0000001127 nova-compute[98206]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:02:55.140942 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:02:55.141355 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.260s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:02:55.141355 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:02:55.143237 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] HCTL ('19', '-', '-', 0) found on session 76 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:02:55.143382 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:02:55.151485 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:55.151485 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:55.151485 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:55.151485 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:55.151485 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:55.151485 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:55.151485 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:55.151485 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:55.151485 np0000001127 nova-compute[98206]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:55.151485 np0000001127 nova-compute[98206]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:55.151485 np0000001127 nova-compute[98206]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:55.151485 np0000001127 nova-compute[98206]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:55.151485 np0000001127 nova-compute[98206]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:02:55.151485 np0000001127 nova-compute[98206]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:02:55.151485 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:02:55.151485 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:55.151485 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:55.151485 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:55.151485 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:55.151485 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:55.151485 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:55.151485 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:55.151485 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:55.151485 np0000001127 nova-compute[98206]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:55.151485 np0000001127 nova-compute[98206]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:55.151485 np0000001127 nova-compute[98206]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:55.151485 np0000001127 nova-compute[98206]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:55.151485 np0000001127 nova-compute[98206]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:02:55.151485 np0000001127 nova-compute[98206]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:02:55.151485 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:02:55.152089 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.268s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:02:55.152089 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:02:55.153854 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] HCTL ('20', '-', '-', 0) found on session 77 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:02:55.153854 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:02:55.171017 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Searching for a device in session 76 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:02:55.171017 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '710ab2b4-9ee4-4904-b5c2-088ae02f0fe8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:02:55.190577 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Searching for a device in session 77 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:02:55.190577 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '710ab2b4-9ee4-4904-b5c2-088ae02f0fe8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:02:55.285460 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999582916999998 future=<Future at 0x71c0584a7080 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:02:55.292168 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Instance destroyed successfully.
May 21 02:02:55.293002 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lazy-loading 'resources' on Instance uuid 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:55.498964 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:55.508621 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:55.537703 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:55.546311 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:55.798763 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-21T02:00:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-692094759',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serveractionsv293testjson-server-1227980448',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdSLsNf05ft6B/PkgYJEgNxCPaotlaC+SYwLSyQfqbTHXXe3gCjns78xO/QDQw3uXc0vYQiJCLA0+VzLHhxlUHFht+sbUG63daZBfxAE+WcylLxkwBu6nkTH7iMalcD6A==',key_name='tempest-keypair-121683660',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:02:16Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9dde2f210a0e4debaa655c852b3621da',ramdisk_id='',reservation_id='r-3sc7d1ev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='fea37df7-c5b0-431e-9e55-09d856a51ff9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2031447781',owner_user_name='tempest-ServerActionsV293TestJSON-2031447781-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:02:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45d8378885514dd79b666ba5f5352716',uuid=44334b65-4382-4a2d-80f1-a1ae2cdfe1e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b938e0e-b319-49b6-a973-0e80c89b92e6", "address": "fa:16:3e:bc:04:20", "network": {"id": "effc5fd0-bb6d-41a3-aa93-0b65d17db1d9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2119568761-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dde2f210a0e4debaa655c852b3621da", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b938e0e-b3", "ovs_interfaceid": "1b938e0e-b319-49b6-a973-0e80c89b92e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:02:55.799090 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Converting VIF {"id": "1b938e0e-b319-49b6-a973-0e80c89b92e6", "address": "fa:16:3e:bc:04:20", "network": {"id": "effc5fd0-bb6d-41a3-aa93-0b65d17db1d9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2119568761-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dde2f210a0e4debaa655c852b3621da", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b938e0e-b3", "ovs_interfaceid": "1b938e0e-b319-49b6-a973-0e80c89b92e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:02:55.799441 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:04:20,bridge_name='br-int',has_traffic_filtering=True,id=1b938e0e-b319-49b6-a973-0e80c89b92e6,network=Network(effc5fd0-bb6d-41a3-aa93-0b65d17db1d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b938e0e-b3') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:02:55.799640 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:04:20,bridge_name='br-int',has_traffic_filtering=True,id=1b938e0e-b319-49b6-a973-0e80c89b92e6,network=Network(effc5fd0-bb6d-41a3-aa93-0b65d17db1d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b938e0e-b3') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:02:55.800820 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:55.800990 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b938e0e-b3, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:55.803619 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:55.804534 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:02:55.810592 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:55.810744 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d3c53508-7739-4fa3-894e-a59c316959dd) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:02:55.811410 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:55.813859 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:02:55.817638 np0000001127 nova-compute[98206]: INFO os_vif [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:04:20,bridge_name='br-int',has_traffic_filtering=True,id=1b938e0e-b319-49b6-a973-0e80c89b92e6,network=Network(effc5fd0-bb6d-41a3-aa93-0b65d17db1d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b938e0e-b3')
May 21 02:02:55.823492 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:02:55.823818 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:02:55.823961 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:02:55.884387 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:02:56.175911 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Removed pending STOPPED event for e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2 due to new event <LifecycleEvent: 1779328976.175577, e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2 => Started> {{(pid=98206) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 21 02:02:56.178956 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328976.175577, e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:02:56.179167 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] VM Started (Lifecycle Event)
May 21 02:02:56.406389 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:02:56.546063 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.00033994299997175403 future=<Future at 0x71c07c3744d0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:02:56.546367 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:02:56.546491 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=13.738306217999934 future=<Future at 0x71c0584a7080 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:02:56.546557 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=13.738183248999803 future=<Future at 0x71c0584a7080 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:02:56.681805 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:02:56.688063 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328976.6877143, e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:02:56.688138 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] VM Paused (Lifecycle Event)
May 21 02:02:56.900608 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Found WWN 330000000cfb9da48 for multipath device dm-12 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:02:56.901142 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:02:56.901142 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] <== connect_volume: return (4428ms) {'type': 'block', 'scsi_wwn': '330000000cfb9da48', 'path': '/dev/dm-12', 'multipath_id': '330000000cfb9da48'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:02:56.901142 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000cfb9da48', 'path': '/dev/dm-12', 'multipath_id': '330000000cfb9da48'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:02:56.903295 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.078s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:02:56.903295 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:02:56.903295 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:02:56.905636 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lazy-loading 'flavor' on Instance uuid 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:02:56.941923 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:56.941923 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:56.941923 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:56.941923 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:56.941923 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:56.941923 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:56.941923 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:56.941923 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:56.941923 np0000001127 nova-compute[98206]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:56.941923 np0000001127 nova-compute[98206]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:56.941923 np0000001127 nova-compute[98206]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:56.941923 np0000001127 nova-compute[98206]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:56.941923 np0000001127 nova-compute[98206]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:02:56.941923 np0000001127 nova-compute[98206]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:02:56.941923 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:02:56.942695 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:56.942695 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:02:56.942695 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:56.942695 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:02:56.942695 np0000001127 nova-compute[98206]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:56.942695 np0000001127 nova-compute[98206]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b (non-flash)
May 21 02:02:56.942695 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:56.942695 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:02:56.942695 np0000001127 nova-compute[98206]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:56.942695 np0000001127 nova-compute[98206]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:02:56.942695 np0000001127 nova-compute[98206]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:56.942695 np0000001127 nova-compute[98206]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:02:56.942695 np0000001127 nova-compute[98206]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:02:56.942695 np0000001127 nova-compute[98206]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:02:56.942695 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:02:56.946541 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', '56'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', '64'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', '65'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', '70'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', '71'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f', '72'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f', '73'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', '74'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', '75'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8', '76'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8', '77')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:02:56.946541 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', '65')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:02:56.946541 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b', '64')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:02:56.947042 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c0585c7ce0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b'): ({'sdj'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:02:56.947585 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Removing multipathed devices sdk, sdj {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:02:56.947925 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Flush multipath device 330000000c2b561bb {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:02:57.006290 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:02:57.061795 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:02:57.104850 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:02:57.104850 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:02:57.108739 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:02:57.124632 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:02:57.124632 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:02:57.143251 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:57.192247 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:02:57.200344 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 3 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:02:57.205561 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 65, target: iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b, portal: 192.168.40.100,3260]
May 21 02:02:57.205561 np0000001127 nova-compute[98206]: Logout of [sid: 65, target: iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b, portal: 192.168.40.100,3260] successful.
May 21 02:02:57.205561 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:57.241085 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-fc8708c8-167c-498e-bed3-fc6045a65e80 req-03734167-57d3-409d-98c9-3539e90b6ed8 service nova] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Received event network-vif-unplugged-1b938e0e-b319-49b6-a973-0e80c89b92e6 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:57.241085 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fc8708c8-167c-498e-bed3-fc6045a65e80 req-03734167-57d3-409d-98c9-3539e90b6ed8 service nova] Acquiring lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:57.241085 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fc8708c8-167c-498e-bed3-fc6045a65e80 req-03734167-57d3-409d-98c9-3539e90b6ed8 service nova] Lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:57.241085 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fc8708c8-167c-498e-bed3-fc6045a65e80 req-03734167-57d3-409d-98c9-3539e90b6ed8 service nova] Lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:57.241085 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-fc8708c8-167c-498e-bed3-fc6045a65e80 req-03734167-57d3-409d-98c9-3539e90b6ed8 service nova] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] No waiting events found dispatching network-vif-unplugged-1b938e0e-b319-49b6-a973-0e80c89b92e6 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:02:57.241085 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-fc8708c8-167c-498e-bed3-fc6045a65e80 req-03734167-57d3-409d-98c9-3539e90b6ed8 service nova] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Received event network-vif-unplugged-1b938e0e-b319-49b6-a973-0e80c89b92e6 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:02:57.241490 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-fc8708c8-167c-498e-bed3-fc6045a65e80 req-03734167-57d3-409d-98c9-3539e90b6ed8 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Received event network-vif-plugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:57.241822 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fc8708c8-167c-498e-bed3-fc6045a65e80 req-03734167-57d3-409d-98c9-3539e90b6ed8 service nova] Acquiring lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:57.242889 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fc8708c8-167c-498e-bed3-fc6045a65e80 req-03734167-57d3-409d-98c9-3539e90b6ed8 service nova] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:57.243281 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fc8708c8-167c-498e-bed3-fc6045a65e80 req-03734167-57d3-409d-98c9-3539e90b6ed8 service nova] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:57.243825 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-fc8708c8-167c-498e-bed3-fc6045a65e80 req-03734167-57d3-409d-98c9-3539e90b6ed8 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Processing event network-vif-plugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:02:57.244201 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-fc8708c8-167c-498e-bed3-fc6045a65e80 req-03734167-57d3-409d-98c9-3539e90b6ed8 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Received event network-vif-plugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:57.244438 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fc8708c8-167c-498e-bed3-fc6045a65e80 req-03734167-57d3-409d-98c9-3539e90b6ed8 service nova] Acquiring lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:57.244895 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fc8708c8-167c-498e-bed3-fc6045a65e80 req-03734167-57d3-409d-98c9-3539e90b6ed8 service nova] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:57.245689 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:02:57.246017 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:57.246617 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fc8708c8-167c-498e-bed3-fc6045a65e80 req-03734167-57d3-409d-98c9-3539e90b6ed8 service nova] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:57.246617 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-fc8708c8-167c-498e-bed3-fc6045a65e80 req-03734167-57d3-409d-98c9-3539e90b6ed8 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] No waiting events found dispatching network-vif-plugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:02:57.247689 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-fc8708c8-167c-498e-bed3-fc6045a65e80 req-03734167-57d3-409d-98c9-3539e90b6ed8 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Received unexpected event network-vif-plugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a for instance with vm_state resized and task_state resize_reverting.
May 21 02:02:57.257109 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Instance running successfully.
May 21 02:02:57.257109 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] finish_revert_migration finished successfully. {{(pid=98206) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12978}}
May 21 02:02:57.267995 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Acquiring lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:57.269265 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:57.270539 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:57.316804 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 64, target: iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b, portal: 192.168.50.100,3260]
May 21 02:02:57.316804 np0000001127 nova-compute[98206]: Logout of [sid: 64, target: iqn.2023-03.storpool.com:os--volume-b38b53ce-4cdb-4612-9475-9ea4e1b1205b, portal: 192.168.50.100,3260] successful.
May 21 02:02:57.316804 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:57.342846 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:02:57.343107 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.441s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:02:57.343285 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] <== disconnect_volume: return (1519ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:02:57.343390 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:02:57.343718 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Deleting instance files /opt/stack/data/nova/instances/44334b65-4382-4a2d-80f1-a1ae2cdfe1e8_del
May 21 02:02:57.344508 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Deletion of /opt/stack/data/nova/instances/44334b65-4382-4a2d-80f1-a1ae2cdfe1e8_del complete
May 21 02:02:57.406848 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Attempting to attach volume 710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 02:02:57.409487 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] attach device xml: <disk type="block" device="disk">
May 21 02:02:57.409487 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:02:57.409487 np0000001127 nova-compute[98206]:   <alias name="ua-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8"/>
May 21 02:02:57.409487 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-12"/>
May 21 02:02:57.409487 np0000001127 nova-compute[98206]:   <target dev="vdc" bus="virtio"/>
May 21 02:02:57.409487 np0000001127 nova-compute[98206]:   <serial>710ab2b4-9ee4-4904-b5c2-088ae02f0fe8</serial>
May 21 02:02:57.409487 np0000001127 nova-compute[98206]: </disk>
May 21 02:02:57.409487 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 02:02:57.705664 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] During sync_power_state the instance has a pending task (resize_reverting). Skip.
May 21 02:02:57.705899 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328977.7057037, e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:02:57.706102 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] VM Resumed (Lifecycle Event)
May 21 02:02:57.776901 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:02:57.852420 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Took 3.05 seconds to destroy the instance on the hypervisor.
May 21 02:02:57.853907 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:02:57.854186 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:02:57.854332 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:02:57.854812 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:57.988828 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:02:58.208833 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:02:58.210926 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:02:58.325275 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-ce44e432-69d3-49e8-b3a5-3903eb31fe2f tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Updating instance to original state: 'active'
May 21 02:02:58.350554 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:58.350879 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:58.355152 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:02:58.355940 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Claim successful on node np0000001127
May 21 02:02:58.713864 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] During sync_power_state the instance has a pending task (resize_reverting). Skip.
May 21 02:02:58.968229 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:02:59.096367 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:02:59.096924 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:02:59.096924 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:02:59.096924 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:02:59.096924 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] No VIF found with MAC fa:16:3e:41:22:0a, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:02:59.309995 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-199e5680-a22a-4a55-84dc-96d81ff3075a req-7c66dfa6-08be-4ce9-9754-86577ec011d8 service nova] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Received event network-vif-deleted-1b938e0e-b319-49b6-a973-0e80c89b92e6 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:02:59.473050 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Took 1.62 seconds to deallocate network for instance.
May 21 02:02:59.742354 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Acquiring lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:59.742811 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:59.742811 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Acquiring lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:02:59.743023 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:02:59.743133 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:02:59.745216 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Terminating instance
May 21 02:02:59.998052 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:02:59.998252 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:03:00.062603 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Took 0.59 seconds to detach 1 volumes for instance.
May 21 02:03:00.065504 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Deleting volume: b38b53ce-4cdb-4612-9475-9ea4e1b1205b {{(pid=98206) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 21 02:03:00.249838 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:03:00.271789 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:00.275857 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:00.296940 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:00.328517 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:00.501364 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:03:00.595131 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999629322999908 future=<Future at 0x71c05850fc20 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:03:00.596168 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Instance destroyed successfully.
May 21 02:03:00.596587 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lazy-loading 'resources' on Instance uuid e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:03:00.642781 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:00.671923 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-04fe5f6b-5d4e-4545-95cc-02881f676473 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.947s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:00.812133 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:01.016622 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.664s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:01.016622 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:03:01.018174 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.375s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:01.099178 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:01:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-381884727',display_name='tempest-ServerActionsTestOtherB-server-381884727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serveractionstestotherb-server-381884727',id=26,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLe1NRJOlGeHTlYSJiaM3PGrlo+7H9agLjrz4WfSrLuMOzPRjsAs6TJ8fG0Jtb2QDKUpaM4oEEkqECJm++HadkTr0S3iHGop0JxrI6HPofsIchSwvm0vHW+elldzycD14Q==',key_name='tempest-keypair-1287891018',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:02:57Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='513057b933ef4779a2e885ae526782b9',ramdisk_id='',reservation_id='r-xyowjbmv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1655903174',owner_user_name='tempest-ServerActionsTestOtherB-1655903174-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:02:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c4b29ba15854339bc78b55da0b300da',uuid=e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "address": "fa:16:3e:92:96:ee", "network": {"id": "acd0fbfa-f6d3-457c-a46f-cb55a0527d2b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-127865059-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "513057b933ef4779a2e885ae526782b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516875-8b", "ovs_interfaceid": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:03:01.099427 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Converting VIF {"id": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "address": "fa:16:3e:92:96:ee", "network": {"id": "acd0fbfa-f6d3-457c-a46f-cb55a0527d2b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-127865059-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "513057b933ef4779a2e885ae526782b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516875-8b", "ovs_interfaceid": "76516875-8b8a-41f5-9a3f-b76d4c3cc02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:03:01.100143 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:96:ee,bridge_name='br-int',has_traffic_filtering=True,id=76516875-8b8a-41f5-9a3f-b76d4c3cc02a,network=Network(acd0fbfa-f6d3-457c-a46f-cb55a0527d2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76516875-8b') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:03:01.100503 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:96:ee,bridge_name='br-int',has_traffic_filtering=True,id=76516875-8b8a-41f5-9a3f-b76d4c3cc02a,network=Network(acd0fbfa-f6d3-457c-a46f-cb55a0527d2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76516875-8b') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:03:01.102829 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:01.103374 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76516875-8b, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:03:01.112423 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:03:01.113299 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:01.113539 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2dea3b8e-8f68-48fc-ab64-04c7e4a6173a) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:03:01.118514 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:01.118779 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:03:01.119223 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:01.121113 np0000001127 nova-compute[98206]: INFO os_vif [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:96:ee,bridge_name='br-int',has_traffic_filtering=True,id=76516875-8b8a-41f5-9a3f-b76d4c3cc02a,network=Network(acd0fbfa-f6d3-457c-a46f-cb55a0527d2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76516875-8b')
May 21 02:03:01.122403 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:03:01.122746 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:03:01.122939 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:03:01.123323 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:03:01.123664 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0fe98eab-6f95-43f2-9f8a-a4dc45525665', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:03:01.123788 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:03:01.162829 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:01.162829 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:01.162829 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:01.162829 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:01.162829 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:01.162829 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:01.162829 np0000001127 nova-compute[98206]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:03:01.162829 np0000001127 nova-compute[98206]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:03:01.162829 np0000001127 nova-compute[98206]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:03:01.162829 np0000001127 nova-compute[98206]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:03:01.162829 np0000001127 nova-compute[98206]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:01.162829 np0000001127 nova-compute[98206]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:01.162829 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:03:01.163207 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:01.163207 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:01.163207 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:01.163207 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:01.163207 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:01.163207 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:01.163207 np0000001127 nova-compute[98206]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:03:01.163207 np0000001127 nova-compute[98206]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:03:01.163207 np0000001127 nova-compute[98206]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:03:01.163207 np0000001127 nova-compute[98206]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665 (non-flash)
May 21 02:03:01.163207 np0000001127 nova-compute[98206]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:01.163207 np0000001127 nova-compute[98206]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:01.163207 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:03:01.163489 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', '56'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', '57'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', '70'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', '71'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f', '72'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f', '73'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', '74'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', '75'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8', '76'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8', '77')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:03:01.163644 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', '74')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:03:01.168247 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665', '75')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:03:01.170337 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c0585c5f80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665'): ({'sdm'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:03:01.171171 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Removing multipathed devices sdl, sdm {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:03:01.171528 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Flush multipath device 3300000006680ae0e {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:03:01.205733 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:03:01.261916 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:03:01.314249 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Checking to see if SCSI volumes sdl, sdm have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:03:01.314493 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] SCSI volumes sdl, sdm have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:03:01.317554 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Checking to see if device paths {'sdl', 'sdm'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:03:01.341457 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Device paths {'sdl', 'sdm'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:03:01.341740 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:03:01.355798 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:01.388229 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a3b40319-e196-4e03-bec0-5be83f04a36b req-366bd59b-c4fb-4b17-a1bc-685457e24d41 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Received event network-vif-unplugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:01.389581 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a3b40319-e196-4e03-bec0-5be83f04a36b req-366bd59b-c4fb-4b17-a1bc-685457e24d41 service nova] Acquiring lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:01.390043 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a3b40319-e196-4e03-bec0-5be83f04a36b req-366bd59b-c4fb-4b17-a1bc-685457e24d41 service nova] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:01.390232 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a3b40319-e196-4e03-bec0-5be83f04a36b req-366bd59b-c4fb-4b17-a1bc-685457e24d41 service nova] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:01.390460 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a3b40319-e196-4e03-bec0-5be83f04a36b req-366bd59b-c4fb-4b17-a1bc-685457e24d41 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] No waiting events found dispatching network-vif-unplugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:03:01.390617 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a3b40319-e196-4e03-bec0-5be83f04a36b req-366bd59b-c4fb-4b17-a1bc-685457e24d41 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Received event network-vif-unplugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:03:01.390792 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a3b40319-e196-4e03-bec0-5be83f04a36b req-366bd59b-c4fb-4b17-a1bc-685457e24d41 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Received event network-vif-unplugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:01.391101 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a3b40319-e196-4e03-bec0-5be83f04a36b req-366bd59b-c4fb-4b17-a1bc-685457e24d41 service nova] Acquiring lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:01.391291 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a3b40319-e196-4e03-bec0-5be83f04a36b req-366bd59b-c4fb-4b17-a1bc-685457e24d41 service nova] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:01.391590 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a3b40319-e196-4e03-bec0-5be83f04a36b req-366bd59b-c4fb-4b17-a1bc-685457e24d41 service nova] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:01.391784 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a3b40319-e196-4e03-bec0-5be83f04a36b req-366bd59b-c4fb-4b17-a1bc-685457e24d41 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] No waiting events found dispatching network-vif-unplugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:03:01.391970 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a3b40319-e196-4e03-bec0-5be83f04a36b req-366bd59b-c4fb-4b17-a1bc-685457e24d41 service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Received event network-vif-unplugged-76516875-8b8a-41f5-9a3f-b76d4c3cc02a for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:03:01.405685 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 74, target: iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665, portal: 192.168.40.100,3260]
May 21 02:03:01.405685 np0000001127 nova-compute[98206]: Logout of [sid: 74, target: iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665, portal: 192.168.40.100,3260] successful.
May 21 02:03:01.405685 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:01.408863 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:01.430779 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:01.447719 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:01.499632 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 75, target: iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665, portal: 192.168.50.100,3260]
May 21 02:03:01.499632 np0000001127 nova-compute[98206]: Logout of [sid: 75, target: iqn.2023-03.storpool.com:os--volume-0fe98eab-6f95-43f2-9f8a-a4dc45525665, portal: 192.168.50.100,3260] successful.
May 21 02:03:01.499632 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:01.525454 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:03:01.525813 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:03:01.526127 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:01.526530 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:01.532851 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:01.533091 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:03:01.533222 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] <== disconnect_volume: return (410ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:03:01.533392 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:03:01.533676 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Deleting instance files /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2_del
May 21 02:03:01.547054 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Deletion of /opt/stack/data/nova/instances/e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2_del complete
May 21 02:03:01.651753 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1ebeaddb48014da28103c3479e9b250b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db73ea4d098a4b768f0b51d6cbe9eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:03:01.835420 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:03:01.835615 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:03:02.030165 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:03:02.058006 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Took 1.81 seconds to destroy the instance on the hypervisor.
May 21 02:03:02.058750 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:03:02.059079 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:03:02.059170 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:03:02.059415 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:02.159769 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:02.230405 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Successfully created port: 01b64dbf-89aa-471a-a2df-58edb2a7a254 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:03:02.338050 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:03:02.533036 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:03:02.823307 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Successfully updated port: 01b64dbf-89aa-471a-a2df-58edb2a7a254 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:03:02.844781 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.827s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:02.894632 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-dcae59bf-4f16-4294-bbab-2fedf745fef8 req-5267e801-01f2-459a-a9ae-a58b9071e53d service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Received event network-changed-01b64dbf-89aa-471a-a2df-58edb2a7a254 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:02.894803 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-dcae59bf-4f16-4294-bbab-2fedf745fef8 req-5267e801-01f2-459a-a9ae-a58b9071e53d service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Refreshing instance network info cache due to event network-changed-01b64dbf-89aa-471a-a2df-58edb2a7a254. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:03:02.895296 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-dcae59bf-4f16-4294-bbab-2fedf745fef8 req-5267e801-01f2-459a-a9ae-a58b9071e53d service nova] Acquiring lock "refresh_cache-2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:03:02.895296 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-dcae59bf-4f16-4294-bbab-2fedf745fef8 req-5267e801-01f2-459a-a9ae-a58b9071e53d service nova] Acquired lock "refresh_cache-2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:03:02.895296 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-dcae59bf-4f16-4294-bbab-2fedf745fef8 req-5267e801-01f2-459a-a9ae-a58b9071e53d service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Refreshing network info cache for port 01b64dbf-89aa-471a-a2df-58edb2a7a254 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:03:02.912208 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Deleted allocations for instance 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8
May 21 02:03:03.040233 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Booting with volume c67c8aea-4ddd-455a-ae1e-631955ce95da at /dev/vda
May 21 02:03:03.069904 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:03:03.096556 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:03:03.113800 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:03:03.143842 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:03.195666 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:03:03.196073 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:03:03.207204 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:03:03.208804 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe9e:216', 'fe80::14d9:7bff:fe3b:f0dc', 'fe80::fc16:3eff:fe45:a237', 'fe80::789a:c1ff:fe89:a024', 'fe80::fc16:3eff:fe41:220a', 'fe80::3c32:60ff:fe45:d447', 'fe80::fc16:3eff:fe2b:20c8', 'fe80::fc16:3eff:fe60:a612', 'fe80::fc16:3eff:fe59:b4d0', 'fe80::f819:cdff:fe2b:de28', 'fe80::fc16:3eff:fe27:7142', 'fe80::fc16:3eff:fef4:b759', 'fe80::40b3:49ff:feb3:3b55'] 
May 21 02:03:03.209317 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:03:03.209317 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:03:03.209435 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:03:03.210271 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Updating existing volume attachment record: 7cce67cb-8b97-4fe5-858a-e568075cfbb8 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:03:03.326312 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Acquiring lock "refresh_cache-2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:03:03.401128 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-dcae59bf-4f16-4294-bbab-2fedf745fef8 req-5267e801-01f2-459a-a9ae-a58b9071e53d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:03.464925 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-59b48b9c-a7a8-473a-bc44-b90212e20cf8 req-6dd35af2-19f9-4783-bc86-600798672acc service nova] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Received event network-vif-deleted-76516875-8b8a-41f5-9a3f-b76d4c3cc02a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:03.496229 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-dcae59bf-4f16-4294-bbab-2fedf745fef8 req-5267e801-01f2-459a-a9ae-a58b9071e53d service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:03:03.573940 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Took 1.51 seconds to deallocate network for instance.
May 21 02:03:03.826573 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-dcae59bf-4f16-4294-bbab-2fedf745fef8 req-5267e801-01f2-459a-a9ae-a58b9071e53d service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:03:03.937293 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-580b3ab2-e0ec-4409-8d90-c91337747c2c tempest-ServerActionsV293TestJSON-2031447781 tempest-ServerActionsV293TestJSON-2031447781-project-member] Lock "44334b65-4382-4a2d-80f1-a1ae2cdfe1e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.642s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:04.350175 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-dcae59bf-4f16-4294-bbab-2fedf745fef8 req-5267e801-01f2-459a-a9ae-a58b9071e53d service nova] Releasing lock "refresh_cache-2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:03:04.352057 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Acquired lock "refresh_cache-2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:03:04.352675 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:03:04.405835 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Took 0.83 seconds to detach 1 volumes for instance.
May 21 02:03:04.915853 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:04.917783 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:04.949455 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:03:05.168784 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:03:05.185168 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:05.387109 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Updating instance_info_cache with network_info: [{"id": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "address": "fa:16:3e:ed:a6:59", "network": {"id": "56a7d47c-c10f-4969-a14d-a81a8b4f0e1c", "bridge": "br-int", "label": "tempest-TestShelveInstance-781032295-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db73ea4d098a4b768f0b51d6cbe9eda8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b64dbf-89", "ovs_interfaceid": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:03:05.443900 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:03:05.445008 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:03:05.445274 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Creating image(s)
May 21 02:03:05.445693 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Did not create local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 21 02:03:05.445857 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Ensure instance console log exists: /opt/stack/data/nova/instances/2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:03:05.446881 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:05.446881 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:05.446881 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:05.708935 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:03:05.709051 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:03:05.889160 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Releasing lock "refresh_cache-2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:03:05.889440 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Instance network_info: |[{"id": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "address": "fa:16:3e:ed:a6:59", "network": {"id": "56a7d47c-c10f-4969-a14d-a81a8b4f0e1c", "bridge": "br-int", "label": "tempest-TestShelveInstance-781032295-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db73ea4d098a4b768f0b51d6cbe9eda8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b64dbf-89", "ovs_interfaceid": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:03:05.890456 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Start _get_guest_xml network_info=[{"id": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "address": "fa:16:3e:ed:a6:59", "network": {"id": "56a7d47c-c10f-4969-a14d-a81a8b4f0e1c", "bridge": "br-int", "label": "tempest-TestShelveInstance-781032295-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db73ea4d098a4b768f0b51d6cbe9eda8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b64dbf-89", "ovs_interfaceid": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c67c8aea-4ddd-455a-ae1e-631955ce95da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61', 'attached_at': '', 'detached_at': '', 'volume_id': 'c67c8aea-4ddd-455a-ae1e-631955ce95da', 'serial': 'c67c8aea-4ddd-455a-ae1e-631955ce95da'}, 'delete_on_termination': True, 'attachment_id': '7cce67cb-8b97-4fe5-858a-e568075cfbb8', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:03:05.892995 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:03:05.894843 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestShelveInstance-server-2112280893', uuid='2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61'), owner=OwnerMeta(userid='1ebeaddb48014da28103c3479e9b250b', username='tempest-TestShelveInstance-1611299604-project-member', projectid='db73ea4d098a4b768f0b51d6cbe9eda8', projectname='tempest-TestShelveInstance-1611299604'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "address": "fa:16:3e:ed:a6:59", "network": {"id": "56a7d47c-c10f-4969-a14d-a81a8b4f0e1c", "bridge": "br-int", "label": "tempest-TestShelveInstance-781032295-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db73ea4d098a4b768f0b51d6cbe9eda8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b64dbf-89", "ovs_interfaceid": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779328985.894372) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:03:05.897407 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:03:05.897783 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:03:05.898615 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:03:05.898830 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:03:05.900017 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:03:05.900813 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:03:05.900813 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:03:05.900813 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:03:05.901028 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:03:05.901155 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:03:05.901243 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:03:05.901858 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:03:05.902027 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:03:05.902194 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:03:05.902350 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:03:05.902544 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:03:05.924739 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:03:05.925255 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c67c8aea-4ddd-455a-ae1e-631955ce95da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:03:05.925442 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:03:05.925922 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:03:05.926204 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c67c8aea-4ddd-455a-ae1e-631955ce95da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:03:05.939858 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:03:05.940334 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:03:05.940693 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:03:05.941264 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:03:05.943137 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:03:05.943355 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:03:05.958613 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:03:05.958613 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:05.967597 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:03:05.967597 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:05.973612 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da] added
May 21 02:03:05.973612 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:03:05.973612 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:03:05.973612 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:03:05.973612 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:03:05.973612 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:03:05.973612 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:05.973860 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:03:05.977362 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0334(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:03:05.977362 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:03:05.992241 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da] added
May 21 02:03:05.992241 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:03:05.992241 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:03:05.992241 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:03:05.992241 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:03:05.992241 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:03:05.992241 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:05.992561 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:03:05.992619 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0492(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:03:05.992847 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:03:06.110861 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:06.119808 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:06.211912 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:03:06.266835 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:06.268005 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:06.415430 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:06.720375 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.804s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:06.772210 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lazy-loading 'flavor' on Instance uuid f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:03:06.790309 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Deleted allocations for instance e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2
May 21 02:03:06.974851 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:03:06.984164 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:03:06.991720 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:03:06.991720 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:06.995401 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:03:07.010980 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:03:07.017477 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:03:07.017477 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:07.033554 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:07.033554 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:07.033554 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:07.033554 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:07.033554 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:07.033554 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:07.033554 np0000001127 nova-compute[98206]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:03:07.033554 np0000001127 nova-compute[98206]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:03:07.033554 np0000001127 nova-compute[98206]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:07.033554 np0000001127 nova-compute[98206]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:07.033554 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:03:07.033554 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:07.033554 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:07.033554 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:07.033554 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:07.033554 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:07.033554 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:07.033554 np0000001127 nova-compute[98206]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:03:07.033554 np0000001127 nova-compute[98206]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:03:07.033554 np0000001127 nova-compute[98206]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:07.033554 np0000001127 nova-compute[98206]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:07.033554 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:03:07.041425 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:07.062139 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:07.062139 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:07.062139 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:07.062139 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:07.062139 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:07.062139 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:07.062139 np0000001127 nova-compute[98206]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:03:07.062139 np0000001127 nova-compute[98206]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:03:07.062139 np0000001127 nova-compute[98206]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:07.062139 np0000001127 nova-compute[98206]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:07.062139 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:03:07.062436 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:07.062436 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:07.062436 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:07.062436 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:07.062436 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:07.062436 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:07.062436 np0000001127 nova-compute[98206]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:03:07.062436 np0000001127 nova-compute[98206]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:03:07.062436 np0000001127 nova-compute[98206]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:07.062436 np0000001127 nova-compute[98206]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:07.062436 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:03:07.083040 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da, portal: 192.168.40.100,3260]
May 21 02:03:07.083040 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da, portal: 192.168.40.100,3260] successful.
May 21 02:03:07.083040 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:07.096077 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:07.125785 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:07.125785 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:07.125785 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:07.125785 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:07.125785 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:07.125785 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:07.125785 np0000001127 nova-compute[98206]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:03:07.125785 np0000001127 nova-compute[98206]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:03:07.125785 np0000001127 nova-compute[98206]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:07.125785 np0000001127 nova-compute[98206]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:07.125785 np0000001127 nova-compute[98206]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:07.125785 np0000001127 nova-compute[98206]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:07.125785 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:03:07.125785 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:07.125785 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:07.125785 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:07.125785 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:07.125785 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:07.125785 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:07.125785 np0000001127 nova-compute[98206]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:03:07.125785 np0000001127 nova-compute[98206]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:03:07.125785 np0000001127 nova-compute[98206]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:07.125785 np0000001127 nova-compute[98206]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:07.125785 np0000001127 nova-compute[98206]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:07.125785 np0000001127 nova-compute[98206]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:07.125785 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:03:07.126935 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.186s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:03:07.126935 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:03:07.126935 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da, portal: 192.168.50.100,3260]
May 21 02:03:07.126935 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da, portal: 192.168.50.100,3260] successful.
May 21 02:03:07.126935 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:07.128314 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] HCTL ('15', '-', '-', 0) found on session 78 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:03:07.128483 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:03:07.141905 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:07.151097 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Searching for a device in session 78 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:03:07.151207 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c67c8aea-4ddd-455a-ae1e-631955ce95da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:03:07.168865 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:07.168865 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:07.168865 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:07.168865 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:07.168865 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:07.168865 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:07.168865 np0000001127 nova-compute[98206]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:03:07.168865 np0000001127 nova-compute[98206]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:03:07.168865 np0000001127 nova-compute[98206]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:07.168865 np0000001127 nova-compute[98206]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:07.168865 np0000001127 nova-compute[98206]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:07.168865 np0000001127 nova-compute[98206]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:07.168865 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:03:07.169363 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:07.169363 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:07.169363 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:07.169363 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:07.169363 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:07.169363 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:07.169363 np0000001127 nova-compute[98206]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:03:07.169363 np0000001127 nova-compute[98206]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:03:07.169363 np0000001127 nova-compute[98206]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:07.169363 np0000001127 nova-compute[98206]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:07.169363 np0000001127 nova-compute[98206]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:07.169363 np0000001127 nova-compute[98206]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:07.169363 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:03:07.169363 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.226s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:03:07.169863 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:03:07.170461 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] HCTL ('16', '-', '-', 0) found on session 79 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:03:07.171938 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:03:07.192676 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Searching for a device in session 79 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:03:07.192676 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c67c8aea-4ddd-455a-ae1e-631955ce95da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:03:07.425544 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Acquiring lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:07.425805 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:07.781213 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:07.803557 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-702f389f-1f72-484c-a950-c1ee7bea5702 tempest-ServerActionsTestOtherB-1655903174 tempest-ServerActionsTestOtherB-1655903174-project-member] Lock "e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.061s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:07.928202 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Detaching volume 78aacfe6-62ec-4fa1-8213-fc77ced5281f
May 21 02:03:07.943882 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:03:07.981150 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Attempting to driver detach volume 78aacfe6-62ec-4fa1-8213-fc77ced5281f from mountpoint /dev/vdb
May 21 02:03:07.987715 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Found disk vdb by alias ua-78aacfe6-62ec-4fa1-8213-fc77ced5281f {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:03:07.989440 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Found disk vdb by alias ua-78aacfe6-62ec-4fa1-8213-fc77ced5281f {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:03:07.989642 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Attempting to detach device vdb from instance 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 02:03:07.989963 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:03:07.989963 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:03:07.989963 np0000001127 nova-compute[98206]:   <alias name="ua-78aacfe6-62ec-4fa1-8213-fc77ced5281f"/>
May 21 02:03:07.989963 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-1"/>
May 21 02:03:07.989963 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:03:07.989963 np0000001127 nova-compute[98206]:   <serial>78aacfe6-62ec-4fa1-8213-fc77ced5281f</serial>
May 21 02:03:07.989963 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:03:07.989963 np0000001127 nova-compute[98206]: </disk>
May 21 02:03:07.989963 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:03:08.000341 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Successfully detached device vdb from instance 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a from the persistent domain config.
May 21 02:03:08.000539 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] (1/8): Attempting to detach device vdb with device alias ua-78aacfe6-62ec-4fa1-8213-fc77ced5281f from instance 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 02:03:08.000907 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:03:08.000907 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:03:08.000907 np0000001127 nova-compute[98206]:   <alias name="ua-78aacfe6-62ec-4fa1-8213-fc77ced5281f"/>
May 21 02:03:08.000907 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-1"/>
May 21 02:03:08.000907 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:03:08.000907 np0000001127 nova-compute[98206]:   <serial>78aacfe6-62ec-4fa1-8213-fc77ced5281f</serial>
May 21 02:03:08.000907 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:03:08.000907 np0000001127 nova-compute[98206]: </disk>
May 21 02:03:08.000907 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:03:08.491225 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779328988.4907825, 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a => ua-78aacfe6-62ec-4fa1-8213-fc77ced5281f> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 02:03:08.493835 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-78aacfe6-62ec-4fa1-8213-fc77ced5281f for instance 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 02:03:08.496486 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Successfully detached device vdb from instance 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a from the live domain config.
May 21 02:03:08.497515 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:03:08.498066 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f', 'iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '78aacfe6-62ec-4fa1-8213-fc77ced5281f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:03:08.498325 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:03:08.887165 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:08.887682 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:08.887682 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Attaching volume ca41e75f-27e1-4730-8d34-4d606a9c8908 to /dev/vdb
May 21 02:03:08.941337 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:03:08.960310 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:03:08.977387 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Found WWN 330000000b2501f6d for multipath device dm-7 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:03:08.977677 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.052s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:03:08.977875 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] <== connect_volume: return (3052ms) {'type': 'block', 'scsi_wwn': '330000000b2501f6d', 'path': '/dev/dm-7', 'multipath_id': '330000000b2501f6d'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:03:08.978024 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b2501f6d', 'path': '/dev/dm-7', 'multipath_id': '330000000b2501f6d'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:03:08.979023 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.480s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:03:08.979711 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f', 'iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '78aacfe6-62ec-4fa1-8213-fc77ced5281f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:03:08.979913 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:03:08.989497 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:09.036146 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:09.036146 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:09.036146 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:09.036146 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:09.036146 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:09.036146 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:09.036146 np0000001127 nova-compute[98206]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:03:09.036146 np0000001127 nova-compute[98206]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:03:09.036146 np0000001127 nova-compute[98206]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:09.036146 np0000001127 nova-compute[98206]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:09.036146 np0000001127 nova-compute[98206]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:09.036146 np0000001127 nova-compute[98206]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:09.036146 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:03:09.037098 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:09.037098 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:09.037098 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:09.037098 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:09.037098 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:09.037098 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:09.037098 np0000001127 nova-compute[98206]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:03:09.037098 np0000001127 nova-compute[98206]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f (non-flash)
May 21 02:03:09.037098 np0000001127 nova-compute[98206]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:09.037098 np0000001127 nova-compute[98206]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:09.037098 np0000001127 nova-compute[98206]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:09.037098 np0000001127 nova-compute[98206]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:09.037098 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:03:09.037098 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', '56'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', '57'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', '70'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', '71'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f', '72'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f', '73'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8', '76'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8', '77'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', '78'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', '79')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:03:09.037777 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f', '72')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:03:09.039438 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f', '73')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:03:09.040368 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c5153a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f'): ({'sde'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:03:09.040691 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Removing multipathed devices sdd, sde {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:03:09.041281 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:03:09.041696 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:03:09.042255 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Flush multipath device 3300000000e0699ba {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:03:09.060065 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:03:09.061723 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe9e:216', 'fe80::14d9:7bff:fe3b:f0dc', 'fe80::fc16:3eff:fe45:a237', 'fe80::789a:c1ff:fe89:a024', 'fe80::fc16:3eff:fe41:220a', 'fe80::3c32:60ff:fe45:d447', 'fe80::fc16:3eff:fe2b:20c8', 'fe80::fc16:3eff:fe60:a612', 'fe80::fc16:3eff:fe59:b4d0', 'fe80::f819:cdff:fe2b:de28', 'fe80::fc16:3eff:fe27:7142', 'fe80::fc16:3eff:fef4:b759', 'fe80::40b3:49ff:feb3:3b55'] 
May 21 02:03:09.062655 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:03:09.064869 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:03:09.064869 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:03:09.065179 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Updating existing volume attachment record: 007900ea-24ef-4f4e-82be-414985c54e0c {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:03:09.079212 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:03:09.127546 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:03:09.171132 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:03:09.171392 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:03:09.174365 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:03:09.190412 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:03:09.190759 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:03:09.208388 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:09.245246 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 72, target: iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f, portal: 192.168.40.100,3260]
May 21 02:03:09.245246 np0000001127 nova-compute[98206]: Logout of [sid: 72, target: iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f, portal: 192.168.40.100,3260] successful.
May 21 02:03:09.245246 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:09.269691 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:09.282726 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:09.329214 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 73, target: iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f, portal: 192.168.50.100,3260]
May 21 02:03:09.329214 np0000001127 nova-compute[98206]: Logout of [sid: 73, target: iqn.2023-03.storpool.com:os--volume-78aacfe6-62ec-4fa1-8213-fc77ced5281f, portal: 192.168.50.100,3260] successful.
May 21 02:03:09.329214 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:09.354112 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:09.354480 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:03:09.354736 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] <== disconnect_volume: return (856ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:03:09.354995 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:03:09.487628 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:02:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2112280893',display_name='tempest-TestShelveInstance-server-2112280893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testshelveinstance-server-2112280893',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKg59I6WmGN0vl+Yr0jgT9PuUDGWUY6yf9vpZilx62JeV2qSOqh9YtAt/kfJ2GJwnEwbhZeLHjGZ5bn7cuWJBoTGUXrOx2rpzPhSzUdpCOkXSzB0vlWvtf/xO7vuSD50lg==',key_name='tempest-TestShelveInstance-1094914629',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db73ea4d098a4b768f0b51d6cbe9eda8',ramdisk_id='',reservation_id='r-icby8s1w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1611299604',owner_user_name='tempest-TestShelveInstance-1611299604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:03:03Z,user_data=None,user_id='1ebeaddb48014da28103c3479e9b250b',uuid=2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "address": "fa:16:3e:ed:a6:59", "network": {"id": "56a7d47c-c10f-4969-a14d-a81a8b4f0e1c", "bridge": "br-int", "label": "tempest-TestShelveInstance-781032295-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db73ea4d098a4b768f0b51d6cbe9eda8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b64dbf-89", "ovs_interfaceid": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:03:09.487977 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Converting VIF {"id": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "address": "fa:16:3e:ed:a6:59", "network": {"id": "56a7d47c-c10f-4969-a14d-a81a8b4f0e1c", "bridge": "br-int", "label": "tempest-TestShelveInstance-781032295-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db73ea4d098a4b768f0b51d6cbe9eda8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b64dbf-89", "ovs_interfaceid": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:03:09.488488 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a6:59,bridge_name='br-int',has_traffic_filtering=True,id=01b64dbf-89aa-471a-a2df-58edb2a7a254,network=Network(56a7d47c-c10f-4969-a14d-a81a8b4f0e1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b64dbf-89') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:03:09.489170 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:03:09.673041 np0000001127 nova-compute[98206]: DEBUG os_brick.encryptors [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908', 'iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ca41e75f-27e1-4730-8d34-4d606a9c8908', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80', 'attached_at': '', 'detached_at': '', 'volume_id': 'ca41e75f-27e1-4730-8d34-4d606a9c8908', 'serial': 'ca41e75f-27e1-4730-8d34-4d606a9c8908'} {{(pid=98206) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 21 02:03:09.675902 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:03:09.676319 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908', 'iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ca41e75f-27e1-4730-8d34-4d606a9c8908', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:03:09.676506 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:03:09.677013 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:03:09.677284 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908', 'iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ca41e75f-27e1-4730-8d34-4d606a9c8908', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:03:09.689874 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:03:09.690413 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:03:09.690951 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:03:09.691183 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:03:09.691927 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:03:09.697393 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:03:09.708355 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:03:09.708355 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:09.716896 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:03:09.716896 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:09.725738 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908] added
May 21 02:03:09.725738 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:03:09.725738 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:03:09.725738 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:03:09.725738 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:03:09.725738 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:03:09.725738 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:09.726088 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:03:09.726207 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.035(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:03:09.726880 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:03:09.730230 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908] added
May 21 02:03:09.730230 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:03:09.730230 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:03:09.730230 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:03:09.730230 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:03:09.730230 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:03:09.730230 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:09.730931 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:03:09.730931 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0361(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:03:09.730931 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:03:09.910140 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lazy-loading 'flavor' on Instance uuid 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:03:09.995723 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] End _get_guest_xml xml=<domain type="qemu">
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:   <uuid>2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61</uuid>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:   <name>instance-00000021</name>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:       <nova:name>tempest-TestShelveInstance-server-2112280893</nova:name>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:03:05</nova:creationTime>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:       <nova:image uuid="">
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:         <nova:user uuid="1ebeaddb48014da28103c3479e9b250b">tempest-TestShelveInstance-1611299604-project-member</nova:user>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:         <nova:project uuid="db73ea4d098a4b768f0b51d6cbe9eda8">tempest-TestShelveInstance-1611299604</nova:project>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:       <nova:root type="volume" uuid=""/>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:         <nova:port uuid="01b64dbf-89aa-471a-a2df-58edb2a7a254">
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:     <system>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:       <entry name="serial">2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61</entry>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:       <entry name="uuid">2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61</entry>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:     </system>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:   <os>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:   </os>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:   <features>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:   </features>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:   <devices>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61/disk.config"/>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:     </disk>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:       <alias name="ua-c67c8aea-4ddd-455a-ae1e-631955ce95da"/>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-7"/>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:       <serial>c67c8aea-4ddd-455a-ae1e-631955ce95da</serial>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:     </disk>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:ed:a6:59"/>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:       <target dev="tap01b64dbf-89"/>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:     </interface>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61/console.log" append="off"/>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:     </serial>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:     <video>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:     </video>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:     </rng>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:   </devices>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]: </domain>
May 21 02:03:09.995723 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:03:09.999785 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Preparing to wait for external event network-vif-plugged-01b64dbf-89aa-471a-a2df-58edb2a7a254 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:03:09.999785 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Acquiring lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:09.999785 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:09.999785 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:09.999785 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:02:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2112280893',display_name='tempest-TestShelveInstance-server-2112280893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testshelveinstance-server-2112280893',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKg59I6WmGN0vl+Yr0jgT9PuUDGWUY6yf9vpZilx62JeV2qSOqh9YtAt/kfJ2GJwnEwbhZeLHjGZ5bn7cuWJBoTGUXrOx2rpzPhSzUdpCOkXSzB0vlWvtf/xO7vuSD50lg==',key_name='tempest-TestShelveInstance-1094914629',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db73ea4d098a4b768f0b51d6cbe9eda8',ramdisk_id='',reservation_id='r-icby8s1w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1611299604',owner_user_name='tempest-TestShelveInstance-1611299604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:03:03Z,user_data=None,user_id='1ebeaddb48014da28103c3479e9b250b',uuid=2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "address": "fa:16:3e:ed:a6:59", "network": {"id": "56a7d47c-c10f-4969-a14d-a81a8b4f0e1c", "bridge": "br-int", "label": "tempest-TestShelveInstance-781032295-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db73ea4d098a4b768f0b51d6cbe9eda8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b64dbf-89", "ovs_interfaceid": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:03:09.999785 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Converting VIF {"id": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "address": "fa:16:3e:ed:a6:59", "network": {"id": "56a7d47c-c10f-4969-a14d-a81a8b4f0e1c", "bridge": "br-int", "label": "tempest-TestShelveInstance-781032295-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db73ea4d098a4b768f0b51d6cbe9eda8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b64dbf-89", "ovs_interfaceid": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:03:09.999785 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a6:59,bridge_name='br-int',has_traffic_filtering=True,id=01b64dbf-89aa-471a-a2df-58edb2a7a254,network=Network(56a7d47c-c10f-4969-a14d-a81a8b4f0e1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b64dbf-89') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:03:09.999785 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a6:59,bridge_name='br-int',has_traffic_filtering=True,id=01b64dbf-89aa-471a-a2df-58edb2a7a254,network=Network(56a7d47c-c10f-4969-a14d-a81a8b4f0e1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b64dbf-89') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:03:09.999785 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:09.999785 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:03:10.000438 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:03:10.001020 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:10.001217 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e5c5f6fb-65ca-5397-8eec-f001eb8667b9', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:03:10.002296 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:10.003993 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:03:10.005636 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:10.008227 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:10.008393 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01b64dbf-89, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:03:10.008800 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap01b64dbf-89, col_values=(('qos', UUID('f645436d-98cd-4e50-94fe-c397ebf14ebf')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:03:10.009022 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap01b64dbf-89, col_values=(('external_ids', {'iface-id': '01b64dbf-89aa-471a-a2df-58edb2a7a254', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:a6:59', 'vm-uuid': '2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:03:10.010433 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:10.012100 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:03:10.017793 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:10.018907 np0000001127 nova-compute[98206]: INFO os_vif [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a6:59,bridge_name='br-int',has_traffic_filtering=True,id=01b64dbf-89aa-471a-a2df-58edb2a7a254,network=Network(56a7d47c-c10f-4969-a14d-a81a8b4f0e1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b64dbf-89')
May 21 02:03:10.285196 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.00044847399999525805 future=<Future at 0x71c0584a7080 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:03:10.285302 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:03:10.285434 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=5.309305686000016 future=<Future at 0x71c05850fc20 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:03:10.285502 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=5.309212373000037 future=<Future at 0x71c05850fc20 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:03:10.286692 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] Emitting event <LifecycleEvent: 1779328975.2846022, 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:03:10.286868 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] VM Stopped (Lifecycle Event)
May 21 02:03:10.727048 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:03:10.731515 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:03:10.742497 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:03:10.742497 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:03:10.758765 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:03:10.758765 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:10.760707 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:10.790256 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:10.793826 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:10.793826 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:10.793826 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:10.793826 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:10.793826 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:10.793826 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:10.793826 np0000001127 nova-compute[98206]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:10.793826 np0000001127 nova-compute[98206]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:10.793826 np0000001127 nova-compute[98206]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:10.793826 np0000001127 nova-compute[98206]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:10.793826 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:03:10.793826 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:10.793826 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:10.793826 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:10.793826 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:10.793826 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:10.793826 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:10.793826 np0000001127 nova-compute[98206]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:10.793826 np0000001127 nova-compute[98206]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:10.793826 np0000001127 nova-compute[98206]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:10.793826 np0000001127 nova-compute[98206]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:10.793826 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:03:10.795291 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-f2b0207f-8015-46a4-ad19-3c9a69b3c4bb tempest-ServerBootFromVolumeStableRescueTest-260444396 tempest-ServerBootFromVolumeStableRescueTest-260444396-project-member] [instance: 44334b65-4382-4a2d-80f1-a1ae2cdfe1e8] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:03:10.815320 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:10.815320 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:10.815320 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:10.815320 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:10.815320 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:10.815320 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:10.815320 np0000001127 nova-compute[98206]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:10.815320 np0000001127 nova-compute[98206]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:10.815320 np0000001127 nova-compute[98206]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:10.815320 np0000001127 nova-compute[98206]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:10.815320 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:03:10.815948 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:10.815948 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:10.815948 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:10.815948 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:10.815948 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:10.815948 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:10.815948 np0000001127 nova-compute[98206]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:10.815948 np0000001127 nova-compute[98206]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:10.815948 np0000001127 nova-compute[98206]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:10.815948 np0000001127 nova-compute[98206]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:10.815948 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:03:10.821400 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:10.846034 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908, portal: 192.168.40.100,3260]
May 21 02:03:10.846034 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908, portal: 192.168.40.100,3260] successful.
May 21 02:03:10.846034 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:10.864930 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:10.873810 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908, portal: 192.168.50.100,3260]
May 21 02:03:10.873810 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908, portal: 192.168.50.100,3260] successful.
May 21 02:03:10.873810 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:10.883568 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:10.883568 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:10.883568 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:10.883568 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:10.883568 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:10.883568 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:10.883568 np0000001127 nova-compute[98206]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:10.883568 np0000001127 nova-compute[98206]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:10.883568 np0000001127 nova-compute[98206]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:10.883568 np0000001127 nova-compute[98206]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:10.883568 np0000001127 nova-compute[98206]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908 (non-flash)
May 21 02:03:10.883568 np0000001127 nova-compute[98206]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908 (non-flash)
May 21 02:03:10.883568 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:03:10.883973 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:10.883973 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:10.883973 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:10.883973 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:10.883973 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:10.883973 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:10.883973 np0000001127 nova-compute[98206]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:10.883973 np0000001127 nova-compute[98206]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:10.883973 np0000001127 nova-compute[98206]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:10.883973 np0000001127 nova-compute[98206]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:10.883973 np0000001127 nova-compute[98206]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908 (non-flash)
May 21 02:03:10.883973 np0000001127 nova-compute[98206]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908 (non-flash)
May 21 02:03:10.883973 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:03:10.884438 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.193s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:03:10.884438 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:03:10.885440 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] HCTL ('9', '-', '-', 0) found on session 80 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:03:10.885555 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:03:10.890591 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:10.917484 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-874c896a-c31f-4949-923f-dc1f6edb5a2c tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.492s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:10.919261 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Searching for a device in session 80 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:03:10.920154 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ca41e75f-27e1-4730-8d34-4d606a9c8908', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:03:10.925331 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:10.925331 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:10.925331 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:10.925331 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:10.925331 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:10.925331 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:10.925331 np0000001127 nova-compute[98206]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:10.925331 np0000001127 nova-compute[98206]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:10.925331 np0000001127 nova-compute[98206]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:10.925331 np0000001127 nova-compute[98206]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:10.925331 np0000001127 nova-compute[98206]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908 (non-flash)
May 21 02:03:10.925331 np0000001127 nova-compute[98206]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908 (non-flash)
May 21 02:03:10.925331 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:03:10.926134 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:10.926134 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:10.926134 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:10.926134 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:10.926134 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:10.926134 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:10.926134 np0000001127 nova-compute[98206]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:10.926134 np0000001127 nova-compute[98206]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:10.926134 np0000001127 nova-compute[98206]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:10.926134 np0000001127 nova-compute[98206]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:10.926134 np0000001127 nova-compute[98206]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908 (non-flash)
May 21 02:03:10.926134 np0000001127 nova-compute[98206]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908 (non-flash)
May 21 02:03:10.926134 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:03:10.926134 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.234s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:03:10.926134 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:03:10.928652 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] HCTL ('10', '-', '-', 0) found on session 81 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:03:10.928877 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:03:10.954094 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Searching for a device in session 81 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:03:10.954430 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ca41e75f-27e1-4730-8d34-4d606a9c8908', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:03:11.400583 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:11.415441 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:11.537940 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:03:11.538087 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:03:11.538241 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] No VIF found with MAC fa:16:3e:ed:a6:59, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:03:11.538724 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Using config drive
May 21 02:03:11.692152 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:03:12.048768 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:12.239062 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Creating config drive at /opt/stack/data/nova/instances/2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61/disk.config
May 21 02:03:12.246998 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppwa47v5m {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:12.336128 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppwa47v5m" returned: 0 in 0.089s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:12.714947 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Found WWN 3300000006a55c993 for multipath device dm-1 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:03:12.715714 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:03:12.717701 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '3300000006a55c993', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '3300000006a55c993'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:03:12.718000 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006a55c993', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '3300000006a55c993'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:03:12.724074 np0000001127 nova-compute[98206]: WARNING stevedore.named [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 21 02:03:12.724548 np0000001127 nova-compute[98206]: WARNING castellan.key_manager [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 21 02:03:12.724803 np0000001127 nova-compute[98206]: WARNING nova.keymgr.conf_key_mgr [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 21 02:03:12.756108 np0000001127 nova-compute[98206]: WARNING os_brick.encryptors.luks [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 21 02:03:12.756537 np0000001127 nova-compute[98206]: WARNING stevedore.named [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 21 02:03:12.756729 np0000001127 nova-compute[98206]: WARNING castellan.key_manager [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 21 02:03:12.756896 np0000001127 nova-compute[98206]: WARNING nova.keymgr.conf_key_mgr [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 21 02:03:12.758733 np0000001127 nova-compute[98206]: DEBUG os_brick.encryptors [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x71c05862d160>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908', 'iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ca41e75f-27e1-4730-8d34-4d606a9c8908', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': 'f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80', 'attached_at': '', 'detached_at': '', 'volume_id': 'ca41e75f-27e1-4730-8d34-4d606a9c8908', 'serial': 'ca41e75f-27e1-4730-8d34-4d606a9c8908'} {{(pid=98206) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 21 02:03:12.759034 np0000001127 nova-compute[98206]: DEBUG os_brick.encryptors.luks [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] formatting encrypted volume /dev/dm-1 {{(pid=98206) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 21 02:03:12.888977 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:12.926008 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:13.037651 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:13.361991 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:13.369673 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:13.370981 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:13.388884 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a972ef49-5964-43f8-a322-83d07f4a4c25 req-74e58341-e614-469b-bee4-be5cf8f8798b service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Received event network-vif-plugged-01b64dbf-89aa-471a-a2df-58edb2a7a254 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:13.388884 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a972ef49-5964-43f8-a322-83d07f4a4c25 req-74e58341-e614-469b-bee4-be5cf8f8798b service nova] Acquiring lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:13.388884 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a972ef49-5964-43f8-a322-83d07f4a4c25 req-74e58341-e614-469b-bee4-be5cf8f8798b service nova] Lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:13.389956 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a972ef49-5964-43f8-a322-83d07f4a4c25 req-74e58341-e614-469b-bee4-be5cf8f8798b service nova] Lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:13.391356 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a972ef49-5964-43f8-a322-83d07f4a4c25 req-74e58341-e614-469b-bee4-be5cf8f8798b service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Processing event network-vif-plugged-01b64dbf-89aa-471a-a2df-58edb2a7a254 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:03:13.402812 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:13.520219 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:14.188495 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328994.1855507, 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:03:14.188495 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] VM Started (Lifecycle Event)
May 21 02:03:14.190563 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:03:14.195293 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:03:14.201987 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Instance spawned successfully.
May 21 02:03:14.203953 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:03:14.698248 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:03:14.703888 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:03:14.712906 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:03:14.712906 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:03:14.712906 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:03:14.713152 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:03:14.713563 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:03:14.713638 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:03:15.012935 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:15.213697 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:03:15.213697 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328995.2119806, 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:03:15.213697 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] VM Paused (Lifecycle Event)
May 21 02:03:15.222461 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Took 9.78 seconds to spawn the instance on the hypervisor.
May 21 02:03:15.222861 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:03:15.507309 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-aa25472e-9d0e-4a94-89a6-8e993ddd5189 req-2f9bc702-0759-4464-9959-26d91e763344 service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Received event network-vif-plugged-01b64dbf-89aa-471a-a2df-58edb2a7a254 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:15.508700 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-aa25472e-9d0e-4a94-89a6-8e993ddd5189 req-2f9bc702-0759-4464-9959-26d91e763344 service nova] Acquiring lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:15.508902 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-aa25472e-9d0e-4a94-89a6-8e993ddd5189 req-2f9bc702-0759-4464-9959-26d91e763344 service nova] Lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:15.508987 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-aa25472e-9d0e-4a94-89a6-8e993ddd5189 req-2f9bc702-0759-4464-9959-26d91e763344 service nova] Lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:15.509156 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-aa25472e-9d0e-4a94-89a6-8e993ddd5189 req-2f9bc702-0759-4464-9959-26d91e763344 service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] No waiting events found dispatching network-vif-plugged-01b64dbf-89aa-471a-a2df-58edb2a7a254 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:03:15.509315 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-aa25472e-9d0e-4a94-89a6-8e993ddd5189 req-2f9bc702-0759-4464-9959-26d91e763344 service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Received unexpected event network-vif-plugged-01b64dbf-89aa-471a-a2df-58edb2a7a254 for instance with vm_state active and task_state None.
May 21 02:03:15.596014 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0012053479999849515 future=<Future at 0x71c05850fc20 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:03:15.596148 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:03:15.596630 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Emitting event <LifecycleEvent: 1779328980.5946522, e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:03:15.596862 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] VM Stopped (Lifecycle Event)
May 21 02:03:15.716032 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:03:15.722042 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779328995.7206604, 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:03:15.722042 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] VM Resumed (Lifecycle Event)
May 21 02:03:15.743361 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Acquiring lock "ee14489e-8772-4a35-b7e7-760bc8f7f4ad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:15.750476 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Lock "ee14489e-8772-4a35-b7e7-760bc8f7f4ad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.007s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:15.752205 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Took 17.47 seconds to build instance.
May 21 02:03:16.099432 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: e5b6a2f4-cfeb-4c49-9c26-1eae8e74dad2] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:03:16.223458 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:03:16.229575 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:03:16.253055 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:03:16.257235 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29f179c2-d3a7-4f2e-882f-cfc4b5ceb35d tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.988s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:16.417720 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:16.725494 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:16.853256 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:16.854388 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:16.863420 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:03:16.863683 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Claim successful on node np0000001127
May 21 02:03:17.426596 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Acquiring lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:17.427167 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:17.520205 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Secret XML: <secret ephemeral="no" private="no">
May 21 02:03:17.520205 np0000001127 nova-compute[98206]:   <usage type="volume">
May 21 02:03:17.520205 np0000001127 nova-compute[98206]:     <volume>ca41e75f-27e1-4730-8d34-4d606a9c8908</volume>
May 21 02:03:17.520205 np0000001127 nova-compute[98206]:   </usage>
May 21 02:03:17.520205 np0000001127 nova-compute[98206]: </secret>
May 21 02:03:17.520205 np0000001127 nova-compute[98206]:  {{(pid=98206) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 21 02:03:17.532813 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lazy-loading 'flavor' on Instance uuid f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:03:17.931749 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Detaching volume 710ab2b4-9ee4-4904-b5c2-088ae02f0fe8
May 21 02:03:17.956126 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Refreshing inventories for resource provider a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 21 02:03:18.007576 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Attempting to driver detach volume 710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 from mountpoint /dev/vdc
May 21 02:03:18.015259 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Found disk vdc by alias ua-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:03:18.017392 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Found disk vdc by alias ua-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:03:18.017392 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Attempting to detach device vdc from instance 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 02:03:18.017392 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:03:18.017392 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:03:18.017392 np0000001127 nova-compute[98206]:   <alias name="ua-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8"/>
May 21 02:03:18.017392 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-12"/>
May 21 02:03:18.017392 np0000001127 nova-compute[98206]:   <target dev="vdc" bus="virtio"/>
May 21 02:03:18.017392 np0000001127 nova-compute[98206]:   <serial>710ab2b4-9ee4-4904-b5c2-088ae02f0fe8</serial>
May 21 02:03:18.017392 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 21 02:03:18.017392 np0000001127 nova-compute[98206]: </disk>
May 21 02:03:18.017392 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:03:18.025849 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Successfully detached device vdc from instance 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a from the persistent domain config.
May 21 02:03:18.025849 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] (1/8): Attempting to detach device vdc with device alias ua-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 from instance 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 02:03:18.025849 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:03:18.025849 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:03:18.025849 np0000001127 nova-compute[98206]:   <alias name="ua-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8"/>
May 21 02:03:18.025849 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-12"/>
May 21 02:03:18.025849 np0000001127 nova-compute[98206]:   <target dev="vdc" bus="virtio"/>
May 21 02:03:18.025849 np0000001127 nova-compute[98206]:   <serial>710ab2b4-9ee4-4904-b5c2-088ae02f0fe8</serial>
May 21 02:03:18.025849 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 21 02:03:18.025849 np0000001127 nova-compute[98206]: </disk>
May 21 02:03:18.025849 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:03:18.040547 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Updating ProviderTree inventory for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 21 02:03:18.042443 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Attempting to attach volume ca41e75f-27e1-4730-8d34-4d606a9c8908 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 02:03:18.042758 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Updating inventory in ProviderTree for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 21 02:03:18.051334 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] attach device xml: <disk type="block" device="disk">
May 21 02:03:18.051334 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:03:18.051334 np0000001127 nova-compute[98206]:   <alias name="ua-ca41e75f-27e1-4730-8d34-4d606a9c8908"/>
May 21 02:03:18.051334 np0000001127 nova-compute[98206]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 21 02:03:18.051334 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:03:18.051334 np0000001127 nova-compute[98206]:   <serial>ca41e75f-27e1-4730-8d34-4d606a9c8908</serial>
May 21 02:03:18.051334 np0000001127 nova-compute[98206]:   <encryption format="luks">
May 21 02:03:18.051334 np0000001127 nova-compute[98206]:     <secret type="passphrase" uuid="f2061d0a-89d8-421e-b514-3a9286040314"/>
May 21 02:03:18.051334 np0000001127 nova-compute[98206]:   </encryption>
May 21 02:03:18.051334 np0000001127 nova-compute[98206]: </disk>
May 21 02:03:18.051334 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 02:03:18.111914 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Refreshing aggregate associations for resource provider a0b7bd56-5a70-4557-8cfd-9f933f412754, aggregates: None {{(pid=98206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 21 02:03:18.183060 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Refreshing trait associations for resource provider a0b7bd56-5a70-4557-8cfd-9f933f412754, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_ARCH_X86_64,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ARCH_PPC64LE,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,HW_ARCH_X86_64,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ARCH_S390X,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOUND_MODEL_USB,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_SOUND_MODEL_SB16,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_ARCH_RISCV64,COMPUTE_ARCH_MIPSEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ARCH_AARCH64,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_SOUND_MODEL_AC97,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX {{(pid=98206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 21 02:03:18.808331 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779328998.8078725, 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a => ua-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 02:03:18.811112 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 for instance 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 02:03:18.812939 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:18.818912 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Successfully detached device vdc from instance 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a from the live domain config.
May 21 02:03:18.822244 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:03:18.822601 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8', 'iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '710ab2b4-9ee4-4904-b5c2-088ae02f0fe8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:03:18.822851 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:03:18.823507 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:03:18.823663 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8', 'iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '710ab2b4-9ee4-4904-b5c2-088ae02f0fe8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:03:18.823882 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:03:18.851208 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:03:18.851541 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:03:18.869891 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:18.869891 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:18.869891 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:18.869891 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:18.869891 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:18.869891 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:18.869891 np0000001127 nova-compute[98206]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:18.869891 np0000001127 nova-compute[98206]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:18.869891 np0000001127 nova-compute[98206]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:18.869891 np0000001127 nova-compute[98206]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:18.869891 np0000001127 nova-compute[98206]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908 (non-flash)
May 21 02:03:18.869891 np0000001127 nova-compute[98206]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908 (non-flash)
May 21 02:03:18.869891 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:03:18.870345 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:18.870345 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:18.870345 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:18.870345 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:18.870345 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:18.870345 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:18.870345 np0000001127 nova-compute[98206]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:18.870345 np0000001127 nova-compute[98206]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8 (non-flash)
May 21 02:03:18.870345 np0000001127 nova-compute[98206]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:18.870345 np0000001127 nova-compute[98206]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:18.870345 np0000001127 nova-compute[98206]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908 (non-flash)
May 21 02:03:18.870345 np0000001127 nova-compute[98206]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908 (non-flash)
May 21 02:03:18.870345 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:03:18.870345 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', '56'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', '57'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', '70'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', '71'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8', '76'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8', '77'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', '78'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', '79'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908', '80'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908', '81')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:03:18.870345 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8', '76')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:03:18.872093 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8', '77')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:03:18.873494 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c0585c68e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8'): ({'sdn'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8'): ({'sdo'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:03:18.873762 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Removing multipathed devices sdo, sdn {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:03:18.874068 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Flush multipath device 330000000cfb9da48 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:03:18.909815 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:03:18.959354 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:03:19.003075 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Checking to see if SCSI volumes sdo, sdn have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:03:19.003263 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] SCSI volumes sdo, sdn have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:03:19.004898 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Checking to see if device paths {'sdo', 'sdn'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:03:19.017505 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Device paths {'sdo', 'sdn'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:03:19.017505 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:03:19.033790 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:19.068331 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 76, target: iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8, portal: 192.168.40.100,3260]
May 21 02:03:19.068331 np0000001127 nova-compute[98206]: Logout of [sid: 76, target: iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8, portal: 192.168.40.100,3260] successful.
May 21 02:03:19.068331 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:19.102914 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:19.119146 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:19.170100 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 77, target: iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8, portal: 192.168.50.100,3260]
May 21 02:03:19.170100 np0000001127 nova-compute[98206]: Logout of [sid: 77, target: iqn.2023-03.storpool.com:os--volume-710ab2b4-9ee4-4904-b5c2-088ae02f0fe8, portal: 192.168.50.100,3260] successful.
May 21 02:03:19.170100 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:19.198968 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:19.199244 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:03:19.199447 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] <== disconnect_volume: return (376ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:03:19.201522 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:03:19.357378 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:03:19.719807 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "8948a19b-9e7e-448d-b782-be58020b5320" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:19.722052 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "8948a19b-9e7e-448d-b782-be58020b5320" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:19.767428 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lazy-loading 'flavor' on Instance uuid 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:03:19.865534 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.012s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:19.865980 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:03:20.022453 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:20.226710 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lazy-loading 'flavor' on Instance uuid 8948a19b-9e7e-448d-b782-be58020b5320 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:03:20.371873 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:03:20.372494 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:03:20.374581 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:20.374581 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:20.461736 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f1c1152331140f9b4acfc98d16623bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5852e542a6f42ffb8e104daf741f872', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:03:20.657428 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:03:20.657428 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:03:20.657579 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:03:20.657908 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] No VIF found with MAC fa:16:3e:59:b4:d0, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:03:20.776069 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-76c6e0e4-2803-47d1-9acb-5a3462e88cc9 tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.349s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:20.877376 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:03:20.982322 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Successfully created port: a0dd78aa-e6ea-44ca-a6a4-b819dafa6653 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:03:21.016556 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2b8c3191-5f73-473b-8f02-c9444f5c2e1d req-f37cbe8f-20f2-4454-9c1f-d0999b7bccba service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Received event network-changed-01b64dbf-89aa-471a-a2df-58edb2a7a254 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:21.017657 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2b8c3191-5f73-473b-8f02-c9444f5c2e1d req-f37cbe8f-20f2-4454-9c1f-d0999b7bccba service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Refreshing instance network info cache due to event network-changed-01b64dbf-89aa-471a-a2df-58edb2a7a254. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:03:21.017833 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2b8c3191-5f73-473b-8f02-c9444f5c2e1d req-f37cbe8f-20f2-4454-9c1f-d0999b7bccba service nova] Acquiring lock "refresh_cache-2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:03:21.017929 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2b8c3191-5f73-473b-8f02-c9444f5c2e1d req-f37cbe8f-20f2-4454-9c1f-d0999b7bccba service nova] Acquired lock "refresh_cache-2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:03:21.020448 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-2b8c3191-5f73-473b-8f02-c9444f5c2e1d req-f37cbe8f-20f2-4454-9c1f-d0999b7bccba service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Refreshing network info cache for port 01b64dbf-89aa-471a-a2df-58edb2a7a254 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:03:21.235191 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "8948a19b-9e7e-448d-b782-be58020b5320" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.514s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:21.381248 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:03:21.419815 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:21.526911 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-2b8c3191-5f73-473b-8f02-c9444f5c2e1d req-f37cbe8f-20f2-4454-9c1f-d0999b7bccba service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:21.603987 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Successfully updated port: a0dd78aa-e6ea-44ca-a6a4-b819dafa6653 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:03:21.933482 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7f92117c-fe97-4e4d-9ebd-efd59456215e req-befbcd2f-f4b3-48d1-9308-c766668260a1 service nova] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Received event network-changed-a0dd78aa-e6ea-44ca-a6a4-b819dafa6653 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:21.933675 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7f92117c-fe97-4e4d-9ebd-efd59456215e req-befbcd2f-f4b3-48d1-9308-c766668260a1 service nova] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Refreshing instance network info cache due to event network-changed-a0dd78aa-e6ea-44ca-a6a4-b819dafa6653. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:03:21.935538 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7f92117c-fe97-4e4d-9ebd-efd59456215e req-befbcd2f-f4b3-48d1-9308-c766668260a1 service nova] Acquiring lock "refresh_cache-ee14489e-8772-4a35-b7e7-760bc8f7f4ad" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:03:21.936296 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7f92117c-fe97-4e4d-9ebd-efd59456215e req-befbcd2f-f4b3-48d1-9308-c766668260a1 service nova] Acquired lock "refresh_cache-ee14489e-8772-4a35-b7e7-760bc8f7f4ad" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:03:21.936459 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-7f92117c-fe97-4e4d-9ebd-efd59456215e req-befbcd2f-f4b3-48d1-9308-c766668260a1 service nova] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Refreshing network info cache for port a0dd78aa-e6ea-44ca-a6a4-b819dafa6653 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:03:21.956649 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-2b8c3191-5f73-473b-8f02-c9444f5c2e1d req-f37cbe8f-20f2-4454-9c1f-d0999b7bccba service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:22.106694 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Acquiring lock "refresh_cache-ee14489e-8772-4a35-b7e7-760bc8f7f4ad" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:03:22.191842 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-2b8c3191-5f73-473b-8f02-c9444f5c2e1d req-f37cbe8f-20f2-4454-9c1f-d0999b7bccba service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Updated VIF entry in instance network info cache for port 01b64dbf-89aa-471a-a2df-58edb2a7a254. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:03:22.191842 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-2b8c3191-5f73-473b-8f02-c9444f5c2e1d req-f37cbe8f-20f2-4454-9c1f-d0999b7bccba service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Updating instance_info_cache with network_info: [{"id": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "address": "fa:16:3e:ed:a6:59", "network": {"id": "56a7d47c-c10f-4969-a14d-a81a8b4f0e1c", "bridge": "br-int", "label": "tempest-TestShelveInstance-781032295-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db73ea4d098a4b768f0b51d6cbe9eda8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b64dbf-89", "ovs_interfaceid": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:03:22.220989 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b6fe6a43-ce32-47b0-b2dc-18e01ea609b2 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.333s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:22.344540 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "8948a19b-9e7e-448d-b782-be58020b5320" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:22.344540 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "8948a19b-9e7e-448d-b782-be58020b5320" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:22.345120 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Attaching volume 2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a to /dev/vdb
May 21 02:03:22.393714 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:03:22.395024 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:03:22.395343 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Creating image(s)
May 21 02:03:22.396278 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Acquiring lock "/opt/stack/data/nova/instances/ee14489e-8772-4a35-b7e7-760bc8f7f4ad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:22.396649 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Lock "/opt/stack/data/nova/instances/ee14489e-8772-4a35-b7e7-760bc8f7f4ad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:22.397459 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Lock "/opt/stack/data/nova/instances/ee14489e-8772-4a35-b7e7-760bc8f7f4ad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:22.398454 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:03:22.401478 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:03:22.402367 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:22.423706 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:03:22.440428 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:03:22.445868 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-7f92117c-fe97-4e4d-9ebd-efd59456215e req-befbcd2f-f4b3-48d1-9308-c766668260a1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:22.474481 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:22.504041 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.098s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:22.507637 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:22.508719 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:22.510030 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:03:22.514820 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:03:22.516487 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:22.531291 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:03:22.532525 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:03:22.547440 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:03:22.549322 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe9e:216', 'fe80::14d9:7bff:fe3b:f0dc', 'fe80::fc16:3eff:fe45:a237', 'fe80::789a:c1ff:fe89:a024', 'fe80::fc16:3eff:fe41:220a', 'fe80::3c32:60ff:fe45:d447', 'fe80::fc16:3eff:fe2b:20c8', 'fe80::fc16:3eff:fe60:a612', 'fe80::fc16:3eff:fe59:b4d0', 'fe80::f819:cdff:fe2b:de28', 'fe80::fc16:3eff:fe27:7142', 'fe80::fc16:3eff:fef4:b759', 'fe80::40b3:49ff:feb3:3b55', 'fe80::fc16:3eff:feed:a659', 'fe80::803:29ff:fe32:ac7b'] 
May 21 02:03:22.552303 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:03:22.552303 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:03:22.552686 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:03:22.553025 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Updating existing volume attachment record: f79c248f-ebe4-43f0-ad69-a202eea16030 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:03:22.588338 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-7f92117c-fe97-4e4d-9ebd-efd59456215e req-befbcd2f-f4b3-48d1-9308-c766668260a1 service nova] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:03:22.610988 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Acquiring lock "76097fea-0890-40a8-a902-9f510cd34b52" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:22.611374 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "76097fea-0890-40a8-a902-9f510cd34b52" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:22.626451 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.109s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:22.626803 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/ee14489e-8772-4a35-b7e7-760bc8f7f4ad/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:22.673675 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "df1fb869-23ef-48e0-b609-ce91c2540c2e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:22.673930 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:22.693496 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2b8c3191-5f73-473b-8f02-c9444f5c2e1d req-f37cbe8f-20f2-4454-9c1f-d0999b7bccba service nova] Releasing lock "refresh_cache-2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:03:22.696896 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/ee14489e-8772-4a35-b7e7-760bc8f7f4ad/disk 1073741824" returned: 0 in 0.070s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:22.698647 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:22.699034 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:22.802226 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.103s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:22.802436 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ee14489e-8772-4a35-b7e7-760bc8f7f4ad/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:03:22.802958 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee14489e-8772-4a35-b7e7-760bc8f7f4ad/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:22.849073 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-7f92117c-fe97-4e4d-9ebd-efd59456215e req-befbcd2f-f4b3-48d1-9308-c766668260a1 service nova] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:03:22.913541 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee14489e-8772-4a35-b7e7-760bc8f7f4ad/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:22.913963 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Cannot resize image /opt/stack/data/nova/instances/ee14489e-8772-4a35-b7e7-760bc8f7f4ad/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:03:22.914628 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:03:22.914863 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Ensure instance console log exists: /opt/stack/data/nova/instances/ee14489e-8772-4a35-b7e7-760bc8f7f4ad/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:03:22.914996 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:22.915195 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:22.915333 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:23.117003 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:03:23.138658 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:03:23.141603 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a', 'iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:03:23.141603 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:03:23.141603 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:03:23.141603 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a', 'iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:03:23.154320 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:03:23.155157 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:03:23.155672 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:03:23.155908 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:03:23.156672 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:03:23.156932 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:03:23.168738 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:03:23.168738 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:23.175253 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:03:23.175253 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:23.181660 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a] added
May 21 02:03:23.181660 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:03:23.181660 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:03:23.181660 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:03:23.181660 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:03:23.181660 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:03:23.181660 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:23.182006 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:03:23.182044 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0261(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:03:23.182191 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:03:23.183366 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Detaching volume 8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0
May 21 02:03:23.186912 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a] added
May 21 02:03:23.186912 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:03:23.186912 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:03:23.186912 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:03:23.186912 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:03:23.186912 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:03:23.186912 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:23.187178 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:03:23.187797 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0303(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:03:23.188925 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:03:23.248565 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:23.248808 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:23.252208 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Attempting to driver detach volume 8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 from mountpoint /dev/vdb
May 21 02:03:23.261430 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Found disk vdb by alias ua-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:03:23.263715 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Found disk vdb by alias ua-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:03:23.263900 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Attempting to detach device vdb from instance df1fb869-23ef-48e0-b609-ce91c2540c2e from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 02:03:23.264277 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:03:23.264277 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:03:23.264277 np0000001127 nova-compute[98206]:   <alias name="ua-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0"/>
May 21 02:03:23.264277 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-5"/>
May 21 02:03:23.264277 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:03:23.264277 np0000001127 nova-compute[98206]:   <serial>8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0</serial>
May 21 02:03:23.264277 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 21 02:03:23.264277 np0000001127 nova-compute[98206]: </disk>
May 21 02:03:23.264277 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:03:23.281030 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Successfully detached device vdb from instance df1fb869-23ef-48e0-b609-ce91c2540c2e from the persistent domain config.
May 21 02:03:23.281204 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] (1/8): Attempting to detach device vdb with device alias ua-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 from instance df1fb869-23ef-48e0-b609-ce91c2540c2e from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 02:03:23.281513 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:03:23.281513 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:03:23.281513 np0000001127 nova-compute[98206]:   <alias name="ua-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0"/>
May 21 02:03:23.281513 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-5"/>
May 21 02:03:23.281513 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:03:23.281513 np0000001127 nova-compute[98206]:   <serial>8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0</serial>
May 21 02:03:23.281513 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 21 02:03:23.281513 np0000001127 nova-compute[98206]: </disk>
May 21 02:03:23.281513 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:03:23.352659 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7f92117c-fe97-4e4d-9ebd-efd59456215e req-befbcd2f-f4b3-48d1-9308-c766668260a1 service nova] Releasing lock "refresh_cache-ee14489e-8772-4a35-b7e7-760bc8f7f4ad" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:03:23.353128 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Acquired lock "refresh_cache-ee14489e-8772-4a35-b7e7-760bc8f7f4ad" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:03:23.353282 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:03:23.404760 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Acquiring lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:23.404922 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:23.405359 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Acquiring lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:23.405605 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:23.405691 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:23.408584 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Terminating instance
May 21 02:03:23.671572 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:23.671702 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:23.675413 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:03:23.675554 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Claim successful on node np0000001127
May 21 02:03:23.752055 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Detaching volume ca41e75f-27e1-4730-8d34-4d606a9c8908
May 21 02:03:23.802662 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Attempting to driver detach volume ca41e75f-27e1-4730-8d34-4d606a9c8908 from mountpoint /dev/vdb
May 21 02:03:23.844922 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779329003.84458, df1fb869-23ef-48e0-b609-ce91c2540c2e => ua-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 02:03:23.845800 np0000001127 nova-compute[98206]: DEBUG os_brick.encryptors [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908', 'iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ca41e75f-27e1-4730-8d34-4d606a9c8908', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': 'f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80', 'attached_at': '', 'detached_at': '', 'volume_id': 'ca41e75f-27e1-4730-8d34-4d606a9c8908', 'serial': 'ca41e75f-27e1-4730-8d34-4d606a9c8908'} {{(pid=98206) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 21 02:03:23.846149 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 for instance df1fb869-23ef-48e0-b609-ce91c2540c2e {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 02:03:23.850069 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Successfully detached device vdb from instance df1fb869-23ef-48e0-b609-ce91c2540c2e from the live domain config.
May 21 02:03:23.851107 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Found disk vdb by alias ua-ca41e75f-27e1-4730-8d34-4d606a9c8908 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:03:23.852946 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:03:23.853407 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:03:23.854302 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:03:23.854573 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Found disk vdb by alias ua-ca41e75f-27e1-4730-8d34-4d606a9c8908 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:03:23.854725 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Attempting to detach device vdb from instance f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80 from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 02:03:23.855055 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:03:23.855055 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:03:23.855055 np0000001127 nova-compute[98206]:   <alias name="ua-ca41e75f-27e1-4730-8d34-4d606a9c8908"/>
May 21 02:03:23.855055 np0000001127 nova-compute[98206]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 21 02:03:23.855055 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:03:23.855055 np0000001127 nova-compute[98206]:   <serial>ca41e75f-27e1-4730-8d34-4d606a9c8908</serial>
May 21 02:03:23.855055 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:03:23.855055 np0000001127 nova-compute[98206]:   <encryption format="luks">
May 21 02:03:23.855055 np0000001127 nova-compute[98206]:     <secret type="passphrase" uuid="f2061d0a-89d8-421e-b514-3a9286040314"/>
May 21 02:03:23.855055 np0000001127 nova-compute[98206]:   </encryption>
May 21 02:03:23.855055 np0000001127 nova-compute[98206]: </disk>
May 21 02:03:23.855055 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:03:23.862999 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Successfully detached device vdb from instance f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80 from the persistent domain config.
May 21 02:03:23.863160 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] (1/8): Attempting to detach device vdb with device alias ua-ca41e75f-27e1-4730-8d34-4d606a9c8908 from instance f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80 from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 02:03:23.863487 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:03:23.863487 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:03:23.863487 np0000001127 nova-compute[98206]:   <alias name="ua-ca41e75f-27e1-4730-8d34-4d606a9c8908"/>
May 21 02:03:23.863487 np0000001127 nova-compute[98206]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 21 02:03:23.863487 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:03:23.863487 np0000001127 nova-compute[98206]:   <serial>ca41e75f-27e1-4730-8d34-4d606a9c8908</serial>
May 21 02:03:23.863487 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:03:23.863487 np0000001127 nova-compute[98206]:   <encryption format="luks">
May 21 02:03:23.863487 np0000001127 nova-compute[98206]:     <secret type="passphrase" uuid="f2061d0a-89d8-421e-b514-3a9286040314"/>
May 21 02:03:23.863487 np0000001127 nova-compute[98206]:   </encryption>
May 21 02:03:23.863487 np0000001127 nova-compute[98206]: </disk>
May 21 02:03:23.863487 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:03:24.053331 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:03:24.075233 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-883a1b56-89c0-4e3e-89cd-fb5306597f8e req-076954dd-ccf3-4351-a9c6-86eb8786dec2 service nova] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Received event network-changed-c0e8bfdd-1ce7-47c4-a730-362b39289635 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:24.075233 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-883a1b56-89c0-4e3e-89cd-fb5306597f8e req-076954dd-ccf3-4351-a9c6-86eb8786dec2 service nova] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Refreshing instance network info cache due to event network-changed-c0e8bfdd-1ce7-47c4-a730-362b39289635. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:03:24.075233 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-883a1b56-89c0-4e3e-89cd-fb5306597f8e req-076954dd-ccf3-4351-a9c6-86eb8786dec2 service nova] Acquiring lock "refresh_cache-23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:03:24.075233 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-883a1b56-89c0-4e3e-89cd-fb5306597f8e req-076954dd-ccf3-4351-a9c6-86eb8786dec2 service nova] Acquired lock "refresh_cache-23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:03:24.075233 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-883a1b56-89c0-4e3e-89cd-fb5306597f8e req-076954dd-ccf3-4351-a9c6-86eb8786dec2 service nova] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Refreshing network info cache for port c0e8bfdd-1ce7-47c4-a730-362b39289635 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:03:24.100142 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:24.104317 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:24.121275 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:24.135918 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:03:24.141417 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:24.164172 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:24.165763 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:24.186922 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:03:24.189215 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:03:24.203571 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:03:24.203571 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:03:24.214687 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:03:24.214687 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:24.222943 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:24.241493 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:24.250413 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:24.250413 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:24.250413 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:24.250413 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:24.250413 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:24.250413 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:24.250413 np0000001127 nova-compute[98206]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:24.250413 np0000001127 nova-compute[98206]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:24.250413 np0000001127 nova-compute[98206]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908 (non-flash)
May 21 02:03:24.250413 np0000001127 nova-compute[98206]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908 (non-flash)
May 21 02:03:24.250413 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:03:24.250835 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:24.250835 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:24.250835 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:24.250835 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:24.250835 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:24.250835 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:24.250835 np0000001127 nova-compute[98206]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:24.250835 np0000001127 nova-compute[98206]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:24.250835 np0000001127 nova-compute[98206]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908 (non-flash)
May 21 02:03:24.250835 np0000001127 nova-compute[98206]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908 (non-flash)
May 21 02:03:24.250835 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:03:24.263693 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:24.263693 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:24.263693 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:24.263693 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:24.263693 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:24.263693 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:24.263693 np0000001127 nova-compute[98206]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:24.263693 np0000001127 nova-compute[98206]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:24.263693 np0000001127 nova-compute[98206]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908 (non-flash)
May 21 02:03:24.263693 np0000001127 nova-compute[98206]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908 (non-flash)
May 21 02:03:24.263693 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:03:24.264131 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:24.264131 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:24.264131 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:24.264131 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:24.264131 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:24.264131 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:24.264131 np0000001127 nova-compute[98206]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:24.264131 np0000001127 nova-compute[98206]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:24.264131 np0000001127 nova-compute[98206]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908 (non-flash)
May 21 02:03:24.264131 np0000001127 nova-compute[98206]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908 (non-flash)
May 21 02:03:24.264131 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:03:24.319160 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a, portal: 192.168.40.100,3260]
May 21 02:03:24.319160 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a, portal: 192.168.40.100,3260] successful.
May 21 02:03:24.319160 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:24.329186 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a, portal: 192.168.50.100,3260]
May 21 02:03:24.329186 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a, portal: 192.168.50.100,3260] successful.
May 21 02:03:24.329186 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:24.339228 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-396b720c-849c-4e4b-96a0-1f31f6170ba3 req-8bec7a23-a6db-490f-91c7-11cbba2ba5c0 service nova] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Received event network-vif-unplugged-c0e8bfdd-1ce7-47c4-a730-362b39289635 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:24.341908 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:24.345357 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-396b720c-849c-4e4b-96a0-1f31f6170ba3 req-8bec7a23-a6db-490f-91c7-11cbba2ba5c0 service nova] Acquiring lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:24.345585 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-396b720c-849c-4e4b-96a0-1f31f6170ba3 req-8bec7a23-a6db-490f-91c7-11cbba2ba5c0 service nova] Lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:24.345706 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-396b720c-849c-4e4b-96a0-1f31f6170ba3 req-8bec7a23-a6db-490f-91c7-11cbba2ba5c0 service nova] Lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:24.345864 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-396b720c-849c-4e4b-96a0-1f31f6170ba3 req-8bec7a23-a6db-490f-91c7-11cbba2ba5c0 service nova] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] No waiting events found dispatching network-vif-unplugged-c0e8bfdd-1ce7-47c4-a730-362b39289635 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:03:24.346133 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-396b720c-849c-4e4b-96a0-1f31f6170ba3 req-8bec7a23-a6db-490f-91c7-11cbba2ba5c0 service nova] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Received event network-vif-unplugged-c0e8bfdd-1ce7-47c4-a730-362b39289635 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:03:24.348836 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:24.369938 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:24.369938 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:24.369938 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:24.369938 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:24.369938 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:24.369938 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:24.369938 np0000001127 nova-compute[98206]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:24.369938 np0000001127 nova-compute[98206]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:24.369938 np0000001127 nova-compute[98206]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908 (non-flash)
May 21 02:03:24.369938 np0000001127 nova-compute[98206]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908 (non-flash)
May 21 02:03:24.369938 np0000001127 nova-compute[98206]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:03:24.369938 np0000001127 nova-compute[98206]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:03:24.369938 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:03:24.370576 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:24.370576 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:24.370576 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:24.370576 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:24.370576 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:24.370576 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:24.370576 np0000001127 nova-compute[98206]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:24.370576 np0000001127 nova-compute[98206]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:24.370576 np0000001127 nova-compute[98206]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908 (non-flash)
May 21 02:03:24.370576 np0000001127 nova-compute[98206]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908 (non-flash)
May 21 02:03:24.370576 np0000001127 nova-compute[98206]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:03:24.370576 np0000001127 nova-compute[98206]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:03:24.370576 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:03:24.370576 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.215s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:03:24.370576 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:03:24.372024 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] HCTL ('17', '-', '-', 0) found on session 82 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:03:24.372152 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:03:24.375496 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:24.380334 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:24.380334 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:24.380334 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:24.380334 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:24.380334 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:24.380334 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:24.380334 np0000001127 nova-compute[98206]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:24.380334 np0000001127 nova-compute[98206]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:24.380334 np0000001127 nova-compute[98206]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908 (non-flash)
May 21 02:03:24.380334 np0000001127 nova-compute[98206]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908 (non-flash)
May 21 02:03:24.380334 np0000001127 nova-compute[98206]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:03:24.380334 np0000001127 nova-compute[98206]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:03:24.380334 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:03:24.382972 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:24.382972 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:24.382972 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:24.382972 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:24.382972 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:24.382972 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:24.382972 np0000001127 nova-compute[98206]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:24.382972 np0000001127 nova-compute[98206]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:24.382972 np0000001127 nova-compute[98206]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908 (non-flash)
May 21 02:03:24.382972 np0000001127 nova-compute[98206]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908 (non-flash)
May 21 02:03:24.382972 np0000001127 nova-compute[98206]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:03:24.382972 np0000001127 nova-compute[98206]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:03:24.382972 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:03:24.382972 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.225s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:03:24.382972 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:03:24.383435 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] HCTL ('18', '-', '-', 0) found on session 83 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:03:24.383588 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:03:24.395344 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Searching for a device in session 82 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:03:24.395344 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:03:24.414794 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Searching for a device in session 83 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:03:24.414794 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:03:24.425189 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:24.576030 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779329004.5756104, f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80 => ua-ca41e75f-27e1-4730-8d34-4d606a9c8908> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 02:03:24.576577 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-883a1b56-89c0-4e3e-89cd-fb5306597f8e req-076954dd-ccf3-4351-a9c6-86eb8786dec2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:24.581077 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Updating instance_info_cache with network_info: [{"id": "a0dd78aa-e6ea-44ca-a6a4-b819dafa6653", "address": "fa:16:3e:3f:55:7a", "network": {"id": "6d2e68f2-ff8f-41f5-accf-4865237c0702", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1863313078-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c5852e542a6f42ffb8e104daf741f872", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0dd78aa-e6", "ovs_interfaceid": "a0dd78aa-e6ea-44ca-a6a4-b819dafa6653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:03:24.582775 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-ca41e75f-27e1-4730-8d34-4d606a9c8908 for instance f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80 {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 02:03:24.586884 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.99972087199967 future=<Future at 0x71c0586d7500 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:03:24.588349 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.998245325999733 future=<Future at 0x71c0586d7500 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:03:24.588501 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.998088936999693 future=<Future at 0x71c0586d7500 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:03:24.591968 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Successfully detached device vdb from instance f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80 from the live domain config.
May 21 02:03:24.598297 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Instance destroyed successfully.
May 21 02:03:24.601191 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lazy-loading 'resources' on Instance uuid 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:03:24.604823 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:03:24.604823 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908', 'iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ca41e75f-27e1-4730-8d34-4d606a9c8908', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:03:24.604823 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:03:24.919480 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-883a1b56-89c0-4e3e-89cd-fb5306597f8e req-076954dd-ccf3-4351-a9c6-86eb8786dec2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:25.024100 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:25.084619 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Releasing lock "refresh_cache-ee14489e-8772-4a35-b7e7-760bc8f7f4ad" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:03:25.088256 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Instance network_info: |[{"id": "a0dd78aa-e6ea-44ca-a6a4-b819dafa6653", "address": "fa:16:3e:3f:55:7a", "network": {"id": "6d2e68f2-ff8f-41f5-accf-4865237c0702", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1863313078-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c5852e542a6f42ffb8e104daf741f872", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0dd78aa-e6", "ovs_interfaceid": "a0dd78aa-e6ea-44ca-a6a4-b819dafa6653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:03:25.088256 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Start _get_guest_xml network_info=[{"id": "a0dd78aa-e6ea-44ca-a6a4-b819dafa6653", "address": "fa:16:3e:3f:55:7a", "network": {"id": "6d2e68f2-ff8f-41f5-accf-4865237c0702", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1863313078-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c5852e542a6f42ffb8e104daf741f872", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0dd78aa-e6", "ovs_interfaceid": "a0dd78aa-e6ea-44ca-a6a4-b819dafa6653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:03:25.096107 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-883a1b56-89c0-4e3e-89cd-fb5306597f8e req-076954dd-ccf3-4351-a9c6-86eb8786dec2 service nova] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Updated VIF entry in instance network info cache for port c0e8bfdd-1ce7-47c4-a730-362b39289635. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:03:25.096400 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-883a1b56-89c0-4e3e-89cd-fb5306597f8e req-076954dd-ccf3-4351-a9c6-86eb8786dec2 service nova] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Updating instance_info_cache with network_info: [{"id": "c0e8bfdd-1ce7-47c4-a730-362b39289635", "address": "fa:16:3e:41:22:0a", "network": {"id": "101a7f52-26cc-4331-b0f1-02b8c890fb35", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1092866296-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb7bdb5c7bbb4465b12c92ffdd425114", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0e8bfdd-1c", "ovs_interfaceid": "c0e8bfdd-1ce7-47c4-a730-362b39289635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:03:25.101282 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:03:25.101282 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-ServersNegativeTestJSON-server-1073214439', uuid='ee14489e-8772-4a35-b7e7-760bc8f7f4ad'), owner=OwnerMeta(userid='9f1c1152331140f9b4acfc98d16623bc', username='tempest-ServersNegativeTestJSON-1944632598-project-member', projectid='c5852e542a6f42ffb8e104daf741f872', projectname='tempest-ServersNegativeTestJSON-1944632598'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a0dd78aa-e6ea-44ca-a6a4-b819dafa6653", "address": "fa:16:3e:3f:55:7a", "network": {"id": "6d2e68f2-ff8f-41f5-accf-4865237c0702", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1863313078-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c5852e542a6f42ffb8e104daf741f872", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0dd78aa-e6", "ovs_interfaceid": "a0dd78aa-e6ea-44ca-a6a4-b819dafa6653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329005.1005821) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:03:25.102238 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:03:25.102765 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:03:25.103982 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:01:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-2131771438',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testinstanceswithcindervolumes-server-2131771438',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2S6OkiVrrHfIqcpMEoA7FR3RHfcqi608TQs8IzVfXaDmpk0TGAbpW5WuJYdw49uIjsxViMzQYBEsjLt9OsVnNhNpokb32+C+Gg5x5HpNTJmss66tY7o5HzUCYkKowI4w==',key_name='tempest-TestInstancesWithCinderVolumes-314392276',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:01:55Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb7bdb5c7bbb4465b12c92ffdd425114',ramdisk_id='',reservation_id='r-0csmfz12',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_signature_verified='False',owner_project_name='tempest-TestInstancesWithCinderVolumes-1975993015',owner_user_name='tempest-TestInstancesWithCinderVolumes-1975993015-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:01:56Z,user_data=None,user_id='c14700a43e7e4c5eb6bbbbb14a135387',uuid=23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0e8bfdd-1ce7-47c4-a730-362b39289635", "address": "fa:16:3e:41:22:0a", "network": {"id": "101a7f52-26cc-4331-b0f1-02b8c890fb35", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1092866296-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb7bdb5c7bbb4465b12c92ffdd425114", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0e8bfdd-1c", "ovs_interfaceid": "c0e8bfdd-1ce7-47c4-a730-362b39289635", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:03:25.104172 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Converting VIF {"id": "c0e8bfdd-1ce7-47c4-a730-362b39289635", "address": "fa:16:3e:41:22:0a", "network": {"id": "101a7f52-26cc-4331-b0f1-02b8c890fb35", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1092866296-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb7bdb5c7bbb4465b12c92ffdd425114", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0e8bfdd-1c", "ovs_interfaceid": "c0e8bfdd-1ce7-47c4-a730-362b39289635", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:03:25.104828 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:22:0a,bridge_name='br-int',has_traffic_filtering=True,id=c0e8bfdd-1ce7-47c4-a730-362b39289635,network=Network(101a7f52-26cc-4331-b0f1-02b8c890fb35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0e8bfdd-1c') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:03:25.105045 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:22:0a,bridge_name='br-int',has_traffic_filtering=True,id=c0e8bfdd-1ce7-47c4-a730-362b39289635,network=Network(101a7f52-26cc-4331-b0f1-02b8c890fb35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0e8bfdd-1c') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:03:25.106383 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:25.107501 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0e8bfdd-1c, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:03:25.107659 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:25.108439 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:03:25.108831 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:03:25.111487 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:03:25.111487 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:03:25.111487 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:03:25.111487 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:03:25.111487 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:03:25.111487 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:03:25.111487 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:03:25.111487 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:03:25.111487 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:03:25.111487 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:03:25.111487 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:03:25.111487 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:03:25.111953 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:03:25.117495 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:25.120620 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:25.120810 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4a3ea9aa-9c10-4edf-89fe-82423dec2daf) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:03:25.121421 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:25.122012 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:03:25.124858 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:03:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1073214439',display_name='tempest-ServersNegativeTestJSON-server-1073214439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serversnegativetestjson-server-1073214439',id=34,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5852e542a6f42ffb8e104daf741f872',ramdisk_id='',reservation_id='r-aqyncd0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1944632598',owner_user_name='tempest-ServersNegativeTestJSON-1944632598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:03:21Z,user_data=None,user_id='9f1c1152331140f9b4acfc98d16623bc',uuid=ee14489e-8772-4a35-b7e7-760bc8f7f4ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0dd78aa-e6ea-44ca-a6a4-b819dafa6653", "address": "fa:16:3e:3f:55:7a", "network": {"id": "6d2e68f2-ff8f-41f5-accf-4865237c0702", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1863313078-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c5852e542a6f42ffb8e104daf741f872", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0dd78aa-e6", "ovs_interfaceid": "a0dd78aa-e6ea-44ca-a6a4-b819dafa6653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:03:25.125381 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Converting VIF {"id": "a0dd78aa-e6ea-44ca-a6a4-b819dafa6653", "address": "fa:16:3e:3f:55:7a", "network": {"id": "6d2e68f2-ff8f-41f5-accf-4865237c0702", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1863313078-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c5852e542a6f42ffb8e104daf741f872", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0dd78aa-e6", "ovs_interfaceid": "a0dd78aa-e6ea-44ca-a6a4-b819dafa6653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:03:25.125886 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:55:7a,bridge_name='br-int',has_traffic_filtering=True,id=a0dd78aa-e6ea-44ca-a6a4-b819dafa6653,network=Network(6d2e68f2-ff8f-41f5-accf-4865237c0702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0dd78aa-e6') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:03:25.126832 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:25.127589 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Lazy-loading 'pci_devices' on Instance uuid ee14489e-8772-4a35-b7e7-760bc8f7f4ad {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:03:25.129301 np0000001127 nova-compute[98206]: INFO os_vif [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:22:0a,bridge_name='br-int',has_traffic_filtering=True,id=c0e8bfdd-1ce7-47c4-a730-362b39289635,network=Network(101a7f52-26cc-4331-b0f1-02b8c890fb35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0e8bfdd-1c')
May 21 02:03:25.130762 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:03:25.131015 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6372443-59c0-4c3c-93a4-2dc76f1369e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:03:25.131183 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:03:25.156590 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:03:25.324014 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:03:25.324274 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:03:25.598859 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-883a1b56-89c0-4e3e-89cd-fb5306597f8e req-076954dd-ccf3-4351-a9c6-86eb8786dec2 service nova] Releasing lock "refresh_cache-23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:03:25.599434 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-883a1b56-89c0-4e3e-89cd-fb5306597f8e req-076954dd-ccf3-4351-a9c6-86eb8786dec2 service nova] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Received event network-changed-c0e8bfdd-1ce7-47c4-a730-362b39289635 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:25.599434 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-883a1b56-89c0-4e3e-89cd-fb5306597f8e req-076954dd-ccf3-4351-a9c6-86eb8786dec2 service nova] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Refreshing instance network info cache due to event network-changed-c0e8bfdd-1ce7-47c4-a730-362b39289635. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:03:25.599434 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-883a1b56-89c0-4e3e-89cd-fb5306597f8e req-076954dd-ccf3-4351-a9c6-86eb8786dec2 service nova] Acquiring lock "refresh_cache-23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:03:25.599434 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-883a1b56-89c0-4e3e-89cd-fb5306597f8e req-076954dd-ccf3-4351-a9c6-86eb8786dec2 service nova] Acquired lock "refresh_cache-23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:03:25.599434 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-883a1b56-89c0-4e3e-89cd-fb5306597f8e req-076954dd-ccf3-4351-a9c6-86eb8786dec2 service nova] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Refreshing network info cache for port c0e8bfdd-1ce7-47c4-a730-362b39289635 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:03:25.633500 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] End _get_guest_xml xml=<domain type="qemu">
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:   <uuid>ee14489e-8772-4a35-b7e7-760bc8f7f4ad</uuid>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:   <name>instance-00000022</name>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:       <nova:name>tempest-ServersNegativeTestJSON-server-1073214439</nova:name>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:03:25</nova:creationTime>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:         <nova:user uuid="9f1c1152331140f9b4acfc98d16623bc">tempest-ServersNegativeTestJSON-1944632598-project-member</nova:user>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:         <nova:project uuid="c5852e542a6f42ffb8e104daf741f872">tempest-ServersNegativeTestJSON-1944632598</nova:project>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:         <nova:port uuid="a0dd78aa-e6ea-44ca-a6a4-b819dafa6653">
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:     <system>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:       <entry name="serial">ee14489e-8772-4a35-b7e7-760bc8f7f4ad</entry>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:       <entry name="uuid">ee14489e-8772-4a35-b7e7-760bc8f7f4ad</entry>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:     </system>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:   <os>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:   </os>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:   <features>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:   </features>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:   <devices>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/ee14489e-8772-4a35-b7e7-760bc8f7f4ad/disk"/>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:     </disk>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/ee14489e-8772-4a35-b7e7-760bc8f7f4ad/disk.config"/>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:     </disk>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:3f:55:7a"/>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:       <target dev="tapa0dd78aa-e6"/>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:     </interface>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/ee14489e-8772-4a35-b7e7-760bc8f7f4ad/console.log" append="off"/>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:     </serial>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:     <video>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:     </video>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:     </rng>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:   </devices>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]: </domain>
May 21 02:03:25.633500 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:03:25.633500 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Preparing to wait for external event network-vif-plugged-a0dd78aa-e6ea-44ca-a6a4-b819dafa6653 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:03:25.633500 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Acquiring lock "ee14489e-8772-4a35-b7e7-760bc8f7f4ad-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:25.633500 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Lock "ee14489e-8772-4a35-b7e7-760bc8f7f4ad-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:25.633500 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Lock "ee14489e-8772-4a35-b7e7-760bc8f7f4ad-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:25.633500 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:03:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1073214439',display_name='tempest-ServersNegativeTestJSON-server-1073214439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serversnegativetestjson-server-1073214439',id=34,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5852e542a6f42ffb8e104daf741f872',ramdisk_id='',reservation_id='r-aqyncd0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1944632598',owner_user_name='tempest-ServersNegativeTestJSON-1944632598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:03:21Z,user_data=None,user_id='9f1c1152331140f9b4acfc98d16623bc',uuid=ee14489e-8772-4a35-b7e7-760bc8f7f4ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0dd78aa-e6ea-44ca-a6a4-b819dafa6653", "address": "fa:16:3e:3f:55:7a", "network": {"id": "6d2e68f2-ff8f-41f5-accf-4865237c0702", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1863313078-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c5852e542a6f42ffb8e104daf741f872", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0dd78aa-e6", "ovs_interfaceid": "a0dd78aa-e6ea-44ca-a6a4-b819dafa6653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:03:25.633500 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Converting VIF {"id": "a0dd78aa-e6ea-44ca-a6a4-b819dafa6653", "address": "fa:16:3e:3f:55:7a", "network": {"id": "6d2e68f2-ff8f-41f5-accf-4865237c0702", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1863313078-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c5852e542a6f42ffb8e104daf741f872", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0dd78aa-e6", "ovs_interfaceid": "a0dd78aa-e6ea-44ca-a6a4-b819dafa6653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:03:25.633500 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:55:7a,bridge_name='br-int',has_traffic_filtering=True,id=a0dd78aa-e6ea-44ca-a6a4-b819dafa6653,network=Network(6d2e68f2-ff8f-41f5-accf-4865237c0702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0dd78aa-e6') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:03:25.636325 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:55:7a,bridge_name='br-int',has_traffic_filtering=True,id=a0dd78aa-e6ea-44ca-a6a4-b819dafa6653,network=Network(6d2e68f2-ff8f-41f5-accf-4865237c0702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0dd78aa-e6') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:03:25.638615 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:25.638827 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:03:25.639328 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:03:25.640032 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:25.640248 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0c031fc3-7956-5c4b-8a98-16a81ac03f46', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:03:25.652689 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:25.653440 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:03:25.655769 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:25.655908 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0dd78aa-e6, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:03:25.656275 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa0dd78aa-e6, col_values=(('qos', UUID('17600660-89f3-4ca7-b0ad-5c5b2a851aeb')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:03:25.656435 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa0dd78aa-e6, col_values=(('external_ids', {'iface-id': 'a0dd78aa-e6ea-44ca-a6a4-b819dafa6653', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:55:7a', 'vm-uuid': 'ee14489e-8772-4a35-b7e7-760bc8f7f4ad'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:03:25.657236 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:25.658345 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:03:25.664674 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:25.666627 np0000001127 nova-compute[98206]: INFO os_vif [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:55:7a,bridge_name='br-int',has_traffic_filtering=True,id=a0dd78aa-e6ea-44ca-a6a4-b819dafa6653,network=Network(6d2e68f2-ff8f-41f5-accf-4865237c0702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0dd78aa-e6')
May 21 02:03:25.827481 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:03:26.101703 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-883a1b56-89c0-4e3e-89cd-fb5306597f8e req-076954dd-ccf3-4351-a9c6-86eb8786dec2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:26.176633 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Found WWN 330000000fa6d99f7 for multipath device dm-11 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:03:26.180026 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:03:26.180433 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '330000000fa6d99f7', 'path': '/dev/dm-11', 'multipath_id': '330000000fa6d99f7'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:03:26.180709 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000fa6d99f7', 'path': '/dev/dm-11', 'multipath_id': '330000000fa6d99f7'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:03:26.181014 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.327s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:03:26.181397 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:03:26.181568 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:03:26.184692 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lazy-loading 'flavor' on Instance uuid 8948a19b-9e7e-448d-b782-be58020b5320 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:03:26.218860 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:26.218860 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:26.218860 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:26.218860 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:26.218860 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:26.218860 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:26.218860 np0000001127 nova-compute[98206]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:26.218860 np0000001127 nova-compute[98206]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:26.218860 np0000001127 nova-compute[98206]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908 (non-flash)
May 21 02:03:26.218860 np0000001127 nova-compute[98206]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908 (non-flash)
May 21 02:03:26.218860 np0000001127 nova-compute[98206]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:03:26.218860 np0000001127 nova-compute[98206]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:03:26.218860 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:03:26.219210 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:26.219210 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:26.219210 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:26.219210 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:26.219210 np0000001127 nova-compute[98206]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:26.219210 np0000001127 nova-compute[98206]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0 (non-flash)
May 21 02:03:26.219210 np0000001127 nova-compute[98206]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:26.219210 np0000001127 nova-compute[98206]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:26.219210 np0000001127 nova-compute[98206]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908 (non-flash)
May 21 02:03:26.219210 np0000001127 nova-compute[98206]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908 (non-flash)
May 21 02:03:26.219210 np0000001127 nova-compute[98206]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:03:26.219210 np0000001127 nova-compute[98206]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:03:26.219210 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:03:26.219210 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', '56'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', '57'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', '70'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', '71'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', '78'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', '79'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908', '80'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908', '81'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a', '82'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a', '83')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:03:26.219519 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', '70')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:03:26.220731 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0', '71')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:03:26.221692 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c72e5c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0'): ({'sdi'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:03:26.221890 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Removing multipathed devices sdi, sdh {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:03:26.222103 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Flush multipath device 33000000066d115e2 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:03:26.256182 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:03:26.296337 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:03:26.334863 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.663s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:26.335522 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:03:26.348409 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:03:26.348665 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:03:26.351214 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:03:26.371529 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:03:26.371705 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:03:26.385687 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:26.409782 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-760f3fd0-7f52-4c10-a4ef-7090e29f6be3 req-e2dc4845-b6c3-43bd-a7ef-82a106978fbd service nova] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Received event network-vif-unplugged-c0e8bfdd-1ce7-47c4-a730-362b39289635 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:26.410210 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-760f3fd0-7f52-4c10-a4ef-7090e29f6be3 req-e2dc4845-b6c3-43bd-a7ef-82a106978fbd service nova] Acquiring lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:26.410425 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-760f3fd0-7f52-4c10-a4ef-7090e29f6be3 req-e2dc4845-b6c3-43bd-a7ef-82a106978fbd service nova] Lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:26.410618 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-760f3fd0-7f52-4c10-a4ef-7090e29f6be3 req-e2dc4845-b6c3-43bd-a7ef-82a106978fbd service nova] Lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:26.410809 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-760f3fd0-7f52-4c10-a4ef-7090e29f6be3 req-e2dc4845-b6c3-43bd-a7ef-82a106978fbd service nova] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] No waiting events found dispatching network-vif-unplugged-c0e8bfdd-1ce7-47c4-a730-362b39289635 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:03:26.410973 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-760f3fd0-7f52-4c10-a4ef-7090e29f6be3 req-e2dc4845-b6c3-43bd-a7ef-82a106978fbd service nova] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Received event network-vif-unplugged-c0e8bfdd-1ce7-47c4-a730-362b39289635 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:03:26.421758 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:26.426168 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0, portal: 192.168.40.100,3260]
May 21 02:03:26.426168 np0000001127 nova-compute[98206]: Logout of [sid: 70, target: iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0, portal: 192.168.40.100,3260] successful.
May 21 02:03:26.426168 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:26.453951 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:26.468927 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:26.494910 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-883a1b56-89c0-4e3e-89cd-fb5306597f8e req-076954dd-ccf3-4351-a9c6-86eb8786dec2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:26.507434 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 71, target: iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0, portal: 192.168.50.100,3260]
May 21 02:03:26.507434 np0000001127 nova-compute[98206]: Logout of [sid: 71, target: iqn.2023-03.storpool.com:os--volume-8af31b05-6a4c-4ca6-9039-35eb0ecf6fd0, portal: 192.168.50.100,3260] successful.
May 21 02:03:26.507434 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:26.530054 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:26.530294 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:03:26.530443 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] <== disconnect_volume: return (2676ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:03:26.530621 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:03:26.533853 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.929s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:03:26.534250 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908', 'iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ca41e75f-27e1-4730-8d34-4d606a9c8908', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:03:26.534373 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:03:26.574481 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:26.574481 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:26.574481 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:26.574481 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:26.574481 np0000001127 nova-compute[98206]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:26.574481 np0000001127 nova-compute[98206]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:26.574481 np0000001127 nova-compute[98206]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908 (non-flash)
May 21 02:03:26.574481 np0000001127 nova-compute[98206]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908 (non-flash)
May 21 02:03:26.574481 np0000001127 nova-compute[98206]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:03:26.574481 np0000001127 nova-compute[98206]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:03:26.574481 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:03:26.574992 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:26.574992 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:26.574992 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:26.574992 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:26.574992 np0000001127 nova-compute[98206]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:26.574992 np0000001127 nova-compute[98206]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:26.574992 np0000001127 nova-compute[98206]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908 (non-flash)
May 21 02:03:26.574992 np0000001127 nova-compute[98206]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908 (non-flash)
May 21 02:03:26.574992 np0000001127 nova-compute[98206]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:03:26.574992 np0000001127 nova-compute[98206]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:03:26.574992 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:03:26.574992 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', '56'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', '57'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', '78'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', '79'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908', '80'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908', '81'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a', '82'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a', '83')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:03:26.574992 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908', '80')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:03:26.576454 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908', '81')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:03:26.577656 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c5dbf60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908'): ({'sde'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:03:26.580005 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Removing multipathed devices sdd, sde {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:03:26.580005 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Flush multipath device 3300000006a55c993 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:03:26.610438 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:03:26.658287 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-883a1b56-89c0-4e3e-89cd-fb5306597f8e req-076954dd-ccf3-4351-a9c6-86eb8786dec2 service nova] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Updated VIF entry in instance network info cache for port c0e8bfdd-1ce7-47c4-a730-362b39289635. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:03:26.658661 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-883a1b56-89c0-4e3e-89cd-fb5306597f8e req-076954dd-ccf3-4351-a9c6-86eb8786dec2 service nova] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Updating instance_info_cache with network_info: [{"id": "c0e8bfdd-1ce7-47c4-a730-362b39289635", "address": "fa:16:3e:41:22:0a", "network": {"id": "101a7f52-26cc-4331-b0f1-02b8c890fb35", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1092866296-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb7bdb5c7bbb4465b12c92ffdd425114", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0e8bfdd-1c", "ovs_interfaceid": "c0e8bfdd-1ce7-47c4-a730-362b39289635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:03:26.661138 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:03:26.687526 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Attempting to attach volume 2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 02:03:26.688866 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] attach device xml: <disk type="block" device="disk">
May 21 02:03:26.688866 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:03:26.688866 np0000001127 nova-compute[98206]:   <alias name="ua-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a"/>
May 21 02:03:26.688866 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-11"/>
May 21 02:03:26.688866 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:03:26.688866 np0000001127 nova-compute[98206]:   <serial>2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a</serial>
May 21 02:03:26.688866 np0000001127 nova-compute[98206]: </disk>
May 21 02:03:26.688866 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 02:03:26.723224 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:03:26.724357 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:03:26.726424 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:03:26.746922 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:03:26.747247 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:03:26.761582 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:26.802202 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 80, target: iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908, portal: 192.168.40.100,3260]
May 21 02:03:26.802202 np0000001127 nova-compute[98206]: Logout of [sid: 80, target: iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908, portal: 192.168.40.100,3260] successful.
May 21 02:03:26.802202 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:26.823414 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:26.837847 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:26.843279 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:03:26.843453 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:03:26.843863 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:26.844365 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:26.877150 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 81, target: iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908, portal: 192.168.50.100,3260]
May 21 02:03:26.877150 np0000001127 nova-compute[98206]: Logout of [sid: 81, target: iqn.2023-03.storpool.com:os--volume-ca41e75f-27e1-4730-8d34-4d606a9c8908, portal: 192.168.50.100,3260] successful.
May 21 02:03:26.877150 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:26.899557 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:26.903502 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:03:26.903777 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] <== disconnect_volume: return (2299ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:03:26.903974 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:03:26.905215 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.774s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:03:26.905613 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6372443-59c0-4c3c-93a4-2dc76f1369e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:03:26.906694 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:03:26.942776 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1caa8b5626fb4e5988cc4c80fb335a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98d81a820544f078c16b171f1e8b65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:03:26.950344 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:26.950344 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:26.950344 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:26.950344 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:26.950344 np0000001127 nova-compute[98206]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:26.950344 np0000001127 nova-compute[98206]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:26.950344 np0000001127 nova-compute[98206]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:03:26.950344 np0000001127 nova-compute[98206]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:03:26.950344 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:03:26.950739 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:26.950739 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:03:26.950739 np0000001127 nova-compute[98206]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:26.950739 np0000001127 nova-compute[98206]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4 (non-flash)
May 21 02:03:26.950739 np0000001127 nova-compute[98206]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:26.950739 np0000001127 nova-compute[98206]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:03:26.950739 np0000001127 nova-compute[98206]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:03:26.950739 np0000001127 nova-compute[98206]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:03:26.950739 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:03:26.950739 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', '56'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', '57'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', '78'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', '79'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a', '82'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a', '83')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:03:26.951225 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', '56')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:03:26.952304 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4', '57')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:03:26.953126 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c73f4c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4'): ({'sdg'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:03:26.953337 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Removing multipathed devices sdg, sdf {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:03:26.958699 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Flush multipath device 33000000041b69012 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:03:27.015243 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:03:27.064149 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:03:27.108942 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:03:27.109098 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:03:27.110338 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:03:27.117070 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lazy-loading 'flavor' on Instance uuid df1fb869-23ef-48e0-b609-ce91c2540c2e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:03:27.127296 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:03:27.127481 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:03:27.141248 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:27.161184 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-883a1b56-89c0-4e3e-89cd-fb5306597f8e req-076954dd-ccf3-4351-a9c6-86eb8786dec2 service nova] Releasing lock "refresh_cache-23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:03:27.161457 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-883a1b56-89c0-4e3e-89cd-fb5306597f8e req-076954dd-ccf3-4351-a9c6-86eb8786dec2 service nova] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Received event network-vif-unplugged-a0dd78aa-e6ea-44ca-a6a4-b819dafa6653 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:27.161777 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-883a1b56-89c0-4e3e-89cd-fb5306597f8e req-076954dd-ccf3-4351-a9c6-86eb8786dec2 service nova] Acquiring lock "ee14489e-8772-4a35-b7e7-760bc8f7f4ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:27.161990 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-883a1b56-89c0-4e3e-89cd-fb5306597f8e req-076954dd-ccf3-4351-a9c6-86eb8786dec2 service nova] Lock "ee14489e-8772-4a35-b7e7-760bc8f7f4ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:27.162170 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-883a1b56-89c0-4e3e-89cd-fb5306597f8e req-076954dd-ccf3-4351-a9c6-86eb8786dec2 service nova] Lock "ee14489e-8772-4a35-b7e7-760bc8f7f4ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:27.162364 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-883a1b56-89c0-4e3e-89cd-fb5306597f8e req-076954dd-ccf3-4351-a9c6-86eb8786dec2 service nova] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] No event matching network-vif-unplugged-a0dd78aa-e6ea-44ca-a6a4-b819dafa6653 in dict_keys([('network-vif-plugged', 'a0dd78aa-e6ea-44ca-a6a4-b819dafa6653')]) {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 21 02:03:27.162593 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-883a1b56-89c0-4e3e-89cd-fb5306597f8e req-076954dd-ccf3-4351-a9c6-86eb8786dec2 service nova] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Received unexpected event network-vif-unplugged-a0dd78aa-e6ea-44ca-a6a4-b819dafa6653 for instance with vm_state building and task_state spawning.
May 21 02:03:27.183601 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:03:27.184496 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:03:27.184496 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] No VIF found with MAC fa:16:3e:3f:55:7a, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:03:27.185128 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4, portal: 192.168.40.100,3260]
May 21 02:03:27.185128 np0000001127 nova-compute[98206]: Logout of [sid: 56, target: iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4, portal: 192.168.40.100,3260] successful.
May 21 02:03:27.185128 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:27.186664 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Using config drive
May 21 02:03:27.205246 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:27.219320 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:27.265496 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4, portal: 192.168.50.100,3260]
May 21 02:03:27.265496 np0000001127 nova-compute[98206]: Logout of [sid: 57, target: iqn.2023-03.storpool.com:os--volume-e6372443-59c0-4c3c-93a4-2dc76f1369e4, portal: 192.168.50.100,3260] successful.
May 21 02:03:27.265496 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:27.282870 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:03:27.283110 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:03:27.283254 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] <== disconnect_volume: return (2151ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:03:27.283394 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:03:27.283669 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Deleting instance files /opt/stack/data/nova/instances/23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a_del
May 21 02:03:27.284257 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Deletion of /opt/stack/data/nova/instances/23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a_del complete
May 21 02:03:27.348691 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:03:27.475494 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lazy-loading 'flavor' on Instance uuid f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:03:27.556762 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Successfully created port: f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:03:27.694802 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:27.793244 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Took 3.74 seconds to destroy the instance on the hypervisor.
May 21 02:03:27.793884 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:03:27.794080 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:03:27.794157 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:03:27.794391 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:27.840141 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Creating config drive at /opt/stack/data/nova/instances/ee14489e-8772-4a35-b7e7-760bc8f7f4ad/disk.config
May 21 02:03:27.844279 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ee14489e-8772-4a35-b7e7-760bc8f7f4ad/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpme6l1r1i {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:27.860893 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:03:27.912506 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:27.915138 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ee14489e-8772-4a35-b7e7-760bc8f7f4ad/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpme6l1r1i" returned: 0 in 0.071s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:28.064882 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cf1d6811-8966-4eaf-8cda-98bd892f5b04 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "df1fb869-23ef-48e0-b609-ce91c2540c2e" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:28.125767 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9b6888a5-47a0-40fa-aeec-ab571089f89f tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.450s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:28.128901 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cf1d6811-8966-4eaf-8cda-98bd892f5b04 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.064s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:28.129271 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-cf1d6811-8966-4eaf-8cda-98bd892f5b04 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:03:28.133897 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-cf1d6811-8966-4eaf-8cda-98bd892f5b04 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98206) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 21 02:03:28.133897 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-cf1d6811-8966-4eaf-8cda-98bd892f5b04 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lazy-loading 'flavor' on Instance uuid df1fb869-23ef-48e0-b609-ce91c2540c2e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:03:28.217486 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Successfully updated port: f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:03:28.285345 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a15ec022-3288-4973-8160-be15670cc963 req-12e7ea7f-bca4-4a4d-91a0-b28573cbece4 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Received event network-changed-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:28.285484 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a15ec022-3288-4973-8160-be15670cc963 req-12e7ea7f-bca4-4a4d-91a0-b28573cbece4 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Refreshing instance network info cache due to event network-changed-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:03:28.285685 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a15ec022-3288-4973-8160-be15670cc963 req-12e7ea7f-bca4-4a4d-91a0-b28573cbece4 service nova] Acquiring lock "refresh_cache-76097fea-0890-40a8-a902-9f510cd34b52" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:03:28.285824 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a15ec022-3288-4973-8160-be15670cc963 req-12e7ea7f-bca4-4a4d-91a0-b28573cbece4 service nova] Acquired lock "refresh_cache-76097fea-0890-40a8-a902-9f510cd34b52" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:03:28.285932 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-a15ec022-3288-4973-8160-be15670cc963 req-12e7ea7f-bca4-4a4d-91a0-b28573cbece4 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Refreshing network info cache for port f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:03:28.377158 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:03:28.377340 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:03:28.377479 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:03:28.377624 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] No VIF found with MAC fa:16:3e:27:71:42, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:03:28.422489 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:28.447551 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:28.452607 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:28.489974 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a8cff0e7-2441-4338-aa9f-d060bf65c275 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.240s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:28.507014 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f4823e38-5663-4cb8-aee0-fa0a8b9661ca req-5d0c4679-3b4b-42e0-83f2-0023fda110f8 service nova] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Received event network-vif-deleted-c0e8bfdd-1ce7-47c4-a730-362b39289635 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:28.509555 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-f4823e38-5663-4cb8-aee0-fa0a8b9661ca req-5d0c4679-3b4b-42e0-83f2-0023fda110f8 service nova] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Neutron deleted interface c0e8bfdd-1ce7-47c4-a730-362b39289635; detaching it from the instance and deleting it from the info cache
May 21 02:03:28.509926 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-f4823e38-5663-4cb8-aee0-fa0a8b9661ca req-5d0c4679-3b4b-42e0-83f2-0023fda110f8 service nova] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:03:28.570292 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:28.712614 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:03:28.720093 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Acquiring lock "refresh_cache-76097fea-0890-40a8-a902-9f510cd34b52" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:03:28.730818 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4c99d291-9b16-4d83-b140-b7fa3ddcbb8c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:28.731053 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4c99d291-9b16-4d83-b140-b7fa3ddcbb8c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:28.732552 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4c99d291-9b16-4d83-b140-b7fa3ddcbb8c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:28.732552 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4c99d291-9b16-4d83-b140-b7fa3ddcbb8c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:28.732552 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4c99d291-9b16-4d83-b140-b7fa3ddcbb8c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:28.734543 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-4c99d291-9b16-4d83-b140-b7fa3ddcbb8c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Terminating instance
May 21 02:03:28.781663 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:28.786423 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:28.788849 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-a15ec022-3288-4973-8160-be15670cc963 req-12e7ea7f-bca4-4a4d-91a0-b28573cbece4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:28.797777 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:28.818828 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:28.878413 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:03:28.879579 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:03:28.881484 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Creating image(s)
May 21 02:03:28.881484 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Acquiring lock "/opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:28.881484 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "/opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:28.882518 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "/opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:28.883022 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:03:28.885787 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:03:28.887020 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:28.909315 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-a15ec022-3288-4973-8160-be15670cc963 req-12e7ea7f-bca4-4a4d-91a0-b28573cbece4 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:03:29.003304 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.116s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:29.003720 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:29.004129 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:29.004648 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:03:29.007065 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:03:29.007395 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:29.037979 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f4823e38-5663-4cb8-aee0-fa0a8b9661ca req-5d0c4679-3b4b-42e0-83f2-0023fda110f8 service nova] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Detach interface failed, port_id=c0e8bfdd-1ce7-47c4-a730-362b39289635, reason: Instance 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:03:29.096400 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-a15ec022-3288-4973-8160-be15670cc963 req-12e7ea7f-bca4-4a4d-91a0-b28573cbece4 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:03:29.101821 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.094s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:29.102351 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:29.179721 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk 1073741824" returned: 0 in 0.077s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:29.180247 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.176s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:29.180687 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:29.198531 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:29.211909 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:29.216086 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Took 1.42 seconds to deallocate network for instance.
May 21 02:03:29.238218 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-4c99d291-9b16-4d83-b140-b7fa3ddcbb8c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:03:29.239622 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:29.241949 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:29.277026 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:29.280848 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:29.298806 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.118s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:29.299481 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Checking if we can resize image /opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:03:29.300287 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:29.316639 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:29.319207 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:29.351277 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:29.355428 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:29.413064 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:29.413858 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Cannot resize image /opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:03:29.414244 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:03:29.414439 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Ensure instance console log exists: /opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:03:29.414788 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:29.415007 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:29.415150 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:29.466421 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329009.4660852, ee14489e-8772-4a35-b7e7-760bc8f7f4ad => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:03:29.466599 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] VM Started (Lifecycle Event)
May 21 02:03:29.600140 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a15ec022-3288-4973-8160-be15670cc963 req-12e7ea7f-bca4-4a4d-91a0-b28573cbece4 service nova] Releasing lock "refresh_cache-76097fea-0890-40a8-a902-9f510cd34b52" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:03:29.600847 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Acquired lock "refresh_cache-76097fea-0890-40a8-a902-9f510cd34b52" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:03:29.601116 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:03:29.604383 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:29.637786 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Instance destroyed successfully.
May 21 02:03:29.637786 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-cf1d6811-8966-4eaf-8cda-98bd892f5b04 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lazy-loading 'numa_topology' on Instance uuid df1fb869-23ef-48e0-b609-ce91c2540c2e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:03:29.642826 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:29.658106 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Instance destroyed successfully.
May 21 02:03:29.661874 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-4c99d291-9b16-4d83-b140-b7fa3ddcbb8c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lazy-loading 'resources' on Instance uuid f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:03:29.670020 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:29.801023 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Took 0.58 seconds to detach 1 volumes for instance.
May 21 02:03:29.958274 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a06df4c6-9c1e-4281-8f8e-4ec924fe326e tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "8948a19b-9e7e-448d-b782-be58020b5320" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.614s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:29.972493 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:03:29.975358 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329009.9749641, ee14489e-8772-4a35-b7e7-760bc8f7f4ad => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:03:29.975658 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] VM Paused (Lifecycle Event)
May 21 02:03:30.013569 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:30.029889 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:30.062853 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:30.078524 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:30.145983 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-cf1d6811-8966-4eaf-8cda-98bd892f5b04 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Object Instance<df1fb869-23ef-48e0-b609-ce91c2540c2e> lazy-loaded attributes: flavor,numa_topology {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:03:30.146269 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-cf1d6811-8966-4eaf-8cda-98bd892f5b04 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:03:30.168826 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-4c99d291-9b16-4d83-b140-b7fa3ddcbb8c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:02:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1467423404',display_name='tempest-TestEncryptedCinderVolumes-server-1467423404',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testencryptedcindervolumes-server-1467423404',id=31,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM6WR2DOYy/d7/xyZL4MwGC+7U4T14LZmtisTSWfALbAAji373atkb2fHTxPyq8LcgoIYQKL1p95NjhGrWTxF60KiYQkDlHCTfcYKgQqHoE8wmm7LAYOYH6x0LGCOFmMyw==',key_name='tempest-keypair-999591050',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:02:27Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='177bec65268546d2b899e09989183b6e',ramdisk_id='',reservation_id='r-2nv25p31',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-991116896',owner_user_name='tempest-TestEncryptedCinderVolumes-991116896-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:02:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0efcbc1b88f49989c9f6b6a7439f2c4',uuid=f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe51ab3c-f522-4909-912f-0ff45fd331b9", "address": "fa:16:3e:59:b4:d0", "network": {"id": "38d66f09-c738-4e79-9aeb-12e87e29f568", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-447420743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "177bec65268546d2b899e09989183b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe51ab3c-f5", "ovs_interfaceid": "fe51ab3c-f522-4909-912f-0ff45fd331b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:03:30.168826 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-4c99d291-9b16-4d83-b140-b7fa3ddcbb8c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Converting VIF {"id": "fe51ab3c-f522-4909-912f-0ff45fd331b9", "address": "fa:16:3e:59:b4:d0", "network": {"id": "38d66f09-c738-4e79-9aeb-12e87e29f568", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-447420743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "177bec65268546d2b899e09989183b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe51ab3c-f5", "ovs_interfaceid": "fe51ab3c-f522-4909-912f-0ff45fd331b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:03:30.169149 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-4c99d291-9b16-4d83-b140-b7fa3ddcbb8c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:b4:d0,bridge_name='br-int',has_traffic_filtering=True,id=fe51ab3c-f522-4909-912f-0ff45fd331b9,network=Network(38d66f09-c738-4e79-9aeb-12e87e29f568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe51ab3c-f5') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:03:30.169462 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-4c99d291-9b16-4d83-b140-b7fa3ddcbb8c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:b4:d0,bridge_name='br-int',has_traffic_filtering=True,id=fe51ab3c-f522-4909-912f-0ff45fd331b9,network=Network(38d66f09-c738-4e79-9aeb-12e87e29f568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe51ab3c-f5') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:03:30.171986 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:30.172350 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe51ab3c-f5, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:03:30.176407 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:30.180498 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:03:30.183270 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:30.187853 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:30.188073 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=74af7423-1ef6-4562-9739-baf836f002c3) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:03:30.189706 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:30.190239 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:03:30.196165 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:30.201504 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:30.207245 np0000001127 nova-compute[98206]: INFO os_vif [None req-4c99d291-9b16-4d83-b140-b7fa3ddcbb8c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:b4:d0,bridge_name='br-int',has_traffic_filtering=True,id=fe51ab3c-f522-4909-912f-0ff45fd331b9,network=Network(38d66f09-c738-4e79-9aeb-12e87e29f568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe51ab3c-f5')
May 21 02:03:30.207782 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-4c99d291-9b16-4d83-b140-b7fa3ddcbb8c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Deleting instance files /opt/stack/data/nova/instances/f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80_del
May 21 02:03:30.209145 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-4c99d291-9b16-4d83-b140-b7fa3ddcbb8c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Deletion of /opt/stack/data/nova/instances/f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80_del complete
May 21 02:03:30.221014 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:30.226375 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:30.261918 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:03:30.309191 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:30.310234 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:30.316562 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Rescuing
May 21 02:03:30.316562 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "refresh_cache-8948a19b-9e7e-448d-b782-be58020b5320" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:03:30.316562 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquired lock "refresh_cache-8948a19b-9e7e-448d-b782-be58020b5320" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:03:30.317056 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:03:30.368236 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Received event network-vif-plugged-a0dd78aa-e6ea-44ca-a6a4-b819dafa6653 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:30.368236 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] Acquiring lock "ee14489e-8772-4a35-b7e7-760bc8f7f4ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:30.368236 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] Lock "ee14489e-8772-4a35-b7e7-760bc8f7f4ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:30.368236 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] Lock "ee14489e-8772-4a35-b7e7-760bc8f7f4ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:30.368236 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Processing event network-vif-plugged-a0dd78aa-e6ea-44ca-a6a4-b819dafa6653 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:03:30.368236 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Received event network-vif-plugged-a0dd78aa-e6ea-44ca-a6a4-b819dafa6653 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:30.368236 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] Acquiring lock "ee14489e-8772-4a35-b7e7-760bc8f7f4ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:30.368236 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] Lock "ee14489e-8772-4a35-b7e7-760bc8f7f4ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:30.368236 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] Lock "ee14489e-8772-4a35-b7e7-760bc8f7f4ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:30.368236 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] No waiting events found dispatching network-vif-plugged-a0dd78aa-e6ea-44ca-a6a4-b819dafa6653 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:03:30.369015 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Received unexpected event network-vif-plugged-a0dd78aa-e6ea-44ca-a6a4-b819dafa6653 for instance with vm_state building and task_state spawning.
May 21 02:03:30.369015 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Received event network-vif-unplugged-fe51ab3c-f522-4909-912f-0ff45fd331b9 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:30.369015 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] Acquiring lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:30.369015 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] Lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:30.370166 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:03:30.370388 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] Lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:30.370593 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] No waiting events found dispatching network-vif-unplugged-fe51ab3c-f522-4909-912f-0ff45fd331b9 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:03:30.370778 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Received event network-vif-unplugged-fe51ab3c-f522-4909-912f-0ff45fd331b9 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:03:30.370943 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Received event network-vif-unplugged-fe51ab3c-f522-4909-912f-0ff45fd331b9 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:30.371222 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] Acquiring lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:30.371400 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] Lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:30.371567 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] Lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:30.371734 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] No waiting events found dispatching network-vif-unplugged-fe51ab3c-f522-4909-912f-0ff45fd331b9 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:03:30.371862 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Received event network-vif-unplugged-fe51ab3c-f522-4909-912f-0ff45fd331b9 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:03:30.371989 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Received event network-vif-plugged-fe51ab3c-f522-4909-912f-0ff45fd331b9 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:30.372229 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] Acquiring lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:30.372378 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] Lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:30.372522 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] Lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:30.372702 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] No waiting events found dispatching network-vif-plugged-fe51ab3c-f522-4909-912f-0ff45fd331b9 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:03:30.372961 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Received unexpected event network-vif-plugged-fe51ab3c-f522-4909-912f-0ff45fd331b9 for instance with vm_state active and task_state deleting.
May 21 02:03:30.373830 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Received event network-vif-plugged-fe51ab3c-f522-4909-912f-0ff45fd331b9 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:30.373984 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] Acquiring lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:30.374112 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] Lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:30.374226 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] Lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:30.374335 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] No waiting events found dispatching network-vif-plugged-fe51ab3c-f522-4909-912f-0ff45fd331b9 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:03:30.374456 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Received unexpected event network-vif-plugged-fe51ab3c-f522-4909-912f-0ff45fd331b9 for instance with vm_state active and task_state deleting.
May 21 02:03:30.375081 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Received event network-vif-unplugged-fe51ab3c-f522-4909-912f-0ff45fd331b9 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:30.375081 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] Acquiring lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:30.375081 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] Lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:30.375339 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] Lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:30.376851 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] No waiting events found dispatching network-vif-unplugged-fe51ab3c-f522-4909-912f-0ff45fd331b9 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:03:30.377045 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Received event network-vif-unplugged-fe51ab3c-f522-4909-912f-0ff45fd331b9 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:03:30.377045 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Received event network-vif-unplugged-fe51ab3c-f522-4909-912f-0ff45fd331b9 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:30.377898 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] Acquiring lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:30.378092 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] Lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:30.378232 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] Lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:30.378382 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] No waiting events found dispatching network-vif-unplugged-fe51ab3c-f522-4909-912f-0ff45fd331b9 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:03:30.378552 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cc3a2c8c-521e-46ab-b696-a5345d259503 req-baeced8f-86c1-4dd5-b46f-a9b135ed2902 service nova] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Received event network-vif-unplugged-fe51ab3c-f522-4909-912f-0ff45fd331b9 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:03:30.379210 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:03:30.381989 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Instance spawned successfully.
May 21 02:03:30.382358 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:03:30.478584 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:03:30.482495 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999749444999907 future=<Future at 0x71c0984bf410 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:03:30.482495 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999843800999997 future=<Future at 0x71c0586d58e0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:03:30.482495 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329010.4812617, ee14489e-8772-4a35-b7e7-760bc8f7f4ad => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:03:30.482495 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] VM Resumed (Lifecycle Event)
May 21 02:03:30.504438 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:30.585974 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0f93f5f3-bd07-4213-a686-ab4580fcb6a1 req-f59b5d29-110c-4870-a51b-8e4ff7634212 service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Received event network-vif-unplugged-397001b0-550b-43bb-8c99-269fa0d710bb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:30.586134 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0f93f5f3-bd07-4213-a686-ab4580fcb6a1 req-f59b5d29-110c-4870-a51b-8e4ff7634212 service nova] Acquiring lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:30.586417 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0f93f5f3-bd07-4213-a686-ab4580fcb6a1 req-f59b5d29-110c-4870-a51b-8e4ff7634212 service nova] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:30.586566 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0f93f5f3-bd07-4213-a686-ab4580fcb6a1 req-f59b5d29-110c-4870-a51b-8e4ff7634212 service nova] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:30.586941 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0f93f5f3-bd07-4213-a686-ab4580fcb6a1 req-f59b5d29-110c-4870-a51b-8e4ff7634212 service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] No waiting events found dispatching network-vif-unplugged-397001b0-550b-43bb-8c99-269fa0d710bb {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:03:30.587867 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-0f93f5f3-bd07-4213-a686-ab4580fcb6a1 req-f59b5d29-110c-4870-a51b-8e4ff7634212 service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Received unexpected event network-vif-unplugged-397001b0-550b-43bb-8c99-269fa0d710bb for instance with vm_state stopped and task_state None.
May 21 02:03:30.588117 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0f93f5f3-bd07-4213-a686-ab4580fcb6a1 req-f59b5d29-110c-4870-a51b-8e4ff7634212 service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Received event network-vif-unplugged-397001b0-550b-43bb-8c99-269fa0d710bb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:30.589237 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0f93f5f3-bd07-4213-a686-ab4580fcb6a1 req-f59b5d29-110c-4870-a51b-8e4ff7634212 service nova] Acquiring lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:30.589643 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0f93f5f3-bd07-4213-a686-ab4580fcb6a1 req-f59b5d29-110c-4870-a51b-8e4ff7634212 service nova] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:30.592760 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0f93f5f3-bd07-4213-a686-ab4580fcb6a1 req-f59b5d29-110c-4870-a51b-8e4ff7634212 service nova] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:30.592976 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0f93f5f3-bd07-4213-a686-ab4580fcb6a1 req-f59b5d29-110c-4870-a51b-8e4ff7634212 service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] No waiting events found dispatching network-vif-unplugged-397001b0-550b-43bb-8c99-269fa0d710bb {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:03:30.593138 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-0f93f5f3-bd07-4213-a686-ab4580fcb6a1 req-f59b5d29-110c-4870-a51b-8e4ff7634212 service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Received unexpected event network-vif-unplugged-397001b0-550b-43bb-8c99-269fa0d710bb for instance with vm_state stopped and task_state None.
May 21 02:03:30.655963 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cf1d6811-8966-4eaf-8cda-98bd892f5b04 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.527s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:30.660066 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Updating instance_info_cache with network_info: [{"id": "f11d80e2-4ef4-404d-9b12-4b33f3e9caa2", "address": "fa:16:3e:4b:b4:81", "network": {"id": "8f999b5c-800e-44f7-84c5-6eff98ea03cb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-569078034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e98d81a820544f078c16b171f1e8b65c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11d80e2-4e", "ovs_interfaceid": "f11d80e2-4ef4-404d-9b12-4b33f3e9caa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:03:30.722425 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-4c99d291-9b16-4d83-b140-b7fa3ddcbb8c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Took 1.48 seconds to destroy the instance on the hypervisor.
May 21 02:03:30.723236 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-4c99d291-9b16-4d83-b140-b7fa3ddcbb8c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:03:30.723612 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:03:30.723758 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:03:30.724017 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:30.821173 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:30.883583 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:30.891700 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:03:30.892267 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:03:30.892320 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:03:30.892627 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:03:30.893313 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:03:30.893706 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:03:30.984528 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:03:30.992337 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:03:31.066586 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:03:31.066897 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:03:31.162449 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Releasing lock "refresh_cache-76097fea-0890-40a8-a902-9f510cd34b52" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:03:31.162857 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Instance network_info: |[{"id": "f11d80e2-4ef4-404d-9b12-4b33f3e9caa2", "address": "fa:16:3e:4b:b4:81", "network": {"id": "8f999b5c-800e-44f7-84c5-6eff98ea03cb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-569078034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e98d81a820544f078c16b171f1e8b65c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11d80e2-4e", "ovs_interfaceid": "f11d80e2-4ef4-404d-9b12-4b33f3e9caa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:03:31.164731 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Start _get_guest_xml network_info=[{"id": "f11d80e2-4ef4-404d-9b12-4b33f3e9caa2", "address": "fa:16:3e:4b:b4:81", "network": {"id": "8f999b5c-800e-44f7-84c5-6eff98ea03cb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-569078034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e98d81a820544f078c16b171f1e8b65c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11d80e2-4e", "ovs_interfaceid": "f11d80e2-4ef4-404d-9b12-4b33f3e9caa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:03:31.168138 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:03:31.169370 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-1252242961', uuid='76097fea-0890-40a8-a902-9f510cd34b52'), owner=OwnerMeta(userid='1caa8b5626fb4e5988cc4c80fb335a00', username='tempest-ServerStableDeviceRescueTest-1611761335-project-member', projectid='e98d81a820544f078c16b171f1e8b65c', projectname='tempest-ServerStableDeviceRescueTest-1611761335'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f11d80e2-4ef4-404d-9b12-4b33f3e9caa2", "address": "fa:16:3e:4b:b4:81", "network": {"id": "8f999b5c-800e-44f7-84c5-6eff98ea03cb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-569078034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e98d81a820544f078c16b171f1e8b65c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11d80e2-4e", "ovs_interfaceid": "f11d80e2-4ef4-404d-9b12-4b33f3e9caa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329011.168998) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:03:31.170393 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:03:31.171719 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:03:31.171719 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:03:31.171884 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:03:31.174496 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:03:31.174496 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:03:31.174496 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:03:31.174496 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:03:31.174496 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:03:31.174496 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:03:31.174496 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:03:31.174496 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:03:31.174496 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:03:31.174496 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:03:31.174496 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:03:31.174496 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:03:31.186753 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:03:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1252242961',display_name='tempest-ServerStableDeviceRescueTest-server-1252242961',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serverstabledevicerescuetest-server-1252242961',id=35,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHXCzQMtcvcohxOdCdKixRwGu+ErSI1etxf94mKw3iE+m9xL8VE+MVuRtLXTemgUp3Ov8UZFqLioHdWgMENwGDRghzsJP56fHg3vEKwC2p9V2H3plwGhSr7x3Y5MpdP3g==',key_name='tempest-keypair-900990808',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e98d81a820544f078c16b171f1e8b65c',ramdisk_id='',reservation_id='r-0pmad0cj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1611761335',owner_user_name='tempest-ServerStableDeviceRescueTest-1611761335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:03:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1caa8b5626fb4e5988cc4c80fb335a00',uuid=76097fea-0890-40a8-a902-9f510cd34b52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f11d80e2-4ef4-404d-9b12-4b33f3e9caa2", "address": "fa:16:3e:4b:b4:81", "network": {"id": "8f999b5c-800e-44f7-84c5-6eff98ea03cb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-569078034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e98d81a820544f078c16b171f1e8b65c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11d80e2-4e", "ovs_interfaceid": "f11d80e2-4ef4-404d-9b12-4b33f3e9caa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:03:31.186753 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Converting VIF {"id": "f11d80e2-4ef4-404d-9b12-4b33f3e9caa2", "address": "fa:16:3e:4b:b4:81", "network": {"id": "8f999b5c-800e-44f7-84c5-6eff98ea03cb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-569078034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e98d81a820544f078c16b171f1e8b65c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11d80e2-4e", "ovs_interfaceid": "f11d80e2-4ef4-404d-9b12-4b33f3e9caa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:03:31.186753 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:b4:81,bridge_name='br-int',has_traffic_filtering=True,id=f11d80e2-4ef4-404d-9b12-4b33f3e9caa2,network=Network(8f999b5c-800e-44f7-84c5-6eff98ea03cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf11d80e2-4e') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:03:31.187320 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lazy-loading 'pci_devices' on Instance uuid 76097fea-0890-40a8-a902-9f510cd34b52 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:03:31.300026 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:31.399385 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Took 9.01 seconds to spawn the instance on the hypervisor.
May 21 02:03:31.403362 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:03:31.427367 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:31.496159 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:03:31.516241 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Updating instance_info_cache with network_info: [{"id": "9089f785-707f-4bb7-ac00-927fe747fcc5", "address": "fa:16:3e:27:71:42", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9089f785-70", "ovs_interfaceid": "9089f785-707f-4bb7-ac00-927fe747fcc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:03:31.571877 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:03:31.689855 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] End _get_guest_xml xml=<domain type="qemu">
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:   <uuid>76097fea-0890-40a8-a902-9f510cd34b52</uuid>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:   <name>instance-00000023</name>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1252242961</nova:name>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:03:31</nova:creationTime>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:         <nova:user uuid="1caa8b5626fb4e5988cc4c80fb335a00">tempest-ServerStableDeviceRescueTest-1611761335-project-member</nova:user>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:         <nova:project uuid="e98d81a820544f078c16b171f1e8b65c">tempest-ServerStableDeviceRescueTest-1611761335</nova:project>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:         <nova:port uuid="f11d80e2-4ef4-404d-9b12-4b33f3e9caa2">
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:     <system>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:       <entry name="serial">76097fea-0890-40a8-a902-9f510cd34b52</entry>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:       <entry name="uuid">76097fea-0890-40a8-a902-9f510cd34b52</entry>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:     </system>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:   <os>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:   </os>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:   <features>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:   </features>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:   <devices>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk"/>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:     </disk>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk.config"/>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:     </disk>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:4b:b4:81"/>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:       <target dev="tapf11d80e2-4e"/>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:     </interface>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/console.log" append="off"/>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:     </serial>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:     <video>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:     </video>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:     </rng>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:   </devices>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]: </domain>
May 21 02:03:31.689855 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:03:31.691789 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Preparing to wait for external event network-vif-plugged-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:03:31.691789 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Acquiring lock "76097fea-0890-40a8-a902-9f510cd34b52-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:31.691789 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "76097fea-0890-40a8-a902-9f510cd34b52-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:31.691789 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "76097fea-0890-40a8-a902-9f510cd34b52-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:31.691789 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:03:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1252242961',display_name='tempest-ServerStableDeviceRescueTest-server-1252242961',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serverstabledevicerescuetest-server-1252242961',id=35,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHXCzQMtcvcohxOdCdKixRwGu+ErSI1etxf94mKw3iE+m9xL8VE+MVuRtLXTemgUp3Ov8UZFqLioHdWgMENwGDRghzsJP56fHg3vEKwC2p9V2H3plwGhSr7x3Y5MpdP3g==',key_name='tempest-keypair-900990808',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e98d81a820544f078c16b171f1e8b65c',ramdisk_id='',reservation_id='r-0pmad0cj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1611761335',owner_user_name='tempest-ServerStableDeviceRescueTest-1611761335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:03:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1caa8b5626fb4e5988cc4c80fb335a00',uuid=76097fea-0890-40a8-a902-9f510cd34b52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f11d80e2-4ef4-404d-9b12-4b33f3e9caa2", "address": "fa:16:3e:4b:b4:81", "network": {"id": "8f999b5c-800e-44f7-84c5-6eff98ea03cb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-569078034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e98d81a820544f078c16b171f1e8b65c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11d80e2-4e", "ovs_interfaceid": "f11d80e2-4ef4-404d-9b12-4b33f3e9caa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:03:31.691789 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Converting VIF {"id": "f11d80e2-4ef4-404d-9b12-4b33f3e9caa2", "address": "fa:16:3e:4b:b4:81", "network": {"id": "8f999b5c-800e-44f7-84c5-6eff98ea03cb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-569078034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e98d81a820544f078c16b171f1e8b65c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11d80e2-4e", "ovs_interfaceid": "f11d80e2-4ef4-404d-9b12-4b33f3e9caa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:03:31.691789 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:b4:81,bridge_name='br-int',has_traffic_filtering=True,id=f11d80e2-4ef4-404d-9b12-4b33f3e9caa2,network=Network(8f999b5c-800e-44f7-84c5-6eff98ea03cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf11d80e2-4e') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:03:31.692146 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:b4:81,bridge_name='br-int',has_traffic_filtering=True,id=f11d80e2-4ef4-404d-9b12-4b33f3e9caa2,network=Network(8f999b5c-800e-44f7-84c5-6eff98ea03cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf11d80e2-4e') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:03:31.692146 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:31.692307 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:03:31.692478 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:03:31.693447 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:31.693614 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4420b3ba-ee56-5af2-9e92-ce27d5d89955', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:03:31.694359 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:31.695677 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:03:31.701009 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:31.703058 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:31.703231 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf11d80e2-4e, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:03:31.703529 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf11d80e2-4e, col_values=(('qos', UUID('c8f10512-83ea-4d09-9957-721169a0df51')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:03:31.703705 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf11d80e2-4e, col_values=(('external_ids', {'iface-id': 'f11d80e2-4ef4-404d-9b12-4b33f3e9caa2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:b4:81', 'vm-uuid': '76097fea-0890-40a8-a902-9f510cd34b52'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:03:31.704411 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:31.705686 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:03:31.719354 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:31.720413 np0000001127 nova-compute[98206]: INFO os_vif [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:b4:81,bridge_name='br-int',has_traffic_filtering=True,id=f11d80e2-4ef4-404d-9b12-4b33f3e9caa2,network=Network(8f999b5c-800e-44f7-84c5-6eff98ea03cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf11d80e2-4e')
May 21 02:03:31.930856 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Took 15.17 seconds to build instance.
May 21 02:03:31.992892 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:03:32.019197 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Releasing lock "refresh_cache-8948a19b-9e7e-448d-b782-be58020b5320" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:03:32.078538 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.768s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:32.150545 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Deleted allocations for instance 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a
May 21 02:03:32.166044 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lazy-loading 'flavor' on Instance uuid df1fb869-23ef-48e0-b609-ce91c2540c2e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:03:32.421585 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c4c75e50-1149-4ebb-b61a-eb9f263b84a5 req-cd15da18-f2c3-48ca-b8be-c916ecf8b7cf service nova] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Received event network-vif-deleted-fe51ab3c-f522-4909-912f-0ff45fd331b9 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:32.432309 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Lock "ee14489e-8772-4a35-b7e7-760bc8f7f4ad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.682s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:32.495491 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Took 1.77 seconds to deallocate network for instance.
May 21 02:03:32.671150 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "refresh_cache-df1fb869-23ef-48e0-b609-ce91c2540c2e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:03:32.671281 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquired lock "refresh_cache-df1fb869-23ef-48e0-b609-ce91c2540c2e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:03:32.671366 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:03:32.671559 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lazy-loading 'info_cache' on Instance uuid df1fb869-23ef-48e0-b609-ce91c2540c2e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:03:33.001241 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4c99d291-9b16-4d83-b140-b7fa3ddcbb8c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:33.002064 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4c99d291-9b16-4d83-b140-b7fa3ddcbb8c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:33.160593 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-012b4b10-1fa2-40d7-ae8a-a20cfe02b54b tempest-TestInstancesWithCinderVolumes-1975993015 tempest-TestInstancesWithCinderVolumes-1975993015-project-member] Lock "23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.756s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:33.174211 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Object Instance<df1fb869-23ef-48e0-b609-ce91c2540c2e> lazy-loaded attributes: flavor,info_cache {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:03:33.240514 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:03:33.240514 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:03:33.240514 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] No VIF found with MAC fa:16:3e:4b:b4:81, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:03:33.240514 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Using config drive
May 21 02:03:33.494159 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4c99d291-9b16-4d83-b140-b7fa3ddcbb8c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:03:33.494329 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-4c99d291-9b16-4d83-b140-b7fa3ddcbb8c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:03:33.676538 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:33.699103 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:33.705277 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:33.736750 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:33.752281 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:33.913596 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:33.934869 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:33.953624 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-082bbbab-d545-4348-855b-d785c6402d94 req-4491c6fa-6f31-42a8-93c9-bd96356c0dd8 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Received event network-vif-unplugged-9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:33.953807 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-082bbbab-d545-4348-855b-d785c6402d94 req-4491c6fa-6f31-42a8-93c9-bd96356c0dd8 service nova] Acquiring lock "8948a19b-9e7e-448d-b782-be58020b5320-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:33.954031 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-082bbbab-d545-4348-855b-d785c6402d94 req-4491c6fa-6f31-42a8-93c9-bd96356c0dd8 service nova] Lock "8948a19b-9e7e-448d-b782-be58020b5320-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:33.954081 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-082bbbab-d545-4348-855b-d785c6402d94 req-4491c6fa-6f31-42a8-93c9-bd96356c0dd8 service nova] Lock "8948a19b-9e7e-448d-b782-be58020b5320-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:33.954181 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-082bbbab-d545-4348-855b-d785c6402d94 req-4491c6fa-6f31-42a8-93c9-bd96356c0dd8 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] No waiting events found dispatching network-vif-unplugged-9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:03:33.954283 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-082bbbab-d545-4348-855b-d785c6402d94 req-4491c6fa-6f31-42a8-93c9-bd96356c0dd8 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Received unexpected event network-vif-unplugged-9089f785-707f-4bb7-ac00-927fe747fcc5 for instance with vm_state active and task_state rescuing.
May 21 02:03:34.000572 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-4c99d291-9b16-4d83-b140-b7fa3ddcbb8c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:03:34.006228 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Acquiring lock "8411461f-7376-4907-a1ad-59b31e520f56" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:34.007071 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Lock "8411461f-7376-4907-a1ad-59b31e520f56" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.006s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:34.025328 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.99909249700022 future=<Future at 0x71c07c52a960 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:03:34.033692 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Creating config drive at /opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk.config
May 21 02:03:34.036049 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Instance destroyed successfully.
May 21 02:03:34.036788 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lazy-loading 'numa_topology' on Instance uuid 8948a19b-9e7e-448d-b782-be58020b5320 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:03:34.056166 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplkf0m74q {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:34.116274 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplkf0m74q" returned: 0 in 0.060s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:34.219778 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:34.376598 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Updating instance_info_cache with network_info: [{"id": "397001b0-550b-43bb-8c99-269fa0d710bb", "address": "fa:16:3e:f4:b7:59", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397001b0-55", "ovs_interfaceid": "397001b0-550b-43bb-8c99-269fa0d710bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:03:34.510187 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4c99d291-9b16-4d83-b140-b7fa3ddcbb8c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.509s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:34.515154 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:03:34.544784 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Attempting rescue
May 21 02:03:34.545770 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98206) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 21 02:03:34.554247 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Instance directory exists: not creating {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 21 02:03:34.554247 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Creating image(s)
May 21 02:03:34.554247 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "/opt/stack/data/nova/instances/8948a19b-9e7e-448d-b782-be58020b5320/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:34.554247 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "/opt/stack/data/nova/instances/8948a19b-9e7e-448d-b782-be58020b5320/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:34.554247 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "/opt/stack/data/nova/instances/8948a19b-9e7e-448d-b782-be58020b5320/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:34.554247 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8948a19b-9e7e-448d-b782-be58020b5320 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:03:34.585743 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-4c99d291-9b16-4d83-b140-b7fa3ddcbb8c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Deleted allocations for instance f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80
May 21 02:03:34.620180 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:34.655097 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:34.776607 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:34.865572 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6bae0d7b-4bf7-4251-881c-b0cee4b09d08 req-2cd27e0f-20b0-4fbc-b5fc-392cce3043b8 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Received event network-vif-plugged-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:34.865866 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6bae0d7b-4bf7-4251-881c-b0cee4b09d08 req-2cd27e0f-20b0-4fbc-b5fc-392cce3043b8 service nova] Acquiring lock "76097fea-0890-40a8-a902-9f510cd34b52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:34.866214 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6bae0d7b-4bf7-4251-881c-b0cee4b09d08 req-2cd27e0f-20b0-4fbc-b5fc-392cce3043b8 service nova] Lock "76097fea-0890-40a8-a902-9f510cd34b52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:34.866365 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6bae0d7b-4bf7-4251-881c-b0cee4b09d08 req-2cd27e0f-20b0-4fbc-b5fc-392cce3043b8 service nova] Lock "76097fea-0890-40a8-a902-9f510cd34b52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:34.866507 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6bae0d7b-4bf7-4251-881c-b0cee4b09d08 req-2cd27e0f-20b0-4fbc-b5fc-392cce3043b8 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Processing event network-vif-plugged-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:03:34.883705 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Releasing lock "refresh_cache-df1fb869-23ef-48e0-b609-ce91c2540c2e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:03:35.009414 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:35.028231 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:35.055610 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Object Instance<8948a19b-9e7e-448d-b782-be58020b5320> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:03:35.057058 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:03:35.061899 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:03:35.063115 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:35.064743 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:35.064743 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:35.066044 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:03:35.070956 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:03:35.071780 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:35.098970 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:35.130492 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:35.131046 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:35.138083 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:03:35.139591 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Claim successful on node np0000001127
May 21 02:03:35.199595 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.127s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:35.200280 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/8948a19b-9e7e-448d-b782-be58020b5320/disk.rescue {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:35.277375 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/8948a19b-9e7e-448d-b782-be58020b5320/disk.rescue" returned: 0 in 0.077s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:35.280421 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:35.280421 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lazy-loading 'migration_context' on Instance uuid 8948a19b-9e7e-448d-b782-be58020b5320 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:03:35.612297 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4c99d291-9b16-4d83-b140-b7fa3ddcbb8c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.881s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:35.630853 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329015.6304123, 76097fea-0890-40a8-a902-9f510cd34b52 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:03:35.631050 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] VM Started (Lifecycle Event)
May 21 02:03:35.633039 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:03:35.637396 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:03:35.641863 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Instance spawned successfully.
May 21 02:03:35.642258 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:03:35.783072 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Object Instance<8948a19b-9e7e-448d-b782-be58020b5320> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:03:35.783446 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:03:35.784114 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Start _get_guest_xml network_info=[{"id": "9089f785-707f-4bb7-ac00-927fe747fcc5", "address": "fa:16:3e:27:71:42", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "vif_mac": "fa:16:3e:27:71:42"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9089f785-70", "ovs_interfaceid": "9089f785-707f-4bb7-ac00-927fe747fcc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1545019a-a9af-4414-b299-e8f325be0886', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:03:35.784308 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lazy-loading 'resources' on Instance uuid 8948a19b-9e7e-448d-b782-be58020b5320 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:03:35.900601 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Instance destroyed successfully.
May 21 02:03:35.900983 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lazy-loading 'numa_topology' on Instance uuid df1fb869-23ef-48e0-b609-ce91c2540c2e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:03:36.023870 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-299d3be2-45c6-45f5-80db-a521a292099f req-90fc4aa9-07f3-4909-8774-1520e08282de service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Received event network-vif-unplugged-9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:36.024178 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-299d3be2-45c6-45f5-80db-a521a292099f req-90fc4aa9-07f3-4909-8774-1520e08282de service nova] Acquiring lock "8948a19b-9e7e-448d-b782-be58020b5320-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:36.024310 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-299d3be2-45c6-45f5-80db-a521a292099f req-90fc4aa9-07f3-4909-8774-1520e08282de service nova] Lock "8948a19b-9e7e-448d-b782-be58020b5320-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:36.026483 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-299d3be2-45c6-45f5-80db-a521a292099f req-90fc4aa9-07f3-4909-8774-1520e08282de service nova] Lock "8948a19b-9e7e-448d-b782-be58020b5320-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:36.026483 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-299d3be2-45c6-45f5-80db-a521a292099f req-90fc4aa9-07f3-4909-8774-1520e08282de service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] No waiting events found dispatching network-vif-unplugged-9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:03:36.026483 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-299d3be2-45c6-45f5-80db-a521a292099f req-90fc4aa9-07f3-4909-8774-1520e08282de service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Received unexpected event network-vif-unplugged-9089f785-707f-4bb7-ac00-927fe747fcc5 for instance with vm_state active and task_state rescuing.
May 21 02:03:36.134327 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:03:36.136160 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:03:36.160740 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:03:36.160906 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:03:36.161319 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:03:36.161730 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:03:36.162044 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:03:36.162342 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:03:36.286876 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Object Instance<8948a19b-9e7e-448d-b782-be58020b5320> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:03:36.289037 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:03:36.290092 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-211968432', uuid='8948a19b-9e7e-448d-b782-be58020b5320'), owner=OwnerMeta(userid='8b5074a8e47b444cb19c7dcf761ac2ae', username='tempest-ServerRescueNegativeTestJSON-1108613901-project-member', projectid='87eb25eb23724c49b5bdbc462a1f36bc', projectname='tempest-ServerRescueNegativeTestJSON-1108613901'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9089f785-707f-4bb7-ac00-927fe747fcc5", "address": "fa:16:3e:27:71:42", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "vif_mac": "fa:16:3e:27:71:42"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9089f785-70", "ovs_interfaceid": "9089f785-707f-4bb7-ac00-927fe747fcc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329016.2898) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:03:36.290985 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:03:36.291303 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:03:36.291986 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:03:36.292167 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:03:36.293125 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:03:36.293437 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:03:36.293668 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:03:36.293744 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:03:36.293909 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:03:36.293987 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:03:36.294078 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:03:36.294208 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:03:36.294305 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:03:36.294401 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:03:36.294529 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:03:36.294660 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:03:36.294758 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8948a19b-9e7e-448d-b782-be58020b5320 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:03:36.403937 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Object Instance<df1fb869-23ef-48e0-b609-ce91c2540c2e> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:03:36.404331 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lazy-loading 'resources' on Instance uuid df1fb869-23ef-48e0-b609-ce91c2540c2e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:03:36.429202 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:36.638729 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:03:36.639031 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329016.6388292, 76097fea-0890-40a8-a902-9f510cd34b52 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:03:36.639195 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] VM Paused (Lifecycle Event)
May 21 02:03:36.667289 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Took 7.79 seconds to spawn the instance on the hypervisor.
May 21 02:03:36.668018 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:03:36.704812 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:36.789892 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:03:36.790137 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:03:36.796502 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Object Instance<8948a19b-9e7e-448d-b782-be58020b5320> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:03:36.812164 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:02:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-211968432',display_name='tempest-ServerRescueNegativeTestJSON-server-211968432',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serverrescuenegativetestjson-server-211968432',id=32,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFx9wnklHgIW/7mX/mDP0Acf71gIHeOJ42Z6/jd1Qb5TRL5dzkGcgjJOewbr4VJwvfK5/AZfylhiEzVdL+ykfazuitFbm4WyjJZfeHI3do3V/FnUZD7DAaZ4ri/2MlV9dQ==',key_name='tempest-keypair-1008477287',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:02:41Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87eb25eb23724c49b5bdbc462a1f36bc',ramdisk_id='',reservation_id='r-0isusuuj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1108613901',owner_user_name='tempest-ServerRescueNegativeTestJSON-1108613901-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:02:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b5074a8e47b444cb19c7dcf761ac2ae',uuid=8948a19b-9e7e-448d-b782-be58020b5320,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9089f785-707f-4bb7-ac00-927fe747fcc5", "address": "fa:16:3e:27:71:42", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "vif_mac": "fa:16:3e:27:71:42"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9089f785-70", "ovs_interfaceid": "9089f785-707f-4bb7-ac00-927fe747fcc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:03:36.812396 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Converting VIF {"id": "9089f785-707f-4bb7-ac00-927fe747fcc5", "address": "fa:16:3e:27:71:42", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "vif_mac": "fa:16:3e:27:71:42"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9089f785-70", "ovs_interfaceid": "9089f785-707f-4bb7-ac00-927fe747fcc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:03:36.813152 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:71:42,bridge_name='br-int',has_traffic_filtering=True,id=9089f785-707f-4bb7-ac00-927fe747fcc5,network=Network(b8fcc592-f44d-440d-b1f1-c57714291c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9089f785-70') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:03:36.813968 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lazy-loading 'pci_devices' on Instance uuid 8948a19b-9e7e-448d-b782-be58020b5320 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:03:36.906076 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Object Instance<df1fb869-23ef-48e0-b609-ce91c2540c2e> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:03:36.906842 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:01:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1160366387',display_name='tempest-AttachVolumeTestJSON-server-1160366387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumetestjson-server-1160366387',id=27,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAujiHJsmhJMgEmRnWv5ymFbZbTAYncvgq9NsMeC8MiZ8la1gTOga8PrdaHkWknChauf3EhimnVrbr35Cl923XBy1BnVqXrs2rMVao3ITr2vCMWLpWOxbYc5JhA+8oEsw==',key_name='tempest-keypair-1825862747',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:01:35Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e80cee8643f34f6685ff7fb42920afc3',ramdisk_id='',reservation_id='r-td2yddno',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2050140136',owner_user_name='tempest-AttachVolumeTestJSON-2050140136-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:03:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='640fad0f3dfe4ee99b04c12c2b8fd9dd',uuid=df1fb869-23ef-48e0-b609-ce91c2540c2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "397001b0-550b-43bb-8c99-269fa0d710bb", "address": "fa:16:3e:f4:b7:59", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397001b0-55", "ovs_interfaceid": "397001b0-550b-43bb-8c99-269fa0d710bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:03:36.907060 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Converting VIF {"id": "397001b0-550b-43bb-8c99-269fa0d710bb", "address": "fa:16:3e:f4:b7:59", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397001b0-55", "ovs_interfaceid": "397001b0-550b-43bb-8c99-269fa0d710bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:03:36.907626 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:b7:59,bridge_name='br-int',has_traffic_filtering=True,id=397001b0-550b-43bb-8c99-269fa0d710bb,network=Network(70a21e20-dfdf-49b9-bfd2-75a1f49c8a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397001b0-55') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:03:36.907911 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:b7:59,bridge_name='br-int',has_traffic_filtering=True,id=397001b0-550b-43bb-8c99-269fa0d710bb,network=Network(70a21e20-dfdf-49b9-bfd2-75a1f49c8a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397001b0-55') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:03:36.909086 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:36.909310 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap397001b0-55, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:03:36.916190 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:36.918101 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:03:36.926052 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:36.928761 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:36.928923 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0845bbc5-fbc0-4cdf-aa3c-817cf15510c5) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:03:36.929745 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:36.930182 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:03:36.937783 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:36.940608 np0000001127 nova-compute[98206]: INFO os_vif [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:b7:59,bridge_name='br-int',has_traffic_filtering=True,id=397001b0-550b-43bb-8c99-269fa0d710bb,network=Network(70a21e20-dfdf-49b9-bfd2-75a1f49c8a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397001b0-55')
May 21 02:03:36.945633 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a9fb68c6-6a4c-424c-b86a-2a19652c05fa req-821caacf-69ed-4e30-9d02-03743bcd4674 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Received event network-vif-plugged-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:36.946341 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a9fb68c6-6a4c-424c-b86a-2a19652c05fa req-821caacf-69ed-4e30-9d02-03743bcd4674 service nova] Acquiring lock "76097fea-0890-40a8-a902-9f510cd34b52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:36.946781 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a9fb68c6-6a4c-424c-b86a-2a19652c05fa req-821caacf-69ed-4e30-9d02-03743bcd4674 service nova] Lock "76097fea-0890-40a8-a902-9f510cd34b52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:36.950143 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a9fb68c6-6a4c-424c-b86a-2a19652c05fa req-821caacf-69ed-4e30-9d02-03743bcd4674 service nova] Lock "76097fea-0890-40a8-a902-9f510cd34b52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:36.950818 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Start _get_guest_xml network_info=[{"id": "397001b0-550b-43bb-8c99-269fa0d710bb", "address": "fa:16:3e:f4:b7:59", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397001b0-55", "ovs_interfaceid": "397001b0-550b-43bb-8c99-269fa0d710bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:03:36.951131 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a9fb68c6-6a4c-424c-b86a-2a19652c05fa req-821caacf-69ed-4e30-9d02-03743bcd4674 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] No waiting events found dispatching network-vif-plugged-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:03:36.951260 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-a9fb68c6-6a4c-424c-b86a-2a19652c05fa req-821caacf-69ed-4e30-9d02-03743bcd4674 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Received unexpected event network-vif-plugged-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 for instance with vm_state active and task_state None.
May 21 02:03:36.957406 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:03:36.957406 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-1160366387', uuid='df1fb869-23ef-48e0-b609-ce91c2540c2e'), owner=OwnerMeta(userid='640fad0f3dfe4ee99b04c12c2b8fd9dd', username='tempest-AttachVolumeTestJSON-2050140136-project-member', projectid='e80cee8643f34f6685ff7fb42920afc3', projectname='tempest-AttachVolumeTestJSON-2050140136'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "397001b0-550b-43bb-8c99-269fa0d710bb", "address": "fa:16:3e:f4:b7:59", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397001b0-55", "ovs_interfaceid": "397001b0-550b-43bb-8c99-269fa0d710bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329016.9560616) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:03:36.958356 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:03:36.958762 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:03:36.960075 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:03:36.960075 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:03:36.960925 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:03:36.960925 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:03:36.961052 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:03:36.961195 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:03:36.961384 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:03:36.961547 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:03:36.961717 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:03:36.961919 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:03:36.962079 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:03:36.962238 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:03:36.962737 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:03:36.962737 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:03:36.962737 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lazy-loading 'vcpu_model' on Instance uuid df1fb869-23ef-48e0-b609-ce91c2540c2e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:03:37.141849 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:03:37.143717 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329017.1434798, 76097fea-0890-40a8-a902-9f510cd34b52 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:03:37.143855 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] VM Resumed (Lifecycle Event)
May 21 02:03:37.179408 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Took 13.56 seconds to build instance.
May 21 02:03:37.296275 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:03:37.315899 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Object Instance<8948a19b-9e7e-448d-b782-be58020b5320> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:03:37.317395 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] End _get_guest_xml xml=<domain type="qemu">
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:   <uuid>8948a19b-9e7e-448d-b782-be58020b5320</uuid>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:   <name>instance-00000020</name>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-211968432</nova:name>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:03:36</nova:creationTime>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:           <nova:property name="hw_machine_type">pc</nova:property>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:           <nova:property name="hw_video_model">virtio</nova:property>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:         <nova:user uuid="8b5074a8e47b444cb19c7dcf761ac2ae">tempest-ServerRescueNegativeTestJSON-1108613901-project-member</nova:user>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:         <nova:project uuid="87eb25eb23724c49b5bdbc462a1f36bc">tempest-ServerRescueNegativeTestJSON-1108613901</nova:project>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:         <nova:port uuid="9089f785-707f-4bb7-ac00-927fe747fcc5">
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:     <system>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:       <entry name="serial">8948a19b-9e7e-448d-b782-be58020b5320</entry>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:       <entry name="uuid">8948a19b-9e7e-448d-b782-be58020b5320</entry>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:     </system>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:   <os>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:   </os>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:   <features>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:   </features>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:   <devices>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/8948a19b-9e7e-448d-b782-be58020b5320/disk.rescue"/>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:     </disk>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/8948a19b-9e7e-448d-b782-be58020b5320/disk"/>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:       <target dev="vdb" bus="virtio"/>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:     </disk>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/8948a19b-9e7e-448d-b782-be58020b5320/disk.config.rescue"/>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:     </disk>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:27:71:42"/>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:       <target dev="tap9089f785-70"/>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:     </interface>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/8948a19b-9e7e-448d-b782-be58020b5320/console.log" append="off"/>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:     </serial>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:     <video>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:     </video>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:     </rng>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:   </devices>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]: </domain>
May 21 02:03:37.317395 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:03:37.328141 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Instance destroyed successfully.
May 21 02:03:37.466138 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Object Instance<df1fb869-23ef-48e0-b609-ce91c2540c2e> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:03:37.482299 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:01:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1160366387',display_name='tempest-AttachVolumeTestJSON-server-1160366387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumetestjson-server-1160366387',id=27,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAujiHJsmhJMgEmRnWv5ymFbZbTAYncvgq9NsMeC8MiZ8la1gTOga8PrdaHkWknChauf3EhimnVrbr35Cl923XBy1BnVqXrs2rMVao3ITr2vCMWLpWOxbYc5JhA+8oEsw==',key_name='tempest-keypair-1825862747',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:01:35Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e80cee8643f34f6685ff7fb42920afc3',ramdisk_id='',reservation_id='r-td2yddno',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2050140136',owner_user_name='tempest-AttachVolumeTestJSON-2050140136-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:03:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='640fad0f3dfe4ee99b04c12c2b8fd9dd',uuid=df1fb869-23ef-48e0-b609-ce91c2540c2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "397001b0-550b-43bb-8c99-269fa0d710bb", "address": "fa:16:3e:f4:b7:59", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397001b0-55", "ovs_interfaceid": "397001b0-550b-43bb-8c99-269fa0d710bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:03:37.482641 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Converting VIF {"id": "397001b0-550b-43bb-8c99-269fa0d710bb", "address": "fa:16:3e:f4:b7:59", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397001b0-55", "ovs_interfaceid": "397001b0-550b-43bb-8c99-269fa0d710bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:03:37.483338 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:b7:59,bridge_name='br-int',has_traffic_filtering=True,id=397001b0-550b-43bb-8c99-269fa0d710bb,network=Network(70a21e20-dfdf-49b9-bfd2-75a1f49c8a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397001b0-55') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:03:37.484347 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lazy-loading 'pci_devices' on Instance uuid df1fb869-23ef-48e0-b609-ce91c2540c2e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:03:37.646175 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:03:37.649745 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:03:37.681108 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "76097fea-0890-40a8-a902-9f510cd34b52" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.069s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:37.807636 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.674s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:37.807636 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:03:37.986032 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Object Instance<df1fb869-23ef-48e0-b609-ce91c2540c2e> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:03:37.987222 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] End _get_guest_xml xml=<domain type="qemu">
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:   <uuid>df1fb869-23ef-48e0-b609-ce91c2540c2e</uuid>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:   <name>instance-0000001b</name>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:       <nova:name>tempest-AttachVolumeTestJSON-server-1160366387</nova:name>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:03:36</nova:creationTime>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:           <nova:property name="hw_machine_type">pc</nova:property>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:           <nova:property name="hw_video_model">virtio</nova:property>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:         <nova:user uuid="640fad0f3dfe4ee99b04c12c2b8fd9dd">tempest-AttachVolumeTestJSON-2050140136-project-member</nova:user>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:         <nova:project uuid="e80cee8643f34f6685ff7fb42920afc3">tempest-AttachVolumeTestJSON-2050140136</nova:project>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:         <nova:port uuid="397001b0-550b-43bb-8c99-269fa0d710bb">
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:     <system>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:       <entry name="serial">df1fb869-23ef-48e0-b609-ce91c2540c2e</entry>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:       <entry name="uuid">df1fb869-23ef-48e0-b609-ce91c2540c2e</entry>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:     </system>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:   <os>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:   </os>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:   <features>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:   </features>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:   <devices>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk"/>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:     </disk>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk.config"/>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:     </disk>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:f4:b7:59"/>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:       <target dev="tap397001b0-55"/>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:     </interface>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/console.log" append="off"/>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:     </serial>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:     <video>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:     </video>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:     </rng>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:   </devices>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]: </domain>
May 21 02:03:37.987222 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:03:37.989102 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:38.095791 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:38.096313 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:38.206858 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:38.207885 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lazy-loading 'trusted_certs' on Instance uuid df1fb869-23ef-48e0-b609-ce91c2540c2e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:03:38.313266 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:03:38.314411 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:03:38.315002 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:38.315400 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:38.695808 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f1c1152331140f9b4acfc98d16623bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5852e542a6f42ffb8e104daf741f872', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:03:38.710291 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Object Instance<df1fb869-23ef-48e0-b609-ce91c2540c2e> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:03:38.711347 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:38.761758 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-da1c482f-325d-420f-92b6-67bb14cd0664 req-7a337b95-9e2b-4126-820a-55665cffcfb2 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Received event network-changed-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:38.761991 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-da1c482f-325d-420f-92b6-67bb14cd0664 req-7a337b95-9e2b-4126-820a-55665cffcfb2 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Refreshing instance network info cache due to event network-changed-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:03:38.762481 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-da1c482f-325d-420f-92b6-67bb14cd0664 req-7a337b95-9e2b-4126-820a-55665cffcfb2 service nova] Acquiring lock "refresh_cache-76097fea-0890-40a8-a902-9f510cd34b52" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:03:38.762662 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-da1c482f-325d-420f-92b6-67bb14cd0664 req-7a337b95-9e2b-4126-820a-55665cffcfb2 service nova] Acquired lock "refresh_cache-76097fea-0890-40a8-a902-9f510cd34b52" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:03:38.763065 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-da1c482f-325d-420f-92b6-67bb14cd0664 req-7a337b95-9e2b-4126-820a-55665cffcfb2 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Refreshing network info cache for port f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:03:38.822966 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.112s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:38.823235 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Checking if we can resize image /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:03:38.823425 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:38.839754 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:03:38.878059 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:38.898014 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:03:38.898211 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:03:38.898382 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:03:38.898439 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] No VIF found with MAC fa:16:3e:27:71:42, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:03:38.898972 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Using config drive
May 21 02:03:38.946986 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk --force-share --output=json" returned: 0 in 0.123s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:38.948411 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Cannot resize image /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:03:38.948411 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lazy-loading 'migration_context' on Instance uuid df1fb869-23ef-48e0-b609-ce91c2540c2e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:03:39.269326 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-da1c482f-325d-420f-92b6-67bb14cd0664 req-7a337b95-9e2b-4126-820a-55665cffcfb2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:39.345921 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:03:39.357323 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Successfully created port: 1a8ae0f9-583a-4b78-9099-269768bf1687 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:03:39.404953 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lazy-loading 'ec2_ids' on Instance uuid 8948a19b-9e7e-448d-b782-be58020b5320 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:03:39.450245 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Object Instance<df1fb869-23ef-48e0-b609-ce91c2540c2e> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:03:39.451363 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:01:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1160366387',display_name='tempest-AttachVolumeTestJSON-server-1160366387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumetestjson-server-1160366387',id=27,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAujiHJsmhJMgEmRnWv5ymFbZbTAYncvgq9NsMeC8MiZ8la1gTOga8PrdaHkWknChauf3EhimnVrbr35Cl923XBy1BnVqXrs2rMVao3ITr2vCMWLpWOxbYc5JhA+8oEsw==',key_name='tempest-keypair-1825862747',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:01:35Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='e80cee8643f34f6685ff7fb42920afc3',ramdisk_id='',reservation_id='r-td2yddno',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2050140136',owner_user_name='tempest-AttachVolumeTestJSON-2050140136-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:03:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='640fad0f3dfe4ee99b04c12c2b8fd9dd',uuid=df1fb869-23ef-48e0-b609-ce91c2540c2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "397001b0-550b-43bb-8c99-269fa0d710bb", "address": "fa:16:3e:f4:b7:59", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397001b0-55", "ovs_interfaceid": "397001b0-550b-43bb-8c99-269fa0d710bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:03:39.452592 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Converting VIF {"id": "397001b0-550b-43bb-8c99-269fa0d710bb", "address": "fa:16:3e:f4:b7:59", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397001b0-55", "ovs_interfaceid": "397001b0-550b-43bb-8c99-269fa0d710bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:03:39.452940 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:b7:59,bridge_name='br-int',has_traffic_filtering=True,id=397001b0-550b-43bb-8c99-269fa0d710bb,network=Network(70a21e20-dfdf-49b9-bfd2-75a1f49c8a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397001b0-55') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:03:39.453242 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:b7:59,bridge_name='br-int',has_traffic_filtering=True,id=397001b0-550b-43bb-8c99-269fa0d710bb,network=Network(70a21e20-dfdf-49b9-bfd2-75a1f49c8a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397001b0-55') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:03:39.453654 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:39.454537 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:03:39.454537 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:03:39.455565 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:39.456269 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '45865939-732d-5f56-85d7-bdddcc19598a', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:03:39.456734 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:39.457594 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:03:39.464302 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:39.468292 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:39.468292 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap397001b0-55, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:03:39.468292 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap397001b0-55, col_values=(('qos', UUID('e1b485e8-f917-489b-a1e5-8ae2fcb9f396')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:03:39.468292 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap397001b0-55, col_values=(('external_ids', {'iface-id': '397001b0-550b-43bb-8c99-269fa0d710bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:b7:59', 'vm-uuid': 'df1fb869-23ef-48e0-b609-ce91c2540c2e'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:03:39.470693 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:39.470693 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:03:39.486787 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:39.489003 np0000001127 nova-compute[98206]: INFO os_vif [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:b7:59,bridge_name='br-int',has_traffic_filtering=True,id=397001b0-550b-43bb-8c99-269fa0d710bb,network=Network(70a21e20-dfdf-49b9-bfd2-75a1f49c8a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397001b0-55')
May 21 02:03:39.590459 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0038485480004055717 future=<Future at 0x71c0586d7500 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:03:39.590594 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:03:39.590705 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=5.890040769999814 future=<Future at 0x71c0984bf410 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:03:39.590803 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=5.889938258999791 future=<Future at 0x71c0984bf410 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:03:39.591442 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Emitting event <LifecycleEvent: 1779329004.5864987, 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:03:39.591726 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] VM Stopped (Lifecycle Event)
May 21 02:03:39.711784 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-da1c482f-325d-420f-92b6-67bb14cd0664 req-7a337b95-9e2b-4126-820a-55665cffcfb2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:39.876820 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-da1c482f-325d-420f-92b6-67bb14cd0664 req-7a337b95-9e2b-4126-820a-55665cffcfb2 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Updated VIF entry in instance network info cache for port f11d80e2-4ef4-404d-9b12-4b33f3e9caa2. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:03:39.877078 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-da1c482f-325d-420f-92b6-67bb14cd0664 req-7a337b95-9e2b-4126-820a-55665cffcfb2 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Updating instance_info_cache with network_info: [{"id": "f11d80e2-4ef4-404d-9b12-4b33f3e9caa2", "address": "fa:16:3e:4b:b4:81", "network": {"id": "8f999b5c-800e-44f7-84c5-6eff98ea03cb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-569078034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e98d81a820544f078c16b171f1e8b65c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11d80e2-4e", "ovs_interfaceid": "f11d80e2-4ef4-404d-9b12-4b33f3e9caa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:03:39.910889 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Object Instance<8948a19b-9e7e-448d-b782-be58020b5320> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:03:39.910889 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lazy-loading 'keypairs' on Instance uuid 8948a19b-9e7e-448d-b782-be58020b5320 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:03:39.949783 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Successfully updated port: 1a8ae0f9-583a-4b78-9099-269768bf1687 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:03:40.028727 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:40.063176 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:40.067617 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:40.097391 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: 23b5a9b1-af3f-4618-9eb4-1e57b30d9e7a] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:03:40.183560 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:40.364500 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:03:40.372700 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:03:40.372700 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Creating image(s)
May 21 02:03:40.372700 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Acquiring lock "/opt/stack/data/nova/instances/8411461f-7376-4907-a1ad-59b31e520f56/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:40.372964 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Lock "/opt/stack/data/nova/instances/8411461f-7376-4907-a1ad-59b31e520f56/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:40.374443 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Lock "/opt/stack/data/nova/instances/8411461f-7376-4907-a1ad-59b31e520f56/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:40.374443 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:03:40.376696 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:03:40.378873 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-da1c482f-325d-420f-92b6-67bb14cd0664 req-7a337b95-9e2b-4126-820a-55665cffcfb2 service nova] Releasing lock "refresh_cache-76097fea-0890-40a8-a902-9f510cd34b52" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:03:40.381511 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:40.404628 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "d35a1f35-4fdd-4efa-a753-7aa8d1a205a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:40.405912 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "d35a1f35-4fdd-4efa-a753-7aa8d1a205a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:40.415063 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Object Instance<8948a19b-9e7e-448d-b782-be58020b5320> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:03:40.424123 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:40.453997 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bd934291-620c-4936-8adb-02b2b1c9c808 req-4118222c-8937-4021-9636-7fc55f949ca7 service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Received event network-vif-plugged-397001b0-550b-43bb-8c99-269fa0d710bb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:40.454266 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bd934291-620c-4936-8adb-02b2b1c9c808 req-4118222c-8937-4021-9636-7fc55f949ca7 service nova] Acquiring lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:40.454493 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bd934291-620c-4936-8adb-02b2b1c9c808 req-4118222c-8937-4021-9636-7fc55f949ca7 service nova] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:40.454724 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bd934291-620c-4936-8adb-02b2b1c9c808 req-4118222c-8937-4021-9636-7fc55f949ca7 service nova] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:40.454773 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bd934291-620c-4936-8adb-02b2b1c9c808 req-4118222c-8937-4021-9636-7fc55f949ca7 service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] No waiting events found dispatching network-vif-plugged-397001b0-550b-43bb-8c99-269fa0d710bb {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:03:40.454895 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-bd934291-620c-4936-8adb-02b2b1c9c808 req-4118222c-8937-4021-9636-7fc55f949ca7 service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Received unexpected event network-vif-plugged-397001b0-550b-43bb-8c99-269fa0d710bb for instance with vm_state stopped and task_state powering-on.
May 21 02:03:40.460531 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Acquiring lock "refresh_cache-8411461f-7376-4907-a1ad-59b31e520f56" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:03:40.462020 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:40.479588 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Acquired lock "refresh_cache-8411461f-7376-4907-a1ad-59b31e520f56" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:03:40.479588 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:03:40.498883 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:40.508202 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:40.521988 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.138s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:40.521988 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:40.522120 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:40.522545 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:03:40.529108 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:03:40.529780 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:40.623140 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.093s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:40.623839 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/8411461f-7376-4907-a1ad-59b31e520f56/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:40.668869 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Creating config drive at /opt/stack/data/nova/instances/8948a19b-9e7e-448d-b782-be58020b5320/disk.config.rescue
May 21 02:03:40.677548 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8948a19b-9e7e-448d-b782-be58020b5320/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpj6q1x6kn {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:40.704160 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/8411461f-7376-4907-a1ad-59b31e520f56/disk 1073741824" returned: 0 in 0.079s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:40.705106 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.183s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:40.707949 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:40.742601 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8948a19b-9e7e-448d-b782-be58020b5320/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpj6q1x6kn" returned: 0 in 0.064s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:40.802135 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.096s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:40.802799 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8411461f-7376-4907-a1ad-59b31e520f56/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:03:40.803048 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8411461f-7376-4907-a1ad-59b31e520f56/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:40.833647 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-84861011-3528-4be2-a288-f46ef5bffa3d req-f3910dec-05ba-4b06-afee-cecd447f3976 service nova] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Received event network-changed-1a8ae0f9-583a-4b78-9099-269768bf1687 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:40.834486 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-84861011-3528-4be2-a288-f46ef5bffa3d req-f3910dec-05ba-4b06-afee-cecd447f3976 service nova] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Refreshing instance network info cache due to event network-changed-1a8ae0f9-583a-4b78-9099-269768bf1687. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:03:40.835054 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-84861011-3528-4be2-a288-f46ef5bffa3d req-f3910dec-05ba-4b06-afee-cecd447f3976 service nova] Acquiring lock "refresh_cache-8411461f-7376-4907-a1ad-59b31e520f56" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:03:40.906109 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8411461f-7376-4907-a1ad-59b31e520f56/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:40.906817 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Cannot resize image /opt/stack/data/nova/instances/8411461f-7376-4907-a1ad-59b31e520f56/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:03:40.907135 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:03:40.907431 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Ensure instance console log exists: /opt/stack/data/nova/instances/8411461f-7376-4907-a1ad-59b31e520f56/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:03:40.907807 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:40.908156 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:40.908311 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:40.910992 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:03:41.064015 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Removed pending STOPPED event for df1fb869-23ef-48e0-b609-ce91c2540c2e due to new event <LifecycleEvent: 1779329021.063362, df1fb869-23ef-48e0-b609-ce91c2540c2e => Resumed> {{(pid=98206) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 21 02:03:41.065767 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Instance event wait completed in 0 seconds for  {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:03:41.066019 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329021.063362, df1fb869-23ef-48e0-b609-ce91c2540c2e => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:03:41.069505 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] VM Resumed (Lifecycle Event)
May 21 02:03:41.076739 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:03:41.081401 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Instance rebooted successfully.
May 21 02:03:41.303651 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:41.314875 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:41.327533 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:41.344187 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:41.426313 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:41.432022 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:41.522385 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:41.523078 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:41.524090 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:41.527219 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:03:41.527323 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Claim successful on node np0000001127
May 21 02:03:41.529235 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:41.545695 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Updating instance_info_cache with network_info: [{"id": "1a8ae0f9-583a-4b78-9099-269768bf1687", "address": "fa:16:3e:5c:38:d6", "network": {"id": "6d2e68f2-ff8f-41f5-accf-4865237c0702", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1863313078-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c5852e542a6f42ffb8e104daf741f872", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a8ae0f9-58", "ovs_interfaceid": "1a8ae0f9-583a-4b78-9099-269768bf1687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:03:41.581440 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:03:41.588388 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:03:42.049921 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Releasing lock "refresh_cache-8411461f-7376-4907-a1ad-59b31e520f56" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:03:42.050171 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Instance network_info: |[{"id": "1a8ae0f9-583a-4b78-9099-269768bf1687", "address": "fa:16:3e:5c:38:d6", "network": {"id": "6d2e68f2-ff8f-41f5-accf-4865237c0702", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1863313078-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c5852e542a6f42ffb8e104daf741f872", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a8ae0f9-58", "ovs_interfaceid": "1a8ae0f9-583a-4b78-9099-269768bf1687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:03:42.050611 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-84861011-3528-4be2-a288-f46ef5bffa3d req-f3910dec-05ba-4b06-afee-cecd447f3976 service nova] Acquired lock "refresh_cache-8411461f-7376-4907-a1ad-59b31e520f56" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:03:42.052855 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-84861011-3528-4be2-a288-f46ef5bffa3d req-f3910dec-05ba-4b06-afee-cecd447f3976 service nova] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Refreshing network info cache for port 1a8ae0f9-583a-4b78-9099-269768bf1687 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:03:42.054048 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Start _get_guest_xml network_info=[{"id": "1a8ae0f9-583a-4b78-9099-269768bf1687", "address": "fa:16:3e:5c:38:d6", "network": {"id": "6d2e68f2-ff8f-41f5-accf-4865237c0702", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1863313078-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c5852e542a6f42ffb8e104daf741f872", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a8ae0f9-58", "ovs_interfaceid": "1a8ae0f9-583a-4b78-9099-269768bf1687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:03:42.057632 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:03:42.059084 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-ServersNegativeTestJSON-server-453301296', uuid='8411461f-7376-4907-a1ad-59b31e520f56'), owner=OwnerMeta(userid='9f1c1152331140f9b4acfc98d16623bc', username='tempest-ServersNegativeTestJSON-1944632598-project-member', projectid='c5852e542a6f42ffb8e104daf741f872', projectname='tempest-ServersNegativeTestJSON-1944632598'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1a8ae0f9-583a-4b78-9099-269768bf1687", "address": "fa:16:3e:5c:38:d6", "network": {"id": "6d2e68f2-ff8f-41f5-accf-4865237c0702", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1863313078-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c5852e542a6f42ffb8e104daf741f872", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a8ae0f9-58", "ovs_interfaceid": "1a8ae0f9-583a-4b78-9099-269768bf1687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329022.0586827) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:03:42.060718 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:03:42.061127 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:03:42.062442 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:03:42.062665 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:03:42.064191 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:03:42.064573 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:03:42.064799 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:03:42.065148 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:03:42.065352 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:03:42.065430 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:03:42.065639 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:03:42.065772 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:03:42.065933 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:03:42.066052 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:03:42.066258 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:03:42.066258 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:03:42.083876 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:03:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-453301296',display_name='tempest-ServersNegativeTestJSON-server-453301296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serversnegativetestjson-server-453301296',id=36,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5852e542a6f42ffb8e104daf741f872',ramdisk_id='',reservation_id='r-beutvk2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1944632598',owner_user_name='tempest-ServersNegativeTestJSON-1944632598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:03:39Z,user_data=None,user_id='9f1c1152331140f9b4acfc98d16623bc',uuid=8411461f-7376-4907-a1ad-59b31e520f56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a8ae0f9-583a-4b78-9099-269768bf1687", "address": "fa:16:3e:5c:38:d6", "network": {"id": "6d2e68f2-ff8f-41f5-accf-4865237c0702", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1863313078-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c5852e542a6f42ffb8e104daf741f872", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a8ae0f9-58", "ovs_interfaceid": "1a8ae0f9-583a-4b78-9099-269768bf1687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:03:42.084075 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Converting VIF {"id": "1a8ae0f9-583a-4b78-9099-269768bf1687", "address": "fa:16:3e:5c:38:d6", "network": {"id": "6d2e68f2-ff8f-41f5-accf-4865237c0702", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1863313078-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c5852e542a6f42ffb8e104daf741f872", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a8ae0f9-58", "ovs_interfaceid": "1a8ae0f9-583a-4b78-9099-269768bf1687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:03:42.084746 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:38:d6,bridge_name='br-int',has_traffic_filtering=True,id=1a8ae0f9-583a-4b78-9099-269768bf1687,network=Network(6d2e68f2-ff8f-41f5-accf-4865237c0702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a8ae0f9-58') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:03:42.085351 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Lazy-loading 'pci_devices' on Instance uuid 8411461f-7376-4907-a1ad-59b31e520f56 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:03:42.093550 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] During sync_power_state the instance has a pending task (powering-on). Skip.
May 21 02:03:42.093866 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329022.0936801, df1fb869-23ef-48e0-b609-ce91c2540c2e => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:03:42.093985 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] VM Started (Lifecycle Event)
May 21 02:03:42.237200 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-857fe551-2f9b-41fc-b3e4-21b3a88fbd81 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:03:42.546616 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cea38139-dcd8-4660-b406-5d74952ed49b req-f188d078-aea5-4b3a-920d-4e1c4be9a42c service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Received event network-vif-plugged-397001b0-550b-43bb-8c99-269fa0d710bb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:42.548113 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cea38139-dcd8-4660-b406-5d74952ed49b req-f188d078-aea5-4b3a-920d-4e1c4be9a42c service nova] Acquiring lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:42.548727 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cea38139-dcd8-4660-b406-5d74952ed49b req-f188d078-aea5-4b3a-920d-4e1c4be9a42c service nova] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:42.548727 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cea38139-dcd8-4660-b406-5d74952ed49b req-f188d078-aea5-4b3a-920d-4e1c4be9a42c service nova] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:42.548727 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cea38139-dcd8-4660-b406-5d74952ed49b req-f188d078-aea5-4b3a-920d-4e1c4be9a42c service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] No waiting events found dispatching network-vif-plugged-397001b0-550b-43bb-8c99-269fa0d710bb {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:03:42.548727 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-cea38139-dcd8-4660-b406-5d74952ed49b req-f188d078-aea5-4b3a-920d-4e1c4be9a42c service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Received unexpected event network-vif-plugged-397001b0-550b-43bb-8c99-269fa0d710bb for instance with vm_state stopped and task_state powering-on.
May 21 02:03:42.555286 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-84861011-3528-4be2-a288-f46ef5bffa3d req-f3910dec-05ba-4b06-afee-cecd447f3976 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:42.590217 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] End _get_guest_xml xml=<domain type="qemu">
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:   <uuid>8411461f-7376-4907-a1ad-59b31e520f56</uuid>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:   <name>instance-00000024</name>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:       <nova:name>tempest-ServersNegativeTestJSON-server-453301296</nova:name>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:03:42</nova:creationTime>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:         <nova:user uuid="9f1c1152331140f9b4acfc98d16623bc">tempest-ServersNegativeTestJSON-1944632598-project-member</nova:user>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:         <nova:project uuid="c5852e542a6f42ffb8e104daf741f872">tempest-ServersNegativeTestJSON-1944632598</nova:project>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:         <nova:port uuid="1a8ae0f9-583a-4b78-9099-269768bf1687">
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:     <system>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:       <entry name="serial">8411461f-7376-4907-a1ad-59b31e520f56</entry>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:       <entry name="uuid">8411461f-7376-4907-a1ad-59b31e520f56</entry>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:     </system>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:   <os>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:   </os>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:   <features>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:   </features>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:   <devices>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/8411461f-7376-4907-a1ad-59b31e520f56/disk"/>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:     </disk>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/8411461f-7376-4907-a1ad-59b31e520f56/disk.config"/>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:     </disk>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:5c:38:d6"/>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:       <target dev="tap1a8ae0f9-58"/>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:     </interface>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/8411461f-7376-4907-a1ad-59b31e520f56/console.log" append="off"/>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:     </serial>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:     <video>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:     </video>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:     </rng>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:   </devices>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]: </domain>
May 21 02:03:42.590217 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:03:42.594292 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Preparing to wait for external event network-vif-plugged-1a8ae0f9-583a-4b78-9099-269768bf1687 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:03:42.594292 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Acquiring lock "8411461f-7376-4907-a1ad-59b31e520f56-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:42.594292 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Lock "8411461f-7376-4907-a1ad-59b31e520f56-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:42.594292 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Lock "8411461f-7376-4907-a1ad-59b31e520f56-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:42.594292 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:03:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-453301296',display_name='tempest-ServersNegativeTestJSON-server-453301296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serversnegativetestjson-server-453301296',id=36,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5852e542a6f42ffb8e104daf741f872',ramdisk_id='',reservation_id='r-beutvk2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1944632598',owner_user_name='tempest-ServersNegativeTestJSON-1944632598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:03:39Z,user_data=None,user_id='9f1c1152331140f9b4acfc98d16623bc',uuid=8411461f-7376-4907-a1ad-59b31e520f56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a8ae0f9-583a-4b78-9099-269768bf1687", "address": "fa:16:3e:5c:38:d6", "network": {"id": "6d2e68f2-ff8f-41f5-accf-4865237c0702", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1863313078-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c5852e542a6f42ffb8e104daf741f872", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a8ae0f9-58", "ovs_interfaceid": "1a8ae0f9-583a-4b78-9099-269768bf1687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:03:42.594292 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Converting VIF {"id": "1a8ae0f9-583a-4b78-9099-269768bf1687", "address": "fa:16:3e:5c:38:d6", "network": {"id": "6d2e68f2-ff8f-41f5-accf-4865237c0702", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1863313078-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c5852e542a6f42ffb8e104daf741f872", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a8ae0f9-58", "ovs_interfaceid": "1a8ae0f9-583a-4b78-9099-269768bf1687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:03:42.596207 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:38:d6,bridge_name='br-int',has_traffic_filtering=True,id=1a8ae0f9-583a-4b78-9099-269768bf1687,network=Network(6d2e68f2-ff8f-41f5-accf-4865237c0702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a8ae0f9-58') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:03:42.596535 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:38:d6,bridge_name='br-int',has_traffic_filtering=True,id=1a8ae0f9-583a-4b78-9099-269768bf1687,network=Network(6d2e68f2-ff8f-41f5-accf-4865237c0702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a8ae0f9-58') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:03:42.597426 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:03:42.601076 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:42.601076 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:03:42.601076 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:03:42.601076 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:03:42.601076 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:03:42.601076 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] No VIF found with MAC fa:16:3e:f4:b7:59, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:03:42.601076 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-f0c04616-e9e1-4806-92d7-7f77b532e21a tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:03:42.601795 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:42.602126 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dee04773-ac30-52e9-a4a9-8de3b0d1e5db', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:03:42.602786 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:03:42.608319 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:03:42.621949 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:42.622213 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a8ae0f9-58, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:03:42.622689 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1a8ae0f9-58, col_values=(('qos', UUID('af4261c9-3cf7-4b41-bcb8-07cdff4c69cc')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:03:42.622889 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1a8ae0f9-58, col_values=(('external_ids', {'iface-id': '1a8ae0f9-583a-4b78-9099-269768bf1687', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:38:d6', 'vm-uuid': '8411461f-7376-4907-a1ad-59b31e520f56'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:03:42.626748 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:03:42.634496 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:42.634496 np0000001127 nova-compute[98206]: INFO os_vif [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:38:d6,bridge_name='br-int',has_traffic_filtering=True,id=1a8ae0f9-583a-4b78-9099-269768bf1687,network=Network(6d2e68f2-ff8f-41f5-accf-4865237c0702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a8ae0f9-58')
May 21 02:03:42.945049 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e3980ff4-941c-48ea-93c5-8bd0901ed74d req-a20c1d5b-ec05-4a36-9818-4d47cca7fd4b service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Received event network-vif-plugged-9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:42.947550 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e3980ff4-941c-48ea-93c5-8bd0901ed74d req-a20c1d5b-ec05-4a36-9818-4d47cca7fd4b service nova] Acquiring lock "8948a19b-9e7e-448d-b782-be58020b5320-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:42.947550 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e3980ff4-941c-48ea-93c5-8bd0901ed74d req-a20c1d5b-ec05-4a36-9818-4d47cca7fd4b service nova] Lock "8948a19b-9e7e-448d-b782-be58020b5320-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:42.947550 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e3980ff4-941c-48ea-93c5-8bd0901ed74d req-a20c1d5b-ec05-4a36-9818-4d47cca7fd4b service nova] Lock "8948a19b-9e7e-448d-b782-be58020b5320-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:42.947550 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e3980ff4-941c-48ea-93c5-8bd0901ed74d req-a20c1d5b-ec05-4a36-9818-4d47cca7fd4b service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] No waiting events found dispatching network-vif-plugged-9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:03:42.947550 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-e3980ff4-941c-48ea-93c5-8bd0901ed74d req-a20c1d5b-ec05-4a36-9818-4d47cca7fd4b service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Received unexpected event network-vif-plugged-9089f785-707f-4bb7-ac00-927fe747fcc5 for instance with vm_state rescued and task_state None.
May 21 02:03:42.947550 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e3980ff4-941c-48ea-93c5-8bd0901ed74d req-a20c1d5b-ec05-4a36-9818-4d47cca7fd4b service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Received event network-vif-plugged-9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:42.947550 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e3980ff4-941c-48ea-93c5-8bd0901ed74d req-a20c1d5b-ec05-4a36-9818-4d47cca7fd4b service nova] Acquiring lock "8948a19b-9e7e-448d-b782-be58020b5320-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:42.947550 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e3980ff4-941c-48ea-93c5-8bd0901ed74d req-a20c1d5b-ec05-4a36-9818-4d47cca7fd4b service nova] Lock "8948a19b-9e7e-448d-b782-be58020b5320-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:42.947550 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e3980ff4-941c-48ea-93c5-8bd0901ed74d req-a20c1d5b-ec05-4a36-9818-4d47cca7fd4b service nova] Lock "8948a19b-9e7e-448d-b782-be58020b5320-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:42.947550 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e3980ff4-941c-48ea-93c5-8bd0901ed74d req-a20c1d5b-ec05-4a36-9818-4d47cca7fd4b service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] No waiting events found dispatching network-vif-plugged-9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:03:42.947550 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-e3980ff4-941c-48ea-93c5-8bd0901ed74d req-a20c1d5b-ec05-4a36-9818-4d47cca7fd4b service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Received unexpected event network-vif-plugged-9089f785-707f-4bb7-ac00-927fe747fcc5 for instance with vm_state rescued and task_state None.
May 21 02:03:43.085825 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-84861011-3528-4be2-a288-f46ef5bffa3d req-f3910dec-05ba-4b06-afee-cecd447f3976 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:43.119301 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] During sync_power_state the instance has a pending task (powering-on). Skip.
May 21 02:03:43.119766 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Removed pending STOPPED event for 8948a19b-9e7e-448d-b782-be58020b5320 due to new event <LifecycleEvent: 1779329023.119479, 8948a19b-9e7e-448d-b782-be58020b5320 => Resumed> {{(pid=98206) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 21 02:03:43.119867 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329023.119479, 8948a19b-9e7e-448d-b782-be58020b5320 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:03:43.121533 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] VM Resumed (Lifecycle Event)
May 21 02:03:43.318082 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-84861011-3528-4be2-a288-f46ef5bffa3d req-f3910dec-05ba-4b06-afee-cecd447f3976 service nova] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Updated VIF entry in instance network info cache for port 1a8ae0f9-583a-4b78-9099-269768bf1687. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:03:43.319214 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-84861011-3528-4be2-a288-f46ef5bffa3d req-f3910dec-05ba-4b06-afee-cecd447f3976 service nova] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Updating instance_info_cache with network_info: [{"id": "1a8ae0f9-583a-4b78-9099-269768bf1687", "address": "fa:16:3e:5c:38:d6", "network": {"id": "6d2e68f2-ff8f-41f5-accf-4865237c0702", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1863313078-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c5852e542a6f42ffb8e104daf741f872", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a8ae0f9-58", "ovs_interfaceid": "1a8ae0f9-583a-4b78-9099-269768bf1687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:03:43.356553 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:03:43.356922 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:03:43.624606 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:03:43.628686 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:03:43.823190 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-84861011-3528-4be2-a288-f46ef5bffa3d req-f3910dec-05ba-4b06-afee-cecd447f3976 service nova] Releasing lock "refresh_cache-8411461f-7376-4907-a1ad-59b31e520f56" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:03:43.860056 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:03:43.902339 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-27613eef-d0a7-4041-8a78-ee34165ab69c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Unrescuing
May 21 02:03:43.902558 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-27613eef-d0a7-4041-8a78-ee34165ab69c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "refresh_cache-8948a19b-9e7e-448d-b782-be58020b5320" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:03:43.902662 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-27613eef-d0a7-4041-8a78-ee34165ab69c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquired lock "refresh_cache-8948a19b-9e7e-448d-b782-be58020b5320" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:03:43.903366 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-27613eef-d0a7-4041-8a78-ee34165ab69c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:03:44.131069 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 21 02:03:44.131330 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329024.1311302, 8948a19b-9e7e-448d-b782-be58020b5320 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:03:44.131488 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] VM Started (Lifecycle Event)
May 21 02:03:44.164430 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:03:44.164614 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:03:44.164684 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] No VIF found with MAC fa:16:3e:5c:38:d6, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:03:44.165078 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Using config drive
May 21 02:03:44.368756 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.846s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:44.369245 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:03:44.407137 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-27613eef-d0a7-4041-8a78-ee34165ab69c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:44.635337 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:03:44.638723 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:03:44.670743 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:44.845044 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-27613eef-d0a7-4041-8a78-ee34165ab69c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:44.873380 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Creating config drive at /opt/stack/data/nova/instances/8411461f-7376-4907-a1ad-59b31e520f56/disk.config
May 21 02:03:44.875860 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8411461f-7376-4907-a1ad-59b31e520f56/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf9ypcwkl {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:44.904391 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:03:44.904612 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:03:44.906572 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:44.906997 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:44.943878 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8411461f-7376-4907-a1ad-59b31e520f56/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf9ypcwkl" returned: 0 in 0.068s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:45.013183 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0efcbc1b88f49989c9f6b6a7439f2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177bec65268546d2b899e09989183b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:03:45.082887 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-27613eef-d0a7-4041-8a78-ee34165ab69c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Updating instance_info_cache with network_info: [{"id": "9089f785-707f-4bb7-ac00-927fe747fcc5", "address": "fa:16:3e:27:71:42", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9089f785-70", "ovs_interfaceid": "9089f785-707f-4bb7-ac00-927fe747fcc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:03:45.141655 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 21 02:03:45.412313 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:03:45.481216 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.00043396599994594 future=<Future at 0x71c0984bf410 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:03:45.483495 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:03:45.483495 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0004429229998095252 future=<Future at 0x71c0586d58e0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:03:45.483495 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0006211229997461487 future=<Future at 0x71c0586d58e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:03:45.483495 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:03:45.483495 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=3.542527127000085 future=<Future at 0x71c07c52a960 state=cancelled>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:03:45.483495 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=3.542446888000086 future=<Future at 0x71c07c52a960 state=cancelled>) was cancelled while queued, skipping {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:03:45.483495 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:03:45.484108 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Emitting event <LifecycleEvent: 1779329010.4810503, f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:03:45.484271 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] VM Stopped (Lifecycle Event)
May 21 02:03:45.497887 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:45.537371 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:45.587334 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-27613eef-d0a7-4041-8a78-ee34165ab69c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Releasing lock "refresh_cache-8948a19b-9e7e-448d-b782-be58020b5320" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:03:45.588113 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-27613eef-d0a7-4041-8a78-ee34165ab69c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lazy-loading 'flavor' on Instance uuid 8948a19b-9e7e-448d-b782-be58020b5320 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:03:45.721410 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:45.782693 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:45.888890 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Successfully created port: 0478a2ae-a44c-4e56-bac8-7434c0d3af2a {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:03:45.899689 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7dcebf26-d4b3-49a4-8514-d858800f1853 req-ed6b9327-5b67-4934-a7b3-31231203d617 service nova] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Received event network-vif-plugged-1a8ae0f9-583a-4b78-9099-269768bf1687 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:45.900784 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7dcebf26-d4b3-49a4-8514-d858800f1853 req-ed6b9327-5b67-4934-a7b3-31231203d617 service nova] Acquiring lock "8411461f-7376-4907-a1ad-59b31e520f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:45.900988 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7dcebf26-d4b3-49a4-8514-d858800f1853 req-ed6b9327-5b67-4934-a7b3-31231203d617 service nova] Lock "8411461f-7376-4907-a1ad-59b31e520f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:45.901128 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7dcebf26-d4b3-49a4-8514-d858800f1853 req-ed6b9327-5b67-4934-a7b3-31231203d617 service nova] Lock "8411461f-7376-4907-a1ad-59b31e520f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:45.901253 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7dcebf26-d4b3-49a4-8514-d858800f1853 req-ed6b9327-5b67-4934-a7b3-31231203d617 service nova] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Processing event network-vif-plugged-1a8ae0f9-583a-4b78-9099-269768bf1687 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:03:45.917686 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:03:45.991856 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: f5934cbe-3cf6-4c39-a9b5-2a8ed2370f80] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:03:46.131814 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:46.139828 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:46.161757 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:46.352152 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:46.360322 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:46.430631 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:46.480560 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:46.502850 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:46.513301 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999667203000172 future=<Future at 0x71c0983bd0d0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:03:46.513956 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.998854865999874 future=<Future at 0x71c0983bd0d0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:03:46.514618 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.998172671000248 future=<Future at 0x71c0983bd0d0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:03:46.524794 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Instance destroyed successfully.
May 21 02:03:46.525600 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-27613eef-d0a7-4041-8a78-ee34165ab69c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lazy-loading 'numa_topology' on Instance uuid 8948a19b-9e7e-448d-b782-be58020b5320 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:03:46.553451 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b62552a2-c622-4123-a5e7-70e966d36f20 req-58c419c1-f635-415c-8e7e-ac0feb0e9892 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Received event network-vif-unplugged-9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:46.554356 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b62552a2-c622-4123-a5e7-70e966d36f20 req-58c419c1-f635-415c-8e7e-ac0feb0e9892 service nova] Acquiring lock "8948a19b-9e7e-448d-b782-be58020b5320-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:46.554716 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b62552a2-c622-4123-a5e7-70e966d36f20 req-58c419c1-f635-415c-8e7e-ac0feb0e9892 service nova] Lock "8948a19b-9e7e-448d-b782-be58020b5320-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:46.554955 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b62552a2-c622-4123-a5e7-70e966d36f20 req-58c419c1-f635-415c-8e7e-ac0feb0e9892 service nova] Lock "8948a19b-9e7e-448d-b782-be58020b5320-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:46.555114 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b62552a2-c622-4123-a5e7-70e966d36f20 req-58c419c1-f635-415c-8e7e-ac0feb0e9892 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] No waiting events found dispatching network-vif-unplugged-9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:03:46.555277 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-b62552a2-c622-4123-a5e7-70e966d36f20 req-58c419c1-f635-415c-8e7e-ac0feb0e9892 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Received unexpected event network-vif-unplugged-9089f785-707f-4bb7-ac00-927fe747fcc5 for instance with vm_state rescued and task_state unrescuing.
May 21 02:03:46.672633 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:46.680365 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:46.891708 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:46.899284 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:46.924770 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:03:46.925334 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329026.924796, 8411461f-7376-4907-a1ad-59b31e520f56 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:03:46.925775 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] VM Started (Lifecycle Event)
May 21 02:03:46.930748 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:03:46.938374 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:03:46.938374 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Instance spawned successfully.
May 21 02:03:46.938925 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:03:46.942009 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:03:46.947575 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Creating image(s)
May 21 02:03:46.947575 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "/opt/stack/data/nova/instances/d35a1f35-4fdd-4efa-a753-7aa8d1a205a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:46.947575 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "/opt/stack/data/nova/instances/d35a1f35-4fdd-4efa-a753-7aa8d1a205a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:46.947575 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "/opt/stack/data/nova/instances/d35a1f35-4fdd-4efa-a753-7aa8d1a205a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:46.947575 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:03:46.950429 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:03:46.953928 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:47.034489 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-27613eef-d0a7-4041-8a78-ee34165ab69c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Object Instance<8948a19b-9e7e-448d-b782-be58020b5320> lazy-loaded attributes: flavor,numa_topology {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:03:47.088259 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.134s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:47.090382 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:47.091310 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:47.092685 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:03:47.106255 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:03:47.107290 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:47.232047 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.124s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:47.233413 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/d35a1f35-4fdd-4efa-a753-7aa8d1a205a8/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:47.264215 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Successfully updated port: 0478a2ae-a44c-4e56-bac8-7434c0d3af2a {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:03:47.320297 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/d35a1f35-4fdd-4efa-a753-7aa8d1a205a8/disk 1073741824" returned: 0 in 0.087s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:47.322097 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:47.323546 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:47.437927 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:03:47.452729 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:03:47.461322 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:03:47.465002 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:03:47.465110 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:03:47.465490 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:03:47.465870 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:03:47.468395 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:03:47.483237 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:47.525582 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.202s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:47.525740 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d35a1f35-4fdd-4efa-a753-7aa8d1a205a8/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:03:47.526300 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d35a1f35-4fdd-4efa-a753-7aa8d1a205a8/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:47.624361 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:47.657094 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d35a1f35-4fdd-4efa-a753-7aa8d1a205a8/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:47.660934 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Cannot resize image /opt/stack/data/nova/instances/d35a1f35-4fdd-4efa-a753-7aa8d1a205a8/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:03:47.661695 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:03:47.661695 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Ensure instance console log exists: /opt/stack/data/nova/instances/d35a1f35-4fdd-4efa-a753-7aa8d1a205a8/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:03:47.662016 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:47.662308 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:47.662489 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:47.677712 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:03:47.679723 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:03:47.710348 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:47.741486 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:47.745922 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:47.772799 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "refresh_cache-d35a1f35-4fdd-4efa-a753-7aa8d1a205a8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:03:47.772799 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquired lock "refresh_cache-d35a1f35-4fdd-4efa-a753-7aa8d1a205a8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:03:47.772987 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:03:47.853987 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:47.913566 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:47.918510 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:47.957187 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:03:47.957402 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329027.9571133, 8411461f-7376-4907-a1ad-59b31e520f56 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:03:47.957635 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] VM Paused (Lifecycle Event)
May 21 02:03:47.979119 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Took 7.61 seconds to spawn the instance on the hypervisor.
May 21 02:03:47.979366 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:03:48.013561 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6169db95-a512-4ed6-ab57-c65ae8718bf3 req-9e1d6d95-d2a2-440e-8e78-cd0c48fcbf9d service nova] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Received event network-vif-plugged-1a8ae0f9-583a-4b78-9099-269768bf1687 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:48.014976 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6169db95-a512-4ed6-ab57-c65ae8718bf3 req-9e1d6d95-d2a2-440e-8e78-cd0c48fcbf9d service nova] Acquiring lock "8411461f-7376-4907-a1ad-59b31e520f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:48.017163 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6169db95-a512-4ed6-ab57-c65ae8718bf3 req-9e1d6d95-d2a2-440e-8e78-cd0c48fcbf9d service nova] Lock "8411461f-7376-4907-a1ad-59b31e520f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:48.017163 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6169db95-a512-4ed6-ab57-c65ae8718bf3 req-9e1d6d95-d2a2-440e-8e78-cd0c48fcbf9d service nova] Lock "8411461f-7376-4907-a1ad-59b31e520f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:48.018092 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6169db95-a512-4ed6-ab57-c65ae8718bf3 req-9e1d6d95-d2a2-440e-8e78-cd0c48fcbf9d service nova] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] No waiting events found dispatching network-vif-plugged-1a8ae0f9-583a-4b78-9099-269768bf1687 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:03:48.018291 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-6169db95-a512-4ed6-ab57-c65ae8718bf3 req-9e1d6d95-d2a2-440e-8e78-cd0c48fcbf9d service nova] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Received unexpected event network-vif-plugged-1a8ae0f9-583a-4b78-9099-269768bf1687 for instance with vm_state building and task_state spawning.
May 21 02:03:48.412736 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:03:48.463208 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:03:48.468408 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329028.4680572, 8411461f-7376-4907-a1ad-59b31e520f56 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:03:48.468604 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] VM Resumed (Lifecycle Event)
May 21 02:03:48.500227 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Took 13.48 seconds to build instance.
May 21 02:03:48.660996 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:48.677086 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:03:48.679477 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:03:48.679898 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:03:48.680134 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:03:48.680358 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 21 02:03:48.680508 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:03:48.704637 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Received event network-vif-unplugged-9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:48.705640 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] Acquiring lock "8948a19b-9e7e-448d-b782-be58020b5320-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:48.706391 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] Lock "8948a19b-9e7e-448d-b782-be58020b5320-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:48.706391 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] Lock "8948a19b-9e7e-448d-b782-be58020b5320-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:48.706391 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] No waiting events found dispatching network-vif-unplugged-9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:03:48.706391 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Received unexpected event network-vif-unplugged-9089f785-707f-4bb7-ac00-927fe747fcc5 for instance with vm_state rescued and task_state unrescuing.
May 21 02:03:48.706682 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Received event network-changed-0478a2ae-a44c-4e56-bac8-7434c0d3af2a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:48.706682 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Refreshing instance network info cache due to event network-changed-0478a2ae-a44c-4e56-bac8-7434c0d3af2a. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:03:48.709551 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] Acquiring lock "refresh_cache-d35a1f35-4fdd-4efa-a753-7aa8d1a205a8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:03:48.870948 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-27613eef-d0a7-4041-8a78-ee34165ab69c tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:03:48.962011 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Updating instance_info_cache with network_info: [{"id": "0478a2ae-a44c-4e56-bac8-7434c0d3af2a", "address": "fa:16:3e:61:10:5e", "network": {"id": "38d66f09-c738-4e79-9aeb-12e87e29f568", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-447420743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "177bec65268546d2b899e09989183b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0478a2ae-a4", "ovs_interfaceid": "0478a2ae-a44c-4e56-bac8-7434c0d3af2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:03:48.972836 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:03:48.974462 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:03:49.007993 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ad6f9f9a-a7a7-4b83-b567-2512689665ab tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Lock "8411461f-7376-4907-a1ad-59b31e520f56" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:49.201460 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:49.201703 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:49.201941 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:49.202015 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Auditing locally available compute resources for np0000001127 (node: np0000001127) {{(pid=98206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 21 02:03:49.266275 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-97bced5f-9525-4574-bc0c-9a02025bea01 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Acquiring lock "8411461f-7376-4907-a1ad-59b31e520f56" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:49.266570 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-97bced5f-9525-4574-bc0c-9a02025bea01 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Lock "8411461f-7376-4907-a1ad-59b31e520f56" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:49.266666 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-97bced5f-9525-4574-bc0c-9a02025bea01 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Acquiring lock "8411461f-7376-4907-a1ad-59b31e520f56-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:49.266770 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-97bced5f-9525-4574-bc0c-9a02025bea01 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Lock "8411461f-7376-4907-a1ad-59b31e520f56-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:49.266880 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-97bced5f-9525-4574-bc0c-9a02025bea01 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Lock "8411461f-7376-4907-a1ad-59b31e520f56-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:49.269935 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-97bced5f-9525-4574-bc0c-9a02025bea01 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Terminating instance
May 21 02:03:49.467336 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Releasing lock "refresh_cache-d35a1f35-4fdd-4efa-a753-7aa8d1a205a8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:03:49.467724 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Instance network_info: |[{"id": "0478a2ae-a44c-4e56-bac8-7434c0d3af2a", "address": "fa:16:3e:61:10:5e", "network": {"id": "38d66f09-c738-4e79-9aeb-12e87e29f568", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-447420743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "177bec65268546d2b899e09989183b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0478a2ae-a4", "ovs_interfaceid": "0478a2ae-a44c-4e56-bac8-7434c0d3af2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:03:49.470387 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] Acquired lock "refresh_cache-d35a1f35-4fdd-4efa-a753-7aa8d1a205a8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:03:49.470387 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Start _get_guest_xml network_info=[{"id": "0478a2ae-a44c-4e56-bac8-7434c0d3af2a", "address": "fa:16:3e:61:10:5e", "network": {"id": "38d66f09-c738-4e79-9aeb-12e87e29f568", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-447420743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "177bec65268546d2b899e09989183b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0478a2ae-a4", "ovs_interfaceid": "0478a2ae-a44c-4e56-bac8-7434c0d3af2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:03:49.470387 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Refreshing network info cache for port 0478a2ae-a44c-4e56-bac8-7434c0d3af2a {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:03:49.472773 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:03:49.473881 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-677776071', uuid='d35a1f35-4fdd-4efa-a753-7aa8d1a205a8'), owner=OwnerMeta(userid='c0efcbc1b88f49989c9f6b6a7439f2c4', username='tempest-TestEncryptedCinderVolumes-991116896-project-member', projectid='177bec65268546d2b899e09989183b6e', projectname='tempest-TestEncryptedCinderVolumes-991116896'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0478a2ae-a44c-4e56-bac8-7434c0d3af2a", "address": "fa:16:3e:61:10:5e", "network": {"id": "38d66f09-c738-4e79-9aeb-12e87e29f568", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-447420743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "177bec65268546d2b899e09989183b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0478a2ae-a4", "ovs_interfaceid": "0478a2ae-a44c-4e56-bac8-7434c0d3af2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329029.4735625) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:03:49.477219 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:03:49.478378 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:03:49.478796 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] During sync_power_state the instance has a pending task (deleting). Skip.
May 21 02:03:49.479234 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Removed pending STOPPED event for 8948a19b-9e7e-448d-b782-be58020b5320 due to new event <LifecycleEvent: 1779329029.4789264, 8948a19b-9e7e-448d-b782-be58020b5320 => Resumed> {{(pid=98206) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 21 02:03:49.479475 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329029.4789264, 8948a19b-9e7e-448d-b782-be58020b5320 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:03:49.480636 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] VM Resumed (Lifecycle Event)
May 21 02:03:49.481359 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:03:49.481847 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:03:49.482905 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:03:49.483359 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:03:49.483595 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:03:49.483695 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:03:49.483811 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:03:49.483889 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:03:49.483978 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:03:49.484146 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:03:49.484245 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:03:49.484346 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:03:49.485709 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:03:49.485870 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:03:49.500277 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:03:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-677776071',display_name='tempest-TestEncryptedCinderVolumes-server-677776071',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testencryptedcindervolumes-server-677776071',id=37,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTpWBzLpDObU/KfOerIlcjfmK1W7wNqlOeuHR2EDlVWezLFMgXgV+cgYLad5hJ8gsfoDqBBhjKd36bII4QWX5x7odWsUHCcT+rx4JzMW0D9m6XFd7CH79hxLomEJWdIhg==',key_name='tempest-keypair-2139954079',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='177bec65268546d2b899e09989183b6e',ramdisk_id='',reservation_id='r-z1j7wdmi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-991116896',owner_user_name='tempest-TestEncryptedCinderVolumes-991116896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:03:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0efcbc1b88f49989c9f6b6a7439f2c4',uuid=d35a1f35-4fdd-4efa-a753-7aa8d1a205a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0478a2ae-a44c-4e56-bac8-7434c0d3af2a", "address": "fa:16:3e:61:10:5e", "network": {"id": "38d66f09-c738-4e79-9aeb-12e87e29f568", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-447420743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "177bec65268546d2b899e09989183b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0478a2ae-a4", "ovs_interfaceid": "0478a2ae-a44c-4e56-bac8-7434c0d3af2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:03:49.500653 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Converting VIF {"id": "0478a2ae-a44c-4e56-bac8-7434c0d3af2a", "address": "fa:16:3e:61:10:5e", "network": {"id": "38d66f09-c738-4e79-9aeb-12e87e29f568", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-447420743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "177bec65268546d2b899e09989183b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0478a2ae-a4", "ovs_interfaceid": "0478a2ae-a44c-4e56-bac8-7434c0d3af2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:03:49.501396 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:10:5e,bridge_name='br-int',has_traffic_filtering=True,id=0478a2ae-a44c-4e56-bac8-7434c0d3af2a,network=Network(38d66f09-c738-4e79-9aeb-12e87e29f568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0478a2ae-a4') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:03:49.501712 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lazy-loading 'pci_devices' on Instance uuid d35a1f35-4fdd-4efa-a753-7aa8d1a205a8 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:03:49.775350 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-97bced5f-9525-4574-bc0c-9a02025bea01 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:03:49.794042 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:49.797762 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:49.817214 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:49.975069 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:49.982528 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:03:49.990054 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:03:49.996773 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:50.003531 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:50.008306 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] End _get_guest_xml xml=<domain type="qemu">
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:   <uuid>d35a1f35-4fdd-4efa-a753-7aa8d1a205a8</uuid>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:   <name>instance-00000025</name>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-677776071</nova:name>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:03:49</nova:creationTime>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:         <nova:user uuid="c0efcbc1b88f49989c9f6b6a7439f2c4">tempest-TestEncryptedCinderVolumes-991116896-project-member</nova:user>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:         <nova:project uuid="177bec65268546d2b899e09989183b6e">tempest-TestEncryptedCinderVolumes-991116896</nova:project>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:         <nova:port uuid="0478a2ae-a44c-4e56-bac8-7434c0d3af2a">
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:     <system>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:       <entry name="serial">d35a1f35-4fdd-4efa-a753-7aa8d1a205a8</entry>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:       <entry name="uuid">d35a1f35-4fdd-4efa-a753-7aa8d1a205a8</entry>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:     </system>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:   <os>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:   </os>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:   <features>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:   </features>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:   <devices>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/d35a1f35-4fdd-4efa-a753-7aa8d1a205a8/disk"/>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:     </disk>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/d35a1f35-4fdd-4efa-a753-7aa8d1a205a8/disk.config"/>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:     </disk>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:61:10:5e"/>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:       <target dev="tap0478a2ae-a4"/>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:     </interface>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/d35a1f35-4fdd-4efa-a753-7aa8d1a205a8/console.log" append="off"/>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:     </serial>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:     <video>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:     </video>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:     </rng>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:   </devices>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]: </domain>
May 21 02:03:50.008306 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:03:50.008306 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Preparing to wait for external event network-vif-plugged-0478a2ae-a44c-4e56-bac8-7434c0d3af2a {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:03:50.008306 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "d35a1f35-4fdd-4efa-a753-7aa8d1a205a8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:50.013326 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "d35a1f35-4fdd-4efa-a753-7aa8d1a205a8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:50.013326 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "d35a1f35-4fdd-4efa-a753-7aa8d1a205a8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:50.013326 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:03:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-677776071',display_name='tempest-TestEncryptedCinderVolumes-server-677776071',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testencryptedcindervolumes-server-677776071',id=37,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTpWBzLpDObU/KfOerIlcjfmK1W7wNqlOeuHR2EDlVWezLFMgXgV+cgYLad5hJ8gsfoDqBBhjKd36bII4QWX5x7odWsUHCcT+rx4JzMW0D9m6XFd7CH79hxLomEJWdIhg==',key_name='tempest-keypair-2139954079',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='177bec65268546d2b899e09989183b6e',ramdisk_id='',reservation_id='r-z1j7wdmi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-991116896',owner_user_name='tempest-TestEncryptedCinderVolumes-991116896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:03:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0efcbc1b88f49989c9f6b6a7439f2c4',uuid=d35a1f35-4fdd-4efa-a753-7aa8d1a205a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0478a2ae-a44c-4e56-bac8-7434c0d3af2a", "address": "fa:16:3e:61:10:5e", "network": {"id": "38d66f09-c738-4e79-9aeb-12e87e29f568", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-447420743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "177bec65268546d2b899e09989183b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0478a2ae-a4", "ovs_interfaceid": "0478a2ae-a44c-4e56-bac8-7434c0d3af2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:03:50.013326 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Converting VIF {"id": "0478a2ae-a44c-4e56-bac8-7434c0d3af2a", "address": "fa:16:3e:61:10:5e", "network": {"id": "38d66f09-c738-4e79-9aeb-12e87e29f568", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-447420743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "177bec65268546d2b899e09989183b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0478a2ae-a4", "ovs_interfaceid": "0478a2ae-a44c-4e56-bac8-7434c0d3af2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:03:50.015570 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:10:5e,bridge_name='br-int',has_traffic_filtering=True,id=0478a2ae-a44c-4e56-bac8-7434c0d3af2a,network=Network(38d66f09-c738-4e79-9aeb-12e87e29f568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0478a2ae-a4') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:03:50.016613 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:10:5e,bridge_name='br-int',has_traffic_filtering=True,id=0478a2ae-a44c-4e56-bac8-7434c0d3af2a,network=Network(38d66f09-c738-4e79-9aeb-12e87e29f568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0478a2ae-a4') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:03:50.018976 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:50.018976 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:03:50.018976 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:03:50.022385 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:50.022385 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9fe258f8-bc06-5047-b202-0fae5e43d437', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:03:50.022890 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:50.023705 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:03:50.030003 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:50.039021 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:50.039240 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0478a2ae-a4, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:03:50.039663 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0478a2ae-a4, col_values=(('qos', UUID('f142e408-4565-48d0-97d9-891384ac2530')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:03:50.039883 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0478a2ae-a4, col_values=(('external_ids', {'iface-id': '0478a2ae-a44c-4e56-bac8-7434c0d3af2a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:10:5e', 'vm-uuid': 'd35a1f35-4fdd-4efa-a753-7aa8d1a205a8'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:03:50.043765 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:50.046678 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:03:50.087669 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:50.090608 np0000001127 nova-compute[98206]: INFO os_vif [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:10:5e,bridge_name='br-int',has_traffic_filtering=True,id=0478a2ae-a44c-4e56-bac8-7434c0d3af2a,network=Network(38d66f09-c738-4e79-9aeb-12e87e29f568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0478a2ae-a4')
May 21 02:03:50.121664 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:50.140716 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:50.158158 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Instance destroyed successfully.
May 21 02:03:50.158864 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-97bced5f-9525-4574-bc0c-9a02025bea01 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Lazy-loading 'resources' on Instance uuid 8411461f-7376-4907-a1ad-59b31e520f56 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:03:50.242823 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:50.392569 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:50.393143 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:50.495656 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329030.495032, 8948a19b-9e7e-448d-b782-be58020b5320 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:03:50.495815 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] VM Started (Lifecycle Event)
May 21 02:03:50.500966 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:50.504138 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:50.510880 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:50.627792 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:50.628810 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:50.672242 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-97bced5f-9525-4574-bc0c-9a02025bea01 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:03:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-453301296',display_name='tempest-ServersNegativeTestJSON-server-453301296',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serversnegativetestjson-server-453301296',id=36,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:03:47Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5852e542a6f42ffb8e104daf741f872',ramdisk_id='',reservation_id='r-beutvk2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1944632598',owner_user_name='tempest-ServersNegativeTestJSON-1944632598-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:03:48Z,user_data=None,user_id='9f1c1152331140f9b4acfc98d16623bc',uuid=8411461f-7376-4907-a1ad-59b31e520f56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a8ae0f9-583a-4b78-9099-269768bf1687", "address": "fa:16:3e:5c:38:d6", "network": {"id": "6d2e68f2-ff8f-41f5-accf-4865237c0702", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1863313078-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c5852e542a6f42ffb8e104daf741f872", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a8ae0f9-58", "ovs_interfaceid": "1a8ae0f9-583a-4b78-9099-269768bf1687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:03:50.672242 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-97bced5f-9525-4574-bc0c-9a02025bea01 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Converting VIF {"id": "1a8ae0f9-583a-4b78-9099-269768bf1687", "address": "fa:16:3e:5c:38:d6", "network": {"id": "6d2e68f2-ff8f-41f5-accf-4865237c0702", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1863313078-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c5852e542a6f42ffb8e104daf741f872", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a8ae0f9-58", "ovs_interfaceid": "1a8ae0f9-583a-4b78-9099-269768bf1687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:03:50.672242 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-97bced5f-9525-4574-bc0c-9a02025bea01 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:38:d6,bridge_name='br-int',has_traffic_filtering=True,id=1a8ae0f9-583a-4b78-9099-269768bf1687,network=Network(6d2e68f2-ff8f-41f5-accf-4865237c0702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a8ae0f9-58') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:03:50.672242 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-97bced5f-9525-4574-bc0c-9a02025bea01 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:38:d6,bridge_name='br-int',has_traffic_filtering=True,id=1a8ae0f9-583a-4b78-9099-269768bf1687,network=Network(6d2e68f2-ff8f-41f5-accf-4865237c0702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a8ae0f9-58') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:03:50.675701 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:50.676297 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a8ae0f9-58, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:03:50.678761 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:50.680111 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:03:50.687487 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:50.688875 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:50.689047 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=af4261c9-3cf7-4b41-bcb8-07cdff4c69cc) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:03:50.691933 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:50.692309 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:03:50.702300 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:50.706129 np0000001127 nova-compute[98206]: INFO os_vif [None req-97bced5f-9525-4574-bc0c-9a02025bea01 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:38:d6,bridge_name='br-int',has_traffic_filtering=True,id=1a8ae0f9-583a-4b78-9099-269768bf1687,network=Network(6d2e68f2-ff8f-41f5-accf-4865237c0702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a8ae0f9-58')
May 21 02:03:50.707251 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-97bced5f-9525-4574-bc0c-9a02025bea01 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Deleting instance files /opt/stack/data/nova/instances/8411461f-7376-4907-a1ad-59b31e520f56_del
May 21 02:03:50.707983 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-97bced5f-9525-4574-bc0c-9a02025bea01 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Deletion of /opt/stack/data/nova/instances/8411461f-7376-4907-a1ad-59b31e520f56_del complete
May 21 02:03:50.748961 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Updated VIF entry in instance network info cache for port 0478a2ae-a44c-4e56-bac8-7434c0d3af2a. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:03:50.748961 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Updating instance_info_cache with network_info: [{"id": "0478a2ae-a44c-4e56-bac8-7434c0d3af2a", "address": "fa:16:3e:61:10:5e", "network": {"id": "38d66f09-c738-4e79-9aeb-12e87e29f568", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-447420743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "177bec65268546d2b899e09989183b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0478a2ae-a4", "ovs_interfaceid": "0478a2ae-a44c-4e56-bac8-7434c0d3af2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:03:50.758295 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:50.763347 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-7 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:03:50.764836 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:03:50.766337 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee14489e-8772-4a35-b7e7-760bc8f7f4ad/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:50.876287 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee14489e-8772-4a35-b7e7-760bc8f7f4ad/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:50.876927 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee14489e-8772-4a35-b7e7-760bc8f7f4ad/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:50.980041 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee14489e-8772-4a35-b7e7-760bc8f7f4ad/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:50.986532 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8948a19b-9e7e-448d-b782-be58020b5320/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:51.004091 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:03:51.008651 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:03:51.085442 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8948a19b-9e7e-448d-b782-be58020b5320/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:51.085964 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8948a19b-9e7e-448d-b782-be58020b5320/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:51.182917 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8948a19b-9e7e-448d-b782-be58020b5320/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:51.183037 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-11 (vdb) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:03:51.187185 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk.rescue --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:51.223461 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-97bced5f-9525-4574-bc0c-9a02025bea01 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Took 1.45 seconds to destroy the instance on the hypervisor.
May 21 02:03:51.224597 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-97bced5f-9525-4574-bc0c-9a02025bea01 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:03:51.226663 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:03:51.226663 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:03:51.226663 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:51.252347 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] Releasing lock "refresh_cache-d35a1f35-4fdd-4efa-a753-7aa8d1a205a8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:03:51.253385 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Received event network-vif-plugged-9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:51.253385 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] Acquiring lock "8948a19b-9e7e-448d-b782-be58020b5320-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:51.253594 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] Lock "8948a19b-9e7e-448d-b782-be58020b5320-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:51.253704 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] Lock "8948a19b-9e7e-448d-b782-be58020b5320-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:51.253925 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] No waiting events found dispatching network-vif-plugged-9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:03:51.254247 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Received unexpected event network-vif-plugged-9089f785-707f-4bb7-ac00-927fe747fcc5 for instance with vm_state rescued and task_state unrescuing.
May 21 02:03:51.254303 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Received event network-vif-plugged-9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:51.254599 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] Acquiring lock "8948a19b-9e7e-448d-b782-be58020b5320-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:51.254795 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] Lock "8948a19b-9e7e-448d-b782-be58020b5320-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:51.254936 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] Lock "8948a19b-9e7e-448d-b782-be58020b5320-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:51.255077 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] No waiting events found dispatching network-vif-plugged-9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:03:51.255205 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Received unexpected event network-vif-plugged-9089f785-707f-4bb7-ac00-927fe747fcc5 for instance with vm_state rescued and task_state unrescuing.
May 21 02:03:51.255396 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Received event network-vif-unplugged-9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:51.255625 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] Acquiring lock "8948a19b-9e7e-448d-b782-be58020b5320-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:51.255848 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] Lock "8948a19b-9e7e-448d-b782-be58020b5320-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:51.256023 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] Lock "8948a19b-9e7e-448d-b782-be58020b5320-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:51.256199 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] No waiting events found dispatching network-vif-unplugged-9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:03:51.256366 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Received unexpected event network-vif-unplugged-9089f785-707f-4bb7-ac00-927fe747fcc5 for instance with vm_state rescued and task_state unrescuing.
May 21 02:03:51.256811 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Received event network-vif-unplugged-9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:51.256811 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] Acquiring lock "8948a19b-9e7e-448d-b782-be58020b5320-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:51.256931 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] Lock "8948a19b-9e7e-448d-b782-be58020b5320-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:51.257179 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] Lock "8948a19b-9e7e-448d-b782-be58020b5320-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:51.258497 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] No waiting events found dispatching network-vif-unplugged-9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:03:51.258497 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Received unexpected event network-vif-unplugged-9089f785-707f-4bb7-ac00-927fe747fcc5 for instance with vm_state rescued and task_state unrescuing.
May 21 02:03:51.258497 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Received event network-vif-plugged-9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:51.258497 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] Acquiring lock "8948a19b-9e7e-448d-b782-be58020b5320-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:51.258497 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] Lock "8948a19b-9e7e-448d-b782-be58020b5320-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:51.258702 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] Lock "8948a19b-9e7e-448d-b782-be58020b5320-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:51.258842 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] No waiting events found dispatching network-vif-plugged-9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:03:51.259069 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Received unexpected event network-vif-plugged-9089f785-707f-4bb7-ac00-927fe747fcc5 for instance with vm_state rescued and task_state unrescuing.
May 21 02:03:51.259223 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Received event network-vif-plugged-9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:51.261161 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] Acquiring lock "8948a19b-9e7e-448d-b782-be58020b5320-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:51.263035 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] Lock "8948a19b-9e7e-448d-b782-be58020b5320-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:51.263196 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] Lock "8948a19b-9e7e-448d-b782-be58020b5320-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:51.264068 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c8f045fc-7881-4b07-8a2e-bf14b028f356 req-7d340bce-44ab-4871-94c2-1a27b7cb98eb service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Received event network-changed-9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:51.264068 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c8f045fc-7881-4b07-8a2e-bf14b028f356 req-7d340bce-44ab-4871-94c2-1a27b7cb98eb service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Refreshing instance network info cache due to event network-changed-9089f785-707f-4bb7-ac00-927fe747fcc5. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:03:51.264172 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c8f045fc-7881-4b07-8a2e-bf14b028f356 req-7d340bce-44ab-4871-94c2-1a27b7cb98eb service nova] Acquiring lock "refresh_cache-8948a19b-9e7e-448d-b782-be58020b5320" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:03:51.264204 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c8f045fc-7881-4b07-8a2e-bf14b028f356 req-7d340bce-44ab-4871-94c2-1a27b7cb98eb service nova] Acquired lock "refresh_cache-8948a19b-9e7e-448d-b782-be58020b5320" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:03:51.264344 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-c8f045fc-7881-4b07-8a2e-bf14b028f356 req-7d340bce-44ab-4871-94c2-1a27b7cb98eb service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Refreshing network info cache for port 9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:03:51.265795 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] No waiting events found dispatching network-vif-plugged-9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:03:51.265795 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-b670f248-56ea-495c-a254-ff8b8ab25e15 req-6aaf130c-7596-4fb9-850e-fa5a79eb6a93 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Received unexpected event network-vif-plugged-9089f785-707f-4bb7-ac00-927fe747fcc5 for instance with vm_state rescued and task_state unrescuing.
May 21 02:03:51.285998 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk.rescue --force-share --output=json" returned: 0 in 0.099s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:51.286418 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk.rescue --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:51.305119 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:51.376983 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk.rescue --force-share --output=json" returned: 0 in 0.090s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:51.377651 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:51.479656 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:51.486622 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:51.487967 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:51.514463 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.998956204000024 future=<Future at 0x71c07c5575f0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:03:51.613169 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:51.616841 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Error from libvirt while getting description of instance-00000024: [Error Code 42] Domain not found: no domain with matching uuid '8411461f-7376-4907-a1ad-59b31e520f56' (instance-00000024): libvirt.libvirtError: Domain not found: no domain with matching uuid '8411461f-7376-4907-a1ad-59b31e520f56' (instance-00000024)
May 21 02:03:51.620085 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:51.638731 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:03:51.638854 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:03:51.639004 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] No VIF found with MAC fa:16:3e:61:10:5e, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:03:51.645493 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Using config drive
May 21 02:03:51.722217 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:51.722810 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:51.769463 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-c8f045fc-7881-4b07-8a2e-bf14b028f356 req-7d340bce-44ab-4871-94c2-1a27b7cb98eb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:51.818986 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:51.823639 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:51.929452 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:51.929979 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:52.038153 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:52.042488 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:03:52.044050 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:52.070034 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:03:52.111451 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "env LANG=C uptime" returned: 0 in 0.067s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:52.112072 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Hypervisor/Node resource view: name=np0000001127 free_ram=11612MB free_disk=73.99156951904297GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 21 02:03:52.112293 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:52.113025 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:52.159190 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:52.248281 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-c8f045fc-7881-4b07-8a2e-bf14b028f356 req-7d340bce-44ab-4871-94c2-1a27b7cb98eb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:52.372373 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Creating config drive at /opt/stack/data/nova/instances/d35a1f35-4fdd-4efa-a753-7aa8d1a205a8/disk.config
May 21 02:03:52.379261 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d35a1f35-4fdd-4efa-a753-7aa8d1a205a8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpupzafg5m {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:03:52.401049 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-c8f045fc-7881-4b07-8a2e-bf14b028f356 req-7d340bce-44ab-4871-94c2-1a27b7cb98eb service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Updated VIF entry in instance network info cache for port 9089f785-707f-4bb7-ac00-927fe747fcc5. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:03:52.401415 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-c8f045fc-7881-4b07-8a2e-bf14b028f356 req-7d340bce-44ab-4871-94c2-1a27b7cb98eb service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Updating instance_info_cache with network_info: [{"id": "9089f785-707f-4bb7-ac00-927fe747fcc5", "address": "fa:16:3e:27:71:42", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9089f785-70", "ovs_interfaceid": "9089f785-707f-4bb7-ac00-927fe747fcc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:03:52.438982 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d35a1f35-4fdd-4efa-a753-7aa8d1a205a8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpupzafg5m" returned: 0 in 0.059s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:03:52.583914 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Took 1.36 seconds to deallocate network for instance.
May 21 02:03:52.905277 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c8f045fc-7881-4b07-8a2e-bf14b028f356 req-7d340bce-44ab-4871-94c2-1a27b7cb98eb service nova] Releasing lock "refresh_cache-8948a19b-9e7e-448d-b782-be58020b5320" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:03:52.988547 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:53.009804 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:53.012054 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:53.092377 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-97bced5f-9525-4574-bc0c-9a02025bea01 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:53.178030 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:53.240553 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 29a124ee-2b8c-4f44-8f91-8dd11ac78b52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:03:53.240791 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 66fe5d80-9012-44fe-9b82-1e993211ddf1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:03:53.241153 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance df1fb869-23ef-48e0-b609-ce91c2540c2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:03:53.241584 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance e158490e-746e-4c3b-924e-9aceed1662d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:03:53.241897 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance e95baab0-2c43-4653-b7ae-b9d8920aba33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:03:53.242156 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 8948a19b-9e7e-448d-b782-be58020b5320 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:03:53.242382 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:03:53.242649 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance ee14489e-8772-4a35-b7e7-760bc8f7f4ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:03:53.242898 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 76097fea-0890-40a8-a902-9f510cd34b52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:03:53.244504 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 8411461f-7376-4907-a1ad-59b31e520f56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:03:53.244504 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance d35a1f35-4fdd-4efa-a753-7aa8d1a205a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:03:53.244504 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 21 02:03:53.244504 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Final resource view: name=np0000001127 phys_ram=24030MB used_ram=2688MB phys_disk=95GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:03:52 up 34 min,  2 users,  load average: 10.26, 8.33, 4.69\n', 'num_instances': '11', 'num_vm_active': '9', 'num_task_None': '9', 'num_os_type_None': '11', 'num_proj_6a15fe7a70464159a778cffa4a36c36f': '2', 'io_workload': '1', 'num_proj_e80cee8643f34f6685ff7fb42920afc3': '1', 'num_proj_87eb25eb23724c49b5bdbc462a1f36bc': '3', 'num_vm_rescued': '1', 'num_proj_db73ea4d098a4b768f0b51d6cbe9eda8': '1', 'num_proj_c5852e542a6f42ffb8e104daf741f872': '2', 'num_proj_e98d81a820544f078c16b171f1e8b65c': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_177bec65268546d2b899e09989183b6e': '1', 'num_task_deleting': '1'} {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 21 02:03:53.416739 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:53.421372 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:53.426013 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:53.430822 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:53.434716 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-25b6ee12-45d5-4247-ae01-b4cb14d0376f req-858959c0-b43d-4f14-ab53-70f1585e9418 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Received event network-changed-9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:53.434716 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-25b6ee12-45d5-4247-ae01-b4cb14d0376f req-858959c0-b43d-4f14-ab53-70f1585e9418 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Refreshing instance network info cache due to event network-changed-9089f785-707f-4bb7-ac00-927fe747fcc5. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:03:53.434716 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-25b6ee12-45d5-4247-ae01-b4cb14d0376f req-858959c0-b43d-4f14-ab53-70f1585e9418 service nova] Acquiring lock "refresh_cache-8948a19b-9e7e-448d-b782-be58020b5320" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:03:53.434716 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-25b6ee12-45d5-4247-ae01-b4cb14d0376f req-858959c0-b43d-4f14-ab53-70f1585e9418 service nova] Acquired lock "refresh_cache-8948a19b-9e7e-448d-b782-be58020b5320" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:03:53.434716 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-25b6ee12-45d5-4247-ae01-b4cb14d0376f req-858959c0-b43d-4f14-ab53-70f1585e9418 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Refreshing network info cache for port 9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:03:53.454315 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:53.609259 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-406f3a96-4953-419c-bb28-734a0828579e req-8497e4d4-6f6c-48b1-88e1-3a179bd4b1c5 service nova] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Received event network-vif-plugged-0478a2ae-a44c-4e56-bac8-7434c0d3af2a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:53.609259 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-406f3a96-4953-419c-bb28-734a0828579e req-8497e4d4-6f6c-48b1-88e1-3a179bd4b1c5 service nova] Acquiring lock "d35a1f35-4fdd-4efa-a753-7aa8d1a205a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:53.609430 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-406f3a96-4953-419c-bb28-734a0828579e req-8497e4d4-6f6c-48b1-88e1-3a179bd4b1c5 service nova] Lock "d35a1f35-4fdd-4efa-a753-7aa8d1a205a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:53.609501 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-406f3a96-4953-419c-bb28-734a0828579e req-8497e4d4-6f6c-48b1-88e1-3a179bd4b1c5 service nova] Lock "d35a1f35-4fdd-4efa-a753-7aa8d1a205a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:53.609663 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-406f3a96-4953-419c-bb28-734a0828579e req-8497e4d4-6f6c-48b1-88e1-3a179bd4b1c5 service nova] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Processing event network-vif-plugged-0478a2ae-a44c-4e56-bac8-7434c0d3af2a {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:03:53.938734 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-25b6ee12-45d5-4247-ae01-b4cb14d0376f req-858959c0-b43d-4f14-ab53-70f1585e9418 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:54.051838 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:03:54.052151 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:03:54.225030 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329034.2245893, d35a1f35-4fdd-4efa-a753-7aa8d1a205a8 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:03:54.226880 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:03:54.227200 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] VM Started (Lifecycle Event)
May 21 02:03:54.230563 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:03:54.236529 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Instance spawned successfully.
May 21 02:03:54.237255 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:03:54.357616 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-25b6ee12-45d5-4247-ae01-b4cb14d0376f req-858959c0-b43d-4f14-ab53-70f1585e9418 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:54.512686 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:54.555918 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:03:54.644101 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-25b6ee12-45d5-4247-ae01-b4cb14d0376f req-858959c0-b43d-4f14-ab53-70f1585e9418 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Updated VIF entry in instance network info cache for port 9089f785-707f-4bb7-ac00-927fe747fcc5. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:03:54.646239 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-25b6ee12-45d5-4247-ae01-b4cb14d0376f req-858959c0-b43d-4f14-ab53-70f1585e9418 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Updating instance_info_cache with network_info: [{"id": "9089f785-707f-4bb7-ac00-927fe747fcc5", "address": "fa:16:3e:27:71:42", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9089f785-70", "ovs_interfaceid": "9089f785-707f-4bb7-ac00-927fe747fcc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:03:54.733497 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:03:54.739081 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:03:54.749607 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:03:54.750935 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:03:54.750935 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:03:54.751321 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:03:54.751844 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:03:54.752235 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:03:55.068792 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Compute_service record updated for np0000001127:np0000001127 {{(pid=98206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 21 02:03:55.068792 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.956s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:55.068996 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-97bced5f-9525-4574-bc0c-9a02025bea01 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.977s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:55.070239 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.87 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:03:55.151630 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-25b6ee12-45d5-4247-ae01-b4cb14d0376f req-858959c0-b43d-4f14-ab53-70f1585e9418 service nova] Releasing lock "refresh_cache-8948a19b-9e7e-448d-b782-be58020b5320" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:03:55.152233 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-25b6ee12-45d5-4247-ae01-b4cb14d0376f req-858959c0-b43d-4f14-ab53-70f1585e9418 service nova] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Received event network-vif-deleted-1a8ae0f9-583a-4b78-9099-269768bf1687 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:55.246713 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:03:55.247037 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329035.246785, d35a1f35-4fdd-4efa-a753-7aa8d1a205a8 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:03:55.247150 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] VM Paused (Lifecycle Event)
May 21 02:03:55.261406 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Took 8.33 seconds to spawn the instance on the hypervisor.
May 21 02:03:55.263099 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:03:55.691520 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:55.744579 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-03d4b788-9533-46c6-a3f7-4c63983dc349 req-d9ce6936-10e9-48dd-b107-ed1bb7f27659 service nova] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Received event network-vif-plugged-0478a2ae-a44c-4e56-bac8-7434c0d3af2a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:55.744579 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-03d4b788-9533-46c6-a3f7-4c63983dc349 req-d9ce6936-10e9-48dd-b107-ed1bb7f27659 service nova] Acquiring lock "d35a1f35-4fdd-4efa-a753-7aa8d1a205a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:55.744579 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-03d4b788-9533-46c6-a3f7-4c63983dc349 req-d9ce6936-10e9-48dd-b107-ed1bb7f27659 service nova] Lock "d35a1f35-4fdd-4efa-a753-7aa8d1a205a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:55.744579 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-03d4b788-9533-46c6-a3f7-4c63983dc349 req-d9ce6936-10e9-48dd-b107-ed1bb7f27659 service nova] Lock "d35a1f35-4fdd-4efa-a753-7aa8d1a205a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:55.744579 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-03d4b788-9533-46c6-a3f7-4c63983dc349 req-d9ce6936-10e9-48dd-b107-ed1bb7f27659 service nova] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] No waiting events found dispatching network-vif-plugged-0478a2ae-a44c-4e56-bac8-7434c0d3af2a {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:03:55.744579 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-03d4b788-9533-46c6-a3f7-4c63983dc349 req-d9ce6936-10e9-48dd-b107-ed1bb7f27659 service nova] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Received unexpected event network-vif-plugged-0478a2ae-a44c-4e56-bac8-7434c0d3af2a for instance with vm_state active and task_state None.
May 21 02:03:55.753658 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:03:55.756588 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329035.755544, d35a1f35-4fdd-4efa-a753-7aa8d1a205a8 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:03:55.756588 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] VM Resumed (Lifecycle Event)
May 21 02:03:55.787205 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Took 14.37 seconds to build instance.
May 21 02:03:55.843134 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-97bced5f-9525-4574-bc0c-9a02025bea01 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:03:55.843352 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-97bced5f-9525-4574-bc0c-9a02025bea01 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:03:56.259093 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:03:56.264094 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:03:56.288931 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "d35a1f35-4fdd-4efa-a753-7aa8d1a205a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.883s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:56.347427 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-97bced5f-9525-4574-bc0c-9a02025bea01 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:03:56.482774 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:56.753395 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:56.856331 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-97bced5f-9525-4574-bc0c-9a02025bea01 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.787s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:56.936578 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-97bced5f-9525-4574-bc0c-9a02025bea01 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Deleted allocations for instance 8411461f-7376-4907-a1ad-59b31e520f56
May 21 02:03:56.944057 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:03:56.945982 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:03:56.945982 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.71 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:03:57.163239 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8db0bfb6-65ef-4fc0-a0a4-81b808dd22a6 req-e22986d9-44ae-47b8-9f64-7178cbb0186f service nova] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Received event network-changed-0478a2ae-a44c-4e56-bac8-7434c0d3af2a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:57.164720 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8db0bfb6-65ef-4fc0-a0a4-81b808dd22a6 req-e22986d9-44ae-47b8-9f64-7178cbb0186f service nova] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Refreshing instance network info cache due to event network-changed-0478a2ae-a44c-4e56-bac8-7434c0d3af2a. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:03:57.169660 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8db0bfb6-65ef-4fc0-a0a4-81b808dd22a6 req-e22986d9-44ae-47b8-9f64-7178cbb0186f service nova] Acquiring lock "refresh_cache-d35a1f35-4fdd-4efa-a753-7aa8d1a205a8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:03:57.169660 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8db0bfb6-65ef-4fc0-a0a4-81b808dd22a6 req-e22986d9-44ae-47b8-9f64-7178cbb0186f service nova] Acquired lock "refresh_cache-d35a1f35-4fdd-4efa-a753-7aa8d1a205a8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:03:57.169660 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-8db0bfb6-65ef-4fc0-a0a4-81b808dd22a6 req-e22986d9-44ae-47b8-9f64-7178cbb0186f service nova] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Refreshing network info cache for port 0478a2ae-a44c-4e56-bac8-7434c0d3af2a {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:03:57.659538 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:03:57.669742 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-8db0bfb6-65ef-4fc0-a0a4-81b808dd22a6 req-e22986d9-44ae-47b8-9f64-7178cbb0186f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:57.947309 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-97bced5f-9525-4574-bc0c-9a02025bea01 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Lock "8411461f-7376-4907-a1ad-59b31e520f56" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.681s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:58.045821 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-8db0bfb6-65ef-4fc0-a0a4-81b808dd22a6 req-e22986d9-44ae-47b8-9f64-7178cbb0186f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:03:58.168011 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Triggering sync for uuid 29a124ee-2b8c-4f44-8f91-8dd11ac78b52 {{(pid=98206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 21 02:03:58.168614 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Triggering sync for uuid 66fe5d80-9012-44fe-9b82-1e993211ddf1 {{(pid=98206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 21 02:03:58.169207 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "29a124ee-2b8c-4f44-8f91-8dd11ac78b52" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:58.169534 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "29a124ee-2b8c-4f44-8f91-8dd11ac78b52" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:58.169885 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Triggering sync for uuid df1fb869-23ef-48e0-b609-ce91c2540c2e {{(pid=98206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 21 02:03:58.170583 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "66fe5d80-9012-44fe-9b82-1e993211ddf1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:58.170583 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "66fe5d80-9012-44fe-9b82-1e993211ddf1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:58.170880 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Triggering sync for uuid e158490e-746e-4c3b-924e-9aceed1662d0 {{(pid=98206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 21 02:03:58.171247 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "df1fb869-23ef-48e0-b609-ce91c2540c2e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:58.171455 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:58.171956 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Triggering sync for uuid e95baab0-2c43-4653-b7ae-b9d8920aba33 {{(pid=98206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 21 02:03:58.172337 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "e158490e-746e-4c3b-924e-9aceed1662d0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:58.173418 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Triggering sync for uuid 8948a19b-9e7e-448d-b782-be58020b5320 {{(pid=98206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 21 02:03:58.173418 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Triggering sync for uuid 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61 {{(pid=98206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 21 02:03:58.173638 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "e158490e-746e-4c3b-924e-9aceed1662d0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:58.173852 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "e95baab0-2c43-4653-b7ae-b9d8920aba33" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:58.177804 np0000001127 nova-compute[98206]: WARNING nova.utils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x71c07c516480> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
May 21 02:03:58.179864 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "e95baab0-2c43-4653-b7ae-b9d8920aba33" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.004s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:58.181668 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Triggering sync for uuid ee14489e-8772-4a35-b7e7-760bc8f7f4ad {{(pid=98206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 21 02:03:58.182078 np0000001127 nova-compute[98206]: WARNING nova.utils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x71c07c516480> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
May 21 02:03:58.182291 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Triggering sync for uuid 76097fea-0890-40a8-a902-9f510cd34b52 {{(pid=98206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 21 02:03:58.182455 np0000001127 nova-compute[98206]: WARNING nova.utils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x71c07c516480> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
May 21 02:03:58.182696 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Triggering sync for uuid d35a1f35-4fdd-4efa-a753-7aa8d1a205a8 {{(pid=98206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 21 02:03:58.182831 np0000001127 nova-compute[98206]: WARNING nova.utils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x71c07c516480> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
May 21 02:03:58.183141 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.89 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:03:58.248585 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-8db0bfb6-65ef-4fc0-a0a4-81b808dd22a6 req-e22986d9-44ae-47b8-9f64-7178cbb0186f service nova] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Updated VIF entry in instance network info cache for port 0478a2ae-a44c-4e56-bac8-7434c0d3af2a. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:03:58.248585 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-8db0bfb6-65ef-4fc0-a0a4-81b808dd22a6 req-e22986d9-44ae-47b8-9f64-7178cbb0186f service nova] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Updating instance_info_cache with network_info: [{"id": "0478a2ae-a44c-4e56-bac8-7434c0d3af2a", "address": "fa:16:3e:61:10:5e", "network": {"id": "38d66f09-c738-4e79-9aeb-12e87e29f568", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-447420743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "177bec65268546d2b899e09989183b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0478a2ae-a4", "ovs_interfaceid": "0478a2ae-a44c-4e56-bac8-7434c0d3af2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:03:58.494548 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Acquiring lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:58.497537 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:58.497537 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Shelve offloading
May 21 02:03:58.680854 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "66fe5d80-9012-44fe-9b82-1e993211ddf1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.510s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:58.681326 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "8948a19b-9e7e-448d-b782-be58020b5320" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:58.681398 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "8948a19b-9e7e-448d-b782-be58020b5320" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:58.682841 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "29a124ee-2b8c-4f44-8f91-8dd11ac78b52" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.513s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:58.682841 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:58.684095 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "e158490e-746e-4c3b-924e-9aceed1662d0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.511s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:58.684506 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "ee14489e-8772-4a35-b7e7-760bc8f7f4ad" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:58.684610 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "ee14489e-8772-4a35-b7e7-760bc8f7f4ad" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:58.691546 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.519s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:58.691546 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "76097fea-0890-40a8-a902-9f510cd34b52" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:58.693550 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "76097fea-0890-40a8-a902-9f510cd34b52" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:58.696431 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "e95baab0-2c43-4653-b7ae-b9d8920aba33" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.519s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:58.701694 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "d35a1f35-4fdd-4efa-a753-7aa8d1a205a8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:58.701694 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "d35a1f35-4fdd-4efa-a753-7aa8d1a205a8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:58.749598 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8db0bfb6-65ef-4fc0-a0a4-81b808dd22a6 req-e22986d9-44ae-47b8-9f64-7178cbb0186f service nova] Releasing lock "refresh_cache-d35a1f35-4fdd-4efa-a753-7aa8d1a205a8" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:03:59.190028 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "8948a19b-9e7e-448d-b782-be58020b5320" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.508s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:59.201418 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "ee14489e-8772-4a35-b7e7-760bc8f7f4ad" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.517s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:59.208004 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "76097fea-0890-40a8-a902-9f510cd34b52" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.517s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:59.210511 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "d35a1f35-4fdd-4efa-a753-7aa8d1a205a8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.511s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:59.534123 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:59.539813 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:59.561143 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:59.569220 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:59.598615 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:59.599745 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:59.761084 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e9c15382-9b4b-48e2-951f-eb7351ba64c7 req-2f5215c6-e6e0-4c40-86a5-b2fd31c813e6 service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Received event network-vif-unplugged-01b64dbf-89aa-471a-a2df-58edb2a7a254 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:03:59.761607 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e9c15382-9b4b-48e2-951f-eb7351ba64c7 req-2f5215c6-e6e0-4c40-86a5-b2fd31c813e6 service nova] Acquiring lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:03:59.761607 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e9c15382-9b4b-48e2-951f-eb7351ba64c7 req-2f5215c6-e6e0-4c40-86a5-b2fd31c813e6 service nova] Lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:03:59.761607 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e9c15382-9b4b-48e2-951f-eb7351ba64c7 req-2f5215c6-e6e0-4c40-86a5-b2fd31c813e6 service nova] Lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:03:59.761763 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e9c15382-9b4b-48e2-951f-eb7351ba64c7 req-2f5215c6-e6e0-4c40-86a5-b2fd31c813e6 service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] No waiting events found dispatching network-vif-unplugged-01b64dbf-89aa-471a-a2df-58edb2a7a254 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:03:59.763741 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-e9c15382-9b4b-48e2-951f-eb7351ba64c7 req-2f5215c6-e6e0-4c40-86a5-b2fd31c813e6 service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Received unexpected event network-vif-unplugged-01b64dbf-89aa-471a-a2df-58edb2a7a254 for instance with vm_state active and task_state shelving.
May 21 02:03:59.826033 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:59.837461 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:03:59.849732 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999610437999763 future=<Future at 0x71c09cfc61e0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:03:59.852250 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Instance destroyed successfully.
May 21 02:03:59.852722 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lazy-loading 'numa_topology' on Instance uuid 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:04:00.192181 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "d3816229-124e-468b-959d-030180d271c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:00.192262 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "d3816229-124e-468b-959d-030180d271c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:00.356351 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:04:00.357971 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Acquiring lock "refresh_cache-2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:04:00.358188 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Acquired lock "refresh_cache-2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:04:00.358327 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:04:00.692586 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:00.694860 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:04:00.860495 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:01.279041 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:01.285393 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:01.285792 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:01.290349 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:04:01.290573 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Claim successful on node np0000001127
May 21 02:04:01.455691 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Updating instance_info_cache with network_info: [{"id": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "address": "fa:16:3e:ed:a6:59", "network": {"id": "56a7d47c-c10f-4969-a14d-a81a8b4f0e1c", "bridge": "br-int", "label": "tempest-TestShelveInstance-781032295-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db73ea4d098a4b768f0b51d6cbe9eda8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b64dbf-89", "ovs_interfaceid": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:04:01.483533 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:01.513247 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.00039322099974015146 future=<Future at 0x71c0983bd0d0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:01.513387 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:01.513489 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=4.999861474000227 future=<Future at 0x71c07c5575f0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:01.513570 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=4.999734479000381 future=<Future at 0x71c07c5575f0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:01.820493 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a2685cdc-b4dd-4b33-b944-e081d82f25cc req-9559347b-be34-4484-871b-21b2b7f1e7d5 service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Received event network-vif-unplugged-01b64dbf-89aa-471a-a2df-58edb2a7a254 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:01.820848 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a2685cdc-b4dd-4b33-b944-e081d82f25cc req-9559347b-be34-4484-871b-21b2b7f1e7d5 service nova] Acquiring lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:01.821016 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a2685cdc-b4dd-4b33-b944-e081d82f25cc req-9559347b-be34-4484-871b-21b2b7f1e7d5 service nova] Lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:01.821220 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a2685cdc-b4dd-4b33-b944-e081d82f25cc req-9559347b-be34-4484-871b-21b2b7f1e7d5 service nova] Lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:01.821220 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a2685cdc-b4dd-4b33-b944-e081d82f25cc req-9559347b-be34-4484-871b-21b2b7f1e7d5 service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] No waiting events found dispatching network-vif-unplugged-01b64dbf-89aa-471a-a2df-58edb2a7a254 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:04:01.821308 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-a2685cdc-b4dd-4b33-b944-e081d82f25cc req-9559347b-be34-4484-871b-21b2b7f1e7d5 service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Received unexpected event network-vif-unplugged-01b64dbf-89aa-471a-a2df-58edb2a7a254 for instance with vm_state active and task_state shelving.
May 21 02:04:01.957836 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Releasing lock "refresh_cache-2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:04:01.958376 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:01.958376 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:02.519874 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Instance destroyed successfully.
May 21 02:04:02.520874 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lazy-loading 'resources' on Instance uuid 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:04:02.984911 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:04:02.985540 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:04:03.022969 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Object Instance<2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61> lazy-loaded attributes: numa_topology,resources {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:04:03.023730 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:02:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2112280893',display_name='tempest-TestShelveInstance-server-2112280893',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testshelveinstance-server-2112280893',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKg59I6WmGN0vl+Yr0jgT9PuUDGWUY6yf9vpZilx62JeV2qSOqh9YtAt/kfJ2GJwnEwbhZeLHjGZ5bn7cuWJBoTGUXrOx2rpzPhSzUdpCOkXSzB0vlWvtf/xO7vuSD50lg==',key_name='tempest-TestShelveInstance-1094914629',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:03:15Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db73ea4d098a4b768f0b51d6cbe9eda8',ramdisk_id='',reservation_id='r-icby8s1w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1611299604',owner_user_name='tempest-TestShelveInstance-1611299604-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:03:15Z,user_data=None,user_id='1ebeaddb48014da28103c3479e9b250b',uuid=2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "address": "fa:16:3e:ed:a6:59", "network": {"id": "56a7d47c-c10f-4969-a14d-a81a8b4f0e1c", "bridge": "br-int", "label": "tempest-TestShelveInstance-781032295-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db73ea4d098a4b768f0b51d6cbe9eda8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b64dbf-89", "ovs_interfaceid": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:04:03.023939 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Converting VIF {"id": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "address": "fa:16:3e:ed:a6:59", "network": {"id": "56a7d47c-c10f-4969-a14d-a81a8b4f0e1c", "bridge": "br-int", "label": "tempest-TestShelveInstance-781032295-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db73ea4d098a4b768f0b51d6cbe9eda8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b64dbf-89", "ovs_interfaceid": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:04:03.024721 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a6:59,bridge_name='br-int',has_traffic_filtering=True,id=01b64dbf-89aa-471a-a2df-58edb2a7a254,network=Network(56a7d47c-c10f-4969-a14d-a81a8b4f0e1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b64dbf-89') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:04:03.024944 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a6:59,bridge_name='br-int',has_traffic_filtering=True,id=01b64dbf-89aa-471a-a2df-58edb2a7a254,network=Network(56a7d47c-c10f-4969-a14d-a81a8b4f0e1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b64dbf-89') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:04:03.026610 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:03.026984 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01b64dbf-89, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:04:03.028339 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:03.029480 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:04:03.029675 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:03.030591 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:03.030748 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f645436d-98cd-4e50-94fe-c397ebf14ebf) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:04:03.031247 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:03.031893 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:04:03.034246 np0000001127 nova-compute[98206]: INFO os_vif [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a6:59,bridge_name='br-int',has_traffic_filtering=True,id=01b64dbf-89aa-471a-a2df-58edb2a7a254,network=Network(56a7d47c-c10f-4969-a14d-a81a8b4f0e1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b64dbf-89')
May 21 02:04:03.035861 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:04:03.036262 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c67c8aea-4ddd-455a-ae1e-631955ce95da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:04:03.036593 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:04:03.037123 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:04:03.037644 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c67c8aea-4ddd-455a-ae1e-631955ce95da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:04:03.037883 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:04:03.071015 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:03.071015 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:03.071015 np0000001127 nova-compute[98206]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:03.071015 np0000001127 nova-compute[98206]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:03.071015 np0000001127 nova-compute[98206]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:03.071015 np0000001127 nova-compute[98206]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:03.071015 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:04:03.071015 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:03.071015 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:03.071015 np0000001127 nova-compute[98206]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:03.071015 np0000001127 nova-compute[98206]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:03.071015 np0000001127 nova-compute[98206]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:03.071015 np0000001127 nova-compute[98206]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:03.071015 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:04:03.071015 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', '78'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', '79'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a', '82'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a', '83')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:04:03.071015 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', '78')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:04:03.071015 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', '79')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:04:03.071893 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c744400>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da'): ({'sdk'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:04:03.071893 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Removing multipathed devices sdk, sdj {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:04:03.072016 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Flush multipath device 330000000b2501f6d {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:04:03.132231 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:04:03.188025 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:04:03.231946 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:04:03.232119 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:04:03.233180 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:04:03.245136 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:04:03.245348 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:04:03.256821 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:03.287747 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 78, target: iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da, portal: 192.168.40.100,3260]
May 21 02:04:03.287747 np0000001127 nova-compute[98206]: Logout of [sid: 78, target: iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da, portal: 192.168.40.100,3260] successful.
May 21 02:04:03.287747 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:03.305987 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:03.320294 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:03.355218 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 79, target: iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da, portal: 192.168.50.100,3260]
May 21 02:04:03.355218 np0000001127 nova-compute[98206]: Logout of [sid: 79, target: iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da, portal: 192.168.50.100,3260] successful.
May 21 02:04:03.355218 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:03.373711 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:03.373921 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:04:03.374084 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] <== disconnect_volume: return (337ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:04:03.374193 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:04:03.374560 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Deleting instance files /opt/stack/data/nova/instances/2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61_del
May 21 02:04:03.375083 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Deletion of /opt/stack/data/nova/instances/2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61_del complete
May 21 02:04:03.488273 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:04:03.894611 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-ad4d6f52-5e38-4075-ac55-64ac4dd37dea req-d583a885-f84b-433a-b934-4d06a36fd3f4 service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Received event network-changed-01b64dbf-89aa-471a-a2df-58edb2a7a254 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:03.895113 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-ad4d6f52-5e38-4075-ac55-64ac4dd37dea req-d583a885-f84b-433a-b934-4d06a36fd3f4 service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Refreshing instance network info cache due to event network-changed-01b64dbf-89aa-471a-a2df-58edb2a7a254. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:04:03.895336 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ad4d6f52-5e38-4075-ac55-64ac4dd37dea req-d583a885-f84b-433a-b934-4d06a36fd3f4 service nova] Acquiring lock "refresh_cache-2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:04:03.895668 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ad4d6f52-5e38-4075-ac55-64ac4dd37dea req-d583a885-f84b-433a-b934-4d06a36fd3f4 service nova] Acquired lock "refresh_cache-2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:04:03.895825 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-ad4d6f52-5e38-4075-ac55-64ac4dd37dea req-d583a885-f84b-433a-b934-4d06a36fd3f4 service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Refreshing network info cache for port 01b64dbf-89aa-471a-a2df-58edb2a7a254 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:04:03.994761 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.709s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:03.995319 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:04:04.399131 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-ad4d6f52-5e38-4075-ac55-64ac4dd37dea req-d583a885-f84b-433a-b934-4d06a36fd3f4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:04.507015 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:04:04.507015 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:04:04.507015 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:04.507015 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:04.589798 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4878b5a5bf184852a9ce383caa1c67a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ebdb16aee84e22a88dfc8960debd32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:04:04.790102 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-ad4d6f52-5e38-4075-ac55-64ac4dd37dea req-d583a885-f84b-433a-b934-4d06a36fd3f4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:04.979725 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-ad4d6f52-5e38-4075-ac55-64ac4dd37dea req-d583a885-f84b-433a-b934-4d06a36fd3f4 service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Updated VIF entry in instance network info cache for port 01b64dbf-89aa-471a-a2df-58edb2a7a254. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:04:04.980015 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-ad4d6f52-5e38-4075-ac55-64ac4dd37dea req-d583a885-f84b-433a-b934-4d06a36fd3f4 service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Updating instance_info_cache with network_info: [{"id": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "address": "fa:16:3e:ed:a6:59", "network": {"id": "56a7d47c-c10f-4969-a14d-a81a8b4f0e1c", "bridge": null, "label": "tempest-TestShelveInstance-781032295-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db73ea4d098a4b768f0b51d6cbe9eda8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap01b64dbf-89", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:04:05.008391 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:04:05.142499 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Deleted allocations for instance 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61
May 21 02:04:05.283450 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Successfully created port: c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:04:05.365227 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0113c791-04e4-4bff-8f9f-b361ef9f8483 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Acquiring lock "ee14489e-8772-4a35-b7e7-760bc8f7f4ad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:05.365227 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0113c791-04e4-4bff-8f9f-b361ef9f8483 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Lock "ee14489e-8772-4a35-b7e7-760bc8f7f4ad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:05.365227 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0113c791-04e4-4bff-8f9f-b361ef9f8483 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Acquiring lock "ee14489e-8772-4a35-b7e7-760bc8f7f4ad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:05.365227 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0113c791-04e4-4bff-8f9f-b361ef9f8483 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Lock "ee14489e-8772-4a35-b7e7-760bc8f7f4ad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:05.365227 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0113c791-04e4-4bff-8f9f-b361ef9f8483 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Lock "ee14489e-8772-4a35-b7e7-760bc8f7f4ad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:05.366997 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-0113c791-04e4-4bff-8f9f-b361ef9f8483 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Terminating instance
May 21 02:04:05.487496 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ad4d6f52-5e38-4075-ac55-64ac4dd37dea req-d583a885-f84b-433a-b934-4d06a36fd3f4 service nova] Releasing lock "refresh_cache-2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:04:05.511740 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:04:05.649171 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:05.649376 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:05.871748 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-0113c791-04e4-4bff-8f9f-b361ef9f8483 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:04:05.895347 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:05.902960 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:05.911621 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Successfully updated port: c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:04:05.928764 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:05.939043 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:05.972897 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:05.980225 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-04e95b40-826c-4dd1-9846-e744cf228ec6 req-7bc8bff4-0b60-49bc-983f-1e464cbfa8b4 service nova] [instance: d3816229-124e-468b-959d-030180d271c1] Received event network-changed-c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:05.981797 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-04e95b40-826c-4dd1-9846-e744cf228ec6 req-7bc8bff4-0b60-49bc-983f-1e464cbfa8b4 service nova] [instance: d3816229-124e-468b-959d-030180d271c1] Refreshing instance network info cache due to event network-changed-c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:04:05.982074 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-04e95b40-826c-4dd1-9846-e744cf228ec6 req-7bc8bff4-0b60-49bc-983f-1e464cbfa8b4 service nova] Acquiring lock "refresh_cache-d3816229-124e-468b-959d-030180d271c1" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:04:05.982240 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-04e95b40-826c-4dd1-9846-e744cf228ec6 req-7bc8bff4-0b60-49bc-983f-1e464cbfa8b4 service nova] Acquired lock "refresh_cache-d3816229-124e-468b-959d-030180d271c1" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:04:05.982359 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-04e95b40-826c-4dd1-9846-e744cf228ec6 req-7bc8bff4-0b60-49bc-983f-1e464cbfa8b4 service nova] [instance: d3816229-124e-468b-959d-030180d271c1] Refreshing network info cache for port c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:04:06.018883 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Booting with volume 8c01bebd-50f6-433e-bd1d-2c3837bc127d at /dev/vda
May 21 02:04:06.087992 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:04:06.104346 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2bc90aea-fbeb-4b31-b6e6-cc1e1c74159b req-a47207fc-e673-4848-ae50-d7ae1d7bfda6 service nova] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Received event network-vif-unplugged-a0dd78aa-e6ea-44ca-a6a4-b819dafa6653 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:06.105532 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:04:06.105924 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2bc90aea-fbeb-4b31-b6e6-cc1e1c74159b req-a47207fc-e673-4848-ae50-d7ae1d7bfda6 service nova] Acquiring lock "ee14489e-8772-4a35-b7e7-760bc8f7f4ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:06.107249 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2bc90aea-fbeb-4b31-b6e6-cc1e1c74159b req-a47207fc-e673-4848-ae50-d7ae1d7bfda6 service nova] Lock "ee14489e-8772-4a35-b7e7-760bc8f7f4ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:06.107859 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2bc90aea-fbeb-4b31-b6e6-cc1e1c74159b req-a47207fc-e673-4848-ae50-d7ae1d7bfda6 service nova] Lock "ee14489e-8772-4a35-b7e7-760bc8f7f4ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:06.108807 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2bc90aea-fbeb-4b31-b6e6-cc1e1c74159b req-a47207fc-e673-4848-ae50-d7ae1d7bfda6 service nova] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] No waiting events found dispatching network-vif-unplugged-a0dd78aa-e6ea-44ca-a6a4-b819dafa6653 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:04:06.108807 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2bc90aea-fbeb-4b31-b6e6-cc1e1c74159b req-a47207fc-e673-4848-ae50-d7ae1d7bfda6 service nova] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Received event network-vif-unplugged-a0dd78aa-e6ea-44ca-a6a4-b819dafa6653 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:04:06.141454 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:04:06.192248 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:06.197411 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:04:06.198529 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:04:06.199085 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:06.210538 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:04:06.210538 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe9e:216', 'fe80::14d9:7bff:fe3b:f0dc', 'fe80::fc16:3eff:fe45:a237', 'fe80::789a:c1ff:fe89:a024', 'fe80::fc16:3eff:fe2b:20c8', 'fe80::fc16:3eff:fe60:a612', 'fe80::fc16:3eff:fe4b:b481', 'fe80::2844:63ff:fe5d:6c35', 'fe80::fc16:3eff:fef4:b759', 'fe80::40b3:49ff:feb3:3b55', 'fe80::fc16:3eff:fe27:7142', 'fe80::fc16:3eff:fe61:105e', 'fe80::f819:cdff:fe2b:de28'] 
May 21 02:04:06.210538 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:04:06.210538 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:04:06.211255 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:04:06.211679 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Updating existing volume attachment record: 7d59a41a-b89b-4631-bed2-a8835ae00bf8 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:04:06.226588 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999684274999709 future=<Future at 0x71c0983bd160 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:06.234110 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Instance destroyed successfully.
May 21 02:04:06.234896 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-0113c791-04e4-4bff-8f9f-b361ef9f8483 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Lazy-loading 'resources' on Instance uuid ee14489e-8772-4a35-b7e7-760bc8f7f4ad {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:04:06.352406 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:04:06.352727 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:04:06.415760 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "refresh_cache-d3816229-124e-468b-959d-030180d271c1" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:04:06.486677 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:06.489245 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-04e95b40-826c-4dd1-9846-e744cf228ec6 req-7bc8bff4-0b60-49bc-983f-1e464cbfa8b4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:06.514040 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0006264139997256279 future=<Future at 0x71c07c5575f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:06.514754 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Emitting event <LifecycleEvent: 1779329031.5131989, 8411461f-7376-4907-a1ad-59b31e520f56 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:04:06.515974 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:06.516284 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] VM Stopped (Lifecycle Event)
May 21 02:04:06.518223 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=8.331034932999955 future=<Future at 0x71c09cfc61e0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:06.518416 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=8.330850531000124 future=<Future at 0x71c09cfc61e0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:06.583687 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-04e95b40-826c-4dd1-9846-e744cf228ec6 req-7bc8bff4-0b60-49bc-983f-1e464cbfa8b4 service nova] [instance: d3816229-124e-468b-959d-030180d271c1] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:04:06.740931 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-0113c791-04e4-4bff-8f9f-b361ef9f8483 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:03:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1073214439',display_name='tempest-ServersNegativeTestJSON-server-1073214439',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serversnegativetestjson-server-1073214439',id=34,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:03:31Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5852e542a6f42ffb8e104daf741f872',ramdisk_id='',reservation_id='r-aqyncd0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1944632598',owner_user_name='tempest-ServersNegativeTestJSON-1944632598-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:03:31Z,user_data=None,user_id='9f1c1152331140f9b4acfc98d16623bc',uuid=ee14489e-8772-4a35-b7e7-760bc8f7f4ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0dd78aa-e6ea-44ca-a6a4-b819dafa6653", "address": "fa:16:3e:3f:55:7a", "network": {"id": "6d2e68f2-ff8f-41f5-accf-4865237c0702", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1863313078-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c5852e542a6f42ffb8e104daf741f872", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0dd78aa-e6", "ovs_interfaceid": "a0dd78aa-e6ea-44ca-a6a4-b819dafa6653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:04:06.742445 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-0113c791-04e4-4bff-8f9f-b361ef9f8483 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Converting VIF {"id": "a0dd78aa-e6ea-44ca-a6a4-b819dafa6653", "address": "fa:16:3e:3f:55:7a", "network": {"id": "6d2e68f2-ff8f-41f5-accf-4865237c0702", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1863313078-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c5852e542a6f42ffb8e104daf741f872", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0dd78aa-e6", "ovs_interfaceid": "a0dd78aa-e6ea-44ca-a6a4-b819dafa6653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:04:06.742445 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-0113c791-04e4-4bff-8f9f-b361ef9f8483 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:55:7a,bridge_name='br-int',has_traffic_filtering=True,id=a0dd78aa-e6ea-44ca-a6a4-b819dafa6653,network=Network(6d2e68f2-ff8f-41f5-accf-4865237c0702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0dd78aa-e6') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:04:06.742445 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-0113c791-04e4-4bff-8f9f-b361ef9f8483 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:55:7a,bridge_name='br-int',has_traffic_filtering=True,id=a0dd78aa-e6ea-44ca-a6a4-b819dafa6653,network=Network(6d2e68f2-ff8f-41f5-accf-4865237c0702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0dd78aa-e6') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:04:06.743391 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:06.743736 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0dd78aa-e6, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:04:06.747207 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-04e95b40-826c-4dd1-9846-e744cf228ec6 req-7bc8bff4-0b60-49bc-983f-1e464cbfa8b4 service nova] [instance: d3816229-124e-468b-959d-030180d271c1] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:04:06.747952 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:06.750868 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:04:06.752604 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:06.752711 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=17600660-89f3-4ca7-b0ad-5c5b2a851aeb) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:04:06.753394 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:06.754294 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:04:06.755932 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:06.760462 np0000001127 nova-compute[98206]: INFO os_vif [None req-0113c791-04e4-4bff-8f9f-b361ef9f8483 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:55:7a,bridge_name='br-int',has_traffic_filtering=True,id=a0dd78aa-e6ea-44ca-a6a4-b819dafa6653,network=Network(6d2e68f2-ff8f-41f5-accf-4865237c0702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0dd78aa-e6')
May 21 02:04:06.760462 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-0113c791-04e4-4bff-8f9f-b361ef9f8483 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Deleting instance files /opt/stack/data/nova/instances/ee14489e-8772-4a35-b7e7-760bc8f7f4ad_del
May 21 02:04:06.760462 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-0113c791-04e4-4bff-8f9f-b361ef9f8483 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Deletion of /opt/stack/data/nova/instances/ee14489e-8772-4a35-b7e7-760bc8f7f4ad_del complete
May 21 02:04:06.855909 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:04:07.020081 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 8411461f-7376-4907-a1ad-59b31e520f56] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:04:07.255068 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-04e95b40-826c-4dd1-9846-e744cf228ec6 req-7bc8bff4-0b60-49bc-983f-1e464cbfa8b4 service nova] Releasing lock "refresh_cache-d3816229-124e-468b-959d-030180d271c1" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:04:07.257013 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquired lock "refresh_cache-d3816229-124e-468b-959d-030180d271c1" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:04:07.257013 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:04:07.270268 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-0113c791-04e4-4bff-8f9f-b361ef9f8483 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Took 1.40 seconds to destroy the instance on the hypervisor.
May 21 02:04:07.271987 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-0113c791-04e4-4bff-8f9f-b361ef9f8483 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:04:07.272997 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:04:07.273123 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:04:07.277132 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:07.366822 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:07.370154 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.721s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:07.851996 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:04:07.876081 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d73bc8c6-f5ae-4f26-a0dc-e03e4918318a tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 9.381s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:07.877035 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 9.194s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:08.039463 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Acquiring lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:08.051504 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:08.193986 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:04:08.200167 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7c890e92-fdb9-4d1e-a249-7faed08ce949 req-fa67df12-b0dc-4a4b-9571-fb3ab8f9ced8 service nova] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Received event network-vif-unplugged-a0dd78aa-e6ea-44ca-a6a4-b819dafa6653 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:08.200408 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7c890e92-fdb9-4d1e-a249-7faed08ce949 req-fa67df12-b0dc-4a4b-9571-fb3ab8f9ced8 service nova] Acquiring lock "ee14489e-8772-4a35-b7e7-760bc8f7f4ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:08.200963 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7c890e92-fdb9-4d1e-a249-7faed08ce949 req-fa67df12-b0dc-4a4b-9571-fb3ab8f9ced8 service nova] Lock "ee14489e-8772-4a35-b7e7-760bc8f7f4ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:08.200963 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7c890e92-fdb9-4d1e-a249-7faed08ce949 req-fa67df12-b0dc-4a4b-9571-fb3ab8f9ced8 service nova] Lock "ee14489e-8772-4a35-b7e7-760bc8f7f4ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:08.200963 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7c890e92-fdb9-4d1e-a249-7faed08ce949 req-fa67df12-b0dc-4a4b-9571-fb3ab8f9ced8 service nova] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] No waiting events found dispatching network-vif-unplugged-a0dd78aa-e6ea-44ca-a6a4-b819dafa6653 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:04:08.201340 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7c890e92-fdb9-4d1e-a249-7faed08ce949 req-fa67df12-b0dc-4a4b-9571-fb3ab8f9ced8 service nova] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Received event network-vif-unplugged-a0dd78aa-e6ea-44ca-a6a4-b819dafa6653 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:04:08.201340 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7c890e92-fdb9-4d1e-a249-7faed08ce949 req-fa67df12-b0dc-4a4b-9571-fb3ab8f9ced8 service nova] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Received event network-vif-deleted-a0dd78aa-e6ea-44ca-a6a4-b819dafa6653 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:08.201651 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-7c890e92-fdb9-4d1e-a249-7faed08ce949 req-fa67df12-b0dc-4a4b-9571-fb3ab8f9ced8 service nova] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Neutron deleted interface a0dd78aa-e6ea-44ca-a6a4-b819dafa6653; detaching it from the instance and deleting it from the info cache
May 21 02:04:08.205900 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-7c890e92-fdb9-4d1e-a249-7faed08ce949 req-fa67df12-b0dc-4a4b-9571-fb3ab8f9ced8 service nova] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:04:08.262589 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Updating instance_info_cache with network_info: [{"id": "c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4", "address": "fa:16:3e:79:04:e0", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6fbdc73-9f", "ovs_interfaceid": "c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:04:08.388852 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:04:08.389950 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:04:08.390306 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] During the sync_power process the instance has moved from host None to host np0000001127
May 21 02:04:08.390487 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.514s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:08.390921 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.351s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:08.391319 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Creating image(s)
May 21 02:04:08.391763 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Unshelving
May 21 02:04:08.392367 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Did not create local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 21 02:04:08.393226 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Ensure instance console log exists: /opt/stack/data/nova/instances/d3816229-124e-468b-959d-030180d271c1/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:04:08.394148 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:08.394858 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:08.394858 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:08.708976 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Took 1.44 seconds to deallocate network for instance.
May 21 02:04:08.714969 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7c890e92-fdb9-4d1e-a249-7faed08ce949 req-fa67df12-b0dc-4a4b-9571-fb3ab8f9ced8 service nova] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Detach interface failed, port_id=a0dd78aa-e6ea-44ca-a6a4-b819dafa6653, reason: Instance ee14489e-8772-4a35-b7e7-760bc8f7f4ad could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:04:08.764725 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Releasing lock "refresh_cache-d3816229-124e-468b-959d-030180d271c1" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:04:08.765058 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Instance network_info: |[{"id": "c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4", "address": "fa:16:3e:79:04:e0", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6fbdc73-9f", "ovs_interfaceid": "c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:04:08.766122 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Start _get_guest_xml network_info=[{"id": "c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4", "address": "fa:16:3e:79:04:e0", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6fbdc73-9f", "ovs_interfaceid": "c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d', 'iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8c01bebd-50f6-433e-bd1d-2c3837bc127d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'd3816229-124e-468b-959d-030180d271c1', 'attached_at': '', 'detached_at': '', 'volume_id': '8c01bebd-50f6-433e-bd1d-2c3837bc127d', 'serial': '8c01bebd-50f6-433e-bd1d-2c3837bc127d'}, 'delete_on_termination': False, 'attachment_id': '7d59a41a-b89b-4631-bed2-a8835ae00bf8', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:04:08.768736 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:04:08.770360 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1188074728', uuid='d3816229-124e-468b-959d-030180d271c1'), owner=OwnerMeta(userid='4878b5a5bf184852a9ce383caa1c67a4', username='tempest-TestVolumeBootPattern-1995806391-project-member', projectid='62ebdb16aee84e22a88dfc8960debd32', projectname='tempest-TestVolumeBootPattern-1995806391'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4", "address": "fa:16:3e:79:04:e0", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6fbdc73-9f", "ovs_interfaceid": "c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329048.7699132) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:04:08.772264 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:04:08.772707 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:04:08.773772 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:04:08.773976 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:04:08.774899 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:04:08.775152 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:04:08.775312 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:04:08.775476 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:04:08.775682 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:04:08.775796 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:04:08.775952 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:04:08.776142 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:04:08.776293 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:04:08.776448 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:04:08.776708 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:04:08.776841 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:04:08.788703 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:04:08.789211 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d', 'iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8c01bebd-50f6-433e-bd1d-2c3837bc127d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:04:08.789444 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:04:08.790001 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:04:08.790528 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d', 'iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8c01bebd-50f6-433e-bd1d-2c3837bc127d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:04:08.804992 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:04:08.805669 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:04:08.806375 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:04:08.806708 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:04:08.807011 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:04:08.807372 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:04:08.821640 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:04:08.821640 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:08.827687 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:04:08.827687 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:08.839496 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d] added
May 21 02:04:08.839496 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:04:08.839496 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:04:08.839496 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:04:08.839496 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:04:08.839496 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:04:08.839496 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:08.839496 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:04:08.839496 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0309(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:04:08.839496 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:04:08.842427 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d] added
May 21 02:04:08.842427 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:04:08.842427 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:04:08.842427 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:04:08.842427 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:04:08.842427 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:04:08.842427 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:08.842683 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:04:08.842842 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0354(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:04:08.843005 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:04:09.215874 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0113c791-04e4-4bff-8f9f-b361ef9f8483 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:09.216307 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0113c791-04e4-4bff-8f9f-b361ef9f8483 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:09.401203 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Booting with volume c67c8aea-4ddd-455a-ae1e-631955ce95da at /dev/vda
May 21 02:04:09.450911 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:04:09.464308 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:04:09.489048 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:04:09.539338 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:04:09.539756 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:04:09.551191 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:04:09.551191 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe9e:216', 'fe80::14d9:7bff:fe3b:f0dc', 'fe80::fc16:3eff:fe45:a237', 'fe80::789a:c1ff:fe89:a024', 'fe80::fc16:3eff:fe2b:20c8', 'fe80::fc16:3eff:fe60:a612', 'fe80::fc16:3eff:fe4b:b481', 'fe80::2844:63ff:fe5d:6c35', 'fe80::fc16:3eff:fef4:b759', 'fe80::40b3:49ff:feb3:3b55', 'fe80::fc16:3eff:fe27:7142', 'fe80::fc16:3eff:fe61:105e', 'fe80::f819:cdff:fe2b:de28'] 
May 21 02:04:09.551191 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:04:09.551191 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:04:09.551629 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] <== get_connector_properties: return (100ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:04:09.551705 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Updating existing volume attachment record: 7cb71c16-662c-4003-a326-d1ce8f601bed {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:04:09.838479 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:04:09.844306 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:04:09.852256 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:04:09.852256 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:04:09.861436 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:04:09.861436 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:09.869577 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:09.873419 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:09.884404 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:09.884404 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:09.884404 np0000001127 nova-compute[98206]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:09.884404 np0000001127 nova-compute[98206]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:09.884404 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:04:09.884701 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:09.884701 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:09.884701 np0000001127 nova-compute[98206]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:09.884701 np0000001127 nova-compute[98206]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:09.884701 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:04:09.890314 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:09.890314 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:09.890314 np0000001127 nova-compute[98206]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:09.890314 np0000001127 nova-compute[98206]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:09.890314 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:04:09.890582 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:09.890582 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:09.890582 np0000001127 nova-compute[98206]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:09.890582 np0000001127 nova-compute[98206]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:09.890582 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:04:09.917114 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d, portal: 192.168.50.100,3260]
May 21 02:04:09.917114 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d, portal: 192.168.50.100,3260] successful.
May 21 02:04:09.917114 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:09.925562 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d, portal: 192.168.40.100,3260]
May 21 02:04:09.925562 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d, portal: 192.168.40.100,3260] successful.
May 21 02:04:09.925562 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:09.935500 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:09.941085 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:09.951190 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0113c791-04e4-4bff-8f9f-b361ef9f8483 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:04:09.951695 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-0113c791-04e4-4bff-8f9f-b361ef9f8483 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:04:09.954591 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:09.954591 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:09.954591 np0000001127 nova-compute[98206]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:09.954591 np0000001127 nova-compute[98206]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:09.954591 np0000001127 nova-compute[98206]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d (non-flash)
May 21 02:04:09.954591 np0000001127 nova-compute[98206]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d (non-flash)
May 21 02:04:09.954591 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:04:09.955235 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:09.955235 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:09.955235 np0000001127 nova-compute[98206]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:09.955235 np0000001127 nova-compute[98206]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:09.955235 np0000001127 nova-compute[98206]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d (non-flash)
May 21 02:04:09.955235 np0000001127 nova-compute[98206]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d (non-flash)
May 21 02:04:09.955235 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:04:09.955437 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:09.955437 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:09.955437 np0000001127 nova-compute[98206]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:09.955437 np0000001127 nova-compute[98206]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:09.955437 np0000001127 nova-compute[98206]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d (non-flash)
May 21 02:04:09.955437 np0000001127 nova-compute[98206]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d (non-flash)
May 21 02:04:09.955437 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:04:09.956766 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:09.956766 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:09.956766 np0000001127 nova-compute[98206]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:09.956766 np0000001127 nova-compute[98206]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:09.956766 np0000001127 nova-compute[98206]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d (non-flash)
May 21 02:04:09.956766 np0000001127 nova-compute[98206]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d (non-flash)
May 21 02:04:09.956766 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:04:09.957598 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.149s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:04:09.957916 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.151s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:04:09.958162 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:04:09.958480 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:04:09.959911 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] HCTL ('10', '-', '-', 0) found on session 85 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:04:09.960068 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:04:09.960690 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] HCTL ('9', '-', '-', 0) found on session 84 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:04:09.960860 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:04:09.977893 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching for a device in session 85 and hctl ['10', '*', '*', 0] yield: sdd {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:04:09.978026 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8c01bebd-50f6-433e-bd1d-2c3837bc127d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:04:09.981147 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching for a device in session 84 and hctl ['9', '*', '*', 0] yield: None {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:04:10.460493 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-0113c791-04e4-4bff-8f9f-b361ef9f8483 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:04:10.969567 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0113c791-04e4-4bff-8f9f-b361ef9f8483 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.751s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:10.981433 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching for a device in session 84 and hctl ['9', '*', '*', 0] yield: sde {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:04:10.981728 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8c01bebd-50f6-433e-bd1d-2c3837bc127d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:04:11.037295 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-0113c791-04e4-4bff-8f9f-b361ef9f8483 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Deleted allocations for instance ee14489e-8772-4a35-b7e7-760bc8f7f4ad
May 21 02:04:11.248231 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:11.248542 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:11.249766 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lazy-loading 'pci_requests' on Instance uuid 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:04:11.488711 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:11.753597 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lazy-loading 'numa_topology' on Instance uuid 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:04:11.754515 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:11.822179 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Found WWN 33000000054e1c67e for multipath device dm-1 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:04:11.822500 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:04:11.823488 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '33000000054e1c67e', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '33000000054e1c67e'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:04:11.823634 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000054e1c67e', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '33000000054e1c67e'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:04:11.862705 np0000001127 nova-compute[98206]: DEBUG os_brick.encryptors [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d', 'iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8c01bebd-50f6-433e-bd1d-2c3837bc127d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': 'd3816229-124e-468b-959d-030180d271c1', 'attached_at': '', 'detached_at': '', 'volume_id': '8c01bebd-50f6-433e-bd1d-2c3837bc127d', 'serial': '8c01bebd-50f6-433e-bd1d-2c3837bc127d'} {{(pid=98206) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 21 02:04:11.863374 np0000001127 nova-compute[98206]: WARNING stevedore.named [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 21 02:04:11.863589 np0000001127 nova-compute[98206]: WARNING castellan.key_manager [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 21 02:04:11.863739 np0000001127 nova-compute[98206]: WARNING nova.keymgr.conf_key_mgr [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 21 02:04:11.882959 np0000001127 nova-compute[98206]: WARNING os_brick.encryptors.luks [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 21 02:04:11.883348 np0000001127 nova-compute[98206]: WARNING stevedore.named [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 21 02:04:11.883616 np0000001127 nova-compute[98206]: WARNING castellan.key_manager [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 21 02:04:11.883787 np0000001127 nova-compute[98206]: WARNING nova.keymgr.conf_key_mgr [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 21 02:04:11.884412 np0000001127 nova-compute[98206]: DEBUG os_brick.encryptors [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x71c07c5b3800>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d', 'iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8c01bebd-50f6-433e-bd1d-2c3837bc127d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': 'd3816229-124e-468b-959d-030180d271c1', 'attached_at': '', 'detached_at': '', 'volume_id': '8c01bebd-50f6-433e-bd1d-2c3837bc127d', 'serial': '8c01bebd-50f6-433e-bd1d-2c3837bc127d'} {{(pid=98206) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 21 02:04:11.884603 np0000001127 nova-compute[98206]: DEBUG os_brick.encryptors.luks [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] formatting encrypted volume /dev/dm-1 {{(pid=98206) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 21 02:04:12.045246 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0113c791-04e4-4bff-8f9f-b361ef9f8483 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Lock "ee14489e-8772-4a35-b7e7-760bc8f7f4ad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.681s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:12.256252 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:04:12.256427 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Claim successful on node np0000001127
May 21 02:04:12.915347 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:13.793459 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:04:13.793874 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:04:14.197407 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:14.315369 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:04:14.827497 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.577s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:14.827497 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:14.849918 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.000652822000120068 future=<Future at 0x71c09cfc61e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:14.850027 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:14.850134 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=6.376076944000033 future=<Future at 0x71c0983bd160 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:14.850219 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=6.375992006999695 future=<Future at 0x71c0983bd160 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:14.851141 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Emitting event <LifecycleEvent: 1779329039.8491523, 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:04:14.851576 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] VM Stopped (Lifecycle Event)
May 21 02:04:14.898521 np0000001127 nova-compute[98206]: INFO nova.network.neutron [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Updating port 01b64dbf-89aa-471a-a2df-58edb2a7a254 with attributes {'binding:host_id': 'np0000001127', 'device_owner': 'compute:nova'}
May 21 02:04:15.355179 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:04:15.681357 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Acquiring lock "refresh_cache-2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:04:15.681357 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Acquired lock "refresh_cache-2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:04:15.681357 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:04:15.739757 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b17891fa-b7f5-4f90-a676-a56f4a882850 req-b3d82f02-4c77-43cb-a43c-e1faac2200de service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Received event network-changed-01b64dbf-89aa-471a-a2df-58edb2a7a254 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:15.741638 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b17891fa-b7f5-4f90-a676-a56f4a882850 req-b3d82f02-4c77-43cb-a43c-e1faac2200de service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Refreshing instance network info cache due to event network-changed-01b64dbf-89aa-471a-a2df-58edb2a7a254. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:04:15.741638 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b17891fa-b7f5-4f90-a676-a56f4a882850 req-b3d82f02-4c77-43cb-a43c-e1faac2200de service nova] Acquiring lock "refresh_cache-2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:04:16.060176 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Secret XML: <secret ephemeral="no" private="no">
May 21 02:04:16.060176 np0000001127 nova-compute[98206]:   <usage type="volume">
May 21 02:04:16.060176 np0000001127 nova-compute[98206]:     <volume>8c01bebd-50f6-433e-bd1d-2c3837bc127d</volume>
May 21 02:04:16.060176 np0000001127 nova-compute[98206]:   </usage>
May 21 02:04:16.060176 np0000001127 nova-compute[98206]: </secret>
May 21 02:04:16.060176 np0000001127 nova-compute[98206]:  {{(pid=98206) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 21 02:04:16.182934 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:16.489803 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:16.548848 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:16.573892 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:03:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1188074728',display_name='tempest-TestVolumeBootPattern-server-1188074728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpattern-server-1188074728',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62ebdb16aee84e22a88dfc8960debd32',ramdisk_id='',reservation_id='r-woq36q8v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1995806391',owner_user_name='tempest-TestVolumeBootPattern-1995806391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:04:06Z,user_data=None,user_id='4878b5a5bf184852a9ce383caa1c67a4',uuid=d3816229-124e-468b-959d-030180d271c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4", "address": "fa:16:3e:79:04:e0", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6fbdc73-9f", "ovs_interfaceid": "c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:04:16.574106 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converting VIF {"id": "c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4", "address": "fa:16:3e:79:04:e0", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6fbdc73-9f", "ovs_interfaceid": "c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:04:16.575019 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:04:e0,bridge_name='br-int',has_traffic_filtering=True,id=c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6fbdc73-9f') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:04:16.576276 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lazy-loading 'pci_devices' on Instance uuid d3816229-124e-468b-959d-030180d271c1 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:04:16.688668 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Updating instance_info_cache with network_info: [{"id": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "address": "fa:16:3e:ed:a6:59", "network": {"id": "56a7d47c-c10f-4969-a14d-a81a8b4f0e1c", "bridge": "br-int", "label": "tempest-TestShelveInstance-781032295-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db73ea4d098a4b768f0b51d6cbe9eda8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b64dbf-89", "ovs_interfaceid": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:04:16.757278 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:16.818876 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-677a1f36-f08c-4e39-a5ef-d900d5b955da tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:04:17.079205 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] End _get_guest_xml xml=<domain type="qemu">
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:   <uuid>d3816229-124e-468b-959d-030180d271c1</uuid>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:   <name>instance-00000026</name>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:       <nova:name>tempest-TestVolumeBootPattern-server-1188074728</nova:name>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:04:08</nova:creationTime>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:       <nova:image uuid="">
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:         <nova:properties/>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:         <nova:user uuid="4878b5a5bf184852a9ce383caa1c67a4">tempest-TestVolumeBootPattern-1995806391-project-member</nova:user>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:         <nova:project uuid="62ebdb16aee84e22a88dfc8960debd32">tempest-TestVolumeBootPattern-1995806391</nova:project>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:       <nova:root type="volume" uuid=""/>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:         <nova:port uuid="c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4">
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:     <system>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:       <entry name="serial">d3816229-124e-468b-959d-030180d271c1</entry>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:       <entry name="uuid">d3816229-124e-468b-959d-030180d271c1</entry>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:     </system>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:   <os>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:   </os>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:   <features>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:   </features>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:   <devices>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/d3816229-124e-468b-959d-030180d271c1/disk.config"/>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:     </disk>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:       <alias name="ua-8c01bebd-50f6-433e-bd1d-2c3837bc127d"/>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:       <serial>8c01bebd-50f6-433e-bd1d-2c3837bc127d</serial>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:       <encryption format="luks">
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:         <secret type="passphrase" uuid="2b80e8b8-47a7-4149-b55d-1b44bc91340e"/>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:       </encryption>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:     </disk>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:79:04:e0"/>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:       <target dev="tapc6fbdc73-9f"/>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:     </interface>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/d3816229-124e-468b-959d-030180d271c1/console.log" append="off"/>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:     </serial>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:     <video>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:     </video>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:     </rng>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:   </devices>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]: </domain>
May 21 02:04:17.079205 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:04:17.082358 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Preparing to wait for external event network-vif-plugged-c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:04:17.082358 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "d3816229-124e-468b-959d-030180d271c1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:17.082358 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "d3816229-124e-468b-959d-030180d271c1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:17.082358 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "d3816229-124e-468b-959d-030180d271c1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:17.082358 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:03:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1188074728',display_name='tempest-TestVolumeBootPattern-server-1188074728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpattern-server-1188074728',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62ebdb16aee84e22a88dfc8960debd32',ramdisk_id='',reservation_id='r-woq36q8v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1995806391',owner_user_name='tempest-TestVolumeBootPattern-1995806391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:04:06Z,user_data=None,user_id='4878b5a5bf184852a9ce383caa1c67a4',uuid=d3816229-124e-468b-959d-030180d271c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4", "address": "fa:16:3e:79:04:e0", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6fbdc73-9f", "ovs_interfaceid": "c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:04:17.082358 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converting VIF {"id": "c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4", "address": "fa:16:3e:79:04:e0", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6fbdc73-9f", "ovs_interfaceid": "c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:04:17.082358 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:04:e0,bridge_name='br-int',has_traffic_filtering=True,id=c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6fbdc73-9f') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:04:17.082358 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:04:e0,bridge_name='br-int',has_traffic_filtering=True,id=c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6fbdc73-9f') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:04:17.082358 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:17.082725 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:04:17.082725 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:04:17.083701 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:17.083839 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3096f353-7b7d-5393-84ac-743341c600fa', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:04:17.084570 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:17.085196 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:04:17.085704 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:17.087957 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:17.088108 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc6fbdc73-9f, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:04:17.088918 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc6fbdc73-9f, col_values=(('qos', UUID('6b7acca6-e3eb-4f85-bc28-edf04d67f942')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:04:17.089079 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc6fbdc73-9f, col_values=(('external_ids', {'iface-id': 'c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:04:e0', 'vm-uuid': 'd3816229-124e-468b-959d-030180d271c1'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:04:17.089899 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:17.090881 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:04:17.096045 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:17.097411 np0000001127 nova-compute[98206]: INFO os_vif [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:04:e0,bridge_name='br-int',has_traffic_filtering=True,id=c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6fbdc73-9f')
May 21 02:04:17.191236 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Releasing lock "refresh_cache-2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:04:17.194491 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:04:17.194491 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Creating image(s)
May 21 02:04:17.194491 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Did not create local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 21 02:04:17.194491 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Ensure instance console log exists: /opt/stack/data/nova/instances/2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:04:17.194491 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:17.194491 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:17.194491 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:17.194491 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Start _get_guest_xml network_info=[{"id": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "address": "fa:16:3e:ed:a6:59", "network": {"id": "56a7d47c-c10f-4969-a14d-a81a8b4f0e1c", "bridge": "br-int", "label": "tempest-TestShelveInstance-781032295-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db73ea4d098a4b768f0b51d6cbe9eda8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b64dbf-89", "ovs_interfaceid": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c67c8aea-4ddd-455a-ae1e-631955ce95da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61', 'attached_at': '', 'detached_at': '', 'volume_id': 'c67c8aea-4ddd-455a-ae1e-631955ce95da', 'serial': 'c67c8aea-4ddd-455a-ae1e-631955ce95da'}, 'delete_on_termination': True, 'attachment_id': '7cb71c16-662c-4003-a326-d1ce8f601bed', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:04:17.194491 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b17891fa-b7f5-4f90-a676-a56f4a882850 req-b3d82f02-4c77-43cb-a43c-e1faac2200de service nova] Acquired lock "refresh_cache-2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:04:17.194491 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-b17891fa-b7f5-4f90-a676-a56f4a882850 req-b3d82f02-4c77-43cb-a43c-e1faac2200de service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Refreshing network info cache for port 01b64dbf-89aa-471a-a2df-58edb2a7a254 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:04:17.196667 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:04:17.197922 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestShelveInstance-server-2112280893', uuid='2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61'), owner=OwnerMeta(userid='1ebeaddb48014da28103c3479e9b250b', username='tempest-TestShelveInstance-1611299604-project-member', projectid='db73ea4d098a4b768f0b51d6cbe9eda8', projectname='tempest-TestShelveInstance-1611299604'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "address": "fa:16:3e:ed:a6:59", "network": {"id": "56a7d47c-c10f-4969-a14d-a81a8b4f0e1c", "bridge": "br-int", "label": "tempest-TestShelveInstance-781032295-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db73ea4d098a4b768f0b51d6cbe9eda8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b64dbf-89", "ovs_interfaceid": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329057.197587) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:04:17.199351 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:04:17.199962 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:04:17.200800 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:04:17.200999 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:04:17.202000 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:04:17.202302 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:04:17.202499 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:04:17.202660 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:04:17.202853 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:04:17.202984 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:04:17.203121 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:04:17.203327 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:04:17.203490 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:04:17.203745 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:04:17.203874 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:04:17.203989 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:04:17.204120 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:04:17.325085 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-677a1f36-f08c-4e39-a5ef-d900d5b955da tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] instance snapshotting
May 21 02:04:17.433987 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-677a1f36-f08c-4e39-a5ef-d900d5b955da tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Beginning live snapshot process
May 21 02:04:17.696594 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-b17891fa-b7f5-4f90-a676-a56f4a882850 req-b3d82f02-4c77-43cb-a43c-e1faac2200de service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:17.706554 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Object Instance<2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:04:17.725605 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:04:17.726303 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c67c8aea-4ddd-455a-ae1e-631955ce95da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:04:17.727182 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:04:17.727629 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:04:17.729312 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c67c8aea-4ddd-455a-ae1e-631955ce95da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:04:17.740606 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:04:17.743722 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:04:17.743722 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:04:17.743722 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:04:17.743722 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:04:17.743722 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:04:17.757847 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:04:17.757847 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:17.766785 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:04:17.766785 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:17.775073 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da] added
May 21 02:04:17.775073 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:04:17.775073 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:04:17.775073 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:04:17.775073 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:04:17.775073 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:04:17.775073 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:17.775460 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:04:17.775460 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0338(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:04:17.775593 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:04:17.783604 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da] added
May 21 02:04:17.783604 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:04:17.783604 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:04:17.783604 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:04:17.783604 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:04:17.783604 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:04:17.783604 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:17.783873 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:04:17.783873 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0412(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:04:17.784007 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:04:18.071936 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-b17891fa-b7f5-4f90-a676-a56f4a882850 req-b3d82f02-4c77-43cb-a43c-e1faac2200de service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:18.206324 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-b17891fa-b7f5-4f90-a676-a56f4a882850 req-b3d82f02-4c77-43cb-a43c-e1faac2200de service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Updated VIF entry in instance network info cache for port 01b64dbf-89aa-471a-a2df-58edb2a7a254. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:04:18.206564 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-b17891fa-b7f5-4f90-a676-a56f4a882850 req-b3d82f02-4c77-43cb-a43c-e1faac2200de service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Updating instance_info_cache with network_info: [{"id": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "address": "fa:16:3e:ed:a6:59", "network": {"id": "56a7d47c-c10f-4969-a14d-a81a8b4f0e1c", "bridge": "br-int", "label": "tempest-TestShelveInstance-781032295-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db73ea4d098a4b768f0b51d6cbe9eda8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b64dbf-89", "ovs_interfaceid": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:04:18.617004 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:04:18.617142 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:04:18.617221 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] No VIF found with MAC fa:16:3e:79:04:e0, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:04:18.617794 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Using config drive
May 21 02:04:18.708542 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b17891fa-b7f5-4f90-a676-a56f4a882850 req-b3d82f02-4c77-43cb-a43c-e1faac2200de service nova] Releasing lock "refresh_cache-2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:04:18.775959 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:04:18.784456 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:04:18.794018 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:04:18.794018 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:04:18.801898 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:04:18.801898 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:18.809314 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:18.814614 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:18.827478 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:18.827478 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:18.827478 np0000001127 nova-compute[98206]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:18.827478 np0000001127 nova-compute[98206]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:18.827478 np0000001127 nova-compute[98206]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d (non-flash)
May 21 02:04:18.827478 np0000001127 nova-compute[98206]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d (non-flash)
May 21 02:04:18.827478 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:04:18.827723 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:18.827723 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:18.827723 np0000001127 nova-compute[98206]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:18.827723 np0000001127 nova-compute[98206]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:18.827723 np0000001127 nova-compute[98206]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d (non-flash)
May 21 02:04:18.827723 np0000001127 nova-compute[98206]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d (non-flash)
May 21 02:04:18.827723 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:04:18.838251 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:18.838251 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:18.838251 np0000001127 nova-compute[98206]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:18.838251 np0000001127 nova-compute[98206]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:18.838251 np0000001127 nova-compute[98206]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d (non-flash)
May 21 02:04:18.838251 np0000001127 nova-compute[98206]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d (non-flash)
May 21 02:04:18.838251 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:04:18.838513 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:18.838513 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:18.838513 np0000001127 nova-compute[98206]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:18.838513 np0000001127 nova-compute[98206]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:18.838513 np0000001127 nova-compute[98206]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d (non-flash)
May 21 02:04:18.838513 np0000001127 nova-compute[98206]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d (non-flash)
May 21 02:04:18.838513 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:04:18.868351 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da, portal: 192.168.40.100,3260]
May 21 02:04:18.868351 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da, portal: 192.168.40.100,3260] successful.
May 21 02:04:18.868351 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:18.879980 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da, portal: 192.168.50.100,3260]
May 21 02:04:18.879980 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da, portal: 192.168.50.100,3260] successful.
May 21 02:04:18.879980 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:18.880621 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:18.895036 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:18.901764 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:18.901764 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:18.901764 np0000001127 nova-compute[98206]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:18.901764 np0000001127 nova-compute[98206]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:18.901764 np0000001127 nova-compute[98206]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d (non-flash)
May 21 02:04:18.901764 np0000001127 nova-compute[98206]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d (non-flash)
May 21 02:04:18.901764 np0000001127 nova-compute[98206]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:18.901764 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:18.901764 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:04:18.902070 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:18.902070 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:18.902070 np0000001127 nova-compute[98206]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:18.902070 np0000001127 nova-compute[98206]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:18.902070 np0000001127 nova-compute[98206]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d (non-flash)
May 21 02:04:18.902070 np0000001127 nova-compute[98206]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d (non-flash)
May 21 02:04:18.902070 np0000001127 nova-compute[98206]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:18.902070 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:18.902070 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:04:18.902410 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.161s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:04:18.902410 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:04:18.903305 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] HCTL ('11', '-', '-', 0) found on session 86 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:04:18.903437 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:04:18.912247 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:18.912247 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:18.912247 np0000001127 nova-compute[98206]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:18.912247 np0000001127 nova-compute[98206]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:18.912247 np0000001127 nova-compute[98206]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d (non-flash)
May 21 02:04:18.912247 np0000001127 nova-compute[98206]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d (non-flash)
May 21 02:04:18.912247 np0000001127 nova-compute[98206]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:18.912247 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:18.912247 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:04:18.912661 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:18.912661 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:18.912661 np0000001127 nova-compute[98206]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:18.912661 np0000001127 nova-compute[98206]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:18.912661 np0000001127 nova-compute[98206]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d (non-flash)
May 21 02:04:18.912661 np0000001127 nova-compute[98206]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d (non-flash)
May 21 02:04:18.912661 np0000001127 nova-compute[98206]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:18.912661 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:18.912661 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:04:18.912823 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.170s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:04:18.912978 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:04:18.914027 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] HCTL ('12', '-', '-', 0) found on session 87 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:04:18.914184 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:04:18.921145 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Searching for a device in session 86 and hctl ['11', '*', '*', 0] yield: None {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:04:18.930450 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Searching for a device in session 87 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:04:18.930450 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c67c8aea-4ddd-455a-ae1e-631955ce95da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:04:18.953098 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-677a1f36-f08c-4e39-a5ef-d900d5b955da tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk --force-share --output=json -f qcow2 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:04:19.043665 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-677a1f36-f08c-4e39-a5ef-d900d5b955da tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk --force-share --output=json -f qcow2" returned: 0 in 0.091s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:04:19.044249 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-677a1f36-f08c-4e39-a5ef-d900d5b955da tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk --force-share --output=json -f qcow2 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:04:19.129277 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:19.162259 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-677a1f36-f08c-4e39-a5ef-d900d5b955da tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk --force-share --output=json -f qcow2" returned: 0 in 0.118s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:04:19.166013 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-677a1f36-f08c-4e39-a5ef-d900d5b955da tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:04:19.173644 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-677a1f36-f08c-4e39-a5ef-d900d5b955da tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:04:19.173644 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-677a1f36-f08c-4e39-a5ef-d900d5b955da tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:04:19.267065 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-677a1f36-f08c-4e39-a5ef-d900d5b955da tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.093s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:04:19.268238 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-677a1f36-f08c-4e39-a5ef-d900d5b955da tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzw3a9vhh/a97f96e519654b60bfad350e775cdd4f.delta 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:04:19.295258 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Creating config drive at /opt/stack/data/nova/instances/d3816229-124e-468b-959d-030180d271c1/disk.config
May 21 02:04:19.299310 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d3816229-124e-468b-959d-030180d271c1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfhiauyrc {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:04:19.329497 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-677a1f36-f08c-4e39-a5ef-d900d5b955da tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzw3a9vhh/a97f96e519654b60bfad350e775cdd4f.delta 1073741824" returned: 0 in 0.060s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:04:19.329497 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-677a1f36-f08c-4e39-a5ef-d900d5b955da tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Quiescing instance not available: QEMU guest agent is not enabled.
May 21 02:04:19.353427 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d3816229-124e-468b-959d-030180d271c1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfhiauyrc" returned: 0 in 0.054s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:04:19.557678 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-677a1f36-f08c-4e39-a5ef-d900d5b955da tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] COPY block job progress, current cursor: 0 final cursor: 76677120 {{(pid=98206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 21 02:04:19.920792 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Searching for a device in session 86 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:04:19.920792 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c67c8aea-4ddd-455a-ae1e-631955ce95da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:04:19.998241 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:20.026666 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:20.061397 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-677a1f36-f08c-4e39-a5ef-d900d5b955da tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] COPY block job progress, current cursor: 76677120 final cursor: 76677120 {{(pid=98206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 21 02:04:20.063283 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-677a1f36-f08c-4e39-a5ef-d900d5b955da tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Skipping quiescing instance: QEMU guest agent is not enabled.
May 21 02:04:20.140745 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:20.183366 np0000001127 nova-compute[98206]: DEBUG nova.privsep.utils [None req-677a1f36-f08c-4e39-a5ef-d900d5b955da tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 21 02:04:20.183692 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-677a1f36-f08c-4e39-a5ef-d900d5b955da tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzw3a9vhh/a97f96e519654b60bfad350e775cdd4f.delta /opt/stack/data/nova/instances/snapshots/tmpzw3a9vhh/a97f96e519654b60bfad350e775cdd4f {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:04:20.240933 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d5af01db-5c15-4aec-8ed9-65083d87463d req-b13dc252-8a8f-4783-b5da-d957ad4d45f3 service nova] [instance: d3816229-124e-468b-959d-030180d271c1] Received event network-vif-plugged-c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:20.242628 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d5af01db-5c15-4aec-8ed9-65083d87463d req-b13dc252-8a8f-4783-b5da-d957ad4d45f3 service nova] Acquiring lock "d3816229-124e-468b-959d-030180d271c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:20.243568 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d5af01db-5c15-4aec-8ed9-65083d87463d req-b13dc252-8a8f-4783-b5da-d957ad4d45f3 service nova] Lock "d3816229-124e-468b-959d-030180d271c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:20.243765 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d5af01db-5c15-4aec-8ed9-65083d87463d req-b13dc252-8a8f-4783-b5da-d957ad4d45f3 service nova] Lock "d3816229-124e-468b-959d-030180d271c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:20.243905 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d5af01db-5c15-4aec-8ed9-65083d87463d req-b13dc252-8a8f-4783-b5da-d957ad4d45f3 service nova] [instance: d3816229-124e-468b-959d-030180d271c1] Processing event network-vif-plugged-c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:04:20.344446 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fbaefd02-5d48-4643-a968-ce25c9cbe044 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "df1fb869-23ef-48e0-b609-ce91c2540c2e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:20.344694 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fbaefd02-5d48-4643-a968-ce25c9cbe044 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:20.344910 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fbaefd02-5d48-4643-a968-ce25c9cbe044 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:20.345040 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fbaefd02-5d48-4643-a968-ce25c9cbe044 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:20.345160 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fbaefd02-5d48-4643-a968-ce25c9cbe044 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:20.348078 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-fbaefd02-5d48-4643-a968-ce25c9cbe044 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Terminating instance
May 21 02:04:20.355951 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:20.360837 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:20.363906 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:20.385136 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:20.387518 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:20.659853 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-677a1f36-f08c-4e39-a5ef-d900d5b955da tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzw3a9vhh/a97f96e519654b60bfad350e775cdd4f.delta /opt/stack/data/nova/instances/snapshots/tmpzw3a9vhh/a97f96e519654b60bfad350e775cdd4f" returned: 0 in 0.476s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:04:20.664924 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-677a1f36-f08c-4e39-a5ef-d900d5b955da tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Snapshot extracted, beginning image upload
May 21 02:04:20.761786 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Found WWN 330000000b2501f6d for multipath device dm-2 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:04:20.761947 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:04:20.764519 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '330000000b2501f6d', 'path': '/dev/dm-2', 'multipath_id': '330000000b2501f6d'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:04:20.764519 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b2501f6d', 'path': '/dev/dm-2', 'multipath_id': '330000000b2501f6d'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:04:20.852794 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-fbaefd02-5d48-4643-a968-ce25c9cbe044 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:04:20.874404 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:20.874934 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:20.895523 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:20.906011 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:20.931973 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:21.095859 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-5d695716-b7f4-4e46-8fff-dd21ae9b4c49 req-5807c8ab-488f-4686-8a1d-dab233248120 service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Received event network-vif-unplugged-397001b0-550b-43bb-8c99-269fa0d710bb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:21.095859 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5d695716-b7f4-4e46-8fff-dd21ae9b4c49 req-5807c8ab-488f-4686-8a1d-dab233248120 service nova] Acquiring lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:21.095859 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5d695716-b7f4-4e46-8fff-dd21ae9b4c49 req-5807c8ab-488f-4686-8a1d-dab233248120 service nova] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:21.095859 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5d695716-b7f4-4e46-8fff-dd21ae9b4c49 req-5807c8ab-488f-4686-8a1d-dab233248120 service nova] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:21.095859 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-5d695716-b7f4-4e46-8fff-dd21ae9b4c49 req-5807c8ab-488f-4686-8a1d-dab233248120 service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] No waiting events found dispatching network-vif-unplugged-397001b0-550b-43bb-8c99-269fa0d710bb {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:04:21.095859 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-5d695716-b7f4-4e46-8fff-dd21ae9b4c49 req-5807c8ab-488f-4686-8a1d-dab233248120 service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Received event network-vif-unplugged-397001b0-550b-43bb-8c99-269fa0d710bb for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:04:21.186009 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999669527000151 future=<Future at 0x71c0981f8830 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:21.189551 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Instance destroyed successfully.
May 21 02:04:21.189850 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-fbaefd02-5d48-4643-a968-ce25c9cbe044 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lazy-loading 'resources' on Instance uuid df1fb869-23ef-48e0-b609-ce91c2540c2e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:04:21.226746 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0004772060001414502 future=<Future at 0x71c0983bd160 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:21.227302 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Emitting event <LifecycleEvent: 1779329046.2261481, ee14489e-8772-4a35-b7e7-760bc8f7f4ad => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:04:21.227495 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:21.227784 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] VM Stopped (Lifecycle Event)
May 21 02:04:21.229640 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.956010631000026 future=<Future at 0x71c0981f8830 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:21.229764 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.95586716400021 future=<Future at 0x71c0981f8830 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:21.274268 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-21T02:02:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2112280893',display_name='tempest-TestShelveInstance-server-2112280893',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testshelveinstance-server-2112280893',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1094914629',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:03:15Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='db73ea4d098a4b768f0b51d6cbe9eda8',ramdisk_id='',reservation_id='r-icby8s1w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1611299604',owner_user_name='tempest-TestShelveInstance-1611299604-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:04:09Z,user_data=None,user_id='1ebeaddb48014da28103c3479e9b250b',uuid=2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "address": "fa:16:3e:ed:a6:59", "network": {"id": "56a7d47c-c10f-4969-a14d-a81a8b4f0e1c", "bridge": "br-int", "label": "tempest-TestShelveInstance-781032295-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db73ea4d098a4b768f0b51d6cbe9eda8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b64dbf-89", "ovs_interfaceid": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:04:21.274525 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Converting VIF {"id": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "address": "fa:16:3e:ed:a6:59", "network": {"id": "56a7d47c-c10f-4969-a14d-a81a8b4f0e1c", "bridge": "br-int", "label": "tempest-TestShelveInstance-781032295-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db73ea4d098a4b768f0b51d6cbe9eda8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b64dbf-89", "ovs_interfaceid": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:04:21.275274 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a6:59,bridge_name='br-int',has_traffic_filtering=True,id=01b64dbf-89aa-471a-a2df-58edb2a7a254,network=Network(56a7d47c-c10f-4969-a14d-a81a8b4f0e1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b64dbf-89') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:04:21.275954 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:04:21.491518 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:21.693188 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-fbaefd02-5d48-4643-a968-ce25c9cbe044 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:01:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1160366387',display_name='tempest-AttachVolumeTestJSON-server-1160366387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumetestjson-server-1160366387',id=27,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAujiHJsmhJMgEmRnWv5ymFbZbTAYncvgq9NsMeC8MiZ8la1gTOga8PrdaHkWknChauf3EhimnVrbr35Cl923XBy1BnVqXrs2rMVao3ITr2vCMWLpWOxbYc5JhA+8oEsw==',key_name='tempest-keypair-1825862747',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:01:35Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e80cee8643f34f6685ff7fb42920afc3',ramdisk_id='',reservation_id='r-td2yddno',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2050140136',owner_user_name='tempest-AttachVolumeTestJSON-2050140136-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:03:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='640fad0f3dfe4ee99b04c12c2b8fd9dd',uuid=df1fb869-23ef-48e0-b609-ce91c2540c2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "397001b0-550b-43bb-8c99-269fa0d710bb", "address": "fa:16:3e:f4:b7:59", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397001b0-55", "ovs_interfaceid": "397001b0-550b-43bb-8c99-269fa0d710bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:04:21.693546 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-fbaefd02-5d48-4643-a968-ce25c9cbe044 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Converting VIF {"id": "397001b0-550b-43bb-8c99-269fa0d710bb", "address": "fa:16:3e:f4:b7:59", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397001b0-55", "ovs_interfaceid": "397001b0-550b-43bb-8c99-269fa0d710bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:04:21.694113 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-fbaefd02-5d48-4643-a968-ce25c9cbe044 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:b7:59,bridge_name='br-int',has_traffic_filtering=True,id=397001b0-550b-43bb-8c99-269fa0d710bb,network=Network(70a21e20-dfdf-49b9-bfd2-75a1f49c8a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397001b0-55') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:04:21.694439 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-fbaefd02-5d48-4643-a968-ce25c9cbe044 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:b7:59,bridge_name='br-int',has_traffic_filtering=True,id=397001b0-550b-43bb-8c99-269fa0d710bb,network=Network(70a21e20-dfdf-49b9-bfd2-75a1f49c8a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397001b0-55') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:04:21.695807 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:21.696003 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap397001b0-55, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:04:21.697302 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:21.699184 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:04:21.699184 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:21.699352 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:21.699549 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e1b485e8-f917-489b-a1e5-8ae2fcb9f396) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:04:21.700016 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:21.700460 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:04:21.701142 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:21.703092 np0000001127 nova-compute[98206]: INFO os_vif [None req-fbaefd02-5d48-4643-a968-ce25c9cbe044 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:b7:59,bridge_name='br-int',has_traffic_filtering=True,id=397001b0-550b-43bb-8c99-269fa0d710bb,network=Network(70a21e20-dfdf-49b9-bfd2-75a1f49c8a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397001b0-55')
May 21 02:04:21.703375 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-fbaefd02-5d48-4643-a968-ce25c9cbe044 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Deleting instance files /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e_del
May 21 02:04:21.704129 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-fbaefd02-5d48-4643-a968-ce25c9cbe044 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Deletion of /opt/stack/data/nova/instances/df1fb869-23ef-48e0-b609-ce91c2540c2e_del complete
May 21 02:04:21.732307 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: ee14489e-8772-4a35-b7e7-760bc8f7f4ad] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:04:21.782297 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Object Instance<2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:04:21.783461 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] End _get_guest_xml xml=<domain type="qemu">
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:   <uuid>2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61</uuid>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:   <name>instance-00000021</name>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:       <nova:name>tempest-TestShelveInstance-server-2112280893</nova:name>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:04:17</nova:creationTime>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:       <nova:image uuid="">
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:           <nova:property name="hw_machine_type">pc</nova:property>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:           <nova:property name="hw_video_model">virtio</nova:property>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:         <nova:user uuid="1ebeaddb48014da28103c3479e9b250b">tempest-TestShelveInstance-1611299604-project-member</nova:user>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:         <nova:project uuid="db73ea4d098a4b768f0b51d6cbe9eda8">tempest-TestShelveInstance-1611299604</nova:project>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:       <nova:root type="volume" uuid=""/>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:         <nova:port uuid="01b64dbf-89aa-471a-a2df-58edb2a7a254">
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:     <system>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:       <entry name="serial">2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61</entry>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:       <entry name="uuid">2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61</entry>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:     </system>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:   <os>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:   </os>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:   <features>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:   </features>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:   <devices>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61/disk.config"/>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:     </disk>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:       <alias name="ua-c67c8aea-4ddd-455a-ae1e-631955ce95da"/>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-2"/>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:       <serial>c67c8aea-4ddd-455a-ae1e-631955ce95da</serial>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:     </disk>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:ed:a6:59"/>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:       <target dev="tap01b64dbf-89"/>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:     </interface>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61/console.log" append="off"/>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:     </serial>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:     <video>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:     </video>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:     </rng>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:   </devices>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]: </domain>
May 21 02:04:21.783461 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:04:21.787139 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Preparing to wait for external event network-vif-plugged-01b64dbf-89aa-471a-a2df-58edb2a7a254 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:04:21.787139 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Acquiring lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:21.787139 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:21.787139 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:21.787139 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-21T02:02:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2112280893',display_name='tempest-TestShelveInstance-server-2112280893',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testshelveinstance-server-2112280893',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1094914629',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:03:15Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='db73ea4d098a4b768f0b51d6cbe9eda8',ramdisk_id='',reservation_id='r-icby8s1w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1611299604',owner_user_name='tempest-TestShelveInstance-1611299604-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:04:09Z,user_data=None,user_id='1ebeaddb48014da28103c3479e9b250b',uuid=2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "address": "fa:16:3e:ed:a6:59", "network": {"id": "56a7d47c-c10f-4969-a14d-a81a8b4f0e1c", "bridge": "br-int", "label": "tempest-TestShelveInstance-781032295-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db73ea4d098a4b768f0b51d6cbe9eda8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b64dbf-89", "ovs_interfaceid": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:04:21.787139 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Converting VIF {"id": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "address": "fa:16:3e:ed:a6:59", "network": {"id": "56a7d47c-c10f-4969-a14d-a81a8b4f0e1c", "bridge": "br-int", "label": "tempest-TestShelveInstance-781032295-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db73ea4d098a4b768f0b51d6cbe9eda8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b64dbf-89", "ovs_interfaceid": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:04:21.788938 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a6:59,bridge_name='br-int',has_traffic_filtering=True,id=01b64dbf-89aa-471a-a2df-58edb2a7a254,network=Network(56a7d47c-c10f-4969-a14d-a81a8b4f0e1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b64dbf-89') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:04:21.789215 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a6:59,bridge_name='br-int',has_traffic_filtering=True,id=01b64dbf-89aa-471a-a2df-58edb2a7a254,network=Network(56a7d47c-c10f-4969-a14d-a81a8b4f0e1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b64dbf-89') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:04:21.789875 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:21.790101 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:04:21.790296 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:04:21.791332 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:21.791521 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e5c5f6fb-65ca-5397-8eec-f001eb8667b9', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:04:21.800952 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:21.801633 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:04:21.803076 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:21.805363 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:21.805572 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01b64dbf-89, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:04:21.805920 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap01b64dbf-89, col_values=(('qos', UUID('f56be2e4-8a13-402f-8cb7-8d06031168da')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:04:21.806103 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap01b64dbf-89, col_values=(('external_ids', {'iface-id': '01b64dbf-89aa-471a-a2df-58edb2a7a254', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:a6:59', 'vm-uuid': '2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:04:21.807639 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:21.808019 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:04:21.813749 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:21.815964 np0000001127 nova-compute[98206]: INFO os_vif [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a6:59,bridge_name='br-int',has_traffic_filtering=True,id=01b64dbf-89aa-471a-a2df-58edb2a7a254,network=Network(56a7d47c-c10f-4969-a14d-a81a8b4f0e1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b64dbf-89')
May 21 02:04:21.845382 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329061.8450265, d3816229-124e-468b-959d-030180d271c1 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:04:21.845552 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: d3816229-124e-468b-959d-030180d271c1] VM Started (Lifecycle Event)
May 21 02:04:21.846127 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:04:21.850322 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:04:21.856110 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: d3816229-124e-468b-959d-030180d271c1] Instance spawned successfully.
May 21 02:04:21.856611 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:04:22.209253 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-fbaefd02-5d48-4643-a968-ce25c9cbe044 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Took 1.36 seconds to destroy the instance on the hypervisor.
May 21 02:04:22.209805 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-fbaefd02-5d48-4643-a968-ce25c9cbe044 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:04:22.210234 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:04:22.210404 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:04:22.210771 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:22.281803 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:22.308147 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f0adfadc-2f09-44a6-8fc9-4d437d753561 req-00f37b05-ccbd-4431-b83e-7f8f76556d00 service nova] [instance: d3816229-124e-468b-959d-030180d271c1] Received event network-vif-plugged-c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:22.308704 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f0adfadc-2f09-44a6-8fc9-4d437d753561 req-00f37b05-ccbd-4431-b83e-7f8f76556d00 service nova] Acquiring lock "d3816229-124e-468b-959d-030180d271c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:22.308860 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f0adfadc-2f09-44a6-8fc9-4d437d753561 req-00f37b05-ccbd-4431-b83e-7f8f76556d00 service nova] Lock "d3816229-124e-468b-959d-030180d271c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:22.308994 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f0adfadc-2f09-44a6-8fc9-4d437d753561 req-00f37b05-ccbd-4431-b83e-7f8f76556d00 service nova] Lock "d3816229-124e-468b-959d-030180d271c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:22.309125 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f0adfadc-2f09-44a6-8fc9-4d437d753561 req-00f37b05-ccbd-4431-b83e-7f8f76556d00 service nova] [instance: d3816229-124e-468b-959d-030180d271c1] No waiting events found dispatching network-vif-plugged-c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:04:22.309286 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-f0adfadc-2f09-44a6-8fc9-4d437d753561 req-00f37b05-ccbd-4431-b83e-7f8f76556d00 service nova] [instance: d3816229-124e-468b-959d-030180d271c1] Received unexpected event network-vif-plugged-c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4 for instance with vm_state building and task_state spawning.
May 21 02:04:22.352133 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: d3816229-124e-468b-959d-030180d271c1] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:04:22.355797 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: d3816229-124e-468b-959d-030180d271c1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:04:22.362497 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:04:22.362676 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:04:22.362968 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:04:22.363269 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:04:22.363507 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:04:22.364003 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:04:22.858561 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: d3816229-124e-468b-959d-030180d271c1] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:04:22.858803 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329062.8586438, d3816229-124e-468b-959d-030180d271c1 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:04:22.859422 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: d3816229-124e-468b-959d-030180d271c1] VM Paused (Lifecycle Event)
May 21 02:04:22.869992 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-99e8a993-4d0f-4fa0-b067-8a38107f3ba8 req-02512fa1-e15f-4c77-98a6-6aa7588f72fa service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Received event network-vif-deleted-397001b0-550b-43bb-8c99-269fa0d710bb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:22.870398 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-99e8a993-4d0f-4fa0-b067-8a38107f3ba8 req-02512fa1-e15f-4c77-98a6-6aa7588f72fa service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Neutron deleted interface 397001b0-550b-43bb-8c99-269fa0d710bb; detaching it from the instance and deleting it from the info cache
May 21 02:04:22.870605 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-99e8a993-4d0f-4fa0-b067-8a38107f3ba8 req-02512fa1-e15f-4c77-98a6-6aa7588f72fa service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:04:22.872356 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Took 14.48 seconds to spawn the instance on the hypervisor.
May 21 02:04:22.872561 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:04:23.165085 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1af4f79d-7549-4b9c-a4f7-5924eab39618 req-cafe62ad-a14d-4be8-95f3-b21e8a79d164 service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Received event network-vif-unplugged-397001b0-550b-43bb-8c99-269fa0d710bb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:23.165965 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1af4f79d-7549-4b9c-a4f7-5924eab39618 req-cafe62ad-a14d-4be8-95f3-b21e8a79d164 service nova] Acquiring lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:23.166787 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1af4f79d-7549-4b9c-a4f7-5924eab39618 req-cafe62ad-a14d-4be8-95f3-b21e8a79d164 service nova] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:23.167135 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1af4f79d-7549-4b9c-a4f7-5924eab39618 req-cafe62ad-a14d-4be8-95f3-b21e8a79d164 service nova] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:23.167438 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1af4f79d-7549-4b9c-a4f7-5924eab39618 req-cafe62ad-a14d-4be8-95f3-b21e8a79d164 service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] No waiting events found dispatching network-vif-unplugged-397001b0-550b-43bb-8c99-269fa0d710bb {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:04:23.167705 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1af4f79d-7549-4b9c-a4f7-5924eab39618 req-cafe62ad-a14d-4be8-95f3-b21e8a79d164 service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Received event network-vif-unplugged-397001b0-550b-43bb-8c99-269fa0d710bb for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:04:23.313405 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:04:23.333019 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:04:23.333019 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:04:23.333404 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] No VIF found with MAC fa:16:3e:ed:a6:59, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:04:23.334766 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Using config drive
May 21 02:04:23.360965 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: d3816229-124e-468b-959d-030180d271c1] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:04:23.362547 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329063.362329, d3816229-124e-468b-959d-030180d271c1 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:04:23.362693 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: d3816229-124e-468b-959d-030180d271c1] VM Resumed (Lifecycle Event)
May 21 02:04:23.376992 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-99e8a993-4d0f-4fa0-b067-8a38107f3ba8 req-02512fa1-e15f-4c77-98a6-6aa7588f72fa service nova] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Detach interface failed, port_id=397001b0-550b-43bb-8c99-269fa0d710bb, reason: Instance df1fb869-23ef-48e0-b609-ce91c2540c2e could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:04:23.387349 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Took 22.19 seconds to build instance.
May 21 02:04:23.485379 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-677a1f36-f08c-4e39-a5ef-d900d5b955da tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Snapshot image upload complete
May 21 02:04:23.485601 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-677a1f36-f08c-4e39-a5ef-d900d5b955da tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Took 6.15 seconds to snapshot the instance on the hypervisor.
May 21 02:04:23.815793 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Took 1.61 seconds to deallocate network for instance.
May 21 02:04:23.838031 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lazy-loading 'ec2_ids' on Instance uuid 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:04:23.866051 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: d3816229-124e-468b-959d-030180d271c1] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:04:23.867942 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: d3816229-124e-468b-959d-030180d271c1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:04:23.888775 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f43e11c7-3739-45ae-8ae0-c0b7f28786d4 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "d3816229-124e-468b-959d-030180d271c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.696s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:24.322903 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fbaefd02-5d48-4643-a968-ce25c9cbe044 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:24.324812 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fbaefd02-5d48-4643-a968-ce25c9cbe044 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:24.342281 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Object Instance<2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices,ec2_ids {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:04:24.342406 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lazy-loading 'keypairs' on Instance uuid 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:04:24.786802 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Acquiring lock "76097fea-0890-40a8-a902-9f510cd34b52" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:24.787034 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "76097fea-0890-40a8-a902-9f510cd34b52" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:24.845166 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Object Instance<2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:04:24.849599 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:24.959254 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-fbaefd02-5d48-4643-a968-ce25c9cbe044 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:04:24.959461 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-fbaefd02-5d48-4643-a968-ce25c9cbe044 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:04:25.002241 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Creating config drive at /opt/stack/data/nova/instances/2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61/disk.config
May 21 02:04:25.005830 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfo2oe_v_ {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:04:25.066904 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfo2oe_v_" returned: 0 in 0.061s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:04:25.130155 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "d3816229-124e-468b-959d-030180d271c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:25.130562 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "d3816229-124e-468b-959d-030180d271c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:25.130736 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "d3816229-124e-468b-959d-030180d271c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:25.130923 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "d3816229-124e-468b-959d-030180d271c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:25.131094 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "d3816229-124e-468b-959d-030180d271c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:25.134818 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Terminating instance
May 21 02:04:25.296313 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lazy-loading 'flavor' on Instance uuid 76097fea-0890-40a8-a902-9f510cd34b52 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:04:25.462763 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-fbaefd02-5d48-4643-a968-ce25c9cbe044 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:04:25.522764 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:25.558295 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:25.639482 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:04:25.662272 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:25.692502 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:25.771376 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-493d5aba-1363-4b1a-b4ee-491c2ab094ec req-765487d5-639b-4d66-9396-f2c159da37e9 service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Received event network-vif-plugged-01b64dbf-89aa-471a-a2df-58edb2a7a254 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:25.771651 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-493d5aba-1363-4b1a-b4ee-491c2ab094ec req-765487d5-639b-4d66-9396-f2c159da37e9 service nova] Acquiring lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:25.771797 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-493d5aba-1363-4b1a-b4ee-491c2ab094ec req-765487d5-639b-4d66-9396-f2c159da37e9 service nova] Lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:25.771970 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-493d5aba-1363-4b1a-b4ee-491c2ab094ec req-765487d5-639b-4d66-9396-f2c159da37e9 service nova] Lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:25.772094 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-493d5aba-1363-4b1a-b4ee-491c2ab094ec req-765487d5-639b-4d66-9396-f2c159da37e9 service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Processing event network-vif-plugged-01b64dbf-89aa-471a-a2df-58edb2a7a254 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:04:25.905748 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:25.912351 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:25.915819 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:25.935990 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:25.940092 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:25.975794 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fbaefd02-5d48-4643-a968-ce25c9cbe044 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.652s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:26.015701 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999667092999971 future=<Future at 0x71c05822ffe0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:26.021926 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-115c9e83-0f33-45e2-a09a-df96fc4b7f5c req-619e6560-5345-421a-88ec-87b1a223e28a service nova] [instance: d3816229-124e-468b-959d-030180d271c1] Received event network-vif-unplugged-c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:26.022125 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-115c9e83-0f33-45e2-a09a-df96fc4b7f5c req-619e6560-5345-421a-88ec-87b1a223e28a service nova] Acquiring lock "d3816229-124e-468b-959d-030180d271c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:26.022463 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-115c9e83-0f33-45e2-a09a-df96fc4b7f5c req-619e6560-5345-421a-88ec-87b1a223e28a service nova] Lock "d3816229-124e-468b-959d-030180d271c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:26.022668 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-115c9e83-0f33-45e2-a09a-df96fc4b7f5c req-619e6560-5345-421a-88ec-87b1a223e28a service nova] Lock "d3816229-124e-468b-959d-030180d271c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:26.022842 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-115c9e83-0f33-45e2-a09a-df96fc4b7f5c req-619e6560-5345-421a-88ec-87b1a223e28a service nova] [instance: d3816229-124e-468b-959d-030180d271c1] No waiting events found dispatching network-vif-unplugged-c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:04:26.023004 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-115c9e83-0f33-45e2-a09a-df96fc4b7f5c req-619e6560-5345-421a-88ec-87b1a223e28a service nova] [instance: d3816229-124e-468b-959d-030180d271c1] Received event network-vif-unplugged-c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:04:26.024752 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: d3816229-124e-468b-959d-030180d271c1] Instance destroyed successfully.
May 21 02:04:26.025410 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lazy-loading 'resources' on Instance uuid d3816229-124e-468b-959d-030180d271c1 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:04:26.057847 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:26.070379 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-fbaefd02-5d48-4643-a968-ce25c9cbe044 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Deleted allocations for instance df1fb869-23ef-48e0-b609-ce91c2540c2e
May 21 02:04:26.084747 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:26.086113 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:26.302765 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "76097fea-0890-40a8-a902-9f510cd34b52" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.516s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:26.493141 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:26.527980 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:03:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1188074728',display_name='tempest-TestVolumeBootPattern-server-1188074728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpattern-server-1188074728',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:04:22Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62ebdb16aee84e22a88dfc8960debd32',ramdisk_id='',reservation_id='r-woq36q8v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestVolumeBootPattern-1995806391',owner_user_name='tempest-TestVolumeBootPattern-1995806391-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:04:23Z,user_data=None,user_id='4878b5a5bf184852a9ce383caa1c67a4',uuid=d3816229-124e-468b-959d-030180d271c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4", "address": "fa:16:3e:79:04:e0", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6fbdc73-9f", "ovs_interfaceid": "c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:04:26.528165 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converting VIF {"id": "c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4", "address": "fa:16:3e:79:04:e0", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6fbdc73-9f", "ovs_interfaceid": "c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:04:26.528805 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:04:e0,bridge_name='br-int',has_traffic_filtering=True,id=c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6fbdc73-9f') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:04:26.529049 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:04:e0,bridge_name='br-int',has_traffic_filtering=True,id=c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6fbdc73-9f') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:04:26.530158 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:26.530380 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc6fbdc73-9f, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:04:26.531330 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:26.532040 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:04:26.532892 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:26.534148 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:26.535161 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6b7acca6-e3eb-4f85-bc28-edf04d67f942) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:04:26.535161 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:26.535556 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:04:26.535970 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:26.538326 np0000001127 nova-compute[98206]: INFO os_vif [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:04:e0,bridge_name='br-int',has_traffic_filtering=True,id=c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6fbdc73-9f')
May 21 02:04:26.540680 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:04:26.540938 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329066.540605, 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:04:26.541040 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] VM Started (Lifecycle Event)
May 21 02:04:26.544024 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:04:26.545672 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:04:26.546047 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d', 'iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8c01bebd-50f6-433e-bd1d-2c3837bc127d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:04:26.546170 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:04:26.546558 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Instance spawned successfully.
May 21 02:04:26.547033 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:04:26.548784 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:04:26.549131 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d', 'iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8c01bebd-50f6-433e-bd1d-2c3837bc127d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:04:26.552122 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:04:26.583922 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:26.583922 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:26.583922 np0000001127 nova-compute[98206]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:26.583922 np0000001127 nova-compute[98206]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:26.583922 np0000001127 nova-compute[98206]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d (non-flash)
May 21 02:04:26.583922 np0000001127 nova-compute[98206]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d (non-flash)
May 21 02:04:26.583922 np0000001127 nova-compute[98206]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:26.583922 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:26.583922 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:04:26.584488 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:26.584488 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:26.584488 np0000001127 nova-compute[98206]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:26.584488 np0000001127 nova-compute[98206]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:26.584488 np0000001127 nova-compute[98206]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d (non-flash)
May 21 02:04:26.584488 np0000001127 nova-compute[98206]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d (non-flash)
May 21 02:04:26.584488 np0000001127 nova-compute[98206]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:26.584488 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:26.584488 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:04:26.584488 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a', '82'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a', '83'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d', '84'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d', '85'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', '86'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', '87')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:04:26.584488 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d', '85')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:04:26.588093 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d', '84')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:04:26.589082 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c058576ca0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d'): ({'sde'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:04:26.589340 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Removing multipathed devices sdd, sde {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:04:26.589656 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Flush multipath device 33000000054e1c67e {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:04:26.625241 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:04:26.666548 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:04:26.715320 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:04:26.715524 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:04:26.717081 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:04:26.730986 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:04:26.730986 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:04:26.744217 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:26.783247 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 85, target: iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d, portal: 192.168.40.100,3260]
May 21 02:04:26.783247 np0000001127 nova-compute[98206]: Logout of [sid: 85, target: iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d, portal: 192.168.40.100,3260] successful.
May 21 02:04:26.783247 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:26.804948 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:26.823422 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:26.852072 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 84, target: iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d, portal: 192.168.50.100,3260]
May 21 02:04:26.852072 np0000001127 nova-compute[98206]: Logout of [sid: 84, target: iqn.2023-03.storpool.com:os--volume-8c01bebd-50f6-433e-bd1d-2c3837bc127d, portal: 192.168.50.100,3260] successful.
May 21 02:04:26.852072 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:26.870421 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:26.871879 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:04:26.872029 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] <== disconnect_volume: return (325ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:04:26.872136 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:04:26.872425 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Deleting instance files /opt/stack/data/nova/instances/d3816229-124e-468b-959d-030180d271c1_del
May 21 02:04:26.872910 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Deletion of /opt/stack/data/nova/instances/d3816229-124e-468b-959d-030180d271c1_del complete
May 21 02:04:27.043903 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:04:27.048155 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:04:27.061384 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0774f96b-f547-429f-91c9-99e10d6e316c tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.670s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:27.081995 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fbaefd02-5d48-4643-a968-ce25c9cbe044 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "df1fb869-23ef-48e0-b609-ce91c2540c2e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.737s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:27.381727 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Took 1.74 seconds to destroy the instance on the hypervisor.
May 21 02:04:27.382063 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:04:27.382654 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: d3816229-124e-468b-959d-030180d271c1] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:04:27.382743 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: d3816229-124e-468b-959d-030180d271c1] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:04:27.383942 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:27.436371 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Acquiring lock "76097fea-0890-40a8-a902-9f510cd34b52" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:27.436646 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "76097fea-0890-40a8-a902-9f510cd34b52" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:27.436887 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Attaching volume ecb49e75-1da5-4848-806e-d7bb8cd06f5c to /dev/vdb
May 21 02:04:27.475695 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:27.510332 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:04:27.529812 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:04:27.551503 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329067.5511634, 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:04:27.551823 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] VM Paused (Lifecycle Event)
May 21 02:04:27.563189 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:04:27.623517 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:04:27.623894 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:04:27.635713 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:04:27.637299 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe9e:216', 'fe80::14d9:7bff:fe3b:f0dc', 'fe80::fc16:3eff:fe45:a237', 'fe80::789a:c1ff:fe89:a024', 'fe80::fc16:3eff:fe2b:20c8', 'fe80::fc16:3eff:fe60:a612', 'fe80::fc16:3eff:fe4b:b481', 'fe80::2844:63ff:fe5d:6c35', 'fe80::fc16:3eff:fe27:7142', 'fe80::fc16:3eff:fe61:105e', 'fe80::f819:cdff:fe2b:de28', 'fe80::fc16:3eff:feed:a659', 'fe80::803:29ff:fe32:ac7b'] 
May 21 02:04:27.637455 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:04:27.637670 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:04:27.637964 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:04:27.638268 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Updating existing volume attachment record: dc16f433-fc73-480f-8d8b-e8953a34b8f2 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:04:27.853869 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a3c8097f-8814-4718-a522-aa1e931d4282 req-bb8da27e-3712-437a-bfe0-324c5bfd38ba service nova] [instance: d3816229-124e-468b-959d-030180d271c1] Received event network-vif-deleted-c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:27.859120 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-a3c8097f-8814-4718-a522-aa1e931d4282 req-bb8da27e-3712-437a-bfe0-324c5bfd38ba service nova] [instance: d3816229-124e-468b-959d-030180d271c1] Neutron deleted interface c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4; detaching it from the instance and deleting it from the info cache
May 21 02:04:27.859357 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-a3c8097f-8814-4718-a522-aa1e931d4282 req-bb8da27e-3712-437a-bfe0-324c5bfd38ba service nova] [instance: d3816229-124e-468b-959d-030180d271c1] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:04:27.864537 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-163e3413-08dc-4b5a-8156-695a83d72569 req-8b741a71-c2f4-4641-8d70-098bf8bfeb50 service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Received event network-vif-plugged-01b64dbf-89aa-471a-a2df-58edb2a7a254 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:27.864874 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-163e3413-08dc-4b5a-8156-695a83d72569 req-8b741a71-c2f4-4641-8d70-098bf8bfeb50 service nova] Acquiring lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:27.864874 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-163e3413-08dc-4b5a-8156-695a83d72569 req-8b741a71-c2f4-4641-8d70-098bf8bfeb50 service nova] Lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:27.865343 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-163e3413-08dc-4b5a-8156-695a83d72569 req-8b741a71-c2f4-4641-8d70-098bf8bfeb50 service nova] Lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:27.865425 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-163e3413-08dc-4b5a-8156-695a83d72569 req-8b741a71-c2f4-4641-8d70-098bf8bfeb50 service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] No waiting events found dispatching network-vif-plugged-01b64dbf-89aa-471a-a2df-58edb2a7a254 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:04:27.865605 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-163e3413-08dc-4b5a-8156-695a83d72569 req-8b741a71-c2f4-4641-8d70-098bf8bfeb50 service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Received unexpected event network-vif-plugged-01b64dbf-89aa-471a-a2df-58edb2a7a254 for instance with vm_state active and task_state None.
May 21 02:04:27.987287 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "8948a19b-9e7e-448d-b782-be58020b5320" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:27.987429 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "8948a19b-9e7e-448d-b782-be58020b5320" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:28.054233 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:04:28.057010 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329068.05673, 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:04:28.057182 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] VM Resumed (Lifecycle Event)
May 21 02:04:28.109955 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f4e7d9c6-744e-437d-a3ea-232d612dc536 req-6636281b-63dc-4897-8dff-8de4b586b5b8 service nova] [instance: d3816229-124e-468b-959d-030180d271c1] Received event network-vif-unplugged-c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:28.110438 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f4e7d9c6-744e-437d-a3ea-232d612dc536 req-6636281b-63dc-4897-8dff-8de4b586b5b8 service nova] Acquiring lock "d3816229-124e-468b-959d-030180d271c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:28.110615 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f4e7d9c6-744e-437d-a3ea-232d612dc536 req-6636281b-63dc-4897-8dff-8de4b586b5b8 service nova] Lock "d3816229-124e-468b-959d-030180d271c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:28.110755 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f4e7d9c6-744e-437d-a3ea-232d612dc536 req-6636281b-63dc-4897-8dff-8de4b586b5b8 service nova] Lock "d3816229-124e-468b-959d-030180d271c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:28.110901 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f4e7d9c6-744e-437d-a3ea-232d612dc536 req-6636281b-63dc-4897-8dff-8de4b586b5b8 service nova] [instance: d3816229-124e-468b-959d-030180d271c1] No waiting events found dispatching network-vif-unplugged-c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:04:28.111064 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f4e7d9c6-744e-437d-a3ea-232d612dc536 req-6636281b-63dc-4897-8dff-8de4b586b5b8 service nova] [instance: d3816229-124e-468b-959d-030180d271c1] Received event network-vif-unplugged-c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:04:28.211993 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:04:28.212380 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c', 'iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ecb49e75-1da5-4848-806e-d7bb8cd06f5c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:04:28.212575 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:04:28.212995 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:04:28.213264 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c', 'iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ecb49e75-1da5-4848-806e-d7bb8cd06f5c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:04:28.226653 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:04:28.227180 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:04:28.227446 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:04:28.228207 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:04:28.232251 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:04:28.232505 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:04:28.242865 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:04:28.242865 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:28.249396 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:04:28.249396 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:28.263316 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c] added
May 21 02:04:28.263316 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:04:28.263316 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:04:28.263316 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:04:28.263316 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:04:28.263316 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:04:28.263316 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:28.264696 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:04:28.264696 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0362(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:04:28.264696 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:04:28.268326 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c] added
May 21 02:04:28.268326 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:04:28.268326 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:04:28.268326 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:04:28.268326 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:04:28.268326 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:04:28.268326 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:28.268622 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:04:28.268685 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0362(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:04:28.268829 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:04:28.279942 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: d3816229-124e-468b-959d-030180d271c1] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:04:28.365156 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a3c8097f-8814-4718-a522-aa1e931d4282 req-bb8da27e-3712-437a-bfe0-324c5bfd38ba service nova] [instance: d3816229-124e-468b-959d-030180d271c1] Detach interface failed, port_id=c6fbdc73-9f78-4a1e-ae96-c1fdfd499bb4, reason: Instance d3816229-124e-468b-959d-030180d271c1 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:04:28.490528 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Detaching volume 2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a
May 21 02:04:28.535866 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Attempting to driver detach volume 2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a from mountpoint /dev/vdb
May 21 02:04:28.540486 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Found disk vdb by alias ua-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:04:28.541866 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Found disk vdb by alias ua-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:04:28.542004 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Attempting to detach device vdb from instance 8948a19b-9e7e-448d-b782-be58020b5320 from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 02:04:28.542288 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:04:28.542288 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:04:28.542288 np0000001127 nova-compute[98206]:   <alias name="ua-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a"/>
May 21 02:04:28.542288 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-11"/>
May 21 02:04:28.542288 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:04:28.542288 np0000001127 nova-compute[98206]:   <serial>2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a</serial>
May 21 02:04:28.542288 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:04:28.542288 np0000001127 nova-compute[98206]: </disk>
May 21 02:04:28.542288 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:04:28.550735 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Successfully detached device vdb from instance 8948a19b-9e7e-448d-b782-be58020b5320 from the persistent domain config.
May 21 02:04:28.550941 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] (1/8): Attempting to detach device vdb with device alias ua-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a from instance 8948a19b-9e7e-448d-b782-be58020b5320 from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 02:04:28.551228 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:04:28.551228 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:04:28.551228 np0000001127 nova-compute[98206]:   <alias name="ua-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a"/>
May 21 02:04:28.551228 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-11"/>
May 21 02:04:28.551228 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:04:28.551228 np0000001127 nova-compute[98206]:   <serial>2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a</serial>
May 21 02:04:28.551228 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:04:28.551228 np0000001127 nova-compute[98206]: </disk>
May 21 02:04:28.551228 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:04:28.561337 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:04:28.563935 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:04:28.782456 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: d3816229-124e-468b-959d-030180d271c1] Took 1.40 seconds to deallocate network for instance.
May 21 02:04:29.264284 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:04:29.269985 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:04:29.270641 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779329069.2701676, 8948a19b-9e7e-448d-b782-be58020b5320 => ua-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 02:04:29.273127 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a for instance 8948a19b-9e7e-448d-b782-be58020b5320 {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 02:04:29.276154 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Successfully detached device vdb from instance 8948a19b-9e7e-448d-b782-be58020b5320 from the live domain config.
May 21 02:04:29.277891 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:04:29.278228 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a', 'iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:04:29.279009 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:04:29.279756 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:04:29.279756 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:04:29.286033 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:04:29.286033 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:29.297016 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:29.303654 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:29.313536 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:29.313536 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:29.313536 np0000001127 nova-compute[98206]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:29.313536 np0000001127 nova-compute[98206]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:29.313536 np0000001127 nova-compute[98206]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:29.313536 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:29.313536 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:04:29.313810 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:29.313810 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:29.313810 np0000001127 nova-compute[98206]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:29.313810 np0000001127 nova-compute[98206]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:29.313810 np0000001127 nova-compute[98206]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:29.313810 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:29.313810 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:04:29.320618 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:29.320618 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:29.320618 np0000001127 nova-compute[98206]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:29.320618 np0000001127 nova-compute[98206]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:29.320618 np0000001127 nova-compute[98206]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:29.320618 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:29.320618 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:04:29.320926 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:29.320926 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:29.320926 np0000001127 nova-compute[98206]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:29.320926 np0000001127 nova-compute[98206]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:29.320926 np0000001127 nova-compute[98206]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:29.320926 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:29.320926 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:04:29.364681 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c, portal: 192.168.40.100,3260]
May 21 02:04:29.364681 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c, portal: 192.168.40.100,3260] successful.
May 21 02:04:29.364681 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:29.385765 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:29.397576 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c, portal: 192.168.50.100,3260]
May 21 02:04:29.397576 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c, portal: 192.168.50.100,3260] successful.
May 21 02:04:29.397576 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:29.404812 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Took 0.62 seconds to detach 1 volumes for instance.
May 21 02:04:29.409494 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:29.409494 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:29.409494 np0000001127 nova-compute[98206]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:29.409494 np0000001127 nova-compute[98206]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:29.409494 np0000001127 nova-compute[98206]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:29.409494 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:29.409494 np0000001127 nova-compute[98206]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:29.409494 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:29.409494 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:04:29.409762 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:29.409762 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:29.409762 np0000001127 nova-compute[98206]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:29.409762 np0000001127 nova-compute[98206]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:29.409762 np0000001127 nova-compute[98206]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:29.409762 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:29.409762 np0000001127 nova-compute[98206]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:29.409762 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:29.409762 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:04:29.412731 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.183s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:04:29.412731 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:04:29.412731 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] HCTL ('9', '-', '-', 0) found on session 88 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:04:29.412731 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:04:29.420095 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:29.437231 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Searching for a device in session 88 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:04:29.437231 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ecb49e75-1da5-4848-806e-d7bb8cd06f5c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:04:29.446680 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:29.446680 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:29.446680 np0000001127 nova-compute[98206]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:29.446680 np0000001127 nova-compute[98206]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:29.446680 np0000001127 nova-compute[98206]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:29.446680 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:29.446680 np0000001127 nova-compute[98206]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:29.446680 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:29.446680 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:04:29.446680 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:29.446680 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:29.446680 np0000001127 nova-compute[98206]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:29.446680 np0000001127 nova-compute[98206]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:29.446680 np0000001127 nova-compute[98206]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:29.446680 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:29.446680 np0000001127 nova-compute[98206]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:29.446680 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:29.446680 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:04:29.446680 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.213s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:04:29.446680 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:04:29.446680 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] HCTL ('10', '-', '-', 0) found on session 89 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:04:29.446680 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:04:29.463935 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Searching for a device in session 89 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:04:29.464146 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ecb49e75-1da5-4848-806e-d7bb8cd06f5c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:04:29.912658 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:29.913012 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:30.229162 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:04:30.482483 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:04:30.482700 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:04:30.580675 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "f63a2253-071a-4a1a-94af-3544b20c39cf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:30.580890 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "f63a2253-071a-4a1a-94af-3544b20c39cf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:30.985556 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:04:31.044912 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-10795035-4443-4897-b0ca-e449551606c0 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Get console output
May 21 02:04:31.048217 np0000001127 nova-compute[98206]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
May 21 02:04:31.083001 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:04:31.245778 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Found WWN 3300000004a4ae24e for multipath device dm-1 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:04:31.250839 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:04:31.250839 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '3300000004a4ae24e', 'path': '/dev/dm-1', 'multipath_id': '3300000004a4ae24e'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:04:31.250839 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004a4ae24e', 'path': '/dev/dm-1', 'multipath_id': '3300000004a4ae24e'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:04:31.250839 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.969s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:04:31.250839 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a', 'iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:04:31.250839 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:04:31.250839 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lazy-loading 'flavor' on Instance uuid 76097fea-0890-40a8-a902-9f510cd34b52 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:04:31.279493 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:31.279493 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:31.279493 np0000001127 nova-compute[98206]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:31.279493 np0000001127 nova-compute[98206]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:31.279493 np0000001127 nova-compute[98206]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:31.279493 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:31.279493 np0000001127 nova-compute[98206]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:31.279493 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:31.279493 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:04:31.279493 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:31.279493 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:31.279493 np0000001127 nova-compute[98206]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:31.279493 np0000001127 nova-compute[98206]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a (non-flash)
May 21 02:04:31.279493 np0000001127 nova-compute[98206]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:31.279493 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:31.279493 np0000001127 nova-compute[98206]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:31.279493 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:31.279493 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:04:31.279493 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a', '82'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a', '83'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', '86'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', '87'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c', '88'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c', '89')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:04:31.279493 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a', '82')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:04:31.279493 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a', '83')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:04:31.279493 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c0584674c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a'): ({'sdm'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:04:31.283418 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Removing multipathed devices sdl, sdm {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:04:31.284040 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Flush multipath device 330000000fa6d99f7 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:04:31.324501 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:04:31.369156 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:04:31.423360 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Checking to see if SCSI volumes sdl, sdm have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:04:31.423360 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] SCSI volumes sdl, sdm have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:04:31.423360 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Checking to see if device paths {'sdl', 'sdm'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:04:31.437547 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Device paths {'sdl', 'sdm'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:04:31.437547 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:04:31.450699 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:31.483895 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 82, target: iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a, portal: 192.168.40.100,3260]
May 21 02:04:31.483895 np0000001127 nova-compute[98206]: Logout of [sid: 82, target: iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a, portal: 192.168.40.100,3260] successful.
May 21 02:04:31.483895 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:31.495111 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.582s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:31.496973 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:31.502687 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:31.516521 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:31.536952 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:31.553335 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 83, target: iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a, portal: 192.168.50.100,3260]
May 21 02:04:31.553335 np0000001127 nova-compute[98206]: Logout of [sid: 83, target: iqn.2023-03.storpool.com:os--volume-2c2b96e7-ff21-47b9-a2e7-c0b18e4e6e0a, portal: 192.168.50.100,3260] successful.
May 21 02:04:31.553335 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:31.572913 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:31.573582 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:04:31.576490 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] <== disconnect_volume: return (2294ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:04:31.576490 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:04:31.582857 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Deleted allocations for instance d3816229-124e-468b-959d-030180d271c1
May 21 02:04:31.644915 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:31.645222 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:31.650678 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:04:31.650822 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Claim successful on node np0000001127
May 21 02:04:31.753789 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Attempting to attach volume ecb49e75-1da5-4848-806e-d7bb8cd06f5c with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 02:04:31.755001 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] attach device xml: <disk type="block" device="disk">
May 21 02:04:31.755001 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:04:31.755001 np0000001127 nova-compute[98206]:   <alias name="ua-ecb49e75-1da5-4848-806e-d7bb8cd06f5c"/>
May 21 02:04:31.755001 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-1"/>
May 21 02:04:31.755001 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:04:31.755001 np0000001127 nova-compute[98206]:   <serial>ecb49e75-1da5-4848-806e-d7bb8cd06f5c</serial>
May 21 02:04:31.755001 np0000001127 nova-compute[98206]: </disk>
May 21 02:04:31.755001 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 02:04:32.162766 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lazy-loading 'flavor' on Instance uuid 8948a19b-9e7e-448d-b782-be58020b5320 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:04:32.472273 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "66fe5d80-9012-44fe-9b82-1e993211ddf1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:32.472490 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "66fe5d80-9012-44fe-9b82-1e993211ddf1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:32.472691 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "66fe5d80-9012-44fe-9b82-1e993211ddf1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:32.472849 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "66fe5d80-9012-44fe-9b82-1e993211ddf1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:32.472991 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "66fe5d80-9012-44fe-9b82-1e993211ddf1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:32.475195 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Terminating instance
May 21 02:04:32.590319 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4aa5db7f-db01-4df0-bc7c-c8d9533f7d95 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "d3816229-124e-468b-959d-030180d271c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.460s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:32.978483 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:04:33.000341 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:33.004066 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:33.028872 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:33.165652 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:33.172661 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:33.173808 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3be5d9e4-af35-4a1b-81d5-f5bc551b2cc0 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "8948a19b-9e7e-448d-b782-be58020b5320" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.186s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:33.199957 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-3e5e92de-c114-430b-82d5-6dea0d63affc req-571b0886-b96b-4e38-b521-67c168429efb service nova] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Received event network-vif-unplugged-29bf5645-d178-459e-b25f-1b1db9f87374 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:33.199957 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-3e5e92de-c114-430b-82d5-6dea0d63affc req-571b0886-b96b-4e38-b521-67c168429efb service nova] Acquiring lock "66fe5d80-9012-44fe-9b82-1e993211ddf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:33.199957 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-3e5e92de-c114-430b-82d5-6dea0d63affc req-571b0886-b96b-4e38-b521-67c168429efb service nova] Lock "66fe5d80-9012-44fe-9b82-1e993211ddf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:33.200093 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-3e5e92de-c114-430b-82d5-6dea0d63affc req-571b0886-b96b-4e38-b521-67c168429efb service nova] Lock "66fe5d80-9012-44fe-9b82-1e993211ddf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:33.200201 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-3e5e92de-c114-430b-82d5-6dea0d63affc req-571b0886-b96b-4e38-b521-67c168429efb service nova] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] No waiting events found dispatching network-vif-unplugged-29bf5645-d178-459e-b25f-1b1db9f87374 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:04:33.200358 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-3e5e92de-c114-430b-82d5-6dea0d63affc req-571b0886-b96b-4e38-b521-67c168429efb service nova] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Received event network-vif-unplugged-29bf5645-d178-459e-b25f-1b1db9f87374 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:04:33.254882 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:04:33.255081 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:04:33.346713 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999717185999998 future=<Future at 0x71c07c7bdaf0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:33.348076 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Instance destroyed successfully.
May 21 02:04:33.348482 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lazy-loading 'resources' on Instance uuid 66fe5d80-9012-44fe-9b82-1e993211ddf1 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:04:33.419099 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:04:33.419439 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:04:33.419617 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:04:33.419771 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] No VIF found with MAC fa:16:3e:4b:b4:81, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:04:33.428049 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fe9e2d6c-ceed-4efa-8e1c-b2a8f84968ae tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "8948a19b-9e7e-448d-b782-be58020b5320" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:33.428288 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fe9e2d6c-ceed-4efa-8e1c-b2a8f84968ae tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "8948a19b-9e7e-448d-b782-be58020b5320" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:33.428484 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fe9e2d6c-ceed-4efa-8e1c-b2a8f84968ae tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "8948a19b-9e7e-448d-b782-be58020b5320-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:33.428681 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fe9e2d6c-ceed-4efa-8e1c-b2a8f84968ae tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "8948a19b-9e7e-448d-b782-be58020b5320-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:33.428844 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fe9e2d6c-ceed-4efa-8e1c-b2a8f84968ae tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "8948a19b-9e7e-448d-b782-be58020b5320-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:33.439766 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-fe9e2d6c-ceed-4efa-8e1c-b2a8f84968ae tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Terminating instance
May 21 02:04:33.759620 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:04:33.833968 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "d35a1f35-4fdd-4efa-a753-7aa8d1a205a8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:33.834436 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "d35a1f35-4fdd-4efa-a753-7aa8d1a205a8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:33.850816 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:59:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1476667320',display_name='tempest-ServerActionsTestOtherA-server-1476667320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001127',hostname='tempest-serveractionstestothera-server-1476667320',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxRidCAMyb/mDvqucBNL6o1pu4ohR9TfsTnx1DGEBK8Hs9Bxy4viDAtOuJAjHZZuWNRGwi0rwlQFKlYKc+oTj/M3U8o3nzcuoUHvHlwyO9ufXio2O1Y8v01hvWMmUCFbg==',key_name='tempest-keypair-631476445',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:00:09Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a15fe7a70464159a778cffa4a36c36f',ramdisk_id='',reservation_id='r-szx080g8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1975191698',owner_user_name='tempest-ServerActionsTestOtherA-1975191698-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:00:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbcd1a81252344dd804a4080571f8751',uuid=66fe5d80-9012-44fe-9b82-1e993211ddf1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29bf5645-d178-459e-b25f-1b1db9f87374", "address": "fa:16:3e:45:a2:37", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bf5645-d1", "ovs_interfaceid": "29bf5645-d178-459e-b25f-1b1db9f87374", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:04:33.851040 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Converting VIF {"id": "29bf5645-d178-459e-b25f-1b1db9f87374", "address": "fa:16:3e:45:a2:37", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bf5645-d1", "ovs_interfaceid": "29bf5645-d178-459e-b25f-1b1db9f87374", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:04:33.851649 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:a2:37,bridge_name='br-int',has_traffic_filtering=True,id=29bf5645-d178-459e-b25f-1b1db9f87374,network=Network(6d660724-85bf-45e3-895a-b9ce67043c30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29bf5645-d1') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:04:33.851896 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:a2:37,bridge_name='br-int',has_traffic_filtering=True,id=29bf5645-d178-459e-b25f-1b1db9f87374,network=Network(6d660724-85bf-45e3-895a-b9ce67043c30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29bf5645-d1') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:04:33.853615 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:33.853868 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29bf5645-d1, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:04:33.854916 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:33.855692 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:04:33.856342 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:33.857505 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:33.857810 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=acd71d5c-8172-45bd-813b-172269cbbdc1) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:04:33.858504 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:33.859296 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:04:33.860056 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:33.862039 np0000001127 nova-compute[98206]: INFO os_vif [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:a2:37,bridge_name='br-int',has_traffic_filtering=True,id=29bf5645-d178-459e-b25f-1b1db9f87374,network=Network(6d660724-85bf-45e3-895a-b9ce67043c30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29bf5645-d1')
May 21 02:04:33.863259 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:04:33.863543 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7721af1e-8f1d-4ffa-b905-045839f8645d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:04:33.863767 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:04:33.863965 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:04:33.864277 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7721af1e-8f1d-4ffa-b905-045839f8645d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:04:33.864404 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:04:33.890995 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:33.890995 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:33.890995 np0000001127 nova-compute[98206]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:33.890995 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:33.890995 np0000001127 nova-compute[98206]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:33.890995 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:33.890995 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:04:33.891347 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsi session list stdout=tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:33.891347 np0000001127 nova-compute[98206]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d (non-flash)
May 21 02:04:33.891347 np0000001127 nova-compute[98206]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:33.891347 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:33.891347 np0000001127 nova-compute[98206]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:33.891347 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:33.891347 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:04:33.891347 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', '86'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', '87'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c', '88'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c', '89')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:04:33.891347 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '46')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:04:33.892332 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d', '47')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:04:33.893058 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c058467e20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d'): ({'sdc'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:04:33.893237 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Removing multipathed devices sdc, sdb {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:04:33.893440 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Flush multipath device 3300000007eb86ea1 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:04:33.942104 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-fe9e2d6c-ceed-4efa-8e1c-b2a8f84968ae tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:04:33.951213 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:04:33.968486 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:33.972163 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:33.996776 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:34.000988 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:04:34.057662 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:04:34.057842 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:04:34.059058 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:04:34.070108 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:04:34.070322 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:04:34.084376 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:34.129105 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d, portal: 192.168.40.100,3260]
May 21 02:04:34.129105 np0000001127 nova-compute[98206]: Logout of [sid: 46, target: iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d, portal: 192.168.40.100,3260] successful.
May 21 02:04:34.129105 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:34.145411 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:34.147589 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:34.151502 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-782c8e43-cb30-4ad4-a763-54520d04b402 req-0e3c98ee-7fe5-45c3-85e5-17bb689a11fd service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Received event network-vif-unplugged-9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:34.151502 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-782c8e43-cb30-4ad4-a763-54520d04b402 req-0e3c98ee-7fe5-45c3-85e5-17bb689a11fd service nova] Acquiring lock "8948a19b-9e7e-448d-b782-be58020b5320-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:34.151502 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-782c8e43-cb30-4ad4-a763-54520d04b402 req-0e3c98ee-7fe5-45c3-85e5-17bb689a11fd service nova] Lock "8948a19b-9e7e-448d-b782-be58020b5320-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:34.151502 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-782c8e43-cb30-4ad4-a763-54520d04b402 req-0e3c98ee-7fe5-45c3-85e5-17bb689a11fd service nova] Lock "8948a19b-9e7e-448d-b782-be58020b5320-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:34.151502 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-782c8e43-cb30-4ad4-a763-54520d04b402 req-0e3c98ee-7fe5-45c3-85e5-17bb689a11fd service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] No waiting events found dispatching network-vif-unplugged-9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:04:34.151864 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-782c8e43-cb30-4ad4-a763-54520d04b402 req-0e3c98ee-7fe5-45c3-85e5-17bb689a11fd service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Received event network-vif-unplugged-9089f785-707f-4bb7-ac00-927fe747fcc5 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:04:34.154526 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:34.159668 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:34.189630 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d, portal: 192.168.50.100,3260]
May 21 02:04:34.189630 np0000001127 nova-compute[98206]: Logout of [sid: 47, target: iqn.2023-03.storpool.com:os--volume-7721af1e-8f1d-4ffa-b905-045839f8645d, portal: 192.168.50.100,3260] successful.
May 21 02:04:34.189630 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:34.209232 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:34.209232 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:04:34.209232 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] <== disconnect_volume: return (343ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:04:34.209232 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:04:34.209537 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Deleting instance files /opt/stack/data/nova/instances/66fe5d80-9012-44fe-9b82-1e993211ddf1_del
May 21 02:04:34.210076 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Deletion of /opt/stack/data/nova/instances/66fe5d80-9012-44fe-9b82-1e993211ddf1_del complete
May 21 02:04:34.266673 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.621s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:34.267118 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:04:34.279027 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999757269999918 future=<Future at 0x71c07c7d44d0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:34.283075 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Instance destroyed successfully.
May 21 02:04:34.283075 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-fe9e2d6c-ceed-4efa-8e1c-b2a8f84968ae tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lazy-loading 'resources' on Instance uuid 8948a19b-9e7e-448d-b782-be58020b5320 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:04:34.337570 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lazy-loading 'flavor' on Instance uuid d35a1f35-4fdd-4efa-a753-7aa8d1a205a8 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:04:34.716704 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Took 1.74 seconds to destroy the instance on the hypervisor.
May 21 02:04:34.719491 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:04:34.719491 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:04:34.719491 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:04:34.719491 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:34.776738 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:04:34.776995 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:04:34.777304 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:34.777636 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:34.786545 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-fe9e2d6c-ceed-4efa-8e1c-b2a8f84968ae tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:02:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-211968432',display_name='tempest-ServerRescueNegativeTestJSON-server-211968432',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serverrescuenegativetestjson-server-211968432',id=32,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFx9wnklHgIW/7mX/mDP0Acf71gIHeOJ42Z6/jd1Qb5TRL5dzkGcgjJOewbr4VJwvfK5/AZfylhiEzVdL+ykfazuitFbm4WyjJZfeHI3do3V/FnUZD7DAaZ4ri/2MlV9dQ==',key_name='tempest-keypair-1008477287',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:03:42Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87eb25eb23724c49b5bdbc462a1f36bc',ramdisk_id='',reservation_id='r-0isusuuj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1108613901',owner_user_name='tempest-ServerRescueNegativeTestJSON-1108613901-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:03:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b5074a8e47b444cb19c7dcf761ac2ae',uuid=8948a19b-9e7e-448d-b782-be58020b5320,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9089f785-707f-4bb7-ac00-927fe747fcc5", "address": "fa:16:3e:27:71:42", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9089f785-70", "ovs_interfaceid": "9089f785-707f-4bb7-ac00-927fe747fcc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:04:34.786711 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-fe9e2d6c-ceed-4efa-8e1c-b2a8f84968ae tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Converting VIF {"id": "9089f785-707f-4bb7-ac00-927fe747fcc5", "address": "fa:16:3e:27:71:42", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9089f785-70", "ovs_interfaceid": "9089f785-707f-4bb7-ac00-927fe747fcc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:04:34.790209 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-fe9e2d6c-ceed-4efa-8e1c-b2a8f84968ae tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:71:42,bridge_name='br-int',has_traffic_filtering=True,id=9089f785-707f-4bb7-ac00-927fe747fcc5,network=Network(b8fcc592-f44d-440d-b1f1-c57714291c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9089f785-70') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:04:34.790209 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-fe9e2d6c-ceed-4efa-8e1c-b2a8f84968ae tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:71:42,bridge_name='br-int',has_traffic_filtering=True,id=9089f785-707f-4bb7-ac00-927fe747fcc5,network=Network(b8fcc592-f44d-440d-b1f1-c57714291c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9089f785-70') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:04:34.790209 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:34.790209 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9089f785-70, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:04:34.790209 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:34.790767 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:04:34.790907 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:34.791665 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:34.791902 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=47a5a9ce-7603-48d9-b521-a941f92d8441) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:04:34.792399 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:34.794042 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:04:34.796930 np0000001127 nova-compute[98206]: INFO os_vif [None req-fe9e2d6c-ceed-4efa-8e1c-b2a8f84968ae tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:71:42,bridge_name='br-int',has_traffic_filtering=True,id=9089f785-707f-4bb7-ac00-927fe747fcc5,network=Network(b8fcc592-f44d-440d-b1f1-c57714291c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9089f785-70')
May 21 02:04:34.797363 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-fe9e2d6c-ceed-4efa-8e1c-b2a8f84968ae tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Deleting instance files /opt/stack/data/nova/instances/8948a19b-9e7e-448d-b782-be58020b5320_del
May 21 02:04:34.798098 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-fe9e2d6c-ceed-4efa-8e1c-b2a8f84968ae tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Deletion of /opt/stack/data/nova/instances/8948a19b-9e7e-448d-b782-be58020b5320_del complete
May 21 02:04:34.821707 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:34.879669 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '640fad0f3dfe4ee99b04c12c2b8fd9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80cee8643f34f6685ff7fb42920afc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:04:34.995807 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-126593fb-5e3c-4b6d-85c1-9bb3f080bfc7 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "76097fea-0890-40a8-a902-9f510cd34b52" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.559s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:35.279942 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:04:35.300663 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6849d800-7f84-45b5-8f1d-2e9230e8e42a req-d453063b-fe14-40d5-ab9f-4c3297e6047d service nova] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Received event network-vif-unplugged-29bf5645-d178-459e-b25f-1b1db9f87374 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:35.300663 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6849d800-7f84-45b5-8f1d-2e9230e8e42a req-d453063b-fe14-40d5-ab9f-4c3297e6047d service nova] Acquiring lock "66fe5d80-9012-44fe-9b82-1e993211ddf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:35.300946 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6849d800-7f84-45b5-8f1d-2e9230e8e42a req-d453063b-fe14-40d5-ab9f-4c3297e6047d service nova] Lock "66fe5d80-9012-44fe-9b82-1e993211ddf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:35.301682 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6849d800-7f84-45b5-8f1d-2e9230e8e42a req-d453063b-fe14-40d5-ab9f-4c3297e6047d service nova] Lock "66fe5d80-9012-44fe-9b82-1e993211ddf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:35.301764 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6849d800-7f84-45b5-8f1d-2e9230e8e42a req-d453063b-fe14-40d5-ab9f-4c3297e6047d service nova] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] No waiting events found dispatching network-vif-unplugged-29bf5645-d178-459e-b25f-1b1db9f87374 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:04:35.301897 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6849d800-7f84-45b5-8f1d-2e9230e8e42a req-d453063b-fe14-40d5-ab9f-4c3297e6047d service nova] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Received event network-vif-unplugged-29bf5645-d178-459e-b25f-1b1db9f87374 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:04:35.305389 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-fe9e2d6c-ceed-4efa-8e1c-b2a8f84968ae tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Took 1.36 seconds to destroy the instance on the hypervisor.
May 21 02:04:35.306094 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-fe9e2d6c-ceed-4efa-8e1c-b2a8f84968ae tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:04:35.306572 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:04:35.306672 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:04:35.306987 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:35.311530 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-72999d26-95a0-49f6-8dc4-48920278db3a req-4dee271d-f1c5-47bb-a2ec-82c6c90b33f6 service nova] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Received event network-vif-deleted-29bf5645-d178-459e-b25f-1b1db9f87374 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:35.311689 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-72999d26-95a0-49f6-8dc4-48920278db3a req-4dee271d-f1c5-47bb-a2ec-82c6c90b33f6 service nova] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Neutron deleted interface 29bf5645-d178-459e-b25f-1b1db9f87374; detaching it from the instance and deleting it from the info cache
May 21 02:04:35.311795 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-72999d26-95a0-49f6-8dc4-48920278db3a req-4dee271d-f1c5-47bb-a2ec-82c6c90b33f6 service nova] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:04:35.343764 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "d35a1f35-4fdd-4efa-a753-7aa8d1a205a8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:35.450239 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:35.541011 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Rescuing
May 21 02:04:35.541011 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Acquiring lock "refresh_cache-76097fea-0890-40a8-a902-9f510cd34b52" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:04:35.541011 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Acquired lock "refresh_cache-76097fea-0890-40a8-a902-9f510cd34b52" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:04:35.541011 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:04:35.562282 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Successfully created port: e5285be0-d97c-43fc-93a2-91ac21456315 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:04:35.743392 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:04:35.784716 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:04:35.816996 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-72999d26-95a0-49f6-8dc4-48920278db3a req-4dee271d-f1c5-47bb-a2ec-82c6c90b33f6 service nova] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Detach interface failed, port_id=29bf5645-d178-459e-b25f-1b1db9f87374, reason: Instance 66fe5d80-9012-44fe-9b82-1e993211ddf1 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:04:36.046776 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:36.179714 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Successfully updated port: e5285be0-d97c-43fc-93a2-91ac21456315 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:04:36.186017 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.00034537199962869636 future=<Future at 0x71c0981f8830 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:36.186905 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Emitting event <LifecycleEvent: 1779329061.1855679, df1fb869-23ef-48e0-b609-ce91c2540c2e => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:04:36.187063 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] VM Stopped (Lifecycle Event)
May 21 02:04:36.192601 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:36.192938 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=4.819938815000114 future=<Future at 0x71c05822ffe0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:36.192938 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=4.819813392000015 future=<Future at 0x71c05822ffe0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:36.224588 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6804d842-967e-4917-9494-60ae8c845efa req-47a68fc6-2f3d-4a71-b7e0-7eb57ce89ae0 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Received event network-vif-unplugged-9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:36.224774 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6804d842-967e-4917-9494-60ae8c845efa req-47a68fc6-2f3d-4a71-b7e0-7eb57ce89ae0 service nova] Acquiring lock "8948a19b-9e7e-448d-b782-be58020b5320-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:36.227349 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6804d842-967e-4917-9494-60ae8c845efa req-47a68fc6-2f3d-4a71-b7e0-7eb57ce89ae0 service nova] Lock "8948a19b-9e7e-448d-b782-be58020b5320-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:36.228452 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6804d842-967e-4917-9494-60ae8c845efa req-47a68fc6-2f3d-4a71-b7e0-7eb57ce89ae0 service nova] Lock "8948a19b-9e7e-448d-b782-be58020b5320-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:36.228728 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6804d842-967e-4917-9494-60ae8c845efa req-47a68fc6-2f3d-4a71-b7e0-7eb57ce89ae0 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] No waiting events found dispatching network-vif-unplugged-9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:04:36.228828 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6804d842-967e-4917-9494-60ae8c845efa req-47a68fc6-2f3d-4a71-b7e0-7eb57ce89ae0 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Received event network-vif-unplugged-9089f785-707f-4bb7-ac00-927fe747fcc5 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:04:36.229102 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6804d842-967e-4917-9494-60ae8c845efa req-47a68fc6-2f3d-4a71-b7e0-7eb57ce89ae0 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Received event network-vif-deleted-9089f785-707f-4bb7-ac00-927fe747fcc5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:36.229655 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-6804d842-967e-4917-9494-60ae8c845efa req-47a68fc6-2f3d-4a71-b7e0-7eb57ce89ae0 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Neutron deleted interface 9089f785-707f-4bb7-ac00-927fe747fcc5; detaching it from the instance and deleting it from the info cache
May 21 02:04:36.229958 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-6804d842-967e-4917-9494-60ae8c845efa req-47a68fc6-2f3d-4a71-b7e0-7eb57ce89ae0 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:04:36.245805 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Took 1.53 seconds to deallocate network for instance.
May 21 02:04:36.353327 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:04:36.414077 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:36.454148 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "d35a1f35-4fdd-4efa-a753-7aa8d1a205a8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:36.454328 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "d35a1f35-4fdd-4efa-a753-7aa8d1a205a8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:36.454541 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Attaching volume ee9e7b51-894c-40d4-8954-fecb89ce3df4 to /dev/vdb
May 21 02:04:36.497486 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:36.504931 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:04:36.527203 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:04:36.554734 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Updating instance_info_cache with network_info: [{"id": "f11d80e2-4ef4-404d-9b12-4b33f3e9caa2", "address": "fa:16:3e:4b:b4:81", "network": {"id": "8f999b5c-800e-44f7-84c5-6eff98ea03cb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-569078034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e98d81a820544f078c16b171f1e8b65c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11d80e2-4e", "ovs_interfaceid": "f11d80e2-4ef4-404d-9b12-4b33f3e9caa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:04:36.558400 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:04:36.608341 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:04:36.608341 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:04:36.617449 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:04:36.619907 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe9e:216', 'fe80::14d9:7bff:fe3b:f0dc', 'fe80::789a:c1ff:fe89:a024', 'fe80::fc16:3eff:fe2b:20c8', 'fe80::fc16:3eff:fe60:a612', 'fe80::fc16:3eff:fe4b:b481', 'fe80::2844:63ff:fe5d:6c35', 'fe80::fc16:3eff:fe61:105e', 'fe80::f819:cdff:fe2b:de28', 'fe80::fc16:3eff:feed:a659', 'fe80::803:29ff:fe32:ac7b'] 
May 21 02:04:36.620050 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:04:36.620153 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:04:36.620432 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:04:36.620852 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Updating existing volume attachment record: a9527731-1d86-419d-8db9-2fd49fe5e313 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:04:36.682687 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "refresh_cache-f63a2253-071a-4a1a-94af-3544b20c39cf" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:04:36.682858 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquired lock "refresh_cache-f63a2253-071a-4a1a-94af-3544b20c39cf" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:04:36.683055 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:04:36.696553 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1112689f-6655-45d5-8ff3-c37a841b4203 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: df1fb869-23ef-48e0-b609-ce91c2540c2e] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:04:36.736862 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6804d842-967e-4917-9494-60ae8c845efa req-47a68fc6-2f3d-4a71-b7e0-7eb57ce89ae0 service nova] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Detach interface failed, port_id=9089f785-707f-4bb7-ac00-927fe747fcc5, reason: Instance 8948a19b-9e7e-448d-b782-be58020b5320 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:04:36.799094 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:04:36.800252 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:04:36.802477 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Creating image(s)
May 21 02:04:36.803075 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "/opt/stack/data/nova/instances/f63a2253-071a-4a1a-94af-3544b20c39cf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:36.803256 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "/opt/stack/data/nova/instances/f63a2253-071a-4a1a-94af-3544b20c39cf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:36.803837 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "/opt/stack/data/nova/instances/f63a2253-071a-4a1a-94af-3544b20c39cf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:36.804616 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:04:36.809920 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:04:36.812151 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:04:36.829259 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Took 0.58 seconds to detach 1 volumes for instance.
May 21 02:04:36.837006 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Deleting volume: 7721af1e-8f1d-4ffa-b905-045839f8645d {{(pid=98206) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 21 02:04:36.856245 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Took 1.55 seconds to deallocate network for instance.
May 21 02:04:36.920557 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.109s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:04:36.921057 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:36.921574 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:36.922075 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:04:36.927512 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:04:36.928139 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:04:37.050970 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.122s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:04:37.051443 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/f63a2253-071a-4a1a-94af-3544b20c39cf/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:04:37.066510 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Releasing lock "refresh_cache-76097fea-0890-40a8-a902-9f510cd34b52" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:04:37.119420 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/f63a2253-071a-4a1a-94af-3544b20c39cf/disk 1073741824" returned: 0 in 0.068s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:04:37.119999 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:37.120416 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:04:37.218502 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.098s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:04:37.218969 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f63a2253-071a-4a1a-94af-3544b20c39cf/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:04:37.219768 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f63a2253-071a-4a1a-94af-3544b20c39cf/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:04:37.258637 np0000001127 nova-compute[98206]: DEBUG os_brick.encryptors [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4', 'iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ee9e7b51-894c-40d4-8954-fecb89ce3df4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'd35a1f35-4fdd-4efa-a753-7aa8d1a205a8', 'attached_at': '', 'detached_at': '', 'volume_id': 'ee9e7b51-894c-40d4-8954-fecb89ce3df4', 'serial': 'ee9e7b51-894c-40d4-8954-fecb89ce3df4'} {{(pid=98206) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 21 02:04:37.263276 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:04:37.263898 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4', 'iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ee9e7b51-894c-40d4-8954-fecb89ce3df4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:04:37.264202 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:04:37.265168 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:04:37.265461 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4', 'iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ee9e7b51-894c-40d4-8954-fecb89ce3df4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:04:37.281379 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:04:37.282645 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:04:37.283796 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:04:37.283796 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:04:37.284244 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:04:37.284690 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:04:37.296689 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:04:37.296689 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:37.302956 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:04:37.302956 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:37.315416 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f63a2253-071a-4a1a-94af-3544b20c39cf/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:04:37.315825 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Cannot resize image /opt/stack/data/nova/instances/f63a2253-071a-4a1a-94af-3544b20c39cf/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:04:37.316276 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:04:37.316661 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Ensure instance console log exists: /opt/stack/data/nova/instances/f63a2253-071a-4a1a-94af-3544b20c39cf/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:04:37.320894 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4] added
May 21 02:04:37.320894 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:04:37.320894 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:04:37.320894 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:04:37.320894 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:04:37.320894 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:04:37.320894 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:37.320894 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:04:37.322135 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:37.322135 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0374(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:04:37.322135 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:04:37.322135 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:37.322687 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4] added
May 21 02:04:37.322687 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:04:37.322687 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:04:37.322687 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:04:37.322687 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:04:37.322687 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:04:37.322687 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:37.322687 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:04:37.322998 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0382(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:04:37.322998 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:04:37.324330 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:37.331601 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:04:37.369722 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fe9e2d6c-ceed-4efa-8e1c-b2a8f84968ae tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:37.371063 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fe9e2d6c-ceed-4efa-8e1c-b2a8f84968ae tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:37.395704 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b5d8f906-5809-44ad-bd8b-4c00107d71ae req-5f2c63e4-8cb1-44c3-ba86-9173a6400bc2 service nova] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Received event network-changed-e5285be0-d97c-43fc-93a2-91ac21456315 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:37.395923 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b5d8f906-5809-44ad-bd8b-4c00107d71ae req-5f2c63e4-8cb1-44c3-ba86-9173a6400bc2 service nova] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Refreshing instance network info cache due to event network-changed-e5285be0-d97c-43fc-93a2-91ac21456315. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:04:37.396082 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b5d8f906-5809-44ad-bd8b-4c00107d71ae req-5f2c63e4-8cb1-44c3-ba86-9173a6400bc2 service nova] Acquiring lock "refresh_cache-f63a2253-071a-4a1a-94af-3544b20c39cf" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:04:37.406559 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:37.423887 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "4a71f98e-0988-46c9-9b04-f8d0197468b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:37.424372 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "4a71f98e-0988-46c9-9b04-f8d0197468b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:37.518874 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:37.679254 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Updating instance_info_cache with network_info: [{"id": "e5285be0-d97c-43fc-93a2-91ac21456315", "address": "fa:16:3e:ca:eb:af", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5285be0-d9", "ovs_interfaceid": "e5285be0-d97c-43fc-93a2-91ac21456315", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:04:37.927584 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:04:37.931949 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-fe9e2d6c-ceed-4efa-8e1c-b2a8f84968ae tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:04:37.932405 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-fe9e2d6c-ceed-4efa-8e1c-b2a8f84968ae tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:04:38.186485 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Releasing lock "refresh_cache-f63a2253-071a-4a1a-94af-3544b20c39cf" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:04:38.187042 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Instance network_info: |[{"id": "e5285be0-d97c-43fc-93a2-91ac21456315", "address": "fa:16:3e:ca:eb:af", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5285be0-d9", "ovs_interfaceid": "e5285be0-d97c-43fc-93a2-91ac21456315", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:04:38.187385 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b5d8f906-5809-44ad-bd8b-4c00107d71ae req-5f2c63e4-8cb1-44c3-ba86-9173a6400bc2 service nova] Acquired lock "refresh_cache-f63a2253-071a-4a1a-94af-3544b20c39cf" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:04:38.189531 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Start _get_guest_xml network_info=[{"id": "e5285be0-d97c-43fc-93a2-91ac21456315", "address": "fa:16:3e:ca:eb:af", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5285be0-d9", "ovs_interfaceid": "e5285be0-d97c-43fc-93a2-91ac21456315", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:04:38.189892 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-b5d8f906-5809-44ad-bd8b-4c00107d71ae req-5f2c63e4-8cb1-44c3-ba86-9173a6400bc2 service nova] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Refreshing network info cache for port e5285be0-d97c-43fc-93a2-91ac21456315 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:04:38.194145 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:04:38.195679 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-1805805920', uuid='f63a2253-071a-4a1a-94af-3544b20c39cf'), owner=OwnerMeta(userid='640fad0f3dfe4ee99b04c12c2b8fd9dd', username='tempest-AttachVolumeTestJSON-2050140136-project-member', projectid='e80cee8643f34f6685ff7fb42920afc3', projectname='tempest-AttachVolumeTestJSON-2050140136'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e5285be0-d97c-43fc-93a2-91ac21456315", "address": "fa:16:3e:ca:eb:af", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5285be0-d9", "ovs_interfaceid": "e5285be0-d97c-43fc-93a2-91ac21456315", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329078.195221) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:04:38.197052 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:04:38.197518 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:04:38.198804 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:04:38.199081 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:04:38.200215 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:04:38.201179 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:04:38.201179 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:04:38.201179 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:04:38.201179 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:04:38.201179 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:04:38.201452 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:04:38.201722 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:04:38.201847 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:04:38.202072 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:04:38.202232 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:04:38.202395 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:04:38.220291 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1805805920',display_name='tempest-AttachVolumeTestJSON-server-1805805920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumetestjson-server-1805805920',id=39,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1mwjMvDhv68B2iNB8g+Hoov8ngsHV3yBRmTudTzshaxljlTmc+1N3i2q9+iI9ANNsL6rH21VI2EgAQpOgsVVXfV+RzewnGo3NfT0Dw0942D5T+gP/mRdgi35PF4wHrGg==',key_name='tempest-keypair-869733350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e80cee8643f34f6685ff7fb42920afc3',ramdisk_id='',reservation_id='r-g3p2xd94',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2050140136',owner_user_name='tempest-AttachVolumeTestJSON-2050140136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:04:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='640fad0f3dfe4ee99b04c12c2b8fd9dd',uuid=f63a2253-071a-4a1a-94af-3544b20c39cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5285be0-d97c-43fc-93a2-91ac21456315", "address": "fa:16:3e:ca:eb:af", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5285be0-d9", "ovs_interfaceid": "e5285be0-d97c-43fc-93a2-91ac21456315", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:04:38.220589 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Converting VIF {"id": "e5285be0-d97c-43fc-93a2-91ac21456315", "address": "fa:16:3e:ca:eb:af", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5285be0-d9", "ovs_interfaceid": "e5285be0-d97c-43fc-93a2-91ac21456315", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:04:38.221253 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:eb:af,bridge_name='br-int',has_traffic_filtering=True,id=e5285be0-d97c-43fc-93a2-91ac21456315,network=Network(70a21e20-dfdf-49b9-bfd2-75a1f49c8a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5285be0-d9') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:04:38.222029 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lazy-loading 'pci_devices' on Instance uuid f63a2253-071a-4a1a-94af-3544b20c39cf {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:04:38.323498 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:04:38.324543 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:04:38.341355 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:04:38.341355 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:04:38.345341 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:04:38.345341 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:38.357633 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:38.366496 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:38.371802 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:38.371802 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:38.371802 np0000001127 nova-compute[98206]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:38.371802 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:38.371802 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:04:38.372359 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsi session list stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:38.372359 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:38.372359 np0000001127 nova-compute[98206]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:38.372359 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:38.372359 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:04:38.388366 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:38.388366 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:38.388366 np0000001127 nova-compute[98206]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:38.388366 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:38.388366 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:04:38.388570 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsi session list stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:38.388570 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:38.388570 np0000001127 nova-compute[98206]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:38.388570 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:38.388570 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:04:38.409165 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4, portal: 192.168.50.100,3260]
May 21 02:04:38.409165 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4, portal: 192.168.50.100,3260] successful.
May 21 02:04:38.409165 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:38.422734 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:38.435584 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4, portal: 192.168.40.100,3260]
May 21 02:04:38.435584 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4, portal: 192.168.40.100,3260] successful.
May 21 02:04:38.435584 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:38.437212 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-fe9e2d6c-ceed-4efa-8e1c-b2a8f84968ae tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:04:38.446928 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:38.446928 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:38.446928 np0000001127 nova-compute[98206]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:38.446928 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:38.446928 np0000001127 nova-compute[98206]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4 (non-flash)
May 21 02:04:38.446928 np0000001127 nova-compute[98206]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4 (non-flash)
May 21 02:04:38.446928 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:04:38.447318 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsi session list stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:38.447318 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:38.447318 np0000001127 nova-compute[98206]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:38.447318 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:38.447318 np0000001127 nova-compute[98206]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4 (non-flash)
May 21 02:04:38.447318 np0000001127 nova-compute[98206]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4 (non-flash)
May 21 02:04:38.447318 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:04:38.448524 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.164s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:04:38.448661 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:04:38.449539 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] HCTL ('7', '-', '-', 0) found on session 90 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:04:38.449649 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:04:38.451052 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:38.465549 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Searching for a device in session 90 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:04:38.465549 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ee9e7b51-894c-40d4-8954-fecb89ce3df4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:04:38.476208 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:38.476208 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:38.476208 np0000001127 nova-compute[98206]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:38.476208 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:38.476208 np0000001127 nova-compute[98206]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4 (non-flash)
May 21 02:04:38.476208 np0000001127 nova-compute[98206]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4 (non-flash)
May 21 02:04:38.476208 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:04:38.476518 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsi session list stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:38.476518 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:38.476518 np0000001127 nova-compute[98206]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:38.476518 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:38.476518 np0000001127 nova-compute[98206]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4 (non-flash)
May 21 02:04:38.476518 np0000001127 nova-compute[98206]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4 (non-flash)
May 21 02:04:38.476518 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:04:38.476518 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.193s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:04:38.476792 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:04:38.477236 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] HCTL ('8', '-', '-', 0) found on session 91 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:04:38.477334 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:04:38.495520 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:38.499833 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Searching for a device in session 91 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:04:38.499833 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ee9e7b51-894c-40d4-8954-fecb89ce3df4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:04:38.693126 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-b5d8f906-5809-44ad-bd8b-4c00107d71ae req-5f2c63e4-8cb1-44c3-ba86-9173a6400bc2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:38.727497 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] End _get_guest_xml xml=<domain type="qemu">
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:   <uuid>f63a2253-071a-4a1a-94af-3544b20c39cf</uuid>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:   <name>instance-00000027</name>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:       <nova:name>tempest-AttachVolumeTestJSON-server-1805805920</nova:name>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:04:38</nova:creationTime>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:         <nova:user uuid="640fad0f3dfe4ee99b04c12c2b8fd9dd">tempest-AttachVolumeTestJSON-2050140136-project-member</nova:user>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:         <nova:project uuid="e80cee8643f34f6685ff7fb42920afc3">tempest-AttachVolumeTestJSON-2050140136</nova:project>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:         <nova:port uuid="e5285be0-d97c-43fc-93a2-91ac21456315">
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:     <system>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:       <entry name="serial">f63a2253-071a-4a1a-94af-3544b20c39cf</entry>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:       <entry name="uuid">f63a2253-071a-4a1a-94af-3544b20c39cf</entry>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:     </system>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:   <os>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:   </os>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:   <features>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:   </features>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:   <devices>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/f63a2253-071a-4a1a-94af-3544b20c39cf/disk"/>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:     </disk>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/f63a2253-071a-4a1a-94af-3544b20c39cf/disk.config"/>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:     </disk>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:ca:eb:af"/>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:       <target dev="tape5285be0-d9"/>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:     </interface>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/f63a2253-071a-4a1a-94af-3544b20c39cf/console.log" append="off"/>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:     </serial>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:     <video>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:     </video>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:     </rng>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:   </devices>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]: </domain>
May 21 02:04:38.727497 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:04:38.730760 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Preparing to wait for external event network-vif-plugged-e5285be0-d97c-43fc-93a2-91ac21456315 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:04:38.730760 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "f63a2253-071a-4a1a-94af-3544b20c39cf-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:38.730760 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "f63a2253-071a-4a1a-94af-3544b20c39cf-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:38.730760 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "f63a2253-071a-4a1a-94af-3544b20c39cf-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:38.730760 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1805805920',display_name='tempest-AttachVolumeTestJSON-server-1805805920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumetestjson-server-1805805920',id=39,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1mwjMvDhv68B2iNB8g+Hoov8ngsHV3yBRmTudTzshaxljlTmc+1N3i2q9+iI9ANNsL6rH21VI2EgAQpOgsVVXfV+RzewnGo3NfT0Dw0942D5T+gP/mRdgi35PF4wHrGg==',key_name='tempest-keypair-869733350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e80cee8643f34f6685ff7fb42920afc3',ramdisk_id='',reservation_id='r-g3p2xd94',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2050140136',owner_user_name='tempest-AttachVolumeTestJSON-2050140136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:04:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='640fad0f3dfe4ee99b04c12c2b8fd9dd',uuid=f63a2253-071a-4a1a-94af-3544b20c39cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5285be0-d97c-43fc-93a2-91ac21456315", "address": "fa:16:3e:ca:eb:af", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5285be0-d9", "ovs_interfaceid": "e5285be0-d97c-43fc-93a2-91ac21456315", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:04:38.730760 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Converting VIF {"id": "e5285be0-d97c-43fc-93a2-91ac21456315", "address": "fa:16:3e:ca:eb:af", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5285be0-d9", "ovs_interfaceid": "e5285be0-d97c-43fc-93a2-91ac21456315", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:04:38.730760 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:eb:af,bridge_name='br-int',has_traffic_filtering=True,id=e5285be0-d97c-43fc-93a2-91ac21456315,network=Network(70a21e20-dfdf-49b9-bfd2-75a1f49c8a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5285be0-d9') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:04:38.731218 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:eb:af,bridge_name='br-int',has_traffic_filtering=True,id=e5285be0-d97c-43fc-93a2-91ac21456315,network=Network(70a21e20-dfdf-49b9-bfd2-75a1f49c8a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5285be0-d9') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:04:38.731588 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:38.732046 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:04:38.732419 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:04:38.733597 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:38.733759 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a59b8d21-f942-538e-886f-6843c8d5fc20', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:04:38.736122 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:38.736122 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:04:38.737152 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:38.744559 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:38.745944 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape5285be0-d9, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:04:38.745944 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape5285be0-d9, col_values=(('qos', UUID('2532bbc3-a82e-4fc5-a488-d718f70196c0')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:04:38.745944 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape5285be0-d9, col_values=(('external_ids', {'iface-id': 'e5285be0-d97c-43fc-93a2-91ac21456315', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:eb:af', 'vm-uuid': 'f63a2253-071a-4a1a-94af-3544b20c39cf'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:04:38.747145 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:38.748254 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:04:38.755541 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:38.767079 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:38.776340 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:38.790356 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:38.815419 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:38.816595 np0000001127 nova-compute[98206]: INFO os_vif [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:eb:af,bridge_name='br-int',has_traffic_filtering=True,id=e5285be0-d97c-43fc-93a2-91ac21456315,network=Network(70a21e20-dfdf-49b9-bfd2-75a1f49c8a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5285be0-d9')
May 21 02:04:38.825983 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:38.949046 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fe9e2d6c-ceed-4efa-8e1c-b2a8f84968ae tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.578s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:38.953606 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.546s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:38.986543 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-22918cb0-766b-4c14-ac36-fb891a5729ce req-b217d8ee-1bb6-4fe3-a9f9-7672c59ea391 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Received event network-vif-unplugged-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:38.988290 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-22918cb0-766b-4c14-ac36-fb891a5729ce req-b217d8ee-1bb6-4fe3-a9f9-7672c59ea391 service nova] Acquiring lock "76097fea-0890-40a8-a902-9f510cd34b52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:38.988543 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-22918cb0-766b-4c14-ac36-fb891a5729ce req-b217d8ee-1bb6-4fe3-a9f9-7672c59ea391 service nova] Lock "76097fea-0890-40a8-a902-9f510cd34b52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:38.988704 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-22918cb0-766b-4c14-ac36-fb891a5729ce req-b217d8ee-1bb6-4fe3-a9f9-7672c59ea391 service nova] Lock "76097fea-0890-40a8-a902-9f510cd34b52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:38.989067 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-22918cb0-766b-4c14-ac36-fb891a5729ce req-b217d8ee-1bb6-4fe3-a9f9-7672c59ea391 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] No waiting events found dispatching network-vif-unplugged-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:04:38.989284 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-22918cb0-766b-4c14-ac36-fb891a5729ce req-b217d8ee-1bb6-4fe3-a9f9-7672c59ea391 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Received unexpected event network-vif-unplugged-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 for instance with vm_state active and task_state rescuing.
May 21 02:04:39.042510 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-fe9e2d6c-ceed-4efa-8e1c-b2a8f84968ae tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Deleted allocations for instance 8948a19b-9e7e-448d-b782-be58020b5320
May 21 02:04:39.080975 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.998641371999838 future=<Future at 0x71c05864a240 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:39.087012 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Instance destroyed successfully.
May 21 02:04:39.088224 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lazy-loading 'numa_topology' on Instance uuid 76097fea-0890-40a8-a902-9f510cd34b52 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:04:39.128882 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-b5d8f906-5809-44ad-bd8b-4c00107d71ae req-5f2c63e4-8cb1-44c3-ba86-9173a6400bc2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:39.283822 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:04:39.287563 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-b5d8f906-5809-44ad-bd8b-4c00107d71ae req-5f2c63e4-8cb1-44c3-ba86-9173a6400bc2 service nova] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Updated VIF entry in instance network info cache for port e5285be0-d97c-43fc-93a2-91ac21456315. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:04:39.287843 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-b5d8f906-5809-44ad-bd8b-4c00107d71ae req-5f2c63e4-8cb1-44c3-ba86-9173a6400bc2 service nova] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Updating instance_info_cache with network_info: [{"id": "e5285be0-d97c-43fc-93a2-91ac21456315", "address": "fa:16:3e:ca:eb:af", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5285be0-d9", "ovs_interfaceid": "e5285be0-d97c-43fc-93a2-91ac21456315", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:04:39.523019 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:04:39.523442 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:04:39.592837 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Attempting a stable device rescue
May 21 02:04:39.682598 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=98206) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 21 02:04:39.692131 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Instance directory exists: not creating {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 21 02:04:39.692325 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Creating image(s)
May 21 02:04:39.692725 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Acquiring lock "/opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:39.692847 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "/opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:39.693273 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "/opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:39.693433 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lazy-loading 'trusted_certs' on Instance uuid 76097fea-0890-40a8-a902-9f510cd34b52 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:04:39.790390 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b5d8f906-5809-44ad-bd8b-4c00107d71ae req-5f2c63e4-8cb1-44c3-ba86-9173a6400bc2 service nova] Releasing lock "refresh_cache-f63a2253-071a-4a1a-94af-3544b20c39cf" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:04:40.026002 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:04:40.050627 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fe9e2d6c-ceed-4efa-8e1c-b2a8f84968ae tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "8948a19b-9e7e-448d-b782-be58020b5320" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.622s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:40.195038 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Object Instance<76097fea-0890-40a8-a902-9f510cd34b52> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:04:40.195392 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Acquiring lock "44b7e0f059bbdb0c904c134a4e3c86710a45b80c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:40.195775 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "44b7e0f059bbdb0c904c134a4e3c86710a45b80c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:40.299388 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Found WWN 33000000024659e6c for multipath device dm-0 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:04:40.299890 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:04:40.301585 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '33000000024659e6c', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '33000000024659e6c'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:04:40.301585 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000024659e6c', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '33000000024659e6c'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:04:40.304317 np0000001127 nova-compute[98206]: WARNING stevedore.named [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 21 02:04:40.304317 np0000001127 nova-compute[98206]: WARNING castellan.key_manager [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 21 02:04:40.304317 np0000001127 nova-compute[98206]: WARNING nova.keymgr.conf_key_mgr [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 21 02:04:40.304317 np0000001127 nova-compute[98206]: DEBUG os_brick.encryptors [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x71c07c776270>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4', 'iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ee9e7b51-894c-40d4-8954-fecb89ce3df4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': 'd35a1f35-4fdd-4efa-a753-7aa8d1a205a8', 'attached_at': '', 'detached_at': '', 'volume_id': 'ee9e7b51-894c-40d4-8954-fecb89ce3df4', 'serial': 'ee9e7b51-894c-40d4-8954-fecb89ce3df4'} {{(pid=98206) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 21 02:04:40.304317 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=98206) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 21 02:04:40.304317 np0000001127 nova-compute[98206]: DEBUG os_brick.encryptors.luks [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] opening encrypted volume /dev/dm-0 {{(pid=98206) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 21 02:04:40.337797 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:04:40.337995 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:04:40.338047 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] No VIF found with MAC fa:16:3e:ca:eb:af, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:04:40.338666 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Using config drive
May 21 02:04:40.351765 np0000001127 nova-compute[98206]: WARNING os_brick.encryptors.luks [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 21 02:04:40.351765 np0000001127 nova-compute[98206]: INFO os_brick.encryptors.luks [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] /dev/dm-0 is not a valid LUKS device; formatting device for first use
May 21 02:04:40.351765 np0000001127 nova-compute[98206]: DEBUG os_brick.encryptors.luks [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] formatting encrypted volume /dev/dm-0 {{(pid=98206) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 21 02:04:40.534359 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.582s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:40.538434 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.044s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:40.548061 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:04:40.549432 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Claim successful on node np0000001127
May 21 02:04:40.621203 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Deleted allocations for instance 66fe5d80-9012-44fe-9b82-1e993211ddf1
May 21 02:04:40.763356 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:40.849207 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:41.017401 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.004298592999930406 future=<Future at 0x71c05822ffe0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:41.018677 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Emitting event <LifecycleEvent: 1779329066.0126736, d3816229-124e-468b-959d-030180d271c1 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:04:41.019763 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:41.019763 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Creating config drive at /opt/stack/data/nova/instances/f63a2253-071a-4a1a-94af-3544b20c39cf/disk.config
May 21 02:04:41.020338 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] VM Stopped (Lifecycle Event)
May 21 02:04:41.022515 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=7.3225714239997615 future=<Future at 0x71c07c7bdaf0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:41.022752 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=7.322365331999663 future=<Future at 0x71c07c7bdaf0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:41.038174 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f63a2253-071a-4a1a-94af-3544b20c39cf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2fs_h4et {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:04:41.086831 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-28703202-e9a8-4998-b6a7-1017c0c9e566 req-a0c5d54c-8fd8-4dcc-9752-461bafa3b9ad service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Received event network-vif-unplugged-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:41.087219 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-28703202-e9a8-4998-b6a7-1017c0c9e566 req-a0c5d54c-8fd8-4dcc-9752-461bafa3b9ad service nova] Acquiring lock "76097fea-0890-40a8-a902-9f510cd34b52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:41.087549 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-28703202-e9a8-4998-b6a7-1017c0c9e566 req-a0c5d54c-8fd8-4dcc-9752-461bafa3b9ad service nova] Lock "76097fea-0890-40a8-a902-9f510cd34b52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:41.087940 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-28703202-e9a8-4998-b6a7-1017c0c9e566 req-a0c5d54c-8fd8-4dcc-9752-461bafa3b9ad service nova] Lock "76097fea-0890-40a8-a902-9f510cd34b52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:41.087940 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-28703202-e9a8-4998-b6a7-1017c0c9e566 req-a0c5d54c-8fd8-4dcc-9752-461bafa3b9ad service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] No waiting events found dispatching network-vif-unplugged-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:04:41.088141 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-28703202-e9a8-4998-b6a7-1017c0c9e566 req-a0c5d54c-8fd8-4dcc-9752-461bafa3b9ad service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Received unexpected event network-vif-unplugged-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 for instance with vm_state active and task_state rescuing.
May 21 02:04:41.105213 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f63a2253-071a-4a1a-94af-3544b20c39cf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2fs_h4et" returned: 0 in 0.067s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:04:41.285856 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:04:41.288910 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:04:41.289292 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44b7e0f059bbdb0c904c134a4e3c86710a45b80c.part --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:04:41.390530 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44b7e0f059bbdb0c904c134a4e3c86710a45b80c.part --force-share --output=json" returned: 0 in 0.100s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:04:41.390530 np0000001127 nova-compute[98206]: DEBUG nova.virt.images [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] 3ca8d371-cc7a-4aa9-92a8-b32927eab312 was qcow2, converting to raw {{(pid=98206) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 21 02:04:41.390530 np0000001127 nova-compute[98206]: DEBUG nova.privsep.utils [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 21 02:04:41.390817 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/44b7e0f059bbdb0c904c134a4e3c86710a45b80c.part /opt/stack/data/nova/instances/_base/44b7e0f059bbdb0c904c134a4e3c86710a45b80c.converted {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:04:41.497672 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:41.524899 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: d3816229-124e-468b-959d-030180d271c1] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:04:41.635869 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:41.638767 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b128e021-f7e6-4012-af1e-2eb5c5592751 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "66fe5d80-9012-44fe-9b82-1e993211ddf1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.166s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:41.664188 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/44b7e0f059bbdb0c904c134a4e3c86710a45b80c.part /opt/stack/data/nova/instances/_base/44b7e0f059bbdb0c904c134a4e3c86710a45b80c.converted" returned: 0 in 0.273s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:04:41.665445 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:41.692485 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44b7e0f059bbdb0c904c134a4e3c86710a45b80c.converted --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:04:41.801789 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:41.812143 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44b7e0f059bbdb0c904c134a4e3c86710a45b80c.converted --force-share --output=json" returned: 0 in 0.121s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:04:41.814976 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "44b7e0f059bbdb0c904c134a4e3c86710a45b80c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.618s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:41.814976 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:04:41.823986 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:04:41.827275 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Acquiring lock "44b7e0f059bbdb0c904c134a4e3c86710a45b80c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:41.827275 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "44b7e0f059bbdb0c904c134a4e3c86710a45b80c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:41.827275 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:04:41.829223 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:04:41.829567 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44b7e0f059bbdb0c904c134a4e3c86710a45b80c --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:04:41.947228 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44b7e0f059bbdb0c904c134a4e3c86710a45b80c --force-share --output=json" returned: 0 in 0.113s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:04:41.947228 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44b7e0f059bbdb0c904c134a4e3c86710a45b80c,backing_fmt=raw /opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk.rescue {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:04:42.025945 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44b7e0f059bbdb0c904c134a4e3c86710a45b80c,backing_fmt=raw /opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk.rescue" returned: 0 in 0.079s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:04:42.026579 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "44b7e0f059bbdb0c904c134a4e3c86710a45b80c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:42.027030 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lazy-loading 'migration_context' on Instance uuid 76097fea-0890-40a8-a902-9f510cd34b52 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:04:42.075691 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:42.088991 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:42.090684 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:42.120356 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:42.125842 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:42.268609 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:04:42.268821 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:04:42.530003 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Object Instance<76097fea-0890-40a8-a902-9f510cd34b52> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:04:42.530290 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:04:42.534133 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Start _get_guest_xml network_info=[{"id": "f11d80e2-4ef4-404d-9b12-4b33f3e9caa2", "address": "fa:16:3e:4b:b4:81", "network": {"id": "8f999b5c-800e-44f7-84c5-6eff98ea03cb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-569078034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.9", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-569078034-network", "vif_mac": "fa:16:3e:4b:b4:81"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e98d81a820544f078c16b171f1e8b65c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11d80e2-4e", "ovs_interfaceid": "f11d80e2-4ef4-404d-9b12-4b33f3e9caa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3ca8d371-cc7a-4aa9-92a8-b32927eab312', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c', 'iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ecb49e75-1da5-4848-806e-d7bb8cd06f5c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, 'status': 'reserved', 'instance': '76097fea-0890-40a8-a902-9f510cd34b52', 'attached_at': '', 'detached_at': '', 'volume_id': 'ecb49e75-1da5-4848-806e-d7bb8cd06f5c', 'serial': 'ecb49e75-1da5-4848-806e-d7bb8cd06f5c'}, 'delete_on_termination': False, 'attachment_id': 'dc16f433-fc73-480f-8d8b-e8953a34b8f2', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:04:42.534133 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lazy-loading 'resources' on Instance uuid 76097fea-0890-40a8-a902-9f510cd34b52 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:04:42.785418 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:04:42.822158 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329082.8217728, f63a2253-071a-4a1a-94af-3544b20c39cf => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:04:42.822333 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] VM Started (Lifecycle Event)
May 21 02:04:43.039005 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Object Instance<76097fea-0890-40a8-a902-9f510cd34b52> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:04:43.057203 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:04:43.058637 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-1252242961', uuid='76097fea-0890-40a8-a902-9f510cd34b52'), owner=OwnerMeta(userid='1caa8b5626fb4e5988cc4c80fb335a00', username='tempest-ServerStableDeviceRescueTest-1611761335-project-member', projectid='e98d81a820544f078c16b171f1e8b65c', projectname='tempest-ServerStableDeviceRescueTest-1611761335'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f11d80e2-4ef4-404d-9b12-4b33f3e9caa2", "address": "fa:16:3e:4b:b4:81", "network": {"id": "8f999b5c-800e-44f7-84c5-6eff98ea03cb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-569078034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.9", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-569078034-network", "vif_mac": "fa:16:3e:4b:b4:81"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e98d81a820544f078c16b171f1e8b65c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11d80e2-4e", "ovs_interfaceid": "f11d80e2-4ef4-404d-9b12-4b33f3e9caa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329083.0582266) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:04:43.072228 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:04:43.073875 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:04:43.078208 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:04:43.078692 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:04:43.079525 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:04:43.079875 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:04:43.080031 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:04:43.080145 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:04:43.080281 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:04:43.080433 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:04:43.083738 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:04:43.083935 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:04:43.084107 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:04:43.084274 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:04:43.084440 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:04:43.084600 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:04:43.084740 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lazy-loading 'vcpu_model' on Instance uuid 76097fea-0890-40a8-a902-9f510cd34b52 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:04:43.293818 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.755s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:43.294180 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:04:43.326501 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:04:43.332679 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329083.3308756, f63a2253-071a-4a1a-94af-3544b20c39cf => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:04:43.332679 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] VM Paused (Lifecycle Event)
May 21 02:04:43.486956 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-67f314af-f49c-41f2-9d42-aff9f754f048 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "29a124ee-2b8c-4f44-8f91-8dd11ac78b52" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:43.487174 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-67f314af-f49c-41f2-9d42-aff9f754f048 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "29a124ee-2b8c-4f44-8f91-8dd11ac78b52" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:43.487417 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-67f314af-f49c-41f2-9d42-aff9f754f048 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "29a124ee-2b8c-4f44-8f91-8dd11ac78b52-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:43.487683 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-67f314af-f49c-41f2-9d42-aff9f754f048 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "29a124ee-2b8c-4f44-8f91-8dd11ac78b52-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:43.487890 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-67f314af-f49c-41f2-9d42-aff9f754f048 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "29a124ee-2b8c-4f44-8f91-8dd11ac78b52-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:43.492382 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-67f314af-f49c-41f2-9d42-aff9f754f048 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Terminating instance
May 21 02:04:43.590662 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Object Instance<76097fea-0890-40a8-a902-9f510cd34b52> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:04:43.609362 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk.config --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:04:43.720664 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b08263ac-1d8c-454a-aa49-46c003e85bb4 req-b5b3a35a-33ab-4a7f-aef8-cc9f303f6a39 service nova] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Received event network-vif-plugged-e5285be0-d97c-43fc-93a2-91ac21456315 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:43.720664 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b08263ac-1d8c-454a-aa49-46c003e85bb4 req-b5b3a35a-33ab-4a7f-aef8-cc9f303f6a39 service nova] Acquiring lock "f63a2253-071a-4a1a-94af-3544b20c39cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:43.720664 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b08263ac-1d8c-454a-aa49-46c003e85bb4 req-b5b3a35a-33ab-4a7f-aef8-cc9f303f6a39 service nova] Lock "f63a2253-071a-4a1a-94af-3544b20c39cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:43.720664 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b08263ac-1d8c-454a-aa49-46c003e85bb4 req-b5b3a35a-33ab-4a7f-aef8-cc9f303f6a39 service nova] Lock "f63a2253-071a-4a1a-94af-3544b20c39cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:43.720812 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b08263ac-1d8c-454a-aa49-46c003e85bb4 req-b5b3a35a-33ab-4a7f-aef8-cc9f303f6a39 service nova] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Processing event network-vif-plugged-e5285be0-d97c-43fc-93a2-91ac21456315 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:04:43.726138 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:04:43.726941 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk.config --force-share --output=json" returned: 0 in 0.118s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:04:43.727563 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Acquiring lock "/opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:43.728944 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "/opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:43.729767 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "/opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:43.730383 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:04:43.733191 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c', 'iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ecb49e75-1da5-4848-806e-d7bb8cd06f5c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:04:43.733191 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:04:43.733191 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:04:43.733191 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:04:43.733740 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c', 'iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ecb49e75-1da5-4848-806e-d7bb8cd06f5c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:04:43.736343 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Instance spawned successfully.
May 21 02:04:43.736535 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:04:43.749918 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:43.769173 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:04:43.770510 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:04:43.770666 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:04:43.770907 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:04:43.771116 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:04:43.771272 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.startup = automatic
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.session.scan = manual
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:04:43.786233 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:04:43.786233 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.startup = automatic
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.session.scan = manual
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:04:43.798506 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:04:43.798506 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:43.807748 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:43.829160 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a7325ecd-2056-4b9d-9772-45d15445ccbb tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "e95baab0-2c43-4653-b7ae-b9d8920aba33" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:43.831205 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:04:43.834820 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a7325ecd-2056-4b9d-9772-45d15445ccbb tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "e95baab0-2c43-4653-b7ae-b9d8920aba33" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:43.834820 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a7325ecd-2056-4b9d-9772-45d15445ccbb tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "e95baab0-2c43-4653-b7ae-b9d8920aba33-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:43.834820 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a7325ecd-2056-4b9d-9772-45d15445ccbb tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "e95baab0-2c43-4653-b7ae-b9d8920aba33-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:43.834820 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a7325ecd-2056-4b9d-9772-45d15445ccbb tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "e95baab0-2c43-4653-b7ae-b9d8920aba33-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:43.835964 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:04:43.836832 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:43.837197 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:43.837197 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:43.837197 np0000001127 nova-compute[98206]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:43.837197 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:43.837197 np0000001127 nova-compute[98206]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4 (non-flash)
May 21 02:04:43.837197 np0000001127 nova-compute[98206]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4 (non-flash)
May 21 02:04:43.837197 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:04:43.837630 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:43.838419 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:04:43.838781 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] iscsi session list stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:43.838781 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:43.838781 np0000001127 nova-compute[98206]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:43.838781 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:43.838781 np0000001127 nova-compute[98206]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4 (non-flash)
May 21 02:04:43.838781 np0000001127 nova-compute[98206]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4 (non-flash)
May 21 02:04:43.838781 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:04:43.839029 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.069s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:04:43.841263 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:04:43.841263 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] HCTL ('9', '0', '0', 0) found on session 88 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:04:43.841263 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Scanning host 9 c: 0, t: 0, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:04:43.841263 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-a7325ecd-2056-4b9d-9772-45d15445ccbb tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Terminating instance
May 21 02:04:43.844531 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:43.851347 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329083.851018, f63a2253-071a-4a1a-94af-3544b20c39cf => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:04:43.855030 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Searching for a device in session 88 and hctl ('9', '0', '0', 0) yield: sdd {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:04:43.855202 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ecb49e75-1da5-4848-806e-d7bb8cd06f5c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:04:43.856868 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] VM Resumed (Lifecycle Event)
May 21 02:04:43.857400 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:43.857400 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:43.857400 np0000001127 nova-compute[98206]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:43.857400 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:43.857400 np0000001127 nova-compute[98206]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4 (non-flash)
May 21 02:04:43.857400 np0000001127 nova-compute[98206]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4 (non-flash)
May 21 02:04:43.857400 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:04:43.857400 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] iscsi session list stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:43.857400 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:43.857400 np0000001127 nova-compute[98206]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:43.857400 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:43.857400 np0000001127 nova-compute[98206]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4 (non-flash)
May 21 02:04:43.857400 np0000001127 nova-compute[98206]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4 (non-flash)
May 21 02:04:43.857400 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:04:43.857855 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.087s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:04:43.857855 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:04:43.858368 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] HCTL ('10', '0', '0', 0) found on session 89 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:04:43.858368 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Scanning host 10 c: 0, t: 0, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:04:43.871934 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Searching for a device in session 89 and hctl ('10', '0', '0', 0) yield: sde {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:04:43.872204 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ecb49e75-1da5-4848-806e-d7bb8cd06f5c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:04:43.972739 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4878b5a5bf184852a9ce383caa1c67a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ebdb16aee84e22a88dfc8960debd32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:04:44.008255 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-67f314af-f49c-41f2-9d42-aff9f754f048 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:04:44.018066 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:44.038355 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:44.048593 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:44.066674 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:44.081682 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:44.115807 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:44.265108 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:04:44.265254 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:04:44.267411 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:04:44.267411 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:04:44.267411 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:04:44.267411 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:04:44.281122 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-652f2f4f-c2d5-44c1-acd1-9750502f7da5 req-c3f44499-a3a1-4b61-bf07-33d3f2ec38e3 service nova] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Received event network-vif-unplugged-8b22719a-06e5-4d47-9e5c-66aa0c497f52 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:44.281404 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-652f2f4f-c2d5-44c1-acd1-9750502f7da5 req-c3f44499-a3a1-4b61-bf07-33d3f2ec38e3 service nova] Acquiring lock "29a124ee-2b8c-4f44-8f91-8dd11ac78b52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:44.281660 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-652f2f4f-c2d5-44c1-acd1-9750502f7da5 req-c3f44499-a3a1-4b61-bf07-33d3f2ec38e3 service nova] Lock "29a124ee-2b8c-4f44-8f91-8dd11ac78b52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:44.281805 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-652f2f4f-c2d5-44c1-acd1-9750502f7da5 req-c3f44499-a3a1-4b61-bf07-33d3f2ec38e3 service nova] Lock "29a124ee-2b8c-4f44-8f91-8dd11ac78b52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:44.281969 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-652f2f4f-c2d5-44c1-acd1-9750502f7da5 req-c3f44499-a3a1-4b61-bf07-33d3f2ec38e3 service nova] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] No waiting events found dispatching network-vif-unplugged-8b22719a-06e5-4d47-9e5c-66aa0c497f52 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:04:44.282326 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-652f2f4f-c2d5-44c1-acd1-9750502f7da5 req-c3f44499-a3a1-4b61-bf07-33d3f2ec38e3 service nova] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Received event network-vif-unplugged-8b22719a-06e5-4d47-9e5c-66aa0c497f52 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:04:44.336196 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:04:44.352970 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-a7325ecd-2056-4b9d-9772-45d15445ccbb tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:04:44.361147 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:04:44.390318 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:44.394142 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:04:44.412487 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:44.442697 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:44.475591 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Instance destroyed successfully.
May 21 02:04:44.475591 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-67f314af-f49c-41f2-9d42-aff9f754f048 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lazy-loading 'resources' on Instance uuid 29a124ee-2b8c-4f44-8f91-8dd11ac78b52 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:04:44.707857 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:44.748142 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:44.771395 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:04:44.785179 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Successfully created port: 2673164e-2ce7-4dde-8022-0b0e54feb214 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:04:44.793356 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Instance destroyed successfully.
May 21 02:04:44.795446 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-a7325ecd-2056-4b9d-9772-45d15445ccbb tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lazy-loading 'resources' on Instance uuid e95baab0-2c43-4653-b7ae-b9d8920aba33 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:04:44.797955 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Took 8.00 seconds to spawn the instance on the hypervisor.
May 21 02:04:44.798291 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:04:44.845504 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:04:44.901772 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:04:44.902913 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999683503000142 future=<Future at 0x71c07c797fe0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:44.902913 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999818222999693 future=<Future at 0x71c0901cec60 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:44.979307 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-67f314af-f49c-41f2-9d42-aff9f754f048 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T01:56:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1997816396',display_name='tempest-ServerActionsTestOtherA-server-1997816396',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serveractionstestothera-server-1997816396',id=7,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxRidCAMyb/mDvqucBNL6o1pu4ohR9TfsTnx1DGEBK8Hs9Bxy4viDAtOuJAjHZZuWNRGwi0rwlQFKlYKc+oTj/M3U8o3nzcuoUHvHlwyO9ufXio2O1Y8v01hvWMmUCFbg==',key_name='tempest-keypair-631476445',keypairs=<?>,launch_index=0,launched_at=2026-05-21T01:56:17Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a15fe7a70464159a778cffa4a36c36f',ramdisk_id='',reservation_id='r-vdyv1106',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1975191698',owner_user_name='tempest-ServerActionsTestOtherA-1975191698-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T01:56:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbcd1a81252344dd804a4080571f8751',uuid=29a124ee-2b8c-4f44-8f91-8dd11ac78b52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b22719a-06e5-4d47-9e5c-66aa0c497f52", "address": "fa:16:3e:9e:02:16", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b22719a-06", "ovs_interfaceid": "8b22719a-06e5-4d47-9e5c-66aa0c497f52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:04:44.979307 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-67f314af-f49c-41f2-9d42-aff9f754f048 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Converting VIF {"id": "8b22719a-06e5-4d47-9e5c-66aa0c497f52", "address": "fa:16:3e:9e:02:16", "network": {"id": "6d660724-85bf-45e3-895a-b9ce67043c30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1391831945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a15fe7a70464159a778cffa4a36c36f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b22719a-06", "ovs_interfaceid": "8b22719a-06e5-4d47-9e5c-66aa0c497f52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:04:44.979307 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-67f314af-f49c-41f2-9d42-aff9f754f048 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:02:16,bridge_name='br-int',has_traffic_filtering=True,id=8b22719a-06e5-4d47-9e5c-66aa0c497f52,network=Network(6d660724-85bf-45e3-895a-b9ce67043c30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b22719a-06') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:04:44.979307 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-67f314af-f49c-41f2-9d42-aff9f754f048 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:02:16,bridge_name='br-int',has_traffic_filtering=True,id=8b22719a-06e5-4d47-9e5c-66aa0c497f52,network=Network(6d660724-85bf-45e3-895a-b9ce67043c30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b22719a-06') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:04:44.980758 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:44.982947 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b22719a-06, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:04:44.985833 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:44.987171 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:04:44.997893 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:44.999407 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:45.000591 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f85508f5-8c0e-4c97-b332-64828896cd80) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:04:45.001847 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:04:45.012903 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:45.018019 np0000001127 nova-compute[98206]: INFO os_vif [None req-67f314af-f49c-41f2-9d42-aff9f754f048 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:02:16,bridge_name='br-int',has_traffic_filtering=True,id=8b22719a-06e5-4d47-9e5c-66aa0c497f52,network=Network(6d660724-85bf-45e3-895a-b9ce67043c30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b22719a-06')
May 21 02:04:45.018734 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-67f314af-f49c-41f2-9d42-aff9f754f048 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Deleting instance files /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52_del
May 21 02:04:45.021503 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-67f314af-f49c-41f2-9d42-aff9f754f048 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Deletion of /opt/stack/data/nova/instances/29a124ee-2b8c-4f44-8f91-8dd11ac78b52_del complete
May 21 02:04:45.297177 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-a7325ecd-2056-4b9d-9772-45d15445ccbb tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:01:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1443229473',display_name='tempest-ServerRescueNegativeTestJSON-server-1443229473',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serverrescuenegativetestjson-server-1443229473',id=30,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:02:00Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87eb25eb23724c49b5bdbc462a1f36bc',ramdisk_id='',reservation_id='r-6i2xtfgb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1108613901',owner_user_name='tempest-ServerRescueNegativeTestJSON-1108613901-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:02:00Z,user_data=None,user_id='8b5074a8e47b444cb19c7dcf761ac2ae',uuid=e95baab0-2c43-4653-b7ae-b9d8920aba33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "3b74538b-3b3e-42f5-8f10-612c9d85b221", "address": "fa:16:3e:2b:20:c8", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b74538b-3b", "ovs_interfaceid": "3b74538b-3b3e-42f5-8f10-612c9d85b221", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:04:45.297371 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-a7325ecd-2056-4b9d-9772-45d15445ccbb tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Converting VIF {"id": "3b74538b-3b3e-42f5-8f10-612c9d85b221", "address": "fa:16:3e:2b:20:c8", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b74538b-3b", "ovs_interfaceid": "3b74538b-3b3e-42f5-8f10-612c9d85b221", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:04:45.297841 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-a7325ecd-2056-4b9d-9772-45d15445ccbb tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:20:c8,bridge_name='br-int',has_traffic_filtering=True,id=3b74538b-3b3e-42f5-8f10-612c9d85b221,network=Network(b8fcc592-f44d-440d-b1f1-c57714291c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b74538b-3b') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:04:45.298096 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-a7325ecd-2056-4b9d-9772-45d15445ccbb tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:20:c8,bridge_name='br-int',has_traffic_filtering=True,id=3b74538b-3b3e-42f5-8f10-612c9d85b221,network=Network(b8fcc592-f44d-440d-b1f1-c57714291c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b74538b-3b') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:04:45.298829 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:45.299017 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b74538b-3b, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:04:45.301501 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:04:45.307840 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:45.308711 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:45.308861 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=73c9202c-ac0b-4a37-a59b-f237c3888cbc) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:04:45.310830 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:45.311420 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:04:45.319187 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:45.323640 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Took 13.74 seconds to build instance.
May 21 02:04:45.325287 np0000001127 nova-compute[98206]: INFO os_vif [None req-a7325ecd-2056-4b9d-9772-45d15445ccbb tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:20:c8,bridge_name='br-int',has_traffic_filtering=True,id=3b74538b-3b3e-42f5-8f10-612c9d85b221,network=Network(b8fcc592-f44d-440d-b1f1-c57714291c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b74538b-3b')
May 21 02:04:45.325704 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-a7325ecd-2056-4b9d-9772-45d15445ccbb tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Deleting instance files /opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33_del
May 21 02:04:45.326870 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-a7325ecd-2056-4b9d-9772-45d15445ccbb tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Deletion of /opt/stack/data/nova/instances/e95baab0-2c43-4653-b7ae-b9d8920aba33_del complete
May 21 02:04:45.349498 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Booting with volume 5b6917f9-697f-4cd6-97c4-318fb3116f5a at /dev/vda
May 21 02:04:45.422081 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:04:45.434700 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:04:45.460873 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:04:45.482138 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Successfully updated port: 2673164e-2ce7-4dde-8022-0b0e54feb214 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:04:45.513655 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:04:45.513859 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:04:45.524064 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:04:45.525374 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::789a:c1ff:fe89:a024', 'fe80::fc16:3eff:fe60:a612', 'fe80::fc16:3eff:fe61:105e', 'fe80::f819:cdff:fe2b:de28', 'fe80::fc16:3eff:feed:a659', 'fe80::803:29ff:fe32:ac7b', 'fe80::fc16:3eff:feca:ebaf', 'fe80::40b3:49ff:feb3:3b55'] 
May 21 02:04:45.525763 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:04:45.525763 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:04:45.525905 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:04:45.526126 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Updating existing volume attachment record: d97114a8-5745-4dd3-b496-dddec20739dc {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:04:45.539420 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-67f314af-f49c-41f2-9d42-aff9f754f048 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Took 1.53 seconds to destroy the instance on the hypervisor.
May 21 02:04:45.544485 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-67f314af-f49c-41f2-9d42-aff9f754f048 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:04:45.544485 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:04:45.544485 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:04:45.544676 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:45.676116 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:45.794357 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Found WWN 3300000004a4ae24e for multipath device dm-1 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:04:45.795765 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.063s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:04:45.795992 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] <== connect_volume: return (2065ms) {'type': 'block', 'scsi_wwn': '3300000004a4ae24e', 'path': '/dev/dm-1', 'multipath_id': '3300000004a4ae24e'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:04:45.796240 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004a4ae24e', 'path': '/dev/dm-1', 'multipath_id': '3300000004a4ae24e'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:04:45.820129 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-fc81236a-9129-48a2-9b5b-558ecb9f0c03 req-65fd81b1-21e5-42b4-b692-487ed61cbc03 service nova] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Received event network-vif-plugged-e5285be0-d97c-43fc-93a2-91ac21456315 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:45.820823 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fc81236a-9129-48a2-9b5b-558ecb9f0c03 req-65fd81b1-21e5-42b4-b692-487ed61cbc03 service nova] Acquiring lock "f63a2253-071a-4a1a-94af-3544b20c39cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:45.821129 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fc81236a-9129-48a2-9b5b-558ecb9f0c03 req-65fd81b1-21e5-42b4-b692-487ed61cbc03 service nova] Lock "f63a2253-071a-4a1a-94af-3544b20c39cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:45.821341 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fc81236a-9129-48a2-9b5b-558ecb9f0c03 req-65fd81b1-21e5-42b4-b692-487ed61cbc03 service nova] Lock "f63a2253-071a-4a1a-94af-3544b20c39cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:45.821542 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-fc81236a-9129-48a2-9b5b-558ecb9f0c03 req-65fd81b1-21e5-42b4-b692-487ed61cbc03 service nova] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] No waiting events found dispatching network-vif-plugged-e5285be0-d97c-43fc-93a2-91ac21456315 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:04:45.821726 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-fc81236a-9129-48a2-9b5b-558ecb9f0c03 req-65fd81b1-21e5-42b4-b692-487ed61cbc03 service nova] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Received unexpected event network-vif-plugged-e5285be0-d97c-43fc-93a2-91ac21456315 for instance with vm_state active and task_state None.
May 21 02:04:45.827124 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "f63a2253-071a-4a1a-94af-3544b20c39cf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.245s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:45.836698 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-a7325ecd-2056-4b9d-9772-45d15445ccbb tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Took 1.48 seconds to destroy the instance on the hypervisor.
May 21 02:04:45.836698 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-a7325ecd-2056-4b9d-9772-45d15445ccbb tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:04:45.838915 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:04:45.839096 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:04:45.839357 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:45.918359 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:45.986373 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "refresh_cache-4a71f98e-0988-46c9-9b04-f8d0197468b9" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:04:45.986373 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquired lock "refresh_cache-4a71f98e-0988-46c9-9b04-f8d0197468b9" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:04:45.986492 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:04:46.310432 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:03:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1252242961',display_name='tempest-ServerStableDeviceRescueTest-server-1252242961',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serverstabledevicerescuetest-server-1252242961',id=35,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHXCzQMtcvcohxOdCdKixRwGu+ErSI1etxf94mKw3iE+m9xL8VE+MVuRtLXTemgUp3Ov8UZFqLioHdWgMENwGDRghzsJP56fHg3vEKwC2p9V2H3plwGhSr7x3Y5MpdP3g==',key_name='tempest-keypair-900990808',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:03:36Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e98d81a820544f078c16b171f1e8b65c',ramdisk_id='',reservation_id='r-0pmad0cj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1611761335',owner_user_name='tempest-ServerStableDeviceRescueTest-1611761335-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1caa8b5626fb4e5988cc4c80fb335a00',uuid=76097fea-0890-40a8-a902-9f510cd34b52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f11d80e2-4ef4-404d-9b12-4b33f3e9caa2", "address": "fa:16:3e:4b:b4:81", "network": {"id": "8f999b5c-800e-44f7-84c5-6eff98ea03cb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-569078034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.9", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-569078034-network", "vif_mac": "fa:16:3e:4b:b4:81"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e98d81a820544f078c16b171f1e8b65c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11d80e2-4e", "ovs_interfaceid": "f11d80e2-4ef4-404d-9b12-4b33f3e9caa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:04:46.315275 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Converting VIF {"id": "f11d80e2-4ef4-404d-9b12-4b33f3e9caa2", "address": "fa:16:3e:4b:b4:81", "network": {"id": "8f999b5c-800e-44f7-84c5-6eff98ea03cb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-569078034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.9", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-569078034-network", "vif_mac": "fa:16:3e:4b:b4:81"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e98d81a820544f078c16b171f1e8b65c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11d80e2-4e", "ovs_interfaceid": "f11d80e2-4ef4-404d-9b12-4b33f3e9caa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:04:46.316443 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:b4:81,bridge_name='br-int',has_traffic_filtering=True,id=f11d80e2-4ef4-404d-9b12-4b33f3e9caa2,network=Network(8f999b5c-800e-44f7-84c5-6eff98ea03cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf11d80e2-4e') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:04:46.317523 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lazy-loading 'pci_devices' on Instance uuid 76097fea-0890-40a8-a902-9f510cd34b52 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:04:46.482017 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-24c693fb-3368-4341-b232-b89426d1eb36 req-00fc88ce-4a02-43ce-b971-7b3c8328371c service nova] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Received event network-vif-unplugged-8b22719a-06e5-4d47-9e5c-66aa0c497f52 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:46.482835 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-24c693fb-3368-4341-b232-b89426d1eb36 req-00fc88ce-4a02-43ce-b971-7b3c8328371c service nova] Acquiring lock "29a124ee-2b8c-4f44-8f91-8dd11ac78b52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:46.482971 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-24c693fb-3368-4341-b232-b89426d1eb36 req-00fc88ce-4a02-43ce-b971-7b3c8328371c service nova] Lock "29a124ee-2b8c-4f44-8f91-8dd11ac78b52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:46.483131 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-24c693fb-3368-4341-b232-b89426d1eb36 req-00fc88ce-4a02-43ce-b971-7b3c8328371c service nova] Lock "29a124ee-2b8c-4f44-8f91-8dd11ac78b52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:46.483240 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-24c693fb-3368-4341-b232-b89426d1eb36 req-00fc88ce-4a02-43ce-b971-7b3c8328371c service nova] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] No waiting events found dispatching network-vif-unplugged-8b22719a-06e5-4d47-9e5c-66aa0c497f52 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:04:46.483356 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-24c693fb-3368-4341-b232-b89426d1eb36 req-00fc88ce-4a02-43ce-b971-7b3c8328371c service nova] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Received event network-vif-unplugged-8b22719a-06e5-4d47-9e5c-66aa0c497f52 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:04:46.483447 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-24c693fb-3368-4341-b232-b89426d1eb36 req-00fc88ce-4a02-43ce-b971-7b3c8328371c service nova] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Received event network-changed-2673164e-2ce7-4dde-8022-0b0e54feb214 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:46.483570 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-24c693fb-3368-4341-b232-b89426d1eb36 req-00fc88ce-4a02-43ce-b971-7b3c8328371c service nova] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Refreshing instance network info cache due to event network-changed-2673164e-2ce7-4dde-8022-0b0e54feb214. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:04:46.483680 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-24c693fb-3368-4341-b232-b89426d1eb36 req-00fc88ce-4a02-43ce-b971-7b3c8328371c service nova] Acquiring lock "refresh_cache-4a71f98e-0988-46c9-9b04-f8d0197468b9" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:04:46.501861 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:46.507949 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:04:46.578541 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:04:46.776913 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:46.794715 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:04:46.820052 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Object Instance<76097fea-0890-40a8-a902-9f510cd34b52> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:04:46.822510 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] End _get_guest_xml xml=<domain type="qemu">
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:   <uuid>76097fea-0890-40a8-a902-9f510cd34b52</uuid>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:   <name>instance-00000023</name>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1252242961</nova:name>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:04:43</nova:creationTime>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:           <nova:property name="hw_machine_type">pc</nova:property>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:           <nova:property name="hw_video_model">virtio</nova:property>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:         <nova:user uuid="1caa8b5626fb4e5988cc4c80fb335a00">tempest-ServerStableDeviceRescueTest-1611761335-project-member</nova:user>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:         <nova:project uuid="e98d81a820544f078c16b171f1e8b65c">tempest-ServerStableDeviceRescueTest-1611761335</nova:project>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:         <nova:port uuid="f11d80e2-4ef4-404d-9b12-4b33f3e9caa2">
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:     <system>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       <entry name="serial">76097fea-0890-40a8-a902-9f510cd34b52</entry>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       <entry name="uuid">76097fea-0890-40a8-a902-9f510cd34b52</entry>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:     </system>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:   <os>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:   </os>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:   <features>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:   </features>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:   <devices>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk"/>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:     </disk>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk.config"/>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:     </disk>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       <alias name="ua-ecb49e75-1da5-4848-806e-d7bb8cd06f5c"/>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-1"/>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       <target dev="vdb" bus="virtio"/>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       <serial>ecb49e75-1da5-4848-806e-d7bb8cd06f5c</serial>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:     </disk>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk.rescue"/>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       <target dev="vdc" bus="virtio"/>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       <boot order="1"/>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:     </disk>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:4b:b4:81"/>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       <target dev="tapf11d80e2-4e"/>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:     </interface>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/console.log" append="off"/>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:     </serial>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:     <video>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:     </video>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:     </rng>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:   </devices>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]: </domain>
May 21 02:04:46.822510 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:04:46.827725 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Instance destroyed successfully.
May 21 02:04:46.977266 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Updating instance_info_cache with network_info: [{"id": "2673164e-2ce7-4dde-8022-0b0e54feb214", "address": "fa:16:3e:50:31:dd", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2673164e-2c", "ovs_interfaceid": "2673164e-2ce7-4dde-8022-0b0e54feb214", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:04:46.993793 np0000001127 nova-compute[98206]: DEBUG os_brick.encryptors.luks [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] opening encrypted volume /dev/dm-0 {{(pid=98206) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 21 02:04:47.010005 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Took 1.47 seconds to deallocate network for instance.
May 21 02:04:47.278637 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Acquiring lock "fb553376-632d-46c3-99dd-4fbc6a27c1c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:47.278866 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Lock "fb553376-632d-46c3-99dd-4fbc6a27c1c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:47.299328 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Took 1.46 seconds to deallocate network for instance.
May 21 02:04:47.478958 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Releasing lock "refresh_cache-4a71f98e-0988-46c9-9b04-f8d0197468b9" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:04:47.478958 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Instance network_info: |[{"id": "2673164e-2ce7-4dde-8022-0b0e54feb214", "address": "fa:16:3e:50:31:dd", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2673164e-2c", "ovs_interfaceid": "2673164e-2ce7-4dde-8022-0b0e54feb214", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:04:47.479158 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-24c693fb-3368-4341-b232-b89426d1eb36 req-00fc88ce-4a02-43ce-b971-7b3c8328371c service nova] Acquired lock "refresh_cache-4a71f98e-0988-46c9-9b04-f8d0197468b9" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:04:47.479236 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-24c693fb-3368-4341-b232-b89426d1eb36 req-00fc88ce-4a02-43ce-b971-7b3c8328371c service nova] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Refreshing network info cache for port 2673164e-2ce7-4dde-8022-0b0e54feb214 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:04:47.522494 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-67f314af-f49c-41f2-9d42-aff9f754f048 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:47.522964 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-67f314af-f49c-41f2-9d42-aff9f754f048 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:47.693089 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:04:47.694228 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:04:47.694493 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Creating image(s)
May 21 02:04:47.698935 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Did not create local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 21 02:04:47.699141 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Ensure instance console log exists: /opt/stack/data/nova/instances/4a71f98e-0988-46c9-9b04-f8d0197468b9/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:04:47.699429 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:47.699721 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:47.699831 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:47.700436 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Start _get_guest_xml network_info=[{"id": "2673164e-2ce7-4dde-8022-0b0e54feb214", "address": "fa:16:3e:50:31:dd", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2673164e-2c", "ovs_interfaceid": "2673164e-2ce7-4dde-8022-0b0e54feb214", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a', 'iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b6917f9-697f-4cd6-97c4-318fb3116f5a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '4a71f98e-0988-46c9-9b04-f8d0197468b9', 'attached_at': '', 'detached_at': '', 'volume_id': '5b6917f9-697f-4cd6-97c4-318fb3116f5a', 'serial': '5b6917f9-697f-4cd6-97c4-318fb3116f5a'}, 'delete_on_termination': False, 'attachment_id': 'd97114a8-5745-4dd3-b496-dddec20739dc', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:04:47.706951 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:04:47.708436 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1807531643', uuid='4a71f98e-0988-46c9-9b04-f8d0197468b9'), owner=OwnerMeta(userid='4878b5a5bf184852a9ce383caa1c67a4', username='tempest-TestVolumeBootPattern-1995806391-project-member', projectid='62ebdb16aee84e22a88dfc8960debd32', projectname='tempest-TestVolumeBootPattern-1995806391'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2673164e-2ce7-4dde-8022-0b0e54feb214", "address": "fa:16:3e:50:31:dd", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2673164e-2c", "ovs_interfaceid": "2673164e-2ce7-4dde-8022-0b0e54feb214", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329087.7079263) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:04:47.711434 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:04:47.711829 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:04:47.712714 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:04:47.712890 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:04:47.713862 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:04:47.714148 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:04:47.714283 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:04:47.714387 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:04:47.714516 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:04:47.714597 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:04:47.714688 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:04:47.714840 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:04:47.714937 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:04:47.715054 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:04:47.715158 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:04:47.715269 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:04:47.728698 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:04:47.729107 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a', 'iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b6917f9-697f-4cd6-97c4-318fb3116f5a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:04:47.729256 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:04:47.729827 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:04:47.729827 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a', 'iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b6917f9-697f-4cd6-97c4-318fb3116f5a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:04:47.748255 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:04:47.749199 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:04:47.749758 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:04:47.750039 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:04:47.750520 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:04:47.750767 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:04:47.765227 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:04:47.765227 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:47.773572 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:04:47.773572 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:47.780537 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a] added
May 21 02:04:47.780537 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:04:47.780537 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:04:47.780537 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:04:47.780537 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:04:47.780537 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:04:47.780537 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:47.780938 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:04:47.781336 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:04:47.784007 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0311(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:04:47.784438 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:04:47.789304 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a] added
May 21 02:04:47.789304 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:04:47.789304 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:04:47.789304 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:04:47.789304 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:04:47.789304 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:04:47.789304 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:47.789553 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:04:47.789803 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.039(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:04:47.790000 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:04:47.807908 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a7325ecd-2056-4b9d-9772-45d15445ccbb tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:47.916682 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b0e0cb30-9372-428c-8d9d-c0f1791a3a83 req-23fe56c6-d901-40dc-936a-3f10748f5d03 service nova] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Received event network-vif-deleted-8b22719a-06e5-4d47-9e5c-66aa0c497f52 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:47.916682 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b0e0cb30-9372-428c-8d9d-c0f1791a3a83 req-23fe56c6-d901-40dc-936a-3f10748f5d03 service nova] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Received event network-changed-e5285be0-d97c-43fc-93a2-91ac21456315 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:47.916682 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b0e0cb30-9372-428c-8d9d-c0f1791a3a83 req-23fe56c6-d901-40dc-936a-3f10748f5d03 service nova] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Refreshing instance network info cache due to event network-changed-e5285be0-d97c-43fc-93a2-91ac21456315. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:04:47.917337 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b0e0cb30-9372-428c-8d9d-c0f1791a3a83 req-23fe56c6-d901-40dc-936a-3f10748f5d03 service nova] Acquiring lock "refresh_cache-f63a2253-071a-4a1a-94af-3544b20c39cf" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:04:47.917601 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b0e0cb30-9372-428c-8d9d-c0f1791a3a83 req-23fe56c6-d901-40dc-936a-3f10748f5d03 service nova] Acquired lock "refresh_cache-f63a2253-071a-4a1a-94af-3544b20c39cf" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:04:47.917868 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-b0e0cb30-9372-428c-8d9d-c0f1791a3a83 req-23fe56c6-d901-40dc-936a-3f10748f5d03 service nova] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Refreshing network info cache for port e5285be0-d97c-43fc-93a2-91ac21456315 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:04:47.982162 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-24c693fb-3368-4341-b232-b89426d1eb36 req-00fc88ce-4a02-43ce-b971-7b3c8328371c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:48.075649 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:04:48.075965 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:04:48.076434 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.60 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:04:48.090321 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-67f314af-f49c-41f2-9d42-aff9f754f048 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:04:48.090998 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-67f314af-f49c-41f2-9d42-aff9f754f048 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:04:48.346010 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0009321810002802522 future=<Future at 0x71c07c7bdaf0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:48.346618 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:48.351098 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Emitting event <LifecycleEvent: 1779329073.3449626, 66fe5d80-9012-44fe-9b82-1e993211ddf1 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:04:48.351294 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=0.9274509459996807 future=<Future at 0x71c07c7d44d0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:48.352892 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] VM Stopped (Lifecycle Event)
May 21 02:04:48.352892 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=0.9259717420000015 future=<Future at 0x71c07c7d44d0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:48.371979 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:48.376507 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:04:48.376507 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:04:48.376507 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:04:48.376507 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:04:48.376507 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] No VIF found with MAC fa:16:3e:4b:b4:81, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:04:48.376507 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Using config drive
May 21 02:04:48.422506 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-b0e0cb30-9372-428c-8d9d-c0f1791a3a83 req-23fe56c6-d901-40dc-936a-3f10748f5d03 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:48.438324 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-24c693fb-3368-4341-b232-b89426d1eb36 req-00fc88ce-4a02-43ce-b971-7b3c8328371c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:48.594586 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-67f314af-f49c-41f2-9d42-aff9f754f048 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:04:48.628686 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-24c693fb-3368-4341-b232-b89426d1eb36 req-00fc88ce-4a02-43ce-b971-7b3c8328371c service nova] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Updated VIF entry in instance network info cache for port 2673164e-2ce7-4dde-8022-0b0e54feb214. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:04:48.629040 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-24c693fb-3368-4341-b232-b89426d1eb36 req-00fc88ce-4a02-43ce-b971-7b3c8328371c service nova] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Updating instance_info_cache with network_info: [{"id": "2673164e-2ce7-4dde-8022-0b0e54feb214", "address": "fa:16:3e:50:31:dd", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2673164e-2c", "ovs_interfaceid": "2673164e-2ce7-4dde-8022-0b0e54feb214", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:04:48.676258 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:04:48.680075 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:04:48.680485 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:04:48.680696 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 21 02:04:48.681041 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:04:48.784933 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:04:48.790344 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:04:48.797814 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:04:48.797814 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:04:48.812904 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:04:48.812904 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:48.817017 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:48.826415 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:48.832683 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:48.832683 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:48.832683 np0000001127 nova-compute[98206]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:48.832683 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:48.832683 np0000001127 nova-compute[98206]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4 (non-flash)
May 21 02:04:48.832683 np0000001127 nova-compute[98206]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4 (non-flash)
May 21 02:04:48.832683 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:04:48.832964 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:48.832964 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:48.832964 np0000001127 nova-compute[98206]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:48.832964 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:48.832964 np0000001127 nova-compute[98206]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4 (non-flash)
May 21 02:04:48.832964 np0000001127 nova-compute[98206]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4 (non-flash)
May 21 02:04:48.832964 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:04:48.842055 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:48.842055 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:48.842055 np0000001127 nova-compute[98206]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:48.842055 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:48.842055 np0000001127 nova-compute[98206]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4 (non-flash)
May 21 02:04:48.842055 np0000001127 nova-compute[98206]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4 (non-flash)
May 21 02:04:48.842055 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:04:48.842412 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:48.842412 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:48.842412 np0000001127 nova-compute[98206]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:48.842412 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:48.842412 np0000001127 nova-compute[98206]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4 (non-flash)
May 21 02:04:48.842412 np0000001127 nova-compute[98206]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4 (non-flash)
May 21 02:04:48.842412 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:04:48.845330 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-b0e0cb30-9372-428c-8d9d-c0f1791a3a83 req-23fe56c6-d901-40dc-936a-3f10748f5d03 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:48.856366 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 66fe5d80-9012-44fe-9b82-1e993211ddf1] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:04:48.874734 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a, portal: 192.168.40.100,3260]
May 21 02:04:48.874734 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a, portal: 192.168.40.100,3260] successful.
May 21 02:04:48.874734 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:48.880539 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lazy-loading 'ec2_ids' on Instance uuid 76097fea-0890-40a8-a902-9f510cd34b52 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:04:48.884104 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a, portal: 192.168.50.100,3260]
May 21 02:04:48.884104 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a, portal: 192.168.50.100,3260] successful.
May 21 02:04:48.884104 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:48.888991 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:48.897363 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:48.908037 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:48.908037 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:48.908037 np0000001127 nova-compute[98206]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:48.908037 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:48.908037 np0000001127 nova-compute[98206]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4 (non-flash)
May 21 02:04:48.908037 np0000001127 nova-compute[98206]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4 (non-flash)
May 21 02:04:48.908037 np0000001127 nova-compute[98206]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a (non-flash)
May 21 02:04:48.908037 np0000001127 nova-compute[98206]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a (non-flash)
May 21 02:04:48.908037 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:04:48.908347 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:48.908347 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:48.908347 np0000001127 nova-compute[98206]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:48.908347 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:48.908347 np0000001127 nova-compute[98206]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4 (non-flash)
May 21 02:04:48.908347 np0000001127 nova-compute[98206]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4 (non-flash)
May 21 02:04:48.908347 np0000001127 nova-compute[98206]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a (non-flash)
May 21 02:04:48.908347 np0000001127 nova-compute[98206]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a (non-flash)
May 21 02:04:48.908347 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:04:48.908648 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.159s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:04:48.908648 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:04:48.909576 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] HCTL ('13', '-', '-', 0) found on session 92 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:04:48.909720 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:04:48.916044 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:48.916044 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:48.916044 np0000001127 nova-compute[98206]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:48.916044 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:48.916044 np0000001127 nova-compute[98206]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4 (non-flash)
May 21 02:04:48.916044 np0000001127 nova-compute[98206]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4 (non-flash)
May 21 02:04:48.916044 np0000001127 nova-compute[98206]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a (non-flash)
May 21 02:04:48.916044 np0000001127 nova-compute[98206]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a (non-flash)
May 21 02:04:48.916044 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:04:48.916329 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:48.916329 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:48.916329 np0000001127 nova-compute[98206]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:48.916329 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:48.916329 np0000001127 nova-compute[98206]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4 (non-flash)
May 21 02:04:48.916329 np0000001127 nova-compute[98206]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4 (non-flash)
May 21 02:04:48.916329 np0000001127 nova-compute[98206]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a (non-flash)
May 21 02:04:48.916329 np0000001127 nova-compute[98206]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a (non-flash)
May 21 02:04:48.916329 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:04:48.916619 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.166s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:04:48.916789 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:04:48.917972 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] HCTL ('14', '-', '-', 0) found on session 93 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:04:48.918153 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:04:48.931657 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching for a device in session 92 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:04:48.931842 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b6917f9-697f-4cd6-97c4-318fb3116f5a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:04:48.939816 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching for a device in session 93 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:04:48.939816 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5b6917f9-697f-4cd6-97c4-318fb3116f5a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:04:49.016022 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lazy-loading 'flavor' on Instance uuid d35a1f35-4fdd-4efa-a753-7aa8d1a205a8 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:04:49.032858 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-b0e0cb30-9372-428c-8d9d-c0f1791a3a83 req-23fe56c6-d901-40dc-936a-3f10748f5d03 service nova] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Updated VIF entry in instance network info cache for port e5285be0-d97c-43fc-93a2-91ac21456315. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:04:49.032858 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-b0e0cb30-9372-428c-8d9d-c0f1791a3a83 req-23fe56c6-d901-40dc-936a-3f10748f5d03 service nova] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Updating instance_info_cache with network_info: [{"id": "e5285be0-d97c-43fc-93a2-91ac21456315", "address": "fa:16:3e:ca:eb:af", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5285be0-d9", "ovs_interfaceid": "e5285be0-d97c-43fc-93a2-91ac21456315", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:04:49.103892 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-67f314af-f49c-41f2-9d42-aff9f754f048 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.581s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:49.105049 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a7325ecd-2056-4b9d-9772-45d15445ccbb tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.296s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:49.134569 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-24c693fb-3368-4341-b232-b89426d1eb36 req-00fc88ce-4a02-43ce-b971-7b3c8328371c service nova] Releasing lock "refresh_cache-4a71f98e-0988-46c9-9b04-f8d0197468b9" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:04:49.134734 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-24c693fb-3368-4341-b232-b89426d1eb36 req-00fc88ce-4a02-43ce-b971-7b3c8328371c service nova] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Received event network-vif-deleted-3b74538b-3b3e-42f5-8f10-612c9d85b221 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:49.134897 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-24c693fb-3368-4341-b232-b89426d1eb36 req-00fc88ce-4a02-43ce-b971-7b3c8328371c service nova] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Neutron deleted interface 3b74538b-3b3e-42f5-8f10-612c9d85b221; detaching it from the instance and deleting it from the info cache
May 21 02:04:49.135083 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-24c693fb-3368-4341-b232-b89426d1eb36 req-00fc88ce-4a02-43ce-b971-7b3c8328371c service nova] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:04:49.194973 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-67f314af-f49c-41f2-9d42-aff9f754f048 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Deleted allocations for instance 29a124ee-2b8c-4f44-8f91-8dd11ac78b52
May 21 02:04:49.279186 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.00043000999994546873 future=<Future at 0x71c07c7d44d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:49.279602 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Emitting event <LifecycleEvent: 1779329074.2786455, 8948a19b-9e7e-448d-b782-be58020b5320 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:04:49.279738 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:49.279865 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] VM Stopped (Lifecycle Event)
May 21 02:04:49.279948 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=4.799613517000125 future=<Future at 0x71c05864a240 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:49.280084 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=4.7995042039997315 future=<Future at 0x71c05864a240 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:49.385751 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Object Instance<76097fea-0890-40a8-a902-9f510cd34b52> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:04:49.385975 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lazy-loading 'keypairs' on Instance uuid 76097fea-0890-40a8-a902-9f510cd34b52 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:04:49.519072 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Attempting to attach volume ee9e7b51-894c-40d4-8954-fecb89ce3df4 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 02:04:49.522696 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] attach device xml: <disk type="block" device="disk">
May 21 02:04:49.522696 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:04:49.522696 np0000001127 nova-compute[98206]:   <alias name="ua-ee9e7b51-894c-40d4-8954-fecb89ce3df4"/>
May 21 02:04:49.522696 np0000001127 nova-compute[98206]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 21 02:04:49.522696 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:04:49.522696 np0000001127 nova-compute[98206]:   <serial>ee9e7b51-894c-40d4-8954-fecb89ce3df4</serial>
May 21 02:04:49.522696 np0000001127 nova-compute[98206]: </disk>
May 21 02:04:49.522696 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 02:04:49.534152 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b0e0cb30-9372-428c-8d9d-c0f1791a3a83 req-23fe56c6-d901-40dc-936a-3f10748f5d03 service nova] Releasing lock "refresh_cache-f63a2253-071a-4a1a-94af-3544b20c39cf" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:04:49.573597 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a7325ecd-2056-4b9d-9772-45d15445ccbb tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:04:49.573866 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-a7325ecd-2056-4b9d-9772-45d15445ccbb tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:04:49.638203 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-24c693fb-3368-4341-b232-b89426d1eb36 req-00fc88ce-4a02-43ce-b971-7b3c8328371c service nova] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Detach interface failed, port_id=3b74538b-3b3e-42f5-8f10-612c9d85b221, reason: Instance e95baab0-2c43-4653-b7ae-b9d8920aba33 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:04:49.675924 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:04:49.676215 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:04:49.751351 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:04:49.783344 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-c01abec8-44a0-4328-afcf-020fd9cdf46c tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: 8948a19b-9e7e-448d-b782-be58020b5320] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:04:49.888793 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Object Instance<76097fea-0890-40a8-a902-9f510cd34b52> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:04:49.893758 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:49.988697 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1ed417fd-7ec8-417a-b840-e008cfbff64b req-de9fc894-b8d8-4c58-9767-e6d693768496 service nova] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Received event network-vif-unplugged-2673164e-2ce7-4dde-8022-0b0e54feb214 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:49.988968 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1ed417fd-7ec8-417a-b840-e008cfbff64b req-de9fc894-b8d8-4c58-9767-e6d693768496 service nova] Acquiring lock "4a71f98e-0988-46c9-9b04-f8d0197468b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:49.989203 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1ed417fd-7ec8-417a-b840-e008cfbff64b req-de9fc894-b8d8-4c58-9767-e6d693768496 service nova] Lock "4a71f98e-0988-46c9-9b04-f8d0197468b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:49.989340 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1ed417fd-7ec8-417a-b840-e008cfbff64b req-de9fc894-b8d8-4c58-9767-e6d693768496 service nova] Lock "4a71f98e-0988-46c9-9b04-f8d0197468b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:49.989493 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1ed417fd-7ec8-417a-b840-e008cfbff64b req-de9fc894-b8d8-4c58-9767-e6d693768496 service nova] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] No waiting events found dispatching network-vif-unplugged-2673164e-2ce7-4dde-8022-0b0e54feb214 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:04:49.989659 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-1ed417fd-7ec8-417a-b840-e008cfbff64b req-de9fc894-b8d8-4c58-9767-e6d693768496 service nova] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Received unexpected event network-vif-unplugged-2673164e-2ce7-4dde-8022-0b0e54feb214 for instance with vm_state building and task_state spawning.
May 21 02:04:50.014956 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Creating config drive at /opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk.config.rescue
May 21 02:04:50.018624 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2gt5g2hb {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:04:50.078309 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-a7325ecd-2056-4b9d-9772-45d15445ccbb tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:04:50.092976 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2gt5g2hb" returned: 0 in 0.074s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:04:50.179876 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:50.205202 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-67f314af-f49c-41f2-9d42-aff9f754f048 tempest-ServerActionsTestOtherA-1975191698 tempest-ServerActionsTestOtherA-1975191698-project-member] Lock "29a124ee-2b8c-4f44-8f91-8dd11ac78b52" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.718s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:50.310541 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:50.509498 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:50.532537 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:50.591047 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a7325ecd-2056-4b9d-9772-45d15445ccbb tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.486s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:50.595279 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.224s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:50.603307 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:04:50.604714 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Claim successful on node np0000001127
May 21 02:04:50.634661 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:50.673197 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-a7325ecd-2056-4b9d-9772-45d15445ccbb tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Deleted allocations for instance e95baab0-2c43-4653-b7ae-b9d8920aba33
May 21 02:04:50.769968 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Found WWN 330000000b6e9b9d2 for multipath device dm-6 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:04:50.772955 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:04:50.774383 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] <== connect_volume: return (3044ms) {'type': 'block', 'scsi_wwn': '330000000b6e9b9d2', 'path': '/dev/disk/by-id/os-brick+dev+dm-6', 'multipath_id': '330000000b6e9b9d2'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:04:50.774612 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b6e9b9d2', 'path': '/dev/disk/by-id/os-brick+dev+dm-6', 'multipath_id': '330000000b6e9b9d2'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:04:50.830355 np0000001127 nova-compute[98206]: DEBUG os_brick.encryptors [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a', 'iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b6917f9-697f-4cd6-97c4-318fb3116f5a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, 'status': 'reserved', 'instance': '4a71f98e-0988-46c9-9b04-f8d0197468b9', 'attached_at': '', 'detached_at': '', 'volume_id': '5b6917f9-697f-4cd6-97c4-318fb3116f5a', 'serial': '5b6917f9-697f-4cd6-97c4-318fb3116f5a'} {{(pid=98206) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 21 02:04:50.831365 np0000001127 nova-compute[98206]: WARNING stevedore.named [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 21 02:04:50.832032 np0000001127 nova-compute[98206]: WARNING castellan.key_manager [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 21 02:04:50.832243 np0000001127 nova-compute[98206]: WARNING nova.keymgr.conf_key_mgr [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 21 02:04:50.835431 np0000001127 nova-compute[98206]: DEBUG os_brick.encryptors [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x71c07c7941d0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a', 'iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b6917f9-697f-4cd6-97c4-318fb3116f5a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, 'status': 'reserved', 'instance': '4a71f98e-0988-46c9-9b04-f8d0197468b9', 'attached_at': '', 'detached_at': '', 'volume_id': '5b6917f9-697f-4cd6-97c4-318fb3116f5a', 'serial': '5b6917f9-697f-4cd6-97c4-318fb3116f5a'} {{(pid=98206) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 21 02:04:50.835637 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=98206) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 21 02:04:50.835778 np0000001127 nova-compute[98206]: DEBUG os_brick.encryptors.luks [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] opening encrypted volume /dev/dm-6 {{(pid=98206) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 21 02:04:50.875605 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:50.889959 np0000001127 nova-compute[98206]: WARNING os_brick.encryptors.luks [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 21 02:04:50.890382 np0000001127 nova-compute[98206]: INFO os_brick.encryptors.luks [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] /dev/dm-6 is not a valid LUKS device; formatting device for first use
May 21 02:04:50.890382 np0000001127 nova-compute[98206]: DEBUG os_brick.encryptors.luks [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] formatting encrypted volume /dev/dm-6 {{(pid=98206) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 21 02:04:50.892633 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:50.912595 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:51.174969 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:04:51.175177 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:04:51.175313 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:04:51.175452 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] No VIF found with MAC fa:16:3e:61:10:5e, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:04:51.464100 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Removed pending STOPPED event for 76097fea-0890-40a8-a902-9f510cd34b52 due to new event <LifecycleEvent: 1779329091.4629092, 76097fea-0890-40a8-a902-9f510cd34b52 => Resumed> {{(pid=98206) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 21 02:04:51.464100 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329091.4629092, 76097fea-0890-40a8-a902-9f510cd34b52 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:04:51.464100 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] VM Resumed (Lifecycle Event)
May 21 02:04:51.488812 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-890de1e9-9a89-4b88-b2b8-afce61c99c64 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:04:51.501124 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:51.693806 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a7325ecd-2056-4b9d-9772-45d15445ccbb tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "e95baab0-2c43-4653-b7ae-b9d8920aba33" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.864s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:51.966650 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:04:51.968782 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:04:51.993558 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:04:51.993783 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:04:52.071677 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-273106b4-e03e-43d4-b07f-039d74ec4921 req-4e518787-8d88-4d6b-94bb-270d2ceee273 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Received event network-vif-plugged-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:52.071955 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-273106b4-e03e-43d4-b07f-039d74ec4921 req-4e518787-8d88-4d6b-94bb-270d2ceee273 service nova] Acquiring lock "76097fea-0890-40a8-a902-9f510cd34b52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:52.072974 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-273106b4-e03e-43d4-b07f-039d74ec4921 req-4e518787-8d88-4d6b-94bb-270d2ceee273 service nova] Lock "76097fea-0890-40a8-a902-9f510cd34b52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:52.073198 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-273106b4-e03e-43d4-b07f-039d74ec4921 req-4e518787-8d88-4d6b-94bb-270d2ceee273 service nova] Lock "76097fea-0890-40a8-a902-9f510cd34b52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:52.073374 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-273106b4-e03e-43d4-b07f-039d74ec4921 req-4e518787-8d88-4d6b-94bb-270d2ceee273 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] No waiting events found dispatching network-vif-plugged-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:04:52.073552 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-273106b4-e03e-43d4-b07f-039d74ec4921 req-4e518787-8d88-4d6b-94bb-270d2ceee273 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Received unexpected event network-vif-plugged-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 for instance with vm_state rescued and task_state None.
May 21 02:04:52.073704 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-273106b4-e03e-43d4-b07f-039d74ec4921 req-4e518787-8d88-4d6b-94bb-270d2ceee273 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Received event network-vif-plugged-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:52.073866 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-273106b4-e03e-43d4-b07f-039d74ec4921 req-4e518787-8d88-4d6b-94bb-270d2ceee273 service nova] Acquiring lock "76097fea-0890-40a8-a902-9f510cd34b52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:52.074057 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-273106b4-e03e-43d4-b07f-039d74ec4921 req-4e518787-8d88-4d6b-94bb-270d2ceee273 service nova] Lock "76097fea-0890-40a8-a902-9f510cd34b52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:52.074190 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-273106b4-e03e-43d4-b07f-039d74ec4921 req-4e518787-8d88-4d6b-94bb-270d2ceee273 service nova] Lock "76097fea-0890-40a8-a902-9f510cd34b52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:52.074356 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-273106b4-e03e-43d4-b07f-039d74ec4921 req-4e518787-8d88-4d6b-94bb-270d2ceee273 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] No waiting events found dispatching network-vif-plugged-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:04:52.074457 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-273106b4-e03e-43d4-b07f-039d74ec4921 req-4e518787-8d88-4d6b-94bb-270d2ceee273 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Received unexpected event network-vif-plugged-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 for instance with vm_state rescued and task_state None.
May 21 02:04:52.476770 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329092.474962, 76097fea-0890-40a8-a902-9f510cd34b52 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:04:52.476770 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] VM Started (Lifecycle Event)
May 21 02:04:52.500586 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:04:52.651495 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-81a903df-fd64-4fe4-9129-96c637f0f209 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "e158490e-746e-4c3b-924e-9aceed1662d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:52.651495 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-81a903df-fd64-4fe4-9129-96c637f0f209 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "e158490e-746e-4c3b-924e-9aceed1662d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:52.651495 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-81a903df-fd64-4fe4-9129-96c637f0f209 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:52.651495 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-81a903df-fd64-4fe4-9129-96c637f0f209 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:52.651495 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-81a903df-fd64-4fe4-9129-96c637f0f209 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:52.657418 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-81a903df-fd64-4fe4-9129-96c637f0f209 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Terminating instance
May 21 02:04:52.704555 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-2384c69f-4b14-4e8a-8a25-28548df72935 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Unrescuing
May 21 02:04:52.706927 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-2384c69f-4b14-4e8a-8a25-28548df72935 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Acquiring lock "refresh_cache-76097fea-0890-40a8-a902-9f510cd34b52" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:04:52.706927 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-2384c69f-4b14-4e8a-8a25-28548df72935 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Acquired lock "refresh_cache-76097fea-0890-40a8-a902-9f510cd34b52" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:04:52.707172 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-2384c69f-4b14-4e8a-8a25-28548df72935 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:04:52.800289 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-2874c59d-565e-4a86-9838-a23c7220c46f tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "d35a1f35-4fdd-4efa-a753-7aa8d1a205a8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.346s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:52.880511 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:52.992138 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:04:53.005705 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:04:53.027665 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.433s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:53.028154 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:04:53.046575 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 2.864s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:53.046575 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:53.051676 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Auditing locally available compute resources for np0000001127 (node: np0000001127) {{(pid=98206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 21 02:04:53.251292 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-81a903df-fd64-4fe4-9129-96c637f0f209 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:04:53.256742 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-2384c69f-4b14-4e8a-8a25-28548df72935 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:53.276912 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:53.285252 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:53.301070 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:53.323625 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:53.357196 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:53.358591 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:53.513707 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 21 02:04:53.556226 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:04:53.556430 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:04:53.556706 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:53.556919 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:53.642081 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999659979000171 future=<Future at 0x71c05824dac0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:53.661499 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1bdf9b4c-a7a0-4587-bdc3-69999dc5548d req-2f882d53-1129-4b89-a3e9-4680e4398560 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Received event network-vif-unplugged-0298cd31-6bbc-4653-a4ac-8d9b5def1753 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:53.661499 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1bdf9b4c-a7a0-4587-bdc3-69999dc5548d req-2f882d53-1129-4b89-a3e9-4680e4398560 service nova] Acquiring lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:53.661499 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1bdf9b4c-a7a0-4587-bdc3-69999dc5548d req-2f882d53-1129-4b89-a3e9-4680e4398560 service nova] Lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:53.661499 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1bdf9b4c-a7a0-4587-bdc3-69999dc5548d req-2f882d53-1129-4b89-a3e9-4680e4398560 service nova] Lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:53.661499 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1bdf9b4c-a7a0-4587-bdc3-69999dc5548d req-2f882d53-1129-4b89-a3e9-4680e4398560 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] No waiting events found dispatching network-vif-unplugged-0298cd31-6bbc-4653-a4ac-8d9b5def1753 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:04:53.661499 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1bdf9b4c-a7a0-4587-bdc3-69999dc5548d req-2f882d53-1129-4b89-a3e9-4680e4398560 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Received event network-vif-unplugged-0298cd31-6bbc-4653-a4ac-8d9b5def1753 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:04:53.661499 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Instance destroyed successfully.
May 21 02:04:53.661499 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-81a903df-fd64-4fe4-9129-96c637f0f209 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lazy-loading 'resources' on Instance uuid e158490e-746e-4c3b-924e-9aceed1662d0 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:04:53.722498 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67349a30ec514c90a316eb35d579b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8db1d8006574d1e9f7117042461bce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:04:53.995787 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "d35a1f35-4fdd-4efa-a753-7aa8d1a205a8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:53.996403 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "d35a1f35-4fdd-4efa-a753-7aa8d1a205a8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:54.080535 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.000522369999998773 future=<Future at 0x71c05864a240 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:54.080535 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:54.080535 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=5.8218497940001726 future=<Future at 0x71c07c797fe0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:54.080535 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=5.82173243599982 future=<Future at 0x71c07c797fe0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:54.092143 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:04:54.098781 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:04:54.102586 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f63a2253-071a-4a1a-94af-3544b20c39cf/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:04:54.127754 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-2384c69f-4b14-4e8a-8a25-28548df72935 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:54.173786 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-81a903df-fd64-4fe4-9129-96c637f0f209 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:01:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1853847854',display_name='tempest-ServerRescueNegativeTestJSON-server-1853847854',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serverrescuenegativetestjson-server-1853847854',id=29,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:02:15Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87eb25eb23724c49b5bdbc462a1f36bc',ramdisk_id='',reservation_id='r-bkabzv7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1108613901',owner_user_name='tempest-ServerRescueNegativeTestJSON-1108613901-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:02:21Z,user_data=None,user_id='8b5074a8e47b444cb19c7dcf761ac2ae',uuid=e158490e-746e-4c3b-924e-9aceed1662d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0298cd31-6bbc-4653-a4ac-8d9b5def1753", "address": "fa:16:3e:60:a6:12", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0298cd31-6b", "ovs_interfaceid": "0298cd31-6bbc-4653-a4ac-8d9b5def1753", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:04:54.174657 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-81a903df-fd64-4fe4-9129-96c637f0f209 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Converting VIF {"id": "0298cd31-6bbc-4653-a4ac-8d9b5def1753", "address": "fa:16:3e:60:a6:12", "network": {"id": "b8fcc592-f44d-440d-b1f1-c57714291c47", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1449144553-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87eb25eb23724c49b5bdbc462a1f36bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0298cd31-6b", "ovs_interfaceid": "0298cd31-6bbc-4653-a4ac-8d9b5def1753", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:04:54.176249 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-81a903df-fd64-4fe4-9129-96c637f0f209 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:a6:12,bridge_name='br-int',has_traffic_filtering=True,id=0298cd31-6bbc-4653-a4ac-8d9b5def1753,network=Network(b8fcc592-f44d-440d-b1f1-c57714291c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0298cd31-6b') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:04:54.176364 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-81a903df-fd64-4fe4-9129-96c637f0f209 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:a6:12,bridge_name='br-int',has_traffic_filtering=True,id=0298cd31-6bbc-4653-a4ac-8d9b5def1753,network=Network(b8fcc592-f44d-440d-b1f1-c57714291c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0298cd31-6b') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:04:54.185640 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:54.185640 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0298cd31-6b, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:04:54.205775 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6886d18d-3d3f-4b83-9203-283e1f34eaf8 req-c35ed697-72dc-478c-af05-a2082540ab04 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Received event network-changed-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:54.205999 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6886d18d-3d3f-4b83-9203-283e1f34eaf8 req-c35ed697-72dc-478c-af05-a2082540ab04 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Refreshing instance network info cache due to event network-changed-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:04:54.206792 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6886d18d-3d3f-4b83-9203-283e1f34eaf8 req-c35ed697-72dc-478c-af05-a2082540ab04 service nova] Acquiring lock "refresh_cache-76097fea-0890-40a8-a902-9f510cd34b52" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:04:54.207100 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:54.209512 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:04:54.210835 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:54.210835 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=616eefe1-1121-48b6-b08d-6d1d374204c1) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:04:54.213323 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:54.213323 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:04:54.213710 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:54.218636 np0000001127 nova-compute[98206]: INFO os_vif [None req-81a903df-fd64-4fe4-9129-96c637f0f209 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:a6:12,bridge_name='br-int',has_traffic_filtering=True,id=0298cd31-6bbc-4653-a4ac-8d9b5def1753,network=Network(b8fcc592-f44d-440d-b1f1-c57714291c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0298cd31-6b')
May 21 02:04:54.219814 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-81a903df-fd64-4fe4-9129-96c637f0f209 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Deleting instance files /opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0_del
May 21 02:04:54.220376 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-81a903df-fd64-4fe4-9129-96c637f0f209 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Deletion of /opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0_del complete
May 21 02:04:54.250983 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f63a2253-071a-4a1a-94af-3544b20c39cf/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:04:54.261033 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f63a2253-071a-4a1a-94af-3544b20c39cf/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:04:54.409371 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f63a2253-071a-4a1a-94af-3544b20c39cf/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:04:54.418065 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-0000001d, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/e158490e-746e-4c3b-924e-9aceed1662d0/disk
May 21 02:04:54.421162 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d35a1f35-4fdd-4efa-a753-7aa8d1a205a8/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:04:54.452171 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-2384c69f-4b14-4e8a-8a25-28548df72935 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Updating instance_info_cache with network_info: [{"id": "f11d80e2-4ef4-404d-9b12-4b33f3e9caa2", "address": "fa:16:3e:4b:b4:81", "network": {"id": "8f999b5c-800e-44f7-84c5-6eff98ea03cb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-569078034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e98d81a820544f078c16b171f1e8b65c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11d80e2-4e", "ovs_interfaceid": "f11d80e2-4ef4-404d-9b12-4b33f3e9caa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:04:54.506107 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Detaching volume ee9e7b51-894c-40d4-8954-fecb89ce3df4
May 21 02:04:54.537168 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Successfully created port: dc7ed06f-f8e7-4e18-8207-748cbf553e58 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:04:54.561840 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d35a1f35-4fdd-4efa-a753-7aa8d1a205a8/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:04:54.564044 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d35a1f35-4fdd-4efa-a753-7aa8d1a205a8/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:04:54.599978 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:04:54.629135 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Attempting to driver detach volume ee9e7b51-894c-40d4-8954-fecb89ce3df4 from mountpoint /dev/vdb
May 21 02:04:54.696769 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d35a1f35-4fdd-4efa-a753-7aa8d1a205a8/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:04:54.697735 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-0 (vdb) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:04:54.702876 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:04:54.742180 np0000001127 nova-compute[98206]: DEBUG os_brick.encryptors [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4', 'iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ee9e7b51-894c-40d4-8954-fecb89ce3df4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': 'd35a1f35-4fdd-4efa-a753-7aa8d1a205a8', 'attached_at': '', 'detached_at': '', 'volume_id': 'ee9e7b51-894c-40d4-8954-fecb89ce3df4', 'serial': 'ee9e7b51-894c-40d4-8954-fecb89ce3df4'} {{(pid=98206) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 21 02:04:54.765086 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Found disk vdb by alias ua-ee9e7b51-894c-40d4-8954-fecb89ce3df4 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:04:54.765855 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-81a903df-fd64-4fe4-9129-96c637f0f209 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Took 1.51 seconds to destroy the instance on the hypervisor.
May 21 02:04:54.769503 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Found disk vdb by alias ua-ee9e7b51-894c-40d4-8954-fecb89ce3df4 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:04:54.772631 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-81a903df-fd64-4fe4-9129-96c637f0f209 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:04:54.772985 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Attempting to detach device vdb from instance d35a1f35-4fdd-4efa-a753-7aa8d1a205a8 from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 02:04:54.773435 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:04:54.773435 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:04:54.773435 np0000001127 nova-compute[98206]:   <alias name="ua-ee9e7b51-894c-40d4-8954-fecb89ce3df4"/>
May 21 02:04:54.773435 np0000001127 nova-compute[98206]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 21 02:04:54.773435 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:04:54.773435 np0000001127 nova-compute[98206]:   <serial>ee9e7b51-894c-40d4-8954-fecb89ce3df4</serial>
May 21 02:04:54.773435 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:04:54.773435 np0000001127 nova-compute[98206]: </disk>
May 21 02:04:54.773435 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:04:54.776122 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:04:54.776122 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:04:54.776122 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:54.793322 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Successfully detached device vdb from instance d35a1f35-4fdd-4efa-a753-7aa8d1a205a8 from the persistent domain config.
May 21 02:04:54.793705 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] (1/8): Attempting to detach device vdb with device alias ua-ee9e7b51-894c-40d4-8954-fecb89ce3df4 from instance d35a1f35-4fdd-4efa-a753-7aa8d1a205a8 from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 02:04:54.794097 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:04:54.794097 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:04:54.794097 np0000001127 nova-compute[98206]:   <alias name="ua-ee9e7b51-894c-40d4-8954-fecb89ce3df4"/>
May 21 02:04:54.794097 np0000001127 nova-compute[98206]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 21 02:04:54.794097 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:04:54.794097 np0000001127 nova-compute[98206]:   <serial>ee9e7b51-894c-40d4-8954-fecb89ce3df4</serial>
May 21 02:04:54.794097 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:04:54.794097 np0000001127 nova-compute[98206]: </disk>
May 21 02:04:54.794097 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:04:54.831313 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:04:54.834418 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:04:54.943575 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:54.965676 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-2384c69f-4b14-4e8a-8a25-28548df72935 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Releasing lock "refresh_cache-76097fea-0890-40a8-a902-9f510cd34b52" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:04:54.968013 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-2384c69f-4b14-4e8a-8a25-28548df72935 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lazy-loading 'flavor' on Instance uuid 76097fea-0890-40a8-a902-9f510cd34b52 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:04:54.979373 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6886d18d-3d3f-4b83-9203-283e1f34eaf8 req-c35ed697-72dc-478c-af05-a2082540ab04 service nova] Acquired lock "refresh_cache-76097fea-0890-40a8-a902-9f510cd34b52" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:04:54.979568 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-6886d18d-3d3f-4b83-9203-283e1f34eaf8 req-c35ed697-72dc-478c-af05-a2082540ab04 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Refreshing network info cache for port f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:04:55.006351 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:04:55.007412 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:04:55.010787 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk.rescue --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:04:55.146636 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:04:55.146636 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk.rescue --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:04:55.310571 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:04:55.377084 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:04:55.380562 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:04:55.472390 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "env LANG=C uptime" returned: 0 in 0.092s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:04:55.472850 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Hypervisor/Node resource view: name=np0000001127 free_ram=12571MB free_disk=73.97571182250977GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 21 02:04:55.473051 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:55.473299 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:55.483591 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-6886d18d-3d3f-4b83-9203-283e1f34eaf8 req-c35ed697-72dc-478c-af05-a2082540ab04 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:55.500541 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779329095.498819, d35a1f35-4fdd-4efa-a753-7aa8d1a205a8 => ua-ee9e7b51-894c-40d4-8954-fecb89ce3df4> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 02:04:55.500541 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-ee9e7b51-894c-40d4-8954-fecb89ce3df4 for instance d35a1f35-4fdd-4efa-a753-7aa8d1a205a8 {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 02:04:55.513581 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Successfully detached device vdb from instance d35a1f35-4fdd-4efa-a753-7aa8d1a205a8 from the live domain config.
May 21 02:04:55.519111 np0000001127 nova-compute[98206]: WARNING stevedore.named [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 21 02:04:55.519420 np0000001127 nova-compute[98206]: WARNING castellan.key_manager [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 21 02:04:55.519783 np0000001127 nova-compute[98206]: WARNING nova.keymgr.conf_key_mgr [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 21 02:04:55.520498 np0000001127 nova-compute[98206]: DEBUG os_brick.encryptors [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x71c05864aed0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4', 'iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ee9e7b51-894c-40d4-8954-fecb89ce3df4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': 'd35a1f35-4fdd-4efa-a753-7aa8d1a205a8', 'attached_at': '', 'detached_at': '', 'volume_id': 'ee9e7b51-894c-40d4-8954-fecb89ce3df4', 'serial': 'ee9e7b51-894c-40d4-8954-fecb89ce3df4'} {{(pid=98206) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 21 02:04:55.520692 np0000001127 nova-compute[98206]: DEBUG os_brick.encryptors.luks [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] closing encrypted volume /dev/dm-5 {{(pid=98206) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:207}}
May 21 02:04:55.542319 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:55.557232 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:04:55.557724 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4', 'iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ee9e7b51-894c-40d4-8954-fecb89ce3df4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:04:55.558794 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:04:55.561192 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:04:55.562452 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:55.565000 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4', 'iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ee9e7b51-894c-40d4-8954-fecb89ce3df4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:04:55.566728 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:04:55.576352 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:55.606909 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:55.607811 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:55.611275 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:55.611275 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:55.611275 np0000001127 nova-compute[98206]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:55.611275 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:55.611275 np0000001127 nova-compute[98206]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4 (non-flash)
May 21 02:04:55.611275 np0000001127 nova-compute[98206]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4 (non-flash)
May 21 02:04:55.611275 np0000001127 nova-compute[98206]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a (non-flash)
May 21 02:04:55.611275 np0000001127 nova-compute[98206]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a (non-flash)
May 21 02:04:55.611275 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:04:55.611275 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsi session list stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:55.611275 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:04:55.611275 np0000001127 nova-compute[98206]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:55.611275 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:04:55.611275 np0000001127 nova-compute[98206]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4 (non-flash)
May 21 02:04:55.611275 np0000001127 nova-compute[98206]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4 (non-flash)
May 21 02:04:55.611275 np0000001127 nova-compute[98206]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a (non-flash)
May 21 02:04:55.611275 np0000001127 nova-compute[98206]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a (non-flash)
May 21 02:04:55.611275 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:04:55.611275 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', '86'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', '87'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c', '88'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c', '89'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4', '90'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a', '92'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a', '93')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:04:55.611275 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4', '91')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:04:55.614809 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4', '90')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:04:55.619767 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:04:55.624382 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:04:55.624382 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Creating image(s)
May 21 02:04:55.629135 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Acquiring lock "/opt/stack/data/nova/instances/fb553376-632d-46c3-99dd-4fbc6a27c1c2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:55.636643 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Lock "/opt/stack/data/nova/instances/fb553376-632d-46c3-99dd-4fbc6a27c1c2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.006s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:55.639444 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Lock "/opt/stack/data/nova/instances/fb553376-632d-46c3-99dd-4fbc6a27c1c2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:55.665655 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Successfully updated port: dc7ed06f-f8e7-4e18-8207-748cbf553e58 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:04:55.672552 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c73d300>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4'): ({'sdb'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:04:55.673430 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:04:55.682499 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Removing multipathed devices sdc, sdb {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:04:55.682499 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Flush multipath device 33000000024659e6c {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:04:55.686545 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:04:55.691584 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:04:55.723410 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:04:55.766506 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2c31489f-9a10-4329-823d-6d8a79978411 req-b6e584bc-b5e9-4425-8f8f-92c134c11611 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Received event network-vif-unplugged-0298cd31-6bbc-4653-a4ac-8d9b5def1753 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:55.766506 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2c31489f-9a10-4329-823d-6d8a79978411 req-b6e584bc-b5e9-4425-8f8f-92c134c11611 service nova] Acquiring lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:55.766730 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2c31489f-9a10-4329-823d-6d8a79978411 req-b6e584bc-b5e9-4425-8f8f-92c134c11611 service nova] Lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:55.767690 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2c31489f-9a10-4329-823d-6d8a79978411 req-b6e584bc-b5e9-4425-8f8f-92c134c11611 service nova] Lock "e158490e-746e-4c3b-924e-9aceed1662d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:55.767875 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2c31489f-9a10-4329-823d-6d8a79978411 req-b6e584bc-b5e9-4425-8f8f-92c134c11611 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] No waiting events found dispatching network-vif-unplugged-0298cd31-6bbc-4653-a4ac-8d9b5def1753 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:04:55.767980 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2c31489f-9a10-4329-823d-6d8a79978411 req-b6e584bc-b5e9-4425-8f8f-92c134c11611 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Received event network-vif-unplugged-0298cd31-6bbc-4653-a4ac-8d9b5def1753 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:04:55.768109 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2c31489f-9a10-4329-823d-6d8a79978411 req-b6e584bc-b5e9-4425-8f8f-92c134c11611 service nova] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Received event network-changed-dc7ed06f-f8e7-4e18-8207-748cbf553e58 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:55.768580 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2c31489f-9a10-4329-823d-6d8a79978411 req-b6e584bc-b5e9-4425-8f8f-92c134c11611 service nova] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Refreshing instance network info cache due to event network-changed-dc7ed06f-f8e7-4e18-8207-748cbf553e58. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:04:55.768580 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2c31489f-9a10-4329-823d-6d8a79978411 req-b6e584bc-b5e9-4425-8f8f-92c134c11611 service nova] Acquiring lock "refresh_cache-fb553376-632d-46c3-99dd-4fbc6a27c1c2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:04:55.768580 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2c31489f-9a10-4329-823d-6d8a79978411 req-b6e584bc-b5e9-4425-8f8f-92c134c11611 service nova] Acquired lock "refresh_cache-fb553376-632d-46c3-99dd-4fbc6a27c1c2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:04:55.768739 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-2c31489f-9a10-4329-823d-6d8a79978411 req-b6e584bc-b5e9-4425-8f8f-92c134c11611 service nova] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Refreshing network info cache for port dc7ed06f-f8e7-4e18-8207-748cbf553e58 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:04:55.776045 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:04:55.801190 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.109s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:04:55.801737 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:55.802754 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:55.804227 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:04:55.810659 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:04:55.810659 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:04:55.836738 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:04:55.853508 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:04:55.853508 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:04:55.878054 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:04:55.878356 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:04:55.889073 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999478322999948 future=<Future at 0x71c058461a00 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:55.894916 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Instance destroyed successfully.
May 21 02:04:55.896825 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-2384c69f-4b14-4e8a-8a25-28548df72935 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lazy-loading 'numa_topology' on Instance uuid 76097fea-0890-40a8-a902-9f510cd34b52 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:04:55.901407 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:55.928386 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.120s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:04:55.929002 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/fb553376-632d-46c3-99dd-4fbc6a27c1c2/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:04:55.958609 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 91, target: iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4, portal: 192.168.40.100,3260]
May 21 02:04:55.958609 np0000001127 nova-compute[98206]: Logout of [sid: 91, target: iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4, portal: 192.168.40.100,3260] successful.
May 21 02:04:55.958609 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:55.990160 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:56.007484 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:56.008515 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/fb553376-632d-46c3-99dd-4fbc6a27c1c2/disk 1073741824" returned: 0 in 0.080s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:04:56.009119 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:56.009433 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:04:56.053778 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 90, target: iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4, portal: 192.168.50.100,3260]
May 21 02:04:56.053778 np0000001127 nova-compute[98206]: Logout of [sid: 90, target: iqn.2023-03.storpool.com:os--volume-ee9e7b51-894c-40d4-8954-fecb89ce3df4, portal: 192.168.50.100,3260] successful.
May 21 02:04:56.053778 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:56.074875 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:04:56.079423 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.519s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:04:56.079625 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] <== disconnect_volume: return (521ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:04:56.079828 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:04:56.122012 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.112s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:04:56.122351 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fb553376-632d-46c3-99dd-4fbc6a27c1c2/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:04:56.122600 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb553376-632d-46c3-99dd-4fbc6a27c1c2/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:04:56.164254 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:04:56.175291 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Acquiring lock "refresh_cache-fb553376-632d-46c3-99dd-4fbc6a27c1c2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:04:56.181886 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-6886d18d-3d3f-4b83-9203-283e1f34eaf8 req-c35ed697-72dc-478c-af05-a2082540ab04 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:56.253574 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb553376-632d-46c3-99dd-4fbc6a27c1c2/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:04:56.254206 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Cannot resize image /opt/stack/data/nova/instances/fb553376-632d-46c3-99dd-4fbc6a27c1c2/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:04:56.255302 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:04:56.255302 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Ensure instance console log exists: /opt/stack/data/nova/instances/fb553376-632d-46c3-99dd-4fbc6a27c1c2/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:04:56.255541 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:56.255720 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:56.255877 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:56.271767 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-2c31489f-9a10-4329-823d-6d8a79978411 req-b6e584bc-b5e9-4425-8f8f-92c134c11611 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:56.320235 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-15d47b81-c3ee-4571-9f73-e42009a1301c req-76ac845c-3698-488f-b8e1-3334cab482e3 service nova] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Received event network-vif-deleted-0298cd31-6bbc-4653-a4ac-8d9b5def1753 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:56.320235 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-15d47b81-c3ee-4571-9f73-e42009a1301c req-76ac845c-3698-488f-b8e1-3334cab482e3 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Received event network-vif-unplugged-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:56.320574 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-15d47b81-c3ee-4571-9f73-e42009a1301c req-76ac845c-3698-488f-b8e1-3334cab482e3 service nova] Acquiring lock "76097fea-0890-40a8-a902-9f510cd34b52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:56.321116 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-15d47b81-c3ee-4571-9f73-e42009a1301c req-76ac845c-3698-488f-b8e1-3334cab482e3 service nova] Lock "76097fea-0890-40a8-a902-9f510cd34b52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:56.321307 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-15d47b81-c3ee-4571-9f73-e42009a1301c req-76ac845c-3698-488f-b8e1-3334cab482e3 service nova] Lock "76097fea-0890-40a8-a902-9f510cd34b52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:56.321495 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-15d47b81-c3ee-4571-9f73-e42009a1301c req-76ac845c-3698-488f-b8e1-3334cab482e3 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] No waiting events found dispatching network-vif-unplugged-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:04:56.321657 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-15d47b81-c3ee-4571-9f73-e42009a1301c req-76ac845c-3698-488f-b8e1-3334cab482e3 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Received unexpected event network-vif-unplugged-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 for instance with vm_state rescued and task_state unrescuing.
May 21 02:04:56.321792 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-15d47b81-c3ee-4571-9f73-e42009a1301c req-76ac845c-3698-488f-b8e1-3334cab482e3 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Received event network-vif-unplugged-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:56.321996 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-15d47b81-c3ee-4571-9f73-e42009a1301c req-76ac845c-3698-488f-b8e1-3334cab482e3 service nova] Acquiring lock "76097fea-0890-40a8-a902-9f510cd34b52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:56.322236 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-15d47b81-c3ee-4571-9f73-e42009a1301c req-76ac845c-3698-488f-b8e1-3334cab482e3 service nova] Lock "76097fea-0890-40a8-a902-9f510cd34b52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:56.322295 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-15d47b81-c3ee-4571-9f73-e42009a1301c req-76ac845c-3698-488f-b8e1-3334cab482e3 service nova] Lock "76097fea-0890-40a8-a902-9f510cd34b52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:56.322429 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-15d47b81-c3ee-4571-9f73-e42009a1301c req-76ac845c-3698-488f-b8e1-3334cab482e3 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] No waiting events found dispatching network-vif-unplugged-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:04:56.322598 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-15d47b81-c3ee-4571-9f73-e42009a1301c req-76ac845c-3698-488f-b8e1-3334cab482e3 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Received unexpected event network-vif-unplugged-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 for instance with vm_state rescued and task_state unrescuing.
May 21 02:04:56.362527 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-2c31489f-9a10-4329-823d-6d8a79978411 req-b6e584bc-b5e9-4425-8f8f-92c134c11611 service nova] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:04:56.381406 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-6886d18d-3d3f-4b83-9203-283e1f34eaf8 req-c35ed697-72dc-478c-af05-a2082540ab04 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Updated VIF entry in instance network info cache for port f11d80e2-4ef4-404d-9b12-4b33f3e9caa2. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:04:56.382192 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-6886d18d-3d3f-4b83-9203-283e1f34eaf8 req-c35ed697-72dc-478c-af05-a2082540ab04 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Updating instance_info_cache with network_info: [{"id": "f11d80e2-4ef4-404d-9b12-4b33f3e9caa2", "address": "fa:16:3e:4b:b4:81", "network": {"id": "8f999b5c-800e-44f7-84c5-6eff98ea03cb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-569078034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e98d81a820544f078c16b171f1e8b65c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11d80e2-4e", "ovs_interfaceid": "f11d80e2-4ef4-404d-9b12-4b33f3e9caa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:04:56.401870 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-2384c69f-4b14-4e8a-8a25-28548df72935 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Object Instance<76097fea-0890-40a8-a902-9f510cd34b52> lazy-loaded attributes: flavor,numa_topology {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:04:56.511996 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:56.570754 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance e158490e-746e-4c3b-924e-9aceed1662d0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:04:56.570906 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 76097fea-0890-40a8-a902-9f510cd34b52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:04:56.571062 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance d35a1f35-4fdd-4efa-a753-7aa8d1a205a8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:04:56.571202 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:04:56.571345 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance f63a2253-071a-4a1a-94af-3544b20c39cf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:04:56.571636 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 4a71f98e-0988-46c9-9b04-f8d0197468b9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:04:56.571799 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance fb553376-632d-46c3-99dd-4fbc6a27c1c2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:04:56.578106 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 21 02:04:56.578106 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Final resource view: name=np0000001127 phys_ram=24030MB used_ram=1856MB phys_disk=95GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:04:55 up 35 min,  2 users,  load average: 10.50, 8.74, 5.08\n', 'num_instances': '7', 'num_vm_rescued': '1', 'num_task_unrescuing': '1', 'num_os_type_None': '7', 'num_proj_e98d81a820544f078c16b171f1e8b65c': '1', 'io_workload': '2', 'num_vm_active': '4', 'num_task_None': '3', 'num_proj_177bec65268546d2b899e09989183b6e': '1', 'num_proj_e80cee8643f34f6685ff7fb42920afc3': '1', 'num_vm_building': '2', 'num_task_spawning': '2', 'num_proj_62ebdb16aee84e22a88dfc8960debd32': '1', 'num_proj_e8db1d8006574d1e9f7117042461bce4': '1', 'num_task_deleting': '1', 'num_proj_87eb25eb23724c49b5bdbc462a1f36bc': '1', 'num_proj_db73ea4d098a4b768f0b51d6cbe9eda8': '1'} {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 21 02:04:56.587104 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-2c31489f-9a10-4329-823d-6d8a79978411 req-b6e584bc-b5e9-4425-8f8f-92c134c11611 service nova] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:04:56.671553 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Took 1.90 seconds to deallocate network for instance.
May 21 02:04:56.686748 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lazy-loading 'flavor' on Instance uuid d35a1f35-4fdd-4efa-a753-7aa8d1a205a8 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:04:56.886636 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6886d18d-3d3f-4b83-9203-283e1f34eaf8 req-c35ed697-72dc-478c-af05-a2082540ab04 service nova] Releasing lock "refresh_cache-76097fea-0890-40a8-a902-9f510cd34b52" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:04:56.886636 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6886d18d-3d3f-4b83-9203-283e1f34eaf8 req-c35ed697-72dc-478c-af05-a2082540ab04 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Received event network-changed-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:56.886636 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6886d18d-3d3f-4b83-9203-283e1f34eaf8 req-c35ed697-72dc-478c-af05-a2082540ab04 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Refreshing instance network info cache due to event network-changed-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:04:56.886636 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6886d18d-3d3f-4b83-9203-283e1f34eaf8 req-c35ed697-72dc-478c-af05-a2082540ab04 service nova] Acquiring lock "refresh_cache-76097fea-0890-40a8-a902-9f510cd34b52" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:04:56.886636 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6886d18d-3d3f-4b83-9203-283e1f34eaf8 req-c35ed697-72dc-478c-af05-a2082540ab04 service nova] Acquired lock "refresh_cache-76097fea-0890-40a8-a902-9f510cd34b52" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:04:56.886636 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-6886d18d-3d3f-4b83-9203-283e1f34eaf8 req-c35ed697-72dc-478c-af05-a2082540ab04 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Refreshing network info cache for port f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:04:56.942573 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:56.973644 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:57.075573 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:57.078138 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:04:57.078247 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:04:57.090726 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2c31489f-9a10-4329-823d-6d8a79978411 req-b6e584bc-b5e9-4425-8f8f-92c134c11611 service nova] Releasing lock "refresh_cache-fb553376-632d-46c3-99dd-4fbc6a27c1c2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:04:57.091173 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Acquired lock "refresh_cache-fb553376-632d-46c3-99dd-4fbc6a27c1c2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:04:57.091317 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:04:57.192343 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-81a903df-fd64-4fe4-9129-96c637f0f209 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:57.357377 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:57.366540 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:57.391000 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-6886d18d-3d3f-4b83-9203-283e1f34eaf8 req-c35ed697-72dc-478c-af05-a2082540ab04 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:57.393583 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:57.584448 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:04:57.687347 np0000001127 nova-compute[98206]: DEBUG os_brick.encryptors.luks [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] opening encrypted volume /dev/dm-6 {{(pid=98206) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 21 02:04:57.690002 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:04:57.699059 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9b20fa93-7a8c-4933-9b50-178a2b0e5315 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "d35a1f35-4fdd-4efa-a753-7aa8d1a205a8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.703s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:57.825125 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-6886d18d-3d3f-4b83-9203-283e1f34eaf8 req-c35ed697-72dc-478c-af05-a2082540ab04 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:57.937318 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:04:57.953998 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-2384c69f-4b14-4e8a-8a25-28548df72935 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:04:57.955103 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Removed pending STOPPED event for 76097fea-0890-40a8-a902-9f510cd34b52 due to new event <LifecycleEvent: 1779329097.954637, 76097fea-0890-40a8-a902-9f510cd34b52 => Resumed> {{(pid=98206) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 21 02:04:57.958970 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329097.954637, 76097fea-0890-40a8-a902-9f510cd34b52 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:04:57.959311 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] VM Resumed (Lifecycle Event)
May 21 02:04:58.030054 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-6886d18d-3d3f-4b83-9203-283e1f34eaf8 req-c35ed697-72dc-478c-af05-a2082540ab04 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Updated VIF entry in instance network info cache for port f11d80e2-4ef4-404d-9b12-4b33f3e9caa2. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:04:58.030390 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-6886d18d-3d3f-4b83-9203-283e1f34eaf8 req-c35ed697-72dc-478c-af05-a2082540ab04 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Updating instance_info_cache with network_info: [{"id": "f11d80e2-4ef4-404d-9b12-4b33f3e9caa2", "address": "fa:16:3e:4b:b4:81", "network": {"id": "8f999b5c-800e-44f7-84c5-6eff98ea03cb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-569078034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e98d81a820544f078c16b171f1e8b65c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11d80e2-4e", "ovs_interfaceid": "f11d80e2-4ef4-404d-9b12-4b33f3e9caa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:04:58.094240 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Compute_service record updated for np0000001127:np0000001127 {{(pid=98206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 21 02:04:58.094649 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.621s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:58.097788 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-81a903df-fd64-4fe4-9129-96c637f0f209 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.903s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:58.099484 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.87 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:04:58.255878 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Updating instance_info_cache with network_info: [{"id": "dc7ed06f-f8e7-4e18-8207-748cbf553e58", "address": "fa:16:3e:93:f8:7e", "network": {"id": "efb73811-c979-4f83-9b27-67a93594f8c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-674032884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8db1d8006574d1e9f7117042461bce4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc7ed06f-f8", "ovs_interfaceid": "dc7ed06f-f8e7-4e18-8207-748cbf553e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:04:58.395006 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f0ccbca7-4300-46e8-9abf-7d8650a030ff req-96919157-47de-41e8-b97a-ec056bae1ef1 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Received event network-vif-plugged-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:58.395387 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f0ccbca7-4300-46e8-9abf-7d8650a030ff req-96919157-47de-41e8-b97a-ec056bae1ef1 service nova] Acquiring lock "76097fea-0890-40a8-a902-9f510cd34b52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:58.396621 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f0ccbca7-4300-46e8-9abf-7d8650a030ff req-96919157-47de-41e8-b97a-ec056bae1ef1 service nova] Lock "76097fea-0890-40a8-a902-9f510cd34b52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:58.397236 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f0ccbca7-4300-46e8-9abf-7d8650a030ff req-96919157-47de-41e8-b97a-ec056bae1ef1 service nova] Lock "76097fea-0890-40a8-a902-9f510cd34b52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:58.397301 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f0ccbca7-4300-46e8-9abf-7d8650a030ff req-96919157-47de-41e8-b97a-ec056bae1ef1 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] No waiting events found dispatching network-vif-plugged-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:04:58.398168 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-f0ccbca7-4300-46e8-9abf-7d8650a030ff req-96919157-47de-41e8-b97a-ec056bae1ef1 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Received unexpected event network-vif-plugged-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 for instance with vm_state active and task_state None.
May 21 02:04:58.399057 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f0ccbca7-4300-46e8-9abf-7d8650a030ff req-96919157-47de-41e8-b97a-ec056bae1ef1 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Received event network-vif-plugged-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:04:58.399271 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f0ccbca7-4300-46e8-9abf-7d8650a030ff req-96919157-47de-41e8-b97a-ec056bae1ef1 service nova] Acquiring lock "76097fea-0890-40a8-a902-9f510cd34b52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:58.400156 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f0ccbca7-4300-46e8-9abf-7d8650a030ff req-96919157-47de-41e8-b97a-ec056bae1ef1 service nova] Lock "76097fea-0890-40a8-a902-9f510cd34b52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:58.400429 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f0ccbca7-4300-46e8-9abf-7d8650a030ff req-96919157-47de-41e8-b97a-ec056bae1ef1 service nova] Lock "76097fea-0890-40a8-a902-9f510cd34b52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:58.400589 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f0ccbca7-4300-46e8-9abf-7d8650a030ff req-96919157-47de-41e8-b97a-ec056bae1ef1 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] No waiting events found dispatching network-vif-plugged-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:04:58.400818 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-f0ccbca7-4300-46e8-9abf-7d8650a030ff req-96919157-47de-41e8-b97a-ec056bae1ef1 service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Received unexpected event network-vif-plugged-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 for instance with vm_state active and task_state None.
May 21 02:04:58.470571 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:04:58.478069 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:04:58.533118 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6886d18d-3d3f-4b83-9203-283e1f34eaf8 req-c35ed697-72dc-478c-af05-a2082540ab04 service nova] Releasing lock "refresh_cache-76097fea-0890-40a8-a902-9f510cd34b52" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:04:58.550869 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d18ad4ea-5dd1-40c9-8e16-3ed573811040 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "d35a1f35-4fdd-4efa-a753-7aa8d1a205a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:58.551210 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d18ad4ea-5dd1-40c9-8e16-3ed573811040 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "d35a1f35-4fdd-4efa-a753-7aa8d1a205a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:58.551536 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d18ad4ea-5dd1-40c9-8e16-3ed573811040 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "d35a1f35-4fdd-4efa-a753-7aa8d1a205a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:58.552031 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d18ad4ea-5dd1-40c9-8e16-3ed573811040 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "d35a1f35-4fdd-4efa-a753-7aa8d1a205a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:58.552031 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d18ad4ea-5dd1-40c9-8e16-3ed573811040 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "d35a1f35-4fdd-4efa-a753-7aa8d1a205a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:58.554350 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-d18ad4ea-5dd1-40c9-8e16-3ed573811040 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Terminating instance
May 21 02:04:58.610327 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-81a903df-fd64-4fe4-9129-96c637f0f209 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:04:58.610551 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-81a903df-fd64-4fe4-9129-96c637f0f209 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:04:58.758914 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Releasing lock "refresh_cache-fb553376-632d-46c3-99dd-4fbc6a27c1c2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:04:58.759319 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Instance network_info: |[{"id": "dc7ed06f-f8e7-4e18-8207-748cbf553e58", "address": "fa:16:3e:93:f8:7e", "network": {"id": "efb73811-c979-4f83-9b27-67a93594f8c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-674032884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8db1d8006574d1e9f7117042461bce4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc7ed06f-f8", "ovs_interfaceid": "dc7ed06f-f8e7-4e18-8207-748cbf553e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:04:58.761403 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Start _get_guest_xml network_info=[{"id": "dc7ed06f-f8e7-4e18-8207-748cbf553e58", "address": "fa:16:3e:93:f8:7e", "network": {"id": "efb73811-c979-4f83-9b27-67a93594f8c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-674032884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8db1d8006574d1e9f7117042461bce4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc7ed06f-f8", "ovs_interfaceid": "dc7ed06f-f8e7-4e18-8207-748cbf553e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:04:58.764350 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:04:58.766133 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-1589960385', uuid='fb553376-632d-46c3-99dd-4fbc6a27c1c2'), owner=OwnerMeta(userid='67349a30ec514c90a316eb35d579b04b', username='tempest-VolumesActionsTest-1094570120-project-member', projectid='e8db1d8006574d1e9f7117042461bce4', projectname='tempest-VolumesActionsTest-1094570120'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "dc7ed06f-f8e7-4e18-8207-748cbf553e58", "address": "fa:16:3e:93:f8:7e", "network": {"id": "efb73811-c979-4f83-9b27-67a93594f8c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-674032884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8db1d8006574d1e9f7117042461bce4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc7ed06f-f8", "ovs_interfaceid": "dc7ed06f-f8e7-4e18-8207-748cbf553e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329098.7656426) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:04:58.769027 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:04:58.769457 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:04:58.770619 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:04:58.770883 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:04:58.772421 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:04:58.772825 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:04:58.773007 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:04:58.773108 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:04:58.773251 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:04:58.773343 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:04:58.773448 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:04:58.773741 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:04:58.773857 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:04:58.773999 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:04:58.774117 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:04:58.774249 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:04:58.793320 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:04:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1589960385',display_name='tempest-VolumesActionsTest-instance-1589960385',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumesactionstest-instance-1589960385',id=41,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8db1d8006574d1e9f7117042461bce4',ramdisk_id='',reservation_id='r-e0tgy6d6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1094570120',owner_user_name='tempest-VolumesActionsTest-1094570120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:04:55Z,user_data=None,user_id='67349a30ec514c90a316eb35d579b04b',uuid=fb553376-632d-46c3-99dd-4fbc6a27c1c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc7ed06f-f8e7-4e18-8207-748cbf553e58", "address": "fa:16:3e:93:f8:7e", "network": {"id": "efb73811-c979-4f83-9b27-67a93594f8c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-674032884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8db1d8006574d1e9f7117042461bce4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc7ed06f-f8", "ovs_interfaceid": "dc7ed06f-f8e7-4e18-8207-748cbf553e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:04:58.793320 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Converting VIF {"id": "dc7ed06f-f8e7-4e18-8207-748cbf553e58", "address": "fa:16:3e:93:f8:7e", "network": {"id": "efb73811-c979-4f83-9b27-67a93594f8c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-674032884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8db1d8006574d1e9f7117042461bce4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc7ed06f-f8", "ovs_interfaceid": "dc7ed06f-f8e7-4e18-8207-748cbf553e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:04:58.793320 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:f8:7e,bridge_name='br-int',has_traffic_filtering=True,id=dc7ed06f-f8e7-4e18-8207-748cbf553e58,network=Network(efb73811-c979-4f83-9b27-67a93594f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc7ed06f-f8') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:04:58.794304 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Lazy-loading 'pci_devices' on Instance uuid fb553376-632d-46c3-99dd-4fbc6a27c1c2 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:04:58.973771 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:04:58.973771 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:04:58.974082 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.70 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:04:58.984383 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329098.982785, 76097fea-0890-40a8-a902-9f510cd34b52 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:04:58.984383 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] VM Started (Lifecycle Event)
May 21 02:04:59.062405 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d18ad4ea-5dd1-40c9-8e16-3ed573811040 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:04:59.113527 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-81a903df-fd64-4fe4-9129-96c637f0f209 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:04:59.123697 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:59.147990 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:59.156956 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:59.187528 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:59.212939 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:59.297971 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] End _get_guest_xml xml=<domain type="qemu">
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:   <uuid>fb553376-632d-46c3-99dd-4fbc6a27c1c2</uuid>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:   <name>instance-00000029</name>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:       <nova:name>tempest-VolumesActionsTest-instance-1589960385</nova:name>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:04:58</nova:creationTime>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:         <nova:user uuid="67349a30ec514c90a316eb35d579b04b">tempest-VolumesActionsTest-1094570120-project-member</nova:user>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:         <nova:project uuid="e8db1d8006574d1e9f7117042461bce4">tempest-VolumesActionsTest-1094570120</nova:project>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:         <nova:port uuid="dc7ed06f-f8e7-4e18-8207-748cbf553e58">
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:     <system>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:       <entry name="serial">fb553376-632d-46c3-99dd-4fbc6a27c1c2</entry>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:       <entry name="uuid">fb553376-632d-46c3-99dd-4fbc6a27c1c2</entry>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:     </system>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:   <os>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:   </os>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:   <features>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:   </features>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:   <devices>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/fb553376-632d-46c3-99dd-4fbc6a27c1c2/disk"/>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:     </disk>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/fb553376-632d-46c3-99dd-4fbc6a27c1c2/disk.config"/>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:     </disk>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:93:f8:7e"/>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:       <target dev="tapdc7ed06f-f8"/>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:     </interface>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/fb553376-632d-46c3-99dd-4fbc6a27c1c2/console.log" append="off"/>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:     </serial>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:     <video>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:     </video>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:     </rng>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:   </devices>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]: </domain>
May 21 02:04:59.297971 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:04:59.300362 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Preparing to wait for external event network-vif-plugged-dc7ed06f-f8e7-4e18-8207-748cbf553e58 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:04:59.300362 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Acquiring lock "fb553376-632d-46c3-99dd-4fbc6a27c1c2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:04:59.300362 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Lock "fb553376-632d-46c3-99dd-4fbc6a27c1c2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:04:59.300362 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Lock "fb553376-632d-46c3-99dd-4fbc6a27c1c2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:59.300362 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:04:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1589960385',display_name='tempest-VolumesActionsTest-instance-1589960385',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumesactionstest-instance-1589960385',id=41,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8db1d8006574d1e9f7117042461bce4',ramdisk_id='',reservation_id='r-e0tgy6d6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1094570120',owner_user_name='tempest-VolumesActionsTest-1094570120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:04:55Z,user_data=None,user_id='67349a30ec514c90a316eb35d579b04b',uuid=fb553376-632d-46c3-99dd-4fbc6a27c1c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc7ed06f-f8e7-4e18-8207-748cbf553e58", "address": "fa:16:3e:93:f8:7e", "network": {"id": "efb73811-c979-4f83-9b27-67a93594f8c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-674032884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8db1d8006574d1e9f7117042461bce4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc7ed06f-f8", "ovs_interfaceid": "dc7ed06f-f8e7-4e18-8207-748cbf553e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:04:59.300362 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Converting VIF {"id": "dc7ed06f-f8e7-4e18-8207-748cbf553e58", "address": "fa:16:3e:93:f8:7e", "network": {"id": "efb73811-c979-4f83-9b27-67a93594f8c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-674032884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8db1d8006574d1e9f7117042461bce4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc7ed06f-f8", "ovs_interfaceid": "dc7ed06f-f8e7-4e18-8207-748cbf553e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:04:59.300608 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:f8:7e,bridge_name='br-int',has_traffic_filtering=True,id=dc7ed06f-f8e7-4e18-8207-748cbf553e58,network=Network(efb73811-c979-4f83-9b27-67a93594f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc7ed06f-f8') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:04:59.302772 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:f8:7e,bridge_name='br-int',has_traffic_filtering=True,id=dc7ed06f-f8e7-4e18-8207-748cbf553e58,network=Network(efb73811-c979-4f83-9b27-67a93594f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc7ed06f-f8') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:04:59.302772 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:59.302772 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:04:59.302772 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:04:59.308204 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:59.308204 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0c1e632e-1d07-549b-b214-291b6ca0bc11', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:04:59.308204 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:59.310539 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:04:59.318736 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:59.322423 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:59.322792 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc7ed06f-f8, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:04:59.323023 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdc7ed06f-f8, col_values=(('qos', UUID('095471f1-f978-4487-b4b2-bb5d17c5412d')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:04:59.323190 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdc7ed06f-f8, col_values=(('external_ids', {'iface-id': 'dc7ed06f-f8e7-4e18-8207-748cbf553e58', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:f8:7e', 'vm-uuid': 'fb553376-632d-46c3-99dd-4fbc6a27c1c2'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:04:59.324203 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:59.326345 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:04:59.335649 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:59.339170 np0000001127 nova-compute[98206]: INFO os_vif [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:f8:7e,bridge_name='br-int',has_traffic_filtering=True,id=dc7ed06f-f8e7-4e18-8207-748cbf553e58,network=Network(efb73811-c979-4f83-9b27-67a93594f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc7ed06f-f8')
May 21 02:04:59.395433 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:59.426052 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Instance destroyed successfully.
May 21 02:04:59.427399 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-d18ad4ea-5dd1-40c9-8e16-3ed573811040 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lazy-loading 'resources' on Instance uuid d35a1f35-4fdd-4efa-a753-7aa8d1a205a8 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:04:59.431883 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:59.488015 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:04:59.493908 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:04:59.635321 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-81a903df-fd64-4fe4-9129-96c637f0f209 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.540s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:04:59.705860 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-81a903df-fd64-4fe4-9129-96c637f0f209 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Deleted allocations for instance e158490e-746e-4c3b-924e-9aceed1662d0
May 21 02:04:59.805548 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:59.818188 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:59.850370 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:59.851060 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:59.904171 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0018343940000704606 future=<Future at 0x71c07c797fe0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:59.907625 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:59.909215 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] Emitting event <LifecycleEvent: 1779329084.9021904, 29a124ee-2b8c-4f44-8f91-8dd11ac78b52 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:04:59.910230 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] VM Stopped (Lifecycle Event)
May 21 02:04:59.910511 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.007756065000194212 future=<Future at 0x71c0901cec60 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:59.911391 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.008655753000311961 future=<Future at 0x71c0901cec60 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:59.911497 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:59.912183 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Emitting event <LifecycleEvent: 1779329084.902662, e95baab0-2c43-4653-b7ae-b9d8920aba33 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:04:59.912351 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] VM Stopped (Lifecycle Event)
May 21 02:04:59.913358 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=8.728358077000394 future=<Future at 0x71c05824dac0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:59.913776 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=8.728209502000027 future=<Future at 0x71c05824dac0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:04:59.929228 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-d18ad4ea-5dd1-40c9-8e16-3ed573811040 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:03:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-677776071',display_name='tempest-TestEncryptedCinderVolumes-server-677776071',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testencryptedcindervolumes-server-677776071',id=37,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTpWBzLpDObU/KfOerIlcjfmK1W7wNqlOeuHR2EDlVWezLFMgXgV+cgYLad5hJ8gsfoDqBBhjKd36bII4QWX5x7odWsUHCcT+rx4JzMW0D9m6XFd7CH79hxLomEJWdIhg==',key_name='tempest-keypair-2139954079',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:03:55Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='177bec65268546d2b899e09989183b6e',ramdisk_id='',reservation_id='r-z1j7wdmi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-991116896',owner_user_name='tempest-TestEncryptedCinderVolumes-991116896-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:03:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0efcbc1b88f49989c9f6b6a7439f2c4',uuid=d35a1f35-4fdd-4efa-a753-7aa8d1a205a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0478a2ae-a44c-4e56-bac8-7434c0d3af2a", "address": "fa:16:3e:61:10:5e", "network": {"id": "38d66f09-c738-4e79-9aeb-12e87e29f568", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-447420743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "177bec65268546d2b899e09989183b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0478a2ae-a4", "ovs_interfaceid": "0478a2ae-a44c-4e56-bac8-7434c0d3af2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:04:59.929529 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-d18ad4ea-5dd1-40c9-8e16-3ed573811040 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Converting VIF {"id": "0478a2ae-a44c-4e56-bac8-7434c0d3af2a", "address": "fa:16:3e:61:10:5e", "network": {"id": "38d66f09-c738-4e79-9aeb-12e87e29f568", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-447420743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "177bec65268546d2b899e09989183b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0478a2ae-a4", "ovs_interfaceid": "0478a2ae-a44c-4e56-bac8-7434c0d3af2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:04:59.930177 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-d18ad4ea-5dd1-40c9-8e16-3ed573811040 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:10:5e,bridge_name='br-int',has_traffic_filtering=True,id=0478a2ae-a44c-4e56-bac8-7434c0d3af2a,network=Network(38d66f09-c738-4e79-9aeb-12e87e29f568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0478a2ae-a4') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:04:59.930425 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-d18ad4ea-5dd1-40c9-8e16-3ed573811040 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:10:5e,bridge_name='br-int',has_traffic_filtering=True,id=0478a2ae-a44c-4e56-bac8-7434c0d3af2a,network=Network(38d66f09-c738-4e79-9aeb-12e87e29f568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0478a2ae-a4') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:04:59.932222 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:59.932477 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0478a2ae-a4, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:04:59.933509 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:59.934608 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:04:59.940787 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:59.941807 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:59.942044 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f142e408-4565-48d0-97d9-891384ac2530) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:04:59.943014 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:59.943232 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:04:59.949622 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:04:59.951549 np0000001127 nova-compute[98206]: INFO os_vif [None req-d18ad4ea-5dd1-40c9-8e16-3ed573811040 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:10:5e,bridge_name='br-int',has_traffic_filtering=True,id=0478a2ae-a44c-4e56-bac8-7434c0d3af2a,network=Network(38d66f09-c738-4e79-9aeb-12e87e29f568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0478a2ae-a4')
May 21 02:04:59.951834 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-d18ad4ea-5dd1-40c9-8e16-3ed573811040 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Deleting instance files /opt/stack/data/nova/instances/d35a1f35-4fdd-4efa-a753-7aa8d1a205a8_del
May 21 02:04:59.952576 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-d18ad4ea-5dd1-40c9-8e16-3ed573811040 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Deletion of /opt/stack/data/nova/instances/d35a1f35-4fdd-4efa-a753-7aa8d1a205a8_del complete
May 21 02:04:59.979217 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:00.001195 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999713358999998 future=<Future at 0x71c098308230 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:05:00.007584 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:00.410091 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:04:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1807531643',display_name='tempest-TestVolumeBootPattern-server-1807531643',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpattern-server-1807531643',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62ebdb16aee84e22a88dfc8960debd32',ramdisk_id='',reservation_id='r-3on5qtnk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1995806391',owner_user_name='tempest-TestVolumeBootPattern-1995806391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:04:45Z,user_data=None,user_id='4878b5a5bf184852a9ce383caa1c67a4',uuid=4a71f98e-0988-46c9-9b04-f8d0197468b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2673164e-2ce7-4dde-8022-0b0e54feb214", "address": "fa:16:3e:50:31:dd", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2673164e-2c", "ovs_interfaceid": "2673164e-2ce7-4dde-8022-0b0e54feb214", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:05:00.410563 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converting VIF {"id": "2673164e-2ce7-4dde-8022-0b0e54feb214", "address": "fa:16:3e:50:31:dd", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2673164e-2c", "ovs_interfaceid": "2673164e-2ce7-4dde-8022-0b0e54feb214", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:05:00.410894 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:31:dd,bridge_name='br-int',has_traffic_filtering=True,id=2673164e-2ce7-4dde-8022-0b0e54feb214,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2673164e-2c') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:05:00.411500 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a71f98e-0988-46c9-9b04-f8d0197468b9 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:05:00.412739 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9033988f-4e18-4335-8319-6a20af4f6561 tempest-ServersNegativeTestJSON-1944632598 tempest-ServersNegativeTestJSON-1944632598-project-member] [instance: 29a124ee-2b8c-4f44-8f91-8dd11ac78b52] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:00.415208 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: e95baab0-2c43-4653-b7ae-b9d8920aba33] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:00.459156 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-d18ad4ea-5dd1-40c9-8e16-3ed573811040 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Took 1.40 seconds to destroy the instance on the hypervisor.
May 21 02:05:00.459239 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-d18ad4ea-5dd1-40c9-8e16-3ed573811040 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:05:00.459532 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:05:00.459715 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:05:00.459948 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:00.479832 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-26786048-609a-47bc-82b6-93910a0b7d40 req-61ca32cb-b550-48e2-90c5-19a3cd48a06f service nova] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Received event network-vif-unplugged-0478a2ae-a44c-4e56-bac8-7434c0d3af2a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:00.481647 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-26786048-609a-47bc-82b6-93910a0b7d40 req-61ca32cb-b550-48e2-90c5-19a3cd48a06f service nova] Acquiring lock "d35a1f35-4fdd-4efa-a753-7aa8d1a205a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:00.481647 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-26786048-609a-47bc-82b6-93910a0b7d40 req-61ca32cb-b550-48e2-90c5-19a3cd48a06f service nova] Lock "d35a1f35-4fdd-4efa-a753-7aa8d1a205a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:00.481647 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-26786048-609a-47bc-82b6-93910a0b7d40 req-61ca32cb-b550-48e2-90c5-19a3cd48a06f service nova] Lock "d35a1f35-4fdd-4efa-a753-7aa8d1a205a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:00.481647 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-26786048-609a-47bc-82b6-93910a0b7d40 req-61ca32cb-b550-48e2-90c5-19a3cd48a06f service nova] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] No waiting events found dispatching network-vif-unplugged-0478a2ae-a44c-4e56-bac8-7434c0d3af2a {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:05:00.481647 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-26786048-609a-47bc-82b6-93910a0b7d40 req-61ca32cb-b550-48e2-90c5-19a3cd48a06f service nova] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Received event network-vif-unplugged-0478a2ae-a44c-4e56-bac8-7434c0d3af2a for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:05:00.481647 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-26786048-609a-47bc-82b6-93910a0b7d40 req-61ca32cb-b550-48e2-90c5-19a3cd48a06f service nova] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Received event network-vif-unplugged-0478a2ae-a44c-4e56-bac8-7434c0d3af2a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:00.481647 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-26786048-609a-47bc-82b6-93910a0b7d40 req-61ca32cb-b550-48e2-90c5-19a3cd48a06f service nova] Acquiring lock "d35a1f35-4fdd-4efa-a753-7aa8d1a205a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:00.481647 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-26786048-609a-47bc-82b6-93910a0b7d40 req-61ca32cb-b550-48e2-90c5-19a3cd48a06f service nova] Lock "d35a1f35-4fdd-4efa-a753-7aa8d1a205a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:00.481647 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-26786048-609a-47bc-82b6-93910a0b7d40 req-61ca32cb-b550-48e2-90c5-19a3cd48a06f service nova] Lock "d35a1f35-4fdd-4efa-a753-7aa8d1a205a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:00.481647 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-26786048-609a-47bc-82b6-93910a0b7d40 req-61ca32cb-b550-48e2-90c5-19a3cd48a06f service nova] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] No waiting events found dispatching network-vif-unplugged-0478a2ae-a44c-4e56-bac8-7434c0d3af2a {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:05:00.481647 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-26786048-609a-47bc-82b6-93910a0b7d40 req-61ca32cb-b550-48e2-90c5-19a3cd48a06f service nova] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Received event network-vif-unplugged-0478a2ae-a44c-4e56-bac8-7434c0d3af2a for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:05:00.577354 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:00.715577 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-81a903df-fd64-4fe4-9129-96c637f0f209 tempest-ServerRescueNegativeTestJSON-1108613901 tempest-ServerRescueNegativeTestJSON-1108613901-project-member] Lock "e158490e-746e-4c3b-924e-9aceed1662d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.066s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:00.864701 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:05:00.864863 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:05:00.865018 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] No VIF found with MAC fa:16:3e:93:f8:7e, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:05:00.865683 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Using config drive
May 21 02:05:00.915965 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] End _get_guest_xml xml=<domain type="qemu">
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:   <uuid>4a71f98e-0988-46c9-9b04-f8d0197468b9</uuid>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:   <name>instance-00000028</name>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:       <nova:name>tempest-TestVolumeBootPattern-server-1807531643</nova:name>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:04:47</nova:creationTime>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:       <nova:image uuid="">
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:         <nova:properties/>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:         <nova:user uuid="4878b5a5bf184852a9ce383caa1c67a4">tempest-TestVolumeBootPattern-1995806391-project-member</nova:user>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:         <nova:project uuid="62ebdb16aee84e22a88dfc8960debd32">tempest-TestVolumeBootPattern-1995806391</nova:project>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:       <nova:root type="volume" uuid=""/>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:         <nova:port uuid="2673164e-2ce7-4dde-8022-0b0e54feb214">
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:     <system>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:       <entry name="serial">4a71f98e-0988-46c9-9b04-f8d0197468b9</entry>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:       <entry name="uuid">4a71f98e-0988-46c9-9b04-f8d0197468b9</entry>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:     </system>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:   <os>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:   </os>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:   <features>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:   </features>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:   <devices>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/4a71f98e-0988-46c9-9b04-f8d0197468b9/disk.config"/>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:     </disk>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:       <alias name="ua-5b6917f9-697f-4cd6-97c4-318fb3116f5a"/>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-6"/>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:       <serial>5b6917f9-697f-4cd6-97c4-318fb3116f5a</serial>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:     </disk>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:50:31:dd"/>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:       <target dev="tap2673164e-2c"/>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:     </interface>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/4a71f98e-0988-46c9-9b04-f8d0197468b9/console.log" append="off"/>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:     </serial>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:     <video>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:     </video>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:     </rng>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:   </devices>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]: </domain>
May 21 02:05:00.915965 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:05:00.921232 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Preparing to wait for external event network-vif-plugged-2673164e-2ce7-4dde-8022-0b0e54feb214 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:05:00.921232 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "4a71f98e-0988-46c9-9b04-f8d0197468b9-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:00.921232 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "4a71f98e-0988-46c9-9b04-f8d0197468b9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:00.921232 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "4a71f98e-0988-46c9-9b04-f8d0197468b9-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:00.921232 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:04:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1807531643',display_name='tempest-TestVolumeBootPattern-server-1807531643',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpattern-server-1807531643',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62ebdb16aee84e22a88dfc8960debd32',ramdisk_id='',reservation_id='r-3on5qtnk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1995806391',owner_user_name='tempest-TestVolumeBootPattern-1995806391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:04:45Z,user_data=None,user_id='4878b5a5bf184852a9ce383caa1c67a4',uuid=4a71f98e-0988-46c9-9b04-f8d0197468b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2673164e-2ce7-4dde-8022-0b0e54feb214", "address": "fa:16:3e:50:31:dd", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2673164e-2c", "ovs_interfaceid": "2673164e-2ce7-4dde-8022-0b0e54feb214", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:05:00.921232 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converting VIF {"id": "2673164e-2ce7-4dde-8022-0b0e54feb214", "address": "fa:16:3e:50:31:dd", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2673164e-2c", "ovs_interfaceid": "2673164e-2ce7-4dde-8022-0b0e54feb214", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:05:00.921232 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:31:dd,bridge_name='br-int',has_traffic_filtering=True,id=2673164e-2ce7-4dde-8022-0b0e54feb214,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2673164e-2c') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:05:00.921232 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:31:dd,bridge_name='br-int',has_traffic_filtering=True,id=2673164e-2ce7-4dde-8022-0b0e54feb214,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2673164e-2c') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:05:00.921232 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:00.921232 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:00.921232 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:05:00.923967 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:00.923967 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3d2a3bed-8503-5b19-af73-4e908ea6ac0a', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:00.923967 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:00.923967 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:05:00.932972 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:00.935482 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:00.935736 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2673164e-2c, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:00.936266 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2673164e-2c, col_values=(('qos', UUID('f048cdca-e0f5-4695-a206-9018a1b18b9e')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:00.937530 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2673164e-2c, col_values=(('external_ids', {'iface-id': '2673164e-2ce7-4dde-8022-0b0e54feb214', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:31:dd', 'vm-uuid': '4a71f98e-0988-46c9-9b04-f8d0197468b9'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:00.941718 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:00.942540 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:05:00.954548 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:00.956053 np0000001127 nova-compute[98206]: INFO os_vif [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:31:dd,bridge_name='br-int',has_traffic_filtering=True,id=2673164e-2ce7-4dde-8022-0b0e54feb214,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2673164e-2c')
May 21 02:05:01.148888 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-22a3cf36-36ab-4e65-8481-d984f4adc240 req-3504a36a-e465-42ac-aafb-e095dffb3733 service nova] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Received event network-vif-deleted-0478a2ae-a44c-4e56-bac8-7434c0d3af2a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:01.149412 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-22a3cf36-36ab-4e65-8481-d984f4adc240 req-3504a36a-e465-42ac-aafb-e095dffb3733 service nova] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Neutron deleted interface 0478a2ae-a44c-4e56-bac8-7434c0d3af2a; detaching it from the instance and deleting it from the info cache
May 21 02:05:01.149412 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-22a3cf36-36ab-4e65-8481-d984f4adc240 req-3504a36a-e465-42ac-aafb-e095dffb3733 service nova] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:05:01.249513 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:01.373244 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:01.515126 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:01.530821 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Creating config drive at /opt/stack/data/nova/instances/fb553376-632d-46c3-99dd-4fbc6a27c1c2/disk.config
May 21 02:05:01.534763 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fb553376-632d-46c3-99dd-4fbc6a27c1c2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpypumb_94 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:01.578617 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:05:01.610760 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fb553376-632d-46c3-99dd-4fbc6a27c1c2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpypumb_94" returned: 0 in 0.076s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:05:01.655893 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-22a3cf36-36ab-4e65-8481-d984f4adc240 req-3504a36a-e465-42ac-aafb-e095dffb3733 service nova] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Detach interface failed, port_id=0478a2ae-a44c-4e56-bac8-7434c0d3af2a, reason: Instance d35a1f35-4fdd-4efa-a753-7aa8d1a205a8 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:05:02.085506 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Took 1.62 seconds to deallocate network for instance.
May 21 02:05:02.167795 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:02.200436 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:02.306422 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:02.479638 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:05:02.479806 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:05:02.479969 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] No VIF found with MAC fa:16:3e:50:31:dd, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:05:02.480492 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Using config drive
May 21 02:05:02.537487 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:02.544022 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:02.548790 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:02.571115 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:02.574003 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e804d1ff-5fc9-4f88-8ae4-f07795a3dbc2 req-395ad605-8dd2-4bdf-b0a9-ef3fe8833998 service nova] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Received event network-vif-plugged-dc7ed06f-f8e7-4e18-8207-748cbf553e58 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:02.574247 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e804d1ff-5fc9-4f88-8ae4-f07795a3dbc2 req-395ad605-8dd2-4bdf-b0a9-ef3fe8833998 service nova] Acquiring lock "fb553376-632d-46c3-99dd-4fbc6a27c1c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:02.574487 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e804d1ff-5fc9-4f88-8ae4-f07795a3dbc2 req-395ad605-8dd2-4bdf-b0a9-ef3fe8833998 service nova] Lock "fb553376-632d-46c3-99dd-4fbc6a27c1c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:02.574659 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e804d1ff-5fc9-4f88-8ae4-f07795a3dbc2 req-395ad605-8dd2-4bdf-b0a9-ef3fe8833998 service nova] Lock "fb553376-632d-46c3-99dd-4fbc6a27c1c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:02.574819 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e804d1ff-5fc9-4f88-8ae4-f07795a3dbc2 req-395ad605-8dd2-4bdf-b0a9-ef3fe8833998 service nova] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Processing event network-vif-plugged-dc7ed06f-f8e7-4e18-8207-748cbf553e58 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:05:02.579413 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:02.593026 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d18ad4ea-5dd1-40c9-8e16-3ed573811040 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:02.593026 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d18ad4ea-5dd1-40c9-8e16-3ed573811040 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:02.987170 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:03.015956 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d18ad4ea-5dd1-40c9-8e16-3ed573811040 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:05:03.016284 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-d18ad4ea-5dd1-40c9-8e16-3ed573811040 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:05:03.131848 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Creating config drive at /opt/stack/data/nova/instances/4a71f98e-0988-46c9-9b04-f8d0197468b9/disk.config
May 21 02:05:03.135654 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4a71f98e-0988-46c9-9b04-f8d0197468b9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzdgu6yac {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:03.227845 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4a71f98e-0988-46c9-9b04-f8d0197468b9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzdgu6yac" returned: 0 in 0.092s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:05:03.251992 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:05:03.253448 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329103.2529278, fb553376-632d-46c3-99dd-4fbc6a27c1c2 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:05:03.253875 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] VM Started (Lifecycle Event)
May 21 02:05:03.258559 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:05:03.266356 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Instance spawned successfully.
May 21 02:05:03.268693 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:05:03.336077 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:03.522992 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-d18ad4ea-5dd1-40c9-8e16-3ed573811040 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:05:03.760494 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:03.770651 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:05:03.773429 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:03.783587 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:03.787565 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:03.787565 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:03.787565 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:03.787565 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:03.787565 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:03.811081 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:03.948283 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:04.041217 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d18ad4ea-5dd1-40c9-8e16-3ed573811040 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.448s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:04.161275 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-d18ad4ea-5dd1-40c9-8e16-3ed573811040 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Deleted allocations for instance d35a1f35-4fdd-4efa-a753-7aa8d1a205a8
May 21 02:05:04.274336 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:05:04.274943 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329104.2746503, fb553376-632d-46c3-99dd-4fbc6a27c1c2 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:05:04.275655 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] VM Paused (Lifecycle Event)
May 21 02:05:04.291082 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:04.300933 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Took 8.68 seconds to spawn the instance on the hypervisor.
May 21 02:05:04.301412 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:04.303056 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:04.306039 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:04.326733 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:04.679956 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7cb7dbac-2985-4fb6-954b-d5adcc8a06b3 req-904f5498-589f-4807-9eee-a9ff2afcac43 service nova] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Received event network-vif-plugged-dc7ed06f-f8e7-4e18-8207-748cbf553e58 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:04.686199 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7cb7dbac-2985-4fb6-954b-d5adcc8a06b3 req-904f5498-589f-4807-9eee-a9ff2afcac43 service nova] Acquiring lock "fb553376-632d-46c3-99dd-4fbc6a27c1c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:04.686610 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7cb7dbac-2985-4fb6-954b-d5adcc8a06b3 req-904f5498-589f-4807-9eee-a9ff2afcac43 service nova] Lock "fb553376-632d-46c3-99dd-4fbc6a27c1c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:04.686676 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7cb7dbac-2985-4fb6-954b-d5adcc8a06b3 req-904f5498-589f-4807-9eee-a9ff2afcac43 service nova] Lock "fb553376-632d-46c3-99dd-4fbc6a27c1c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:04.686980 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7cb7dbac-2985-4fb6-954b-d5adcc8a06b3 req-904f5498-589f-4807-9eee-a9ff2afcac43 service nova] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] No waiting events found dispatching network-vif-plugged-dc7ed06f-f8e7-4e18-8207-748cbf553e58 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:05:04.690717 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-7cb7dbac-2985-4fb6-954b-d5adcc8a06b3 req-904f5498-589f-4807-9eee-a9ff2afcac43 service nova] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Received unexpected event network-vif-plugged-dc7ed06f-f8e7-4e18-8207-748cbf553e58 for instance with vm_state active and task_state None.
May 21 02:05:04.690717 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7cb7dbac-2985-4fb6-954b-d5adcc8a06b3 req-904f5498-589f-4807-9eee-a9ff2afcac43 service nova] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Received event network-vif-plugged-2673164e-2ce7-4dde-8022-0b0e54feb214 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:04.690717 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7cb7dbac-2985-4fb6-954b-d5adcc8a06b3 req-904f5498-589f-4807-9eee-a9ff2afcac43 service nova] Acquiring lock "4a71f98e-0988-46c9-9b04-f8d0197468b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:04.690949 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7cb7dbac-2985-4fb6-954b-d5adcc8a06b3 req-904f5498-589f-4807-9eee-a9ff2afcac43 service nova] Lock "4a71f98e-0988-46c9-9b04-f8d0197468b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:04.691116 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7cb7dbac-2985-4fb6-954b-d5adcc8a06b3 req-904f5498-589f-4807-9eee-a9ff2afcac43 service nova] Lock "4a71f98e-0988-46c9-9b04-f8d0197468b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:04.691270 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7cb7dbac-2985-4fb6-954b-d5adcc8a06b3 req-904f5498-589f-4807-9eee-a9ff2afcac43 service nova] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Processing event network-vif-plugged-2673164e-2ce7-4dde-8022-0b0e54feb214 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:05:04.691921 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7cb7dbac-2985-4fb6-954b-d5adcc8a06b3 req-904f5498-589f-4807-9eee-a9ff2afcac43 service nova] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Received event network-vif-plugged-2673164e-2ce7-4dde-8022-0b0e54feb214 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:04.691921 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7cb7dbac-2985-4fb6-954b-d5adcc8a06b3 req-904f5498-589f-4807-9eee-a9ff2afcac43 service nova] Acquiring lock "4a71f98e-0988-46c9-9b04-f8d0197468b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:04.691921 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7cb7dbac-2985-4fb6-954b-d5adcc8a06b3 req-904f5498-589f-4807-9eee-a9ff2afcac43 service nova] Lock "4a71f98e-0988-46c9-9b04-f8d0197468b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:04.691921 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7cb7dbac-2985-4fb6-954b-d5adcc8a06b3 req-904f5498-589f-4807-9eee-a9ff2afcac43 service nova] Lock "4a71f98e-0988-46c9-9b04-f8d0197468b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:04.692143 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7cb7dbac-2985-4fb6-954b-d5adcc8a06b3 req-904f5498-589f-4807-9eee-a9ff2afcac43 service nova] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] No waiting events found dispatching network-vif-plugged-2673164e-2ce7-4dde-8022-0b0e54feb214 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:05:04.692192 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-7cb7dbac-2985-4fb6-954b-d5adcc8a06b3 req-904f5498-589f-4807-9eee-a9ff2afcac43 service nova] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Received unexpected event network-vif-plugged-2673164e-2ce7-4dde-8022-0b0e54feb214 for instance with vm_state building and task_state spawning.
May 21 02:05:04.778566 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:04.783209 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329104.782887, fb553376-632d-46c3-99dd-4fbc6a27c1c2 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:05:04.783383 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] VM Resumed (Lifecycle Event)
May 21 02:05:04.824463 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Took 16.54 seconds to build instance.
May 21 02:05:05.035750 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:05:05.038007 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:05:05.040713 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Instance spawned successfully.
May 21 02:05:05.041243 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:05:05.178020 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d18ad4ea-5dd1-40c9-8e16-3ed573811040 tempest-TestEncryptedCinderVolumes-991116896 tempest-TestEncryptedCinderVolumes-991116896-project-member] Lock "d35a1f35-4fdd-4efa-a753-7aa8d1a205a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.626s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:05.190780 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.48 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:05:05.229774 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "0b9a1a2a-77bd-4fe9-ae88-344c193980f5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:05.229924 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "0b9a1a2a-77bd-4fe9-ae88-344c193980f5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:05.286429 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:05.288557 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:05:05.328970 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Lock "fb553376-632d-46c3-99dd-4fbc6a27c1c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.049s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:05.531561 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Acquiring lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:05.531561 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:05.531561 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Acquiring lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:05.531561 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:05.531561 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:05.536437 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Terminating instance
May 21 02:05:05.551072 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:05.551256 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:05.551612 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:05.551880 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:05.552185 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:05.552683 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:05.731705 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:05:05.790744 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329105.7904377, 4a71f98e-0988-46c9-9b04-f8d0197468b9 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:05:05.791179 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] VM Started (Lifecycle Event)
May 21 02:05:05.941355 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:06.039654 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:05:06.057960 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Took 18.36 seconds to spawn the instance on the hypervisor.
May 21 02:05:06.058143 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:06.069757 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:06.074966 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:06.088243 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:06.097682 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:06.127717 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:06.294969 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:06.299209 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:06.299396 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:06.303277 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:05:06.303544 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Claim successful on node np0000001127
May 21 02:05:06.306834 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:05:06.391725 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Instance destroyed successfully.
May 21 02:05:06.393146 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lazy-loading 'resources' on Instance uuid 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:05:06.527155 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:06.572594 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Took 28.14 seconds to build instance.
May 21 02:05:06.752849 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-09198063-2e1f-49fe-a1ef-84e4251778c9 req-386b43e8-4613-48f1-a390-56ca74476cad service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Received event network-changed-01b64dbf-89aa-471a-a2df-58edb2a7a254 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:06.752849 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-09198063-2e1f-49fe-a1ef-84e4251778c9 req-386b43e8-4613-48f1-a390-56ca74476cad service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Refreshing instance network info cache due to event network-changed-01b64dbf-89aa-471a-a2df-58edb2a7a254. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:05:06.752849 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-09198063-2e1f-49fe-a1ef-84e4251778c9 req-386b43e8-4613-48f1-a390-56ca74476cad service nova] Acquiring lock "refresh_cache-2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:05:06.755765 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-09198063-2e1f-49fe-a1ef-84e4251778c9 req-386b43e8-4613-48f1-a390-56ca74476cad service nova] Acquired lock "refresh_cache-2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:05:06.755888 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-09198063-2e1f-49fe-a1ef-84e4251778c9 req-386b43e8-4613-48f1-a390-56ca74476cad service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Refreshing network info cache for port 01b64dbf-89aa-471a-a2df-58edb2a7a254 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:05:06.810776 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329106.8104384, 4a71f98e-0988-46c9-9b04-f8d0197468b9 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:05:06.811304 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] VM Paused (Lifecycle Event)
May 21 02:05:06.895212 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-21T02:02:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2112280893',display_name='tempest-TestShelveInstance-server-2112280893',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testshelveinstance-server-2112280893',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKg59I6WmGN0vl+Yr0jgT9PuUDGWUY6yf9vpZilx62JeV2qSOqh9YtAt/kfJ2GJwnEwbhZeLHjGZ5bn7cuWJBoTGUXrOx2rpzPhSzUdpCOkXSzB0vlWvtf/xO7vuSD50lg==',key_name='tempest-TestShelveInstance-1094914629',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:04:26Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db73ea4d098a4b768f0b51d6cbe9eda8',ramdisk_id='',reservation_id='r-icby8s1w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1611299604',owner_user_name='tempest-TestShelveInstance-1611299604-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:04:27Z,user_data=None,user_id='1ebeaddb48014da28103c3479e9b250b',uuid=2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "address": "fa:16:3e:ed:a6:59", "network": {"id": "56a7d47c-c10f-4969-a14d-a81a8b4f0e1c", "bridge": "br-int", "label": "tempest-TestShelveInstance-781032295-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db73ea4d098a4b768f0b51d6cbe9eda8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b64dbf-89", "ovs_interfaceid": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:05:06.895447 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Converting VIF {"id": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "address": "fa:16:3e:ed:a6:59", "network": {"id": "56a7d47c-c10f-4969-a14d-a81a8b4f0e1c", "bridge": "br-int", "label": "tempest-TestShelveInstance-781032295-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db73ea4d098a4b768f0b51d6cbe9eda8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b64dbf-89", "ovs_interfaceid": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:05:06.895992 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a6:59,bridge_name='br-int',has_traffic_filtering=True,id=01b64dbf-89aa-471a-a2df-58edb2a7a254,network=Network(56a7d47c-c10f-4969-a14d-a81a8b4f0e1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b64dbf-89') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:05:06.896249 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a6:59,bridge_name='br-int',has_traffic_filtering=True,id=01b64dbf-89aa-471a-a2df-58edb2a7a254,network=Network(56a7d47c-c10f-4969-a14d-a81a8b4f0e1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b64dbf-89') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:05:06.898174 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:06.898406 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01b64dbf-89, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:06.902335 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:06.904116 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:05:06.905831 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:06.905911 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f56be2e4-8a13-402f-8cb7-8d06031168da) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:06.906551 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:06.908719 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:05:06.910487 np0000001127 nova-compute[98206]: INFO os_vif [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a6:59,bridge_name='br-int',has_traffic_filtering=True,id=01b64dbf-89aa-471a-a2df-58edb2a7a254,network=Network(56a7d47c-c10f-4969-a14d-a81a8b4f0e1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b64dbf-89')
May 21 02:05:06.911777 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:05:06.912184 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c67c8aea-4ddd-455a-ae1e-631955ce95da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:05:06.912331 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:05:06.912776 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:05:06.913085 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c67c8aea-4ddd-455a-ae1e-631955ce95da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:05:06.913216 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:05:06.942243 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:05:06.942243 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:05:06.942243 np0000001127 nova-compute[98206]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:06.942243 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:06.942243 np0000001127 nova-compute[98206]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a (non-flash)
May 21 02:05:06.942243 np0000001127 nova-compute[98206]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a (non-flash)
May 21 02:05:06.942243 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:05:06.942497 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsi session list stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:05:06.942497 np0000001127 nova-compute[98206]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da (non-flash)
May 21 02:05:06.942497 np0000001127 nova-compute[98206]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:06.942497 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:06.942497 np0000001127 nova-compute[98206]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a (non-flash)
May 21 02:05:06.942497 np0000001127 nova-compute[98206]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a (non-flash)
May 21 02:05:06.942497 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:05:06.942497 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', '86'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', '87'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c', '88'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c', '89'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a', '92'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a', '93')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:05:06.942687 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', '86')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:05:06.943363 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da', '87')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:05:06.944077 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c098406f20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da'): ({'sdg'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:05:06.944258 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Removing multipathed devices sdg, sdf {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:05:06.944450 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Flush multipath device 330000000b2501f6d {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:05:07.000806 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:05:07.059200 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:05:07.076384 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4a98f7ff-e5e5-47f4-9485-bdd6ff634a4b tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "4a71f98e-0988-46c9-9b04-f8d0197468b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.651s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:07.113900 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:05:07.114097 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:05:07.115316 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:05:07.130807 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:05:07.131251 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:05:07.147076 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:07.177456 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7be1952b-88b0-426b-bff5-98a13f9c6179 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Acquiring lock "fb553376-632d-46c3-99dd-4fbc6a27c1c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:07.177646 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7be1952b-88b0-426b-bff5-98a13f9c6179 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Lock "fb553376-632d-46c3-99dd-4fbc6a27c1c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:07.177917 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7be1952b-88b0-426b-bff5-98a13f9c6179 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Acquiring lock "fb553376-632d-46c3-99dd-4fbc6a27c1c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:07.178078 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7be1952b-88b0-426b-bff5-98a13f9c6179 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Lock "fb553376-632d-46c3-99dd-4fbc6a27c1c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:07.178078 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7be1952b-88b0-426b-bff5-98a13f9c6179 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Lock "fb553376-632d-46c3-99dd-4fbc6a27c1c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:07.180825 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-7be1952b-88b0-426b-bff5-98a13f9c6179 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Terminating instance
May 21 02:05:07.190661 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 86, target: iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da, portal: 192.168.40.100,3260]
May 21 02:05:07.190661 np0000001127 nova-compute[98206]: Logout of [sid: 86, target: iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da, portal: 192.168.40.100,3260] successful.
May 21 02:05:07.190661 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:07.209572 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:07.223324 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:07.252754 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 87, target: iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da, portal: 192.168.50.100,3260]
May 21 02:05:07.252754 np0000001127 nova-compute[98206]: Logout of [sid: 87, target: iqn.2023-03.storpool.com:os--volume-c67c8aea-4ddd-455a-ae1e-631955ce95da, portal: 192.168.50.100,3260] successful.
May 21 02:05:07.252754 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:07.265052 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-09198063-2e1f-49fe-a1ef-84e4251778c9 req-386b43e8-4613-48f1-a390-56ca74476cad service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:07.275236 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:07.276948 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:05:07.277186 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] <== disconnect_volume: return (364ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:05:07.277304 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:05:07.277576 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Deleting instance files /opt/stack/data/nova/instances/2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61_del
May 21 02:05:07.278148 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Deletion of /opt/stack/data/nova/instances/2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61_del complete
May 21 02:05:07.315420 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:07.317886 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329107.3175516, 4a71f98e-0988-46c9-9b04-f8d0197468b9 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:05:07.318043 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] VM Resumed (Lifecycle Event)
May 21 02:05:07.684988 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7be1952b-88b0-426b-bff5-98a13f9c6179 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:05:07.694356 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-09198063-2e1f-49fe-a1ef-84e4251778c9 req-386b43e8-4613-48f1-a390-56ca74476cad service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:07.705640 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:07.709691 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:07.734438 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:07.737143 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:07.766272 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:07.796376 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Took 1.76 seconds to destroy the instance on the hypervisor.
May 21 02:05:07.801988 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:05:07.801988 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:05:07.801988 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:05:07.801988 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:07.802308 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:05:07.802666 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:05:07.820899 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:07.830182 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:05:07.954571 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:08.021975 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-09198063-2e1f-49fe-a1ef-84e4251778c9 req-386b43e8-4613-48f1-a390-56ca74476cad service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Updated VIF entry in instance network info cache for port 01b64dbf-89aa-471a-a2df-58edb2a7a254. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:05:08.023538 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-09198063-2e1f-49fe-a1ef-84e4251778c9 req-386b43e8-4613-48f1-a390-56ca74476cad service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Updating instance_info_cache with network_info: [{"id": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "address": "fa:16:3e:ed:a6:59", "network": {"id": "56a7d47c-c10f-4969-a14d-a81a8b4f0e1c", "bridge": "br-int", "label": "tempest-TestShelveInstance-781032295-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db73ea4d098a4b768f0b51d6cbe9eda8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b64dbf-89", "ovs_interfaceid": "01b64dbf-89aa-471a-a2df-58edb2a7a254", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:05:08.048771 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Instance destroyed successfully.
May 21 02:05:08.049499 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-7be1952b-88b0-426b-bff5-98a13f9c6179 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Lazy-loading 'resources' on Instance uuid fb553376-632d-46c3-99dd-4fbc6a27c1c2 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:05:08.294004 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:08.309125 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:05:08.327546 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "4a71f98e-0988-46c9-9b04-f8d0197468b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:08.327834 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "4a71f98e-0988-46c9-9b04-f8d0197468b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:08.329876 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "4a71f98e-0988-46c9-9b04-f8d0197468b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:08.329876 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "4a71f98e-0988-46c9-9b04-f8d0197468b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:08.329876 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "4a71f98e-0988-46c9-9b04-f8d0197468b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:08.333838 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Terminating instance
May 21 02:05:08.337213 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] During sync_power_state the instance has a pending task (deleting). Skip.
May 21 02:05:08.337677 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999749865000013 future=<Future at 0x71c058649160 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:05:08.338119 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999826147000022 future=<Future at 0x71c0983bcfb0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:05:08.524812 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-09198063-2e1f-49fe-a1ef-84e4251778c9 req-386b43e8-4613-48f1-a390-56ca74476cad service nova] Releasing lock "refresh_cache-2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:05:08.551986 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-7be1952b-88b0-426b-bff5-98a13f9c6179 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:04:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1589960385',display_name='tempest-VolumesActionsTest-instance-1589960385',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumesactionstest-instance-1589960385',id=41,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:05:04Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e8db1d8006574d1e9f7117042461bce4',ramdisk_id='',reservation_id='r-e0tgy6d6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1094570120',owner_user_name='tempest-VolumesActionsTest-1094570120-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:05:04Z,user_data=None,user_id='67349a30ec514c90a316eb35d579b04b',uuid=fb553376-632d-46c3-99dd-4fbc6a27c1c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc7ed06f-f8e7-4e18-8207-748cbf553e58", "address": "fa:16:3e:93:f8:7e", "network": {"id": "efb73811-c979-4f83-9b27-67a93594f8c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-674032884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8db1d8006574d1e9f7117042461bce4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc7ed06f-f8", "ovs_interfaceid": "dc7ed06f-f8e7-4e18-8207-748cbf553e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:05:08.552204 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-7be1952b-88b0-426b-bff5-98a13f9c6179 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Converting VIF {"id": "dc7ed06f-f8e7-4e18-8207-748cbf553e58", "address": "fa:16:3e:93:f8:7e", "network": {"id": "efb73811-c979-4f83-9b27-67a93594f8c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-674032884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8db1d8006574d1e9f7117042461bce4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc7ed06f-f8", "ovs_interfaceid": "dc7ed06f-f8e7-4e18-8207-748cbf553e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:05:08.552827 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-7be1952b-88b0-426b-bff5-98a13f9c6179 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:f8:7e,bridge_name='br-int',has_traffic_filtering=True,id=dc7ed06f-f8e7-4e18-8207-748cbf553e58,network=Network(efb73811-c979-4f83-9b27-67a93594f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc7ed06f-f8') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:05:08.553085 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-7be1952b-88b0-426b-bff5-98a13f9c6179 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:f8:7e,bridge_name='br-int',has_traffic_filtering=True,id=dc7ed06f-f8e7-4e18-8207-748cbf553e58,network=Network(efb73811-c979-4f83-9b27-67a93594f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc7ed06f-f8') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:05:08.553975 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:08.554173 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc7ed06f-f8, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:08.555256 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:08.556172 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:05:08.556870 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:08.557736 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:08.557900 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=095471f1-f978-4487-b4b2-bb5d17c5412d) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:08.558290 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:08.558759 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:05:08.559268 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:08.560807 np0000001127 nova-compute[98206]: INFO os_vif [None req-7be1952b-88b0-426b-bff5-98a13f9c6179 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:f8:7e,bridge_name='br-int',has_traffic_filtering=True,id=dc7ed06f-f8e7-4e18-8207-748cbf553e58,network=Network(efb73811-c979-4f83-9b27-67a93594f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc7ed06f-f8')
May 21 02:05:08.561104 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-7be1952b-88b0-426b-bff5-98a13f9c6179 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Deleting instance files /opt/stack/data/nova/instances/fb553376-632d-46c3-99dd-4fbc6a27c1c2_del
May 21 02:05:08.565086 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-7be1952b-88b0-426b-bff5-98a13f9c6179 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Deletion of /opt/stack/data/nova/instances/fb553376-632d-46c3-99dd-4fbc6a27c1c2_del complete
May 21 02:05:08.642129 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.00038679899989801925 future=<Future at 0x71c05824dac0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:05:08.642536 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Emitting event <LifecycleEvent: 1779329093.641633, e158490e-746e-4c3b-924e-9aceed1662d0 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:05:08.642625 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:05:08.642812 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] VM Stopped (Lifecycle Event)
May 21 02:05:08.643832 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=2.2446576249999453 future=<Future at 0x71c058461a00 state=cancelled>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:05:08.644486 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=2.2439851680001084 future=<Future at 0x71c058461a00 state=cancelled>) was cancelled while queued, skipping {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:05:08.644575 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:05:08.644656 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=6.356117723999887 future=<Future at 0x71c098308230 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:05:08.644749 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=6.356030662000194 future=<Future at 0x71c098308230 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:05:08.815301 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.516s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:08.815777 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:05:08.849934 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:05:08.866925 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1693cf22-5309-4d0f-97c2-6f4e5f21e624 req-cafc33ff-6dd7-4628-861e-37a7ef3ffbbb service nova] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Received event network-vif-unplugged-dc7ed06f-f8e7-4e18-8207-748cbf553e58 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:08.869338 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1693cf22-5309-4d0f-97c2-6f4e5f21e624 req-cafc33ff-6dd7-4628-861e-37a7ef3ffbbb service nova] Acquiring lock "fb553376-632d-46c3-99dd-4fbc6a27c1c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:08.869617 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1693cf22-5309-4d0f-97c2-6f4e5f21e624 req-cafc33ff-6dd7-4628-861e-37a7ef3ffbbb service nova] Lock "fb553376-632d-46c3-99dd-4fbc6a27c1c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:08.871012 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1693cf22-5309-4d0f-97c2-6f4e5f21e624 req-cafc33ff-6dd7-4628-861e-37a7ef3ffbbb service nova] Lock "fb553376-632d-46c3-99dd-4fbc6a27c1c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:08.871259 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1693cf22-5309-4d0f-97c2-6f4e5f21e624 req-cafc33ff-6dd7-4628-861e-37a7ef3ffbbb service nova] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] No waiting events found dispatching network-vif-unplugged-dc7ed06f-f8e7-4e18-8207-748cbf553e58 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:05:08.871432 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1693cf22-5309-4d0f-97c2-6f4e5f21e624 req-cafc33ff-6dd7-4628-861e-37a7ef3ffbbb service nova] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Received event network-vif-unplugged-dc7ed06f-f8e7-4e18-8207-748cbf553e58 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:05:08.871617 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1693cf22-5309-4d0f-97c2-6f4e5f21e624 req-cafc33ff-6dd7-4628-861e-37a7ef3ffbbb service nova] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Received event network-vif-unplugged-dc7ed06f-f8e7-4e18-8207-748cbf553e58 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:08.871789 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1693cf22-5309-4d0f-97c2-6f4e5f21e624 req-cafc33ff-6dd7-4628-861e-37a7ef3ffbbb service nova] Acquiring lock "fb553376-632d-46c3-99dd-4fbc6a27c1c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:08.871978 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1693cf22-5309-4d0f-97c2-6f4e5f21e624 req-cafc33ff-6dd7-4628-861e-37a7ef3ffbbb service nova] Lock "fb553376-632d-46c3-99dd-4fbc6a27c1c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:08.872371 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1693cf22-5309-4d0f-97c2-6f4e5f21e624 req-cafc33ff-6dd7-4628-861e-37a7ef3ffbbb service nova] Lock "fb553376-632d-46c3-99dd-4fbc6a27c1c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:08.872572 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1693cf22-5309-4d0f-97c2-6f4e5f21e624 req-cafc33ff-6dd7-4628-861e-37a7ef3ffbbb service nova] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] No waiting events found dispatching network-vif-unplugged-dc7ed06f-f8e7-4e18-8207-748cbf553e58 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:05:08.872712 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1693cf22-5309-4d0f-97c2-6f4e5f21e624 req-cafc33ff-6dd7-4628-861e-37a7ef3ffbbb service nova] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Received event network-vif-unplugged-dc7ed06f-f8e7-4e18-8207-748cbf553e58 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:05:08.872877 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1693cf22-5309-4d0f-97c2-6f4e5f21e624 req-cafc33ff-6dd7-4628-861e-37a7ef3ffbbb service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Received event network-vif-deleted-01b64dbf-89aa-471a-a2df-58edb2a7a254 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:08.873040 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-1693cf22-5309-4d0f-97c2-6f4e5f21e624 req-cafc33ff-6dd7-4628-861e-37a7ef3ffbbb service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Neutron deleted interface 01b64dbf-89aa-471a-a2df-58edb2a7a254; detaching it from the instance and deleting it from the info cache
May 21 02:05:08.873185 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-1693cf22-5309-4d0f-97c2-6f4e5f21e624 req-cafc33ff-6dd7-4628-861e-37a7ef3ffbbb service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:05:08.884106 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:08.889675 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:08.890094 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:05:08.908324 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:08.913041 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:08.935680 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:08.939684 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:09.073617 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-7be1952b-88b0-426b-bff5-98a13f9c6179 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Took 1.39 seconds to destroy the instance on the hypervisor.
May 21 02:05:09.074176 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-7be1952b-88b0-426b-bff5-98a13f9c6179 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:05:09.074481 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:05:09.074593 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:05:09.074829 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:09.145445 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: e158490e-746e-4c3b-924e-9aceed1662d0] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:09.174611 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:09.207379 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.99971096499985 future=<Future at 0x71c0586a8a70 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:05:09.209994 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Instance destroyed successfully.
May 21 02:05:09.210970 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lazy-loading 'resources' on Instance uuid 4a71f98e-0988-46c9-9b04-f8d0197468b9 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:05:09.297436 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:09.323418 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:05:09.323740 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:05:09.324118 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:09.324447 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:09.388417 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1693cf22-5309-4d0f-97c2-6f4e5f21e624 req-cafc33ff-6dd7-4628-861e-37a7ef3ffbbb service nova] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Detach interface failed, port_id=01b64dbf-89aa-471a-a2df-58edb2a7a254, reason: Instance 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:05:09.395063 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Took 1.60 seconds to deallocate network for instance.
May 21 02:05:09.603068 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f369771db7dd49da85131c9692833a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3efe4046d6a442d91b3463e2d99fd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:05:09.679660 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:09.713295 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:04:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1807531643',display_name='tempest-TestVolumeBootPattern-server-1807531643',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpattern-server-1807531643',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:05:06Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62ebdb16aee84e22a88dfc8960debd32',ramdisk_id='',reservation_id='r-3on5qtnk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestVolumeBootPattern-1995806391',owner_user_name='tempest-TestVolumeBootPattern-1995806391-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:05:06Z,user_data=None,user_id='4878b5a5bf184852a9ce383caa1c67a4',uuid=4a71f98e-0988-46c9-9b04-f8d0197468b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2673164e-2ce7-4dde-8022-0b0e54feb214", "address": "fa:16:3e:50:31:dd", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2673164e-2c", "ovs_interfaceid": "2673164e-2ce7-4dde-8022-0b0e54feb214", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:05:09.713918 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converting VIF {"id": "2673164e-2ce7-4dde-8022-0b0e54feb214", "address": "fa:16:3e:50:31:dd", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2673164e-2c", "ovs_interfaceid": "2673164e-2ce7-4dde-8022-0b0e54feb214", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:05:09.714458 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:31:dd,bridge_name='br-int',has_traffic_filtering=True,id=2673164e-2ce7-4dde-8022-0b0e54feb214,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2673164e-2c') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:05:09.714791 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:31:dd,bridge_name='br-int',has_traffic_filtering=True,id=2673164e-2ce7-4dde-8022-0b0e54feb214,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2673164e-2c') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:05:09.715858 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:09.716159 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2673164e-2c, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:09.718566 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:09.719776 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:05:09.719776 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:09.719921 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:09.720063 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f048cdca-e0f5-4695-a206-9018a1b18b9e) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:09.720533 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:09.721574 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:05:09.725498 np0000001127 nova-compute[98206]: INFO os_vif [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:31:dd,bridge_name='br-int',has_traffic_filtering=True,id=2673164e-2ce7-4dde-8022-0b0e54feb214,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2673164e-2c')
May 21 02:05:09.767068 np0000001127 nova-compute[98206]: DEBUG os_brick.encryptors [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a', 'iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b6917f9-697f-4cd6-97c4-318fb3116f5a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, 'status': 'reserved', 'instance': '4a71f98e-0988-46c9-9b04-f8d0197468b9', 'attached_at': '', 'detached_at': '', 'volume_id': '5b6917f9-697f-4cd6-97c4-318fb3116f5a', 'serial': '5b6917f9-697f-4cd6-97c4-318fb3116f5a'} {{(pid=98206) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 21 02:05:09.767724 np0000001127 nova-compute[98206]: WARNING stevedore.named [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 21 02:05:09.768049 np0000001127 nova-compute[98206]: WARNING castellan.key_manager [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 21 02:05:09.768154 np0000001127 nova-compute[98206]: WARNING nova.keymgr.conf_key_mgr [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 21 02:05:09.768658 np0000001127 nova-compute[98206]: DEBUG os_brick.encryptors [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x71c0584dcef0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a', 'iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b6917f9-697f-4cd6-97c4-318fb3116f5a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, 'status': 'reserved', 'instance': '4a71f98e-0988-46c9-9b04-f8d0197468b9', 'attached_at': '', 'detached_at': '', 'volume_id': '5b6917f9-697f-4cd6-97c4-318fb3116f5a', 'serial': '5b6917f9-697f-4cd6-97c4-318fb3116f5a'} {{(pid=98206) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 21 02:05:09.768795 np0000001127 nova-compute[98206]: DEBUG os_brick.encryptors.luks [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] closing encrypted volume /dev/dm-0 {{(pid=98206) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:207}}
May 21 02:05:09.803646 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:05:09.804052 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a', 'iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b6917f9-697f-4cd6-97c4-318fb3116f5a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:05:09.804625 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:05:09.805421 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:05:09.805835 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a', 'iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b6917f9-697f-4cd6-97c4-318fb3116f5a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:05:09.805980 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:05:09.827497 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:05:09.835934 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:09.835934 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:09.835934 np0000001127 nova-compute[98206]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a (non-flash)
May 21 02:05:09.835934 np0000001127 nova-compute[98206]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a (non-flash)
May 21 02:05:09.835934 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:05:09.837221 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:09.837221 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:09.837221 np0000001127 nova-compute[98206]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a (non-flash)
May 21 02:05:09.837221 np0000001127 nova-compute[98206]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a (non-flash)
May 21 02:05:09.837221 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:05:09.837451 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c', '88'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c', '89'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a', '92'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a', '93')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:05:09.838297 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a', '92')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:05:09.840197 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a', '93')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:05:09.842238 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c5442c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a'): ({'sdi'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:05:09.842488 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Removing multipathed devices sdi, sdh {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:05:09.842810 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Flush multipath device 330000000b6e9b9d2 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:05:09.890588 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:05:09.944676 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:05:09.968049 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Took 0.57 seconds to detach 1 volumes for instance.
May 21 02:05:09.970443 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Deleting volume: c67c8aea-4ddd-455a-ae1e-631955ce95da {{(pid=98206) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 21 02:05:10.002536 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:05:10.007913 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:05:10.012159 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f9f4221a-75f4-41c1-90af-9db2ec23e76e req-8b6d4123-4809-4df3-baa2-0bc9cff4588b service nova] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Received event network-vif-deleted-dc7ed06f-f8e7-4e18-8207-748cbf553e58 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:10.013088 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-f9f4221a-75f4-41c1-90af-9db2ec23e76e req-8b6d4123-4809-4df3-baa2-0bc9cff4588b service nova] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Neutron deleted interface dc7ed06f-f8e7-4e18-8207-748cbf553e58; detaching it from the instance and deleting it from the info cache
May 21 02:05:10.013265 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-f9f4221a-75f4-41c1-90af-9db2ec23e76e req-8b6d4123-4809-4df3-baa2-0bc9cff4588b service nova] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:05:10.015423 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:05:10.029242 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:05:10.029481 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:05:10.045269 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:10.088044 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 92, target: iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a, portal: 192.168.40.100,3260]
May 21 02:05:10.088044 np0000001127 nova-compute[98206]: Logout of [sid: 92, target: iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a, portal: 192.168.40.100,3260] successful.
May 21 02:05:10.088044 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:10.106419 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:10.125338 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:10.155239 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 93, target: iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a, portal: 192.168.50.100,3260]
May 21 02:05:10.155239 np0000001127 nova-compute[98206]: Logout of [sid: 93, target: iqn.2023-03.storpool.com:os--volume-5b6917f9-697f-4cd6-97c4-318fb3116f5a, portal: 192.168.50.100,3260] successful.
May 21 02:05:10.155239 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:10.168297 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:10.174377 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:05:10.174377 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] <== disconnect_volume: return (366ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:05:10.174377 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:05:10.174377 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Deleting instance files /opt/stack/data/nova/instances/4a71f98e-0988-46c9-9b04-f8d0197468b9_del
May 21 02:05:10.174377 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Deletion of /opt/stack/data/nova/instances/4a71f98e-0988-46c9-9b04-f8d0197468b9_del complete
May 21 02:05:10.334169 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:05:10.430230 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:05:10.517814 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f9f4221a-75f4-41c1-90af-9db2ec23e76e req-8b6d4123-4809-4df3-baa2-0bc9cff4588b service nova] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Detach interface failed, port_id=dc7ed06f-f8e7-4e18-8207-748cbf553e58, reason: Instance fb553376-632d-46c3-99dd-4fbc6a27c1c2 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:05:10.529529 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:10.529725 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:10.671062 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Successfully created port: c34ad5a3-ad20-4671-ab11-bf70edb362b5 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:05:10.684495 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Took 1.83 seconds to destroy the instance on the hypervisor.
May 21 02:05:10.686540 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:05:10.688211 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:05:10.688211 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:05:10.688211 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:10.933784 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Took 1.86 seconds to deallocate network for instance.
May 21 02:05:10.977524 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e29e53c9-fa1f-4982-a8eb-d96632dadb30 req-457b1f51-3aec-4225-8a39-2dffa10070e4 service nova] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Received event network-vif-unplugged-2673164e-2ce7-4dde-8022-0b0e54feb214 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:10.977797 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e29e53c9-fa1f-4982-a8eb-d96632dadb30 req-457b1f51-3aec-4225-8a39-2dffa10070e4 service nova] Acquiring lock "4a71f98e-0988-46c9-9b04-f8d0197468b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:10.977898 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e29e53c9-fa1f-4982-a8eb-d96632dadb30 req-457b1f51-3aec-4225-8a39-2dffa10070e4 service nova] Lock "4a71f98e-0988-46c9-9b04-f8d0197468b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:10.982426 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e29e53c9-fa1f-4982-a8eb-d96632dadb30 req-457b1f51-3aec-4225-8a39-2dffa10070e4 service nova] Lock "4a71f98e-0988-46c9-9b04-f8d0197468b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:10.982426 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e29e53c9-fa1f-4982-a8eb-d96632dadb30 req-457b1f51-3aec-4225-8a39-2dffa10070e4 service nova] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] No waiting events found dispatching network-vif-unplugged-2673164e-2ce7-4dde-8022-0b0e54feb214 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:05:10.982426 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e29e53c9-fa1f-4982-a8eb-d96632dadb30 req-457b1f51-3aec-4225-8a39-2dffa10070e4 service nova] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Received event network-vif-unplugged-2673164e-2ce7-4dde-8022-0b0e54feb214 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:05:10.982426 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e29e53c9-fa1f-4982-a8eb-d96632dadb30 req-457b1f51-3aec-4225-8a39-2dffa10070e4 service nova] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Received event network-vif-unplugged-2673164e-2ce7-4dde-8022-0b0e54feb214 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:10.982426 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e29e53c9-fa1f-4982-a8eb-d96632dadb30 req-457b1f51-3aec-4225-8a39-2dffa10070e4 service nova] Acquiring lock "4a71f98e-0988-46c9-9b04-f8d0197468b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:10.982426 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e29e53c9-fa1f-4982-a8eb-d96632dadb30 req-457b1f51-3aec-4225-8a39-2dffa10070e4 service nova] Lock "4a71f98e-0988-46c9-9b04-f8d0197468b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:10.982426 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e29e53c9-fa1f-4982-a8eb-d96632dadb30 req-457b1f51-3aec-4225-8a39-2dffa10070e4 service nova] Lock "4a71f98e-0988-46c9-9b04-f8d0197468b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:10.982426 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e29e53c9-fa1f-4982-a8eb-d96632dadb30 req-457b1f51-3aec-4225-8a39-2dffa10070e4 service nova] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] No waiting events found dispatching network-vif-unplugged-2673164e-2ce7-4dde-8022-0b0e54feb214 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:05:10.982426 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e29e53c9-fa1f-4982-a8eb-d96632dadb30 req-457b1f51-3aec-4225-8a39-2dffa10070e4 service nova] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Received event network-vif-unplugged-2673164e-2ce7-4dde-8022-0b0e54feb214 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:05:11.018713 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:11.051345 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:05:11.051562 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:05:11.244554 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:11.344611 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:05:11.345845 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:05:11.346145 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Creating image(s)
May 21 02:05:11.347942 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "/opt/stack/data/nova/instances/0b9a1a2a-77bd-4fe9-ae88-344c193980f5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:11.348870 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "/opt/stack/data/nova/instances/0b9a1a2a-77bd-4fe9-ae88-344c193980f5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:11.349786 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "/opt/stack/data/nova/instances/0b9a1a2a-77bd-4fe9-ae88-344c193980f5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:11.361665 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Successfully updated port: c34ad5a3-ad20-4671-ab11-bf70edb362b5 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:05:11.367918 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:05:11.370114 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:05:11.376495 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:11.442442 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7be1952b-88b0-426b-bff5-98a13f9c6179 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:11.488657 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.115s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:05:11.492490 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:11.492490 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:11.492490 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:05:11.496305 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:05:11.498734 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:11.530829 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:11.559405 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:05:11.621879 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.123s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:05:11.624326 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/0b9a1a2a-77bd-4fe9-ae88-344c193980f5/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:11.690079 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/0b9a1a2a-77bd-4fe9-ae88-344c193980f5/disk 1073741824" returned: 0 in 0.065s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:05:11.690667 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:11.691008 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:11.792510 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.101s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:05:11.793337 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0b9a1a2a-77bd-4fe9-ae88-344c193980f5/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:05:11.793337 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9a1a2a-77bd-4fe9-ae88-344c193980f5/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:11.866513 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "refresh_cache-0b9a1a2a-77bd-4fe9-ae88-344c193980f5" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:05:11.866637 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquired lock "refresh_cache-0b9a1a2a-77bd-4fe9-ae88-344c193980f5" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:05:11.866848 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:05:11.905426 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9a1a2a-77bd-4fe9-ae88-344c193980f5/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:05:11.905882 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Cannot resize image /opt/stack/data/nova/instances/0b9a1a2a-77bd-4fe9-ae88-344c193980f5/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:05:11.906528 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:05:11.906760 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Ensure instance console log exists: /opt/stack/data/nova/instances/0b9a1a2a-77bd-4fe9-ae88-344c193980f5/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:05:11.907130 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:11.907338 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:11.907552 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:12.072723 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.543s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:12.080075 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7be1952b-88b0-426b-bff5-98a13f9c6179 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.638s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:12.093728 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d09159a4-1158-485d-ada4-4f6eeed1e8a5 req-4e2e1f8e-8466-4b79-8af4-3562ec94d68c service nova] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Received event network-changed-c34ad5a3-ad20-4671-ab11-bf70edb362b5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:12.093838 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d09159a4-1158-485d-ada4-4f6eeed1e8a5 req-4e2e1f8e-8466-4b79-8af4-3562ec94d68c service nova] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Refreshing instance network info cache due to event network-changed-c34ad5a3-ad20-4671-ab11-bf70edb362b5. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:05:12.094565 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d09159a4-1158-485d-ada4-4f6eeed1e8a5 req-4e2e1f8e-8466-4b79-8af4-3562ec94d68c service nova] Acquiring lock "refresh_cache-0b9a1a2a-77bd-4fe9-ae88-344c193980f5" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:05:12.094565 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:05:12.165142 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Deleted allocations for instance 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61
May 21 02:05:12.229372 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:12.462760 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7be1952b-88b0-426b-bff5-98a13f9c6179 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:05:12.462957 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-7be1952b-88b0-426b-bff5-98a13f9c6179 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:05:12.479204 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:05:12.599366 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Took 1.91 seconds to deallocate network for instance.
May 21 02:05:12.685658 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:12.830292 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Updating instance_info_cache with network_info: [{"id": "c34ad5a3-ad20-4671-ab11-bf70edb362b5", "address": "fa:16:3e:e1:2e:46", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34ad5a3-ad", "ovs_interfaceid": "c34ad5a3-ad20-4671-ab11-bf70edb362b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:05:12.970769 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-7be1952b-88b0-426b-bff5-98a13f9c6179 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:05:13.028579 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:13.046861 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-08c9e65a-e037-47a8-894a-b78b4fbf6635 req-00d38951-074d-4f6d-a566-d47b5fcadba9 service nova] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Received event network-vif-deleted-2673164e-2ce7-4dde-8022-0b0e54feb214 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:13.176612 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-eed61c0c-e644-4d32-a028-df11e5c01d12 tempest-TestShelveInstance-1611299604 tempest-TestShelveInstance-1611299604-project-member] Lock "2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.646s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:13.191532 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Took 0.59 seconds to detach 1 volumes for instance.
May 21 02:05:13.332283 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Releasing lock "refresh_cache-0b9a1a2a-77bd-4fe9-ae88-344c193980f5" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:05:13.332657 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Instance network_info: |[{"id": "c34ad5a3-ad20-4671-ab11-bf70edb362b5", "address": "fa:16:3e:e1:2e:46", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34ad5a3-ad", "ovs_interfaceid": "c34ad5a3-ad20-4671-ab11-bf70edb362b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:05:13.334090 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d09159a4-1158-485d-ada4-4f6eeed1e8a5 req-4e2e1f8e-8466-4b79-8af4-3562ec94d68c service nova] Acquired lock "refresh_cache-0b9a1a2a-77bd-4fe9-ae88-344c193980f5" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:05:13.334090 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-d09159a4-1158-485d-ada4-4f6eeed1e8a5 req-4e2e1f8e-8466-4b79-8af4-3562ec94d68c service nova] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Refreshing network info cache for port c34ad5a3-ad20-4671-ab11-bf70edb362b5 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:05:13.338167 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Start _get_guest_xml network_info=[{"id": "c34ad5a3-ad20-4671-ab11-bf70edb362b5", "address": "fa:16:3e:e1:2e:46", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34ad5a3-ad", "ovs_interfaceid": "c34ad5a3-ad20-4671-ab11-bf70edb362b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:05:13.343791 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:05:13.344351 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-1516566059', uuid='0b9a1a2a-77bd-4fe9-ae88-344c193980f5'), owner=OwnerMeta(userid='f369771db7dd49da85131c9692833a5a', username='tempest-AttachVolumeNegativeTest-1208856611-project-member', projectid='d3efe4046d6a442d91b3463e2d99fd7b', projectname='tempest-AttachVolumeNegativeTest-1208856611'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c34ad5a3-ad20-4671-ab11-bf70edb362b5", "address": "fa:16:3e:e1:2e:46", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34ad5a3-ad", "ovs_interfaceid": "c34ad5a3-ad20-4671-ab11-bf70edb362b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329113.3438928) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:05:13.347550 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:05:13.348118 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:05:13.350169 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:05:13.350849 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:05:13.352953 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:05:13.353422 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:05:13.353946 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:05:13.354166 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:05:13.354836 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:05:13.355074 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:05:13.355312 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:05:13.355929 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:05:13.355929 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:05:13.355929 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:05:13.358033 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:05:13.358033 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:05:13.380380 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:05:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1516566059',display_name='tempest-AttachVolumeNegativeTest-server-1516566059',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumenegativetest-server-1516566059',id=42,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK60GwDzIWkkLsJ3BBXNMI8CjzqiSj2NaE3M377DqyweY8FpCw055CJ+9EjHyXCTQvIxN/w3rXX8eyWN7cnTjBVAJJaVTKSXeH/bg36hBixhd3F+0sX73uTOui3mQrmYYA==',key_name='tempest-keypair-1478153749',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3efe4046d6a442d91b3463e2d99fd7b',ramdisk_id='',reservation_id='r-a3830dnq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1208856611',owner_user_name='tempest-AttachVolumeNegativeTest-1208856611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:05:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f369771db7dd49da85131c9692833a5a',uuid=0b9a1a2a-77bd-4fe9-ae88-344c193980f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c34ad5a3-ad20-4671-ab11-bf70edb362b5", "address": "fa:16:3e:e1:2e:46", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34ad5a3-ad", "ovs_interfaceid": "c34ad5a3-ad20-4671-ab11-bf70edb362b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:05:13.380380 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Converting VIF {"id": "c34ad5a3-ad20-4671-ab11-bf70edb362b5", "address": "fa:16:3e:e1:2e:46", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34ad5a3-ad", "ovs_interfaceid": "c34ad5a3-ad20-4671-ab11-bf70edb362b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:05:13.380380 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:2e:46,bridge_name='br-int',has_traffic_filtering=True,id=c34ad5a3-ad20-4671-ab11-bf70edb362b5,network=Network(f683b2da-ab41-43e1-a9bb-98914089b4d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc34ad5a3-ad') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:05:13.381449 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b9a1a2a-77bd-4fe9-ae88-344c193980f5 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:05:13.477751 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7be1952b-88b0-426b-bff5-98a13f9c6179 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.398s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:13.542144 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-7be1952b-88b0-426b-bff5-98a13f9c6179 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Deleted allocations for instance fb553376-632d-46c3-99dd-4fbc6a27c1c2
May 21 02:05:13.697009 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:13.697260 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:13.836499 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-d09159a4-1158-485d-ada4-4f6eeed1e8a5 req-4e2e1f8e-8466-4b79-8af4-3562ec94d68c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:13.885385 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] End _get_guest_xml xml=<domain type="qemu">
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:   <uuid>0b9a1a2a-77bd-4fe9-ae88-344c193980f5</uuid>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:   <name>instance-0000002a</name>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1516566059</nova:name>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:05:13</nova:creationTime>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:         <nova:user uuid="f369771db7dd49da85131c9692833a5a">tempest-AttachVolumeNegativeTest-1208856611-project-member</nova:user>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:         <nova:project uuid="d3efe4046d6a442d91b3463e2d99fd7b">tempest-AttachVolumeNegativeTest-1208856611</nova:project>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:         <nova:port uuid="c34ad5a3-ad20-4671-ab11-bf70edb362b5">
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:     <system>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:       <entry name="serial">0b9a1a2a-77bd-4fe9-ae88-344c193980f5</entry>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:       <entry name="uuid">0b9a1a2a-77bd-4fe9-ae88-344c193980f5</entry>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:     </system>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:   <os>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:   </os>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:   <features>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:   </features>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:   <devices>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/0b9a1a2a-77bd-4fe9-ae88-344c193980f5/disk"/>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:     </disk>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/0b9a1a2a-77bd-4fe9-ae88-344c193980f5/disk.config"/>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:     </disk>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:e1:2e:46"/>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:       <target dev="tapc34ad5a3-ad"/>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:     </interface>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/0b9a1a2a-77bd-4fe9-ae88-344c193980f5/console.log" append="off"/>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:     </serial>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:     <video>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:     </video>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:     </rng>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:   </devices>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]: </domain>
May 21 02:05:13.885385 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:05:13.887229 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Preparing to wait for external event network-vif-plugged-c34ad5a3-ad20-4671-ab11-bf70edb362b5 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:05:13.887229 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "0b9a1a2a-77bd-4fe9-ae88-344c193980f5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:13.887229 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "0b9a1a2a-77bd-4fe9-ae88-344c193980f5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:13.887229 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "0b9a1a2a-77bd-4fe9-ae88-344c193980f5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:13.887229 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:05:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1516566059',display_name='tempest-AttachVolumeNegativeTest-server-1516566059',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumenegativetest-server-1516566059',id=42,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK60GwDzIWkkLsJ3BBXNMI8CjzqiSj2NaE3M377DqyweY8FpCw055CJ+9EjHyXCTQvIxN/w3rXX8eyWN7cnTjBVAJJaVTKSXeH/bg36hBixhd3F+0sX73uTOui3mQrmYYA==',key_name='tempest-keypair-1478153749',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3efe4046d6a442d91b3463e2d99fd7b',ramdisk_id='',reservation_id='r-a3830dnq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1208856611',owner_user_name='tempest-AttachVolumeNegativeTest-1208856611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:05:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f369771db7dd49da85131c9692833a5a',uuid=0b9a1a2a-77bd-4fe9-ae88-344c193980f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c34ad5a3-ad20-4671-ab11-bf70edb362b5", "address": "fa:16:3e:e1:2e:46", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34ad5a3-ad", "ovs_interfaceid": "c34ad5a3-ad20-4671-ab11-bf70edb362b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:05:13.887229 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Converting VIF {"id": "c34ad5a3-ad20-4671-ab11-bf70edb362b5", "address": "fa:16:3e:e1:2e:46", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34ad5a3-ad", "ovs_interfaceid": "c34ad5a3-ad20-4671-ab11-bf70edb362b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:05:13.887515 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:2e:46,bridge_name='br-int',has_traffic_filtering=True,id=c34ad5a3-ad20-4671-ab11-bf70edb362b5,network=Network(f683b2da-ab41-43e1-a9bb-98914089b4d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc34ad5a3-ad') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:05:13.888038 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:2e:46,bridge_name='br-int',has_traffic_filtering=True,id=c34ad5a3-ad20-4671-ab11-bf70edb362b5,network=Network(f683b2da-ab41-43e1-a9bb-98914089b4d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc34ad5a3-ad') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:05:13.888038 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:13.888443 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:13.888642 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:05:13.889162 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:13.889323 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6850375e-8ba9-50f9-a696-e07bebb0640f', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:13.891571 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:05:13.894324 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:13.894500 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc34ad5a3-ad, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:13.894804 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc34ad5a3-ad, col_values=(('qos', UUID('23e433c0-6afd-4e13-a4c9-8a8a1e957bca')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:13.895066 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc34ad5a3-ad, col_values=(('external_ids', {'iface-id': 'c34ad5a3-ad20-4671-ab11-bf70edb362b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:2e:46', 'vm-uuid': '0b9a1a2a-77bd-4fe9-ae88-344c193980f5'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:13.897430 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:05:13.902486 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:13.903832 np0000001127 nova-compute[98206]: INFO os_vif [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:2e:46,bridge_name='br-int',has_traffic_filtering=True,id=c34ad5a3-ad20-4671-ab11-bf70edb362b5,network=Network(f683b2da-ab41-43e1-a9bb-98914089b4d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc34ad5a3-ad')
May 21 02:05:14.038397 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:05:14.038846 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:05:14.185145 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-d09159a4-1158-485d-ada4-4f6eeed1e8a5 req-4e2e1f8e-8466-4b79-8af4-3562ec94d68c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:14.327298 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-d09159a4-1158-485d-ada4-4f6eeed1e8a5 req-4e2e1f8e-8466-4b79-8af4-3562ec94d68c service nova] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Updated VIF entry in instance network info cache for port c34ad5a3-ad20-4671-ab11-bf70edb362b5. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:05:14.327595 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-d09159a4-1158-485d-ada4-4f6eeed1e8a5 req-4e2e1f8e-8466-4b79-8af4-3562ec94d68c service nova] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Updating instance_info_cache with network_info: [{"id": "c34ad5a3-ad20-4671-ab11-bf70edb362b5", "address": "fa:16:3e:e1:2e:46", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34ad5a3-ad", "ovs_interfaceid": "c34ad5a3-ad20-4671-ab11-bf70edb362b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:05:14.541225 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:05:14.554741 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7be1952b-88b0-426b-bff5-98a13f9c6179 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Lock "fb553376-632d-46c3-99dd-4fbc6a27c1c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.377s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:14.790821 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "6ccaedfe-bec9-4591-b845-acf0cc81d026" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:14.791074 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "6ccaedfe-bec9-4591-b845-acf0cc81d026" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:14.829435 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d09159a4-1158-485d-ada4-4f6eeed1e8a5 req-4e2e1f8e-8466-4b79-8af4-3562ec94d68c service nova] Releasing lock "refresh_cache-0b9a1a2a-77bd-4fe9-ae88-344c193980f5" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:05:15.001227 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.00040496299970982363 future=<Future at 0x71c098308230 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:05:15.001970 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Emitting event <LifecycleEvent: 1779329100.000715, d35a1f35-4fdd-4efa-a753-7aa8d1a205a8 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:05:15.002624 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:05:15.002846 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] VM Stopped (Lifecycle Event)
May 21 02:05:15.005180 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=8.332254614000249 future=<Future at 0x71c058649160 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:05:15.006232 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=8.33118549100027 future=<Future at 0x71c058649160 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:05:15.049685 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.352s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:15.133621 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Deleted allocations for instance 4a71f98e-0988-46c9-9b04-f8d0197468b9
May 21 02:05:15.294252 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:05:15.433812 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:05:15.433812 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:05:15.433812 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] No VIF found with MAC fa:16:3e:e1:2e:46, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:05:15.434136 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Using config drive
May 21 02:05:15.507387 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: d35a1f35-4fdd-4efa-a753-7aa8d1a205a8] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:15.846951 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:15.860498 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:15.860701 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:15.864010 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:05:15.864199 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Claim successful on node np0000001127
May 21 02:05:15.940640 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:16.009711 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:16.145272 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-11aab1a1-3c7a-4a71-8958-15bea962d4d7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "4a71f98e-0988-46c9-9b04-f8d0197468b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.817s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:16.219423 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Creating config drive at /opt/stack/data/nova/instances/0b9a1a2a-77bd-4fe9-ae88-344c193980f5/disk.config
May 21 02:05:16.227348 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0b9a1a2a-77bd-4fe9-ae88-344c193980f5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzb_658rq {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:16.261711 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Acquiring lock "dc3e1d06-6926-4fd2-b5c2-5d6104ba6826" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:16.262191 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Lock "dc3e1d06-6926-4fd2-b5c2-5d6104ba6826" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:16.304361 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0b9a1a2a-77bd-4fe9-ae88-344c193980f5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzb_658rq" returned: 0 in 0.078s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:05:16.532251 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:16.769117 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:05:16.793092 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:16.820951 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:16.822148 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:16.927744 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:17.073739 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:17.186518 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-603463a6-d78e-43e8-8355-dcb5274c0415 req-be7ca69c-180c-42a3-927a-0976d3e291dc service nova] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Received event network-vif-plugged-c34ad5a3-ad20-4671-ab11-bf70edb362b5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:17.186598 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-603463a6-d78e-43e8-8355-dcb5274c0415 req-be7ca69c-180c-42a3-927a-0976d3e291dc service nova] Acquiring lock "0b9a1a2a-77bd-4fe9-ae88-344c193980f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:17.186746 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-603463a6-d78e-43e8-8355-dcb5274c0415 req-be7ca69c-180c-42a3-927a-0976d3e291dc service nova] Lock "0b9a1a2a-77bd-4fe9-ae88-344c193980f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:17.186910 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-603463a6-d78e-43e8-8355-dcb5274c0415 req-be7ca69c-180c-42a3-927a-0976d3e291dc service nova] Lock "0b9a1a2a-77bd-4fe9-ae88-344c193980f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:17.187030 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-603463a6-d78e-43e8-8355-dcb5274c0415 req-be7ca69c-180c-42a3-927a-0976d3e291dc service nova] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Processing event network-vif-plugged-c34ad5a3-ad20-4671-ab11-bf70edb362b5 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:05:17.198014 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:17.208370 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:17.232504 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:17.257283 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:05:17.257547 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:05:17.346972 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:17.760281 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:05:17.774116 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:05:17.774980 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329117.7744975, 0b9a1a2a-77bd-4fe9-ae88-344c193980f5 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:05:17.775161 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] VM Started (Lifecycle Event)
May 21 02:05:17.779138 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:05:17.785190 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Instance spawned successfully.
May 21 02:05:17.785953 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:05:18.267825 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.407s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:18.268661 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.922s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:18.268985 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:05:18.274150 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:05:18.274627 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Claim successful on node np0000001127
May 21 02:05:18.281753 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:18.287319 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:05:18.296034 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:18.296336 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:18.296900 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:18.297339 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:18.297833 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:18.298281 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:18.470185 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:18.774315 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:05:18.775538 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:05:18.775538 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:18.775538 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:18.793127 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:05:18.793454 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329118.7932122, 0b9a1a2a-77bd-4fe9-ae88-344c193980f5 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:05:18.793652 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] VM Paused (Lifecycle Event)
May 21 02:05:18.804552 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Took 7.46 seconds to spawn the instance on the hypervisor.
May 21 02:05:18.804749 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:18.869639 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '049d6c8cccfa4ae38d78a88ef5be0f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848912b0c0e94d2795bb2332daf1730e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:05:18.908820 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:19.271091 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-261384df-6baa-410a-97c9-f87b1295bb82 req-81bf9834-293c-41cc-a2cb-99dea7277596 service nova] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Received event network-vif-plugged-c34ad5a3-ad20-4671-ab11-bf70edb362b5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:19.271091 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-261384df-6baa-410a-97c9-f87b1295bb82 req-81bf9834-293c-41cc-a2cb-99dea7277596 service nova] Acquiring lock "0b9a1a2a-77bd-4fe9-ae88-344c193980f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:19.271091 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-261384df-6baa-410a-97c9-f87b1295bb82 req-81bf9834-293c-41cc-a2cb-99dea7277596 service nova] Lock "0b9a1a2a-77bd-4fe9-ae88-344c193980f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:19.271341 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-261384df-6baa-410a-97c9-f87b1295bb82 req-81bf9834-293c-41cc-a2cb-99dea7277596 service nova] Lock "0b9a1a2a-77bd-4fe9-ae88-344c193980f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:19.271399 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-261384df-6baa-410a-97c9-f87b1295bb82 req-81bf9834-293c-41cc-a2cb-99dea7277596 service nova] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] No waiting events found dispatching network-vif-plugged-c34ad5a3-ad20-4671-ab11-bf70edb362b5 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:05:19.271855 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-261384df-6baa-410a-97c9-f87b1295bb82 req-81bf9834-293c-41cc-a2cb-99dea7277596 service nova] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Received unexpected event network-vif-plugged-c34ad5a3-ad20-4671-ab11-bf70edb362b5 for instance with vm_state active and task_state None.
May 21 02:05:19.278253 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:05:19.298705 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:19.308859 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329119.3082023, 0b9a1a2a-77bd-4fe9-ae88-344c193980f5 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:05:19.308859 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] VM Resumed (Lifecycle Event)
May 21 02:05:19.318733 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Took 13.08 seconds to build instance.
May 21 02:05:19.425580 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Successfully created port: 595ed872-c1da-4406-aeb4-a249c8ebbe07 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:05:19.626927 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:05:19.627785 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:05:19.731814 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:19.782106 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:05:19.816409 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:19.820522 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:05:19.822657 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3bea9c6f-81a7-4939-a46e-4e4e6bf786b4 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "0b9a1a2a-77bd-4fe9-ae88-344c193980f5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.591s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:19.991177 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Successfully updated port: 595ed872-c1da-4406-aeb4-a249c8ebbe07 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:05:20.055992 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d4e8013f-aa5a-4902-bf30-df7a6a3609ef req-0146efe4-41ad-44bd-873f-90f51fc779cf service nova] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Received event network-changed-595ed872-c1da-4406-aeb4-a249c8ebbe07 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:20.056176 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d4e8013f-aa5a-4902-bf30-df7a6a3609ef req-0146efe4-41ad-44bd-873f-90f51fc779cf service nova] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Refreshing instance network info cache due to event network-changed-595ed872-c1da-4406-aeb4-a249c8ebbe07. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:05:20.056411 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d4e8013f-aa5a-4902-bf30-df7a6a3609ef req-0146efe4-41ad-44bd-873f-90f51fc779cf service nova] Acquiring lock "refresh_cache-6ccaedfe-bec9-4591-b845-acf0cc81d026" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:05:20.056837 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d4e8013f-aa5a-4902-bf30-df7a6a3609ef req-0146efe4-41ad-44bd-873f-90f51fc779cf service nova] Acquired lock "refresh_cache-6ccaedfe-bec9-4591-b845-acf0cc81d026" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:05:20.058350 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-d4e8013f-aa5a-4902-bf30-df7a6a3609ef req-0146efe4-41ad-44bd-873f-90f51fc779cf service nova] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Refreshing network info cache for port 595ed872-c1da-4406-aeb4-a249c8ebbe07 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:05:20.129896 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:05:20.287304 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Booting with volume e8306ca8-501b-4d1b-bf8c-aa9548725dee at /dev/vda
May 21 02:05:20.335525 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:05:20.349544 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:05:20.373727 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:20.434586 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:05:20.436532 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:05:20.450523 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:05:20.453489 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:feca:ebaf', 'fe80::40b3:49ff:feb3:3b55', 'fe80::fc16:3eff:fe4b:b481', 'fe80::2844:63ff:fe5d:6c35', 'fe80::fc16:3eff:fee1:2e46', 'fe80::2482:bff:fe1b:902b'] 
May 21 02:05:20.453489 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:05:20.453489 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:05:20.453489 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:05:20.453489 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Updating existing volume attachment record: cc308969-7de8-4bdd-b28c-4a33e5c108c4 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:05:20.493931 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "refresh_cache-6ccaedfe-bec9-4591-b845-acf0cc81d026" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:05:20.564842 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-d4e8013f-aa5a-4902-bf30-df7a6a3609ef req-0146efe4-41ad-44bd-873f-90f51fc779cf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:20.637309 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.369s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:20.637844 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:05:20.651374 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-d4e8013f-aa5a-4902-bf30-df7a6a3609ef req-0146efe4-41ad-44bd-873f-90f51fc779cf service nova] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:05:20.685966 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-ff617c75-3111-4f84-9178-0eca0b684fb4 req-2d7ccecf-43cc-4411-b12b-2b30fa75ef96 service nova] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Received event network-changed-c34ad5a3-ad20-4671-ab11-bf70edb362b5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:20.686112 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-ff617c75-3111-4f84-9178-0eca0b684fb4 req-2d7ccecf-43cc-4411-b12b-2b30fa75ef96 service nova] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Refreshing instance network info cache due to event network-changed-c34ad5a3-ad20-4671-ab11-bf70edb362b5. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:05:20.686581 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ff617c75-3111-4f84-9178-0eca0b684fb4 req-2d7ccecf-43cc-4411-b12b-2b30fa75ef96 service nova] Acquiring lock "refresh_cache-0b9a1a2a-77bd-4fe9-ae88-344c193980f5" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:05:20.687138 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ff617c75-3111-4f84-9178-0eca0b684fb4 req-2d7ccecf-43cc-4411-b12b-2b30fa75ef96 service nova] Acquired lock "refresh_cache-0b9a1a2a-77bd-4fe9-ae88-344c193980f5" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:05:20.687264 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-ff617c75-3111-4f84-9178-0eca0b684fb4 req-2d7ccecf-43cc-4411-b12b-2b30fa75ef96 service nova] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Refreshing network info cache for port c34ad5a3-ad20-4671-ab11-bf70edb362b5 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:05:20.832862 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-d4e8013f-aa5a-4902-bf30-df7a6a3609ef req-0146efe4-41ad-44bd-873f-90f51fc779cf service nova] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:05:21.147031 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:05:21.148255 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:05:21.148255 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:21.148819 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:21.192339 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-ff617c75-3111-4f84-9178-0eca0b684fb4 req-2d7ccecf-43cc-4411-b12b-2b30fa75ef96 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:21.265780 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67349a30ec514c90a316eb35d579b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8db1d8006574d1e9f7117042461bce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:05:21.335038 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d4e8013f-aa5a-4902-bf30-df7a6a3609ef req-0146efe4-41ad-44bd-873f-90f51fc779cf service nova] Releasing lock "refresh_cache-6ccaedfe-bec9-4591-b845-acf0cc81d026" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:05:21.335864 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquired lock "refresh_cache-6ccaedfe-bec9-4591-b845-acf0cc81d026" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:05:21.336324 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:05:21.536755 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:21.647847 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:05:21.904001 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Successfully created port: 22f09be4-eadb-4267-b696-57e365542719 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:05:21.992255 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:05:22.064055 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "3e53c443-92d8-4e5c-bc47-43deb205786b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:22.064259 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "3e53c443-92d8-4e5c-bc47-43deb205786b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:22.150954 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:05:22.471856 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Successfully updated port: 22f09be4-eadb-4267-b696-57e365542719 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:05:22.532523 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-30eb7dc4-ad8f-4d38-a899-110c5dbf400b req-0d864fb4-dc6e-430d-865d-48e14d37282e service nova] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Received event network-changed-22f09be4-eadb-4267-b696-57e365542719 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:22.532585 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-30eb7dc4-ad8f-4d38-a899-110c5dbf400b req-0d864fb4-dc6e-430d-865d-48e14d37282e service nova] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Refreshing instance network info cache due to event network-changed-22f09be4-eadb-4267-b696-57e365542719. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:05:22.532703 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-30eb7dc4-ad8f-4d38-a899-110c5dbf400b req-0d864fb4-dc6e-430d-865d-48e14d37282e service nova] Acquiring lock "refresh_cache-dc3e1d06-6926-4fd2-b5c2-5d6104ba6826" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:05:22.532996 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-30eb7dc4-ad8f-4d38-a899-110c5dbf400b req-0d864fb4-dc6e-430d-865d-48e14d37282e service nova] Acquired lock "refresh_cache-dc3e1d06-6926-4fd2-b5c2-5d6104ba6826" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:05:22.533445 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-30eb7dc4-ad8f-4d38-a899-110c5dbf400b req-0d864fb4-dc6e-430d-865d-48e14d37282e service nova] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Refreshing network info cache for port 22f09be4-eadb-4267-b696-57e365542719 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:05:22.566553 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:05:22.573710 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:05:22.573985 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:05:22.574516 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Creating image(s)
May 21 02:05:22.574816 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Did not create local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 21 02:05:22.574984 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Ensure instance console log exists: /opt/stack/data/nova/instances/6ccaedfe-bec9-4591-b845-acf0cc81d026/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:05:22.577949 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:22.577949 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:22.577949 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:22.591137 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-ff617c75-3111-4f84-9178-0eca0b684fb4 req-2d7ccecf-43cc-4411-b12b-2b30fa75ef96 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:22.696097 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:22.782526 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-ff617c75-3111-4f84-9178-0eca0b684fb4 req-2d7ccecf-43cc-4411-b12b-2b30fa75ef96 service nova] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Updated VIF entry in instance network info cache for port c34ad5a3-ad20-4671-ab11-bf70edb362b5. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:05:22.782964 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-ff617c75-3111-4f84-9178-0eca0b684fb4 req-2d7ccecf-43cc-4411-b12b-2b30fa75ef96 service nova] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Updating instance_info_cache with network_info: [{"id": "c34ad5a3-ad20-4671-ab11-bf70edb362b5", "address": "fa:16:3e:e1:2e:46", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34ad5a3-ad", "ovs_interfaceid": "c34ad5a3-ad20-4671-ab11-bf70edb362b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:05:22.892379 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Updating instance_info_cache with network_info: [{"id": "595ed872-c1da-4406-aeb4-a249c8ebbe07", "address": "fa:16:3e:0f:28:a1", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap595ed872-c1", "ovs_interfaceid": "595ed872-c1da-4406-aeb4-a249c8ebbe07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:05:22.974067 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Acquiring lock "refresh_cache-dc3e1d06-6926-4fd2-b5c2-5d6104ba6826" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:05:23.039276 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-30eb7dc4-ad8f-4d38-a899-110c5dbf400b req-0d864fb4-dc6e-430d-865d-48e14d37282e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:23.138852 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-30eb7dc4-ad8f-4d38-a899-110c5dbf400b req-0d864fb4-dc6e-430d-865d-48e14d37282e service nova] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:05:23.160295 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:23.162457 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:05:23.163201 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:23.163631 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:05:23.164352 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Creating image(s)
May 21 02:05:23.165254 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Acquiring lock "/opt/stack/data/nova/instances/dc3e1d06-6926-4fd2-b5c2-5d6104ba6826/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:23.165369 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Lock "/opt/stack/data/nova/instances/dc3e1d06-6926-4fd2-b5c2-5d6104ba6826/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:23.166667 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Lock "/opt/stack/data/nova/instances/dc3e1d06-6926-4fd2-b5c2-5d6104ba6826/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:23.168085 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:05:23.171769 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:05:23.171865 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Claim successful on node np0000001127
May 21 02:05:23.188891 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:05:23.190990 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:23.285946 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ff617c75-3111-4f84-9178-0eca0b684fb4 req-2d7ccecf-43cc-4411-b12b-2b30fa75ef96 service nova] Releasing lock "refresh_cache-0b9a1a2a-77bd-4fe9-ae88-344c193980f5" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:05:23.313462 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.122s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:05:23.313462 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:23.313971 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:23.314762 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:05:23.315030 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:23.321503 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:05:23.321503 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:23.339123 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0015368419999504113 future=<Future at 0x71c058649160 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:05:23.339267 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:05:23.339556 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.001551579000079073 future=<Future at 0x71c0983bcfb0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:05:23.339822 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0018693479996727547 future=<Future at 0x71c0983bcfb0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:05:23.339918 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:05:23.340084 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=0.8669119589999355 future=<Future at 0x71c0586a8a70 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:05:23.340208 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=0.8667658570002459 future=<Future at 0x71c0586a8a70 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:05:23.341121 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Emitting event <LifecycleEvent: 1779329108.3373244, 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:05:23.341936 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Emitting event <LifecycleEvent: 1779329108.337887, fb553376-632d-46c3-99dd-4fbc6a27c1c2 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:05:23.342239 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] VM Stopped (Lifecycle Event)
May 21 02:05:23.346625 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] VM Stopped (Lifecycle Event)
May 21 02:05:23.358195 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-30eb7dc4-ad8f-4d38-a899-110c5dbf400b req-0d864fb4-dc6e-430d-865d-48e14d37282e service nova] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:05:23.396409 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Releasing lock "refresh_cache-6ccaedfe-bec9-4591-b845-acf0cc81d026" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:05:23.396409 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Instance network_info: |[{"id": "595ed872-c1da-4406-aeb4-a249c8ebbe07", "address": "fa:16:3e:0f:28:a1", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap595ed872-c1", "ovs_interfaceid": "595ed872-c1da-4406-aeb4-a249c8ebbe07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:05:23.396939 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Start _get_guest_xml network_info=[{"id": "595ed872-c1da-4406-aeb4-a249c8ebbe07", "address": "fa:16:3e:0f:28:a1", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap595ed872-c1", "ovs_interfaceid": "595ed872-c1da-4406-aeb4-a249c8ebbe07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e8306ca8-501b-4d1b-bf8c-aa9548725dee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '6ccaedfe-bec9-4591-b845-acf0cc81d026', 'attached_at': '', 'detached_at': '', 'volume_id': 'e8306ca8-501b-4d1b-bf8c-aa9548725dee', 'serial': 'e8306ca8-501b-4d1b-bf8c-aa9548725dee', 'multiattach': True}, 'delete_on_termination': False, 'attachment_id': 'cc308969-7de8-4bdd-b28c-4a33e5c108c4', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:05:23.400116 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:05:23.401240 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-1624830305', uuid='6ccaedfe-bec9-4591-b845-acf0cc81d026'), owner=OwnerMeta(userid='049d6c8cccfa4ae38d78a88ef5be0f1b', username='tempest-AttachVolumeMultiAttachTest-289054175-project-member', projectid='848912b0c0e94d2795bb2332daf1730e', projectname='tempest-AttachVolumeMultiAttachTest-289054175'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "595ed872-c1da-4406-aeb4-a249c8ebbe07", "address": "fa:16:3e:0f:28:a1", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap595ed872-c1", "ovs_interfaceid": "595ed872-c1da-4406-aeb4-a249c8ebbe07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329123.4009194) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:05:23.402221 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:05:23.402574 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:05:23.403381 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:05:23.403578 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:05:23.404393 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:05:23.404690 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:05:23.404821 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:05:23.404914 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:05:23.405024 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:05:23.405104 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:05:23.405196 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:05:23.405348 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:05:23.405603 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:05:23.405603 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:05:23.405698 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:05:23.406565 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:05:23.415850 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:05:23.416180 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e8306ca8-501b-4d1b-bf8c-aa9548725dee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:05:23.416305 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:05:23.417139 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:05:23.417139 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e8306ca8-501b-4d1b-bf8c-aa9548725dee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:05:23.429809 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:05:23.430497 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:05:23.431069 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:05:23.431333 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:05:23.432138 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:05:23.432990 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:05:23.433935 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.113s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:05:23.434079 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/dc3e1d06-6926-4fd2-b5c2-5d6104ba6826/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:23.457565 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:05:23.457565 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:23.460928 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:05:23.460928 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:23.471511 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee] added
May 21 02:05:23.471511 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:05:23.471511 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:05:23.471511 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:05:23.471511 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:05:23.471511 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:05:23.471511 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:23.471789 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:05:23.472239 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0407(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:05:23.472434 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:05:23.475230 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee] added
May 21 02:05:23.475230 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:05:23.475230 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:05:23.475230 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:05:23.475230 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:05:23.475230 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:05:23.475230 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:23.475555 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:05:23.477490 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0432(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:05:23.477490 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:05:23.501084 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/dc3e1d06-6926-4fd2-b5c2-5d6104ba6826/disk 1073741824" returned: 0 in 0.067s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:05:23.501527 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:23.501891 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:23.594288 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.092s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:05:23.595003 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dc3e1d06-6926-4fd2-b5c2-5d6104ba6826/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:05:23.595285 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3e1d06-6926-4fd2-b5c2-5d6104ba6826/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:23.689761 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3e1d06-6926-4fd2-b5c2-5d6104ba6826/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:05:23.690974 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Cannot resize image /opt/stack/data/nova/instances/dc3e1d06-6926-4fd2-b5c2-5d6104ba6826/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:05:23.691193 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:05:23.691444 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Ensure instance console log exists: /opt/stack/data/nova/instances/dc3e1d06-6926-4fd2-b5c2-5d6104ba6826/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:05:23.691847 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:23.692122 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:23.692308 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:23.849454 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-21c5b505-dacb-4b06-b22c-bc98a882bc43 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: 2ed0b26a-bcef-4a6a-8d5d-fed4b9956e61] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:23.866123 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: fb553376-632d-46c3-99dd-4fbc6a27c1c2] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:23.866933 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-30eb7dc4-ad8f-4d38-a899-110c5dbf400b req-0d864fb4-dc6e-430d-865d-48e14d37282e service nova] Releasing lock "refresh_cache-dc3e1d06-6926-4fd2-b5c2-5d6104ba6826" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:05:23.867357 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Acquired lock "refresh_cache-dc3e1d06-6926-4fd2-b5c2-5d6104ba6826" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:05:23.867852 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:05:23.910405 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:24.207595 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0005325289998836524 future=<Future at 0x71c0586a8a70 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:05:24.208350 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Emitting event <LifecycleEvent: 1779329109.2069113, 4a71f98e-0988-46c9-9b04-f8d0197468b9 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:05:24.208642 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:05:24.208990 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] VM Stopped (Lifecycle Event)
May 21 02:05:24.436250 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:24.473784 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:05:24.476588 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:05:24.492578 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:05:24.498069 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:05:24.498069 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:05:24.502511 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:05:24.502511 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:24.507699 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "f63a2253-071a-4a1a-94af-3544b20c39cf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:24.507699 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "f63a2253-071a-4a1a-94af-3544b20c39cf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:24.520538 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:24.522180 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:24.539976 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:24.539976 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:24.539976 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:05:24.540207 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:24.540207 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:24.540207 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:05:24.547941 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:24.547941 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:24.547941 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:05:24.548163 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:24.548163 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:24.548163 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:05:24.577805 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee, portal: 192.168.40.100,3260]
May 21 02:05:24.577805 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee, portal: 192.168.40.100,3260] successful.
May 21 02:05:24.577805 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:24.591176 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee, portal: 192.168.50.100,3260]
May 21 02:05:24.591176 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee, portal: 192.168.50.100,3260] successful.
May 21 02:05:24.591176 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:24.603940 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:24.606629 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:24.626497 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:24.626497 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:24.626497 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:24.626497 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:24.626497 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:05:24.626497 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:24.626497 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:24.626497 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:24.626497 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:24.626497 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:05:24.626497 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.193s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:05:24.626497 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:05:24.626497 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] HCTL ('7', '-', '-', 0) found on session 94 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:05:24.626497 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:05:24.630421 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:24.630421 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:24.630421 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:24.630421 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:24.630421 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:05:24.630646 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:24.630646 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:24.630646 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:24.630646 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:24.630646 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:05:24.630893 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.199s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:05:24.631026 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:05:24.631718 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] HCTL ('8', '-', '-', 0) found on session 95 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:05:24.631930 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:05:24.670410 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Searching for a device in session 94 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:05:24.670410 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e8306ca8-501b-4d1b-bf8c-aa9548725dee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:05:24.670410 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Searching for a device in session 95 and hctl ['8', '*', '*', 0] yield: None {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:05:24.690461 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:05:24.690461 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:05:24.714061 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-a1b6ca73-dcf2-4c47-8d10-9a646b189a29 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: 4a71f98e-0988-46c9-9b04-f8d0197468b9] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:24.767338 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:25.011692 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lazy-loading 'flavor' on Instance uuid f63a2253-071a-4a1a-94af-3544b20c39cf {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:05:25.029491 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8b7756ae-f9f0-460c-a46a-39756439049c req-e95271e2-6111-4ad1-bd71-8259b302d5cb service nova] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Received event network-vif-unplugged-595ed872-c1da-4406-aeb4-a249c8ebbe07 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:25.029722 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8b7756ae-f9f0-460c-a46a-39756439049c req-e95271e2-6111-4ad1-bd71-8259b302d5cb service nova] Acquiring lock "6ccaedfe-bec9-4591-b845-acf0cc81d026-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:25.029923 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8b7756ae-f9f0-460c-a46a-39756439049c req-e95271e2-6111-4ad1-bd71-8259b302d5cb service nova] Lock "6ccaedfe-bec9-4591-b845-acf0cc81d026-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:25.030060 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8b7756ae-f9f0-460c-a46a-39756439049c req-e95271e2-6111-4ad1-bd71-8259b302d5cb service nova] Lock "6ccaedfe-bec9-4591-b845-acf0cc81d026-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:25.030205 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8b7756ae-f9f0-460c-a46a-39756439049c req-e95271e2-6111-4ad1-bd71-8259b302d5cb service nova] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] No waiting events found dispatching network-vif-unplugged-595ed872-c1da-4406-aeb4-a249c8ebbe07 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:05:25.030364 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-8b7756ae-f9f0-460c-a46a-39756439049c req-e95271e2-6111-4ad1-bd71-8259b302d5cb service nova] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Received unexpected event network-vif-unplugged-595ed872-c1da-4406-aeb4-a249c8ebbe07 for instance with vm_state building and task_state spawning.
May 21 02:05:25.142931 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Updating instance_info_cache with network_info: [{"id": "22f09be4-eadb-4267-b696-57e365542719", "address": "fa:16:3e:4b:bc:3f", "network": {"id": "efb73811-c979-4f83-9b27-67a93594f8c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-674032884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8db1d8006574d1e9f7117042461bce4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f09be4-ea", "ovs_interfaceid": "22f09be4-eadb-4267-b696-57e365542719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:05:25.194042 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:05:25.566659 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:25.646867 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Releasing lock "refresh_cache-dc3e1d06-6926-4fd2-b5c2-5d6104ba6826" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:05:25.647704 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Instance network_info: |[{"id": "22f09be4-eadb-4267-b696-57e365542719", "address": "fa:16:3e:4b:bc:3f", "network": {"id": "efb73811-c979-4f83-9b27-67a93594f8c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-674032884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8db1d8006574d1e9f7117042461bce4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f09be4-ea", "ovs_interfaceid": "22f09be4-eadb-4267-b696-57e365542719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:05:25.649365 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Start _get_guest_xml network_info=[{"id": "22f09be4-eadb-4267-b696-57e365542719", "address": "fa:16:3e:4b:bc:3f", "network": {"id": "efb73811-c979-4f83-9b27-67a93594f8c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-674032884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8db1d8006574d1e9f7117042461bce4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f09be4-ea", "ovs_interfaceid": "22f09be4-eadb-4267-b696-57e365542719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:05:25.653886 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:05:25.655099 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-1686232613', uuid='dc3e1d06-6926-4fd2-b5c2-5d6104ba6826'), owner=OwnerMeta(userid='67349a30ec514c90a316eb35d579b04b', username='tempest-VolumesActionsTest-1094570120-project-member', projectid='e8db1d8006574d1e9f7117042461bce4', projectname='tempest-VolumesActionsTest-1094570120'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "22f09be4-eadb-4267-b696-57e365542719", "address": "fa:16:3e:4b:bc:3f", "network": {"id": "efb73811-c979-4f83-9b27-67a93594f8c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-674032884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8db1d8006574d1e9f7117042461bce4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f09be4-ea", "ovs_interfaceid": "22f09be4-eadb-4267-b696-57e365542719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329125.6547165) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:05:25.657681 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:05:25.658076 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:05:25.660855 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Searching for a device in session 95 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:05:25.663184 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e8306ca8-501b-4d1b-bf8c-aa9548725dee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:05:25.663184 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:05:25.663184 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:05:25.664501 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:05:25.664594 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:05:25.664800 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:05:25.664899 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:05:25.665018 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:05:25.666285 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:05:25.666285 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:05:25.666285 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:05:25.666285 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:05:25.666285 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:05:25.666285 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:05:25.666285 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:05:25.681192 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1686232613',display_name='tempest-VolumesActionsTest-instance-1686232613',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumesactionstest-instance-1686232613',id=44,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8db1d8006574d1e9f7117042461bce4',ramdisk_id='',reservation_id='r-0rlxf6sh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1094570120',owner_user_name='tempest-VolumesActionsTest-1094570120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:05:22Z,user_data=None,user_id='67349a30ec514c90a316eb35d579b04b',uuid=dc3e1d06-6926-4fd2-b5c2-5d6104ba6826,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22f09be4-eadb-4267-b696-57e365542719", "address": "fa:16:3e:4b:bc:3f", "network": {"id": "efb73811-c979-4f83-9b27-67a93594f8c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-674032884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8db1d8006574d1e9f7117042461bce4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f09be4-ea", "ovs_interfaceid": "22f09be4-eadb-4267-b696-57e365542719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:05:25.683791 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Converting VIF {"id": "22f09be4-eadb-4267-b696-57e365542719", "address": "fa:16:3e:4b:bc:3f", "network": {"id": "efb73811-c979-4f83-9b27-67a93594f8c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-674032884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8db1d8006574d1e9f7117042461bce4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f09be4-ea", "ovs_interfaceid": "22f09be4-eadb-4267-b696-57e365542719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:05:25.683791 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:bc:3f,bridge_name='br-int',has_traffic_filtering=True,id=22f09be4-eadb-4267-b696-57e365542719,network=Network(efb73811-c979-4f83-9b27-67a93594f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22f09be4-ea') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:05:25.683791 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Lazy-loading 'pci_devices' on Instance uuid dc3e1d06-6926-4fd2-b5c2-5d6104ba6826 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:05:25.701489 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.540s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:25.701868 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:05:26.016647 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "f63a2253-071a-4a1a-94af-3544b20c39cf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:26.185481 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] End _get_guest_xml xml=<domain type="qemu">
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:   <uuid>dc3e1d06-6926-4fd2-b5c2-5d6104ba6826</uuid>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:   <name>instance-0000002c</name>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:       <nova:name>tempest-VolumesActionsTest-instance-1686232613</nova:name>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:05:25</nova:creationTime>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:         <nova:user uuid="67349a30ec514c90a316eb35d579b04b">tempest-VolumesActionsTest-1094570120-project-member</nova:user>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:         <nova:project uuid="e8db1d8006574d1e9f7117042461bce4">tempest-VolumesActionsTest-1094570120</nova:project>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:         <nova:port uuid="22f09be4-eadb-4267-b696-57e365542719">
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:     <system>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:       <entry name="serial">dc3e1d06-6926-4fd2-b5c2-5d6104ba6826</entry>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:       <entry name="uuid">dc3e1d06-6926-4fd2-b5c2-5d6104ba6826</entry>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:     </system>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:   <os>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:   </os>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:   <features>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:   </features>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:   <devices>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/dc3e1d06-6926-4fd2-b5c2-5d6104ba6826/disk"/>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:     </disk>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/dc3e1d06-6926-4fd2-b5c2-5d6104ba6826/disk.config"/>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:     </disk>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:4b:bc:3f"/>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:       <target dev="tap22f09be4-ea"/>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:     </interface>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/dc3e1d06-6926-4fd2-b5c2-5d6104ba6826/console.log" append="off"/>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:     </serial>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:     <video>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:     </video>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:     </rng>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:   </devices>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]: </domain>
May 21 02:05:26.185481 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:05:26.187405 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Preparing to wait for external event network-vif-plugged-22f09be4-eadb-4267-b696-57e365542719 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:05:26.187405 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Acquiring lock "dc3e1d06-6926-4fd2-b5c2-5d6104ba6826-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:26.187405 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Lock "dc3e1d06-6926-4fd2-b5c2-5d6104ba6826-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:26.187405 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Lock "dc3e1d06-6926-4fd2-b5c2-5d6104ba6826-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:26.187405 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1686232613',display_name='tempest-VolumesActionsTest-instance-1686232613',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumesactionstest-instance-1686232613',id=44,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8db1d8006574d1e9f7117042461bce4',ramdisk_id='',reservation_id='r-0rlxf6sh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1094570120',owner_user_name='tempest-VolumesActionsTest-1094570120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:05:22Z,user_data=None,user_id='67349a30ec514c90a316eb35d579b04b',uuid=dc3e1d06-6926-4fd2-b5c2-5d6104ba6826,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22f09be4-eadb-4267-b696-57e365542719", "address": "fa:16:3e:4b:bc:3f", "network": {"id": "efb73811-c979-4f83-9b27-67a93594f8c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-674032884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8db1d8006574d1e9f7117042461bce4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f09be4-ea", "ovs_interfaceid": "22f09be4-eadb-4267-b696-57e365542719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:05:26.187405 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Converting VIF {"id": "22f09be4-eadb-4267-b696-57e365542719", "address": "fa:16:3e:4b:bc:3f", "network": {"id": "efb73811-c979-4f83-9b27-67a93594f8c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-674032884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8db1d8006574d1e9f7117042461bce4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f09be4-ea", "ovs_interfaceid": "22f09be4-eadb-4267-b696-57e365542719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:05:26.187974 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:bc:3f,bridge_name='br-int',has_traffic_filtering=True,id=22f09be4-eadb-4267-b696-57e365542719,network=Network(efb73811-c979-4f83-9b27-67a93594f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22f09be4-ea') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:05:26.187974 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:bc:3f,bridge_name='br-int',has_traffic_filtering=True,id=22f09be4-eadb-4267-b696-57e365542719,network=Network(efb73811-c979-4f83-9b27-67a93594f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22f09be4-ea') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:05:26.188147 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:26.188352 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:26.190138 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:05:26.190138 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:26.190138 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6c433e55-1103-5bed-801c-2c6e0d587bf8', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:26.190381 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:26.192724 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:05:26.194576 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:26.194871 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22f09be4-ea, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:26.195178 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap22f09be4-ea, col_values=(('qos', UUID('6366ffae-369a-4288-83cd-88749cf819bb')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:26.195321 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap22f09be4-ea, col_values=(('external_ids', {'iface-id': '22f09be4-eadb-4267-b696-57e365542719', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:bc:3f', 'vm-uuid': 'dc3e1d06-6926-4fd2-b5c2-5d6104ba6826'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:26.196200 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:26.198019 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:05:26.204244 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:26.206850 np0000001127 nova-compute[98206]: INFO os_vif [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:bc:3f,bridge_name='br-int',has_traffic_filtering=True,id=22f09be4-eadb-4267-b696-57e365542719,network=Network(efb73811-c979-4f83-9b27-67a93594f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22f09be4-ea')
May 21 02:05:26.208203 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:05:26.208352 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:05:26.208797 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:26.209002 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:26.302765 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4878b5a5bf184852a9ce383caa1c67a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ebdb16aee84e22a88dfc8960debd32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:05:26.463207 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Found WWN 3300000009584f153 for multipath device dm-0 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:05:26.463207 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.046s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:05:26.463207 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] <== connect_volume: return (3046ms) {'type': 'block', 'scsi_wwn': '3300000009584f153', 'path': '/dev/dm-0', 'multipath_id': '3300000009584f153'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:05:26.463207 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009584f153', 'path': '/dev/dm-0', 'multipath_id': '3300000009584f153'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:05:26.537426 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:27.731607 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:05:27.731607 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:05:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1624830305',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumemultiattachtest-server-1624830305',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='848912b0c0e94d2795bb2332daf1730e',ramdisk_id='',reservation_id='r-1ov2krjm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-289054175',owner_user_name='tempest-AttachVolumeMultiAttachTest-289054175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:05:20Z,user_data=None,user_id='049d6c8cccfa4ae38d78a88ef5be0f1b',uuid=6ccaedfe-bec9-4591-b845-acf0cc81d026,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "595ed872-c1da-4406-aeb4-a249c8ebbe07", "address": "fa:16:3e:0f:28:a1", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap595ed872-c1", "ovs_interfaceid": "595ed872-c1da-4406-aeb4-a249c8ebbe07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:05:27.731607 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converting VIF {"id": "595ed872-c1da-4406-aeb4-a249c8ebbe07", "address": "fa:16:3e:0f:28:a1", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap595ed872-c1", "ovs_interfaceid": "595ed872-c1da-4406-aeb4-a249c8ebbe07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:05:27.731607 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:28:a1,bridge_name='br-int',has_traffic_filtering=True,id=595ed872-c1da-4406-aeb4-a249c8ebbe07,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap595ed872-c1') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:05:27.731607 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ccaedfe-bec9-4591-b845-acf0cc81d026 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:05:27.731607 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Successfully created port: 7a9ceef8-458f-4d22-aa65-2dccb71ed1ad {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:05:27.731607 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "f63a2253-071a-4a1a-94af-3544b20c39cf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:27.731607 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "f63a2253-071a-4a1a-94af-3544b20c39cf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:27.731607 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Attaching volume 0bc85eae-59fe-4ca0-88d4-39d1c14b8317 to /dev/vdb
May 21 02:05:27.731607 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:05:27.731607 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:05:27.731607 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:05:27.731607 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:27.731607 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:05:27.731607 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:05:27.731607 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:05:27.731607 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:feca:ebaf', 'fe80::40b3:49ff:feb3:3b55', 'fe80::fc16:3eff:fe4b:b481', 'fe80::2844:63ff:fe5d:6c35', 'fe80::fc16:3eff:fee1:2e46', 'fe80::2482:bff:fe1b:902b'] 
May 21 02:05:27.731607 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:05:27.731607 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:05:27.731607 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:05:27.731607 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Updating existing volume attachment record: 252e0713-94f7-435c-a3df-4454a939a214 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:05:27.731607 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] End _get_guest_xml xml=<domain type="qemu">
May 21 02:05:27.731607 np0000001127 nova-compute[98206]:   <uuid>6ccaedfe-bec9-4591-b845-acf0cc81d026</uuid>
May 21 02:05:27.731607 np0000001127 nova-compute[98206]:   <name>instance-0000002b</name>
May 21 02:05:27.731607 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:05:27.731607 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:05:27.731607 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:05:27.731607 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:05:27.731607 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:05:27.731607 np0000001127 nova-compute[98206]:       <nova:name>tempest-AttachVolumeMultiAttachTest-server-1624830305</nova:name>
May 21 02:05:27.731607 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:05:23</nova:creationTime>
May 21 02:05:27.731607 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:05:27.731607 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:05:27.731607 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:05:27.731607 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:05:27.731607 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:05:27.731607 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:05:27.731607 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:05:27.731607 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:05:27.731607 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:       <nova:image uuid="">
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:         <nova:user uuid="049d6c8cccfa4ae38d78a88ef5be0f1b">tempest-AttachVolumeMultiAttachTest-289054175-project-member</nova:user>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:         <nova:project uuid="848912b0c0e94d2795bb2332daf1730e">tempest-AttachVolumeMultiAttachTest-289054175</nova:project>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:       <nova:root type="volume" uuid=""/>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:         <nova:port uuid="595ed872-c1da-4406-aeb4-a249c8ebbe07">
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:     <system>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:       <entry name="serial">6ccaedfe-bec9-4591-b845-acf0cc81d026</entry>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:       <entry name="uuid">6ccaedfe-bec9-4591-b845-acf0cc81d026</entry>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:     </system>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:   <os>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:   </os>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:   <features>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:   </features>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:   <devices>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/6ccaedfe-bec9-4591-b845-acf0cc81d026/disk.config"/>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:     </disk>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:       <alias name="ua-e8306ca8-501b-4d1b-bf8c-aa9548725dee"/>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-0"/>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:       <serial>e8306ca8-501b-4d1b-bf8c-aa9548725dee</serial>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:       <shareable/>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:     </disk>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:0f:28:a1"/>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:       <target dev="tap595ed872-c1"/>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:     </interface>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/6ccaedfe-bec9-4591-b845-acf0cc81d026/console.log" append="off"/>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:     </serial>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:     <video>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:     </video>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:     </rng>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:   </devices>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]: </domain>
May 21 02:05:27.735422 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:05:27.735422 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Preparing to wait for external event network-vif-plugged-595ed872-c1da-4406-aeb4-a249c8ebbe07 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:05:27.735422 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "6ccaedfe-bec9-4591-b845-acf0cc81d026-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:27.735422 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "6ccaedfe-bec9-4591-b845-acf0cc81d026-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:27.735422 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "6ccaedfe-bec9-4591-b845-acf0cc81d026-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:27.735422 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:05:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1624830305',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumemultiattachtest-server-1624830305',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='848912b0c0e94d2795bb2332daf1730e',ramdisk_id='',reservation_id='r-1ov2krjm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-289054175',owner_user_name='tempest-AttachVolumeMultiAttachTest-289054175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:05:20Z,user_data=None,user_id='049d6c8cccfa4ae38d78a88ef5be0f1b',uuid=6ccaedfe-bec9-4591-b845-acf0cc81d026,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "595ed872-c1da-4406-aeb4-a249c8ebbe07", "address": "fa:16:3e:0f:28:a1", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap595ed872-c1", "ovs_interfaceid": "595ed872-c1da-4406-aeb4-a249c8ebbe07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:05:27.735422 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converting VIF {"id": "595ed872-c1da-4406-aeb4-a249c8ebbe07", "address": "fa:16:3e:0f:28:a1", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap595ed872-c1", "ovs_interfaceid": "595ed872-c1da-4406-aeb4-a249c8ebbe07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:05:27.735422 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:28:a1,bridge_name='br-int',has_traffic_filtering=True,id=595ed872-c1da-4406-aeb4-a249c8ebbe07,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap595ed872-c1') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:05:27.735422 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:28:a1,bridge_name='br-int',has_traffic_filtering=True,id=595ed872-c1da-4406-aeb4-a249c8ebbe07,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap595ed872-c1') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:05:27.735422 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:27.735422 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:27.735422 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:05:27.735422 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:27.735422 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '35498d1f-c88e-53b7-a8a2-685d24d76e58', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:27.735422 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:27.735422 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:05:27.735422 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:27.735422 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:27.735422 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap595ed872-c1, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:27.735422 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap595ed872-c1, col_values=(('qos', UUID('79b670ca-aa2a-4980-81b6-ecdd51bb8592')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:27.738593 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap595ed872-c1, col_values=(('external_ids', {'iface-id': '595ed872-c1da-4406-aeb4-a249c8ebbe07', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:28:a1', 'vm-uuid': '6ccaedfe-bec9-4591-b845-acf0cc81d026'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:27.738593 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:27.738593 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:05:27.738593 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:27.738593 np0000001127 nova-compute[98206]: INFO os_vif [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:28:a1,bridge_name='br-int',has_traffic_filtering=True,id=595ed872-c1da-4406-aeb4-a249c8ebbe07,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap595ed872-c1')
May 21 02:05:27.738593 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Successfully updated port: 7a9ceef8-458f-4d22-aa65-2dccb71ed1ad {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:05:27.738593 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-ab53a795-3d3a-4006-b53d-e732c7e18310 req-e0253f11-f932-4289-af2d-89ceaccc2cea service nova] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Received event network-changed-7a9ceef8-458f-4d22-aa65-2dccb71ed1ad {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:27.738593 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-ab53a795-3d3a-4006-b53d-e732c7e18310 req-e0253f11-f932-4289-af2d-89ceaccc2cea service nova] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Refreshing instance network info cache due to event network-changed-7a9ceef8-458f-4d22-aa65-2dccb71ed1ad. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:05:27.738593 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ab53a795-3d3a-4006-b53d-e732c7e18310 req-e0253f11-f932-4289-af2d-89ceaccc2cea service nova] Acquiring lock "refresh_cache-3e53c443-92d8-4e5c-bc47-43deb205786b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:05:27.738593 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ab53a795-3d3a-4006-b53d-e732c7e18310 req-e0253f11-f932-4289-af2d-89ceaccc2cea service nova] Acquired lock "refresh_cache-3e53c443-92d8-4e5c-bc47-43deb205786b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:05:27.738593 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-ab53a795-3d3a-4006-b53d-e732c7e18310 req-e0253f11-f932-4289-af2d-89ceaccc2cea service nova] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Refreshing network info cache for port 7a9ceef8-458f-4d22-aa65-2dccb71ed1ad {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:05:27.738593 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Booting with volume 22e98b1d-1bf5-45ce-b4e6-15a697eeb617 at /dev/vda
May 21 02:05:27.752616 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:05:27.752747 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:05:27.752853 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] No VIF found with MAC fa:16:3e:4b:bc:3f, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:05:27.753716 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Using config drive
May 21 02:05:27.790971 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:05:27.812162 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:05:27.835552 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:27.879287 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:05:27.879396 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317', 'iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0bc85eae-59fe-4ca0-88d4-39d1c14b8317', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:05:27.879896 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:05:27.880959 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:05:27.881292 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317', 'iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0bc85eae-59fe-4ca0-88d4-39d1c14b8317', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:05:27.900896 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:05:27.905250 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:05:27.906354 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:05:27.906945 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:05:27.907272 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:05:27.907825 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:05:27.908204 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:05:27.908521 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:05:27.923041 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:05:27.923041 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:27.932065 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:05:27.932065 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:27.933225 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:05:27.934577 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:feca:ebaf', 'fe80::40b3:49ff:feb3:3b55', 'fe80::fc16:3eff:fe4b:b481', 'fe80::2844:63ff:fe5d:6c35', 'fe80::fc16:3eff:fee1:2e46', 'fe80::2482:bff:fe1b:902b'] 
May 21 02:05:27.934893 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:05:27.934893 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:05:27.935178 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:05:27.935395 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Updating existing volume attachment record: 64571f50-ca7f-487f-b468-144e42808255 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:05:27.940326 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317] added
May 21 02:05:27.940326 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:05:27.940326 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:05:27.940326 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:05:27.940326 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:05:27.940326 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:05:27.940326 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:27.940326 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:05:27.940600 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0344(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:05:27.940686 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:05:27.949121 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317] added
May 21 02:05:27.949121 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:05:27.949121 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:05:27.949121 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:05:27.949121 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:05:27.949121 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:05:27.949121 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:27.949346 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:05:27.949513 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0423(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:05:27.949714 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:05:28.065776 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "refresh_cache-3e53c443-92d8-4e5c-bc47-43deb205786b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:05:28.119856 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-ab53a795-3d3a-4006-b53d-e732c7e18310 req-e0253f11-f932-4289-af2d-89ceaccc2cea service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:28.243501 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-ab53a795-3d3a-4006-b53d-e732c7e18310 req-e0253f11-f932-4289-af2d-89ceaccc2cea service nova] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:05:28.262630 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:28.315830 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:28.423908 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Creating config drive at /opt/stack/data/nova/instances/dc3e1d06-6926-4fd2-b5c2-5d6104ba6826/disk.config
May 21 02:05:28.427889 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/dc3e1d06-6926-4fd2-b5c2-5d6104ba6826/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpyp9uh026 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:28.480426 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/dc3e1d06-6926-4fd2-b5c2-5d6104ba6826/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpyp9uh026" returned: 0 in 0.052s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:05:28.518773 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-ab53a795-3d3a-4006-b53d-e732c7e18310 req-e0253f11-f932-4289-af2d-89ceaccc2cea service nova] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:05:28.941295 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:05:28.950210 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:05:28.960857 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:05:28.965757 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:05:28.965757 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:05:28.967545 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:05:28.967545 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:28.981496 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:28.985106 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:28.993251 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:28.999427 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:29.002129 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:29.002129 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:29.002129 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:29.002129 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:29.002129 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:05:29.002273 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:29.002273 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:29.002273 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:29.002273 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:29.002273 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:05:29.011947 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:29.011947 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:29.011947 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:29.011947 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:29.011947 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:05:29.012135 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:29.012135 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:29.012135 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:29.012135 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:29.012135 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:05:29.024492 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ab53a795-3d3a-4006-b53d-e732c7e18310 req-e0253f11-f932-4289-af2d-89ceaccc2cea service nova] Releasing lock "refresh_cache-3e53c443-92d8-4e5c-bc47-43deb205786b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:05:29.024492 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquired lock "refresh_cache-3e53c443-92d8-4e5c-bc47-43deb205786b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:05:29.024492 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:05:29.045165 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:05:29.045448 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:05:29.045646 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No VIF found with MAC fa:16:3e:0f:28:a1, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:05:29.046547 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Using config drive
May 21 02:05:29.050128 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317, portal: 192.168.40.100,3260]
May 21 02:05:29.050128 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317, portal: 192.168.40.100,3260] successful.
May 21 02:05:29.050128 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:29.058361 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317, portal: 192.168.50.100,3260]
May 21 02:05:29.058361 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317, portal: 192.168.50.100,3260] successful.
May 21 02:05:29.058361 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:29.066816 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:29.079196 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:29.083498 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:29.091087 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:29.091087 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:29.091087 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:29.091087 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:29.091087 np0000001127 nova-compute[98206]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:29.091087 np0000001127 nova-compute[98206]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:29.091087 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:05:29.091087 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:29.091087 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:29.091087 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:29.091087 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:29.091087 np0000001127 nova-compute[98206]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:29.091087 np0000001127 nova-compute[98206]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:29.091087 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:05:29.095612 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.190s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:05:29.096155 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:05:29.097161 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] HCTL ('11', '-', '-', 0) found on session 96 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:05:29.097402 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:05:29.109633 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:29.109633 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:29.109633 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:29.109633 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:29.109633 np0000001127 nova-compute[98206]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:29.109633 np0000001127 nova-compute[98206]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:29.109633 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:05:29.109924 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:29.109924 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:29.109924 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:29.109924 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:29.109924 np0000001127 nova-compute[98206]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:29.109924 np0000001127 nova-compute[98206]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:29.109924 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:05:29.110387 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.203s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:05:29.110387 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:05:29.111265 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] HCTL ('12', '-', '-', 0) found on session 97 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:05:29.111265 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:05:29.140957 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Searching for a device in session 96 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:05:29.140957 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0bc85eae-59fe-4ca0-88d4-39d1c14b8317', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:05:29.140957 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Searching for a device in session 97 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:05:29.141232 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0bc85eae-59fe-4ca0-88d4-39d1c14b8317', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:05:29.377482 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:29.386933 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:29.389869 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Acquiring lock "9b4239c5-84df-4d87-a2d4-fb6192408f58" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:29.390196 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "9b4239c5-84df-4d87-a2d4-fb6192408f58" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:29.416650 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:29.422122 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:29.556548 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:29.629631 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:05:29.730012 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Creating config drive at /opt/stack/data/nova/instances/6ccaedfe-bec9-4591-b845-acf0cc81d026/disk.config
May 21 02:05:29.734858 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6ccaedfe-bec9-4591-b845-acf0cc81d026/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_1ixr6rg {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:29.809771 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6ccaedfe-bec9-4591-b845-acf0cc81d026/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_1ixr6rg" returned: 0 in 0.075s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:05:29.859081 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:29.895396 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:05:29.909006 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:05:30.013348 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329130.012889, dc3e1d06-6926-4fd2-b5c2-5d6104ba6826 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:05:30.013913 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] VM Started (Lifecycle Event)
May 21 02:05:30.038499 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Updating instance_info_cache with network_info: [{"id": "7a9ceef8-458f-4d22-aa65-2dccb71ed1ad", "address": "fa:16:3e:bd:86:0a", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9ceef8-45", "ovs_interfaceid": "7a9ceef8-458f-4d22-aa65-2dccb71ed1ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:05:30.111515 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:05:30.112897 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:05:30.113164 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Creating image(s)
May 21 02:05:30.113497 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Did not create local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 21 02:05:30.113806 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Ensure instance console log exists: /opt/stack/data/nova/instances/3e53c443-92d8-4e5c-bc47-43deb205786b/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:05:30.113943 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:30.114189 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:30.114476 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:30.348272 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:30.372058 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:30.474013 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Acquiring lock "76097fea-0890-40a8-a902-9f510cd34b52" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:30.474106 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "76097fea-0890-40a8-a902-9f510cd34b52" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:30.477912 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:30.477912 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:30.482371 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:05:30.482371 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Claim successful on node np0000001127
May 21 02:05:30.482998 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:30.516275 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:30.521566 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329130.5212271, dc3e1d06-6926-4fd2-b5c2-5d6104ba6826 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:05:30.521741 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] VM Paused (Lifecycle Event)
May 21 02:05:30.540259 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Releasing lock "refresh_cache-3e53c443-92d8-4e5c-bc47-43deb205786b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:05:30.540547 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Instance network_info: |[{"id": "7a9ceef8-458f-4d22-aa65-2dccb71ed1ad", "address": "fa:16:3e:bd:86:0a", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9ceef8-45", "ovs_interfaceid": "7a9ceef8-458f-4d22-aa65-2dccb71ed1ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:05:30.541280 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Start _get_guest_xml network_info=[{"id": "7a9ceef8-458f-4d22-aa65-2dccb71ed1ad", "address": "fa:16:3e:bd:86:0a", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9ceef8-45", "ovs_interfaceid": "7a9ceef8-458f-4d22-aa65-2dccb71ed1ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617', 'iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '22e98b1d-1bf5-45ce-b4e6-15a697eeb617', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '3e53c443-92d8-4e5c-bc47-43deb205786b', 'attached_at': '', 'detached_at': '', 'volume_id': '22e98b1d-1bf5-45ce-b4e6-15a697eeb617', 'serial': '22e98b1d-1bf5-45ce-b4e6-15a697eeb617'}, 'delete_on_termination': False, 'attachment_id': '64571f50-ca7f-487f-b468-144e42808255', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:05:30.550174 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:05:30.551765 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-352995534', uuid='3e53c443-92d8-4e5c-bc47-43deb205786b'), owner=OwnerMeta(userid='4878b5a5bf184852a9ce383caa1c67a4', username='tempest-TestVolumeBootPattern-1995806391-project-member', projectid='62ebdb16aee84e22a88dfc8960debd32', projectname='tempest-TestVolumeBootPattern-1995806391'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7a9ceef8-458f-4d22-aa65-2dccb71ed1ad", "address": "fa:16:3e:bd:86:0a", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9ceef8-45", "ovs_interfaceid": "7a9ceef8-458f-4d22-aa65-2dccb71ed1ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329130.5512583) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:05:30.553380 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:05:30.553946 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:05:30.555392 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:05:30.555636 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:05:30.557031 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:05:30.557432 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:05:30.557967 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:05:30.558107 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:05:30.558274 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:05:30.558392 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:05:30.558534 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:05:30.558770 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:05:30.558902 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:05:30.559044 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:05:30.559173 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:05:30.559320 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:05:30.575796 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:05:30.576234 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617', 'iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '22e98b1d-1bf5-45ce-b4e6-15a697eeb617', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:05:30.576491 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:05:30.717367 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:30.719464 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:30.743708 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:30.925577 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Found WWN 3300000008c7c1a86 for multipath device dm-4 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:05:30.926134 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.045s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:05:30.926295 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] <== connect_volume: return (3046ms) {'type': 'block', 'scsi_wwn': '3300000008c7c1a86', 'path': '/dev/dm-4', 'multipath_id': '3300000008c7c1a86'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:05:30.926433 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008c7c1a86', 'path': '/dev/dm-4', 'multipath_id': '3300000008c7c1a86'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:05:30.927931 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.351s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:05:30.928108 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617', 'iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '22e98b1d-1bf5-45ce-b4e6-15a697eeb617', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:05:30.930200 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lazy-loading 'flavor' on Instance uuid f63a2253-071a-4a1a-94af-3544b20c39cf {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:05:30.946542 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:05:30.947154 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:05:30.948153 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:05:30.948340 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:05:30.949105 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:05:30.949348 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:05:30.964191 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:05:30.964191 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:30.975180 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:05:30.975180 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:30.979543 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Detaching volume ecb49e75-1da5-4848-806e-d7bb8cd06f5c
May 21 02:05:30.987033 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617] added
May 21 02:05:30.987033 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:05:30.987033 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:05:30.987033 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:05:30.987033 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:05:30.987033 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:05:30.987033 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:30.987294 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:05:30.987422 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.039(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:05:30.987663 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:05:30.989130 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617] added
May 21 02:05:30.989130 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:05:30.989130 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:05:30.989130 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:05:30.989130 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:05:30.989130 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:05:30.989130 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:30.989263 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:05:30.989409 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0401(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:05:30.989545 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:05:31.026528 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:31.035215 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Attempting to driver detach volume ecb49e75-1da5-4848-806e-d7bb8cd06f5c from mountpoint /dev/vdb
May 21 02:05:31.037077 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:05:31.049506 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Found disk vdb by alias ua-ecb49e75-1da5-4848-806e-d7bb8cd06f5c {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:05:31.051351 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Found disk vdb by alias ua-ecb49e75-1da5-4848-806e-d7bb8cd06f5c {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:05:31.051462 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Attempting to detach device vdb from instance 76097fea-0890-40a8-a902-9f510cd34b52 from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 02:05:31.051813 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:05:31.051813 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:05:31.051813 np0000001127 nova-compute[98206]:   <alias name="ua-ecb49e75-1da5-4848-806e-d7bb8cd06f5c"/>
May 21 02:05:31.051813 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-1"/>
May 21 02:05:31.051813 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:05:31.051813 np0000001127 nova-compute[98206]:   <serial>ecb49e75-1da5-4848-806e-d7bb8cd06f5c</serial>
May 21 02:05:31.051813 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:05:31.051813 np0000001127 nova-compute[98206]: </disk>
May 21 02:05:31.051813 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:05:31.065597 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Successfully detached device vdb from instance 76097fea-0890-40a8-a902-9f510cd34b52 from the persistent domain config.
May 21 02:05:31.065597 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] (1/8): Attempting to detach device vdb with device alias ua-ecb49e75-1da5-4848-806e-d7bb8cd06f5c from instance 76097fea-0890-40a8-a902-9f510cd34b52 from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 02:05:31.065597 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:05:31.065597 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:05:31.065597 np0000001127 nova-compute[98206]:   <alias name="ua-ecb49e75-1da5-4848-806e-d7bb8cd06f5c"/>
May 21 02:05:31.065597 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-1"/>
May 21 02:05:31.065597 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:05:31.065597 np0000001127 nova-compute[98206]:   <serial>ecb49e75-1da5-4848-806e-d7bb8cd06f5c</serial>
May 21 02:05:31.065597 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:05:31.065597 np0000001127 nova-compute[98206]: </disk>
May 21 02:05:31.065597 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:05:31.433441 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Attempting to attach volume 0bc85eae-59fe-4ca0-88d4-39d1c14b8317 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 02:05:31.434787 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] attach device xml: <disk type="block" device="disk">
May 21 02:05:31.434787 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:05:31.434787 np0000001127 nova-compute[98206]:   <alias name="ua-0bc85eae-59fe-4ca0-88d4-39d1c14b8317"/>
May 21 02:05:31.434787 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-4"/>
May 21 02:05:31.434787 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:05:31.434787 np0000001127 nova-compute[98206]:   <serial>0bc85eae-59fe-4ca0-88d4-39d1c14b8317</serial>
May 21 02:05:31.434787 np0000001127 nova-compute[98206]: </disk>
May 21 02:05:31.434787 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 02:05:31.539493 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:31.542227 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:05:31.545844 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329131.5455265, 6ccaedfe-bec9-4591-b845-acf0cc81d026 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:05:31.545990 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] VM Started (Lifecycle Event)
May 21 02:05:31.673597 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-ecb49e75-1da5-4848-806e-d7bb8cd06f5c for instance 76097fea-0890-40a8-a902-9f510cd34b52 {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 02:05:31.874811 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:05:31.875082 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:05:31.990023 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:05:31.990490 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:05:32.005781 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:05:32.005781 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:05:32.013718 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:05:32.013718 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:32.021358 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:32.032830 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:32.045197 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:32.045197 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:32.045197 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:32.045197 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:32.045197 np0000001127 nova-compute[98206]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:32.045197 np0000001127 nova-compute[98206]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:32.045197 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:05:32.045442 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:32.045442 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:32.045442 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:32.045442 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:32.045442 np0000001127 nova-compute[98206]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:32.045442 np0000001127 nova-compute[98206]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:32.045442 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:05:32.048569 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:32.051197 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329132.0509279, 6ccaedfe-bec9-4591-b845-acf0cc81d026 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:05:32.051365 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] VM Paused (Lifecycle Event)
May 21 02:05:32.055519 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:32.055519 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:32.055519 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:32.055519 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:32.055519 np0000001127 nova-compute[98206]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:32.055519 np0000001127 nova-compute[98206]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:32.055519 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:05:32.055519 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:32.055519 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:32.055519 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:32.055519 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:32.055519 np0000001127 nova-compute[98206]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:32.055519 np0000001127 nova-compute[98206]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:32.055519 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:05:32.105958 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617, portal: 192.168.40.100,3260]
May 21 02:05:32.105958 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617, portal: 192.168.40.100,3260] successful.
May 21 02:05:32.105958 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:32.112376 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617, portal: 192.168.50.100,3260]
May 21 02:05:32.112376 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617, portal: 192.168.50.100,3260] successful.
May 21 02:05:32.112376 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:32.127331 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:32.138733 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:32.152623 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:32.152623 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:32.152623 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:32.152623 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:32.152623 np0000001127 nova-compute[98206]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:32.152623 np0000001127 nova-compute[98206]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:32.152623 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:32.152623 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:32.152623 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:05:32.152623 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:32.152623 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:32.152623 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:32.152623 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:32.152623 np0000001127 nova-compute[98206]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:32.152623 np0000001127 nova-compute[98206]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:32.152623 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:32.152623 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:32.152623 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:05:32.152623 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.204s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:05:32.153153 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:05:32.153973 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] HCTL ('13', '-', '-', 0) found on session 98 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:05:32.154131 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:05:32.163278 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:32.163278 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:32.163278 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:32.163278 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:32.163278 np0000001127 nova-compute[98206]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:32.163278 np0000001127 nova-compute[98206]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:32.163278 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:32.163278 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:32.163278 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:05:32.163278 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:32.163278 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:32.163278 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:32.163278 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:32.163278 np0000001127 nova-compute[98206]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:32.163278 np0000001127 nova-compute[98206]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:32.163278 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:32.163278 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:32.163278 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:05:32.163278 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.212s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:05:32.163278 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:05:32.163278 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] HCTL ('14', '-', '-', 0) found on session 99 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:05:32.163278 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:05:32.179876 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching for a device in session 98 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:05:32.179876 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '22e98b1d-1bf5-45ce-b4e6-15a697eeb617', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:05:32.182129 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching for a device in session 99 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:05:32.182129 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '22e98b1d-1bf5-45ce-b4e6-15a697eeb617', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:05:32.199443 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:32.378173 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:05:32.502630 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:32.560882 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:32.562626 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:05:32.890140 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.412s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:32.890757 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:05:32.948325 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:05:33.064817 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:05:33.065304 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779329133.0648677, 76097fea-0890-40a8-a902-9f510cd34b52 => ua-ecb49e75-1da5-4848-806e-d7bb8cd06f5c> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 02:05:33.067615 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Successfully detached device vdb from instance 76097fea-0890-40a8-a902-9f510cd34b52 from the live domain config.
May 21 02:05:33.068666 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:05:33.068932 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c', 'iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ecb49e75-1da5-4848-806e-d7bb8cd06f5c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:05:33.069110 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:05:33.099843 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:05:33.100190 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:05:33.100430 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:05:33.100805 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] No VIF found with MAC fa:16:3e:ca:eb:af, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:05:33.400065 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:05:33.400234 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:05:33.400561 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:33.400926 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:33.507776 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '64aaf3f477c745199d5b7f171309b623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72317ce75214e619a14739991461c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:05:33.906569 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:05:33.965292 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Found WWN 330000000ec293e89 for multipath device dm-5 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:05:33.966007 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:05:33.966368 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] <== connect_volume: return (3389ms) {'type': 'block', 'scsi_wwn': '330000000ec293e89', 'path': '/dev/dm-5', 'multipath_id': '330000000ec293e89'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:05:33.966957 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ec293e89', 'path': '/dev/dm-5', 'multipath_id': '330000000ec293e89'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:05:33.967400 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.898s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:05:33.967896 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c', 'iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ecb49e75-1da5-4848-806e-d7bb8cd06f5c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:05:33.968178 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:05:33.999993 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:33.999993 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:33.999993 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:33.999993 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:33.999993 np0000001127 nova-compute[98206]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:33.999993 np0000001127 nova-compute[98206]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:33.999993 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:33.999993 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:33.999993 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:05:34.000662 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:34.000662 np0000001127 nova-compute[98206]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c (non-flash)
May 21 02:05:34.000662 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:34.000662 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:34.000662 np0000001127 nova-compute[98206]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:34.000662 np0000001127 nova-compute[98206]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:34.000662 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:34.000662 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:34.000662 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:05:34.000662 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c', '88'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c', '89'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '95'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317', '96'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317', '97'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617', '98'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617', '99')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:05:34.000662 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c', '88')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:05:34.001663 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c', '89')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:05:34.005726 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c058465080>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c'): ({'sde'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:05:34.006036 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Removing multipathed devices sdd, sde {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:05:34.006324 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Flush multipath device 3300000004a4ae24e {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:05:34.036414 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-ae13edf4-34a8-428d-8a38-384e1795d2d8 req-1706f4b4-c895-4fde-8730-26d3ece3d7ef service nova] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Received event network-vif-plugged-22f09be4-eadb-4267-b696-57e365542719 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:34.036539 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ae13edf4-34a8-428d-8a38-384e1795d2d8 req-1706f4b4-c895-4fde-8730-26d3ece3d7ef service nova] Acquiring lock "dc3e1d06-6926-4fd2-b5c2-5d6104ba6826-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:34.036881 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ae13edf4-34a8-428d-8a38-384e1795d2d8 req-1706f4b4-c895-4fde-8730-26d3ece3d7ef service nova] Lock "dc3e1d06-6926-4fd2-b5c2-5d6104ba6826-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:34.036959 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ae13edf4-34a8-428d-8a38-384e1795d2d8 req-1706f4b4-c895-4fde-8730-26d3ece3d7ef service nova] Lock "dc3e1d06-6926-4fd2-b5c2-5d6104ba6826-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:34.037048 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-ae13edf4-34a8-428d-8a38-384e1795d2d8 req-1706f4b4-c895-4fde-8730-26d3ece3d7ef service nova] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Processing event network-vif-plugged-22f09be4-eadb-4267-b696-57e365542719 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:05:34.037946 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Instance event wait completed in 4 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:05:34.041125 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:05:34.042211 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329134.0417807, dc3e1d06-6926-4fd2-b5c2-5d6104ba6826 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:05:34.042523 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] VM Resumed (Lifecycle Event)
May 21 02:05:34.044788 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Instance spawned successfully.
May 21 02:05:34.046117 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:05:34.067803 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:34.069192 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:05:34.128821 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:05:34.140438 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-29fc47e4-5035-47f3-8d26-06fd9b6007c8 req-0a004f59-1117-4b99-ae29-06406903122d service nova] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Received event network-vif-plugged-595ed872-c1da-4406-aeb4-a249c8ebbe07 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:34.140761 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-29fc47e4-5035-47f3-8d26-06fd9b6007c8 req-0a004f59-1117-4b99-ae29-06406903122d service nova] Acquiring lock "6ccaedfe-bec9-4591-b845-acf0cc81d026-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:34.140930 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-29fc47e4-5035-47f3-8d26-06fd9b6007c8 req-0a004f59-1117-4b99-ae29-06406903122d service nova] Lock "6ccaedfe-bec9-4591-b845-acf0cc81d026-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:34.141053 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-29fc47e4-5035-47f3-8d26-06fd9b6007c8 req-0a004f59-1117-4b99-ae29-06406903122d service nova] Lock "6ccaedfe-bec9-4591-b845-acf0cc81d026-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:34.141186 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-29fc47e4-5035-47f3-8d26-06fd9b6007c8 req-0a004f59-1117-4b99-ae29-06406903122d service nova] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Processing event network-vif-plugged-595ed872-c1da-4406-aeb4-a249c8ebbe07 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:05:34.144810 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:05:34.149772 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:05:34.152537 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Instance spawned successfully.
May 21 02:05:34.152961 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:05:34.186322 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:05:34.186322 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:05:34.186322 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:05:34.200832 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:05:34.201027 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:05:34.216571 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:34.250460 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 88, target: iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c, portal: 192.168.40.100,3260]
May 21 02:05:34.250460 np0000001127 nova-compute[98206]: Logout of [sid: 88, target: iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c, portal: 192.168.40.100,3260] successful.
May 21 02:05:34.250460 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:34.269937 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:34.286328 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:34.323811 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 89, target: iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c, portal: 192.168.50.100,3260]
May 21 02:05:34.323811 np0000001127 nova-compute[98206]: Logout of [sid: 89, target: iqn.2023-03.storpool.com:os--volume-ecb49e75-1da5-4848-806e-d7bb8cd06f5c, portal: 192.168.50.100,3260] successful.
May 21 02:05:34.323811 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:34.351518 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:34.351798 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:05:34.351962 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] <== disconnect_volume: return (1283ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:05:34.352190 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:05:34.410922 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:05:34.442496 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Successfully created port: 7475b4a3-11de-43b6-9d83-b59933d9e8db {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:05:34.475292 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:05:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-352995534',display_name='tempest-TestVolumeBootPattern-server-352995534',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpattern-server-352995534',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBaRNOqohsNJVOU8i1yx10NByg4YHG0kBqhb8dmc6GQzsAdAAhAV6GFGAs9H1IYquThiDuyR1AIlFlID71ty2Ie/veadDUg9qWuDwTODN9ItjcrF0xf97cKKhCzM0WFlw==',key_name='tempest-keypair-189223710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62ebdb16aee84e22a88dfc8960debd32',ramdisk_id='',reservation_id='r-26g0wu0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1995806391',owner_user_name='tempest-TestVolumeBootPattern-1995806391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:05:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4878b5a5bf184852a9ce383caa1c67a4',uuid=3e53c443-92d8-4e5c-bc47-43deb205786b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a9ceef8-458f-4d22-aa65-2dccb71ed1ad", "address": "fa:16:3e:bd:86:0a", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9ceef8-45", "ovs_interfaceid": "7a9ceef8-458f-4d22-aa65-2dccb71ed1ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:05:34.475292 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converting VIF {"id": "7a9ceef8-458f-4d22-aa65-2dccb71ed1ad", "address": "fa:16:3e:bd:86:0a", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9ceef8-45", "ovs_interfaceid": "7a9ceef8-458f-4d22-aa65-2dccb71ed1ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:05:34.476960 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:86:0a,bridge_name='br-int',has_traffic_filtering=True,id=7a9ceef8-458f-4d22-aa65-2dccb71ed1ad,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9ceef8-45') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:05:34.477493 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lazy-loading 'pci_devices' on Instance uuid 3e53c443-92d8-4e5c-bc47-43deb205786b {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:05:34.545585 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:34.553730 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:05:34.557692 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:34.557818 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:34.559101 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:34.559486 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:34.560289 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:34.560859 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:34.667050 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:34.667275 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:34.668363 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:34.668739 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:34.669211 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:34.669400 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:34.701170 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-411bb599-6568-451f-9d0b-565b0386f1cc tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "f63a2253-071a-4a1a-94af-3544b20c39cf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.565s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:34.931645 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lazy-loading 'flavor' on Instance uuid 76097fea-0890-40a8-a902-9f510cd34b52 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:05:34.981559 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] End _get_guest_xml xml=<domain type="qemu">
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:   <uuid>3e53c443-92d8-4e5c-bc47-43deb205786b</uuid>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:   <name>instance-0000002d</name>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:       <nova:name>tempest-TestVolumeBootPattern-server-352995534</nova:name>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:05:30</nova:creationTime>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:       <nova:image uuid="">
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:         <nova:user uuid="4878b5a5bf184852a9ce383caa1c67a4">tempest-TestVolumeBootPattern-1995806391-project-member</nova:user>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:         <nova:project uuid="62ebdb16aee84e22a88dfc8960debd32">tempest-TestVolumeBootPattern-1995806391</nova:project>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:       <nova:root type="volume" uuid=""/>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:         <nova:port uuid="7a9ceef8-458f-4d22-aa65-2dccb71ed1ad">
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:     <system>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:       <entry name="serial">3e53c443-92d8-4e5c-bc47-43deb205786b</entry>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:       <entry name="uuid">3e53c443-92d8-4e5c-bc47-43deb205786b</entry>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:     </system>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:   <os>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:   </os>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:   <features>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:   </features>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:   <devices>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/3e53c443-92d8-4e5c-bc47-43deb205786b/disk.config"/>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:     </disk>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:       <alias name="ua-22e98b1d-1bf5-45ce-b4e6-15a697eeb617"/>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-5"/>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:       <serial>22e98b1d-1bf5-45ce-b4e6-15a697eeb617</serial>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:     </disk>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:bd:86:0a"/>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:       <target dev="tap7a9ceef8-45"/>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:     </interface>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/3e53c443-92d8-4e5c-bc47-43deb205786b/console.log" append="off"/>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:     </serial>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:     <video>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:     </video>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:     </rng>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:   </devices>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]: </domain>
May 21 02:05:34.981559 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:05:34.985506 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Preparing to wait for external event network-vif-plugged-7a9ceef8-458f-4d22-aa65-2dccb71ed1ad {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:05:34.985680 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "3e53c443-92d8-4e5c-bc47-43deb205786b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:34.985864 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "3e53c443-92d8-4e5c-bc47-43deb205786b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:34.986021 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "3e53c443-92d8-4e5c-bc47-43deb205786b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:34.986978 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:05:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-352995534',display_name='tempest-TestVolumeBootPattern-server-352995534',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpattern-server-352995534',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBaRNOqohsNJVOU8i1yx10NByg4YHG0kBqhb8dmc6GQzsAdAAhAV6GFGAs9H1IYquThiDuyR1AIlFlID71ty2Ie/veadDUg9qWuDwTODN9ItjcrF0xf97cKKhCzM0WFlw==',key_name='tempest-keypair-189223710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62ebdb16aee84e22a88dfc8960debd32',ramdisk_id='',reservation_id='r-26g0wu0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1995806391',owner_user_name='tempest-TestVolumeBootPattern-1995806391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:05:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4878b5a5bf184852a9ce383caa1c67a4',uuid=3e53c443-92d8-4e5c-bc47-43deb205786b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a9ceef8-458f-4d22-aa65-2dccb71ed1ad", "address": "fa:16:3e:bd:86:0a", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9ceef8-45", "ovs_interfaceid": "7a9ceef8-458f-4d22-aa65-2dccb71ed1ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:05:34.987180 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converting VIF {"id": "7a9ceef8-458f-4d22-aa65-2dccb71ed1ad", "address": "fa:16:3e:bd:86:0a", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9ceef8-45", "ovs_interfaceid": "7a9ceef8-458f-4d22-aa65-2dccb71ed1ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:05:34.988494 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:86:0a,bridge_name='br-int',has_traffic_filtering=True,id=7a9ceef8-458f-4d22-aa65-2dccb71ed1ad,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9ceef8-45') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:05:34.988662 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:86:0a,bridge_name='br-int',has_traffic_filtering=True,id=7a9ceef8-458f-4d22-aa65-2dccb71ed1ad,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9ceef8-45') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:05:34.989429 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:34.989840 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:34.990084 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:05:34.993452 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:34.993795 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a204a868-b463-5e72-94ca-28e1e2e08564', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:34.997434 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:34.999577 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:05:35.003134 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:35.003405 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a9ceef8-45, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:35.003946 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a9ceef8-45, col_values=(('qos', UUID('9a8b4eb9-0843-4a89-8168-f4a4bd449144')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:35.004181 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a9ceef8-45, col_values=(('external_ids', {'iface-id': '7a9ceef8-458f-4d22-aa65-2dccb71ed1ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:86:0a', 'vm-uuid': '3e53c443-92d8-4e5c-bc47-43deb205786b'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:35.007121 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:35.008684 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:05:35.020716 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:35.022087 np0000001127 nova-compute[98206]: INFO os_vif [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:86:0a,bridge_name='br-int',has_traffic_filtering=True,id=7a9ceef8-458f-4d22-aa65-2dccb71ed1ad,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9ceef8-45')
May 21 02:05:35.068053 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:05:35.068633 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329135.0682669, 6ccaedfe-bec9-4591-b845-acf0cc81d026 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:05:35.069114 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Took 11.91 seconds to spawn the instance on the hypervisor.
May 21 02:05:35.069324 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] VM Resumed (Lifecycle Event)
May 21 02:05:35.070893 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:35.177254 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Took 12.60 seconds to spawn the instance on the hypervisor.
May 21 02:05:35.177436 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:35.298047 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Successfully updated port: 7475b4a3-11de-43b6-9d83-b59933d9e8db {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:05:35.366751 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7fc8ceaf-e03f-4a06-af65-3d6d848fb53b req-f0f1fcb1-50dd-4722-a038-f9cb737117f8 service nova] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Received event network-changed-7475b4a3-11de-43b6-9d83-b59933d9e8db {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:35.366908 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7fc8ceaf-e03f-4a06-af65-3d6d848fb53b req-f0f1fcb1-50dd-4722-a038-f9cb737117f8 service nova] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Refreshing instance network info cache due to event network-changed-7475b4a3-11de-43b6-9d83-b59933d9e8db. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:05:35.367088 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7fc8ceaf-e03f-4a06-af65-3d6d848fb53b req-f0f1fcb1-50dd-4722-a038-f9cb737117f8 service nova] Acquiring lock "refresh_cache-9b4239c5-84df-4d87-a2d4-fb6192408f58" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:05:35.367316 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7fc8ceaf-e03f-4a06-af65-3d6d848fb53b req-f0f1fcb1-50dd-4722-a038-f9cb737117f8 service nova] Acquired lock "refresh_cache-9b4239c5-84df-4d87-a2d4-fb6192408f58" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:05:35.367316 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-7fc8ceaf-e03f-4a06-af65-3d6d848fb53b req-f0f1fcb1-50dd-4722-a038-f9cb737117f8 service nova] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Refreshing network info cache for port 7475b4a3-11de-43b6-9d83-b59933d9e8db {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:05:35.419931 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:05:35.420999 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:05:35.421348 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Creating image(s)
May 21 02:05:35.421873 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Acquiring lock "/opt/stack/data/nova/instances/9b4239c5-84df-4d87-a2d4-fb6192408f58/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:35.422121 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "/opt/stack/data/nova/instances/9b4239c5-84df-4d87-a2d4-fb6192408f58/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:35.422609 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "/opt/stack/data/nova/instances/9b4239c5-84df-4d87-a2d4-fb6192408f58/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:35.423038 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:05:35.425669 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:05:35.428286 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:35.543965 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.115s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:05:35.544595 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:35.545099 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:35.546369 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:05:35.549962 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:05:35.550611 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:35.575437 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:35.590327 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Took 18.31 seconds to build instance.
May 21 02:05:35.595039 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:05:35.652136 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.101s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:05:35.652720 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/9b4239c5-84df-4d87-a2d4-fb6192408f58/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:35.696970 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Took 19.90 seconds to build instance.
May 21 02:05:35.723123 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/9b4239c5-84df-4d87-a2d4-fb6192408f58/disk 1073741824" returned: 0 in 0.070s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:05:35.723602 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.178s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:35.723969 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:35.800295 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Acquiring lock "refresh_cache-9b4239c5-84df-4d87-a2d4-fb6192408f58" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:05:35.823279 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.099s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:05:35.823852 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9b4239c5-84df-4d87-a2d4-fb6192408f58/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:05:35.824160 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b4239c5-84df-4d87-a2d4-fb6192408f58/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:35.873182 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-7fc8ceaf-e03f-4a06-af65-3d6d848fb53b req-f0f1fcb1-50dd-4722-a038-f9cb737117f8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:35.930295 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b4239c5-84df-4d87-a2d4-fb6192408f58/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:05:35.930295 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Cannot resize image /opt/stack/data/nova/instances/9b4239c5-84df-4d87-a2d4-fb6192408f58/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:05:35.930295 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:05:35.930295 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Ensure instance console log exists: /opt/stack/data/nova/instances/9b4239c5-84df-4d87-a2d4-fb6192408f58/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:05:35.930628 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:35.930954 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:35.931125 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:35.951257 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4fcfd20a-be9b-4694-bf73-d182219de18f tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "76097fea-0890-40a8-a902-9f510cd34b52" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.477s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:35.983850 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-7fc8ceaf-e03f-4a06-af65-3d6d848fb53b req-f0f1fcb1-50dd-4722-a038-f9cb737117f8 service nova] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:05:36.070743 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "f63a2253-071a-4a1a-94af-3544b20c39cf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:36.071202 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "f63a2253-071a-4a1a-94af-3544b20c39cf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:36.094533 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-12625604-6e9f-4576-9bc3-86273c6b3857 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Lock "dc3e1d06-6926-4fd2-b5c2-5d6104ba6826" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.831s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:36.153184 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-44a9a391-32aa-40d2-b7c1-9aa9ad4e910f req-8e8fe373-a99e-4625-9f81-a82ba92e322d service nova] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Received event network-vif-plugged-22f09be4-eadb-4267-b696-57e365542719 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:36.153743 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-44a9a391-32aa-40d2-b7c1-9aa9ad4e910f req-8e8fe373-a99e-4625-9f81-a82ba92e322d service nova] Acquiring lock "dc3e1d06-6926-4fd2-b5c2-5d6104ba6826-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:36.154278 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-44a9a391-32aa-40d2-b7c1-9aa9ad4e910f req-8e8fe373-a99e-4625-9f81-a82ba92e322d service nova] Lock "dc3e1d06-6926-4fd2-b5c2-5d6104ba6826-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:36.154278 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-44a9a391-32aa-40d2-b7c1-9aa9ad4e910f req-8e8fe373-a99e-4625-9f81-a82ba92e322d service nova] Lock "dc3e1d06-6926-4fd2-b5c2-5d6104ba6826-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:36.154278 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-44a9a391-32aa-40d2-b7c1-9aa9ad4e910f req-8e8fe373-a99e-4625-9f81-a82ba92e322d service nova] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] No waiting events found dispatching network-vif-plugged-22f09be4-eadb-4267-b696-57e365542719 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:05:36.154481 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-44a9a391-32aa-40d2-b7c1-9aa9ad4e910f req-8e8fe373-a99e-4625-9f81-a82ba92e322d service nova] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Received unexpected event network-vif-plugged-22f09be4-eadb-4267-b696-57e365542719 for instance with vm_state active and task_state None.
May 21 02:05:36.199390 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bb189f82-61ee-4f42-91cc-0c73d5c0d22e tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "6ccaedfe-bec9-4591-b845-acf0cc81d026" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.408s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:36.219655 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-7fc8ceaf-e03f-4a06-af65-3d6d848fb53b req-f0f1fcb1-50dd-4722-a038-f9cb737117f8 service nova] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:05:36.273700 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-4f7f7a7d-2263-4cf0-b62f-66a9cd2d743f req-19c8ae00-972e-424a-98fd-f57ba51c249d service nova] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Received event network-vif-plugged-595ed872-c1da-4406-aeb4-a249c8ebbe07 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:36.274090 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4f7f7a7d-2263-4cf0-b62f-66a9cd2d743f req-19c8ae00-972e-424a-98fd-f57ba51c249d service nova] Acquiring lock "6ccaedfe-bec9-4591-b845-acf0cc81d026-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:36.274346 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4f7f7a7d-2263-4cf0-b62f-66a9cd2d743f req-19c8ae00-972e-424a-98fd-f57ba51c249d service nova] Lock "6ccaedfe-bec9-4591-b845-acf0cc81d026-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:36.274558 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4f7f7a7d-2263-4cf0-b62f-66a9cd2d743f req-19c8ae00-972e-424a-98fd-f57ba51c249d service nova] Lock "6ccaedfe-bec9-4591-b845-acf0cc81d026-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:36.274809 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-4f7f7a7d-2263-4cf0-b62f-66a9cd2d743f req-19c8ae00-972e-424a-98fd-f57ba51c249d service nova] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] No waiting events found dispatching network-vif-plugged-595ed872-c1da-4406-aeb4-a249c8ebbe07 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:05:36.275723 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-4f7f7a7d-2263-4cf0-b62f-66a9cd2d743f req-19c8ae00-972e-424a-98fd-f57ba51c249d service nova] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Received unexpected event network-vif-plugged-595ed872-c1da-4406-aeb4-a249c8ebbe07 for instance with vm_state active and task_state None.
May 21 02:05:36.546733 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:36.561757 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:05:36.561757 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:05:36.561757 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] No VIF found with MAC fa:16:3e:bd:86:0a, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:05:36.562166 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Using config drive
May 21 02:05:36.578625 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lazy-loading 'flavor' on Instance uuid f63a2253-071a-4a1a-94af-3544b20c39cf {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:05:36.725786 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7fc8ceaf-e03f-4a06-af65-3d6d848fb53b req-f0f1fcb1-50dd-4722-a038-f9cb737117f8 service nova] Releasing lock "refresh_cache-9b4239c5-84df-4d87-a2d4-fb6192408f58" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:05:36.729910 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Acquired lock "refresh_cache-9b4239c5-84df-4d87-a2d4-fb6192408f58" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:05:36.729910 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:05:37.072136 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:37.297512 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Creating config drive at /opt/stack/data/nova/instances/3e53c443-92d8-4e5c-bc47-43deb205786b/disk.config
May 21 02:05:37.301210 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3e53c443-92d8-4e5c-bc47-43deb205786b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3b4ezu1b {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:37.339642 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:05:37.358075 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3e53c443-92d8-4e5c-bc47-43deb205786b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3b4ezu1b" returned: 0 in 0.057s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:05:37.558316 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0233fc22-6aee-45b4-8c4a-e4c8d6426ad0 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Acquiring lock "76097fea-0890-40a8-a902-9f510cd34b52" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:37.558494 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0233fc22-6aee-45b4-8c4a-e4c8d6426ad0 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "76097fea-0890-40a8-a902-9f510cd34b52" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:37.558732 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0233fc22-6aee-45b4-8c4a-e4c8d6426ad0 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Acquiring lock "76097fea-0890-40a8-a902-9f510cd34b52-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:37.558880 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0233fc22-6aee-45b4-8c4a-e4c8d6426ad0 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "76097fea-0890-40a8-a902-9f510cd34b52-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:37.559017 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0233fc22-6aee-45b4-8c4a-e4c8d6426ad0 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "76097fea-0890-40a8-a902-9f510cd34b52-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:37.565971 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-0233fc22-6aee-45b4-8c4a-e4c8d6426ad0 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Terminating instance
May 21 02:05:37.591811 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "f63a2253-071a-4a1a-94af-3544b20c39cf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.521s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:37.597549 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:37.803710 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Updating instance_info_cache with network_info: [{"id": "7475b4a3-11de-43b6-9d83-b59933d9e8db", "address": "fa:16:3e:91:3d:5c", "network": {"id": "0618d411-0f50-4ee4-80a9-cbd395ea2c77", "bridge": "br-int", "label": "tempest-TestStampPattern-1490281843-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b72317ce75214e619a14739991461c95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7475b4a3-11", "ovs_interfaceid": "7475b4a3-11de-43b6-9d83-b59933d9e8db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:05:37.930988 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:37.968108 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:38.074073 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-0233fc22-6aee-45b4-8c4a-e4c8d6426ad0 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:05:38.091814 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:38.102115 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:38.105611 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:38.113363 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-18c3cf83-d417-4489-ba0b-a7355c9cd268 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Acquiring lock "dc3e1d06-6926-4fd2-b5c2-5d6104ba6826" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:38.116588 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-18c3cf83-d417-4489-ba0b-a7355c9cd268 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Lock "dc3e1d06-6926-4fd2-b5c2-5d6104ba6826" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:38.116588 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-18c3cf83-d417-4489-ba0b-a7355c9cd268 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Acquiring lock "dc3e1d06-6926-4fd2-b5c2-5d6104ba6826-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:38.116844 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-18c3cf83-d417-4489-ba0b-a7355c9cd268 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Lock "dc3e1d06-6926-4fd2-b5c2-5d6104ba6826-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:38.117086 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-18c3cf83-d417-4489-ba0b-a7355c9cd268 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Lock "dc3e1d06-6926-4fd2-b5c2-5d6104ba6826-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:38.122103 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-18c3cf83-d417-4489-ba0b-a7355c9cd268 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Terminating instance
May 21 02:05:38.143977 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:38.306441 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Releasing lock "refresh_cache-9b4239c5-84df-4d87-a2d4-fb6192408f58" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:05:38.306888 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Instance network_info: |[{"id": "7475b4a3-11de-43b6-9d83-b59933d9e8db", "address": "fa:16:3e:91:3d:5c", "network": {"id": "0618d411-0f50-4ee4-80a9-cbd395ea2c77", "bridge": "br-int", "label": "tempest-TestStampPattern-1490281843-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b72317ce75214e619a14739991461c95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7475b4a3-11", "ovs_interfaceid": "7475b4a3-11de-43b6-9d83-b59933d9e8db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:05:38.309448 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Start _get_guest_xml network_info=[{"id": "7475b4a3-11de-43b6-9d83-b59933d9e8db", "address": "fa:16:3e:91:3d:5c", "network": {"id": "0618d411-0f50-4ee4-80a9-cbd395ea2c77", "bridge": "br-int", "label": "tempest-TestStampPattern-1490281843-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b72317ce75214e619a14739991461c95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7475b4a3-11", "ovs_interfaceid": "7475b4a3-11de-43b6-9d83-b59933d9e8db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:05:38.320867 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:05:38.323413 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-TestStampPattern-server-1203257398', uuid='9b4239c5-84df-4d87-a2d4-fb6192408f58'), owner=OwnerMeta(userid='64aaf3f477c745199d5b7f171309b623', username='tempest-TestStampPattern-1911932868-project-member', projectid='b72317ce75214e619a14739991461c95', projectname='tempest-TestStampPattern-1911932868'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7475b4a3-11de-43b6-9d83-b59933d9e8db", "address": "fa:16:3e:91:3d:5c", "network": {"id": "0618d411-0f50-4ee4-80a9-cbd395ea2c77", "bridge": "br-int", "label": "tempest-TestStampPattern-1490281843-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b72317ce75214e619a14739991461c95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7475b4a3-11", "ovs_interfaceid": "7475b4a3-11de-43b6-9d83-b59933d9e8db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329138.3223634) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:05:38.328898 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:05:38.329465 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:05:38.333170 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:05:38.333550 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:05:38.334746 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:05:38.335358 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:05:38.335777 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:05:38.335777 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:05:38.335938 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:05:38.336083 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:05:38.336212 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:05:38.338616 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:05:38.338616 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:05:38.338616 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:05:38.338616 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:05:38.338616 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:05:38.362441 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:05:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1203257398',display_name='tempest-TestStampPattern-server-1203257398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-teststamppattern-server-1203257398',id=46,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGf4TQxcgjp3MdbOkpJAxq/86PTabA2Iwtv0x1R12epynbyJ/FSoqTOYMbbXiHEg1FsyJTACHLRLEZYTIrFk0vHyzvn2kQ5rh2NeRgjlpvVyNBNMpcSWAWoXIY5iI4y9Gg==',key_name='tempest-TestStampPattern-1436185249',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b72317ce75214e619a14739991461c95',ramdisk_id='',reservation_id='r-sgpj02lw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1911932868',owner_user_name='tempest-TestStampPattern-1911932868-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:05:34Z,user_data=None,user_id='64aaf3f477c745199d5b7f171309b623',uuid=9b4239c5-84df-4d87-a2d4-fb6192408f58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7475b4a3-11de-43b6-9d83-b59933d9e8db", "address": "fa:16:3e:91:3d:5c", "network": {"id": "0618d411-0f50-4ee4-80a9-cbd395ea2c77", "bridge": "br-int", "label": "tempest-TestStampPattern-1490281843-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b72317ce75214e619a14739991461c95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7475b4a3-11", "ovs_interfaceid": "7475b4a3-11de-43b6-9d83-b59933d9e8db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:05:38.362441 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Converting VIF {"id": "7475b4a3-11de-43b6-9d83-b59933d9e8db", "address": "fa:16:3e:91:3d:5c", "network": {"id": "0618d411-0f50-4ee4-80a9-cbd395ea2c77", "bridge": "br-int", "label": "tempest-TestStampPattern-1490281843-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b72317ce75214e619a14739991461c95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7475b4a3-11", "ovs_interfaceid": "7475b4a3-11de-43b6-9d83-b59933d9e8db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:05:38.362834 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:3d:5c,bridge_name='br-int',has_traffic_filtering=True,id=7475b4a3-11de-43b6-9d83-b59933d9e8db,network=Network(0618d411-0f50-4ee4-80a9-cbd395ea2c77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7475b4a3-11') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:05:38.364288 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b4239c5-84df-4d87-a2d4-fb6192408f58 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:05:38.410642 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-809eb3c3-612d-4b88-858e-d096ff5f6b0c req-047a6adb-ba86-4221-bd31-7d1056621b3d service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Received event network-vif-unplugged-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:38.410934 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-809eb3c3-612d-4b88-858e-d096ff5f6b0c req-047a6adb-ba86-4221-bd31-7d1056621b3d service nova] Acquiring lock "76097fea-0890-40a8-a902-9f510cd34b52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:38.411361 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-809eb3c3-612d-4b88-858e-d096ff5f6b0c req-047a6adb-ba86-4221-bd31-7d1056621b3d service nova] Lock "76097fea-0890-40a8-a902-9f510cd34b52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:38.412414 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-809eb3c3-612d-4b88-858e-d096ff5f6b0c req-047a6adb-ba86-4221-bd31-7d1056621b3d service nova] Lock "76097fea-0890-40a8-a902-9f510cd34b52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:38.412997 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-809eb3c3-612d-4b88-858e-d096ff5f6b0c req-047a6adb-ba86-4221-bd31-7d1056621b3d service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] No waiting events found dispatching network-vif-unplugged-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:05:38.413718 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-809eb3c3-612d-4b88-858e-d096ff5f6b0c req-047a6adb-ba86-4221-bd31-7d1056621b3d service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Received event network-vif-unplugged-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:05:38.421684 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:38.434757 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:38.436201 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:38.470532 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:38.481494 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:38.495713 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.99951898800009 future=<Future at 0x71c0584616a0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:05:38.495713 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999074284000017 future=<Future at 0x71c0584616a0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:05:38.495799 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.998827065000114 future=<Future at 0x71c0584616a0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:05:38.504531 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Instance destroyed successfully.
May 21 02:05:38.505104 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-0233fc22-6aee-45b4-8c4a-e4c8d6426ad0 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lazy-loading 'resources' on Instance uuid 76097fea-0890-40a8-a902-9f510cd34b52 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:05:38.626267 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-18c3cf83-d417-4489-ba0b-a7355c9cd268 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:05:38.640329 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:38.665746 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:38.677284 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:38.687287 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:38.716703 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:38.751299 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:38.801167 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:38.858698 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "f63a2253-071a-4a1a-94af-3544b20c39cf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:38.858893 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "f63a2253-071a-4a1a-94af-3544b20c39cf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:38.859103 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Attaching volume 517928f6-d49a-4bf2-b1b8-bee0a4dba99f to /dev/vdc
May 21 02:05:38.870629 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] End _get_guest_xml xml=<domain type="qemu">
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:   <uuid>9b4239c5-84df-4d87-a2d4-fb6192408f58</uuid>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:   <name>instance-0000002e</name>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:       <nova:name>tempest-TestStampPattern-server-1203257398</nova:name>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:05:38</nova:creationTime>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:         <nova:user uuid="64aaf3f477c745199d5b7f171309b623">tempest-TestStampPattern-1911932868-project-member</nova:user>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:         <nova:project uuid="b72317ce75214e619a14739991461c95">tempest-TestStampPattern-1911932868</nova:project>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:         <nova:port uuid="7475b4a3-11de-43b6-9d83-b59933d9e8db">
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:     <system>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:       <entry name="serial">9b4239c5-84df-4d87-a2d4-fb6192408f58</entry>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:       <entry name="uuid">9b4239c5-84df-4d87-a2d4-fb6192408f58</entry>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:     </system>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:   <os>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:   </os>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:   <features>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:   </features>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:   <devices>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/9b4239c5-84df-4d87-a2d4-fb6192408f58/disk"/>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:     </disk>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/9b4239c5-84df-4d87-a2d4-fb6192408f58/disk.config"/>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:     </disk>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:91:3d:5c"/>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:       <target dev="tap7475b4a3-11"/>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:     </interface>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/9b4239c5-84df-4d87-a2d4-fb6192408f58/console.log" append="off"/>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:     </serial>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:     <video>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:     </video>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:     </rng>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:   </devices>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]: </domain>
May 21 02:05:38.870629 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:05:38.874266 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Preparing to wait for external event network-vif-plugged-7475b4a3-11de-43b6-9d83-b59933d9e8db {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:05:38.874266 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Acquiring lock "9b4239c5-84df-4d87-a2d4-fb6192408f58-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:38.874266 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "9b4239c5-84df-4d87-a2d4-fb6192408f58-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:38.874266 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "9b4239c5-84df-4d87-a2d4-fb6192408f58-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:38.874479 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:05:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1203257398',display_name='tempest-TestStampPattern-server-1203257398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-teststamppattern-server-1203257398',id=46,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGf4TQxcgjp3MdbOkpJAxq/86PTabA2Iwtv0x1R12epynbyJ/FSoqTOYMbbXiHEg1FsyJTACHLRLEZYTIrFk0vHyzvn2kQ5rh2NeRgjlpvVyNBNMpcSWAWoXIY5iI4y9Gg==',key_name='tempest-TestStampPattern-1436185249',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b72317ce75214e619a14739991461c95',ramdisk_id='',reservation_id='r-sgpj02lw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1911932868',owner_user_name='tempest-TestStampPattern-1911932868-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:05:34Z,user_data=None,user_id='64aaf3f477c745199d5b7f171309b623',uuid=9b4239c5-84df-4d87-a2d4-fb6192408f58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7475b4a3-11de-43b6-9d83-b59933d9e8db", "address": "fa:16:3e:91:3d:5c", "network": {"id": "0618d411-0f50-4ee4-80a9-cbd395ea2c77", "bridge": "br-int", "label": "tempest-TestStampPattern-1490281843-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b72317ce75214e619a14739991461c95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7475b4a3-11", "ovs_interfaceid": "7475b4a3-11de-43b6-9d83-b59933d9e8db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:05:38.874695 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Converting VIF {"id": "7475b4a3-11de-43b6-9d83-b59933d9e8db", "address": "fa:16:3e:91:3d:5c", "network": {"id": "0618d411-0f50-4ee4-80a9-cbd395ea2c77", "bridge": "br-int", "label": "tempest-TestStampPattern-1490281843-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b72317ce75214e619a14739991461c95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7475b4a3-11", "ovs_interfaceid": "7475b4a3-11de-43b6-9d83-b59933d9e8db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:05:38.875671 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:3d:5c,bridge_name='br-int',has_traffic_filtering=True,id=7475b4a3-11de-43b6-9d83-b59933d9e8db,network=Network(0618d411-0f50-4ee4-80a9-cbd395ea2c77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7475b4a3-11') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:05:38.875671 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:3d:5c,bridge_name='br-int',has_traffic_filtering=True,id=7475b4a3-11de-43b6-9d83-b59933d9e8db,network=Network(0618d411-0f50-4ee4-80a9-cbd395ea2c77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7475b4a3-11') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:05:38.875859 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:38.876252 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:38.876830 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:05:38.877607 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:38.879358 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '30ed0f81-18b4-5bad-8124-d01fbd0ca386', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:38.880683 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:38.881758 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:05:38.894883 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:38.898815 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:38.899394 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7475b4a3-11, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:38.899394 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7475b4a3-11, col_values=(('qos', UUID('740c9fe7-4869-4ad1-9375-d1b8c83bd5b0')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:38.900455 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7475b4a3-11, col_values=(('external_ids', {'iface-id': '7475b4a3-11de-43b6-9d83-b59933d9e8db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:3d:5c', 'vm-uuid': '9b4239c5-84df-4d87-a2d4-fb6192408f58'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:38.901450 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:38.905496 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:05:38.919746 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:38.920897 np0000001127 nova-compute[98206]: INFO os_vif [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:3d:5c,bridge_name='br-int',has_traffic_filtering=True,id=7475b4a3-11de-43b6-9d83-b59933d9e8db,network=Network(0618d411-0f50-4ee4-80a9-cbd395ea2c77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7475b4a3-11')
May 21 02:05:38.929893 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:05:38.948018 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:05:38.980862 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:39.016010 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-0233fc22-6aee-45b4-8c4a-e4c8d6426ad0 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:03:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1252242961',display_name='tempest-ServerStableDeviceRescueTest-server-1252242961',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-serverstabledevicerescuetest-server-1252242961',id=35,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHXCzQMtcvcohxOdCdKixRwGu+ErSI1etxf94mKw3iE+m9xL8VE+MVuRtLXTemgUp3Ov8UZFqLioHdWgMENwGDRghzsJP56fHg3vEKwC2p9V2H3plwGhSr7x3Y5MpdP3g==',key_name='tempest-keypair-900990808',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:04:51Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e98d81a820544f078c16b171f1e8b65c',ramdisk_id='',reservation_id='r-0pmad0cj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1611761335',owner_user_name='tempest-ServerStableDeviceRescueTest-1611761335-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:04:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1caa8b5626fb4e5988cc4c80fb335a00',uuid=76097fea-0890-40a8-a902-9f510cd34b52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f11d80e2-4ef4-404d-9b12-4b33f3e9caa2", "address": "fa:16:3e:4b:b4:81", "network": {"id": "8f999b5c-800e-44f7-84c5-6eff98ea03cb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-569078034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e98d81a820544f078c16b171f1e8b65c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11d80e2-4e", "ovs_interfaceid": "f11d80e2-4ef4-404d-9b12-4b33f3e9caa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:05:39.016328 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-0233fc22-6aee-45b4-8c4a-e4c8d6426ad0 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Converting VIF {"id": "f11d80e2-4ef4-404d-9b12-4b33f3e9caa2", "address": "fa:16:3e:4b:b4:81", "network": {"id": "8f999b5c-800e-44f7-84c5-6eff98ea03cb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-569078034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e98d81a820544f078c16b171f1e8b65c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11d80e2-4e", "ovs_interfaceid": "f11d80e2-4ef4-404d-9b12-4b33f3e9caa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:05:39.018343 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-0233fc22-6aee-45b4-8c4a-e4c8d6426ad0 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:b4:81,bridge_name='br-int',has_traffic_filtering=True,id=f11d80e2-4ef4-404d-9b12-4b33f3e9caa2,network=Network(8f999b5c-800e-44f7-84c5-6eff98ea03cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf11d80e2-4e') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:05:39.018921 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-0233fc22-6aee-45b4-8c4a-e4c8d6426ad0 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:b4:81,bridge_name='br-int',has_traffic_filtering=True,id=f11d80e2-4ef4-404d-9b12-4b33f3e9caa2,network=Network(8f999b5c-800e-44f7-84c5-6eff98ea03cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf11d80e2-4e') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:05:39.027146 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999587385000268 future=<Future at 0x71c098396bd0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:05:39.028240 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:39.030027 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf11d80e2-4e, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:39.034160 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:39.036165 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:05:39.037974 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Instance destroyed successfully.
May 21 02:05:39.038741 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-18c3cf83-d417-4489-ba0b-a7355c9cd268 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Lazy-loading 'resources' on Instance uuid dc3e1d06-6926-4fd2-b5c2-5d6104ba6826 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:05:39.044089 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:05:39.044809 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:05:39.046635 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:39.048834 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:39.049038 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c8f10512-83ea-4d09-9957-721169a0df51) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:39.052119 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:39.056662 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:05:39.059726 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:05:39.061223 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:feca:ebaf', 'fe80::40b3:49ff:feb3:3b55', 'fe80::fc16:3eff:fee1:2e46', 'fe80::2482:bff:fe1b:902b', 'fe80::fc16:3eff:fe0f:28a1', 'fe80::440a:38ff:fe27:fa24', 'fe80::fc16:3eff:febd:860a', 'fe80::c44d:25ff:fe10:25cb'] 
May 21 02:05:39.062204 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:05:39.062204 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:05:39.062740 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:05:39.063010 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Updating existing volume attachment record: ddeb7919-1291-440d-b841-2e5bc0c3d1fb {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:05:39.066354 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:39.071260 np0000001127 nova-compute[98206]: INFO os_vif [None req-0233fc22-6aee-45b4-8c4a-e4c8d6426ad0 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:b4:81,bridge_name='br-int',has_traffic_filtering=True,id=f11d80e2-4ef4-404d-9b12-4b33f3e9caa2,network=Network(8f999b5c-800e-44f7-84c5-6eff98ea03cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf11d80e2-4e')
May 21 02:05:39.071940 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-0233fc22-6aee-45b4-8c4a-e4c8d6426ad0 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Deleting instance files /opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52_del
May 21 02:05:39.073430 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-0233fc22-6aee-45b4-8c4a-e4c8d6426ad0 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Deletion of /opt/stack/data/nova/instances/76097fea-0890-40a8-a902-9f510cd34b52_del complete
May 21 02:05:39.328188 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329139.3270226, 3e53c443-92d8-4e5c-bc47-43deb205786b => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:05:39.328188 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] VM Started (Lifecycle Event)
May 21 02:05:39.549735 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-18c3cf83-d417-4489-ba0b-a7355c9cd268 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1686232613',display_name='tempest-VolumesActionsTest-instance-1686232613',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumesactionstest-instance-1686232613',id=44,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:05:35Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e8db1d8006574d1e9f7117042461bce4',ramdisk_id='',reservation_id='r-0rlxf6sh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1094570120',owner_user_name='tempest-VolumesActionsTest-1094570120-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:05:35Z,user_data=None,user_id='67349a30ec514c90a316eb35d579b04b',uuid=dc3e1d06-6926-4fd2-b5c2-5d6104ba6826,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22f09be4-eadb-4267-b696-57e365542719", "address": "fa:16:3e:4b:bc:3f", "network": {"id": "efb73811-c979-4f83-9b27-67a93594f8c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-674032884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8db1d8006574d1e9f7117042461bce4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f09be4-ea", "ovs_interfaceid": "22f09be4-eadb-4267-b696-57e365542719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:05:39.550023 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-18c3cf83-d417-4489-ba0b-a7355c9cd268 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Converting VIF {"id": "22f09be4-eadb-4267-b696-57e365542719", "address": "fa:16:3e:4b:bc:3f", "network": {"id": "efb73811-c979-4f83-9b27-67a93594f8c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-674032884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8db1d8006574d1e9f7117042461bce4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f09be4-ea", "ovs_interfaceid": "22f09be4-eadb-4267-b696-57e365542719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:05:39.552808 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-18c3cf83-d417-4489-ba0b-a7355c9cd268 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:bc:3f,bridge_name='br-int',has_traffic_filtering=True,id=22f09be4-eadb-4267-b696-57e365542719,network=Network(efb73811-c979-4f83-9b27-67a93594f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22f09be4-ea') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:05:39.552808 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-18c3cf83-d417-4489-ba0b-a7355c9cd268 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:bc:3f,bridge_name='br-int',has_traffic_filtering=True,id=22f09be4-eadb-4267-b696-57e365542719,network=Network(efb73811-c979-4f83-9b27-67a93594f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22f09be4-ea') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:05:39.552808 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:39.552808 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22f09be4-ea, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:39.555390 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:39.555390 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:05:39.561145 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:39.562331 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:39.562627 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6366ffae-369a-4288-83cd-88749cf819bb) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:39.565445 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:39.565445 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:05:39.570741 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:39.572782 np0000001127 nova-compute[98206]: INFO os_vif [None req-18c3cf83-d417-4489-ba0b-a7355c9cd268 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:bc:3f,bridge_name='br-int',has_traffic_filtering=True,id=22f09be4-eadb-4267-b696-57e365542719,network=Network(efb73811-c979-4f83-9b27-67a93594f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22f09be4-ea')
May 21 02:05:39.573664 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-18c3cf83-d417-4489-ba0b-a7355c9cd268 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Deleting instance files /opt/stack/data/nova/instances/dc3e1d06-6926-4fd2-b5c2-5d6104ba6826_del
May 21 02:05:39.574187 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-18c3cf83-d417-4489-ba0b-a7355c9cd268 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Deletion of /opt/stack/data/nova/instances/dc3e1d06-6926-4fd2-b5c2-5d6104ba6826_del complete
May 21 02:05:39.582035 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-0233fc22-6aee-45b4-8c4a-e4c8d6426ad0 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Took 1.51 seconds to destroy the instance on the hypervisor.
May 21 02:05:39.582316 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-0233fc22-6aee-45b4-8c4a-e4c8d6426ad0 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:05:39.582549 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:05:39.582696 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:05:39.583090 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:39.641412 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:05:39.641886 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f', 'iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '517928f6-d49a-4bf2-b1b8-bee0a4dba99f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:05:39.642061 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:05:39.644389 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:05:39.644389 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f', 'iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '517928f6-d49a-4bf2-b1b8-bee0a4dba99f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:05:39.661349 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:39.663958 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:05:39.664716 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:05:39.664973 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:05:39.666010 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:05:39.667229 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:05:39.668306 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:05:39.682963 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:05:39.682963 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:39.690117 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:05:39.690117 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:39.704154 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f] added
May 21 02:05:39.704154 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:05:39.704154 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:05:39.704154 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:05:39.704154 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:05:39.704154 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:05:39.704154 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:39.704421 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:05:39.704746 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0397(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:05:39.705041 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:05:39.705514 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f] added
May 21 02:05:39.705514 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:05:39.705514 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:05:39.705514 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:05:39.705514 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:05:39.705514 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:05:39.705514 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:39.705699 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:05:39.705956 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0386(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:05:39.706149 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:05:39.713889 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Acquiring lock "45f01b41-a43c-4ddf-aa07-22f8c2c50758" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:39.715669 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "45f01b41-a43c-4ddf-aa07-22f8c2c50758" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:39.832215 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:39.834244 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329139.8340178, 3e53c443-92d8-4e5c-bc47-43deb205786b => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:05:39.834353 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] VM Paused (Lifecycle Event)
May 21 02:05:40.080385 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-18c3cf83-d417-4489-ba0b-a7355c9cd268 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Took 1.45 seconds to destroy the instance on the hypervisor.
May 21 02:05:40.081635 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-18c3cf83-d417-4489-ba0b-a7355c9cd268 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:05:40.081929 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:05:40.082012 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:05:40.082274 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:40.216734 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "16a0cc8d-c65b-4166-ad1a-5318b18ed00e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:40.217025 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "16a0cc8d-c65b-4166-ad1a-5318b18ed00e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:40.220238 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:05:40.241075 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:40.337763 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:40.340536 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:05:40.453722 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:05:40.453917 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:05:40.454668 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] No VIF found with MAC fa:16:3e:91:3d:5c, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:05:40.455443 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Using config drive
May 21 02:05:40.542331 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c4d7ea37-c327-412c-ae90-415032694567 req-5cce2d98-7229-4aea-908f-eb6e42f5b28b service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Received event network-vif-unplugged-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:40.542331 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c4d7ea37-c327-412c-ae90-415032694567 req-5cce2d98-7229-4aea-908f-eb6e42f5b28b service nova] Acquiring lock "76097fea-0890-40a8-a902-9f510cd34b52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:40.542331 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c4d7ea37-c327-412c-ae90-415032694567 req-5cce2d98-7229-4aea-908f-eb6e42f5b28b service nova] Lock "76097fea-0890-40a8-a902-9f510cd34b52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:40.542507 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c4d7ea37-c327-412c-ae90-415032694567 req-5cce2d98-7229-4aea-908f-eb6e42f5b28b service nova] Lock "76097fea-0890-40a8-a902-9f510cd34b52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:40.543456 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c4d7ea37-c327-412c-ae90-415032694567 req-5cce2d98-7229-4aea-908f-eb6e42f5b28b service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] No waiting events found dispatching network-vif-unplugged-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:05:40.543456 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c4d7ea37-c327-412c-ae90-415032694567 req-5cce2d98-7229-4aea-908f-eb6e42f5b28b service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Received event network-vif-unplugged-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:05:40.543456 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c4d7ea37-c327-412c-ae90-415032694567 req-5cce2d98-7229-4aea-908f-eb6e42f5b28b service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Received event network-vif-deleted-f11d80e2-4ef4-404d-9b12-4b33f3e9caa2 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:40.543456 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-c4d7ea37-c327-412c-ae90-415032694567 req-5cce2d98-7229-4aea-908f-eb6e42f5b28b service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Neutron deleted interface f11d80e2-4ef4-404d-9b12-4b33f3e9caa2; detaching it from the instance and deleting it from the info cache
May 21 02:05:40.543844 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-c4d7ea37-c327-412c-ae90-415032694567 req-5cce2d98-7229-4aea-908f-eb6e42f5b28b service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:05:40.609758 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bd030ec0-fd36-4bdf-9c61-938d6151d316 req-bd7db460-1c9e-42e8-8e25-9009a8130565 service nova] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Received event network-vif-deleted-22f09be4-eadb-4267-b696-57e365542719 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:40.609882 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-bd030ec0-fd36-4bdf-9c61-938d6151d316 req-bd7db460-1c9e-42e8-8e25-9009a8130565 service nova] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Neutron deleted interface 22f09be4-eadb-4267-b696-57e365542719; detaching it from the instance and deleting it from the info cache
May 21 02:05:40.609995 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-bd030ec0-fd36-4bdf-9c61-938d6151d316 req-bd7db460-1c9e-42e8-8e25-9009a8130565 service nova] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:05:40.705552 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:05:40.706343 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:05:40.707927 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:05:40.723255 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:05:40.723255 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:40.729692 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:05:40.733755 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:05:40.733755 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:40.742167 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:40.749933 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:40.760079 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:40.760079 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:40.760079 np0000001127 nova-compute[98206]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:40.760079 np0000001127 nova-compute[98206]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:40.760079 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:40.760079 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:40.760079 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:05:40.760359 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsi session list stdout=tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:40.760359 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:40.760359 np0000001127 nova-compute[98206]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:40.760359 np0000001127 nova-compute[98206]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:40.760359 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:40.760359 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:40.760359 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:05:40.768420 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:40.768420 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:40.768420 np0000001127 nova-compute[98206]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:40.768420 np0000001127 nova-compute[98206]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:40.768420 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:40.768420 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:40.768420 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:05:40.768809 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsi session list stdout=tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:40.768809 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:40.768809 np0000001127 nova-compute[98206]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:40.768809 np0000001127 nova-compute[98206]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:40.768809 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:40.768809 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:40.768809 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:05:40.791210 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:40.791386 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:40.796054 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:05:40.796054 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Claim successful on node np0000001127
May 21 02:05:40.815343 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f, portal: 192.168.40.100,3260]
May 21 02:05:40.815343 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f, portal: 192.168.40.100,3260] successful.
May 21 02:05:40.815343 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:40.830699 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:40.834330 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f, portal: 192.168.50.100,3260]
May 21 02:05:40.834330 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f, portal: 192.168.50.100,3260] successful.
May 21 02:05:40.834330 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:40.845045 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:05:40.848638 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:40.853442 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f (non-flash)
May 21 02:05:40.853442 np0000001127 nova-compute[98206]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f (non-flash)
May 21 02:05:40.853442 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:40.853442 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:40.853442 np0000001127 nova-compute[98206]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:40.853442 np0000001127 nova-compute[98206]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:40.853442 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:40.853442 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:40.853442 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:05:40.853793 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f (non-flash)
May 21 02:05:40.853793 np0000001127 nova-compute[98206]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f (non-flash)
May 21 02:05:40.853793 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:40.853793 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:40.853793 np0000001127 nova-compute[98206]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:40.853793 np0000001127 nova-compute[98206]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:40.853793 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:40.853793 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:40.853793 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:05:40.854178 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.189s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:05:40.854178 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:05:40.854846 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] HCTL ('9', '-', '-', 0) found on session 100 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:05:40.854963 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:05:40.871184 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f (non-flash)
May 21 02:05:40.871184 np0000001127 nova-compute[98206]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f (non-flash)
May 21 02:05:40.871184 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:40.871184 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:40.871184 np0000001127 nova-compute[98206]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:40.871184 np0000001127 nova-compute[98206]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:40.871184 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:40.871184 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:40.871184 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:05:40.871184 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f (non-flash)
May 21 02:05:40.871184 np0000001127 nova-compute[98206]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f (non-flash)
May 21 02:05:40.871184 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:40.871184 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:40.871184 np0000001127 nova-compute[98206]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:40.871184 np0000001127 nova-compute[98206]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:40.871184 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:40.871184 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:40.871184 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:05:40.871184 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.203s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:05:40.871184 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:05:40.872508 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] HCTL ('10', '-', '-', 0) found on session 101 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:05:40.872508 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:05:40.873946 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Searching for a device in session 100 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:05:40.873946 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '517928f6-d49a-4bf2-b1b8-bee0a4dba99f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:05:40.888433 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Searching for a device in session 101 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:05:40.888687 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '517928f6-d49a-4bf2-b1b8-bee0a4dba99f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:05:40.962519 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:41.051713 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c4d7ea37-c327-412c-ae90-415032694567 req-5cce2d98-7229-4aea-908f-eb6e42f5b28b service nova] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Detach interface failed, port_id=f11d80e2-4ef4-404d-9b12-4b33f3e9caa2, reason: Instance 76097fea-0890-40a8-a902-9f510cd34b52 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:05:41.053327 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:05:41.112495 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Creating config drive at /opt/stack/data/nova/instances/9b4239c5-84df-4d87-a2d4-fb6192408f58/disk.config
May 21 02:05:41.114406 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bd030ec0-fd36-4bdf-9c61-938d6151d316 req-bd7db460-1c9e-42e8-8e25-9009a8130565 service nova] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Detach interface failed, port_id=22f09be4-eadb-4267-b696-57e365542719, reason: Instance dc3e1d06-6926-4fd2-b5c2-5d6104ba6826 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:05:41.117335 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9b4239c5-84df-4d87-a2d4-fb6192408f58/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkazpmoko {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:41.170037 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9b4239c5-84df-4d87-a2d4-fb6192408f58/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkazpmoko" returned: 0 in 0.052s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:05:41.209490 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Took 1.63 seconds to deallocate network for instance.
May 21 02:05:41.296695 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:41.543795 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:41.559098 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Took 1.48 seconds to deallocate network for instance.
May 21 02:05:41.641537 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:41.663670 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:41.664908 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:41.667492 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:05:41.724714 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0233fc22-6aee-45b4-8c4a-e4c8d6426ad0 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:41.767507 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:41.900695 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-37adbd1e-dad3-4212-b178-5cc1c988a96b req-d5844a5f-646a-4ff5-89d0-03f13f6096cb service nova] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Received event network-vif-plugged-7475b4a3-11de-43b6-9d83-b59933d9e8db {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:41.902912 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-37adbd1e-dad3-4212-b178-5cc1c988a96b req-d5844a5f-646a-4ff5-89d0-03f13f6096cb service nova] Acquiring lock "9b4239c5-84df-4d87-a2d4-fb6192408f58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:41.903174 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-37adbd1e-dad3-4212-b178-5cc1c988a96b req-d5844a5f-646a-4ff5-89d0-03f13f6096cb service nova] Lock "9b4239c5-84df-4d87-a2d4-fb6192408f58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:41.903396 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-37adbd1e-dad3-4212-b178-5cc1c988a96b req-d5844a5f-646a-4ff5-89d0-03f13f6096cb service nova] Lock "9b4239c5-84df-4d87-a2d4-fb6192408f58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:41.903658 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-37adbd1e-dad3-4212-b178-5cc1c988a96b req-d5844a5f-646a-4ff5-89d0-03f13f6096cb service nova] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Processing event network-vif-plugged-7475b4a3-11de-43b6-9d83-b59933d9e8db {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:05:42.060392 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:42.064551 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-18c3cf83-d417-4489-ba0b-a7355c9cd268 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:42.064999 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:42.104246 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:42.377601 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:05:42.377902 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:05:42.502496 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329142.5002732, 9b4239c5-84df-4d87-a2d4-fb6192408f58 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:05:42.502496 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:05:42.502496 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] VM Started (Lifecycle Event)
May 21 02:05:42.509280 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:05:42.514263 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Instance spawned successfully.
May 21 02:05:42.514263 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:05:42.684710 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-5a065076-259a-4857-a677-48573cbebddf req-7a5e4c1a-969c-4313-9887-f3e92a03a3f5 service nova] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Received event network-vif-plugged-7a9ceef8-458f-4d22-aa65-2dccb71ed1ad {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:42.684710 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5a065076-259a-4857-a677-48573cbebddf req-7a5e4c1a-969c-4313-9887-f3e92a03a3f5 service nova] Acquiring lock "3e53c443-92d8-4e5c-bc47-43deb205786b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:42.684710 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5a065076-259a-4857-a677-48573cbebddf req-7a5e4c1a-969c-4313-9887-f3e92a03a3f5 service nova] Lock "3e53c443-92d8-4e5c-bc47-43deb205786b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:42.684710 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5a065076-259a-4857-a677-48573cbebddf req-7a5e4c1a-969c-4313-9887-f3e92a03a3f5 service nova] Lock "3e53c443-92d8-4e5c-bc47-43deb205786b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:42.685436 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-5a065076-259a-4857-a677-48573cbebddf req-7a5e4c1a-969c-4313-9887-f3e92a03a3f5 service nova] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Processing event network-vif-plugged-7a9ceef8-458f-4d22-aa65-2dccb71ed1ad {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:05:42.685436 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-5a065076-259a-4857-a677-48573cbebddf req-7a5e4c1a-969c-4313-9887-f3e92a03a3f5 service nova] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Received event network-vif-plugged-7a9ceef8-458f-4d22-aa65-2dccb71ed1ad {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:42.685436 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5a065076-259a-4857-a677-48573cbebddf req-7a5e4c1a-969c-4313-9887-f3e92a03a3f5 service nova] Acquiring lock "3e53c443-92d8-4e5c-bc47-43deb205786b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:42.685436 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5a065076-259a-4857-a677-48573cbebddf req-7a5e4c1a-969c-4313-9887-f3e92a03a3f5 service nova] Lock "3e53c443-92d8-4e5c-bc47-43deb205786b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:42.685436 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5a065076-259a-4857-a677-48573cbebddf req-7a5e4c1a-969c-4313-9887-f3e92a03a3f5 service nova] Lock "3e53c443-92d8-4e5c-bc47-43deb205786b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:42.685436 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-5a065076-259a-4857-a677-48573cbebddf req-7a5e4c1a-969c-4313-9887-f3e92a03a3f5 service nova] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] No waiting events found dispatching network-vif-plugged-7a9ceef8-458f-4d22-aa65-2dccb71ed1ad {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:05:42.685651 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-5a065076-259a-4857-a677-48573cbebddf req-7a5e4c1a-969c-4313-9887-f3e92a03a3f5 service nova] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Received unexpected event network-vif-plugged-7a9ceef8-458f-4d22-aa65-2dccb71ed1ad for instance with vm_state building and task_state spawning.
May 21 02:05:42.686329 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Found WWN 3300000004eb23052 for multipath device dm-1 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:05:42.687519 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Instance event wait completed in 3 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:05:42.687736 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.044s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:05:42.687994 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] <== connect_volume: return (3046ms) {'type': 'block', 'scsi_wwn': '3300000004eb23052', 'path': '/dev/dm-1', 'multipath_id': '3300000004eb23052'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:05:42.688204 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004eb23052', 'path': '/dev/dm-1', 'multipath_id': '3300000004eb23052'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:05:42.692298 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:05:42.694438 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lazy-loading 'flavor' on Instance uuid f63a2253-071a-4a1a-94af-3544b20c39cf {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:05:42.697793 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Instance spawned successfully.
May 21 02:05:42.697793 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:05:42.880892 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:05:43.004615 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:43.006419 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:05:43.022089 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:43.022089 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:43.022089 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:43.022089 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:43.022430 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:43.022709 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:43.197528 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Attempting to attach volume 517928f6-d49a-4bf2-b1b8-bee0a4dba99f with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 02:05:43.200622 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] attach device xml: <disk type="block" device="disk">
May 21 02:05:43.200622 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:05:43.200622 np0000001127 nova-compute[98206]:   <alias name="ua-517928f6-d49a-4bf2-b1b8-bee0a4dba99f"/>
May 21 02:05:43.200622 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-1"/>
May 21 02:05:43.200622 np0000001127 nova-compute[98206]:   <target dev="vdc" bus="virtio"/>
May 21 02:05:43.200622 np0000001127 nova-compute[98206]:   <serial>517928f6-d49a-4bf2-b1b8-bee0a4dba99f</serial>
May 21 02:05:43.200622 np0000001127 nova-compute[98206]: </disk>
May 21 02:05:43.200622 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 02:05:43.203296 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:43.203431 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:43.203851 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:43.204113 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:43.204365 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:43.204692 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:43.388549 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.597s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:43.389233 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.093s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:43.389382 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:05:43.394851 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:05:43.397786 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Claim successful on node np0000001127
May 21 02:05:43.509042 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:05:43.509185 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329143.5090404, 9b4239c5-84df-4d87-a2d4-fb6192408f58 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:05:43.509319 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] VM Paused (Lifecycle Event)
May 21 02:05:43.528418 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Took 8.11 seconds to spawn the instance on the hypervisor.
May 21 02:05:43.528926 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:43.712038 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Took 13.60 seconds to spawn the instance on the hypervisor.
May 21 02:05:43.712600 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:43.900391 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:05:43.900391 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:05:43.900391 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:43.900391 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:43.981381 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f5a8df2b-1b02-4752-837d-3060160dda98 req-8e164502-48fa-4218-9446-d080675f4c4c service nova] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Received event network-vif-plugged-7475b4a3-11de-43b6-9d83-b59933d9e8db {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:43.981381 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f5a8df2b-1b02-4752-837d-3060160dda98 req-8e164502-48fa-4218-9446-d080675f4c4c service nova] Acquiring lock "9b4239c5-84df-4d87-a2d4-fb6192408f58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:43.981381 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f5a8df2b-1b02-4752-837d-3060160dda98 req-8e164502-48fa-4218-9446-d080675f4c4c service nova] Lock "9b4239c5-84df-4d87-a2d4-fb6192408f58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:43.981381 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f5a8df2b-1b02-4752-837d-3060160dda98 req-8e164502-48fa-4218-9446-d080675f4c4c service nova] Lock "9b4239c5-84df-4d87-a2d4-fb6192408f58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:43.981381 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f5a8df2b-1b02-4752-837d-3060160dda98 req-8e164502-48fa-4218-9446-d080675f4c4c service nova] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] No waiting events found dispatching network-vif-plugged-7475b4a3-11de-43b6-9d83-b59933d9e8db {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:05:43.981381 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-f5a8df2b-1b02-4752-837d-3060160dda98 req-8e164502-48fa-4218-9446-d080675f4c4c service nova] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Received unexpected event network-vif-plugged-7475b4a3-11de-43b6-9d83-b59933d9e8db for instance with vm_state active and task_state None.
May 21 02:05:44.006520 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0083b33595414e5e8a3a80e7fea274ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0ea7da0f244aab58f9da579e53864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:05:44.011619 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:44.013450 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329144.01321, 9b4239c5-84df-4d87-a2d4-fb6192408f58 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:05:44.013612 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] VM Resumed (Lifecycle Event)
May 21 02:05:44.036276 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Took 13.63 seconds to build instance.
May 21 02:05:44.225743 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Took 21.15 seconds to build instance.
May 21 02:05:44.402495 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:05:44.516884 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:44.524306 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:05:44.540504 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "9b4239c5-84df-4d87-a2d4-fb6192408f58" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.150s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:44.566609 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:44.582576 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Successfully created port: 75b84cf5-3aac-411c-acc8-a12b14a9f98a {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:05:44.731988 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-caf8bd9d-9fad-4515-b614-60cae53d8f2f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "3e53c443-92d8-4e5c-bc47-43deb205786b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.668s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:44.881919 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:05:44.881919 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:05:44.881919 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:05:44.882065 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:05:44.882165 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] No VIF found with MAC fa:16:3e:ca:eb:af, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:05:44.908205 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:05:44.965145 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:05:44.965145 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:05:45.027433 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329145.0270476, 3e53c443-92d8-4e5c-bc47-43deb205786b => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:05:45.027676 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] VM Resumed (Lifecycle Event)
May 21 02:05:45.128943 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Successfully updated port: 75b84cf5-3aac-411c-acc8-a12b14a9f98a {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:05:45.188768 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-9a98ba94-f800-477b-8689-cf3c57fdeb70 req-7b553ea6-2008-4f04-9a6c-d56db570ee89 service nova] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Received event network-changed-75b84cf5-3aac-411c-acc8-a12b14a9f98a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:45.188932 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-9a98ba94-f800-477b-8689-cf3c57fdeb70 req-7b553ea6-2008-4f04-9a6c-d56db570ee89 service nova] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Refreshing instance network info cache due to event network-changed-75b84cf5-3aac-411c-acc8-a12b14a9f98a. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:05:45.189357 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-9a98ba94-f800-477b-8689-cf3c57fdeb70 req-7b553ea6-2008-4f04-9a6c-d56db570ee89 service nova] Acquiring lock "refresh_cache-45f01b41-a43c-4ddf-aa07-22f8c2c50758" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:05:45.189568 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-9a98ba94-f800-477b-8689-cf3c57fdeb70 req-7b553ea6-2008-4f04-9a6c-d56db570ee89 service nova] Acquired lock "refresh_cache-45f01b41-a43c-4ddf-aa07-22f8c2c50758" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:05:45.189744 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-9a98ba94-f800-477b-8689-cf3c57fdeb70 req-7b553ea6-2008-4f04-9a6c-d56db570ee89 service nova] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Refreshing network info cache for port 75b84cf5-3aac-411c-acc8-a12b14a9f98a {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:05:45.417690 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Booting with volume d65b4beb-8e98-46fc-b1d2-4193962d5bb9 at /dev/vda
May 21 02:05:45.467986 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:05:45.477217 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:05:45.492915 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:05:45.515612 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cfeafd82-351a-4a94-a482-80da5f350e8d req-dcffc333-ff2d-4b43-a3e2-b7ff0cdb2e61 service nova] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Received event network-changed-7475b4a3-11de-43b6-9d83-b59933d9e8db {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:45.517696 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cfeafd82-351a-4a94-a482-80da5f350e8d req-dcffc333-ff2d-4b43-a3e2-b7ff0cdb2e61 service nova] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Refreshing instance network info cache due to event network-changed-7475b4a3-11de-43b6-9d83-b59933d9e8db. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:05:45.517954 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cfeafd82-351a-4a94-a482-80da5f350e8d req-dcffc333-ff2d-4b43-a3e2-b7ff0cdb2e61 service nova] Acquiring lock "refresh_cache-9b4239c5-84df-4d87-a2d4-fb6192408f58" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:05:45.518326 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cfeafd82-351a-4a94-a482-80da5f350e8d req-dcffc333-ff2d-4b43-a3e2-b7ff0cdb2e61 service nova] Acquired lock "refresh_cache-9b4239c5-84df-4d87-a2d4-fb6192408f58" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:05:45.518511 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-cfeafd82-351a-4a94-a482-80da5f350e8d req-dcffc333-ff2d-4b43-a3e2-b7ff0cdb2e61 service nova] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Refreshing network info cache for port 7475b4a3-11de-43b6-9d83-b59933d9e8db {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:05:45.524457 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:45.543657 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:45.554903 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:05:45.569060 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:05:45.569229 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:05:45.582230 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:05:45.583439 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:feca:ebaf', 'fe80::40b3:49ff:feb3:3b55', 'fe80::fc16:3eff:fee1:2e46', 'fe80::2482:bff:fe1b:902b', 'fe80::fc16:3eff:fe0f:28a1', 'fe80::440a:38ff:fe27:fa24', 'fe80::fc16:3eff:febd:860a', 'fe80::c44d:25ff:fe10:25cb', 'fe80::fc16:3eff:fe91:3d5c', 'fe80::a4db:73ff:fe81:949b'] 
May 21 02:05:45.583596 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:05:45.583719 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:05:45.583934 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:05:45.584110 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Updating existing volume attachment record: ba5936f7-c969-4771-8e4b-50c3a0ac41f0 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:05:45.630272 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Acquiring lock "refresh_cache-45f01b41-a43c-4ddf-aa07-22f8c2c50758" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:05:45.692177 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-9a98ba94-f800-477b-8689-cf3c57fdeb70 req-7b553ea6-2008-4f04-9a6c-d56db570ee89 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:45.756942 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-9a98ba94-f800-477b-8689-cf3c57fdeb70 req-7b553ea6-2008-4f04-9a6c-d56db570ee89 service nova] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:05:45.880677 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-9a98ba94-f800-477b-8689-cf3c57fdeb70 req-7b553ea6-2008-4f04-9a6c-d56db570ee89 service nova] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:05:45.979624 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.591s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:45.983058 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0233fc22-6aee-45b4-8c4a-e4c8d6426ad0 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 4.255s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:45.983058 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:05:46.021628 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-cfeafd82-351a-4a94-a482-80da5f350e8d req-dcffc333-ff2d-4b43-a3e2-b7ff0cdb2e61 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:46.073093 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d01984ba-ebdf-4059-8f84-9575256a1896 req-37c9858b-1fb5-4504-9189-eada3e33457b service nova] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Received event network-changed-7a9ceef8-458f-4d22-aa65-2dccb71ed1ad {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:46.073521 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d01984ba-ebdf-4059-8f84-9575256a1896 req-37c9858b-1fb5-4504-9189-eada3e33457b service nova] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Refreshing instance network info cache due to event network-changed-7a9ceef8-458f-4d22-aa65-2dccb71ed1ad. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:05:46.073788 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d01984ba-ebdf-4059-8f84-9575256a1896 req-37c9858b-1fb5-4504-9189-eada3e33457b service nova] Acquiring lock "refresh_cache-3e53c443-92d8-4e5c-bc47-43deb205786b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:05:46.074241 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d01984ba-ebdf-4059-8f84-9575256a1896 req-37c9858b-1fb5-4504-9189-eada3e33457b service nova] Acquired lock "refresh_cache-3e53c443-92d8-4e5c-bc47-43deb205786b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:05:46.074405 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-d01984ba-ebdf-4059-8f84-9575256a1896 req-37c9858b-1fb5-4504-9189-eada3e33457b service nova] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Refreshing network info cache for port 7a9ceef8-458f-4d22-aa65-2dccb71ed1ad {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:05:46.382613 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-9a98ba94-f800-477b-8689-cf3c57fdeb70 req-7b553ea6-2008-4f04-9a6c-d56db570ee89 service nova] Releasing lock "refresh_cache-45f01b41-a43c-4ddf-aa07-22f8c2c50758" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:05:46.383537 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Acquired lock "refresh_cache-45f01b41-a43c-4ddf-aa07-22f8c2c50758" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:05:46.383809 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:05:46.430753 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-cfeafd82-351a-4a94-a482-80da5f350e8d req-dcffc333-ff2d-4b43-a3e2-b7ff0cdb2e61 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:46.454396 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a2631ceb-e622-4f58-b32a-70184c26f531 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "f63a2253-071a-4a1a-94af-3544b20c39cf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.595s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:46.490222 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:05:46.490822 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:05:46.490822 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:46.490998 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:46.551104 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:46.577223 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-d01984ba-ebdf-4059-8f84-9575256a1896 req-37c9858b-1fb5-4504-9189-eada3e33457b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:46.594260 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '049d6c8cccfa4ae38d78a88ef5be0f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848912b0c0e94d2795bb2332daf1730e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:05:46.612142 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-cfeafd82-351a-4a94-a482-80da5f350e8d req-dcffc333-ff2d-4b43-a3e2-b7ff0cdb2e61 service nova] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Updated VIF entry in instance network info cache for port 7475b4a3-11de-43b6-9d83-b59933d9e8db. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:05:46.613023 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-cfeafd82-351a-4a94-a482-80da5f350e8d req-dcffc333-ff2d-4b43-a3e2-b7ff0cdb2e61 service nova] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Updating instance_info_cache with network_info: [{"id": "7475b4a3-11de-43b6-9d83-b59933d9e8db", "address": "fa:16:3e:91:3d:5c", "network": {"id": "0618d411-0f50-4ee4-80a9-cbd395ea2c77", "bridge": "br-int", "label": "tempest-TestStampPattern-1490281843-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b72317ce75214e619a14739991461c95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7475b4a3-11", "ovs_interfaceid": "7475b4a3-11de-43b6-9d83-b59933d9e8db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:05:46.659826 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0233fc22-6aee-45b4-8c4a-e4c8d6426ad0 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:05:46.660079 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-0233fc22-6aee-45b4-8c4a-e4c8d6426ad0 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:05:46.931697 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "f63a2253-071a-4a1a-94af-3544b20c39cf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:46.932861 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "f63a2253-071a-4a1a-94af-3544b20c39cf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:46.952753 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-d01984ba-ebdf-4059-8f84-9575256a1896 req-37c9858b-1fb5-4504-9189-eada3e33457b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:46.995656 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:05:47.013493 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:05:47.115197 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cfeafd82-351a-4a94-a482-80da5f350e8d req-dcffc333-ff2d-4b43-a3e2-b7ff0cdb2e61 service nova] Releasing lock "refresh_cache-9b4239c5-84df-4d87-a2d4-fb6192408f58" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:05:47.159840 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-d01984ba-ebdf-4059-8f84-9575256a1896 req-37c9858b-1fb5-4504-9189-eada3e33457b service nova] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Updated VIF entry in instance network info cache for port 7a9ceef8-458f-4d22-aa65-2dccb71ed1ad. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:05:47.160293 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-d01984ba-ebdf-4059-8f84-9575256a1896 req-37c9858b-1fb5-4504-9189-eada3e33457b service nova] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Updating instance_info_cache with network_info: [{"id": "7a9ceef8-458f-4d22-aa65-2dccb71ed1ad", "address": "fa:16:3e:bd:86:0a", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9ceef8-45", "ovs_interfaceid": "7a9ceef8-458f-4d22-aa65-2dccb71ed1ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:05:47.163996 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-0233fc22-6aee-45b4-8c4a-e4c8d6426ad0 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:05:47.217561 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Successfully created port: ef5fecf8-83a1-4153-927b-7f8b543f83f3 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:05:47.222625 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:47.389502 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Updating instance_info_cache with network_info: [{"id": "75b84cf5-3aac-411c-acc8-a12b14a9f98a", "address": "fa:16:3e:68:a8:10", "network": {"id": "460fd532-ef54-4f63-922b-b9d9f73f665f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1504169250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89e0ea7da0f244aab58f9da579e53864", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75b84cf5-3a", "ovs_interfaceid": "75b84cf5-3aac-411c-acc8-a12b14a9f98a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:05:47.434651 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Detaching volume 0bc85eae-59fe-4ca0-88d4-39d1c14b8317
May 21 02:05:47.479526 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Attempting to driver detach volume 0bc85eae-59fe-4ca0-88d4-39d1c14b8317 from mountpoint /dev/vdb
May 21 02:05:47.489553 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Found disk vdb by alias ua-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:05:47.497562 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Found disk vdb by alias ua-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:05:47.497738 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Attempting to detach device vdb from instance f63a2253-071a-4a1a-94af-3544b20c39cf from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 02:05:47.498526 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:05:47.498526 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:05:47.498526 np0000001127 nova-compute[98206]:   <alias name="ua-0bc85eae-59fe-4ca0-88d4-39d1c14b8317"/>
May 21 02:05:47.498526 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-4"/>
May 21 02:05:47.498526 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:05:47.498526 np0000001127 nova-compute[98206]:   <serial>0bc85eae-59fe-4ca0-88d4-39d1c14b8317</serial>
May 21 02:05:47.498526 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:05:47.498526 np0000001127 nova-compute[98206]: </disk>
May 21 02:05:47.498526 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:05:47.500407 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:05:47.512114 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Successfully detached device vdb from instance f63a2253-071a-4a1a-94af-3544b20c39cf from the persistent domain config.
May 21 02:05:47.512444 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] (1/8): Attempting to detach device vdb with device alias ua-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 from instance f63a2253-071a-4a1a-94af-3544b20c39cf from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 02:05:47.512710 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:05:47.512710 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:05:47.512710 np0000001127 nova-compute[98206]:   <alias name="ua-0bc85eae-59fe-4ca0-88d4-39d1c14b8317"/>
May 21 02:05:47.512710 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-4"/>
May 21 02:05:47.512710 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:05:47.512710 np0000001127 nova-compute[98206]:   <serial>0bc85eae-59fe-4ca0-88d4-39d1c14b8317</serial>
May 21 02:05:47.512710 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:05:47.512710 np0000001127 nova-compute[98206]: </disk>
May 21 02:05:47.512710 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:05:47.663049 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d01984ba-ebdf-4059-8f84-9575256a1896 req-37c9858b-1fb5-4504-9189-eada3e33457b service nova] Releasing lock "refresh_cache-3e53c443-92d8-4e5c-bc47-43deb205786b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:05:47.673483 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0233fc22-6aee-45b4-8c4a-e4c8d6426ad0 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.694s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:47.677298 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-18c3cf83-d417-4489-ba0b-a7355c9cd268 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 5.609s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:47.719523 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:05:47.723095 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:05:47.723289 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Creating image(s)
May 21 02:05:47.723648 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Did not create local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 21 02:05:47.723796 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Ensure instance console log exists: /opt/stack/data/nova/instances/45f01b41-a43c-4ddf-aa07-22f8c2c50758/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:05:47.724049 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:47.724228 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:47.724405 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:47.767386 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-0233fc22-6aee-45b4-8c4a-e4c8d6426ad0 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Deleted allocations for instance 76097fea-0890-40a8-a902-9f510cd34b52
May 21 02:05:47.823712 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Successfully updated port: ef5fecf8-83a1-4153-927b-7f8b543f83f3 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:05:47.893680 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Releasing lock "refresh_cache-45f01b41-a43c-4ddf-aa07-22f8c2c50758" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:05:47.893916 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Instance network_info: |[{"id": "75b84cf5-3aac-411c-acc8-a12b14a9f98a", "address": "fa:16:3e:68:a8:10", "network": {"id": "460fd532-ef54-4f63-922b-b9d9f73f665f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1504169250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89e0ea7da0f244aab58f9da579e53864", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75b84cf5-3a", "ovs_interfaceid": "75b84cf5-3aac-411c-acc8-a12b14a9f98a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:05:47.894781 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Start _get_guest_xml network_info=[{"id": "75b84cf5-3aac-411c-acc8-a12b14a9f98a", "address": "fa:16:3e:68:a8:10", "network": {"id": "460fd532-ef54-4f63-922b-b9d9f73f665f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1504169250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89e0ea7da0f244aab58f9da579e53864", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75b84cf5-3a", "ovs_interfaceid": "75b84cf5-3aac-411c-acc8-a12b14a9f98a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd65b4beb-8e98-46fc-b1d2-4193962d5bb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '45f01b41-a43c-4ddf-aa07-22f8c2c50758', 'attached_at': '', 'detached_at': '', 'volume_id': 'd65b4beb-8e98-46fc-b1d2-4193962d5bb9', 'serial': 'd65b4beb-8e98-46fc-b1d2-4193962d5bb9'}, 'delete_on_termination': False, 'attachment_id': 'ba5936f7-c969-4771-8e4b-50c3a0ac41f0', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:05:47.898046 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-3f499280-29f7-46fc-bed3-59e6ce94c57f req-df1325ff-c0a2-476c-aee3-57c4d8abef31 service nova] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Received event network-changed-ef5fecf8-83a1-4153-927b-7f8b543f83f3 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:47.898046 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-3f499280-29f7-46fc-bed3-59e6ce94c57f req-df1325ff-c0a2-476c-aee3-57c4d8abef31 service nova] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Refreshing instance network info cache due to event network-changed-ef5fecf8-83a1-4153-927b-7f8b543f83f3. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:05:47.898046 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-3f499280-29f7-46fc-bed3-59e6ce94c57f req-df1325ff-c0a2-476c-aee3-57c4d8abef31 service nova] Acquiring lock "refresh_cache-16a0cc8d-c65b-4166-ad1a-5318b18ed00e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:05:47.898046 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-3f499280-29f7-46fc-bed3-59e6ce94c57f req-df1325ff-c0a2-476c-aee3-57c4d8abef31 service nova] Acquired lock "refresh_cache-16a0cc8d-c65b-4166-ad1a-5318b18ed00e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:05:47.898046 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-3f499280-29f7-46fc-bed3-59e6ce94c57f req-df1325ff-c0a2-476c-aee3-57c4d8abef31 service nova] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Refreshing network info cache for port ef5fecf8-83a1-4153-927b-7f8b543f83f3 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:05:47.908508 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:05:47.909987 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-1190516628', uuid='45f01b41-a43c-4ddf-aa07-22f8c2c50758'), owner=OwnerMeta(userid='0083b33595414e5e8a3a80e7fea274ba', username='tempest-TestVolumeBootPatternV346-1354384974-project-member', projectid='89e0ea7da0f244aab58f9da579e53864', projectname='tempest-TestVolumeBootPatternV346-1354384974'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "75b84cf5-3aac-411c-acc8-a12b14a9f98a", "address": "fa:16:3e:68:a8:10", "network": {"id": "460fd532-ef54-4f63-922b-b9d9f73f665f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1504169250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89e0ea7da0f244aab58f9da579e53864", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75b84cf5-3a", "ovs_interfaceid": "75b84cf5-3aac-411c-acc8-a12b14a9f98a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329147.9094503) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:05:47.913354 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:05:47.913611 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:05:47.915681 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:05:47.916407 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:05:47.920494 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:05:47.920494 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:05:47.920494 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:05:47.920494 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:05:47.920494 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:05:47.920494 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:05:47.920494 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:05:47.920494 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:05:47.920494 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:05:47.920494 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:05:47.920494 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:05:47.920494 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:05:47.931143 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:05:47.931476 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd65b4beb-8e98-46fc-b1d2-4193962d5bb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:05:47.931682 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:05:47.932052 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:05:47.932463 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd65b4beb-8e98-46fc-b1d2-4193962d5bb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:05:47.946612 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:05:47.947237 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:05:47.947826 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:05:47.947954 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:05:47.949565 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:05:47.953364 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:05:47.962307 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:05:47.962307 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:47.970092 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:05:47.970092 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:47.976539 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9] added
May 21 02:05:47.976539 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:05:47.976539 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:05:47.976539 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:05:47.976539 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:05:47.976539 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:05:47.976539 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:47.976539 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:05:47.976773 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0288(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:05:47.976943 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:05:47.987508 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9] added
May 21 02:05:47.987508 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:05:47.987508 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:05:47.987508 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:05:47.987508 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:05:47.987508 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:05:47.987508 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:47.988517 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:05:47.988770 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0371(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:05:47.988916 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:05:48.129013 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779329148.1284888, f63a2253-071a-4a1a-94af-3544b20c39cf => ua-0bc85eae-59fe-4ca0-88d4-39d1c14b8317> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 02:05:48.129810 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 for instance f63a2253-071a-4a1a-94af-3544b20c39cf {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 02:05:48.133488 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-18c3cf83-d417-4489-ba0b-a7355c9cd268 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:05:48.133659 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-18c3cf83-d417-4489-ba0b-a7355c9cd268 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:05:48.136245 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Successfully detached device vdb from instance f63a2253-071a-4a1a-94af-3544b20c39cf from the live domain config.
May 21 02:05:48.137443 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:05:48.137872 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317', 'iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0bc85eae-59fe-4ca0-88d4-39d1c14b8317', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:05:48.138159 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:05:48.327672 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "refresh_cache-16a0cc8d-c65b-4166-ad1a-5318b18ed00e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:05:48.405252 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-3f499280-29f7-46fc-bed3-59e6ce94c57f req-df1325ff-c0a2-476c-aee3-57c4d8abef31 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:48.489315 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-3f499280-29f7-46fc-bed3-59e6ce94c57f req-df1325ff-c0a2-476c-aee3-57c4d8abef31 service nova] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:05:48.521566 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:05:48.521566 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:05:48.521566 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Creating image(s)
May 21 02:05:48.521566 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "/opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:48.521566 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "/opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:48.522318 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "/opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:48.522960 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:05:48.525723 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:05:48.526735 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:48.623694 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.096s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:05:48.626275 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:48.626998 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:48.628358 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:05:48.637030 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:05:48.638753 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-18c3cf83-d417-4489-ba0b-a7355c9cd268 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:05:48.643071 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:48.678503 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:05:48.679502 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:05:48.679770 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 21 02:05:48.680288 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:05:48.686975 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-3f499280-29f7-46fc-bed3-59e6ce94c57f req-df1325ff-c0a2-476c-aee3-57c4d8abef31 service nova] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:05:48.736487 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.093s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:05:48.738202 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:48.784968 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0233fc22-6aee-45b4-8c4a-e4c8d6426ad0 tempest-ServerStableDeviceRescueTest-1611761335 tempest-ServerStableDeviceRescueTest-1611761335-project-member] Lock "76097fea-0890-40a8-a902-9f510cd34b52" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.226s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:48.792012 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e/disk 1073741824" returned: 0 in 0.055s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:05:48.794243 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.166s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:48.794243 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:48.897929 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.104s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:05:48.899197 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Checking if we can resize image /opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:05:48.899197 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:48.978071 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:05:48.989326 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:05:48.993007 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:05:48.993007 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:05:49.007244 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:05:49.007244 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:49.015685 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:49.020978 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:05:49.024490 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Cannot resize image /opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:05:49.024490 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:05:49.024490 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Ensure instance console log exists: /opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:05:49.024490 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:49.024490 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:49.024490 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:49.027343 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:49.042209 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f (non-flash)
May 21 02:05:49.042209 np0000001127 nova-compute[98206]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f (non-flash)
May 21 02:05:49.042209 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:49.042209 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:49.042209 np0000001127 nova-compute[98206]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:49.042209 np0000001127 nova-compute[98206]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:49.042209 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:49.042209 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:49.042209 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:05:49.042561 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f (non-flash)
May 21 02:05:49.042561 np0000001127 nova-compute[98206]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f (non-flash)
May 21 02:05:49.042561 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:49.042561 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:49.042561 np0000001127 nova-compute[98206]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:49.042561 np0000001127 nova-compute[98206]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:49.042561 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:49.042561 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:49.042561 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:05:49.049781 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f (non-flash)
May 21 02:05:49.049781 np0000001127 nova-compute[98206]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f (non-flash)
May 21 02:05:49.049781 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:49.049781 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:49.049781 np0000001127 nova-compute[98206]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:49.049781 np0000001127 nova-compute[98206]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:49.049781 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:49.049781 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:49.049781 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:05:49.050055 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f (non-flash)
May 21 02:05:49.050055 np0000001127 nova-compute[98206]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f (non-flash)
May 21 02:05:49.050055 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:49.050055 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:49.050055 np0000001127 nova-compute[98206]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:49.050055 np0000001127 nova-compute[98206]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:49.050055 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:49.050055 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:49.050055 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:05:49.095089 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9, portal: 192.168.40.100,3260]
May 21 02:05:49.095089 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9, portal: 192.168.40.100,3260] successful.
May 21 02:05:49.095089 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:49.102738 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9, portal: 192.168.50.100,3260]
May 21 02:05:49.102738 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9, portal: 192.168.50.100,3260] successful.
May 21 02:05:49.102738 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:49.115460 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:49.125935 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:49.138510 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f (non-flash)
May 21 02:05:49.138510 np0000001127 nova-compute[98206]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f (non-flash)
May 21 02:05:49.138510 np0000001127 nova-compute[98206]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:05:49.138510 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:05:49.138510 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:49.138510 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:49.138510 np0000001127 nova-compute[98206]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:49.138510 np0000001127 nova-compute[98206]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:49.138510 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:49.138510 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:49.138510 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:05:49.138870 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f (non-flash)
May 21 02:05:49.138870 np0000001127 nova-compute[98206]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f (non-flash)
May 21 02:05:49.138870 np0000001127 nova-compute[98206]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:05:49.138870 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:05:49.138870 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:49.138870 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:49.138870 np0000001127 nova-compute[98206]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:49.138870 np0000001127 nova-compute[98206]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:49.138870 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:49.138870 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:49.138870 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:05:49.139339 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.192s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:05:49.139590 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:05:49.141380 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] HCTL ('15', '-', '-', 0) found on session 102 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:05:49.141585 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:05:49.148604 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-18c3cf83-d417-4489-ba0b-a7355c9cd268 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.475s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:49.161654 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f (non-flash)
May 21 02:05:49.161654 np0000001127 nova-compute[98206]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f (non-flash)
May 21 02:05:49.161654 np0000001127 nova-compute[98206]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:05:49.161654 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:05:49.161654 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:49.161654 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:49.161654 np0000001127 nova-compute[98206]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:49.161654 np0000001127 nova-compute[98206]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:49.161654 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:49.161654 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:49.161654 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:05:49.161654 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f (non-flash)
May 21 02:05:49.161654 np0000001127 nova-compute[98206]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f (non-flash)
May 21 02:05:49.161654 np0000001127 nova-compute[98206]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:05:49.161654 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:05:49.161654 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:49.161654 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:49.161654 np0000001127 nova-compute[98206]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:49.161654 np0000001127 nova-compute[98206]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:49.161654 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:49.161654 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:49.161654 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:05:49.161654 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.206s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:05:49.161654 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:05:49.161654 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] HCTL ('16', '-', '-', 0) found on session 103 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:05:49.161654 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:05:49.170990 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Searching for a device in session 102 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:05:49.170990 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd65b4beb-8e98-46fc-b1d2-4193962d5bb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:05:49.177819 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Searching for a device in session 103 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:05:49.177819 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd65b4beb-8e98-46fc-b1d2-4193962d5bb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:05:49.189689 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-3f499280-29f7-46fc-bed3-59e6ce94c57f req-df1325ff-c0a2-476c-aee3-57c4d8abef31 service nova] Releasing lock "refresh_cache-16a0cc8d-c65b-4166-ad1a-5318b18ed00e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:05:49.190172 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquired lock "refresh_cache-16a0cc8d-c65b-4166-ad1a-5318b18ed00e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:05:49.190255 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:05:49.217180 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-18c3cf83-d417-4489-ba0b-a7355c9cd268 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Deleted allocations for instance dc3e1d06-6926-4fd2-b5c2-5d6104ba6826
May 21 02:05:49.569316 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:49.758285 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:05:49.905679 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:49.955885 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:05:50.041750 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Updating instance_info_cache with network_info: [{"id": "ef5fecf8-83a1-4153-927b-7f8b543f83f3", "address": "fa:16:3e:fb:4d:96", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef5fecf8-83", "ovs_interfaceid": "ef5fecf8-83a1-4153-927b-7f8b543f83f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:05:50.227509 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-18c3cf83-d417-4489-ba0b-a7355c9cd268 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Lock "dc3e1d06-6926-4fd2-b5c2-5d6104ba6826" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.113s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:50.544024 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Releasing lock "refresh_cache-16a0cc8d-c65b-4166-ad1a-5318b18ed00e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:05:50.544303 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Instance network_info: |[{"id": "ef5fecf8-83a1-4153-927b-7f8b543f83f3", "address": "fa:16:3e:fb:4d:96", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef5fecf8-83", "ovs_interfaceid": "ef5fecf8-83a1-4153-927b-7f8b543f83f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:05:50.545937 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Start _get_guest_xml network_info=[{"id": "ef5fecf8-83a1-4153-927b-7f8b543f83f3", "address": "fa:16:3e:fb:4d:96", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef5fecf8-83", "ovs_interfaceid": "ef5fecf8-83a1-4153-927b-7f8b543f83f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:05:50.549203 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:05:50.550316 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='16a0cc8d-c65b-4166-ad1a-5318b18ed00e'), owner=OwnerMeta(userid='049d6c8cccfa4ae38d78a88ef5be0f1b', username='tempest-AttachVolumeMultiAttachTest-289054175-project-member', projectid='848912b0c0e94d2795bb2332daf1730e', projectname='tempest-AttachVolumeMultiAttachTest-289054175'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ef5fecf8-83a1-4153-927b-7f8b543f83f3", "address": "fa:16:3e:fb:4d:96", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef5fecf8-83", "ovs_interfaceid": "ef5fecf8-83a1-4153-927b-7f8b543f83f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329150.5500066) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:05:50.551288 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:05:50.551655 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:05:50.552364 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:05:50.552535 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:05:50.553350 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:05:50.553693 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:05:50.553852 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:05:50.553929 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:05:50.554046 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:05:50.554142 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:05:50.554223 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:05:50.554391 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:05:50.554494 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:05:50.554607 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:05:50.554699 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:05:50.554802 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:05:50.564740 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:05:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='multiattach-server-0',id=48,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzu+v5yloohnjet+lpl7Cb5m5YuZdtxheBkBGOMBLLe2AJEatmv/W6U1humbPofoJpKHaVTa0sSri4Ktoz/rRBuEiIFUUGVMQjgWmfd958Eyx52s4Fg6gJyB/ru0BJ+zA==',key_name='tempest-keypair-1890511814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='848912b0c0e94d2795bb2332daf1730e',ramdisk_id='',reservation_id='r-nz73xe70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-289054175',owner_user_name='tempest-AttachVolumeMultiAttachTest-289054175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:05:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='049d6c8cccfa4ae38d78a88ef5be0f1b',uuid=16a0cc8d-c65b-4166-ad1a-5318b18ed00e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef5fecf8-83a1-4153-927b-7f8b543f83f3", "address": "fa:16:3e:fb:4d:96", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef5fecf8-83", "ovs_interfaceid": "ef5fecf8-83a1-4153-927b-7f8b543f83f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:05:50.564967 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converting VIF {"id": "ef5fecf8-83a1-4153-927b-7f8b543f83f3", "address": "fa:16:3e:fb:4d:96", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef5fecf8-83", "ovs_interfaceid": "ef5fecf8-83a1-4153-927b-7f8b543f83f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:05:50.565510 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:4d:96,bridge_name='br-int',has_traffic_filtering=True,id=ef5fecf8-83a1-4153-927b-7f8b543f83f3,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef5fecf8-83') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:05:50.566041 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lazy-loading 'pci_devices' on Instance uuid 16a0cc8d-c65b-4166-ad1a-5318b18ed00e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:05:50.676751 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:05:50.677203 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:05:50.677576 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:05:50.677907 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:05:50.976773 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Found WWN 3300000006ec347e2 for multipath device dm-8 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:05:50.977901 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.046s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:05:50.979352 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] <== connect_volume: return (3046ms) {'type': 'block', 'scsi_wwn': '3300000006ec347e2', 'path': '/dev/dm-8', 'multipath_id': '3300000006ec347e2'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:05:50.979678 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006ec347e2', 'path': '/dev/dm-8', 'multipath_id': '3300000006ec347e2'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:05:50.980983 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.843s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:05:50.982628 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317', 'iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0bc85eae-59fe-4ca0-88d4-39d1c14b8317', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:05:50.983620 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:05:51.015250 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f (non-flash)
May 21 02:05:51.015250 np0000001127 nova-compute[98206]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f (non-flash)
May 21 02:05:51.015250 np0000001127 nova-compute[98206]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:05:51.015250 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:05:51.015250 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:51.015250 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:51.015250 np0000001127 nova-compute[98206]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:51.015250 np0000001127 nova-compute[98206]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:51.015250 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:51.015250 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:51.015250 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:05:51.015627 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f (non-flash)
May 21 02:05:51.015627 np0000001127 nova-compute[98206]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f (non-flash)
May 21 02:05:51.015627 np0000001127 nova-compute[98206]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:05:51.015627 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:05:51.015627 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:51.015627 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:51.015627 np0000001127 nova-compute[98206]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:51.015627 np0000001127 nova-compute[98206]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317 (non-flash)
May 21 02:05:51.015627 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:51.015627 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:51.015627 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:05:51.015914 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f', '100'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f', '101'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '95'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317', '96'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317', '97'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617', '98'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617', '99')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:05:51.016003 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317', '96')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:05:51.016995 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317', '97')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:05:51.018117 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c7aede0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317'): ({'sdg'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:05:51.018377 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Removing multipathed devices sdg, sdf {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:05:51.018757 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Flush multipath device 3300000008c7c1a86 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:05:51.052544 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:05:51.070503 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] End _get_guest_xml xml=<domain type="qemu">
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:   <uuid>16a0cc8d-c65b-4166-ad1a-5318b18ed00e</uuid>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:   <name>instance-00000030</name>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:       <nova:name>multiattach-server-0</nova:name>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:05:50</nova:creationTime>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:         <nova:user uuid="049d6c8cccfa4ae38d78a88ef5be0f1b">tempest-AttachVolumeMultiAttachTest-289054175-project-member</nova:user>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:         <nova:project uuid="848912b0c0e94d2795bb2332daf1730e">tempest-AttachVolumeMultiAttachTest-289054175</nova:project>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:         <nova:port uuid="ef5fecf8-83a1-4153-927b-7f8b543f83f3">
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:     <system>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:       <entry name="serial">16a0cc8d-c65b-4166-ad1a-5318b18ed00e</entry>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:       <entry name="uuid">16a0cc8d-c65b-4166-ad1a-5318b18ed00e</entry>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:     </system>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:   <os>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:   </os>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:   <features>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:   </features>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:   <devices>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e/disk"/>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:     </disk>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e/disk.config"/>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:     </disk>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:fb:4d:96"/>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:       <target dev="tapef5fecf8-83"/>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:     </interface>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e/console.log" append="off"/>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:     </serial>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:     <video>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:     </video>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:     </rng>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:   </devices>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]: </domain>
May 21 02:05:51.070503 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:05:51.070503 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Preparing to wait for external event network-vif-plugged-ef5fecf8-83a1-4153-927b-7f8b543f83f3 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:05:51.070503 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "16a0cc8d-c65b-4166-ad1a-5318b18ed00e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:51.070503 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "16a0cc8d-c65b-4166-ad1a-5318b18ed00e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:51.070503 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "16a0cc8d-c65b-4166-ad1a-5318b18ed00e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:51.070503 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:05:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='multiattach-server-0',id=48,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzu+v5yloohnjet+lpl7Cb5m5YuZdtxheBkBGOMBLLe2AJEatmv/W6U1humbPofoJpKHaVTa0sSri4Ktoz/rRBuEiIFUUGVMQjgWmfd958Eyx52s4Fg6gJyB/ru0BJ+zA==',key_name='tempest-keypair-1890511814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='848912b0c0e94d2795bb2332daf1730e',ramdisk_id='',reservation_id='r-nz73xe70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-289054175',owner_user_name='tempest-AttachVolumeMultiAttachTest-289054175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:05:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='049d6c8cccfa4ae38d78a88ef5be0f1b',uuid=16a0cc8d-c65b-4166-ad1a-5318b18ed00e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef5fecf8-83a1-4153-927b-7f8b543f83f3", "address": "fa:16:3e:fb:4d:96", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef5fecf8-83", "ovs_interfaceid": "ef5fecf8-83a1-4153-927b-7f8b543f83f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:05:51.070503 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converting VIF {"id": "ef5fecf8-83a1-4153-927b-7f8b543f83f3", "address": "fa:16:3e:fb:4d:96", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef5fecf8-83", "ovs_interfaceid": "ef5fecf8-83a1-4153-927b-7f8b543f83f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:05:51.075623 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:4d:96,bridge_name='br-int',has_traffic_filtering=True,id=ef5fecf8-83a1-4153-927b-7f8b543f83f3,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef5fecf8-83') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:05:51.075623 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:4d:96,bridge_name='br-int',has_traffic_filtering=True,id=ef5fecf8-83a1-4153-927b-7f8b543f83f3,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef5fecf8-83') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:05:51.075917 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:51.076551 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:51.076887 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:05:51.078379 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:51.078650 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4c81baea-deaa-5615-b5fc-485ccb630b17', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:51.081508 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:51.081508 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:05:51.083645 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:51.083811 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef5fecf8-83, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:51.084217 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapef5fecf8-83, col_values=(('qos', UUID('32995c08-c83a-4428-acd9-df3885130fd0')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:51.084421 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapef5fecf8-83, col_values=(('external_ids', {'iface-id': 'ef5fecf8-83a1-4153-927b-7f8b543f83f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:4d:96', 'vm-uuid': '16a0cc8d-c65b-4166-ad1a-5318b18ed00e'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:51.087579 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:51.088551 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:05:51.097102 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:51.098868 np0000001127 nova-compute[98206]: INFO os_vif [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:4d:96,bridge_name='br-int',has_traffic_filtering=True,id=ef5fecf8-83a1-4153-927b-7f8b543f83f3,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef5fecf8-83')
May 21 02:05:51.113025 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:05:51.162251 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:05:51.162798 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:05:51.163790 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:05:51.175622 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:05:51.175899 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:05:51.190660 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:51.239029 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 96, target: iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317, portal: 192.168.40.100,3260]
May 21 02:05:51.239029 np0000001127 nova-compute[98206]: Logout of [sid: 96, target: iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317, portal: 192.168.40.100,3260] successful.
May 21 02:05:51.239029 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:51.260160 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:51.272299 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:51.304996 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 97, target: iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317, portal: 192.168.50.100,3260]
May 21 02:05:51.304996 np0000001127 nova-compute[98206]: Logout of [sid: 97, target: iqn.2023-03.storpool.com:os--volume-0bc85eae-59fe-4ca0-88d4-39d1c14b8317, portal: 192.168.50.100,3260] successful.
May 21 02:05:51.304996 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:51.324706 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:51.324986 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:05:51.325170 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] <== disconnect_volume: return (3187ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:05:51.325338 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:05:51.496315 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:05:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1190516628',display_name='tempest-TestVolumeBootPatternV346-server-1190516628',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpatternv346-server-1190516628',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhquHOJAY7QotjYy2HAWitc6rV9lQkf+vLPGZ1M5EWGWaD/LpdqqS3/jOkdchMOpWlNKqHVY6azcL9bcMNaE5y+/NqN74KQvQ6f0zqKwmTC8Qd1i76heeAQRoE8JyWgMQ==',key_name='tempest-keypair-2037732520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89e0ea7da0f244aab58f9da579e53864',ramdisk_id='',reservation_id='r-mg1djcvs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1354384974',owner_user_name='tempest-TestVolumeBootPatternV346-1354384974-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:05:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0083b33595414e5e8a3a80e7fea274ba',uuid=45f01b41-a43c-4ddf-aa07-22f8c2c50758,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75b84cf5-3aac-411c-acc8-a12b14a9f98a", "address": "fa:16:3e:68:a8:10", "network": {"id": "460fd532-ef54-4f63-922b-b9d9f73f665f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1504169250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89e0ea7da0f244aab58f9da579e53864", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75b84cf5-3a", "ovs_interfaceid": "75b84cf5-3aac-411c-acc8-a12b14a9f98a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:05:51.496555 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Converting VIF {"id": "75b84cf5-3aac-411c-acc8-a12b14a9f98a", "address": "fa:16:3e:68:a8:10", "network": {"id": "460fd532-ef54-4f63-922b-b9d9f73f665f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1504169250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89e0ea7da0f244aab58f9da579e53864", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75b84cf5-3a", "ovs_interfaceid": "75b84cf5-3aac-411c-acc8-a12b14a9f98a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:05:51.497049 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:a8:10,bridge_name='br-int',has_traffic_filtering=True,id=75b84cf5-3aac-411c-acc8-a12b14a9f98a,network=Network(460fd532-ef54-4f63-922b-b9d9f73f665f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75b84cf5-3a') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:05:51.497635 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lazy-loading 'pci_devices' on Instance uuid 45f01b41-a43c-4ddf-aa07-22f8c2c50758 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:05:51.558303 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:51.676014 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:05:51.898951 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lazy-loading 'flavor' on Instance uuid f63a2253-071a-4a1a-94af-3544b20c39cf {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:05:52.005748 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] End _get_guest_xml xml=<domain type="qemu">
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:   <uuid>45f01b41-a43c-4ddf-aa07-22f8c2c50758</uuid>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:   <name>instance-0000002f</name>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:       <nova:name>tempest-TestVolumeBootPatternV346-server-1190516628</nova:name>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:05:47</nova:creationTime>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:       <nova:image uuid="">
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:         <nova:user uuid="0083b33595414e5e8a3a80e7fea274ba">tempest-TestVolumeBootPatternV346-1354384974-project-member</nova:user>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:         <nova:project uuid="89e0ea7da0f244aab58f9da579e53864">tempest-TestVolumeBootPatternV346-1354384974</nova:project>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:       <nova:root type="volume" uuid=""/>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:         <nova:port uuid="75b84cf5-3aac-411c-acc8-a12b14a9f98a">
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:     <system>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:       <entry name="serial">45f01b41-a43c-4ddf-aa07-22f8c2c50758</entry>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:       <entry name="uuid">45f01b41-a43c-4ddf-aa07-22f8c2c50758</entry>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:     </system>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:   <os>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:   </os>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:   <features>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:   </features>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:   <devices>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/45f01b41-a43c-4ddf-aa07-22f8c2c50758/disk.config"/>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:     </disk>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:       <alias name="ua-d65b4beb-8e98-46fc-b1d2-4193962d5bb9"/>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-8"/>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:       <serial>d65b4beb-8e98-46fc-b1d2-4193962d5bb9</serial>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:     </disk>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:68:a8:10"/>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:       <target dev="tap75b84cf5-3a"/>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:     </interface>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/45f01b41-a43c-4ddf-aa07-22f8c2c50758/console.log" append="off"/>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:     </serial>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:     <video>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:     </video>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:     </rng>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:   </devices>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]: </domain>
May 21 02:05:52.005748 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:05:52.008447 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Preparing to wait for external event network-vif-plugged-75b84cf5-3aac-411c-acc8-a12b14a9f98a {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:05:52.008447 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Acquiring lock "45f01b41-a43c-4ddf-aa07-22f8c2c50758-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:52.008447 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "45f01b41-a43c-4ddf-aa07-22f8c2c50758-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:52.008447 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "45f01b41-a43c-4ddf-aa07-22f8c2c50758-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:52.008447 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:05:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1190516628',display_name='tempest-TestVolumeBootPatternV346-server-1190516628',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpatternv346-server-1190516628',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhquHOJAY7QotjYy2HAWitc6rV9lQkf+vLPGZ1M5EWGWaD/LpdqqS3/jOkdchMOpWlNKqHVY6azcL9bcMNaE5y+/NqN74KQvQ6f0zqKwmTC8Qd1i76heeAQRoE8JyWgMQ==',key_name='tempest-keypair-2037732520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89e0ea7da0f244aab58f9da579e53864',ramdisk_id='',reservation_id='r-mg1djcvs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1354384974',owner_user_name='tempest-TestVolumeBootPatternV346-1354384974-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:05:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0083b33595414e5e8a3a80e7fea274ba',uuid=45f01b41-a43c-4ddf-aa07-22f8c2c50758,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75b84cf5-3aac-411c-acc8-a12b14a9f98a", "address": "fa:16:3e:68:a8:10", "network": {"id": "460fd532-ef54-4f63-922b-b9d9f73f665f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1504169250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89e0ea7da0f244aab58f9da579e53864", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75b84cf5-3a", "ovs_interfaceid": "75b84cf5-3aac-411c-acc8-a12b14a9f98a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:05:52.008447 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Converting VIF {"id": "75b84cf5-3aac-411c-acc8-a12b14a9f98a", "address": "fa:16:3e:68:a8:10", "network": {"id": "460fd532-ef54-4f63-922b-b9d9f73f665f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1504169250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89e0ea7da0f244aab58f9da579e53864", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75b84cf5-3a", "ovs_interfaceid": "75b84cf5-3aac-411c-acc8-a12b14a9f98a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:05:52.008447 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:a8:10,bridge_name='br-int',has_traffic_filtering=True,id=75b84cf5-3aac-411c-acc8-a12b14a9f98a,network=Network(460fd532-ef54-4f63-922b-b9d9f73f665f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75b84cf5-3a') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:05:52.009078 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:a8:10,bridge_name='br-int',has_traffic_filtering=True,id=75b84cf5-3aac-411c-acc8-a12b14a9f98a,network=Network(460fd532-ef54-4f63-922b-b9d9f73f665f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75b84cf5-3a') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:05:52.009723 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:52.009723 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:52.009723 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:05:52.010853 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:52.010853 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6cba4bf6-d0e1-5389-83d1-9566ecf334c4', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:52.011987 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:52.011987 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:05:52.019151 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:52.021723 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:52.021723 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75b84cf5-3a, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:52.021723 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap75b84cf5-3a, col_values=(('qos', UUID('efc915ed-d2d3-4668-88cc-a37f4ef18f30')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:52.021723 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap75b84cf5-3a, col_values=(('external_ids', {'iface-id': '75b84cf5-3aac-411c-acc8-a12b14a9f98a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:a8:10', 'vm-uuid': '45f01b41-a43c-4ddf-aa07-22f8c2c50758'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:52.023591 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:52.023591 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:05:52.033864 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:52.034205 np0000001127 nova-compute[98206]: INFO os_vif [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:a8:10,bridge_name='br-int',has_traffic_filtering=True,id=75b84cf5-3aac-411c-acc8-a12b14a9f98a,network=Network(460fd532-ef54-4f63-922b-b9d9f73f665f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75b84cf5-3a')
May 21 02:05:52.182550 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:52.183268 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:52.183268 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:52.183388 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Auditing locally available compute resources for np0000001127 (node: np0000001127) {{(pid=98206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 21 02:05:52.334639 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:52.623137 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:05:52.623253 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:05:52.623384 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No VIF found with MAC fa:16:3e:fb:4d:96, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:05:52.623866 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Using config drive
May 21 02:05:52.907226 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3f7b0c88-fc96-4b61-8f20-1e348abfe537 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "f63a2253-071a-4a1a-94af-3544b20c39cf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.974s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:53.131492 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:53.246265 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b4239c5-84df-4d87-a2d4-fb6192408f58/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:53.358647 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Creating config drive at /opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e/disk.config
May 21 02:05:53.363552 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b4239c5-84df-4d87-a2d4-fb6192408f58/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:05:53.363552 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b4239c5-84df-4d87-a2d4-fb6192408f58/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:53.393829 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpko45foqh {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:53.447057 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "f63a2253-071a-4a1a-94af-3544b20c39cf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:53.447057 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "f63a2253-071a-4a1a-94af-3544b20c39cf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:53.463875 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpko45foqh" returned: 0 in 0.072s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:05:53.477673 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b4239c5-84df-4d87-a2d4-fb6192408f58/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:05:53.491200 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-5 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:05:53.495224 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f63a2253-071a-4a1a-94af-3544b20c39cf/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:53.500802 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.006170825000026525 future=<Future at 0x71c0584616a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:05:53.502200 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Emitting event <LifecycleEvent: 1779329138.4944522, 76097fea-0890-40a8-a902-9f510cd34b52 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:05:53.502730 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:05:53.503293 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] VM Stopped (Lifecycle Event)
May 21 02:05:53.523069 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=0.5037723300001744 future=<Future at 0x71c098396bd0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:05:53.524705 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=0.5021402440002021 future=<Future at 0x71c098396bd0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:05:53.571668 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:05:53.571898 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:05:53.572296 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] No VIF found with MAC fa:16:3e:68:a8:10, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:05:53.572975 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Using config drive
May 21 02:05:53.616790 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f63a2253-071a-4a1a-94af-3544b20c39cf/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:05:53.619294 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f63a2253-071a-4a1a-94af-3544b20c39cf/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:53.749776 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f63a2253-071a-4a1a-94af-3544b20c39cf/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:05:53.750008 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-1 (vdc) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:05:53.953454 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Detaching volume 517928f6-d49a-4bf2-b1b8-bee0a4dba99f
May 21 02:05:54.020932 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:54.024999 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Attempting to driver detach volume 517928f6-d49a-4bf2-b1b8-bee0a4dba99f from mountpoint /dev/vdc
May 21 02:05:54.028897 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 76097fea-0890-40a8-a902-9f510cd34b52] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:54.029541 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.002874762999908853 future=<Future at 0x71c098396bd0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:05:54.030310 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Emitting event <LifecycleEvent: 1779329139.026503, dc3e1d06-6926-4fd2-b5c2-5d6104ba6826 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:05:54.030793 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:05:54.031116 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] VM Stopped (Lifecycle Event)
May 21 02:05:54.052726 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Found disk vdc by alias ua-517928f6-d49a-4bf2-b1b8-bee0a4dba99f {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:05:54.054823 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Found disk vdc by alias ua-517928f6-d49a-4bf2-b1b8-bee0a4dba99f {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:05:54.055063 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Attempting to detach device vdc from instance f63a2253-071a-4a1a-94af-3544b20c39cf from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 02:05:54.058681 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:05:54.058681 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:05:54.058681 np0000001127 nova-compute[98206]:   <alias name="ua-517928f6-d49a-4bf2-b1b8-bee0a4dba99f"/>
May 21 02:05:54.058681 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-1"/>
May 21 02:05:54.058681 np0000001127 nova-compute[98206]:   <target dev="vdc" bus="virtio"/>
May 21 02:05:54.058681 np0000001127 nova-compute[98206]:   <serial>517928f6-d49a-4bf2-b1b8-bee0a4dba99f</serial>
May 21 02:05:54.058681 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 21 02:05:54.058681 np0000001127 nova-compute[98206]: </disk>
May 21 02:05:54.058681 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:05:54.059239 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:54.072868 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Successfully detached device vdc from instance f63a2253-071a-4a1a-94af-3544b20c39cf from the persistent domain config.
May 21 02:05:54.073657 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] (1/8): Attempting to detach device vdc with device alias ua-517928f6-d49a-4bf2-b1b8-bee0a4dba99f from instance f63a2253-071a-4a1a-94af-3544b20c39cf from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 02:05:54.073657 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:05:54.073657 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:05:54.073657 np0000001127 nova-compute[98206]:   <alias name="ua-517928f6-d49a-4bf2-b1b8-bee0a4dba99f"/>
May 21 02:05:54.073657 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-1"/>
May 21 02:05:54.073657 np0000001127 nova-compute[98206]:   <target dev="vdc" bus="virtio"/>
May 21 02:05:54.073657 np0000001127 nova-compute[98206]:   <serial>517928f6-d49a-4bf2-b1b8-bee0a4dba99f</serial>
May 21 02:05:54.073657 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 21 02:05:54.073657 np0000001127 nova-compute[98206]: </disk>
May 21 02:05:54.073657 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:05:54.085254 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:54.190213 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:54.251811 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:54.258766 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:54.270885 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:54.293361 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-910f34ec-9315-4d22-bd2f-96ce29013006 req-f4021b45-6234-45b0-ac4a-c2bfadaa0b18 service nova] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Received event network-vif-plugged-ef5fecf8-83a1-4153-927b-7f8b543f83f3 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:54.300483 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-910f34ec-9315-4d22-bd2f-96ce29013006 req-f4021b45-6234-45b0-ac4a-c2bfadaa0b18 service nova] Acquiring lock "16a0cc8d-c65b-4166-ad1a-5318b18ed00e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:54.300974 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-910f34ec-9315-4d22-bd2f-96ce29013006 req-f4021b45-6234-45b0-ac4a-c2bfadaa0b18 service nova] Lock "16a0cc8d-c65b-4166-ad1a-5318b18ed00e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:54.301229 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-910f34ec-9315-4d22-bd2f-96ce29013006 req-f4021b45-6234-45b0-ac4a-c2bfadaa0b18 service nova] Lock "16a0cc8d-c65b-4166-ad1a-5318b18ed00e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:54.301409 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-910f34ec-9315-4d22-bd2f-96ce29013006 req-f4021b45-6234-45b0-ac4a-c2bfadaa0b18 service nova] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Processing event network-vif-plugged-ef5fecf8-83a1-4153-927b-7f8b543f83f3 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:05:54.354104 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Creating config drive at /opt/stack/data/nova/instances/45f01b41-a43c-4ddf-aa07-22f8c2c50758/disk.config
May 21 02:05:54.360013 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/45f01b41-a43c-4ddf-aa07-22f8c2c50758/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_ptsqc23 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:54.393273 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:05:54.394387 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:54.435912 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/45f01b41-a43c-4ddf-aa07-22f8c2c50758/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_ptsqc23" returned: 0 in 0.075s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:05:54.513705 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:05:54.520018 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9a1a2a-77bd-4fe9-ae88-344c193980f5/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:54.544930 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-0c31446c-398c-4bc2-8daa-377f4bc97e59 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: dc3e1d06-6926-4fd2-b5c2-5d6104ba6826] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:54.647033 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9a1a2a-77bd-4fe9-ae88-344c193980f5/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:05:54.648502 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9a1a2a-77bd-4fe9-ae88-344c193980f5/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:54.773008 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9a1a2a-77bd-4fe9-ae88-344c193980f5/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:05:54.811054 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779329154.8104856, f63a2253-071a-4a1a-94af-3544b20c39cf => ua-517928f6-d49a-4bf2-b1b8-bee0a4dba99f> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 02:05:54.816455 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-517928f6-d49a-4bf2-b1b8-bee0a4dba99f for instance f63a2253-071a-4a1a-94af-3544b20c39cf {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 02:05:54.823228 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Successfully detached device vdc from instance f63a2253-071a-4a1a-94af-3544b20c39cf from the live domain config.
May 21 02:05:54.825364 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:05:54.825364 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f', 'iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '517928f6-d49a-4bf2-b1b8-bee0a4dba99f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:05:54.825364 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:05:55.064303 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:55.093383 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:55.097436 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:55.129305 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:05:55.131395 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329155.1310842, 16a0cc8d-c65b-4166-ad1a-5318b18ed00e => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:05:55.131638 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] VM Started (Lifecycle Event)
May 21 02:05:55.136554 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:05:55.143110 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Instance spawned successfully.
May 21 02:05:55.143434 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:05:55.212984 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:55.281141 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.454s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:05:55.283936 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f', 'iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '517928f6-d49a-4bf2-b1b8-bee0a4dba99f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:05:55.283936 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:05:55.296928 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-8 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:05:55.303224 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:05:55.313632 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:05:55.315005 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:05:55.335664 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f (non-flash)
May 21 02:05:55.335664 np0000001127 nova-compute[98206]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f (non-flash)
May 21 02:05:55.335664 np0000001127 nova-compute[98206]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:05:55.335664 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:05:55.335664 np0000001127 nova-compute[98206]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c4248ca-46a6-4e10-83e7-8ee5dd6219b0 (non-flash)
May 21 02:05:55.335664 np0000001127 nova-compute[98206]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c4248ca-46a6-4e10-83e7-8ee5dd6219b0 (non-flash)
May 21 02:05:55.335664 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:55.335664 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:55.335664 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:55.335664 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:55.335664 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:05:55.339104 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f (non-flash)
May 21 02:05:55.339104 np0000001127 nova-compute[98206]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f (non-flash)
May 21 02:05:55.339104 np0000001127 nova-compute[98206]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:05:55.339104 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:05:55.339104 np0000001127 nova-compute[98206]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c4248ca-46a6-4e10-83e7-8ee5dd6219b0 (non-flash)
May 21 02:05:55.339104 np0000001127 nova-compute[98206]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c4248ca-46a6-4e10-83e7-8ee5dd6219b0 (non-flash)
May 21 02:05:55.339104 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:55.339104 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:05:55.339104 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:55.339104 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:05:55.339104 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:05:55.339104 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f', '100'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f', '101'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c4248ca-46a6-4e10-83e7-8ee5dd6219b0', '104'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c4248ca-46a6-4e10-83e7-8ee5dd6219b0', '105'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '95'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617', '98'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617', '99')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:05:55.339104 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f', '100')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:05:55.339104 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f', '101')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:05:55.340554 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c0585a3c40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f'): ({'sde'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:05:55.341112 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Removing multipathed devices sdd, sde {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:05:55.341706 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Flush multipath device 3300000004eb23052 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:05:55.376932 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:05:55.380446 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "env LANG=C uptime" returned: 0 in 0.065s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:05:55.382465 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Hypervisor/Node resource view: name=np0000001127 free_ram=12759MB free_disk=74.00810241699219GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 21 02:05:55.383846 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:55.384174 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:55.427947 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:05:55.468634 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:05:55.468890 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:05:55.470292 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:05:55.490960 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:05:55.491255 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:05:55.508743 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:55.513371 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:55.516528 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:55.527873 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:55.531161 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:55.547173 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 100, target: iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f, portal: 192.168.40.100,3260]
May 21 02:05:55.547173 np0000001127 nova-compute[98206]: Logout of [sid: 100, target: iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f, portal: 192.168.40.100,3260] successful.
May 21 02:05:55.547173 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:55.555603 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:55.575434 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:55.591431 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:55.629390 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 101, target: iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f, portal: 192.168.50.100,3260]
May 21 02:05:55.629390 np0000001127 nova-compute[98206]: Logout of [sid: 101, target: iqn.2023-03.storpool.com:os--volume-517928f6-d49a-4bf2-b1b8-bee0a4dba99f, portal: 192.168.50.100,3260] successful.
May 21 02:05:55.629390 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:55.637032 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:55.639956 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:05:55.651551 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:55.651742 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:55.653315 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:55.653680 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:55.654203 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:55.654576 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:55.658290 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:05:55.658865 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:05:55.658999 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] <== disconnect_volume: return (832ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:05:55.659110 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:05:56.143070 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:05:56.143994 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329156.1432202, 16a0cc8d-c65b-4166-ad1a-5318b18ed00e => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:05:56.143994 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] VM Paused (Lifecycle Event)
May 21 02:05:56.164324 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Took 7.64 seconds to spawn the instance on the hypervisor.
May 21 02:05:56.164732 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:56.252026 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lazy-loading 'flavor' on Instance uuid f63a2253-071a-4a1a-94af-3544b20c39cf {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:05:56.361272 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8ce69e2c-ed3f-4992-b526-2e9dcb6b476e req-79699603-1689-4dcd-945f-07ef425866b8 service nova] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Received event network-vif-plugged-ef5fecf8-83a1-4153-927b-7f8b543f83f3 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:56.362911 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8ce69e2c-ed3f-4992-b526-2e9dcb6b476e req-79699603-1689-4dcd-945f-07ef425866b8 service nova] Acquiring lock "16a0cc8d-c65b-4166-ad1a-5318b18ed00e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:56.363718 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8ce69e2c-ed3f-4992-b526-2e9dcb6b476e req-79699603-1689-4dcd-945f-07ef425866b8 service nova] Lock "16a0cc8d-c65b-4166-ad1a-5318b18ed00e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:56.364543 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8ce69e2c-ed3f-4992-b526-2e9dcb6b476e req-79699603-1689-4dcd-945f-07ef425866b8 service nova] Lock "16a0cc8d-c65b-4166-ad1a-5318b18ed00e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:56.364830 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8ce69e2c-ed3f-4992-b526-2e9dcb6b476e req-79699603-1689-4dcd-945f-07ef425866b8 service nova] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] No waiting events found dispatching network-vif-plugged-ef5fecf8-83a1-4153-927b-7f8b543f83f3 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:05:56.365357 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-8ce69e2c-ed3f-4992-b526-2e9dcb6b476e req-79699603-1689-4dcd-945f-07ef425866b8 service nova] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Received unexpected event network-vif-plugged-ef5fecf8-83a1-4153-927b-7f8b543f83f3 for instance with vm_state active and task_state None.
May 21 02:05:56.365615 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8ce69e2c-ed3f-4992-b526-2e9dcb6b476e req-79699603-1689-4dcd-945f-07ef425866b8 service nova] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Received event network-vif-plugged-75b84cf5-3aac-411c-acc8-a12b14a9f98a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:56.365849 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8ce69e2c-ed3f-4992-b526-2e9dcb6b476e req-79699603-1689-4dcd-945f-07ef425866b8 service nova] Acquiring lock "45f01b41-a43c-4ddf-aa07-22f8c2c50758-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:56.366081 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8ce69e2c-ed3f-4992-b526-2e9dcb6b476e req-79699603-1689-4dcd-945f-07ef425866b8 service nova] Lock "45f01b41-a43c-4ddf-aa07-22f8c2c50758-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:56.366333 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8ce69e2c-ed3f-4992-b526-2e9dcb6b476e req-79699603-1689-4dcd-945f-07ef425866b8 service nova] Lock "45f01b41-a43c-4ddf-aa07-22f8c2c50758-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:56.366591 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8ce69e2c-ed3f-4992-b526-2e9dcb6b476e req-79699603-1689-4dcd-945f-07ef425866b8 service nova] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Processing event network-vif-plugged-75b84cf5-3aac-411c-acc8-a12b14a9f98a {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:05:56.367037 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8ce69e2c-ed3f-4992-b526-2e9dcb6b476e req-79699603-1689-4dcd-945f-07ef425866b8 service nova] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Received event network-vif-plugged-75b84cf5-3aac-411c-acc8-a12b14a9f98a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:56.367331 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8ce69e2c-ed3f-4992-b526-2e9dcb6b476e req-79699603-1689-4dcd-945f-07ef425866b8 service nova] Acquiring lock "45f01b41-a43c-4ddf-aa07-22f8c2c50758-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:56.367705 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:05:56.367971 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8ce69e2c-ed3f-4992-b526-2e9dcb6b476e req-79699603-1689-4dcd-945f-07ef425866b8 service nova] Lock "45f01b41-a43c-4ddf-aa07-22f8c2c50758-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:56.368459 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8ce69e2c-ed3f-4992-b526-2e9dcb6b476e req-79699603-1689-4dcd-945f-07ef425866b8 service nova] Lock "45f01b41-a43c-4ddf-aa07-22f8c2c50758-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:56.369131 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8ce69e2c-ed3f-4992-b526-2e9dcb6b476e req-79699603-1689-4dcd-945f-07ef425866b8 service nova] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] No waiting events found dispatching network-vif-plugged-75b84cf5-3aac-411c-acc8-a12b14a9f98a {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:05:56.369333 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-8ce69e2c-ed3f-4992-b526-2e9dcb6b476e req-79699603-1689-4dcd-945f-07ef425866b8 service nova] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Received unexpected event network-vif-plugged-75b84cf5-3aac-411c-acc8-a12b14a9f98a for instance with vm_state building and task_state spawning.
May 21 02:05:56.372711 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:05:56.375024 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Instance spawned successfully.
May 21 02:05:56.375388 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:05:56.488404 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance f63a2253-071a-4a1a-94af-3544b20c39cf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:05:56.488536 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 0b9a1a2a-77bd-4fe9-ae88-344c193980f5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:05:56.488668 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 6ccaedfe-bec9-4591-b845-acf0cc81d026 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:05:56.488792 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 3e53c443-92d8-4e5c-bc47-43deb205786b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:05:56.489283 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 9b4239c5-84df-4d87-a2d4-fb6192408f58 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:05:56.489283 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 45f01b41-a43c-4ddf-aa07-22f8c2c50758 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:05:56.489359 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 16a0cc8d-c65b-4166-ad1a-5318b18ed00e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:05:56.490491 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 21 02:05:56.490491 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Final resource view: name=np0000001127 phys_ram=24030MB used_ram=1856MB phys_disk=95GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:05:55 up 36 min,  2 users,  load average: 10.47, 8.97, 5.39\n', 'num_instances': '7', 'num_vm_active': '5', 'num_task_None': '5', 'num_os_type_None': '7', 'num_proj_e80cee8643f34f6685ff7fb42920afc3': '1', 'io_workload': '2', 'num_proj_d3efe4046d6a442d91b3463e2d99fd7b': '1', 'num_proj_848912b0c0e94d2795bb2332daf1730e': '2', 'num_proj_62ebdb16aee84e22a88dfc8960debd32': '1', 'num_proj_b72317ce75214e619a14739991461c95': '1', 'num_vm_building': '2', 'num_task_spawning': '2', 'num_proj_89e0ea7da0f244aab58f9da579e53864': '1'} {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 21 02:05:56.557943 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:56.650260 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:56.656796 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329156.6553168, 16a0cc8d-c65b-4166-ad1a-5318b18ed00e => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:05:56.656796 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] VM Resumed (Lifecycle Event)
May 21 02:05:56.677439 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Took 15.44 seconds to build instance.
May 21 02:05:56.881850 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:56.882001 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:56.882337 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:56.882396 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:56.882660 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:56.882894 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:05:57.004292 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:05:57.004610 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:05:57.029258 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:57.160514 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:57.166120 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:05:57.179921 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7db04e0c-f165-42fc-b9a1-6942e41c41e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "16a0cc8d-c65b-4166-ad1a-5318b18ed00e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.962s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:57.262412 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3f495d2b-d6d7-45d6-a2f9-38645123bbc5 tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "f63a2253-071a-4a1a-94af-3544b20c39cf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.815s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:57.389369 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Took 9.67 seconds to spawn the instance on the hypervisor.
May 21 02:05:57.389369 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:57.509651 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:05:57.672911 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329157.671927, 45f01b41-a43c-4ddf-aa07-22f8c2c50758 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:05:57.672911 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] VM Started (Lifecycle Event)
May 21 02:05:57.849916 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-4410e7ea-7541-4376-97c2-f3355ae56a01 req-67c67c04-9e7c-4e2c-8895-e2bd76bac870 service nova] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Received event network-changed-ef5fecf8-83a1-4153-927b-7f8b543f83f3 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:57.850090 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-4410e7ea-7541-4376-97c2-f3355ae56a01 req-67c67c04-9e7c-4e2c-8895-e2bd76bac870 service nova] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Refreshing instance network info cache due to event network-changed-ef5fecf8-83a1-4153-927b-7f8b543f83f3. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:05:57.850315 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4410e7ea-7541-4376-97c2-f3355ae56a01 req-67c67c04-9e7c-4e2c-8895-e2bd76bac870 service nova] Acquiring lock "refresh_cache-16a0cc8d-c65b-4166-ad1a-5318b18ed00e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:05:57.850448 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4410e7ea-7541-4376-97c2-f3355ae56a01 req-67c67c04-9e7c-4e2c-8895-e2bd76bac870 service nova] Acquired lock "refresh_cache-16a0cc8d-c65b-4166-ad1a-5318b18ed00e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:05:57.850657 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-4410e7ea-7541-4376-97c2-f3355ae56a01 req-67c67c04-9e7c-4e2c-8895-e2bd76bac870 service nova] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Refreshing network info cache for port ef5fecf8-83a1-4153-927b-7f8b543f83f3 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:05:57.911630 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Took 17.18 seconds to build instance.
May 21 02:05:58.026556 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Compute_service record updated for np0000001127:np0000001127 {{(pid=98206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 21 02:05:58.028723 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.643s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:58.030683 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.87 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:05:58.177017 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:58.182734 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:05:58.305865 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-6858d4b5-d45c-449f-bfe1-2276ef897b3e tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "f63a2253-071a-4a1a-94af-3544b20c39cf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:58.307233 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-6858d4b5-d45c-449f-bfe1-2276ef897b3e tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "f63a2253-071a-4a1a-94af-3544b20c39cf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:58.307233 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-6858d4b5-d45c-449f-bfe1-2276ef897b3e tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "f63a2253-071a-4a1a-94af-3544b20c39cf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:58.307233 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-6858d4b5-d45c-449f-bfe1-2276ef897b3e tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "f63a2253-071a-4a1a-94af-3544b20c39cf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:58.307233 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-6858d4b5-d45c-449f-bfe1-2276ef897b3e tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "f63a2253-071a-4a1a-94af-3544b20c39cf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:58.310852 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-6858d4b5-d45c-449f-bfe1-2276ef897b3e tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Terminating instance
May 21 02:05:58.358200 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-4410e7ea-7541-4376-97c2-f3355ae56a01 req-67c67c04-9e7c-4e2c-8895-e2bd76bac870 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:58.413640 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "45f01b41-a43c-4ddf-aa07-22f8c2c50758" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.699s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:58.688973 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329158.6879146, 45f01b41-a43c-4ddf-aa07-22f8c2c50758 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:05:58.689155 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] VM Paused (Lifecycle Event)
May 21 02:05:58.809689 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "0b9a1a2a-77bd-4fe9-ae88-344c193980f5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:58.809871 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "0b9a1a2a-77bd-4fe9-ae88-344c193980f5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:58.828830 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-6858d4b5-d45c-449f-bfe1-2276ef897b3e tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:05:58.864764 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:58.886205 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:58.899169 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:58.905742 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:05:58.906203 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:05:58.906589 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.77 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:05:58.938303 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:58.981028 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-4410e7ea-7541-4376-97c2-f3355ae56a01 req-67c67c04-9e7c-4e2c-8895-e2bd76bac870 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:05:59.154983 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:59.170928 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:59.194217 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:59.194833 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Instance destroyed successfully.
May 21 02:05:59.195846 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-6858d4b5-d45c-449f-bfe1-2276ef897b3e tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lazy-loading 'resources' on Instance uuid f63a2253-071a-4a1a-94af-3544b20c39cf {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:05:59.206486 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329159.2060943, 45f01b41-a43c-4ddf-aa07-22f8c2c50758 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:05:59.206778 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] VM Resumed (Lifecycle Event)
May 21 02:05:59.316739 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lazy-loading 'flavor' on Instance uuid 0b9a1a2a-77bd-4fe9-ae88-344c193980f5 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:05:59.320694 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-55627731-0991-4a64-bfae-ee16b28d8597 req-ac1a4fb3-b045-4604-acd8-7388ead1aa02 service nova] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Received event network-vif-unplugged-e5285be0-d97c-43fc-93a2-91ac21456315 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:05:59.324709 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-55627731-0991-4a64-bfae-ee16b28d8597 req-ac1a4fb3-b045-4604-acd8-7388ead1aa02 service nova] Acquiring lock "f63a2253-071a-4a1a-94af-3544b20c39cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:59.324935 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-55627731-0991-4a64-bfae-ee16b28d8597 req-ac1a4fb3-b045-4604-acd8-7388ead1aa02 service nova] Lock "f63a2253-071a-4a1a-94af-3544b20c39cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:05:59.325376 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-55627731-0991-4a64-bfae-ee16b28d8597 req-ac1a4fb3-b045-4604-acd8-7388ead1aa02 service nova] Lock "f63a2253-071a-4a1a-94af-3544b20c39cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:05:59.325376 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-55627731-0991-4a64-bfae-ee16b28d8597 req-ac1a4fb3-b045-4604-acd8-7388ead1aa02 service nova] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] No waiting events found dispatching network-vif-unplugged-e5285be0-d97c-43fc-93a2-91ac21456315 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:05:59.325493 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-55627731-0991-4a64-bfae-ee16b28d8597 req-ac1a4fb3-b045-4604-acd8-7388ead1aa02 service nova] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Received event network-vif-unplugged-e5285be0-d97c-43fc-93a2-91ac21456315 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:05:59.360545 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-4410e7ea-7541-4376-97c2-f3355ae56a01 req-67c67c04-9e7c-4e2c-8895-e2bd76bac870 service nova] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Updated VIF entry in instance network info cache for port ef5fecf8-83a1-4153-927b-7f8b543f83f3. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:05:59.361013 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-4410e7ea-7541-4376-97c2-f3355ae56a01 req-67c67c04-9e7c-4e2c-8895-e2bd76bac870 service nova] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Updating instance_info_cache with network_info: [{"id": "ef5fecf8-83a1-4153-927b-7f8b543f83f3", "address": "fa:16:3e:fb:4d:96", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef5fecf8-83", "ovs_interfaceid": "ef5fecf8-83a1-4153-927b-7f8b543f83f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:05:59.704119 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-6858d4b5-d45c-449f-bfe1-2276ef897b3e tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1805805920',display_name='tempest-AttachVolumeTestJSON-server-1805805920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumetestjson-server-1805805920',id=39,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1mwjMvDhv68B2iNB8g+Hoov8ngsHV3yBRmTudTzshaxljlTmc+1N3i2q9+iI9ANNsL6rH21VI2EgAQpOgsVVXfV+RzewnGo3NfT0Dw0942D5T+gP/mRdgi35PF4wHrGg==',key_name='tempest-keypair-869733350',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:04:44Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e80cee8643f34f6685ff7fb42920afc3',ramdisk_id='',reservation_id='r-g3p2xd94',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2050140136',owner_user_name='tempest-AttachVolumeTestJSON-2050140136-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:04:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='640fad0f3dfe4ee99b04c12c2b8fd9dd',uuid=f63a2253-071a-4a1a-94af-3544b20c39cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5285be0-d97c-43fc-93a2-91ac21456315", "address": "fa:16:3e:ca:eb:af", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5285be0-d9", "ovs_interfaceid": "e5285be0-d97c-43fc-93a2-91ac21456315", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:05:59.704119 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-6858d4b5-d45c-449f-bfe1-2276ef897b3e tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Converting VIF {"id": "e5285be0-d97c-43fc-93a2-91ac21456315", "address": "fa:16:3e:ca:eb:af", "network": {"id": "70a21e20-dfdf-49b9-bfd2-75a1f49c8a86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-846228823-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e80cee8643f34f6685ff7fb42920afc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5285be0-d9", "ovs_interfaceid": "e5285be0-d97c-43fc-93a2-91ac21456315", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:05:59.708495 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-6858d4b5-d45c-449f-bfe1-2276ef897b3e tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:eb:af,bridge_name='br-int',has_traffic_filtering=True,id=e5285be0-d97c-43fc-93a2-91ac21456315,network=Network(70a21e20-dfdf-49b9-bfd2-75a1f49c8a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5285be0-d9') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:05:59.708495 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-6858d4b5-d45c-449f-bfe1-2276ef897b3e tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:eb:af,bridge_name='br-int',has_traffic_filtering=True,id=e5285be0-d97c-43fc-93a2-91ac21456315,network=Network(70a21e20-dfdf-49b9-bfd2-75a1f49c8a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5285be0-d9') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:05:59.708495 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:59.708495 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape5285be0-d9, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:59.710736 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:59.713006 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:05:59.715012 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:05:59.715104 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:59.715391 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2532bbc3-a82e-4fc5-a488-d718f70196c0) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:05:59.716856 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:59.716978 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:05:59.718358 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:05:59.719432 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:05:59.721489 np0000001127 nova-compute[98206]: INFO os_vif [None req-6858d4b5-d45c-449f-bfe1-2276ef897b3e tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:eb:af,bridge_name='br-int',has_traffic_filtering=True,id=e5285be0-d97c-43fc-93a2-91ac21456315,network=Network(70a21e20-dfdf-49b9-bfd2-75a1f49c8a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5285be0-d9')
May 21 02:05:59.721813 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-6858d4b5-d45c-449f-bfe1-2276ef897b3e tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Deleting instance files /opt/stack/data/nova/instances/f63a2253-071a-4a1a-94af-3544b20c39cf_del
May 21 02:05:59.722542 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-6858d4b5-d45c-449f-bfe1-2276ef897b3e tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Deletion of /opt/stack/data/nova/instances/f63a2253-071a-4a1a-94af-3544b20c39cf_del complete
May 21 02:05:59.863412 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4410e7ea-7541-4376-97c2-f3355ae56a01 req-67c67c04-9e7c-4e2c-8895-e2bd76bac870 service nova] Releasing lock "refresh_cache-16a0cc8d-c65b-4166-ad1a-5318b18ed00e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:05:59.983042 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "b6df4554-8490-4d5a-9d4d-acfd46419cb3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:05:59.983270 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "b6df4554-8490-4d5a-9d4d-acfd46419cb3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:00.107912 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-3d22187c-7c75-4d86-9ea9-0950149dc32a req-adba3d09-4e69-4b1a-a198-9ae039290399 service nova] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Received event network-changed-75b84cf5-3aac-411c-acc8-a12b14a9f98a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:06:00.108002 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-3d22187c-7c75-4d86-9ea9-0950149dc32a req-adba3d09-4e69-4b1a-a198-9ae039290399 service nova] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Refreshing instance network info cache due to event network-changed-75b84cf5-3aac-411c-acc8-a12b14a9f98a. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:06:00.108172 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-3d22187c-7c75-4d86-9ea9-0950149dc32a req-adba3d09-4e69-4b1a-a198-9ae039290399 service nova] Acquiring lock "refresh_cache-45f01b41-a43c-4ddf-aa07-22f8c2c50758" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:06:00.108276 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-3d22187c-7c75-4d86-9ea9-0950149dc32a req-adba3d09-4e69-4b1a-a198-9ae039290399 service nova] Acquired lock "refresh_cache-45f01b41-a43c-4ddf-aa07-22f8c2c50758" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:06:00.110927 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-3d22187c-7c75-4d86-9ea9-0950149dc32a req-adba3d09-4e69-4b1a-a198-9ae039290399 service nova] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Refreshing network info cache for port 75b84cf5-3aac-411c-acc8-a12b14a9f98a {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:06:00.225589 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999606889999995 future=<Future at 0x71c058506d20 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:06:00.226315 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.998997149999923 future=<Future at 0x71c058506d20 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:06:00.226315 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.998795986999994 future=<Future at 0x71c058506d20 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:06:00.233714 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-6858d4b5-d45c-449f-bfe1-2276ef897b3e tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Took 1.40 seconds to destroy the instance on the hypervisor.
May 21 02:06:00.235038 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-6858d4b5-d45c-449f-bfe1-2276ef897b3e tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:06:00.235901 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:06:00.236021 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:06:00.236629 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:06:00.329543 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "0b9a1a2a-77bd-4fe9-ae88-344c193980f5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.519s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:00.448664 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:06:00.495367 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:06:00.612837 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-3d22187c-7c75-4d86-9ea9-0950149dc32a req-adba3d09-4e69-4b1a-a198-9ae039290399 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:06:01.120508 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:01.121203 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:01.127918 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:06:01.130312 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Claim successful on node np0000001127
May 21 02:06:01.264876 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-3d22187c-7c75-4d86-9ea9-0950149dc32a req-adba3d09-4e69-4b1a-a198-9ae039290399 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:06:01.442020 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7d19c1ac-f3f3-4585-bc6d-b025fcd5bd4f req-c4459ba9-5db3-4615-90ff-bcb86d7aad32 service nova] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Received event network-vif-unplugged-e5285be0-d97c-43fc-93a2-91ac21456315 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:06:01.442181 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7d19c1ac-f3f3-4585-bc6d-b025fcd5bd4f req-c4459ba9-5db3-4615-90ff-bcb86d7aad32 service nova] Acquiring lock "f63a2253-071a-4a1a-94af-3544b20c39cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:01.442331 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7d19c1ac-f3f3-4585-bc6d-b025fcd5bd4f req-c4459ba9-5db3-4615-90ff-bcb86d7aad32 service nova] Lock "f63a2253-071a-4a1a-94af-3544b20c39cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:01.442492 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7d19c1ac-f3f3-4585-bc6d-b025fcd5bd4f req-c4459ba9-5db3-4615-90ff-bcb86d7aad32 service nova] Lock "f63a2253-071a-4a1a-94af-3544b20c39cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:01.442618 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7d19c1ac-f3f3-4585-bc6d-b025fcd5bd4f req-c4459ba9-5db3-4615-90ff-bcb86d7aad32 service nova] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] No waiting events found dispatching network-vif-unplugged-e5285be0-d97c-43fc-93a2-91ac21456315 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:06:01.442714 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7d19c1ac-f3f3-4585-bc6d-b025fcd5bd4f req-c4459ba9-5db3-4615-90ff-bcb86d7aad32 service nova] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Received event network-vif-unplugged-e5285be0-d97c-43fc-93a2-91ac21456315 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:06:01.442809 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7d19c1ac-f3f3-4585-bc6d-b025fcd5bd4f req-c4459ba9-5db3-4615-90ff-bcb86d7aad32 service nova] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Received event network-vif-deleted-e5285be0-d97c-43fc-93a2-91ac21456315 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:06:01.442935 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-7d19c1ac-f3f3-4585-bc6d-b025fcd5bd4f req-c4459ba9-5db3-4615-90ff-bcb86d7aad32 service nova] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Neutron deleted interface e5285be0-d97c-43fc-93a2-91ac21456315; detaching it from the instance and deleting it from the info cache
May 21 02:06:01.443049 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-7d19c1ac-f3f3-4585-bc6d-b025fcd5bd4f req-c4459ba9-5db3-4615-90ff-bcb86d7aad32 service nova] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:06:01.512781 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-3d22187c-7c75-4d86-9ea9-0950149dc32a req-adba3d09-4e69-4b1a-a198-9ae039290399 service nova] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Updated VIF entry in instance network info cache for port 75b84cf5-3aac-411c-acc8-a12b14a9f98a. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:06:01.513068 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-3d22187c-7c75-4d86-9ea9-0950149dc32a req-adba3d09-4e69-4b1a-a198-9ae039290399 service nova] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Updating instance_info_cache with network_info: [{"id": "75b84cf5-3aac-411c-acc8-a12b14a9f98a", "address": "fa:16:3e:68:a8:10", "network": {"id": "460fd532-ef54-4f63-922b-b9d9f73f665f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1504169250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89e0ea7da0f244aab58f9da579e53864", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75b84cf5-3a", "ovs_interfaceid": "75b84cf5-3aac-411c-acc8-a12b14a9f98a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:06:01.519299 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "0b9a1a2a-77bd-4fe9-ae88-344c193980f5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:01.519299 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "0b9a1a2a-77bd-4fe9-ae88-344c193980f5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:01.519299 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Attaching volume 53a7a7d6-7bab-4974-8121-00c91a9de3c9 to /dev/vdb
May 21 02:06:01.572554 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:06:01.575403 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:01.586205 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:06:01.611068 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:01.658739 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:06:01.659328 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:06:01.676560 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:06:01.677869 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fee1:2e46', 'fe80::2482:bff:fe1b:902b', 'fe80::fc16:3eff:fe0f:28a1', 'fe80::440a:38ff:fe27:fa24', 'fe80::fc16:3eff:febd:860a', 'fe80::c44d:25ff:fe10:25cb', 'fe80::fc16:3eff:fe91:3d5c', 'fe80::a4db:73ff:fe81:949b', 'fe80::fc16:3eff:fefb:4d96', 'fe80::fc16:3eff:fe68:a810', 'fe80::3cc0:a4ff:feab:836e'] 
May 21 02:06:01.677977 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:06:01.678105 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:06:01.678345 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:06:01.678596 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Updating existing volume attachment record: 0a028faf-9786-4219-83b1-8a80050aee9f {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:06:01.688912 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:06:01.953761 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7d19c1ac-f3f3-4585-bc6d-b025fcd5bd4f req-c4459ba9-5db3-4615-90ff-bcb86d7aad32 service nova] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Detach interface failed, port_id=e5285be0-d97c-43fc-93a2-91ac21456315, reason: Instance f63a2253-071a-4a1a-94af-3544b20c39cf could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:06:02.018376 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-3d22187c-7c75-4d86-9ea9-0950149dc32a req-adba3d09-4e69-4b1a-a198-9ae039290399 service nova] Releasing lock "refresh_cache-45f01b41-a43c-4ddf-aa07-22f8c2c50758" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:06:02.194124 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Took 1.96 seconds to deallocate network for instance.
May 21 02:06:02.257876 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:06:02.258495 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9', 'iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '53a7a7d6-7bab-4974-8121-00c91a9de3c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:06:02.258612 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:06:02.259090 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:06:02.259348 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9', 'iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '53a7a7d6-7bab-4974-8121-00c91a9de3c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:06:02.278965 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:06:02.279711 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:06:02.280653 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:06:02.281433 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:06:02.281829 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:06:02.282111 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:06:02.302276 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:06:02.302276 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:02.316549 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:06:02.316549 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:02.325504 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9] added
May 21 02:06:02.325504 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:06:02.325504 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:06:02.325504 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:06:02.325504 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:06:02.325504 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:06:02.325504 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:02.325861 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:06:02.326459 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0438(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:06:02.326459 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:06:02.337363 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9] added
May 21 02:06:02.337363 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:06:02.337363 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:06:02.337363 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:06:02.337363 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:06:02.337363 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:06:02.337363 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:02.337733 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:06:02.337733 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0564(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:06:02.337961 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:06:02.710723 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-6858d4b5-d45c-449f-bfe1-2276ef897b3e tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:02.911761 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:06:02.911887 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:06:03.326726 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:06:03.338302 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:06:03.355673 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:06:03.355673 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:06:03.358746 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:06:03.358746 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:03.378235 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:03.380067 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:03.403330 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:03.403330 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:03.403330 np0000001127 nova-compute[98206]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c4248ca-46a6-4e10-83e7-8ee5dd6219b0 (non-flash)
May 21 02:06:03.403330 np0000001127 nova-compute[98206]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c4248ca-46a6-4e10-83e7-8ee5dd6219b0 (non-flash)
May 21 02:06:03.403330 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:03.403330 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:03.403330 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:03.403330 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:03.403330 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:06:03.403330 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:03.403330 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:03.403330 np0000001127 nova-compute[98206]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c4248ca-46a6-4e10-83e7-8ee5dd6219b0 (non-flash)
May 21 02:06:03.403330 np0000001127 nova-compute[98206]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c4248ca-46a6-4e10-83e7-8ee5dd6219b0 (non-flash)
May 21 02:06:03.403330 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:03.403330 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:03.403330 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:03.403330 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:03.403330 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:06:03.417927 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:06:03.421698 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:03.421698 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:03.421698 np0000001127 nova-compute[98206]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c4248ca-46a6-4e10-83e7-8ee5dd6219b0 (non-flash)
May 21 02:06:03.421698 np0000001127 nova-compute[98206]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c4248ca-46a6-4e10-83e7-8ee5dd6219b0 (non-flash)
May 21 02:06:03.421698 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:03.421698 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:03.421698 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:03.421698 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:03.421698 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:06:03.429171 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:03.429171 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:03.429171 np0000001127 nova-compute[98206]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c4248ca-46a6-4e10-83e7-8ee5dd6219b0 (non-flash)
May 21 02:06:03.429171 np0000001127 nova-compute[98206]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c4248ca-46a6-4e10-83e7-8ee5dd6219b0 (non-flash)
May 21 02:06:03.429171 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:03.429171 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:03.429171 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:03.429171 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:03.429171 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:06:03.479799 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9, portal: 192.168.50.100,3260]
May 21 02:06:03.479799 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9, portal: 192.168.50.100,3260] successful.
May 21 02:06:03.479799 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:03.492187 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:03.497449 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9, portal: 192.168.40.100,3260]
May 21 02:06:03.497449 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9, portal: 192.168.40.100,3260] successful.
May 21 02:06:03.497449 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:03.516181 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:03.516181 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:03.516181 np0000001127 nova-compute[98206]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c4248ca-46a6-4e10-83e7-8ee5dd6219b0 (non-flash)
May 21 02:06:03.516181 np0000001127 nova-compute[98206]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c4248ca-46a6-4e10-83e7-8ee5dd6219b0 (non-flash)
May 21 02:06:03.516181 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:03.516181 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:03.516181 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:03.516181 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:03.516181 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:03.516181 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:03.516181 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:06:03.517003 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:03.517003 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:03.517003 np0000001127 nova-compute[98206]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c4248ca-46a6-4e10-83e7-8ee5dd6219b0 (non-flash)
May 21 02:06:03.517003 np0000001127 nova-compute[98206]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c4248ca-46a6-4e10-83e7-8ee5dd6219b0 (non-flash)
May 21 02:06:03.517003 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:03.517003 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:03.517003 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:03.517003 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:03.517003 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:03.517003 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:03.517003 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:06:03.517003 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:03.517708 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.236s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:06:03.517891 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:06:03.519099 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] HCTL ('9', '-', '-', 0) found on session 106 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:06:03.519260 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:06:03.538010 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Searching for a device in session 106 and hctl ['9', '*', '*', 0] yield: None {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:06:03.546341 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:03.546341 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:03.546341 np0000001127 nova-compute[98206]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c4248ca-46a6-4e10-83e7-8ee5dd6219b0 (non-flash)
May 21 02:06:03.546341 np0000001127 nova-compute[98206]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c4248ca-46a6-4e10-83e7-8ee5dd6219b0 (non-flash)
May 21 02:06:03.546341 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:03.546341 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:03.546341 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:03.546341 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:03.546341 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:03.546341 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:03.546341 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:06:03.546341 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:03.546341 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:03.546341 np0000001127 nova-compute[98206]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c4248ca-46a6-4e10-83e7-8ee5dd6219b0 (non-flash)
May 21 02:06:03.546341 np0000001127 nova-compute[98206]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c4248ca-46a6-4e10-83e7-8ee5dd6219b0 (non-flash)
May 21 02:06:03.546341 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:03.546341 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:03.546341 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:03.546341 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:03.546341 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:03.546341 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:03.546341 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:06:03.546341 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.260s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:06:03.546341 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:06:03.547616 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] HCTL ('10', '-', '-', 0) found on session 107 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:06:03.547616 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:06:03.562836 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Searching for a device in session 107 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:06:03.562836 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '53a7a7d6-7bab-4974-8121-00c91a9de3c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:06:03.933520 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.812s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:03.934332 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-6858d4b5-d45c-449f-bfe1-2276ef897b3e tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.224s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:03.934685 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:06:04.442054 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:06:04.443902 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:06:04.446339 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:06:04.446339 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:06:04.539035 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Searching for a device in session 106 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:06:04.539531 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '53a7a7d6-7bab-4974-8121-00c91a9de3c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:06:04.602699 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '049d6c8cccfa4ae38d78a88ef5be0f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848912b0c0e94d2795bb2332daf1730e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:06:04.696702 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-6858d4b5-d45c-449f-bfe1-2276ef897b3e tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:06:04.697249 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-6858d4b5-d45c-449f-bfe1-2276ef897b3e tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:06:04.718462 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:04.944674 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:06:05.204152 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-6858d4b5-d45c-449f-bfe1-2276ef897b3e tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:06:05.308546 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Found WWN 3300000009c7c166a for multipath device dm-1 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:06:05.308916 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.050s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:06:05.309169 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] <== connect_volume: return (3050ms) {'type': 'block', 'scsi_wwn': '3300000009c7c166a', 'path': '/dev/dm-1', 'multipath_id': '3300000009c7c166a'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:06:05.309339 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009c7c166a', 'path': '/dev/dm-1', 'multipath_id': '3300000009c7c166a'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:06:05.316502 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lazy-loading 'flavor' on Instance uuid 0b9a1a2a-77bd-4fe9-ae88-344c193980f5 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:06:05.380931 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Successfully created port: 2df7e0cb-dcdb-4934-82e5-97157bb2e5a5 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:06:05.450221 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:06:05.713881 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-6858d4b5-d45c-449f-bfe1-2276ef897b3e tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.780s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:05.799127 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-6858d4b5-d45c-449f-bfe1-2276ef897b3e tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Deleted allocations for instance f63a2253-071a-4a1a-94af-3544b20c39cf
May 21 02:06:05.820574 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Attempting to attach volume 53a7a7d6-7bab-4974-8121-00c91a9de3c9 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 02:06:05.823111 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] attach device xml: <disk type="block" device="disk">
May 21 02:06:05.823111 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:06:05.823111 np0000001127 nova-compute[98206]:   <alias name="ua-53a7a7d6-7bab-4974-8121-00c91a9de3c9"/>
May 21 02:06:05.823111 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-1"/>
May 21 02:06:05.823111 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:06:05.823111 np0000001127 nova-compute[98206]:   <serial>53a7a7d6-7bab-4974-8121-00c91a9de3c9</serial>
May 21 02:06:05.823111 np0000001127 nova-compute[98206]: </disk>
May 21 02:06:05.823111 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 02:06:06.098139 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Successfully updated port: 2df7e0cb-dcdb-4934-82e5-97157bb2e5a5 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:06:06.213915 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-327e1163-55ff-4af7-be3e-946979f78ba4 req-27b73aad-70d1-4e81-bcba-51aabef644a7 service nova] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Received event network-changed-2df7e0cb-dcdb-4934-82e5-97157bb2e5a5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:06:06.213915 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-327e1163-55ff-4af7-be3e-946979f78ba4 req-27b73aad-70d1-4e81-bcba-51aabef644a7 service nova] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Refreshing instance network info cache due to event network-changed-2df7e0cb-dcdb-4934-82e5-97157bb2e5a5. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:06:06.213915 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-327e1163-55ff-4af7-be3e-946979f78ba4 req-27b73aad-70d1-4e81-bcba-51aabef644a7 service nova] Acquiring lock "refresh_cache-b6df4554-8490-4d5a-9d4d-acfd46419cb3" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:06:06.213915 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-327e1163-55ff-4af7-be3e-946979f78ba4 req-27b73aad-70d1-4e81-bcba-51aabef644a7 service nova] Acquired lock "refresh_cache-b6df4554-8490-4d5a-9d4d-acfd46419cb3" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:06:06.213915 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-327e1163-55ff-4af7-be3e-946979f78ba4 req-27b73aad-70d1-4e81-bcba-51aabef644a7 service nova] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Refreshing network info cache for port 2df7e0cb-dcdb-4934-82e5-97157bb2e5a5 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:06:06.465299 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:06:06.468553 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:06:06.469725 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Creating image(s)
May 21 02:06:06.472585 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "/opt/stack/data/nova/instances/b6df4554-8490-4d5a-9d4d-acfd46419cb3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:06.472585 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "/opt/stack/data/nova/instances/b6df4554-8490-4d5a-9d4d-acfd46419cb3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:06.472585 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "/opt/stack/data/nova/instances/b6df4554-8490-4d5a-9d4d-acfd46419cb3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:06.475967 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:06:06.480492 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:06:06.483394 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:06.588213 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:06.605168 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "refresh_cache-b6df4554-8490-4d5a-9d4d-acfd46419cb3" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:06:06.621590 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.138s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:06:06.622222 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:06.623417 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:06.623527 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:06:06.631194 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:06:06.631816 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:06.720588 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-327e1163-55ff-4af7-be3e-946979f78ba4 req-27b73aad-70d1-4e81-bcba-51aabef644a7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:06:06.758086 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.126s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:06:06.758626 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/b6df4554-8490-4d5a-9d4d-acfd46419cb3/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:06.833520 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-327e1163-55ff-4af7-be3e-946979f78ba4 req-27b73aad-70d1-4e81-bcba-51aabef644a7 service nova] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:06:06.839844 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-6858d4b5-d45c-449f-bfe1-2276ef897b3e tempest-AttachVolumeTestJSON-2050140136 tempest-AttachVolumeTestJSON-2050140136-project-member] Lock "f63a2253-071a-4a1a-94af-3544b20c39cf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.534s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:06.851309 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/b6df4554-8490-4d5a-9d4d-acfd46419cb3/disk 1073741824" returned: 0 in 0.093s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:06:06.851606 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:06.851910 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:06.984127 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.131s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:06:06.984127 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b6df4554-8490-4d5a-9d4d-acfd46419cb3/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:06:06.984127 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6df4554-8490-4d5a-9d4d-acfd46419cb3/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:07.108594 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-327e1163-55ff-4af7-be3e-946979f78ba4 req-27b73aad-70d1-4e81-bcba-51aabef644a7 service nova] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:06:07.115131 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6df4554-8490-4d5a-9d4d-acfd46419cb3/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:06:07.115571 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Cannot resize image /opt/stack/data/nova/instances/b6df4554-8490-4d5a-9d4d-acfd46419cb3/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:06:07.116020 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:06:07.116281 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Ensure instance console log exists: /opt/stack/data/nova/instances/b6df4554-8490-4d5a-9d4d-acfd46419cb3/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:06:07.116666 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:07.117087 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:07.117398 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:07.566277 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:06:07.567653 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:06:07.567653 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:06:07.567653 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] No VIF found with MAC fa:16:3e:e1:2e:46, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:06:07.612659 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-327e1163-55ff-4af7-be3e-946979f78ba4 req-27b73aad-70d1-4e81-bcba-51aabef644a7 service nova] Releasing lock "refresh_cache-b6df4554-8490-4d5a-9d4d-acfd46419cb3" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:06:07.613049 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquired lock "refresh_cache-b6df4554-8490-4d5a-9d4d-acfd46419cb3" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:06:07.613797 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:06:08.221717 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:06:08.416955 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:06:08.589177 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Updating instance_info_cache with network_info: [{"id": "2df7e0cb-dcdb-4934-82e5-97157bb2e5a5", "address": "fa:16:3e:65:65:57", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df7e0cb-dc", "ovs_interfaceid": "2df7e0cb-dcdb-4934-82e5-97157bb2e5a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:06:09.092446 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Releasing lock "refresh_cache-b6df4554-8490-4d5a-9d4d-acfd46419cb3" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:06:09.092446 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Instance network_info: |[{"id": "2df7e0cb-dcdb-4934-82e5-97157bb2e5a5", "address": "fa:16:3e:65:65:57", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df7e0cb-dc", "ovs_interfaceid": "2df7e0cb-dcdb-4934-82e5-97157bb2e5a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:06:09.094180 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Start _get_guest_xml network_info=[{"id": "2df7e0cb-dcdb-4934-82e5-97157bb2e5a5", "address": "fa:16:3e:65:65:57", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df7e0cb-dc", "ovs_interfaceid": "2df7e0cb-dcdb-4934-82e5-97157bb2e5a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:06:09.096649 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:06:09.098006 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='b6df4554-8490-4d5a-9d4d-acfd46419cb3'), owner=OwnerMeta(userid='049d6c8cccfa4ae38d78a88ef5be0f1b', username='tempest-AttachVolumeMultiAttachTest-289054175-project-member', projectid='848912b0c0e94d2795bb2332daf1730e', projectname='tempest-AttachVolumeMultiAttachTest-289054175'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2df7e0cb-dcdb-4934-82e5-97157bb2e5a5", "address": "fa:16:3e:65:65:57", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df7e0cb-dc", "ovs_interfaceid": "2df7e0cb-dcdb-4934-82e5-97157bb2e5a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329169.0976322) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:06:09.099294 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:06:09.100086 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:06:09.100439 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:06:09.100615 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:06:09.101484 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:06:09.103005 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:06:09.103005 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:06:09.103005 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:06:09.103005 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:06:09.103005 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:06:09.103005 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:06:09.103005 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:06:09.103005 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:06:09.103005 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:06:09.103005 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:06:09.103005 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:06:09.112683 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:05:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='multiattach-server-1',id=49,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzu+v5yloohnjet+lpl7Cb5m5YuZdtxheBkBGOMBLLe2AJEatmv/W6U1humbPofoJpKHaVTa0sSri4Ktoz/rRBuEiIFUUGVMQjgWmfd958Eyx52s4Fg6gJyB/ru0BJ+zA==',key_name='tempest-keypair-1890511814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='848912b0c0e94d2795bb2332daf1730e',ramdisk_id='',reservation_id='r-enzzniws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-289054175',owner_user_name='tempest-AttachVolumeMultiAttachTest-289054175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:06:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='049d6c8cccfa4ae38d78a88ef5be0f1b',uuid=b6df4554-8490-4d5a-9d4d-acfd46419cb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2df7e0cb-dcdb-4934-82e5-97157bb2e5a5", "address": "fa:16:3e:65:65:57", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df7e0cb-dc", "ovs_interfaceid": "2df7e0cb-dcdb-4934-82e5-97157bb2e5a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:06:09.112950 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converting VIF {"id": "2df7e0cb-dcdb-4934-82e5-97157bb2e5a5", "address": "fa:16:3e:65:65:57", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df7e0cb-dc", "ovs_interfaceid": "2df7e0cb-dcdb-4934-82e5-97157bb2e5a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:06:09.113565 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:65:57,bridge_name='br-int',has_traffic_filtering=True,id=2df7e0cb-dcdb-4934-82e5-97157bb2e5a5,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df7e0cb-dc') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:06:09.114305 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lazy-loading 'pci_devices' on Instance uuid b6df4554-8490-4d5a-9d4d-acfd46419cb3 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:06:09.155110 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f7fafa33-94e3-4ba2-80ce-4a1b849a6016 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "0b9a1a2a-77bd-4fe9-ae88-344c193980f5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.638s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:09.618493 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] End _get_guest_xml xml=<domain type="qemu">
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:   <uuid>b6df4554-8490-4d5a-9d4d-acfd46419cb3</uuid>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:   <name>instance-00000031</name>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:       <nova:name>multiattach-server-1</nova:name>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:06:09</nova:creationTime>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:         <nova:user uuid="049d6c8cccfa4ae38d78a88ef5be0f1b">tempest-AttachVolumeMultiAttachTest-289054175-project-member</nova:user>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:         <nova:project uuid="848912b0c0e94d2795bb2332daf1730e">tempest-AttachVolumeMultiAttachTest-289054175</nova:project>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:         <nova:port uuid="2df7e0cb-dcdb-4934-82e5-97157bb2e5a5">
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:     <system>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:       <entry name="serial">b6df4554-8490-4d5a-9d4d-acfd46419cb3</entry>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:       <entry name="uuid">b6df4554-8490-4d5a-9d4d-acfd46419cb3</entry>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:     </system>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:   <os>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:   </os>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:   <features>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:   </features>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:   <devices>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/b6df4554-8490-4d5a-9d4d-acfd46419cb3/disk"/>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:     </disk>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/b6df4554-8490-4d5a-9d4d-acfd46419cb3/disk.config"/>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:     </disk>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:65:65:57"/>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:       <target dev="tap2df7e0cb-dc"/>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:     </interface>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/b6df4554-8490-4d5a-9d4d-acfd46419cb3/console.log" append="off"/>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:     </serial>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:     <video>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:     </video>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:     </rng>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:   </devices>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]: </domain>
May 21 02:06:09.618493 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:06:09.618493 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Preparing to wait for external event network-vif-plugged-2df7e0cb-dcdb-4934-82e5-97157bb2e5a5 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:06:09.618493 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "b6df4554-8490-4d5a-9d4d-acfd46419cb3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:09.618493 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "b6df4554-8490-4d5a-9d4d-acfd46419cb3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:09.618493 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "b6df4554-8490-4d5a-9d4d-acfd46419cb3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:09.622960 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:05:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='multiattach-server-1',id=49,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzu+v5yloohnjet+lpl7Cb5m5YuZdtxheBkBGOMBLLe2AJEatmv/W6U1humbPofoJpKHaVTa0sSri4Ktoz/rRBuEiIFUUGVMQjgWmfd958Eyx52s4Fg6gJyB/ru0BJ+zA==',key_name='tempest-keypair-1890511814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='848912b0c0e94d2795bb2332daf1730e',ramdisk_id='',reservation_id='r-enzzniws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-289054175',owner_user_name='tempest-AttachVolumeMultiAttachTest-289054175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:06:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='049d6c8cccfa4ae38d78a88ef5be0f1b',uuid=b6df4554-8490-4d5a-9d4d-acfd46419cb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2df7e0cb-dcdb-4934-82e5-97157bb2e5a5", "address": "fa:16:3e:65:65:57", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df7e0cb-dc", "ovs_interfaceid": "2df7e0cb-dcdb-4934-82e5-97157bb2e5a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:06:09.622960 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converting VIF {"id": "2df7e0cb-dcdb-4934-82e5-97157bb2e5a5", "address": "fa:16:3e:65:65:57", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df7e0cb-dc", "ovs_interfaceid": "2df7e0cb-dcdb-4934-82e5-97157bb2e5a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:06:09.624848 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:65:57,bridge_name='br-int',has_traffic_filtering=True,id=2df7e0cb-dcdb-4934-82e5-97157bb2e5a5,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df7e0cb-dc') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:06:09.624848 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:65:57,bridge_name='br-int',has_traffic_filtering=True,id=2df7e0cb-dcdb-4934-82e5-97157bb2e5a5,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df7e0cb-dc') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:06:09.625713 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:09.625858 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:06:09.626257 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:06:09.627245 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:09.627779 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '49454634-a96b-5e61-86c7-87aba8024002', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:06:09.628517 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:09.629433 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:06:09.632920 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:09.639519 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:09.639519 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2df7e0cb-dc, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:06:09.639519 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2df7e0cb-dc, col_values=(('qos', UUID('6b22ef58-bafb-4d6c-943f-fa5e2b6a1e32')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:06:09.639519 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2df7e0cb-dc, col_values=(('external_ids', {'iface-id': '2df7e0cb-dcdb-4934-82e5-97157bb2e5a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:65:57', 'vm-uuid': 'b6df4554-8490-4d5a-9d4d-acfd46419cb3'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:06:09.640021 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:09.645223 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:06:09.646533 np0000001127 nova-compute[98206]: INFO os_vif [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:65:57,bridge_name='br-int',has_traffic_filtering=True,id=2df7e0cb-dcdb-4934-82e5-97157bb2e5a5,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df7e0cb-dc')
May 21 02:06:11.179081 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:06:11.179454 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:06:11.179454 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No VIF found with MAC fa:16:3e:65:65:57, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:06:11.179773 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Using config drive
May 21 02:06:11.588757 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:11.692318 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:06:11.841530 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Creating config drive at /opt/stack/data/nova/instances/b6df4554-8490-4d5a-9d4d-acfd46419cb3/disk.config
May 21 02:06:11.844808 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b6df4554-8490-4d5a-9d4d-acfd46419cb3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpd1ck70zv {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:11.904115 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b6df4554-8490-4d5a-9d4d-acfd46419cb3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpd1ck70zv" returned: 0 in 0.059s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:06:11.936766 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "5c34ef68-490d-42c1-8e1a-1913b3b183e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:11.937000 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "5c34ef68-490d-42c1-8e1a-1913b3b183e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:12.359713 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:12.388814 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:12.388814 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:12.440569 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:06:12.500200 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:12.563365 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:12.564522 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:12.684593 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c56791b6-0595-4e3f-ae3b-e0dacb21bde8 req-38e3a761-20c1-4dd0-b9b1-595a5b828224 service nova] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Received event network-vif-plugged-2df7e0cb-dcdb-4934-82e5-97157bb2e5a5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:06:12.684903 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c56791b6-0595-4e3f-ae3b-e0dacb21bde8 req-38e3a761-20c1-4dd0-b9b1-595a5b828224 service nova] Acquiring lock "b6df4554-8490-4d5a-9d4d-acfd46419cb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:12.685214 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c56791b6-0595-4e3f-ae3b-e0dacb21bde8 req-38e3a761-20c1-4dd0-b9b1-595a5b828224 service nova] Lock "b6df4554-8490-4d5a-9d4d-acfd46419cb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:12.685455 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c56791b6-0595-4e3f-ae3b-e0dacb21bde8 req-38e3a761-20c1-4dd0-b9b1-595a5b828224 service nova] Lock "b6df4554-8490-4d5a-9d4d-acfd46419cb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:12.685908 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c56791b6-0595-4e3f-ae3b-e0dacb21bde8 req-38e3a761-20c1-4dd0-b9b1-595a5b828224 service nova] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Processing event network-vif-plugged-2df7e0cb-dcdb-4934-82e5-97157bb2e5a5 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:06:13.022001 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:13.022443 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:13.027956 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:06:13.028099 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Claim successful on node np0000001127
May 21 02:06:13.085533 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:13.354389 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:13.371661 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:06:13.371661 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329173.3709068, b6df4554-8490-4d5a-9d4d-acfd46419cb3 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:06:13.371661 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] VM Started (Lifecycle Event)
May 21 02:06:13.377145 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:06:13.377220 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Instance spawned successfully.
May 21 02:06:13.377787 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:06:13.877199 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:06:13.882305 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:06:13.886831 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:06:13.886973 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:06:13.887340 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:06:13.887664 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:06:13.887958 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:06:13.888265 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:06:14.385643 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:06:14.388657 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329174.3868408, b6df4554-8490-4d5a-9d4d-acfd46419cb3 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:06:14.388657 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] VM Paused (Lifecycle Event)
May 21 02:06:14.397794 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Took 7.93 seconds to spawn the instance on the hypervisor.
May 21 02:06:14.398013 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:06:14.547613 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:06:14.547613 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:06:14.642345 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:14.774129 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-af94fa24-41e7-4b26-84c0-19038a5c56e1 req-19ff619a-31f1-4a58-af45-8ed74dd4345e service nova] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Received event network-vif-plugged-2df7e0cb-dcdb-4934-82e5-97157bb2e5a5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:06:14.774129 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-af94fa24-41e7-4b26-84c0-19038a5c56e1 req-19ff619a-31f1-4a58-af45-8ed74dd4345e service nova] Acquiring lock "b6df4554-8490-4d5a-9d4d-acfd46419cb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:14.774129 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-af94fa24-41e7-4b26-84c0-19038a5c56e1 req-19ff619a-31f1-4a58-af45-8ed74dd4345e service nova] Lock "b6df4554-8490-4d5a-9d4d-acfd46419cb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:14.774371 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-af94fa24-41e7-4b26-84c0-19038a5c56e1 req-19ff619a-31f1-4a58-af45-8ed74dd4345e service nova] Lock "b6df4554-8490-4d5a-9d4d-acfd46419cb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:14.775186 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-af94fa24-41e7-4b26-84c0-19038a5c56e1 req-19ff619a-31f1-4a58-af45-8ed74dd4345e service nova] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] No waiting events found dispatching network-vif-plugged-2df7e0cb-dcdb-4934-82e5-97157bb2e5a5 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:06:14.775352 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-af94fa24-41e7-4b26-84c0-19038a5c56e1 req-19ff619a-31f1-4a58-af45-8ed74dd4345e service nova] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Received unexpected event network-vif-plugged-2df7e0cb-dcdb-4934-82e5-97157bb2e5a5 for instance with vm_state active and task_state None.
May 21 02:06:14.890338 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:06:14.892976 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329174.892537, b6df4554-8490-4d5a-9d4d-acfd46419cb3 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:06:14.893140 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] VM Resumed (Lifecycle Event)
May 21 02:06:14.918594 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Took 13.92 seconds to build instance.
May 21 02:06:15.050595 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:06:15.226631 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.000988594999853376 future=<Future at 0x71c058506d20 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:06:15.231491 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] Emitting event <LifecycleEvent: 1779329160.224998, f63a2253-071a-4a1a-94af-3544b20c39cf => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:06:15.232125 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:06:15.232125 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] VM Stopped (Lifecycle Event)
May 21 02:06:15.397319 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:06:15.399813 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:06:15.421123 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e51532a8-2a57-4985-a74d-2285cc6e59be tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "b6df4554-8490-4d5a-9d4d-acfd46419cb3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.437s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:15.562044 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.540s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:15.562895 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:06:15.736139 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ed56c0cf-f6a2-4355-b741-e7d6aadfcf7a tempest-AttachSCSIVolumeTestJSON-1415132564 tempest-AttachSCSIVolumeTestJSON-1415132564-project-member] [instance: f63a2253-071a-4a1a-94af-3544b20c39cf] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:06:16.076771 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:06:16.083655 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:06:16.083655 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:06:16.083655 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:06:16.231260 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f369771db7dd49da85131c9692833a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3efe4046d6a442d91b3463e2d99fd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:06:16.581268 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:06:16.600983 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:17.018242 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Successfully created port: 1f2f0fc8-f7e3-4579-8d3a-53ba1117725c {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:06:17.086956 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:06:17.290451 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0e8ae3e3-60e6-4154-9edc-a7e52c016d06 req-caf4919f-aa24-4d4c-9c54-c2fc20c09a9b service nova] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Received event network-changed-ef5fecf8-83a1-4153-927b-7f8b543f83f3 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:06:17.290451 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0e8ae3e3-60e6-4154-9edc-a7e52c016d06 req-caf4919f-aa24-4d4c-9c54-c2fc20c09a9b service nova] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Refreshing instance network info cache due to event network-changed-ef5fecf8-83a1-4153-927b-7f8b543f83f3. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:06:17.290451 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0e8ae3e3-60e6-4154-9edc-a7e52c016d06 req-caf4919f-aa24-4d4c-9c54-c2fc20c09a9b service nova] Acquiring lock "refresh_cache-16a0cc8d-c65b-4166-ad1a-5318b18ed00e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:06:17.290451 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0e8ae3e3-60e6-4154-9edc-a7e52c016d06 req-caf4919f-aa24-4d4c-9c54-c2fc20c09a9b service nova] Acquired lock "refresh_cache-16a0cc8d-c65b-4166-ad1a-5318b18ed00e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:06:17.290451 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-0e8ae3e3-60e6-4154-9edc-a7e52c016d06 req-caf4919f-aa24-4d4c-9c54-c2fc20c09a9b service nova] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Refreshing network info cache for port ef5fecf8-83a1-4153-927b-7f8b543f83f3 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:06:17.795296 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-0e8ae3e3-60e6-4154-9edc-a7e52c016d06 req-caf4919f-aa24-4d4c-9c54-c2fc20c09a9b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:06:17.867312 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Successfully updated port: 1f2f0fc8-f7e3-4579-8d3a-53ba1117725c {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:06:17.942852 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bd305f49-cc77-4bf5-a45a-61854373ad42 req-70e85500-b251-47f4-9e39-58ec3169d16f service nova] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Received event network-changed-1f2f0fc8-f7e3-4579-8d3a-53ba1117725c {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:06:17.943415 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bd305f49-cc77-4bf5-a45a-61854373ad42 req-70e85500-b251-47f4-9e39-58ec3169d16f service nova] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Refreshing instance network info cache due to event network-changed-1f2f0fc8-f7e3-4579-8d3a-53ba1117725c. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:06:17.944365 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bd305f49-cc77-4bf5-a45a-61854373ad42 req-70e85500-b251-47f4-9e39-58ec3169d16f service nova] Acquiring lock "refresh_cache-5c34ef68-490d-42c1-8e1a-1913b3b183e7" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:06:17.944463 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bd305f49-cc77-4bf5-a45a-61854373ad42 req-70e85500-b251-47f4-9e39-58ec3169d16f service nova] Acquired lock "refresh_cache-5c34ef68-490d-42c1-8e1a-1913b3b183e7" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:06:17.944629 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-bd305f49-cc77-4bf5-a45a-61854373ad42 req-70e85500-b251-47f4-9e39-58ec3169d16f service nova] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Refreshing network info cache for port 1f2f0fc8-f7e3-4579-8d3a-53ba1117725c {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:06:18.119169 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:06:18.120924 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:06:18.121797 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Creating image(s)
May 21 02:06:18.124496 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c34ef68-490d-42c1-8e1a-1913b3b183e7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:18.124878 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "/opt/stack/data/nova/instances/5c34ef68-490d-42c1-8e1a-1913b3b183e7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:18.129935 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "/opt/stack/data/nova/instances/5c34ef68-490d-42c1-8e1a-1913b3b183e7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:18.134752 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:06:18.135109 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:06:18.138511 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:18.251661 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-0e8ae3e3-60e6-4154-9edc-a7e52c016d06 req-caf4919f-aa24-4d4c-9c54-c2fc20c09a9b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:06:18.370368 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "refresh_cache-5c34ef68-490d-42c1-8e1a-1913b3b183e7" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:06:18.448079 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.309s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:06:18.449129 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:18.449285 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:18.452996 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-bd305f49-cc77-4bf5-a45a-61854373ad42 req-70e85500-b251-47f4-9e39-58ec3169d16f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:06:18.456544 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:06:18.461495 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:06:18.461651 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:18.500497 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-0e8ae3e3-60e6-4154-9edc-a7e52c016d06 req-caf4919f-aa24-4d4c-9c54-c2fc20c09a9b service nova] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Updated VIF entry in instance network info cache for port ef5fecf8-83a1-4153-927b-7f8b543f83f3. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:06:18.501288 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-0e8ae3e3-60e6-4154-9edc-a7e52c016d06 req-caf4919f-aa24-4d4c-9c54-c2fc20c09a9b service nova] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Updating instance_info_cache with network_info: [{"id": "ef5fecf8-83a1-4153-927b-7f8b543f83f3", "address": "fa:16:3e:fb:4d:96", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef5fecf8-83", "ovs_interfaceid": "ef5fecf8-83a1-4153-927b-7f8b543f83f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:06:18.566411 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-bd305f49-cc77-4bf5-a45a-61854373ad42 req-70e85500-b251-47f4-9e39-58ec3169d16f service nova] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:06:18.587204 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.126s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:06:18.588110 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/5c34ef68-490d-42c1-8e1a-1913b3b183e7/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:18.669199 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/5c34ef68-490d-42c1-8e1a-1913b3b183e7/disk 1073741824" returned: 0 in 0.081s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:06:18.669806 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:18.670122 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:18.794169 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.123s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:06:18.794345 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5c34ef68-490d-42c1-8e1a-1913b3b183e7/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:06:18.795210 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c34ef68-490d-42c1-8e1a-1913b3b183e7/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:18.797518 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-bd305f49-cc77-4bf5-a45a-61854373ad42 req-70e85500-b251-47f4-9e39-58ec3169d16f service nova] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:06:18.917113 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c34ef68-490d-42c1-8e1a-1913b3b183e7/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:06:18.918490 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Cannot resize image /opt/stack/data/nova/instances/5c34ef68-490d-42c1-8e1a-1913b3b183e7/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:06:18.918904 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:06:18.919094 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Ensure instance console log exists: /opt/stack/data/nova/instances/5c34ef68-490d-42c1-8e1a-1913b3b183e7/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:06:18.919407 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:18.919651 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:18.919810 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:19.009295 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0e8ae3e3-60e6-4154-9edc-a7e52c016d06 req-caf4919f-aa24-4d4c-9c54-c2fc20c09a9b service nova] Releasing lock "refresh_cache-16a0cc8d-c65b-4166-ad1a-5318b18ed00e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:06:19.317952 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bd305f49-cc77-4bf5-a45a-61854373ad42 req-70e85500-b251-47f4-9e39-58ec3169d16f service nova] Releasing lock "refresh_cache-5c34ef68-490d-42c1-8e1a-1913b3b183e7" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:06:19.318362 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquired lock "refresh_cache-5c34ef68-490d-42c1-8e1a-1913b3b183e7" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:06:19.318500 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:06:19.356437 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-73b3b1f7-75be-4c80-bd38-01345c190fed req-cd2c4071-8073-4d64-a962-9fd421aa3622 service nova] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Received event network-changed-2df7e0cb-dcdb-4934-82e5-97157bb2e5a5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:06:19.357013 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-73b3b1f7-75be-4c80-bd38-01345c190fed req-cd2c4071-8073-4d64-a962-9fd421aa3622 service nova] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Refreshing instance network info cache due to event network-changed-2df7e0cb-dcdb-4934-82e5-97157bb2e5a5. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:06:19.357390 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-73b3b1f7-75be-4c80-bd38-01345c190fed req-cd2c4071-8073-4d64-a962-9fd421aa3622 service nova] Acquiring lock "refresh_cache-b6df4554-8490-4d5a-9d4d-acfd46419cb3" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:06:19.357848 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-73b3b1f7-75be-4c80-bd38-01345c190fed req-cd2c4071-8073-4d64-a962-9fd421aa3622 service nova] Acquired lock "refresh_cache-b6df4554-8490-4d5a-9d4d-acfd46419cb3" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:06:19.357848 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-73b3b1f7-75be-4c80-bd38-01345c190fed req-cd2c4071-8073-4d64-a962-9fd421aa3622 service nova] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Refreshing network info cache for port 2df7e0cb-dcdb-4934-82e5-97157bb2e5a5 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:06:19.529278 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "16a0cc8d-c65b-4166-ad1a-5318b18ed00e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:19.529858 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "16a0cc8d-c65b-4166-ad1a-5318b18ed00e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:19.648909 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:19.860030 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-73b3b1f7-75be-4c80-bd38-01345c190fed req-cd2c4071-8073-4d64-a962-9fd421aa3622 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:06:19.907213 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:06:20.034656 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lazy-loading 'flavor' on Instance uuid 16a0cc8d-c65b-4166-ad1a-5318b18ed00e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:06:20.111172 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:06:20.264839 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-73b3b1f7-75be-4c80-bd38-01345c190fed req-cd2c4071-8073-4d64-a962-9fd421aa3622 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:06:20.340798 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Updating instance_info_cache with network_info: [{"id": "1f2f0fc8-f7e3-4579-8d3a-53ba1117725c", "address": "fa:16:3e:cc:c2:95", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f2f0fc8-f7", "ovs_interfaceid": "1f2f0fc8-f7e3-4579-8d3a-53ba1117725c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:06:20.449743 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-73b3b1f7-75be-4c80-bd38-01345c190fed req-cd2c4071-8073-4d64-a962-9fd421aa3622 service nova] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Updated VIF entry in instance network info cache for port 2df7e0cb-dcdb-4934-82e5-97157bb2e5a5. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:06:20.450030 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-73b3b1f7-75be-4c80-bd38-01345c190fed req-cd2c4071-8073-4d64-a962-9fd421aa3622 service nova] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Updating instance_info_cache with network_info: [{"id": "2df7e0cb-dcdb-4934-82e5-97157bb2e5a5", "address": "fa:16:3e:65:65:57", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df7e0cb-dc", "ovs_interfaceid": "2df7e0cb-dcdb-4934-82e5-97157bb2e5a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:06:20.848030 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Releasing lock "refresh_cache-5c34ef68-490d-42c1-8e1a-1913b3b183e7" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:06:20.848411 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Instance network_info: |[{"id": "1f2f0fc8-f7e3-4579-8d3a-53ba1117725c", "address": "fa:16:3e:cc:c2:95", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f2f0fc8-f7", "ovs_interfaceid": "1f2f0fc8-f7e3-4579-8d3a-53ba1117725c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:06:20.850509 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Start _get_guest_xml network_info=[{"id": "1f2f0fc8-f7e3-4579-8d3a-53ba1117725c", "address": "fa:16:3e:cc:c2:95", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f2f0fc8-f7", "ovs_interfaceid": "1f2f0fc8-f7e3-4579-8d3a-53ba1117725c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:06:20.855325 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:06:20.857832 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-76664382', uuid='5c34ef68-490d-42c1-8e1a-1913b3b183e7'), owner=OwnerMeta(userid='f369771db7dd49da85131c9692833a5a', username='tempest-AttachVolumeNegativeTest-1208856611-project-member', projectid='d3efe4046d6a442d91b3463e2d99fd7b', projectname='tempest-AttachVolumeNegativeTest-1208856611'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1f2f0fc8-f7e3-4579-8d3a-53ba1117725c", "address": "fa:16:3e:cc:c2:95", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f2f0fc8-f7", "ovs_interfaceid": "1f2f0fc8-f7e3-4579-8d3a-53ba1117725c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329180.857241) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:06:20.864800 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:06:20.865405 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:06:20.869373 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:06:20.869651 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:06:20.870818 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:06:20.871139 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:06:20.871362 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:06:20.872612 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:06:20.872995 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:06:20.873200 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:06:20.873722 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:06:20.873722 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:06:20.873722 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:06:20.873722 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:06:20.873722 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:06:20.873844 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:06:20.887405 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:06:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-76664382',display_name='tempest-AttachVolumeNegativeTest-server-76664382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumenegativetest-server-76664382',id=50,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFu+X4/AsJbBcSP8JzvjdCL2C/e+lFFYDHf7a98euK3fxi7nuTH9jWju0Br2RKvHSjbXppqO5GDD2jW0WvJTQbTt/o8PFR3x+wd9YCoLwWz4mCv+Lc1THDtgtRM2pAeIw==',key_name='tempest-keypair-320293375',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3efe4046d6a442d91b3463e2d99fd7b',ramdisk_id='',reservation_id='r-ri2opg4j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1208856611',owner_user_name='tempest-AttachVolumeNegativeTest-1208856611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:06:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f369771db7dd49da85131c9692833a5a',uuid=5c34ef68-490d-42c1-8e1a-1913b3b183e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f2f0fc8-f7e3-4579-8d3a-53ba1117725c", "address": "fa:16:3e:cc:c2:95", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f2f0fc8-f7", "ovs_interfaceid": "1f2f0fc8-f7e3-4579-8d3a-53ba1117725c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:06:20.887692 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Converting VIF {"id": "1f2f0fc8-f7e3-4579-8d3a-53ba1117725c", "address": "fa:16:3e:cc:c2:95", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f2f0fc8-f7", "ovs_interfaceid": "1f2f0fc8-f7e3-4579-8d3a-53ba1117725c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:06:20.888249 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:c2:95,bridge_name='br-int',has_traffic_filtering=True,id=1f2f0fc8-f7e3-4579-8d3a-53ba1117725c,network=Network(f683b2da-ab41-43e1-a9bb-98914089b4d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f2f0fc8-f7') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:06:20.888949 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c34ef68-490d-42c1-8e1a-1913b3b183e7 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:06:20.952442 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-73b3b1f7-75be-4c80-bd38-01345c190fed req-cd2c4071-8073-4d64-a962-9fd421aa3622 service nova] Releasing lock "refresh_cache-b6df4554-8490-4d5a-9d4d-acfd46419cb3" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:06:21.044785 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "16a0cc8d-c65b-4166-ad1a-5318b18ed00e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.515s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:21.392606 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] End _get_guest_xml xml=<domain type="qemu">
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:   <uuid>5c34ef68-490d-42c1-8e1a-1913b3b183e7</uuid>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:   <name>instance-00000032</name>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:       <nova:name>tempest-AttachVolumeNegativeTest-server-76664382</nova:name>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:06:20</nova:creationTime>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:         <nova:user uuid="f369771db7dd49da85131c9692833a5a">tempest-AttachVolumeNegativeTest-1208856611-project-member</nova:user>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:         <nova:project uuid="d3efe4046d6a442d91b3463e2d99fd7b">tempest-AttachVolumeNegativeTest-1208856611</nova:project>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:         <nova:port uuid="1f2f0fc8-f7e3-4579-8d3a-53ba1117725c">
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:     <system>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:       <entry name="serial">5c34ef68-490d-42c1-8e1a-1913b3b183e7</entry>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:       <entry name="uuid">5c34ef68-490d-42c1-8e1a-1913b3b183e7</entry>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:     </system>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:   <os>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:   </os>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:   <features>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:   </features>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:   <devices>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/5c34ef68-490d-42c1-8e1a-1913b3b183e7/disk"/>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:     </disk>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/5c34ef68-490d-42c1-8e1a-1913b3b183e7/disk.config"/>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:     </disk>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:cc:c2:95"/>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:       <target dev="tap1f2f0fc8-f7"/>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:     </interface>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/5c34ef68-490d-42c1-8e1a-1913b3b183e7/console.log" append="off"/>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:     </serial>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:     <video>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:     </video>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:     </rng>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:   </devices>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]: </domain>
May 21 02:06:21.392606 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:06:21.394730 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Preparing to wait for external event network-vif-plugged-1f2f0fc8-f7e3-4579-8d3a-53ba1117725c {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:06:21.394730 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "5c34ef68-490d-42c1-8e1a-1913b3b183e7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:21.394730 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "5c34ef68-490d-42c1-8e1a-1913b3b183e7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:21.394730 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "5c34ef68-490d-42c1-8e1a-1913b3b183e7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:21.394730 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:06:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-76664382',display_name='tempest-AttachVolumeNegativeTest-server-76664382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumenegativetest-server-76664382',id=50,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFu+X4/AsJbBcSP8JzvjdCL2C/e+lFFYDHf7a98euK3fxi7nuTH9jWju0Br2RKvHSjbXppqO5GDD2jW0WvJTQbTt/o8PFR3x+wd9YCoLwWz4mCv+Lc1THDtgtRM2pAeIw==',key_name='tempest-keypair-320293375',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3efe4046d6a442d91b3463e2d99fd7b',ramdisk_id='',reservation_id='r-ri2opg4j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1208856611',owner_user_name='tempest-AttachVolumeNegativeTest-1208856611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:06:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f369771db7dd49da85131c9692833a5a',uuid=5c34ef68-490d-42c1-8e1a-1913b3b183e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f2f0fc8-f7e3-4579-8d3a-53ba1117725c", "address": "fa:16:3e:cc:c2:95", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f2f0fc8-f7", "ovs_interfaceid": "1f2f0fc8-f7e3-4579-8d3a-53ba1117725c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:06:21.394730 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Converting VIF {"id": "1f2f0fc8-f7e3-4579-8d3a-53ba1117725c", "address": "fa:16:3e:cc:c2:95", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f2f0fc8-f7", "ovs_interfaceid": "1f2f0fc8-f7e3-4579-8d3a-53ba1117725c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:06:21.394730 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:c2:95,bridge_name='br-int',has_traffic_filtering=True,id=1f2f0fc8-f7e3-4579-8d3a-53ba1117725c,network=Network(f683b2da-ab41-43e1-a9bb-98914089b4d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f2f0fc8-f7') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:06:21.394730 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:c2:95,bridge_name='br-int',has_traffic_filtering=True,id=1f2f0fc8-f7e3-4579-8d3a-53ba1117725c,network=Network(f683b2da-ab41-43e1-a9bb-98914089b4d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f2f0fc8-f7') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:06:21.395284 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:21.395678 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:06:21.395990 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:06:21.396804 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:21.397015 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '990fc252-e153-5f2a-a631-6e0dcc77530d', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:06:21.401145 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:06:21.406213 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:21.406492 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f2f0fc8-f7, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:06:21.406950 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f2f0fc8-f7, col_values=(('qos', UUID('1443a7f6-7193-4d91-ba31-3d45c77971fb')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:06:21.407206 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f2f0fc8-f7, col_values=(('external_ids', {'iface-id': '1f2f0fc8-f7e3-4579-8d3a-53ba1117725c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:c2:95', 'vm-uuid': '5c34ef68-490d-42c1-8e1a-1913b3b183e7'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:06:21.408170 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:21.410787 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:06:21.414192 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:21.415235 np0000001127 nova-compute[98206]: INFO os_vif [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:c2:95,bridge_name='br-int',has_traffic_filtering=True,id=1f2f0fc8-f7e3-4579-8d3a-53ba1117725c,network=Network(f683b2da-ab41-43e1-a9bb-98914089b4d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f2f0fc8-f7')
May 21 02:06:21.602407 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:21.976077 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Acquiring lock "9b4239c5-84df-4d87-a2d4-fb6192408f58" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:21.976487 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "9b4239c5-84df-4d87-a2d4-fb6192408f58" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:22.145243 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "16a0cc8d-c65b-4166-ad1a-5318b18ed00e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:22.145618 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "16a0cc8d-c65b-4166-ad1a-5318b18ed00e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:22.145738 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Attaching volume b6914633-9282-48cd-83a7-c48bf2509544 to /dev/vdb
May 21 02:06:22.204965 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:06:22.224576 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:06:22.250333 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:22.296516 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:06:22.298637 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:06:22.310934 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:06:22.311283 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fee1:2e46', 'fe80::2482:bff:fe1b:902b', 'fe80::fc16:3eff:fe0f:28a1', 'fe80::440a:38ff:fe27:fa24', 'fe80::fc16:3eff:febd:860a', 'fe80::c44d:25ff:fe10:25cb', 'fe80::fc16:3eff:fe91:3d5c', 'fe80::a4db:73ff:fe81:949b', 'fe80::fc16:3eff:fefb:4d96', 'fe80::fc16:3eff:fe68:a810', 'fe80::3cc0:a4ff:feab:836e', 'fe80::fc16:3eff:fe65:6557'] 
May 21 02:06:22.311449 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:06:22.311757 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:06:22.311995 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:06:22.312888 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Updating existing volume attachment record: 8b85703b-978b-4557-9ee6-16b305e1b0f8 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:06:22.479396 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lazy-loading 'flavor' on Instance uuid 9b4239c5-84df-4d87-a2d4-fb6192408f58 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:06:22.878262 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:06:22.879488 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544', 'iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b6914633-9282-48cd-83a7-c48bf2509544', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:06:22.879488 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:06:22.879488 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:06:22.879811 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544', 'iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b6914633-9282-48cd-83a7-c48bf2509544', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:06:22.898827 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:06:22.899880 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:06:22.900690 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:06:22.901062 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:06:22.901612 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:06:22.901824 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:06:22.918985 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:06:22.918985 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:22.926178 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:06:22.926178 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:22.934532 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544] added
May 21 02:06:22.934532 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:06:22.934532 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:06:22.934532 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:06:22.934532 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:06:22.934532 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:06:22.934532 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:22.934869 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:06:22.934869 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.033(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:06:22.935025 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:06:22.937344 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:06:22.937513 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:06:22.937626 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] No VIF found with MAC fa:16:3e:cc:c2:95, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:06:22.938194 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Using config drive
May 21 02:06:22.939988 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544] added
May 21 02:06:22.939988 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:06:22.939988 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:06:22.939988 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:06:22.939988 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:06:22.939988 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:06:22.939988 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:22.940145 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:06:22.940389 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0394(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:06:22.940596 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:06:23.444400 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:06:23.486783 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "9b4239c5-84df-4d87-a2d4-fb6192408f58" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:23.607555 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Creating config drive at /opt/stack/data/nova/instances/5c34ef68-490d-42c1-8e1a-1913b3b183e7/disk.config
May 21 02:06:23.613053 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5c34ef68-490d-42c1-8e1a-1913b3b183e7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqorjqvll {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:23.690799 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5c34ef68-490d-42c1-8e1a-1913b3b183e7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqorjqvll" returned: 0 in 0.077s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:06:23.937379 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:06:23.941647 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:06:23.956221 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:06:23.956221 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:06:23.959134 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:06:23.959134 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:23.978384 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:23.985180 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:23.999885 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:23.999885 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:23.999885 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:23.999885 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:23.999885 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:23.999885 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:23.999885 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:23.999885 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:23.999885 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:06:24.000306 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:24.000306 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:24.000306 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:24.000306 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:24.000306 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:24.000306 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:24.000306 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:24.000306 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:24.000306 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:06:24.019595 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:24.019595 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:24.019595 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:24.019595 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:24.019595 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:24.019595 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:24.019595 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:24.019595 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:24.019595 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:06:24.019595 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:24.019595 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:24.019595 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:24.019595 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:24.019595 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:24.019595 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:24.019595 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:24.019595 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:24.019595 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:06:24.051882 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544, portal: 192.168.50.100,3260]
May 21 02:06:24.051882 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544, portal: 192.168.50.100,3260] successful.
May 21 02:06:24.051882 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:24.067445 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:24.083205 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544, portal: 192.168.40.100,3260]
May 21 02:06:24.083205 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544, portal: 192.168.40.100,3260] successful.
May 21 02:06:24.083205 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:24.094003 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:24.094003 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:24.094003 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:24.094003 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:24.094003 np0000001127 nova-compute[98206]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:24.094003 np0000001127 nova-compute[98206]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:24.094003 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:24.094003 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:24.094003 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:24.094003 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:24.094003 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:06:24.094259 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:24.094259 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:24.094259 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:24.094259 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:24.094259 np0000001127 nova-compute[98206]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:24.094259 np0000001127 nova-compute[98206]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:24.094259 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:24.094259 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:24.094259 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:24.094259 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:24.094259 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:06:24.095049 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.194s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:06:24.095336 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:06:24.096827 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] HCTL ('11', '-', '-', 0) found on session 110 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:06:24.096989 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:06:24.103984 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:24.124664 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Searching for a device in session 110 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:06:24.124999 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b6914633-9282-48cd-83a7-c48bf2509544', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:06:24.131307 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:24.131307 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:24.131307 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:24.131307 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:24.131307 np0000001127 nova-compute[98206]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:24.131307 np0000001127 nova-compute[98206]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:24.131307 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:24.131307 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:24.131307 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:24.131307 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:24.131307 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:06:24.131731 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:24.131731 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:24.131731 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:24.131731 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:24.131731 np0000001127 nova-compute[98206]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:24.131731 np0000001127 nova-compute[98206]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:24.131731 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:24.131731 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:24.131731 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:24.131731 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:24.131731 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:06:24.132079 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.231s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:06:24.132079 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:06:24.133770 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] HCTL ('12', '-', '-', 0) found on session 111 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:06:24.134335 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:06:24.160511 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Searching for a device in session 111 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:06:24.160511 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b6914633-9282-48cd-83a7-c48bf2509544', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:06:24.255460 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:24.286825 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:24.390694 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:24.472574 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:24.504309 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d2888c50-a64f-4917-a96d-af21a5261f9b req-b402201c-bf3f-49fa-9449-5ddcbe866122 service nova] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Received event network-vif-plugged-1f2f0fc8-f7e3-4579-8d3a-53ba1117725c {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:06:24.504309 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d2888c50-a64f-4917-a96d-af21a5261f9b req-b402201c-bf3f-49fa-9449-5ddcbe866122 service nova] Acquiring lock "5c34ef68-490d-42c1-8e1a-1913b3b183e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:24.504309 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d2888c50-a64f-4917-a96d-af21a5261f9b req-b402201c-bf3f-49fa-9449-5ddcbe866122 service nova] Lock "5c34ef68-490d-42c1-8e1a-1913b3b183e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:24.504309 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d2888c50-a64f-4917-a96d-af21a5261f9b req-b402201c-bf3f-49fa-9449-5ddcbe866122 service nova] Lock "5c34ef68-490d-42c1-8e1a-1913b3b183e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:24.504685 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d2888c50-a64f-4917-a96d-af21a5261f9b req-b402201c-bf3f-49fa-9449-5ddcbe866122 service nova] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Processing event network-vif-plugged-1f2f0fc8-f7e3-4579-8d3a-53ba1117725c {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:06:24.613979 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Acquiring lock "9b4239c5-84df-4d87-a2d4-fb6192408f58" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:24.614115 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "9b4239c5-84df-4d87-a2d4-fb6192408f58" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:24.614330 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Attaching volume bab0d744-7bfa-4c99-a049-e85167159946 to /dev/vdb
May 21 02:06:24.669450 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:06:24.683608 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:06:24.717589 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:24.767336 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:06:24.767742 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:06:24.783571 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:06:24.784780 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fee1:2e46', 'fe80::2482:bff:fe1b:902b', 'fe80::fc16:3eff:fe0f:28a1', 'fe80::440a:38ff:fe27:fa24', 'fe80::fc16:3eff:febd:860a', 'fe80::c44d:25ff:fe10:25cb', 'fe80::fc16:3eff:fe91:3d5c', 'fe80::a4db:73ff:fe81:949b', 'fe80::fc16:3eff:fefb:4d96', 'fe80::fc16:3eff:fe68:a810', 'fe80::3cc0:a4ff:feab:836e', 'fe80::fc16:3eff:fe65:6557', 'fe80::fc16:3eff:fecc:c295'] 
May 21 02:06:24.785410 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:06:24.785691 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:06:24.786196 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:06:24.786610 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Updating existing volume attachment record: e0f77144-8411-45b8-b530-2e56fc96e7e9 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:06:24.901278 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:06:25.238988 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:06:25.243493 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329185.2399948, 5c34ef68-490d-42c1-8e1a-1913b3b183e7 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:06:25.243493 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] VM Started (Lifecycle Event)
May 21 02:06:25.243493 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:06:25.244921 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Instance spawned successfully.
May 21 02:06:25.245221 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:06:25.358375 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:06:25.358868 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946', 'iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bab0d744-7bfa-4c99-a049-e85167159946', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:06:25.359213 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:06:25.438854 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:25.744460 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:06:25.747013 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:06:25.756732 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:06:25.756943 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:06:25.758497 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:06:25.758497 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:06:25.758497 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:06:25.758497 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:06:25.923537 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Found WWN 1StorPooliSCSI_DISK_1034578903445799047 for multipath device dm-4 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:06:25.923907 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.044s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:06:25.924136 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] <== connect_volume: return (3045ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799047', 'path': '/dev/dm-4', 'multipath_id': '1StorPooliSCSI_DISK_1034578903445799047'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:06:25.924444 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799047', 'path': '/dev/dm-4', 'multipath_id': '1StorPooliSCSI_DISK_1034578903445799047'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:06:25.925126 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.566s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:06:25.925460 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946', 'iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bab0d744-7bfa-4c99-a049-e85167159946', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:06:25.932020 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lazy-loading 'flavor' on Instance uuid 16a0cc8d-c65b-4166-ad1a-5318b18ed00e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:06:25.945087 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:06:25.945861 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:06:25.946784 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:06:25.946784 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:06:25.950338 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1afac291-8cd1-47bc-a3e7-e102bee73d11 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "3e53c443-92d8-4e5c-bc47-43deb205786b" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:25.950634 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1afac291-8cd1-47bc-a3e7-e102bee73d11 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "3e53c443-92d8-4e5c-bc47-43deb205786b" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:25.950841 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1afac291-8cd1-47bc-a3e7-e102bee73d11 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:06:25.953871 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.008s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:06:25.954912 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:06:25.956406 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1afac291-8cd1-47bc-a3e7-e102bee73d11 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98206) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 21 02:06:25.957020 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-1afac291-8cd1-47bc-a3e7-e102bee73d11 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lazy-loading 'flavor' on Instance uuid 3e53c443-92d8-4e5c-bc47-43deb205786b {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:06:25.965261 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:06:25.965261 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:25.977415 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:06:25.977415 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:25.990552 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946] added
May 21 02:06:25.990552 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:06:25.990552 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:06:25.990552 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:06:25.990552 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:06:25.990552 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:06:25.990552 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:25.990552 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:06:25.990552 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0437(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:06:25.990552 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:06:25.992966 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946] added
May 21 02:06:25.992966 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:06:25.992966 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:06:25.992966 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:06:25.992966 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:06:25.992966 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:06:25.992966 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:25.993235 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:06:25.993875 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0386(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:06:25.993875 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:06:26.251175 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:06:26.251444 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329186.2512417, 5c34ef68-490d-42c1-8e1a-1913b3b183e7 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:06:26.251608 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] VM Paused (Lifecycle Event)
May 21 02:06:26.264823 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Took 8.15 seconds to spawn the instance on the hypervisor.
May 21 02:06:26.265133 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:06:26.409091 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:26.436173 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Attempting to attach volume b6914633-9282-48cd-83a7-c48bf2509544 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 02:06:26.438097 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] attach device xml: <disk type="block" device="disk">
May 21 02:06:26.438097 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:06:26.438097 np0000001127 nova-compute[98206]:   <alias name="ua-b6914633-9282-48cd-83a7-c48bf2509544"/>
May 21 02:06:26.438097 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-4"/>
May 21 02:06:26.438097 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:06:26.438097 np0000001127 nova-compute[98206]:   <serial>b6914633-9282-48cd-83a7-c48bf2509544</serial>
May 21 02:06:26.438097 np0000001127 nova-compute[98206]:   <shareable/>
May 21 02:06:26.438097 np0000001127 nova-compute[98206]: </disk>
May 21 02:06:26.438097 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 02:06:26.588230 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-22878df4-61a2-46a2-881e-46a2d18e536d req-f5c9230d-b89c-4ca1-bd38-7565e5d5dab0 service nova] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Received event network-vif-plugged-1f2f0fc8-f7e3-4579-8d3a-53ba1117725c {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:06:26.588580 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-22878df4-61a2-46a2-881e-46a2d18e536d req-f5c9230d-b89c-4ca1-bd38-7565e5d5dab0 service nova] Acquiring lock "5c34ef68-490d-42c1-8e1a-1913b3b183e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:26.588759 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-22878df4-61a2-46a2-881e-46a2d18e536d req-f5c9230d-b89c-4ca1-bd38-7565e5d5dab0 service nova] Lock "5c34ef68-490d-42c1-8e1a-1913b3b183e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:26.588925 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-22878df4-61a2-46a2-881e-46a2d18e536d req-f5c9230d-b89c-4ca1-bd38-7565e5d5dab0 service nova] Lock "5c34ef68-490d-42c1-8e1a-1913b3b183e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:26.589035 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-22878df4-61a2-46a2-881e-46a2d18e536d req-f5c9230d-b89c-4ca1-bd38-7565e5d5dab0 service nova] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] No waiting events found dispatching network-vif-plugged-1f2f0fc8-f7e3-4579-8d3a-53ba1117725c {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:06:26.589190 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-22878df4-61a2-46a2-881e-46a2d18e536d req-f5c9230d-b89c-4ca1-bd38-7565e5d5dab0 service nova] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Received unexpected event network-vif-plugged-1f2f0fc8-f7e3-4579-8d3a-53ba1117725c for instance with vm_state active and task_state None.
May 21 02:06:26.607175 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:26.753951 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:06:26.758045 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329186.757708, 5c34ef68-490d-42c1-8e1a-1913b3b183e7 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:06:26.758192 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] VM Resumed (Lifecycle Event)
May 21 02:06:26.776982 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Took 13.83 seconds to build instance.
May 21 02:06:26.991069 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:06:26.994630 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:26.996221 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:06:27.003071 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:06:27.016049 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:06:27.016049 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:06:27.032131 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:27.032131 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:27.040566 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:27.045719 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:27.050869 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:27.063553 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:27.063553 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:27.063553 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:27.063553 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:27.063553 np0000001127 nova-compute[98206]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:27.063553 np0000001127 nova-compute[98206]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:27.063553 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:27.063553 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:27.063553 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:27.063553 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:27.063553 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:06:27.063553 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:27.063553 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:27.063553 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:27.063553 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:27.063553 np0000001127 nova-compute[98206]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:27.063553 np0000001127 nova-compute[98206]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:27.063553 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:27.063553 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:27.063553 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:27.063553 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:27.063553 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:06:27.075003 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:27.078058 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:27.078058 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:27.078058 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:27.078058 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:27.078058 np0000001127 nova-compute[98206]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:27.078058 np0000001127 nova-compute[98206]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:27.078058 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:27.078058 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:27.078058 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:27.078058 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:27.078058 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:06:27.078340 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:27.078340 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:27.078340 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:27.078340 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:27.078340 np0000001127 nova-compute[98206]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:27.078340 np0000001127 nova-compute[98206]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:27.078340 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:27.078340 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:27.078340 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:27.078340 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:27.078340 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:06:27.120802 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946, portal: 192.168.50.100,3260]
May 21 02:06:27.120802 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946, portal: 192.168.50.100,3260] successful.
May 21 02:06:27.120802 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:27.145615 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:27.151028 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946, portal: 192.168.40.100,3260]
May 21 02:06:27.151028 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946, portal: 192.168.40.100,3260] successful.
May 21 02:06:27.151028 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:27.167605 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:27.183380 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:27.183380 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:27.183380 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:27.183380 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:27.183380 np0000001127 nova-compute[98206]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:27.183380 np0000001127 nova-compute[98206]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:27.183380 np0000001127 nova-compute[98206]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946 (non-flash)
May 21 02:06:27.183380 np0000001127 nova-compute[98206]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946 (non-flash)
May 21 02:06:27.183380 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:27.183380 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:27.183380 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:27.183380 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:27.183380 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:06:27.183380 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:27.183380 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:27.183380 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:27.183380 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:27.183380 np0000001127 nova-compute[98206]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:27.183380 np0000001127 nova-compute[98206]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:27.183380 np0000001127 nova-compute[98206]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946 (non-flash)
May 21 02:06:27.183380 np0000001127 nova-compute[98206]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946 (non-flash)
May 21 02:06:27.183380 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:27.183380 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:27.183380 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:27.183380 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:27.183380 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:06:27.184732 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.230s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:06:27.184732 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:06:27.187869 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] HCTL ('17', '-', '-', 0) found on session 112 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:06:27.187869 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:06:27.202065 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:27.202065 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:27.202065 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:27.202065 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:27.202065 np0000001127 nova-compute[98206]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:27.202065 np0000001127 nova-compute[98206]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:27.202065 np0000001127 nova-compute[98206]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946 (non-flash)
May 21 02:06:27.202065 np0000001127 nova-compute[98206]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946 (non-flash)
May 21 02:06:27.202065 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:27.202065 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:27.202065 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:27.202065 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:27.202065 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:06:27.202065 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:27.202065 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:27.202065 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:27.202065 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:27.202065 np0000001127 nova-compute[98206]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:27.202065 np0000001127 nova-compute[98206]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:27.202065 np0000001127 nova-compute[98206]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946 (non-flash)
May 21 02:06:27.202065 np0000001127 nova-compute[98206]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946 (non-flash)
May 21 02:06:27.202065 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:27.202065 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:27.202065 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:27.202065 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:27.202065 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:06:27.202065 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.254s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:06:27.202065 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:06:27.202065 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] HCTL ('18', '-', '-', 0) found on session 113 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:06:27.202065 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:06:27.284898 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Searching for a device in session 112 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:06:27.284898 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'bab0d744-7bfa-4c99-a049-e85167159946', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:06:27.284898 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:06:27.284898 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:06:27.284898 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cb4d5382-b9a0-42df-ae1c-b4cea8873320 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "5c34ef68-490d-42c1-8e1a-1913b3b183e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.344s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:27.289930 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Searching for a device in session 113 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:06:27.289930 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bab0d744-7bfa-4c99-a049-e85167159946', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:06:27.313848 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:27.320564 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:27.355349 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Instance destroyed successfully.
May 21 02:06:27.355349 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-1afac291-8cd1-47bc-a3e7-e102bee73d11 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lazy-loading 'numa_topology' on Instance uuid 3e53c443-92d8-4e5c-bc47-43deb205786b {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:06:27.493125 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d6375976-d811-49c5-9a5d-dc1827544211 req-d73b2911-b334-4ecd-87c6-cf44cf37d0b7 service nova] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Received event network-vif-unplugged-7a9ceef8-458f-4d22-aa65-2dccb71ed1ad {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:06:27.493792 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d6375976-d811-49c5-9a5d-dc1827544211 req-d73b2911-b334-4ecd-87c6-cf44cf37d0b7 service nova] Acquiring lock "3e53c443-92d8-4e5c-bc47-43deb205786b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:27.494080 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d6375976-d811-49c5-9a5d-dc1827544211 req-d73b2911-b334-4ecd-87c6-cf44cf37d0b7 service nova] Lock "3e53c443-92d8-4e5c-bc47-43deb205786b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:27.494213 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d6375976-d811-49c5-9a5d-dc1827544211 req-d73b2911-b334-4ecd-87c6-cf44cf37d0b7 service nova] Lock "3e53c443-92d8-4e5c-bc47-43deb205786b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:27.495310 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d6375976-d811-49c5-9a5d-dc1827544211 req-d73b2911-b334-4ecd-87c6-cf44cf37d0b7 service nova] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] No waiting events found dispatching network-vif-unplugged-7a9ceef8-458f-4d22-aa65-2dccb71ed1ad {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:06:27.495438 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-d6375976-d811-49c5-9a5d-dc1827544211 req-d73b2911-b334-4ecd-87c6-cf44cf37d0b7 service nova] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Received unexpected event network-vif-unplugged-7a9ceef8-458f-4d22-aa65-2dccb71ed1ad for instance with vm_state active and task_state powering-off.
May 21 02:06:27.773123 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999727163999978 future=<Future at 0x71c07c555c10 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:06:27.773618 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.99947192100035 future=<Future at 0x71c07c555c10 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:06:27.773618 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999362448000284 future=<Future at 0x71c07c555c10 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:06:27.857343 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-1afac291-8cd1-47bc-a3e7-e102bee73d11 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Object Instance<3e53c443-92d8-4e5c-bc47-43deb205786b> lazy-loaded attributes: flavor,numa_topology {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:06:27.857600 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1afac291-8cd1-47bc-a3e7-e102bee73d11 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:06:27.947778 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:06:28.123917 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:06:28.124063 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:06:28.124185 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:06:28.124278 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No VIF found with MAC fa:16:3e:fb:4d:96, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:06:28.369918 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1afac291-8cd1-47bc-a3e7-e102bee73d11 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "3e53c443-92d8-4e5c-bc47-43deb205786b" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.419s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:28.469580 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-84081294-3354-430c-a63c-6bd6bfd2fad4 req-520ded9a-f8f9-4ac4-ba77-a0c997dde98b service nova] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Received event network-changed-1f2f0fc8-f7e3-4579-8d3a-53ba1117725c {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:06:28.470088 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-84081294-3354-430c-a63c-6bd6bfd2fad4 req-520ded9a-f8f9-4ac4-ba77-a0c997dde98b service nova] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Refreshing instance network info cache due to event network-changed-1f2f0fc8-f7e3-4579-8d3a-53ba1117725c. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:06:28.470225 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-84081294-3354-430c-a63c-6bd6bfd2fad4 req-520ded9a-f8f9-4ac4-ba77-a0c997dde98b service nova] Acquiring lock "refresh_cache-5c34ef68-490d-42c1-8e1a-1913b3b183e7" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:06:28.470343 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-84081294-3354-430c-a63c-6bd6bfd2fad4 req-520ded9a-f8f9-4ac4-ba77-a0c997dde98b service nova] Acquired lock "refresh_cache-5c34ef68-490d-42c1-8e1a-1913b3b183e7" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:06:28.470481 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-84081294-3354-430c-a63c-6bd6bfd2fad4 req-520ded9a-f8f9-4ac4-ba77-a0c997dde98b service nova] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Refreshing network info cache for port 1f2f0fc8-f7e3-4579-8d3a-53ba1117725c {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:06:28.970576 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Found WWN 330000000662e3594 for multipath device dm-11 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:06:28.971740 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.046s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:06:28.971740 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] <== connect_volume: return (3612ms) {'type': 'block', 'scsi_wwn': '330000000662e3594', 'path': '/dev/dm-11', 'multipath_id': '330000000662e3594'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:06:28.971740 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000662e3594', 'path': '/dev/dm-11', 'multipath_id': '330000000662e3594'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:06:28.975079 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-84081294-3354-430c-a63c-6bd6bfd2fad4 req-520ded9a-f8f9-4ac4-ba77-a0c997dde98b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:06:28.977675 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lazy-loading 'flavor' on Instance uuid 9b4239c5-84df-4d87-a2d4-fb6192408f58 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:06:29.422228 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-84081294-3354-430c-a63c-6bd6bfd2fad4 req-520ded9a-f8f9-4ac4-ba77-a0c997dde98b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:06:29.483483 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Attempting to attach volume bab0d744-7bfa-4c99-a049-e85167159946 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 02:06:29.485520 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] attach device xml: <disk type="block" device="disk">
May 21 02:06:29.485520 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:06:29.485520 np0000001127 nova-compute[98206]:   <alias name="ua-bab0d744-7bfa-4c99-a049-e85167159946"/>
May 21 02:06:29.485520 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-11"/>
May 21 02:06:29.485520 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:06:29.485520 np0000001127 nova-compute[98206]:   <serial>bab0d744-7bfa-4c99-a049-e85167159946</serial>
May 21 02:06:29.485520 np0000001127 nova-compute[98206]: </disk>
May 21 02:06:29.485520 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 02:06:29.591367 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-19db80b2-45d1-484c-9020-f836634a2a78 req-1ade8da4-eeae-456a-a151-89817bb76df1 service nova] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Received event network-vif-unplugged-7a9ceef8-458f-4d22-aa65-2dccb71ed1ad {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:06:29.591946 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-19db80b2-45d1-484c-9020-f836634a2a78 req-1ade8da4-eeae-456a-a151-89817bb76df1 service nova] Acquiring lock "3e53c443-92d8-4e5c-bc47-43deb205786b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:29.592203 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-19db80b2-45d1-484c-9020-f836634a2a78 req-1ade8da4-eeae-456a-a151-89817bb76df1 service nova] Lock "3e53c443-92d8-4e5c-bc47-43deb205786b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:29.592416 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-19db80b2-45d1-484c-9020-f836634a2a78 req-1ade8da4-eeae-456a-a151-89817bb76df1 service nova] Lock "3e53c443-92d8-4e5c-bc47-43deb205786b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:29.592664 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-19db80b2-45d1-484c-9020-f836634a2a78 req-1ade8da4-eeae-456a-a151-89817bb76df1 service nova] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] No waiting events found dispatching network-vif-unplugged-7a9ceef8-458f-4d22-aa65-2dccb71ed1ad {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:06:29.592827 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-19db80b2-45d1-484c-9020-f836634a2a78 req-1ade8da4-eeae-456a-a151-89817bb76df1 service nova] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Received unexpected event network-vif-unplugged-7a9ceef8-458f-4d22-aa65-2dccb71ed1ad for instance with vm_state stopped and task_state None.
May 21 02:06:29.596435 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "b6df4554-8490-4d5a-9d4d-acfd46419cb3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:29.596691 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "b6df4554-8490-4d5a-9d4d-acfd46419cb3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:29.631392 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-84081294-3354-430c-a63c-6bd6bfd2fad4 req-520ded9a-f8f9-4ac4-ba77-a0c997dde98b service nova] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Updated VIF entry in instance network info cache for port 1f2f0fc8-f7e3-4579-8d3a-53ba1117725c. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:06:29.631863 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-84081294-3354-430c-a63c-6bd6bfd2fad4 req-520ded9a-f8f9-4ac4-ba77-a0c997dde98b service nova] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Updating instance_info_cache with network_info: [{"id": "1f2f0fc8-f7e3-4579-8d3a-53ba1117725c", "address": "fa:16:3e:cc:c2:95", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f2f0fc8-f7", "ovs_interfaceid": "1f2f0fc8-f7e3-4579-8d3a-53ba1117725c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:06:29.710975 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-126de395-32bb-4f14-9cbf-2edd4976e626 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "16a0cc8d-c65b-4166-ad1a-5318b18ed00e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.564s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:30.102666 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lazy-loading 'flavor' on Instance uuid b6df4554-8490-4d5a-9d4d-acfd46419cb3 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:06:30.134105 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-84081294-3354-430c-a63c-6bd6bfd2fad4 req-520ded9a-f8f9-4ac4-ba77-a0c997dde98b service nova] Releasing lock "refresh_cache-5c34ef68-490d-42c1-8e1a-1913b3b183e7" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:06:31.109565 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "b6df4554-8490-4d5a-9d4d-acfd46419cb3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:31.180720 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:06:31.180869 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:06:31.180974 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:06:31.181078 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] No VIF found with MAC fa:16:3e:91:3d:5c, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:06:31.410178 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:31.607858 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:32.233361 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "b6df4554-8490-4d5a-9d4d-acfd46419cb3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:32.233910 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "b6df4554-8490-4d5a-9d4d-acfd46419cb3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:32.233910 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Attaching volume b6914633-9282-48cd-83a7-c48bf2509544 to /dev/vdb
May 21 02:06:32.275007 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "3e53c443-92d8-4e5c-bc47-43deb205786b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:32.275503 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "3e53c443-92d8-4e5c-bc47-43deb205786b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:32.275732 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "3e53c443-92d8-4e5c-bc47-43deb205786b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:32.275913 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "3e53c443-92d8-4e5c-bc47-43deb205786b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:32.276062 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "3e53c443-92d8-4e5c-bc47-43deb205786b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:32.278090 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Terminating instance
May 21 02:06:32.297825 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:06:32.314540 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:06:32.338921 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:32.605252 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:06:32.605640 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:06:32.622681 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:06:32.624842 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fee1:2e46', 'fe80::2482:bff:fe1b:902b', 'fe80::fc16:3eff:fe0f:28a1', 'fe80::440a:38ff:fe27:fa24', 'fe80::fc16:3eff:fe91:3d5c', 'fe80::a4db:73ff:fe81:949b', 'fe80::fc16:3eff:fefb:4d96', 'fe80::fc16:3eff:fe68:a810', 'fe80::3cc0:a4ff:feab:836e', 'fe80::fc16:3eff:fe65:6557', 'fe80::fc16:3eff:fecc:c295'] 
May 21 02:06:32.625079 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:06:32.625235 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:06:32.625661 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] <== get_connector_properties: return (326ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:06:32.627214 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Updating existing volume attachment record: 9e62af0d-c524-48b7-87ff-5b64327c6c93 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:06:32.779391 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e5fdea2d-9d8e-4a36-b5d1-f347c892f3e0 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "9b4239c5-84df-4d87-a2d4-fb6192408f58" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.165s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:32.781216 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:06:32.790502 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Instance destroyed successfully.
May 21 02:06:32.790502 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lazy-loading 'resources' on Instance uuid 3e53c443-92d8-4e5c-bc47-43deb205786b {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:06:33.230689 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:06:33.230689 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544', 'iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b6914633-9282-48cd-83a7-c48bf2509544', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:06:33.230689 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:06:33.230689 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:06:33.230689 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544', 'iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b6914633-9282-48cd-83a7-c48bf2509544', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:06:33.249435 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:06:33.251837 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:06:33.251837 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:06:33.251837 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:06:33.252044 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:06:33.252289 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.startup = automatic
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.session.scan = manual
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:06:33.270884 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:06:33.270884 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.startup = automatic
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.session.scan = manual
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:06:33.279574 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:06:33.279574 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:33.292451 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:33.293720 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:05:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-352995534',display_name='tempest-TestVolumeBootPattern-server-352995534',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpattern-server-352995534',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBaRNOqohsNJVOU8i1yx10NByg4YHG0kBqhb8dmc6GQzsAdAAhAV6GFGAs9H1IYquThiDuyR1AIlFlID71ty2Ie/veadDUg9qWuDwTODN9ItjcrF0xf97cKKhCzM0WFlw==',key_name='tempest-keypair-189223710',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:05:43Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='62ebdb16aee84e22a88dfc8960debd32',ramdisk_id='',reservation_id='r-26g0wu0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1995806391',owner_user_name='tempest-TestVolumeBootPattern-1995806391-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:06:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4878b5a5bf184852a9ce383caa1c67a4',uuid=3e53c443-92d8-4e5c-bc47-43deb205786b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7a9ceef8-458f-4d22-aa65-2dccb71ed1ad", "address": "fa:16:3e:bd:86:0a", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9ceef8-45", "ovs_interfaceid": "7a9ceef8-458f-4d22-aa65-2dccb71ed1ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:06:33.296124 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converting VIF {"id": "7a9ceef8-458f-4d22-aa65-2dccb71ed1ad", "address": "fa:16:3e:bd:86:0a", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9ceef8-45", "ovs_interfaceid": "7a9ceef8-458f-4d22-aa65-2dccb71ed1ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:06:33.297312 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:86:0a,bridge_name='br-int',has_traffic_filtering=True,id=7a9ceef8-458f-4d22-aa65-2dccb71ed1ad,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9ceef8-45') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:06:33.298042 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:86:0a,bridge_name='br-int',has_traffic_filtering=True,id=7a9ceef8-458f-4d22-aa65-2dccb71ed1ad,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9ceef8-45') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:06:33.300400 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:33.300743 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a9ceef8-45, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:06:33.303646 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:33.305174 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:06:33.306123 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:33.306312 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9a8b4eb9-0843-4a89-8168-f4a4bd449144) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:06:33.306960 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:33.307606 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:06:33.308506 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:33.312991 np0000001127 nova-compute[98206]: INFO os_vif [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:86:0a,bridge_name='br-int',has_traffic_filtering=True,id=7a9ceef8-458f-4d22-aa65-2dccb71ed1ad,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9ceef8-45')
May 21 02:06:33.316786 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:33.316786 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:33.316786 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:33.316786 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:33.316786 np0000001127 nova-compute[98206]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:33.316786 np0000001127 nova-compute[98206]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:33.316786 np0000001127 nova-compute[98206]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946 (non-flash)
May 21 02:06:33.316786 np0000001127 nova-compute[98206]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946 (non-flash)
May 21 02:06:33.316786 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:33.316786 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:33.316786 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:33.316786 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:33.316786 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:06:33.317373 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:33.317373 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:33.317373 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:33.317373 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:33.317373 np0000001127 nova-compute[98206]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:33.317373 np0000001127 nova-compute[98206]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:33.317373 np0000001127 nova-compute[98206]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946 (non-flash)
May 21 02:06:33.317373 np0000001127 nova-compute[98206]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946 (non-flash)
May 21 02:06:33.317373 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:33.317373 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:33.317373 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:33.317373 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:33.317373 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:06:33.318052 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.067s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:06:33.318052 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:06:33.318532 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:06:33.319079 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617', 'iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '22e98b1d-1bf5-45ce-b4e6-15a697eeb617', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:06:33.319277 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:06:33.320128 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] HCTL ('11', '0', '0', 0) found on session 110 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:06:33.320249 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Scanning host 11 c: 0, t: 0, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:06:33.332726 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:33.332726 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:33.332726 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:33.332726 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:33.332726 np0000001127 nova-compute[98206]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:33.332726 np0000001127 nova-compute[98206]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:33.332726 np0000001127 nova-compute[98206]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946 (non-flash)
May 21 02:06:33.332726 np0000001127 nova-compute[98206]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946 (non-flash)
May 21 02:06:33.332726 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:33.332726 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:33.332726 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:33.332726 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:33.332726 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:06:33.334156 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:33.334156 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:33.334156 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:33.334156 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:33.334156 np0000001127 nova-compute[98206]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:33.334156 np0000001127 nova-compute[98206]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:33.334156 np0000001127 nova-compute[98206]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946 (non-flash)
May 21 02:06:33.334156 np0000001127 nova-compute[98206]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946 (non-flash)
May 21 02:06:33.334156 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:33.334156 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:33.334156 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:33.334156 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:33.334156 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:06:33.334156 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.083s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:06:33.334156 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:06:33.334156 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] HCTL ('12', '0', '0', 0) found on session 111 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:06:33.334974 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Scanning host 12 c: 0, t: 0, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:06:33.336491 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Searching for a device in session 110 and hctl ('11', '0', '0', 0) yield: sdf {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:06:33.336734 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b6914633-9282-48cd-83a7-c48bf2509544', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:06:33.347714 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Searching for a device in session 111 and hctl ('12', '0', '0', 0) yield: sdg {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:06:33.348203 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b6914633-9282-48cd-83a7-c48bf2509544', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:06:34.251532 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:06:35.270036 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Found WWN 1StorPooliSCSI_DISK_1034578903445799047 for multipath device dm-4 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:06:35.270449 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.040s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:06:35.270706 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] <== connect_volume: return (2040ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799047', 'path': '/dev/dm-4', 'multipath_id': '1StorPooliSCSI_DISK_1034578903445799047'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:06:35.270975 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799047', 'path': '/dev/dm-4', 'multipath_id': '1StorPooliSCSI_DISK_1034578903445799047'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:06:35.271460 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.952s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:06:35.271830 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617', 'iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '22e98b1d-1bf5-45ce-b4e6-15a697eeb617', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:06:35.271995 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:06:35.274042 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lazy-loading 'flavor' on Instance uuid b6df4554-8490-4d5a-9d4d-acfd46419cb3 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:06:35.305389 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:35.305389 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:35.305389 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:35.305389 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:35.305389 np0000001127 nova-compute[98206]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:35.305389 np0000001127 nova-compute[98206]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:35.305389 np0000001127 nova-compute[98206]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946 (non-flash)
May 21 02:06:35.305389 np0000001127 nova-compute[98206]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946 (non-flash)
May 21 02:06:35.305389 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:35.305389 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:35.305389 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:35.305389 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:35.305389 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:06:35.305800 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:35.305800 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:35.305800 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:35.305800 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:35.305800 np0000001127 nova-compute[98206]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:35.305800 np0000001127 nova-compute[98206]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:35.305800 np0000001127 nova-compute[98206]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946 (non-flash)
May 21 02:06:35.305800 np0000001127 nova-compute[98206]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946 (non-flash)
May 21 02:06:35.305800 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:35.305800 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:35.305800 np0000001127 nova-compute[98206]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:35.305800 np0000001127 nova-compute[98206]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617 (non-flash)
May 21 02:06:35.305800 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:06:35.306013 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', '103'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9', '106'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9', '107'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544', '110'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544', '111'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946', '112'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946', '113'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '95'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617', '98'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617', '99')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:06:35.306013 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617', '98')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:06:35.308014 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617', '99')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:06:35.309481 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c09835e020>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617'): ({'sdi'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:06:35.309856 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Removing multipathed devices sdi, sdh {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:06:35.310169 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Flush multipath device 330000000ec293e89 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:06:35.364117 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:06:35.417629 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:06:35.467030 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:06:35.467300 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:06:35.469036 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:06:35.481024 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:06:35.481186 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:06:35.493508 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:35.531496 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 98, target: iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617, portal: 192.168.40.100,3260]
May 21 02:06:35.531496 np0000001127 nova-compute[98206]: Logout of [sid: 98, target: iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617, portal: 192.168.40.100,3260] successful.
May 21 02:06:35.531496 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:35.553665 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:35.570503 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:35.614486 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 99, target: iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617, portal: 192.168.50.100,3260]
May 21 02:06:35.614486 np0000001127 nova-compute[98206]: Logout of [sid: 99, target: iqn.2023-03.storpool.com:os--volume-22e98b1d-1bf5-45ce-b4e6-15a697eeb617, portal: 192.168.50.100,3260] successful.
May 21 02:06:35.614486 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:35.639387 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:35.639873 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:06:35.640043 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] <== disconnect_volume: return (2320ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:06:35.640194 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:06:35.640880 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Deleting instance files /opt/stack/data/nova/instances/3e53c443-92d8-4e5c-bc47-43deb205786b_del
May 21 02:06:35.643341 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Deletion of /opt/stack/data/nova/instances/3e53c443-92d8-4e5c-bc47-43deb205786b_del complete
May 21 02:06:35.780667 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Attempting to attach volume b6914633-9282-48cd-83a7-c48bf2509544 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 02:06:35.781415 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] attach device xml: <disk type="block" device="disk">
May 21 02:06:35.781415 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:06:35.781415 np0000001127 nova-compute[98206]:   <alias name="ua-b6914633-9282-48cd-83a7-c48bf2509544"/>
May 21 02:06:35.781415 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-4"/>
May 21 02:06:35.781415 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:06:35.781415 np0000001127 nova-compute[98206]:   <serial>b6914633-9282-48cd-83a7-c48bf2509544</serial>
May 21 02:06:35.781415 np0000001127 nova-compute[98206]:   <shareable/>
May 21 02:06:35.781415 np0000001127 nova-compute[98206]: </disk>
May 21 02:06:35.781415 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 02:06:36.149566 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Took 3.37 seconds to destroy the instance on the hypervisor.
May 21 02:06:36.150002 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:06:36.150279 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:06:36.150381 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:06:36.150647 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:06:36.216188 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:06:36.610812 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:36.685018 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7bddbcec-8a80-4b5d-9e3d-6943ba893d5f req-440d39ad-525c-4a4a-b7a8-41a83eb492d3 service nova] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Received event network-vif-deleted-7a9ceef8-458f-4d22-aa65-2dccb71ed1ad {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:06:36.685616 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-7bddbcec-8a80-4b5d-9e3d-6943ba893d5f req-440d39ad-525c-4a4a-b7a8-41a83eb492d3 service nova] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Neutron deleted interface 7a9ceef8-458f-4d22-aa65-2dccb71ed1ad; detaching it from the instance and deleting it from the info cache
May 21 02:06:36.685616 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-7bddbcec-8a80-4b5d-9e3d-6943ba893d5f req-440d39ad-525c-4a4a-b7a8-41a83eb492d3 service nova] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:06:37.130598 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:06:37.190746 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7bddbcec-8a80-4b5d-9e3d-6943ba893d5f req-440d39ad-525c-4a4a-b7a8-41a83eb492d3 service nova] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Detach interface failed, port_id=7a9ceef8-458f-4d22-aa65-2dccb71ed1ad, reason: Instance 3e53c443-92d8-4e5c-bc47-43deb205786b could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:06:37.397875 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Acquiring lock "9b4239c5-84df-4d87-a2d4-fb6192408f58" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:37.398070 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "9b4239c5-84df-4d87-a2d4-fb6192408f58" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:37.451979 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:06:37.452111 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:06:37.452261 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:06:37.452398 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No VIF found with MAC fa:16:3e:65:65:57, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:06:37.632760 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Took 1.48 seconds to deallocate network for instance.
May 21 02:06:37.902453 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Detaching volume bab0d744-7bfa-4c99-a049-e85167159946
May 21 02:06:37.944037 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Attempting to driver detach volume bab0d744-7bfa-4c99-a049-e85167159946 from mountpoint /dev/vdb
May 21 02:06:37.948742 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Found disk vdb by alias ua-bab0d744-7bfa-4c99-a049-e85167159946 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:06:37.949885 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Found disk vdb by alias ua-bab0d744-7bfa-4c99-a049-e85167159946 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:06:37.950053 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Attempting to detach device vdb from instance 9b4239c5-84df-4d87-a2d4-fb6192408f58 from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 02:06:37.950280 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:06:37.950280 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:06:37.950280 np0000001127 nova-compute[98206]:   <alias name="ua-bab0d744-7bfa-4c99-a049-e85167159946"/>
May 21 02:06:37.950280 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-11"/>
May 21 02:06:37.950280 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:06:37.950280 np0000001127 nova-compute[98206]:   <serial>bab0d744-7bfa-4c99-a049-e85167159946</serial>
May 21 02:06:37.950280 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:06:37.950280 np0000001127 nova-compute[98206]: </disk>
May 21 02:06:37.950280 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:06:37.956241 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Successfully detached device vdb from instance 9b4239c5-84df-4d87-a2d4-fb6192408f58 from the persistent domain config.
May 21 02:06:37.956380 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] (1/8): Attempting to detach device vdb with device alias ua-bab0d744-7bfa-4c99-a049-e85167159946 from instance 9b4239c5-84df-4d87-a2d4-fb6192408f58 from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 02:06:37.956654 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:06:37.956654 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:06:37.956654 np0000001127 nova-compute[98206]:   <alias name="ua-bab0d744-7bfa-4c99-a049-e85167159946"/>
May 21 02:06:37.956654 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-11"/>
May 21 02:06:37.956654 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:06:37.956654 np0000001127 nova-compute[98206]:   <serial>bab0d744-7bfa-4c99-a049-e85167159946</serial>
May 21 02:06:37.956654 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:06:37.956654 np0000001127 nova-compute[98206]: </disk>
May 21 02:06:37.956654 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:06:38.203016 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Took 0.57 seconds to detach 1 volumes for instance.
May 21 02:06:38.307569 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:38.556625 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779329198.5562592, 9b4239c5-84df-4d87-a2d4-fb6192408f58 => ua-bab0d744-7bfa-4c99-a049-e85167159946> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 02:06:38.559209 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-bab0d744-7bfa-4c99-a049-e85167159946 for instance 9b4239c5-84df-4d87-a2d4-fb6192408f58 {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 02:06:38.564958 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Successfully detached device vdb from instance 9b4239c5-84df-4d87-a2d4-fb6192408f58 from the live domain config.
May 21 02:06:38.568031 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:06:38.568430 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946', 'iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bab0d744-7bfa-4c99-a049-e85167159946', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:06:38.568596 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:06:38.569056 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:06:38.569418 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946', 'iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bab0d744-7bfa-4c99-a049-e85167159946', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:06:38.569613 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:06:38.608954 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:38.608954 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:38.608954 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:38.608954 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:38.608954 np0000001127 nova-compute[98206]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:38.608954 np0000001127 nova-compute[98206]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:38.608954 np0000001127 nova-compute[98206]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946 (non-flash)
May 21 02:06:38.608954 np0000001127 nova-compute[98206]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946 (non-flash)
May 21 02:06:38.608954 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:38.608954 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:38.608954 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:06:38.608954 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:38.608954 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:38.608954 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:38.608954 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:38.608954 np0000001127 nova-compute[98206]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:38.608954 np0000001127 nova-compute[98206]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:38.608954 np0000001127 nova-compute[98206]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946 (non-flash)
May 21 02:06:38.608954 np0000001127 nova-compute[98206]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946 (non-flash)
May 21 02:06:38.608954 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:38.608954 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:38.608954 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:06:38.609394 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', '103'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9', '106'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9', '107'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544', '110'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544', '111'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946', '112'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946', '113'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '95')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:06:38.609394 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946', '113')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:06:38.610212 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946', '112')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:06:38.611067 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c0587d8ae0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946'): ({'sdm'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946'): ({'sdl'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:06:38.611248 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Removing multipathed devices sdl, sdm {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:06:38.611458 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Flush multipath device 330000000662e3594 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:06:38.644760 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:06:38.698983 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:06:38.708302 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:38.708446 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:38.742994 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Checking to see if SCSI volumes sdl, sdm have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:06:38.743203 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] SCSI volumes sdl, sdm have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:06:38.744687 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Checking to see if device paths {'sdl', 'sdm'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:06:38.759080 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Device paths {'sdl', 'sdm'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:06:38.759277 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:06:38.776629 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:38.813822 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 113, target: iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946, portal: 192.168.40.100,3260]
May 21 02:06:38.813822 np0000001127 nova-compute[98206]: Logout of [sid: 113, target: iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946, portal: 192.168.40.100,3260] successful.
May 21 02:06:38.813822 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:38.828069 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:38.843154 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:38.884406 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 112, target: iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946, portal: 192.168.50.100,3260]
May 21 02:06:38.884406 np0000001127 nova-compute[98206]: Logout of [sid: 112, target: iqn.2023-03.storpool.com:os--volume-bab0d744-7bfa-4c99-a049-e85167159946, portal: 192.168.50.100,3260] successful.
May 21 02:06:38.884406 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:38.912219 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:38.912219 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:06:38.912219 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] <== disconnect_volume: return (341ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:06:38.912219 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:06:39.057507 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c6db4672-6933-498e-bf2d-202d67c49d04 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "b6df4554-8490-4d5a-9d4d-acfd46419cb3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.816s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:39.186708 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:06:39.186807 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:06:39.469325 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lazy-loading 'flavor' on Instance uuid 9b4239c5-84df-4d87-a2d4-fb6192408f58 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:06:39.691499 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:06:40.206587 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.489s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:40.401036 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Deleted allocations for instance 3e53c443-92d8-4e5c-bc47-43deb205786b
May 21 02:06:40.427947 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-93e71cec-380d-4e92-90f4-6f620253d891 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "16a0cc8d-c65b-4166-ad1a-5318b18ed00e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:40.428132 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-93e71cec-380d-4e92-90f4-6f620253d891 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "16a0cc8d-c65b-4166-ad1a-5318b18ed00e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:40.474942 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b1cc0b7b-cea8-444f-bf58-63d3cafb46be tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "9b4239c5-84df-4d87-a2d4-fb6192408f58" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.077s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:40.931496 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-93e71cec-380d-4e92-90f4-6f620253d891 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Detaching volume b6914633-9282-48cd-83a7-c48bf2509544
May 21 02:06:40.998927 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-93e71cec-380d-4e92-90f4-6f620253d891 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Attempting to driver detach volume b6914633-9282-48cd-83a7-c48bf2509544 from mountpoint /dev/vdb
May 21 02:06:41.005551 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-93e71cec-380d-4e92-90f4-6f620253d891 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Found disk vdb by alias ua-b6914633-9282-48cd-83a7-c48bf2509544 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:06:41.013425 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-93e71cec-380d-4e92-90f4-6f620253d891 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Found disk vdb by alias ua-b6914633-9282-48cd-83a7-c48bf2509544 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:06:41.013708 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-93e71cec-380d-4e92-90f4-6f620253d891 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Attempting to detach device vdb from instance 16a0cc8d-c65b-4166-ad1a-5318b18ed00e from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 02:06:41.014183 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-93e71cec-380d-4e92-90f4-6f620253d891 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:06:41.014183 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:06:41.014183 np0000001127 nova-compute[98206]:   <alias name="ua-b6914633-9282-48cd-83a7-c48bf2509544"/>
May 21 02:06:41.014183 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-4"/>
May 21 02:06:41.014183 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:06:41.014183 np0000001127 nova-compute[98206]:   <serial>b6914633-9282-48cd-83a7-c48bf2509544</serial>
May 21 02:06:41.014183 np0000001127 nova-compute[98206]:   <shareable/>
May 21 02:06:41.014183 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:06:41.014183 np0000001127 nova-compute[98206]: </disk>
May 21 02:06:41.014183 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:06:41.025986 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-93e71cec-380d-4e92-90f4-6f620253d891 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Successfully detached device vdb from instance 16a0cc8d-c65b-4166-ad1a-5318b18ed00e from the persistent domain config.
May 21 02:06:41.026309 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-93e71cec-380d-4e92-90f4-6f620253d891 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] (1/8): Attempting to detach device vdb with device alias ua-b6914633-9282-48cd-83a7-c48bf2509544 from instance 16a0cc8d-c65b-4166-ad1a-5318b18ed00e from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 02:06:41.026635 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-93e71cec-380d-4e92-90f4-6f620253d891 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:06:41.026635 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:06:41.026635 np0000001127 nova-compute[98206]:   <alias name="ua-b6914633-9282-48cd-83a7-c48bf2509544"/>
May 21 02:06:41.026635 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-4"/>
May 21 02:06:41.026635 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:06:41.026635 np0000001127 nova-compute[98206]:   <serial>b6914633-9282-48cd-83a7-c48bf2509544</serial>
May 21 02:06:41.026635 np0000001127 nova-compute[98206]:   <shareable/>
May 21 02:06:41.026635 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:06:41.026635 np0000001127 nova-compute[98206]: </disk>
May 21 02:06:41.026635 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:06:41.412560 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-318f0e32-51a8-43d1-bbf6-7adf76a5d494 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "3e53c443-92d8-4e5c-bc47-43deb205786b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.136s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:41.615524 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:41.750407 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779329201.7500076, 16a0cc8d-c65b-4166-ad1a-5318b18ed00e => ua-b6914633-9282-48cd-83a7-c48bf2509544> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 02:06:41.753003 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-93e71cec-380d-4e92-90f4-6f620253d891 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-b6914633-9282-48cd-83a7-c48bf2509544 for instance 16a0cc8d-c65b-4166-ad1a-5318b18ed00e {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 02:06:41.755391 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-93e71cec-380d-4e92-90f4-6f620253d891 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Successfully detached device vdb from instance 16a0cc8d-c65b-4166-ad1a-5318b18ed00e from the live domain config.
May 21 02:06:42.308608 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-93e71cec-380d-4e92-90f4-6f620253d891 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Detected multiple connections on this host for volume: b6914633-9282-48cd-83a7-c48bf2509544, skipping target disconnect.
May 21 02:06:42.773290 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.00041855799963741447 future=<Future at 0x71c07c555c10 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:06:42.773640 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] Emitting event <LifecycleEvent: 1779329187.772748, 3e53c443-92d8-4e5c-bc47-43deb205786b => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:06:42.773770 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] VM Stopped (Lifecycle Event)
May 21 02:06:42.774210 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:06:42.880349 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-93e71cec-380d-4e92-90f4-6f620253d891 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lazy-loading 'flavor' on Instance uuid 16a0cc8d-c65b-4166-ad1a-5318b18ed00e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:06:43.278210 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-665e5dd5-ad5d-40f3-a231-0a4329fce3b7 tempest-TaggedBootDevicesTest-1353067880 tempest-TaggedBootDevicesTest-1353067880-project-member] [instance: 3e53c443-92d8-4e5c-bc47-43deb205786b] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:06:43.310453 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:43.330062 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-98ecaf08-4707-4542-924b-a7e5f800ce7b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:06:43.710671 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Acquiring lock "feb908f9-10aa-4ba0-8289-c76a3a6279c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:43.711035 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "feb908f9-10aa-4ba0-8289-c76a3a6279c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:43.841725 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-98ecaf08-4707-4542-924b-a7e5f800ce7b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] instance snapshotting
May 21 02:06:43.888118 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-93e71cec-380d-4e92-90f4-6f620253d891 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "16a0cc8d-c65b-4166-ad1a-5318b18ed00e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.460s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:43.946983 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "b6df4554-8490-4d5a-9d4d-acfd46419cb3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:43.947177 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "b6df4554-8490-4d5a-9d4d-acfd46419cb3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:43.951446 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-98ecaf08-4707-4542-924b-a7e5f800ce7b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Beginning live snapshot process
May 21 02:06:44.213389 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:06:44.450317 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Detaching volume b6914633-9282-48cd-83a7-c48bf2509544
May 21 02:06:44.511934 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Attempting to driver detach volume b6914633-9282-48cd-83a7-c48bf2509544 from mountpoint /dev/vdb
May 21 02:06:44.518588 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Found disk vdb by alias ua-b6914633-9282-48cd-83a7-c48bf2509544 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:06:44.519312 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Found disk vdb by alias ua-b6914633-9282-48cd-83a7-c48bf2509544 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:06:44.519380 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Attempting to detach device vdb from instance b6df4554-8490-4d5a-9d4d-acfd46419cb3 from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 02:06:44.519657 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:06:44.519657 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:06:44.519657 np0000001127 nova-compute[98206]:   <alias name="ua-b6914633-9282-48cd-83a7-c48bf2509544"/>
May 21 02:06:44.519657 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-4"/>
May 21 02:06:44.519657 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:06:44.519657 np0000001127 nova-compute[98206]:   <serial>b6914633-9282-48cd-83a7-c48bf2509544</serial>
May 21 02:06:44.519657 np0000001127 nova-compute[98206]:   <shareable/>
May 21 02:06:44.519657 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:06:44.519657 np0000001127 nova-compute[98206]: </disk>
May 21 02:06:44.519657 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:06:44.528547 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Successfully detached device vdb from instance b6df4554-8490-4d5a-9d4d-acfd46419cb3 from the persistent domain config.
May 21 02:06:44.528800 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] (1/8): Attempting to detach device vdb with device alias ua-b6914633-9282-48cd-83a7-c48bf2509544 from instance b6df4554-8490-4d5a-9d4d-acfd46419cb3 from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 02:06:44.529248 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:06:44.529248 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:06:44.529248 np0000001127 nova-compute[98206]:   <alias name="ua-b6914633-9282-48cd-83a7-c48bf2509544"/>
May 21 02:06:44.529248 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-4"/>
May 21 02:06:44.529248 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:06:44.529248 np0000001127 nova-compute[98206]:   <serial>b6914633-9282-48cd-83a7-c48bf2509544</serial>
May 21 02:06:44.529248 np0000001127 nova-compute[98206]:   <shareable/>
May 21 02:06:44.529248 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:06:44.529248 np0000001127 nova-compute[98206]: </disk>
May 21 02:06:44.529248 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:06:44.763291 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:44.763494 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:44.767744 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:06:44.767893 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Claim successful on node np0000001127
May 21 02:06:45.468924 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-98ecaf08-4707-4542-924b-a7e5f800ce7b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b4239c5-84df-4d87-a2d4-fb6192408f58/disk --force-share --output=json -f qcow2 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:45.557170 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-98ecaf08-4707-4542-924b-a7e5f800ce7b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b4239c5-84df-4d87-a2d4-fb6192408f58/disk --force-share --output=json -f qcow2" returned: 0 in 0.088s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:06:45.557793 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-98ecaf08-4707-4542-924b-a7e5f800ce7b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b4239c5-84df-4d87-a2d4-fb6192408f58/disk --force-share --output=json -f qcow2 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:45.658237 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-98ecaf08-4707-4542-924b-a7e5f800ce7b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b4239c5-84df-4d87-a2d4-fb6192408f58/disk --force-share --output=json -f qcow2" returned: 0 in 0.100s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:06:45.658940 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-98ecaf08-4707-4542-924b-a7e5f800ce7b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:06:45.661581 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-98ecaf08-4707-4542-924b-a7e5f800ce7b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:06:45.661750 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-98ecaf08-4707-4542-924b-a7e5f800ce7b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:45.747737 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-98ecaf08-4707-4542-924b-a7e5f800ce7b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.086s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:06:45.748233 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-98ecaf08-4707-4542-924b-a7e5f800ce7b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcy8h0jmw/b662fb50f1f1422e846ffa16371b2b53.delta 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:45.802225 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-98ecaf08-4707-4542-924b-a7e5f800ce7b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcy8h0jmw/b662fb50f1f1422e846ffa16371b2b53.delta 1073741824" returned: 0 in 0.054s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:06:45.802832 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-98ecaf08-4707-4542-924b-a7e5f800ce7b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Quiescing instance not available: QEMU guest agent is not enabled.
May 21 02:06:46.027572 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-98ecaf08-4707-4542-924b-a7e5f800ce7b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] COPY block job progress, current cursor: 0 final cursor: 76808192 {{(pid=98206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 21 02:06:46.141415 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:06:46.141675 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:06:46.530707 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-98ecaf08-4707-4542-924b-a7e5f800ce7b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] COPY block job progress, current cursor: 76808192 final cursor: 76808192 {{(pid=98206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 21 02:06:46.532778 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-98ecaf08-4707-4542-924b-a7e5f800ce7b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Skipping quiescing instance: QEMU guest agent is not enabled.
May 21 02:06:46.570714 np0000001127 nova-compute[98206]: DEBUG nova.privsep.utils [None req-98ecaf08-4707-4542-924b-a7e5f800ce7b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 21 02:06:46.570714 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-98ecaf08-4707-4542-924b-a7e5f800ce7b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcy8h0jmw/b662fb50f1f1422e846ffa16371b2b53.delta /opt/stack/data/nova/instances/snapshots/tmpcy8h0jmw/b662fb50f1f1422e846ffa16371b2b53 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:46.627397 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:46.645881 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:06:46.849539 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-98ecaf08-4707-4542-924b-a7e5f800ce7b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcy8h0jmw/b662fb50f1f1422e846ffa16371b2b53.delta /opt/stack/data/nova/instances/snapshots/tmpcy8h0jmw/b662fb50f1f1422e846ffa16371b2b53" returned: 0 in 0.279s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:06:46.854023 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-98ecaf08-4707-4542-924b-a7e5f800ce7b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Snapshot extracted, beginning image upload
May 21 02:06:46.993441 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "609b1611-3b05-4b86-8bf3-85f16f199d80" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:46.993604 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "609b1611-3b05-4b86-8bf3-85f16f199d80" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:47.153235 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.390s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:47.153623 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:06:47.496129 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:06:47.659661 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:06:47.660065 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:06:47.660183 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:06:47.660583 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:06:47.731066 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0083b33595414e5e8a3a80e7fea274ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0ea7da0f244aab58f9da579e53864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:06:47.992497 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779329207.9898734, b6df4554-8490-4d5a-9d4d-acfd46419cb3 => ua-b6914633-9282-48cd-83a7-c48bf2509544> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 02:06:47.993825 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-b6914633-9282-48cd-83a7-c48bf2509544 for instance b6df4554-8490-4d5a-9d4d-acfd46419cb3 {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 02:06:47.996924 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Successfully detached device vdb from instance b6df4554-8490-4d5a-9d4d-acfd46419cb3 from the live domain config.
May 21 02:06:48.034944 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:06:48.035058 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544', 'iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b6914633-9282-48cd-83a7-c48bf2509544', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:06:48.035272 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:06:48.035702 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:06:48.036017 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544', 'iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b6914633-9282-48cd-83a7-c48bf2509544', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:06:48.036220 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:06:48.062751 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:48.062751 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:48.067975 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:06:48.068164 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Claim successful on node np0000001127
May 21 02:06:48.071228 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:48.071228 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:48.071228 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:48.071228 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:48.071228 np0000001127 nova-compute[98206]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:48.071228 np0000001127 nova-compute[98206]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:48.071228 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:48.071228 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:48.071228 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:06:48.071228 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:48.071228 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:48.071228 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:48.071228 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:48.071228 np0000001127 nova-compute[98206]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:48.071228 np0000001127 nova-compute[98206]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544 (non-flash)
May 21 02:06:48.071228 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:48.071228 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:48.071228 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:06:48.071228 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', '103'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9', '106'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9', '107'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544', '110'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544', '111'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '95')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:06:48.071673 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544', '111')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:06:48.073980 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544', '110')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:06:48.074662 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c09835e660>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544'): ({'sdf'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:06:48.074662 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Removing multipathed devices sdg, sdf {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:06:48.074662 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Flush multipath device 3300000004e8703d6 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:06:48.111725 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:06:48.162490 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:06:48.169044 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:06:48.221659 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:06:48.221659 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:06:48.221659 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:06:48.235922 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:06:48.235922 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:06:48.247984 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:48.285144 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Successfully created port: 59724ac9-1c92-4fdf-a5c9-de82a9453bc6 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:06:48.288767 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 111, target: iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544, portal: 192.168.40.100,3260]
May 21 02:06:48.288767 np0000001127 nova-compute[98206]: Logout of [sid: 111, target: iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544, portal: 192.168.40.100,3260] successful.
May 21 02:06:48.288767 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:48.308655 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:48.312406 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:48.321399 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:48.362211 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 110, target: iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544, portal: 192.168.50.100,3260]
May 21 02:06:48.362211 np0000001127 nova-compute[98206]: Logout of [sid: 110, target: iqn.2023-03.storpool.com:os--volume-b6914633-9282-48cd-83a7-c48bf2509544, portal: 192.168.50.100,3260] successful.
May 21 02:06:48.362211 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:48.389290 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:48.389290 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:06:48.389290 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] <== disconnect_volume: return (350ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:06:48.389290 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:06:48.666994 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:06:48.676321 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:06:48.677236 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.87 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:06:48.856210 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Successfully updated port: 59724ac9-1c92-4fdf-a5c9-de82a9453bc6 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:06:48.930112 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-ef4fd70f-1318-43e6-8169-c65386735523 req-8726d0a2-6a60-4182-9aa9-fe6d6702b8ae service nova] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Received event network-changed-59724ac9-1c92-4fdf-a5c9-de82a9453bc6 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:06:48.931198 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-ef4fd70f-1318-43e6-8169-c65386735523 req-8726d0a2-6a60-4182-9aa9-fe6d6702b8ae service nova] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Refreshing instance network info cache due to event network-changed-59724ac9-1c92-4fdf-a5c9-de82a9453bc6. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:06:48.931400 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ef4fd70f-1318-43e6-8169-c65386735523 req-8726d0a2-6a60-4182-9aa9-fe6d6702b8ae service nova] Acquiring lock "refresh_cache-feb908f9-10aa-4ba0-8289-c76a3a6279c7" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:06:48.931557 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ef4fd70f-1318-43e6-8169-c65386735523 req-8726d0a2-6a60-4182-9aa9-fe6d6702b8ae service nova] Acquired lock "refresh_cache-feb908f9-10aa-4ba0-8289-c76a3a6279c7" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:06:48.932537 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-ef4fd70f-1318-43e6-8169-c65386735523 req-8726d0a2-6a60-4182-9aa9-fe6d6702b8ae service nova] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Refreshing network info cache for port 59724ac9-1c92-4fdf-a5c9-de82a9453bc6 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:06:48.955070 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lazy-loading 'flavor' on Instance uuid b6df4554-8490-4d5a-9d4d-acfd46419cb3 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:06:49.178646 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Booting with volume ece91188-02a7-416e-acb0-f751583ab435 at /dev/vda
May 21 02:06:49.248723 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:06:49.265727 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:06:49.292437 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:49.340240 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:06:49.340555 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:06:49.348568 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:06:49.349835 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fee1:2e46', 'fe80::2482:bff:fe1b:902b', 'fe80::fc16:3eff:fe0f:28a1', 'fe80::440a:38ff:fe27:fa24', 'fe80::fc16:3eff:fe91:3d5c', 'fe80::a4db:73ff:fe81:949b', 'fe80::fc16:3eff:fefb:4d96', 'fe80::fc16:3eff:fe68:a810', 'fe80::3cc0:a4ff:feab:836e', 'fe80::fc16:3eff:fe65:6557', 'fe80::fc16:3eff:fecc:c295'] 
May 21 02:06:49.349982 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:06:49.350084 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:06:49.350317 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] <== get_connector_properties: return (101ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:06:49.350536 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Updating existing volume attachment record: de64a0c3-fb04-41e0-9e6b-294deffaaeaf {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:06:49.360060 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Acquiring lock "refresh_cache-feb908f9-10aa-4ba0-8289-c76a3a6279c7" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:06:49.434904 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-ef4fd70f-1318-43e6-8169-c65386735523 req-8726d0a2-6a60-4182-9aa9-fe6d6702b8ae service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:06:49.532051 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-ef4fd70f-1318-43e6-8169-c65386735523 req-8726d0a2-6a60-4182-9aa9-fe6d6702b8ae service nova] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:06:49.655484 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-98ecaf08-4707-4542-924b-a7e5f800ce7b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Snapshot image upload complete
May 21 02:06:49.658484 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-98ecaf08-4707-4542-924b-a7e5f800ce7b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Took 5.81 seconds to snapshot the instance on the hypervisor.
May 21 02:06:49.705791 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:06:49.706186 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:06:49.740784 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-ef4fd70f-1318-43e6-8169-c65386735523 req-8726d0a2-6a60-4182-9aa9-fe6d6702b8ae service nova] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:06:49.966051 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b293ba58-512f-4fb9-8ef0-462ba1d457e9 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "b6df4554-8490-4d5a-9d4d-acfd46419cb3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.019s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:50.209206 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:06:50.243995 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ef4fd70f-1318-43e6-8169-c65386735523 req-8726d0a2-6a60-4182-9aa9-fe6d6702b8ae service nova] Releasing lock "refresh_cache-feb908f9-10aa-4ba0-8289-c76a3a6279c7" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:06:50.244513 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Acquired lock "refresh_cache-feb908f9-10aa-4ba0-8289-c76a3a6279c7" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:06:50.245901 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:06:50.552663 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:06:50.553022 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.12 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:06:50.675835 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:06:50.676325 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:06:50.676526 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 21 02:06:50.677360 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:06:50.719358 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.657s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:50.719727 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:06:50.839099 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:06:51.017376 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:06:51.131584 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Acquiring lock "b646159a-f806-487d-8a14-0aa8e2438f2b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:51.131722 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "b646159a-f806-487d-8a14-0aa8e2438f2b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:51.212156 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Updating instance_info_cache with network_info: [{"id": "59724ac9-1c92-4fdf-a5c9-de82a9453bc6", "address": "fa:16:3e:f5:8e:ad", "network": {"id": "460fd532-ef54-4f63-922b-b9d9f73f665f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1504169250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89e0ea7da0f244aab58f9da579e53864", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap59724ac9-1c", "ovs_interfaceid": "59724ac9-1c92-4fdf-a5c9-de82a9453bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:06:51.228799 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:06:51.228799 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:06:51.229081 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:06:51.229437 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:06:51.339136 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:51.339314 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:51.342221 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4878b5a5bf184852a9ce383caa1c67a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ebdb16aee84e22a88dfc8960debd32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:06:51.501824 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:06:51.503055 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:06:51.503289 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Creating image(s)
May 21 02:06:51.503708 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Did not create local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 21 02:06:51.503908 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Ensure instance console log exists: /opt/stack/data/nova/instances/feb908f9-10aa-4ba0-8289-c76a3a6279c7/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:06:51.505231 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:51.505480 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:51.505769 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:51.628832 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:51.633869 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:06:51.676625 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:06:51.714079 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Releasing lock "refresh_cache-feb908f9-10aa-4ba0-8289-c76a3a6279c7" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:06:51.714315 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Instance network_info: |[{"id": "59724ac9-1c92-4fdf-a5c9-de82a9453bc6", "address": "fa:16:3e:f5:8e:ad", "network": {"id": "460fd532-ef54-4f63-922b-b9d9f73f665f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1504169250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89e0ea7da0f244aab58f9da579e53864", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap59724ac9-1c", "ovs_interfaceid": "59724ac9-1c92-4fdf-a5c9-de82a9453bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:06:51.715161 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Start _get_guest_xml network_info=[{"id": "59724ac9-1c92-4fdf-a5c9-de82a9453bc6", "address": "fa:16:3e:f5:8e:ad", "network": {"id": "460fd532-ef54-4f63-922b-b9d9f73f665f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1504169250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89e0ea7da0f244aab58f9da579e53864", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap59724ac9-1c", "ovs_interfaceid": "59724ac9-1c92-4fdf-a5c9-de82a9453bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435', 'iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ece91188-02a7-416e-acb0-f751583ab435', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'feb908f9-10aa-4ba0-8289-c76a3a6279c7', 'attached_at': '', 'detached_at': '', 'volume_id': 'ece91188-02a7-416e-acb0-f751583ab435', 'serial': 'ece91188-02a7-416e-acb0-f751583ab435'}, 'delete_on_termination': False, 'attachment_id': 'de64a0c3-fb04-41e0-9e6b-294deffaaeaf', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:06:51.718943 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:06:51.720058 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-891374816', uuid='feb908f9-10aa-4ba0-8289-c76a3a6279c7'), owner=OwnerMeta(userid='0083b33595414e5e8a3a80e7fea274ba', username='tempest-TestVolumeBootPatternV346-1354384974-project-member', projectid='89e0ea7da0f244aab58f9da579e53864', projectname='tempest-TestVolumeBootPatternV346-1354384974'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "59724ac9-1c92-4fdf-a5c9-de82a9453bc6", "address": "fa:16:3e:f5:8e:ad", "network": {"id": "460fd532-ef54-4f63-922b-b9d9f73f665f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1504169250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89e0ea7da0f244aab58f9da579e53864", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap59724ac9-1c", "ovs_interfaceid": "59724ac9-1c92-4fdf-a5c9-de82a9453bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329211.7196946) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:06:51.721543 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:06:51.721891 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:06:51.722952 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:06:51.723197 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:06:51.724150 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:06:51.724443 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:06:51.724577 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:06:51.724688 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:06:51.724794 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:06:51.724863 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:06:51.724968 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:06:51.725132 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:06:51.725226 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:06:51.725338 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:06:51.725454 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:06:51.725582 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:06:51.735315 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:06:51.743817 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:06:51.744433 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435', 'iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ece91188-02a7-416e-acb0-f751583ab435', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:06:51.744639 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:06:51.745092 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:06:51.745324 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435', 'iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ece91188-02a7-416e-acb0-f751583ab435', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:06:51.766910 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:06:51.767964 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:06:51.768667 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:06:51.769350 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:06:51.769954 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:06:51.770233 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:06:51.786834 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:06:51.786834 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:51.795309 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:06:51.795309 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:51.805101 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435] added
May 21 02:06:51.805101 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:06:51.805101 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:06:51.805101 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:06:51.805101 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:06:51.805101 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:06:51.805101 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:51.805101 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:06:51.805101 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0357(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:06:51.805101 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:06:51.810203 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435] added
May 21 02:06:51.810203 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:06:51.810203 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:06:51.810203 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:06:51.810203 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:06:51.810203 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:06:51.810203 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:51.810420 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:06:51.810653 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0404(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:06:51.810845 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:06:51.845145 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:06:51.971110 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Successfully created port: 58f0082f-9f4d-42c5-9569-faf668cc281d {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:06:52.186697 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:52.186697 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:52.186697 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:52.186697 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Auditing locally available compute resources for np0000001127 (node: np0000001127) {{(pid=98206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 21 02:06:52.206448 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:52.206663 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:52.210220 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:06:52.211988 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Claim successful on node np0000001127
May 21 02:06:52.244604 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:06:52.413680 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:52.630296 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Successfully updated port: 58f0082f-9f4d-42c5-9569-faf668cc281d {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:06:52.688351 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1c2d5370-194b-4526-82e5-107d5551e10a req-80468e25-b748-4732-b9b8-a14ecb387358 service nova] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Received event network-changed-58f0082f-9f4d-42c5-9569-faf668cc281d {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:06:52.688351 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1c2d5370-194b-4526-82e5-107d5551e10a req-80468e25-b748-4732-b9b8-a14ecb387358 service nova] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Refreshing instance network info cache due to event network-changed-58f0082f-9f4d-42c5-9569-faf668cc281d. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:06:52.688351 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1c2d5370-194b-4526-82e5-107d5551e10a req-80468e25-b748-4732-b9b8-a14ecb387358 service nova] Acquiring lock "refresh_cache-609b1611-3b05-4b86-8bf3-85f16f199d80" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:06:52.688351 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1c2d5370-194b-4526-82e5-107d5551e10a req-80468e25-b748-4732-b9b8-a14ecb387358 service nova] Acquired lock "refresh_cache-609b1611-3b05-4b86-8bf3-85f16f199d80" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:06:52.688351 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-1c2d5370-194b-4526-82e5-107d5551e10a req-80468e25-b748-4732-b9b8-a14ecb387358 service nova] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Refreshing network info cache for port 58f0082f-9f4d-42c5-9569-faf668cc281d {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:06:52.749079 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Booting with volume 9e45da95-d0bd-4a28-859f-96496102cc36 at /dev/vda
May 21 02:06:52.799583 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:06:52.805501 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:06:52.811363 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:06:52.826312 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:06:52.826312 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:52.829720 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:06:52.834406 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:06:52.834406 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:52.851734 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:52.866696 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:52.874082 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:52.888754 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:52.888754 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:52.888754 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:52.888754 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:52.888754 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:52.888754 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:52.888754 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:06:52.889495 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:52.889495 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:52.889495 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:52.889495 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:52.889495 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:52.889495 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:52.889495 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:06:52.889883 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:52.889883 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:52.889883 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:52.889883 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:52.889883 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:52.889883 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:52.889883 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:06:52.892070 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:52.892070 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:52.892070 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:52.892070 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:52.892070 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:52.892070 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:52.892070 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:06:52.928030 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:06:52.928817 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:06:52.937416 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435, portal: 192.168.40.100,3260]
May 21 02:06:52.937416 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435, portal: 192.168.40.100,3260] successful.
May 21 02:06:52.937416 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:52.942398 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:06:52.942398 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fee1:2e46', 'fe80::2482:bff:fe1b:902b', 'fe80::fc16:3eff:fe0f:28a1', 'fe80::440a:38ff:fe27:fa24', 'fe80::fc16:3eff:fe91:3d5c', 'fe80::a4db:73ff:fe81:949b', 'fe80::fc16:3eff:fefb:4d96', 'fe80::fc16:3eff:fe68:a810', 'fe80::3cc0:a4ff:feab:836e', 'fe80::fc16:3eff:fe65:6557', 'fe80::fc16:3eff:fecc:c295'] 
May 21 02:06:52.942398 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:06:52.942398 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:06:52.942398 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:06:52.942765 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Updating existing volume attachment record: 4115dc87-a760-4395-9d58-5798cde4b0e5 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:06:52.951722 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435, portal: 192.168.50.100,3260]
May 21 02:06:52.951722 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435, portal: 192.168.50.100,3260] successful.
May 21 02:06:52.951722 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:52.957212 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:52.971462 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:52.985981 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:52.985981 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:52.985981 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:52.985981 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:52.985981 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:06:52.985981 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:06:52.985981 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:52.985981 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:52.985981 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:06:52.986238 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:52.986238 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:52.986238 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:52.986238 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:52.986238 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:06:52.986238 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:06:52.986238 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:52.986238 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:52.986238 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:06:52.988992 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.218s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:06:52.989277 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:06:52.990398 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] HCTL ('11', '-', '-', 0) found on session 114 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:06:52.990585 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:06:52.992628 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:52.992628 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:52.992628 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:52.992628 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:52.992628 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:06:52.992628 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:06:52.992628 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:52.992628 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:52.992628 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:06:52.992820 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:52.992820 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:52.992820 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:52.992820 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:52.992820 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:06:52.992820 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:06:52.992820 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:52.992820 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:52.992820 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:06:52.995868 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.224s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:06:52.995868 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:06:52.995868 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] HCTL ('12', '-', '-', 0) found on session 115 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:06:52.995868 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:06:53.009108 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Searching for a device in session 114 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:06:53.009108 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ece91188-02a7-416e-acb0-f751583ab435', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:06:53.020640 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Searching for a device in session 115 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:06:53.020640 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ece91188-02a7-416e-acb0-f751583ab435', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:06:53.134398 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "refresh_cache-609b1611-3b05-4b86-8bf3-85f16f199d80" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:06:53.195520 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-1c2d5370-194b-4526-82e5-107d5551e10a req-80468e25-b748-4732-b9b8-a14ecb387358 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:06:53.241660 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c34ef68-490d-42c1-8e1a-1913b3b183e7/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:53.290974 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-1c2d5370-194b-4526-82e5-107d5551e10a req-80468e25-b748-4732-b9b8-a14ecb387358 service nova] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:06:53.313587 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:53.371131 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c34ef68-490d-42c1-8e1a-1913b3b183e7/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:06:53.371708 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c34ef68-490d-42c1-8e1a-1913b3b183e7/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:53.478355 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c34ef68-490d-42c1-8e1a-1913b3b183e7/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:06:53.483164 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9a1a2a-77bd-4fe9-ae88-344c193980f5/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:53.507292 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-1c2d5370-194b-4526-82e5-107d5551e10a req-80468e25-b748-4732-b9b8-a14ecb387358 service nova] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:06:53.585701 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9a1a2a-77bd-4fe9-ae88-344c193980f5/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:06:53.586895 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9a1a2a-77bd-4fe9-ae88-344c193980f5/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:53.700852 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9a1a2a-77bd-4fe9-ae88-344c193980f5/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:06:53.700852 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:06:53.707600 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b4239c5-84df-4d87-a2d4-fb6192408f58/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:53.769454 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:06:53.825138 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b4239c5-84df-4d87-a2d4-fb6192408f58/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:06:53.825582 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b4239c5-84df-4d87-a2d4-fb6192408f58/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:53.920482 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b4239c5-84df-4d87-a2d4-fb6192408f58/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:06:53.927971 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-8 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:06:53.930334 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:54.013757 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1c2d5370-194b-4526-82e5-107d5551e10a req-80468e25-b748-4732-b9b8-a14ecb387358 service nova] Releasing lock "refresh_cache-609b1611-3b05-4b86-8bf3-85f16f199d80" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:06:54.014611 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquired lock "refresh_cache-609b1611-3b05-4b86-8bf3-85f16f199d80" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:06:54.014882 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:06:54.040503 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:06:54.047410 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:54.128150 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:06:54.129017 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:06:54.163446 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:06:54.166850 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6df4554-8490-4d5a-9d4d-acfd46419cb3/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:54.259245 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6df4554-8490-4d5a-9d4d-acfd46419cb3/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:06:54.259716 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6df4554-8490-4d5a-9d4d-acfd46419cb3/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:54.353687 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6df4554-8490-4d5a-9d4d-acfd46419cb3/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:06:54.358746 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:06:54.360653 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:06:54.361966 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:54.411664 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "env LANG=C uptime" returned: 0 in 0.049s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:06:54.412920 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Hypervisor/Node resource view: name=np0000001127 free_ram=11928MB free_disk=73.02070236206055GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 21 02:06:54.413177 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:54.590015 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:06:54.633361 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:06:54.789412 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Found WWN 330000000ea85bcea for multipath device dm-4 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:06:54.790094 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.045s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:06:54.790271 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] <== connect_volume: return (3045ms) {'type': 'block', 'scsi_wwn': '330000000ea85bcea', 'path': '/dev/dm-4', 'multipath_id': '330000000ea85bcea'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:06:54.790495 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ea85bcea', 'path': '/dev/dm-4', 'multipath_id': '330000000ea85bcea'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:06:54.801082 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:06:54.964195 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Updating instance_info_cache with network_info: [{"id": "58f0082f-9f4d-42c5-9569-faf668cc281d", "address": "fa:16:3e:97:bd:d9", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f0082f-9f", "ovs_interfaceid": "58f0082f-9f4d-42c5-9569-faf668cc281d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:06:55.107506 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:06:55.107506 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:06:55.107506 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Creating image(s)
May 21 02:06:55.107506 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Did not create local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 21 02:06:55.107506 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Ensure instance console log exists: /opt/stack/data/nova/instances/609b1611-3b05-4b86-8bf3-85f16f199d80/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:06:55.108035 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:55.109692 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:55.109943 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:55.142478 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.936s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:55.143497 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.730s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:55.143721 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:06:55.151021 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:06:55.151211 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Claim successful on node np0000001127
May 21 02:06:55.299214 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:06:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-891374816',display_name='tempest-TestVolumeBootPatternV346-server-891374816',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpatternv346-server-891374816',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBclrTkdYWcg7wYv1sFfFNpc1Ib37K10WPzdS5tiiV8cvq1InEqjgIitIWUAZpitwxd9II4iGKxlZmi34SZNU4+GgmWYChQfrkginL0AO/ukukJQYm1189+G1jlwKhhLfw==',key_name='tempest-keypair-1297469579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89e0ea7da0f244aab58f9da579e53864',ramdisk_id='',reservation_id='r-im1o600w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1354384974',owner_user_name='tempest-TestVolumeBootPatternV346-1354384974-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:06:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0083b33595414e5e8a3a80e7fea274ba',uuid=feb908f9-10aa-4ba0-8289-c76a3a6279c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59724ac9-1c92-4fdf-a5c9-de82a9453bc6", "address": "fa:16:3e:f5:8e:ad", "network": {"id": "460fd532-ef54-4f63-922b-b9d9f73f665f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1504169250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89e0ea7da0f244aab58f9da579e53864", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap59724ac9-1c", "ovs_interfaceid": "59724ac9-1c92-4fdf-a5c9-de82a9453bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:06:55.299475 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Converting VIF {"id": "59724ac9-1c92-4fdf-a5c9-de82a9453bc6", "address": "fa:16:3e:f5:8e:ad", "network": {"id": "460fd532-ef54-4f63-922b-b9d9f73f665f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1504169250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89e0ea7da0f244aab58f9da579e53864", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap59724ac9-1c", "ovs_interfaceid": "59724ac9-1c92-4fdf-a5c9-de82a9453bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:06:55.300269 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:8e:ad,bridge_name='br-int',has_traffic_filtering=True,id=59724ac9-1c92-4fdf-a5c9-de82a9453bc6,network=Network(460fd532-ef54-4f63-922b-b9d9f73f665f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59724ac9-1c') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:06:55.301199 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lazy-loading 'pci_devices' on Instance uuid feb908f9-10aa-4ba0-8289-c76a3a6279c7 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:06:55.466162 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Releasing lock "refresh_cache-609b1611-3b05-4b86-8bf3-85f16f199d80" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:06:55.466461 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Instance network_info: |[{"id": "58f0082f-9f4d-42c5-9569-faf668cc281d", "address": "fa:16:3e:97:bd:d9", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f0082f-9f", "ovs_interfaceid": "58f0082f-9f4d-42c5-9569-faf668cc281d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:06:55.467494 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Start _get_guest_xml network_info=[{"id": "58f0082f-9f4d-42c5-9569-faf668cc281d", "address": "fa:16:3e:97:bd:d9", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f0082f-9f", "ovs_interfaceid": "58f0082f-9f4d-42c5-9569-faf668cc281d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36', 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9e45da95-d0bd-4a28-859f-96496102cc36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '609b1611-3b05-4b86-8bf3-85f16f199d80', 'attached_at': '', 'detached_at': '', 'volume_id': '9e45da95-d0bd-4a28-859f-96496102cc36', 'serial': '9e45da95-d0bd-4a28-859f-96496102cc36'}, 'delete_on_termination': False, 'attachment_id': '4115dc87-a760-4395-9d58-5798cde4b0e5', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:06:55.472059 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:06:55.472059 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-269447234', uuid='609b1611-3b05-4b86-8bf3-85f16f199d80'), owner=OwnerMeta(userid='4878b5a5bf184852a9ce383caa1c67a4', username='tempest-TestVolumeBootPattern-1995806391-project-member', projectid='62ebdb16aee84e22a88dfc8960debd32', projectname='tempest-TestVolumeBootPattern-1995806391'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "58f0082f-9f4d-42c5-9569-faf668cc281d", "address": "fa:16:3e:97:bd:d9", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f0082f-9f", "ovs_interfaceid": "58f0082f-9f4d-42c5-9569-faf668cc281d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329215.4712656) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:06:55.473190 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:06:55.473709 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:06:55.475652 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:06:55.475961 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:06:55.477129 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:06:55.477538 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:06:55.477824 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:06:55.478019 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:06:55.478427 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:06:55.478598 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:06:55.478771 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:06:55.478991 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:06:55.479288 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:06:55.479715 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:06:55.479963 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:06:55.480185 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:06:55.490738 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:06:55.491443 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36', 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9e45da95-d0bd-4a28-859f-96496102cc36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:06:55.491443 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:06:55.492103 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:06:55.493085 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36', 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9e45da95-d0bd-4a28-859f-96496102cc36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:06:55.496410 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:55.504975 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:06:55.505568 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:06:55.505985 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:06:55.506297 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:06:55.506918 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:06:55.507116 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:06:55.523488 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:06:55.523488 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:55.528974 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:06:55.528974 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:55.534409 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36] added
May 21 02:06:55.534409 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:06:55.534409 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:06:55.534409 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:06:55.534409 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:06:55.534409 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:06:55.534409 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:55.534690 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:06:55.534778 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0285(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:06:55.534950 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:06:55.543489 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36] added
May 21 02:06:55.543489 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:06:55.543489 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:06:55.543489 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:06:55.543489 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:06:55.543489 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:06:55.543489 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:55.543752 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:06:55.543799 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0367(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:06:55.543950 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:06:55.669003 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:06:55.669188 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:06:55.669496 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:06:55.669752 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:06:55.766894 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '64aaf3f477c745199d5b7f171309b623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72317ce75214e619a14739991461c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:06:55.806492 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] End _get_guest_xml xml=<domain type="qemu">
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:   <uuid>feb908f9-10aa-4ba0-8289-c76a3a6279c7</uuid>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:   <name>instance-00000033</name>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:       <nova:name>tempest-TestVolumeBootPatternV346-server-891374816</nova:name>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:06:51</nova:creationTime>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:       <nova:image uuid="">
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:         <nova:user uuid="0083b33595414e5e8a3a80e7fea274ba">tempest-TestVolumeBootPatternV346-1354384974-project-member</nova:user>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:         <nova:project uuid="89e0ea7da0f244aab58f9da579e53864">tempest-TestVolumeBootPatternV346-1354384974</nova:project>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:       <nova:root type="volume" uuid=""/>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:         <nova:port uuid="59724ac9-1c92-4fdf-a5c9-de82a9453bc6">
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:     <system>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:       <entry name="serial">feb908f9-10aa-4ba0-8289-c76a3a6279c7</entry>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:       <entry name="uuid">feb908f9-10aa-4ba0-8289-c76a3a6279c7</entry>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:     </system>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:   <os>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:   </os>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:   <features>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:   </features>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:   <devices>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/feb908f9-10aa-4ba0-8289-c76a3a6279c7/disk.config"/>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:     </disk>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:       <alias name="ua-ece91188-02a7-416e-acb0-f751583ab435"/>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-4"/>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:       <serial>ece91188-02a7-416e-acb0-f751583ab435</serial>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:     </disk>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:f5:8e:ad"/>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:       <target dev="tap59724ac9-1c"/>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:     </interface>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/feb908f9-10aa-4ba0-8289-c76a3a6279c7/console.log" append="off"/>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:     </serial>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:     <video>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:     </video>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:     </rng>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:   </devices>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]: </domain>
May 21 02:06:55.806492 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:06:55.806492 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Preparing to wait for external event network-vif-plugged-59724ac9-1c92-4fdf-a5c9-de82a9453bc6 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:06:55.806492 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Acquiring lock "feb908f9-10aa-4ba0-8289-c76a3a6279c7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:55.806492 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "feb908f9-10aa-4ba0-8289-c76a3a6279c7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:55.806492 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "feb908f9-10aa-4ba0-8289-c76a3a6279c7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:55.806492 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:06:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-891374816',display_name='tempest-TestVolumeBootPatternV346-server-891374816',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpatternv346-server-891374816',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBclrTkdYWcg7wYv1sFfFNpc1Ib37K10WPzdS5tiiV8cvq1InEqjgIitIWUAZpitwxd9II4iGKxlZmi34SZNU4+GgmWYChQfrkginL0AO/ukukJQYm1189+G1jlwKhhLfw==',key_name='tempest-keypair-1297469579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89e0ea7da0f244aab58f9da579e53864',ramdisk_id='',reservation_id='r-im1o600w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1354384974',owner_user_name='tempest-TestVolumeBootPatternV346-1354384974-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:06:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0083b33595414e5e8a3a80e7fea274ba',uuid=feb908f9-10aa-4ba0-8289-c76a3a6279c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59724ac9-1c92-4fdf-a5c9-de82a9453bc6", "address": "fa:16:3e:f5:8e:ad", "network": {"id": "460fd532-ef54-4f63-922b-b9d9f73f665f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1504169250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89e0ea7da0f244aab58f9da579e53864", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap59724ac9-1c", "ovs_interfaceid": "59724ac9-1c92-4fdf-a5c9-de82a9453bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:06:55.806492 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Converting VIF {"id": "59724ac9-1c92-4fdf-a5c9-de82a9453bc6", "address": "fa:16:3e:f5:8e:ad", "network": {"id": "460fd532-ef54-4f63-922b-b9d9f73f665f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1504169250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89e0ea7da0f244aab58f9da579e53864", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap59724ac9-1c", "ovs_interfaceid": "59724ac9-1c92-4fdf-a5c9-de82a9453bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:06:55.810398 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:8e:ad,bridge_name='br-int',has_traffic_filtering=True,id=59724ac9-1c92-4fdf-a5c9-de82a9453bc6,network=Network(460fd532-ef54-4f63-922b-b9d9f73f665f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59724ac9-1c') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:06:55.810398 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:8e:ad,bridge_name='br-int',has_traffic_filtering=True,id=59724ac9-1c92-4fdf-a5c9-de82a9453bc6,network=Network(460fd532-ef54-4f63-922b-b9d9f73f665f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59724ac9-1c') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:06:55.810398 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:55.810398 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:06:55.810398 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:06:55.810398 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:55.810398 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6fc5640b-efa6-59c5-910c-e57ff68a5b9d', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:06:55.820204 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:55.821975 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:06:55.824269 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:55.824567 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59724ac9-1c, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:06:55.825074 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap59724ac9-1c, col_values=(('qos', UUID('2bed4f88-c9ce-4c0f-a2d9-ddffd75aaf56')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:06:55.825355 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap59724ac9-1c, col_values=(('external_ids', {'iface-id': '59724ac9-1c92-4fdf-a5c9-de82a9453bc6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:8e:ad', 'vm-uuid': 'feb908f9-10aa-4ba0-8289-c76a3a6279c7'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:06:55.826364 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:55.828381 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:06:55.832328 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:55.833874 np0000001127 nova-compute[98206]: INFO os_vif [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:8e:ad,bridge_name='br-int',has_traffic_filtering=True,id=59724ac9-1c92-4fdf-a5c9-de82a9453bc6,network=Network(460fd532-ef54-4f63-922b-b9d9f73f665f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59724ac9-1c')
May 21 02:06:56.172298 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:06:56.325904 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Successfully created port: b3b7dd36-e770-402c-88ef-e5a90396d71f {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:06:56.535703 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:06:56.544379 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:06:56.554665 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:06:56.554665 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:06:56.564170 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:06:56.564170 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:56.571005 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:56.581500 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:56.591891 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:56.591891 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:56.591891 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:56.591891 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:56.591891 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:06:56.591891 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:06:56.591891 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:56.591891 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:56.591891 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:06:56.592152 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:56.592152 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:56.592152 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:56.592152 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:56.592152 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:06:56.592152 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:06:56.592152 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:56.592152 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:56.592152 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:06:56.603645 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:56.603645 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:56.603645 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:56.603645 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:56.603645 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:06:56.603645 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:06:56.603645 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:56.603645 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:56.603645 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:06:56.604070 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:56.604070 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:56.604070 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:56.604070 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:56.604070 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:06:56.604070 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:06:56.604070 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:56.604070 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:56.604070 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:06:56.630974 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:56.657757 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36, portal: 192.168.40.100,3260]
May 21 02:06:56.657757 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36, portal: 192.168.40.100,3260] successful.
May 21 02:06:56.657757 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:56.671013 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:56.679336 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36, portal: 192.168.50.100,3260]
May 21 02:06:56.679336 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36, portal: 192.168.50.100,3260] successful.
May 21 02:06:56.679336 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:56.683410 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:06:56.691508 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:56.691508 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:56.691508 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:56.691508 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:56.691508 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:06:56.691508 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:06:56.691508 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:06:56.691508 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:06:56.691508 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:56.691508 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:56.691508 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:06:56.691508 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:56.691508 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:56.691508 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:56.691508 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:56.691508 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:06:56.691508 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:06:56.691508 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:06:56.691508 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:06:56.691508 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:56.691508 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:56.691508 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:06:56.691508 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.186s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:06:56.692136 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:06:56.692946 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] HCTL ('13', '-', '-', 0) found on session 116 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:06:56.692946 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:06:56.693485 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:06:56.721887 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching for a device in session 116 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:06:56.721887 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9e45da95-d0bd-4a28-859f-96496102cc36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:06:56.724960 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:56.724960 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:56.724960 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:56.724960 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:56.724960 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:06:56.724960 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:06:56.724960 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:06:56.724960 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:06:56.724960 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:56.724960 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:56.724960 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:06:56.726118 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:56.726118 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:06:56.726118 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:56.726118 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:06:56.726118 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:06:56.726118 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:06:56.726118 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:06:56.726118 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:06:56.726118 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:56.726118 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:06:56.726118 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:06:56.726118 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.219s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:06:56.726118 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:06:56.729881 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] HCTL ('14', '-', '-', 0) found on session 117 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:06:56.730060 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:06:56.753658 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching for a device in session 117 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:06:56.753658 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9e45da95-d0bd-4a28-859f-96496102cc36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:06:56.958299 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:06:56.958299 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:06:57.139835 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Successfully updated port: b3b7dd36-e770-402c-88ef-e5a90396d71f {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:06:57.195333 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-4d142447-980f-4356-8cd1-391739cb3234 req-630cdfb6-0ad0-4fed-a786-af0c9415cb2a service nova] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Received event network-changed-b3b7dd36-e770-402c-88ef-e5a90396d71f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:06:57.195333 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-4d142447-980f-4356-8cd1-391739cb3234 req-630cdfb6-0ad0-4fed-a786-af0c9415cb2a service nova] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Refreshing instance network info cache due to event network-changed-b3b7dd36-e770-402c-88ef-e5a90396d71f. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:06:57.195333 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4d142447-980f-4356-8cd1-391739cb3234 req-630cdfb6-0ad0-4fed-a786-af0c9415cb2a service nova] Acquiring lock "refresh_cache-b646159a-f806-487d-8a14-0aa8e2438f2b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:06:57.195333 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4d142447-980f-4356-8cd1-391739cb3234 req-630cdfb6-0ad0-4fed-a786-af0c9415cb2a service nova] Acquired lock "refresh_cache-b646159a-f806-487d-8a14-0aa8e2438f2b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:06:57.195333 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-4d142447-980f-4356-8cd1-391739cb3234 req-630cdfb6-0ad0-4fed-a786-af0c9415cb2a service nova] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Refreshing network info cache for port b3b7dd36-e770-402c-88ef-e5a90396d71f {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:06:57.356291 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:06:57.356357 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:06:57.356456 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] No VIF found with MAC fa:16:3e:f5:8e:ad, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:06:57.356782 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Using config drive
May 21 02:06:57.463516 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:06:57.507106 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:06:57.642982 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Acquiring lock "refresh_cache-b646159a-f806-487d-8a14-0aa8e2438f2b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:06:57.701296 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-4d142447-980f-4356-8cd1-391739cb3234 req-630cdfb6-0ad0-4fed-a786-af0c9415cb2a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:06:57.704500 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:06:57.705683 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:06:57.706953 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Creating image(s)
May 21 02:06:57.706953 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Acquiring lock "/opt/stack/data/nova/instances/b646159a-f806-487d-8a14-0aa8e2438f2b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:57.706953 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "/opt/stack/data/nova/instances/b646159a-f806-487d-8a14-0aa8e2438f2b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:57.706953 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "/opt/stack/data/nova/instances/b646159a-f806-487d-8a14-0aa8e2438f2b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:57.707169 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Acquiring lock "6f0c185f301d555136d7070b29d747a62ebb105f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:57.707452 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "6f0c185f301d555136d7070b29d747a62ebb105f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:57.796823 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-4d142447-980f-4356-8cd1-391739cb3234 req-630cdfb6-0ad0-4fed-a786-af0c9415cb2a service nova] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:06:57.871258 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:06:57.971125 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.828s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:57.971125 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:06:57.973915 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 3.561s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:57.997125 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-4d142447-980f-4356-8cd1-391739cb3234 req-630cdfb6-0ad0-4fed-a786-af0c9415cb2a service nova] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:06:58.021739 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Creating config drive at /opt/stack/data/nova/instances/feb908f9-10aa-4ba0-8289-c76a3a6279c7/disk.config
May 21 02:06:58.033666 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/feb908f9-10aa-4ba0-8289-c76a3a6279c7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzpnpmlkd {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:58.100528 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/feb908f9-10aa-4ba0-8289-c76a3a6279c7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzpnpmlkd" returned: 0 in 0.067s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:06:58.281113 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:58.493088 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:06:58.493612 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:06:58.497388 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:06:58.497388 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:06:58.500551 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4d142447-980f-4356-8cd1-391739cb3234 req-630cdfb6-0ad0-4fed-a786-af0c9415cb2a service nova] Releasing lock "refresh_cache-b646159a-f806-487d-8a14-0aa8e2438f2b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:06:58.501913 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Acquired lock "refresh_cache-b646159a-f806-487d-8a14-0aa8e2438f2b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:06:58.502572 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:06:58.524126 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Found WWN 330000000bcd06062 for multipath device dm-7 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:06:58.525563 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:06:58.525563 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '330000000bcd06062', 'path': '/dev/dm-7', 'multipath_id': '330000000bcd06062'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:06:58.525563 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000bcd06062', 'path': '/dev/dm-7', 'multipath_id': '330000000bcd06062'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:06:58.604881 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '049d6c8cccfa4ae38d78a88ef5be0f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848912b0c0e94d2795bb2332daf1730e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:06:58.632141 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:58.664419 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:58.664419 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:58.788730 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:58.852590 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:06:58.859607 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:06:58.859764 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f0c185f301d555136d7070b29d747a62ebb105f.part --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:58.882790 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:58.955088 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f0c185f301d555136d7070b29d747a62ebb105f.part --force-share --output=json" returned: 0 in 0.095s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:06:58.955668 np0000001127 nova-compute[98206]: DEBUG nova.virt.images [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] cdde4299-39d3-4183-b073-d9779fd9433a was qcow2, converting to raw {{(pid=98206) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 21 02:06:58.958181 np0000001127 nova-compute[98206]: DEBUG nova.privsep.utils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 21 02:06:58.958305 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6f0c185f301d555136d7070b29d747a62ebb105f.part /opt/stack/data/nova/instances/_base/6f0c185f301d555136d7070b29d747a62ebb105f.converted {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:59.003252 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b5690796-0b6a-495a-a9c2-2c15dc4177a5 req-90cbc501-00af-47eb-9fdb-333ee8e61104 service nova] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Received event network-vif-plugged-59724ac9-1c92-4fdf-a5c9-de82a9453bc6 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:06:59.013614 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:06:59.018741 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b5690796-0b6a-495a-a9c2-2c15dc4177a5 req-90cbc501-00af-47eb-9fdb-333ee8e61104 service nova] Acquiring lock "feb908f9-10aa-4ba0-8289-c76a3a6279c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:59.020859 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b5690796-0b6a-495a-a9c2-2c15dc4177a5 req-90cbc501-00af-47eb-9fdb-333ee8e61104 service nova] Lock "feb908f9-10aa-4ba0-8289-c76a3a6279c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.009s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:59.021058 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b5690796-0b6a-495a-a9c2-2c15dc4177a5 req-90cbc501-00af-47eb-9fdb-333ee8e61104 service nova] Lock "feb908f9-10aa-4ba0-8289-c76a3a6279c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:59.021196 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b5690796-0b6a-495a-a9c2-2c15dc4177a5 req-90cbc501-00af-47eb-9fdb-333ee8e61104 service nova] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Processing event network-vif-plugged-59724ac9-1c92-4fdf-a5c9-de82a9453bc6 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:06:59.036231 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:06:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-269447234',display_name='tempest-TestVolumeBootPattern-server-269447234',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpattern-server-269447234',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD77pimAV1eFekdNNNwkDDYOspV1DjTEfg3EMaUFkrngdEQ/pxsYYNODb0KKjbXdzAIBQimySPjMk1dUCykAebV38iqHCRucGJu9wI9IqvxnrGnYQ91hkWS0RnG0pTDGQA==',key_name='tempest-keypair-251449393',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62ebdb16aee84e22a88dfc8960debd32',ramdisk_id='',reservation_id='r-b8d3jixu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1995806391',owner_user_name='tempest-TestVolumeBootPattern-1995806391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:06:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4878b5a5bf184852a9ce383caa1c67a4',uuid=609b1611-3b05-4b86-8bf3-85f16f199d80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58f0082f-9f4d-42c5-9569-faf668cc281d", "address": "fa:16:3e:97:bd:d9", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f0082f-9f", "ovs_interfaceid": "58f0082f-9f4d-42c5-9569-faf668cc281d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:06:59.039490 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converting VIF {"id": "58f0082f-9f4d-42c5-9569-faf668cc281d", "address": "fa:16:3e:97:bd:d9", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f0082f-9f", "ovs_interfaceid": "58f0082f-9f4d-42c5-9569-faf668cc281d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:06:59.039490 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:bd:d9,bridge_name='br-int',has_traffic_filtering=True,id=58f0082f-9f4d-42c5-9569-faf668cc281d,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58f0082f-9f') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:06:59.039490 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lazy-loading 'pci_devices' on Instance uuid 609b1611-3b05-4b86-8bf3-85f16f199d80 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:06:59.103656 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 0b9a1a2a-77bd-4fe9-ae88-344c193980f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:06:59.103656 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 6ccaedfe-bec9-4591-b845-acf0cc81d026 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:06:59.103656 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 9b4239c5-84df-4d87-a2d4-fb6192408f58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:06:59.103656 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 45f01b41-a43c-4ddf-aa07-22f8c2c50758 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:06:59.103848 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 16a0cc8d-c65b-4166-ad1a-5318b18ed00e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:06:59.104041 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance b6df4554-8490-4d5a-9d4d-acfd46419cb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:06:59.104041 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 5c34ef68-490d-42c1-8e1a-1913b3b183e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:06:59.104279 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance feb908f9-10aa-4ba0-8289-c76a3a6279c7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:06:59.104279 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 609b1611-3b05-4b86-8bf3-85f16f199d80 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:06:59.104279 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance b646159a-f806-487d-8a14-0aa8e2438f2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:06:59.104536 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance aa3f5a78-fb82-4e21-8ebf-90bf48a122be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:06:59.104617 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 21 02:06:59.104766 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Final resource view: name=np0000001127 phys_ram=24030MB used_ram=2624MB phys_disk=95GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:06:54 up 37 min,  2 users,  load average: 10.52, 9.35, 5.73\n', 'num_instances': '11', 'num_vm_active': '7', 'num_task_None': '8', 'num_os_type_None': '11', 'num_proj_d3efe4046d6a442d91b3463e2d99fd7b': '2', 'io_workload': '4', 'num_proj_848912b0c0e94d2795bb2332daf1730e': '4', 'num_proj_b72317ce75214e619a14739991461c95': '2', 'num_proj_89e0ea7da0f244aab58f9da579e53864': '2', 'num_vm_building': '4', 'num_task_spawning': '3', 'num_proj_62ebdb16aee84e22a88dfc8960debd32': '1'} {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 21 02:06:59.229297 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:06:59.350103 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6f0c185f301d555136d7070b29d747a62ebb105f.part /opt/stack/data/nova/instances/_base/6f0c185f301d555136d7070b29d747a62ebb105f.converted" returned: 0 in 0.392s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:06:59.366329 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f0c185f301d555136d7070b29d747a62ebb105f.converted --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:59.446579 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:06:59.510487 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f0c185f301d555136d7070b29d747a62ebb105f.converted --force-share --output=json" returned: 0 in 0.145s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:06:59.512591 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "6f0c185f301d555136d7070b29d747a62ebb105f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.805s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:59.514149 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:06:59.520710 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:06:59.522234 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:06:59.537897 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f0c185f301d555136d7070b29d747a62ebb105f --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:59.562537 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] End _get_guest_xml xml=<domain type="qemu">
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:   <uuid>609b1611-3b05-4b86-8bf3-85f16f199d80</uuid>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:   <name>instance-00000034</name>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:       <nova:name>tempest-TestVolumeBootPattern-server-269447234</nova:name>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:06:55</nova:creationTime>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:       <nova:image uuid="">
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:         <nova:user uuid="4878b5a5bf184852a9ce383caa1c67a4">tempest-TestVolumeBootPattern-1995806391-project-member</nova:user>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:         <nova:project uuid="62ebdb16aee84e22a88dfc8960debd32">tempest-TestVolumeBootPattern-1995806391</nova:project>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:       <nova:root type="volume" uuid=""/>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:         <nova:port uuid="58f0082f-9f4d-42c5-9569-faf668cc281d">
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:     <system>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:       <entry name="serial">609b1611-3b05-4b86-8bf3-85f16f199d80</entry>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:       <entry name="uuid">609b1611-3b05-4b86-8bf3-85f16f199d80</entry>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:     </system>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:   <os>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:   </os>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:   <features>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:   </features>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:   <devices>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/609b1611-3b05-4b86-8bf3-85f16f199d80/disk.config"/>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:     </disk>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:       <alias name="ua-9e45da95-d0bd-4a28-859f-96496102cc36"/>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-7"/>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:       <serial>9e45da95-d0bd-4a28-859f-96496102cc36</serial>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:     </disk>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:97:bd:d9"/>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:       <target dev="tap58f0082f-9f"/>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:     </interface>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/609b1611-3b05-4b86-8bf3-85f16f199d80/console.log" append="off"/>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:     </serial>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:     <video>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:     </video>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:     </rng>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:   </devices>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]: </domain>
May 21 02:06:59.562537 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:06:59.572193 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Preparing to wait for external event network-vif-plugged-58f0082f-9f4d-42c5-9569-faf668cc281d {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:06:59.572193 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "609b1611-3b05-4b86-8bf3-85f16f199d80-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:59.572193 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "609b1611-3b05-4b86-8bf3-85f16f199d80-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:59.572193 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "609b1611-3b05-4b86-8bf3-85f16f199d80-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:59.572193 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:06:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-269447234',display_name='tempest-TestVolumeBootPattern-server-269447234',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpattern-server-269447234',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD77pimAV1eFekdNNNwkDDYOspV1DjTEfg3EMaUFkrngdEQ/pxsYYNODb0KKjbXdzAIBQimySPjMk1dUCykAebV38iqHCRucGJu9wI9IqvxnrGnYQ91hkWS0RnG0pTDGQA==',key_name='tempest-keypair-251449393',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62ebdb16aee84e22a88dfc8960debd32',ramdisk_id='',reservation_id='r-b8d3jixu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1995806391',owner_user_name='tempest-TestVolumeBootPattern-1995806391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:06:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4878b5a5bf184852a9ce383caa1c67a4',uuid=609b1611-3b05-4b86-8bf3-85f16f199d80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58f0082f-9f4d-42c5-9569-faf668cc281d", "address": "fa:16:3e:97:bd:d9", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f0082f-9f", "ovs_interfaceid": "58f0082f-9f4d-42c5-9569-faf668cc281d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:06:59.572193 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converting VIF {"id": "58f0082f-9f4d-42c5-9569-faf668cc281d", "address": "fa:16:3e:97:bd:d9", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f0082f-9f", "ovs_interfaceid": "58f0082f-9f4d-42c5-9569-faf668cc281d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:06:59.572193 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:bd:d9,bridge_name='br-int',has_traffic_filtering=True,id=58f0082f-9f4d-42c5-9569-faf668cc281d,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58f0082f-9f') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:06:59.572193 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:bd:d9,bridge_name='br-int',has_traffic_filtering=True,id=58f0082f-9f4d-42c5-9569-faf668cc281d,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58f0082f-9f') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:06:59.572193 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:59.578045 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:06:59.579172 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:06:59.586928 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Successfully created port: 2b286fbf-a6fe-4dcc-af12-2521cf154dbb {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:06:59.591828 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:59.592137 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '72be94b1-87b8-5b13-932f-ec67b1b675a6', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:06:59.594295 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:59.598232 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:59.598493 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58f0082f-9f, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:06:59.600207 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap58f0082f-9f, col_values=(('qos', UUID('d4ea99b8-22ed-4a46-ab8d-e19ba443f067')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:06:59.600207 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap58f0082f-9f, col_values=(('external_ids', {'iface-id': '58f0082f-9f4d-42c5-9569-faf668cc281d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:bd:d9', 'vm-uuid': '609b1611-3b05-4b86-8bf3-85f16f199d80'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:06:59.601775 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:59.603738 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:06:59.608749 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:06:59.611237 np0000001127 nova-compute[98206]: INFO os_vif [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:bd:d9,bridge_name='br-int',has_traffic_filtering=True,id=58f0082f-9f4d-42c5-9569-faf668cc281d,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58f0082f-9f')
May 21 02:06:59.651742 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f0c185f301d555136d7070b29d747a62ebb105f --force-share --output=json" returned: 0 in 0.125s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:06:59.655446 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Acquiring lock "6f0c185f301d555136d7070b29d747a62ebb105f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:59.655446 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "6f0c185f301d555136d7070b29d747a62ebb105f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:59.655446 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:06:59.655737 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:06:59.659493 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f0c185f301d555136d7070b29d747a62ebb105f --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:59.697319 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Updating instance_info_cache with network_info: [{"id": "b3b7dd36-e770-402c-88ef-e5a90396d71f", "address": "fa:16:3e:dc:c2:65", "network": {"id": "0618d411-0f50-4ee4-80a9-cbd395ea2c77", "bridge": "br-int", "label": "tempest-TestStampPattern-1490281843-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b72317ce75214e619a14739991461c95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b7dd36-e7", "ovs_interfaceid": "b3b7dd36-e770-402c-88ef-e5a90396d71f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:06:59.767458 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329219.7668245, feb908f9-10aa-4ba0-8289-c76a3a6279c7 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:06:59.768601 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:06:59.772414 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] VM Started (Lifecycle Event)
May 21 02:06:59.773961 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f0c185f301d555136d7070b29d747a62ebb105f --force-share --output=json" returned: 0 in 0.117s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:06:59.774846 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6f0c185f301d555136d7070b29d747a62ebb105f,backing_fmt=raw /opt/stack/data/nova/instances/b646159a-f806-487d-8a14-0aa8e2438f2b/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:59.775318 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:06:59.808019 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Instance spawned successfully.
May 21 02:06:59.809092 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:06:59.846444 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6f0c185f301d555136d7070b29d747a62ebb105f,backing_fmt=raw /opt/stack/data/nova/instances/b646159a-f806-487d-8a14-0aa8e2438f2b/disk 1073741824" returned: 0 in 0.071s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:06:59.847188 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "6f0c185f301d555136d7070b29d747a62ebb105f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:59.848060 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f0c185f301d555136d7070b29d747a62ebb105f --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:06:59.944100 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f0c185f301d555136d7070b29d747a62ebb105f --force-share --output=json" returned: 0 in 0.096s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:06:59.946680 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:06:59.947902 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Ensure instance console log exists: /opt/stack/data/nova/instances/b646159a-f806-487d-8a14-0aa8e2438f2b/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:06:59.947902 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:06:59.947902 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:06:59.947902 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:06:59.992028 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:06:59.992028 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:07:00.200909 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Releasing lock "refresh_cache-b646159a-f806-487d-8a14-0aa8e2438f2b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:07:00.201521 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Instance network_info: |[{"id": "b3b7dd36-e770-402c-88ef-e5a90396d71f", "address": "fa:16:3e:dc:c2:65", "network": {"id": "0618d411-0f50-4ee4-80a9-cbd395ea2c77", "bridge": "br-int", "label": "tempest-TestStampPattern-1490281843-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b72317ce75214e619a14739991461c95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b7dd36-e7", "ovs_interfaceid": "b3b7dd36-e770-402c-88ef-e5a90396d71f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:07:00.203765 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Start _get_guest_xml network_info=[{"id": "b3b7dd36-e770-402c-88ef-e5a90396d71f", "address": "fa:16:3e:dc:c2:65", "network": {"id": "0618d411-0f50-4ee4-80a9-cbd395ea2c77", "bridge": "br-int", "label": "tempest-TestStampPattern-1490281843-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b72317ce75214e619a14739991461c95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b7dd36-e7", "ovs_interfaceid": "b3b7dd36-e770-402c-88ef-e5a90396d71f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='ed433fe6f01a0a09e29158c554118ab4',container_format='bare',created_at=2026-05-21T02:06:42Z,direct_url=<?>,disk_format='qcow2',id=cdde4299-39d3-4183-b073-d9779fd9433a,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1186696453',owner='b72317ce75214e619a14739991461c95',properties=ImageMetaProps,protected=<?>,size=53739520,status='active',tags=<?>,updated_at=2026-05-21T02:06:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'cdde4299-39d3-4183-b073-d9779fd9433a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:07:00.207894 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:07:00.209393 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-TestStampPattern-server-53523629', uuid='b646159a-f806-487d-8a14-0aa8e2438f2b'), owner=OwnerMeta(userid='64aaf3f477c745199d5b7f171309b623', username='tempest-TestStampPattern-1911932868-project-member', projectid='b72317ce75214e619a14739991461c95', projectname='tempest-TestStampPattern-1911932868'), image=ImageMeta(id='cdde4299-39d3-4183-b073-d9779fd9433a', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio', 'img_owner_id': 'b72317ce75214e619a14739991461c95'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b3b7dd36-e770-402c-88ef-e5a90396d71f", "address": "fa:16:3e:dc:c2:65", "network": {"id": "0618d411-0f50-4ee4-80a9-cbd395ea2c77", "bridge": "br-int", "label": "tempest-TestStampPattern-1490281843-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b72317ce75214e619a14739991461c95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b7dd36-e7", "ovs_interfaceid": "b3b7dd36-e770-402c-88ef-e5a90396d71f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329220.2089083) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:07:00.210639 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:07:00.211036 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:07:00.211930 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:07:00.211997 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:07:00.213075 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:07:00.213641 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='ed433fe6f01a0a09e29158c554118ab4',container_format='bare',created_at=2026-05-21T02:06:42Z,direct_url=<?>,disk_format='qcow2',id=cdde4299-39d3-4183-b073-d9779fd9433a,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1186696453',owner='b72317ce75214e619a14739991461c95',properties=ImageMetaProps,protected=<?>,size=53739520,status='active',tags=<?>,updated_at=2026-05-21T02:06:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:07:00.213641 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:07:00.213641 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:07:00.213641 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:07:00.214727 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:07:00.214727 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:07:00.214727 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:07:00.214727 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:07:00.214727 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:07:00.214727 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:07:00.214727 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:07:00.226793 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:06:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-53523629',display_name='tempest-TestStampPattern-server-53523629',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-teststamppattern-server-53523629',id=53,image_ref='cdde4299-39d3-4183-b073-d9779fd9433a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGf4TQxcgjp3MdbOkpJAxq/86PTabA2Iwtv0x1R12epynbyJ/FSoqTOYMbbXiHEg1FsyJTACHLRLEZYTIrFk0vHyzvn2kQ5rh2NeRgjlpvVyNBNMpcSWAWoXIY5iI4y9Gg==',key_name='tempest-TestStampPattern-1436185249',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b72317ce75214e619a14739991461c95',ramdisk_id='',reservation_id='r-ir04vejp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9b4239c5-84df-4d87-a2d4-fb6192408f58',image_min_disk='1',image_min_ram='0',image_owner_id='b72317ce75214e619a14739991461c95',image_owner_project_name='tempest-TestStampPattern-1911932868',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1911932868-project-member',image_user_id='64aaf3f477c745199d5b7f171309b623',network_allocated='True',owner_project_name='tempest-TestStampPattern-1911932868',owner_user_name='tempest-TestStampPattern-1911932868-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:06:57Z,user_data=None,user_id='64aaf3f477c745199d5b7f171309b623',uuid=b646159a-f806-487d-8a14-0aa8e2438f2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3b7dd36-e770-402c-88ef-e5a90396d71f", "address": "fa:16:3e:dc:c2:65", "network": {"id": "0618d411-0f50-4ee4-80a9-cbd395ea2c77", "bridge": "br-int", "label": "tempest-TestStampPattern-1490281843-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b72317ce75214e619a14739991461c95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b7dd36-e7", "ovs_interfaceid": "b3b7dd36-e770-402c-88ef-e5a90396d71f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:07:00.227942 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Converting VIF {"id": "b3b7dd36-e770-402c-88ef-e5a90396d71f", "address": "fa:16:3e:dc:c2:65", "network": {"id": "0618d411-0f50-4ee4-80a9-cbd395ea2c77", "bridge": "br-int", "label": "tempest-TestStampPattern-1490281843-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b72317ce75214e619a14739991461c95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b7dd36-e7", "ovs_interfaceid": "b3b7dd36-e770-402c-88ef-e5a90396d71f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:07:00.227942 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:c2:65,bridge_name='br-int',has_traffic_filtering=True,id=b3b7dd36-e770-402c-88ef-e5a90396d71f,network=Network(0618d411-0f50-4ee4-80a9-cbd395ea2c77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3b7dd36-e7') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:07:00.228137 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lazy-loading 'pci_devices' on Instance uuid b646159a-f806-487d-8a14-0aa8e2438f2b {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:07:00.276045 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:07:00.278622 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:07:00.323422 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:00.323621 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:00.323949 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:00.324236 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:00.324520 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:00.325042 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:00.354627 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Successfully updated port: 2b286fbf-a6fe-4dcc-af12-2521cf154dbb {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:07:00.495248 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:07:00.566889 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:07:00.569334 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:07:00.569334 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Creating image(s)
May 21 02:07:00.569334 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "/opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:00.569334 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "/opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:00.569832 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "/opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:00.570912 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:07:00.574611 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:07:00.575979 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:00.674412 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.098s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:00.675070 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:00.675389 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:00.676782 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:07:00.680662 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:07:00.681194 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:00.733262 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] End _get_guest_xml xml=<domain type="qemu">
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:   <uuid>b646159a-f806-487d-8a14-0aa8e2438f2b</uuid>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:   <name>instance-00000035</name>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:       <nova:name>tempest-TestStampPattern-server-53523629</nova:name>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:07:00</nova:creationTime>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:           <nova:property name="hw_machine_type">pc</nova:property>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:           <nova:property name="hw_video_model">virtio</nova:property>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:           <nova:property name="img_owner_id">b72317ce75214e619a14739991461c95</nova:property>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:         <nova:user uuid="64aaf3f477c745199d5b7f171309b623">tempest-TestStampPattern-1911932868-project-member</nova:user>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:         <nova:project uuid="b72317ce75214e619a14739991461c95">tempest-TestStampPattern-1911932868</nova:project>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:         <nova:port uuid="b3b7dd36-e770-402c-88ef-e5a90396d71f">
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:     <system>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:       <entry name="serial">b646159a-f806-487d-8a14-0aa8e2438f2b</entry>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:       <entry name="uuid">b646159a-f806-487d-8a14-0aa8e2438f2b</entry>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:     </system>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:   <os>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:   </os>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:   <features>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:   </features>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:   <devices>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/b646159a-f806-487d-8a14-0aa8e2438f2b/disk"/>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:     </disk>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/b646159a-f806-487d-8a14-0aa8e2438f2b/disk.config"/>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:     </disk>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:dc:c2:65"/>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:       <target dev="tapb3b7dd36-e7"/>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:     </interface>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/b646159a-f806-487d-8a14-0aa8e2438f2b/console.log" append="off"/>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:     </serial>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:     <video>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:     </video>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:     </rng>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:   </devices>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]: </domain>
May 21 02:07:00.733262 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:07:00.737069 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Preparing to wait for external event network-vif-plugged-b3b7dd36-e770-402c-88ef-e5a90396d71f {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:07:00.737069 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Acquiring lock "b646159a-f806-487d-8a14-0aa8e2438f2b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:00.737069 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "b646159a-f806-487d-8a14-0aa8e2438f2b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:00.737069 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "b646159a-f806-487d-8a14-0aa8e2438f2b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:00.737069 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:06:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-53523629',display_name='tempest-TestStampPattern-server-53523629',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-teststamppattern-server-53523629',id=53,image_ref='cdde4299-39d3-4183-b073-d9779fd9433a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGf4TQxcgjp3MdbOkpJAxq/86PTabA2Iwtv0x1R12epynbyJ/FSoqTOYMbbXiHEg1FsyJTACHLRLEZYTIrFk0vHyzvn2kQ5rh2NeRgjlpvVyNBNMpcSWAWoXIY5iI4y9Gg==',key_name='tempest-TestStampPattern-1436185249',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b72317ce75214e619a14739991461c95',ramdisk_id='',reservation_id='r-ir04vejp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9b4239c5-84df-4d87-a2d4-fb6192408f58',image_min_disk='1',image_min_ram='0',image_owner_id='b72317ce75214e619a14739991461c95',image_owner_project_name='tempest-TestStampPattern-1911932868',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1911932868-project-member',image_user_id='64aaf3f477c745199d5b7f171309b623',network_allocated='True',owner_project_name='tempest-TestStampPattern-1911932868',owner_user_name='tempest-TestStampPattern-1911932868-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:06:57Z,user_data=None,user_id='64aaf3f477c745199d5b7f171309b623',uuid=b646159a-f806-487d-8a14-0aa8e2438f2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3b7dd36-e770-402c-88ef-e5a90396d71f", "address": "fa:16:3e:dc:c2:65", "network": {"id": "0618d411-0f50-4ee4-80a9-cbd395ea2c77", "bridge": "br-int", "label": "tempest-TestStampPattern-1490281843-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b72317ce75214e619a14739991461c95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b7dd36-e7", "ovs_interfaceid": "b3b7dd36-e770-402c-88ef-e5a90396d71f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:07:00.737069 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Converting VIF {"id": "b3b7dd36-e770-402c-88ef-e5a90396d71f", "address": "fa:16:3e:dc:c2:65", "network": {"id": "0618d411-0f50-4ee4-80a9-cbd395ea2c77", "bridge": "br-int", "label": "tempest-TestStampPattern-1490281843-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b72317ce75214e619a14739991461c95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b7dd36-e7", "ovs_interfaceid": "b3b7dd36-e770-402c-88ef-e5a90396d71f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:07:00.737552 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:c2:65,bridge_name='br-int',has_traffic_filtering=True,id=b3b7dd36-e770-402c-88ef-e5a90396d71f,network=Network(0618d411-0f50-4ee4-80a9-cbd395ea2c77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3b7dd36-e7') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:07:00.737900 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:c2:65,bridge_name='br-int',has_traffic_filtering=True,id=b3b7dd36-e770-402c-88ef-e5a90396d71f,network=Network(0618d411-0f50-4ee4-80a9-cbd395ea2c77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3b7dd36-e7') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:07:00.738281 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:00.738717 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:07:00.739355 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:07:00.740343 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:00.740559 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '82cc23d8-f066-5e42-bf7b-ca7c428eb2de', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:07:00.742304 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:00.743458 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:07:00.750256 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:00.756765 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:00.756985 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3b7dd36-e7, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:07:00.757340 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb3b7dd36-e7, col_values=(('qos', UUID('92cfaa9a-f3a0-4e62-970f-2c772d2a575b')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:07:00.757512 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb3b7dd36-e7, col_values=(('external_ids', {'iface-id': 'b3b7dd36-e770-402c-88ef-e5a90396d71f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:c2:65', 'vm-uuid': 'b646159a-f806-487d-8a14-0aa8e2438f2b'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:07:00.758507 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:00.761326 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:07:00.768786 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:00.770358 np0000001127 nova-compute[98206]: INFO os_vif [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:c2:65,bridge_name='br-int',has_traffic_filtering=True,id=b3b7dd36-e770-402c-88ef-e5a90396d71f,network=Network(0618d411-0f50-4ee4-80a9-cbd395ea2c77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3b7dd36-e7')
May 21 02:07:00.781760 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:07:00.783201 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329220.7829099, feb908f9-10aa-4ba0-8289-c76a3a6279c7 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:07:00.783421 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] VM Paused (Lifecycle Event)
May 21 02:07:00.800804 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.120s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:00.801298 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:00.836423 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Took 9.33 seconds to spawn the instance on the hypervisor.
May 21 02:07:00.836939 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:07:00.861236 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "refresh_cache-aa3f5a78-fb82-4e21-8ebf-90bf48a122be" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:07:00.861236 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquired lock "refresh_cache-aa3f5a78-fb82-4e21-8ebf-90bf48a122be" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:07:00.861236 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:07:00.865533 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk 1073741824" returned: 0 in 0.064s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:00.866164 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:00.866543 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:00.978865 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.112s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:00.979245 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:07:00.979547 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:01.005011 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Compute_service record updated for np0000001127:np0000001127 {{(pid=98206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 21 02:07:01.005672 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.032s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:01.006319 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:07:01.063708 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-dc4fffb4-0907-4bd6-8d43-a9b442e220b4 req-82ce8838-2bd5-49ff-b96f-1279cbb16a07 service nova] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Received event network-vif-plugged-59724ac9-1c92-4fdf-a5c9-de82a9453bc6 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:01.063870 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-dc4fffb4-0907-4bd6-8d43-a9b442e220b4 req-82ce8838-2bd5-49ff-b96f-1279cbb16a07 service nova] Acquiring lock "feb908f9-10aa-4ba0-8289-c76a3a6279c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:01.063946 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-dc4fffb4-0907-4bd6-8d43-a9b442e220b4 req-82ce8838-2bd5-49ff-b96f-1279cbb16a07 service nova] Lock "feb908f9-10aa-4ba0-8289-c76a3a6279c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:01.064083 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-dc4fffb4-0907-4bd6-8d43-a9b442e220b4 req-82ce8838-2bd5-49ff-b96f-1279cbb16a07 service nova] Lock "feb908f9-10aa-4ba0-8289-c76a3a6279c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:01.064206 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-dc4fffb4-0907-4bd6-8d43-a9b442e220b4 req-82ce8838-2bd5-49ff-b96f-1279cbb16a07 service nova] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] No waiting events found dispatching network-vif-plugged-59724ac9-1c92-4fdf-a5c9-de82a9453bc6 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:07:01.064358 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-dc4fffb4-0907-4bd6-8d43-a9b442e220b4 req-82ce8838-2bd5-49ff-b96f-1279cbb16a07 service nova] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Received unexpected event network-vif-plugged-59724ac9-1c92-4fdf-a5c9-de82a9453bc6 for instance with vm_state active and task_state None.
May 21 02:07:01.064465 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-dc4fffb4-0907-4bd6-8d43-a9b442e220b4 req-82ce8838-2bd5-49ff-b96f-1279cbb16a07 service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Received event network-changed-2b286fbf-a6fe-4dcc-af12-2521cf154dbb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:01.064632 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-dc4fffb4-0907-4bd6-8d43-a9b442e220b4 req-82ce8838-2bd5-49ff-b96f-1279cbb16a07 service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Refreshing instance network info cache due to event network-changed-2b286fbf-a6fe-4dcc-af12-2521cf154dbb. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:07:01.064780 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-dc4fffb4-0907-4bd6-8d43-a9b442e220b4 req-82ce8838-2bd5-49ff-b96f-1279cbb16a07 service nova] Acquiring lock "refresh_cache-aa3f5a78-fb82-4e21-8ebf-90bf48a122be" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:07:01.083880 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:01.084301 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Cannot resize image /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:07:01.084657 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:07:01.084897 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Ensure instance console log exists: /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:07:01.085208 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:01.085692 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:01.085692 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:01.143699 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:07:01.143699 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:07:01.143699 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] No VIF found with MAC fa:16:3e:97:bd:d9, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:07:01.144399 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Using config drive
May 21 02:07:01.286650 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:07:01.294160 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329221.2937708, feb908f9-10aa-4ba0-8289-c76a3a6279c7 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:07:01.294448 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] VM Resumed (Lifecycle Event)
May 21 02:07:01.354152 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Took 16.64 seconds to build instance.
May 21 02:07:01.452755 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:07:01.635782 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:01.650705 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:01.668165 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:01.797356 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:07:01.799681 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:07:01.815340 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Creating config drive at /opt/stack/data/nova/instances/609b1611-3b05-4b86-8bf3-85f16f199d80/disk.config
May 21 02:07:01.822690 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/609b1611-3b05-4b86-8bf3-85f16f199d80/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpylh07zgf {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:01.855394 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Updating instance_info_cache with network_info: [{"id": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "address": "fa:16:3e:db:08:dd", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b286fbf-a6", "ovs_interfaceid": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:07:01.858596 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bb19e649-3d9d-4820-a303-b45b1e01de0b tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "feb908f9-10aa-4ba0-8289-c76a3a6279c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.147s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:01.885000 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/609b1611-3b05-4b86-8bf3-85f16f199d80/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpylh07zgf" returned: 0 in 0.062s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:02.005795 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:07:02.006093 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:07:02.006719 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:07:02.006992 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:07:02.007323 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 48.67 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:07:02.056790 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Acquiring lock "2b990342-3aef-4ea5-a3bb-c776f4dd8567" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:02.057115 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "2b990342-3aef-4ea5-a3bb-c776f4dd8567" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:02.291710 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:07:02.292098 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:07:02.292098 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] No VIF found with MAC fa:16:3e:dc:c2:65, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:07:02.292492 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Using config drive
May 21 02:07:02.343868 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:02.359955 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Releasing lock "refresh_cache-aa3f5a78-fb82-4e21-8ebf-90bf48a122be" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:07:02.360387 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Instance network_info: |[{"id": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "address": "fa:16:3e:db:08:dd", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b286fbf-a6", "ovs_interfaceid": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:07:02.364733 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Start _get_guest_xml network_info=[{"id": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "address": "fa:16:3e:db:08:dd", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b286fbf-a6", "ovs_interfaceid": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:07:02.371057 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-dc4fffb4-0907-4bd6-8d43-a9b442e220b4 req-82ce8838-2bd5-49ff-b96f-1279cbb16a07 service nova] Acquired lock "refresh_cache-aa3f5a78-fb82-4e21-8ebf-90bf48a122be" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:07:02.371302 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-dc4fffb4-0907-4bd6-8d43-a9b442e220b4 req-82ce8838-2bd5-49ff-b96f-1279cbb16a07 service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Refreshing network info cache for port 2b286fbf-a6fe-4dcc-af12-2521cf154dbb {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:07:02.373099 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:07:02.374671 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='aa3f5a78-fb82-4e21-8ebf-90bf48a122be'), owner=OwnerMeta(userid='049d6c8cccfa4ae38d78a88ef5be0f1b', username='tempest-AttachVolumeMultiAttachTest-289054175-project-member', projectid='848912b0c0e94d2795bb2332daf1730e', projectname='tempest-AttachVolumeMultiAttachTest-289054175'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "address": "fa:16:3e:db:08:dd", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b286fbf-a6", "ovs_interfaceid": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329222.3742547) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:07:02.378868 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:07:02.379865 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:07:02.380083 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:02.381315 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:02.386038 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:07:02.387164 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:07:02.394276 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:07:02.395393 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:07:02.395393 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:07:02.395879 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:07:02.396406 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:07:02.396629 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:07:02.397204 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:07:02.397204 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:07:02.397204 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:07:02.397551 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:07:02.397756 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:07:02.398069 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:07:02.418609 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:06:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='multiattach-server-0',id=54,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzu+v5yloohnjet+lpl7Cb5m5YuZdtxheBkBGOMBLLe2AJEatmv/W6U1humbPofoJpKHaVTa0sSri4Ktoz/rRBuEiIFUUGVMQjgWmfd958Eyx52s4Fg6gJyB/ru0BJ+zA==',key_name='tempest-keypair-1890511814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='848912b0c0e94d2795bb2332daf1730e',ramdisk_id='',reservation_id='r-riou1f0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-289054175',owner_user_name='tempest-AttachVolumeMultiAttachTest-289054175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:07:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='049d6c8cccfa4ae38d78a88ef5be0f1b',uuid=aa3f5a78-fb82-4e21-8ebf-90bf48a122be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "address": "fa:16:3e:db:08:dd", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b286fbf-a6", "ovs_interfaceid": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:07:02.419123 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converting VIF {"id": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "address": "fa:16:3e:db:08:dd", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b286fbf-a6", "ovs_interfaceid": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:07:02.420809 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:08:dd,bridge_name='br-int',has_traffic_filtering=True,id=2b286fbf-a6fe-4dcc-af12-2521cf154dbb,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b286fbf-a6') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:07:02.421397 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lazy-loading 'pci_devices' on Instance uuid aa3f5a78-fb82-4e21-8ebf-90bf48a122be {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:07:02.508012 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:02.561847 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:07:02.622805 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2415565e-5aa4-461f-a6f1-0ca18797b96b req-16520d11-2d53-4cd1-949d-5b9891f2fd14 service nova] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Received event network-vif-plugged-58f0082f-9f4d-42c5-9569-faf668cc281d {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:02.623291 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2415565e-5aa4-461f-a6f1-0ca18797b96b req-16520d11-2d53-4cd1-949d-5b9891f2fd14 service nova] Acquiring lock "609b1611-3b05-4b86-8bf3-85f16f199d80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:02.623523 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2415565e-5aa4-461f-a6f1-0ca18797b96b req-16520d11-2d53-4cd1-949d-5b9891f2fd14 service nova] Lock "609b1611-3b05-4b86-8bf3-85f16f199d80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:02.623594 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2415565e-5aa4-461f-a6f1-0ca18797b96b req-16520d11-2d53-4cd1-949d-5b9891f2fd14 service nova] Lock "609b1611-3b05-4b86-8bf3-85f16f199d80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:02.623908 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2415565e-5aa4-461f-a6f1-0ca18797b96b req-16520d11-2d53-4cd1-949d-5b9891f2fd14 service nova] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Processing event network-vif-plugged-58f0082f-9f4d-42c5-9569-faf668cc281d {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:07:02.772242 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:02.779381 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:02.783016 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:02.807018 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:02.814307 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:02.826926 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:02.874238 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-dc4fffb4-0907-4bd6-8d43-a9b442e220b4 req-82ce8838-2bd5-49ff-b96f-1279cbb16a07 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:02.924648 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] End _get_guest_xml xml=<domain type="qemu">
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:   <uuid>aa3f5a78-fb82-4e21-8ebf-90bf48a122be</uuid>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:   <name>instance-00000036</name>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:       <nova:name>multiattach-server-0</nova:name>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:07:02</nova:creationTime>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:         <nova:user uuid="049d6c8cccfa4ae38d78a88ef5be0f1b">tempest-AttachVolumeMultiAttachTest-289054175-project-member</nova:user>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:         <nova:project uuid="848912b0c0e94d2795bb2332daf1730e">tempest-AttachVolumeMultiAttachTest-289054175</nova:project>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:         <nova:port uuid="2b286fbf-a6fe-4dcc-af12-2521cf154dbb">
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:     <system>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:       <entry name="serial">aa3f5a78-fb82-4e21-8ebf-90bf48a122be</entry>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:       <entry name="uuid">aa3f5a78-fb82-4e21-8ebf-90bf48a122be</entry>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:     </system>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:   <os>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:   </os>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:   <features>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:   </features>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:   <devices>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk"/>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:     </disk>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk.config"/>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:     </disk>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:db:08:dd"/>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:       <target dev="tap2b286fbf-a6"/>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:     </interface>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/console.log" append="off"/>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:     </serial>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:     <video>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:     </video>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:     </rng>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:   </devices>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]: </domain>
May 21 02:07:02.924648 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:07:02.926447 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Preparing to wait for external event network-vif-plugged-2b286fbf-a6fe-4dcc-af12-2521cf154dbb {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:07:02.926447 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:02.926447 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:02.926447 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:02.926896 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:06:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='multiattach-server-0',id=54,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzu+v5yloohnjet+lpl7Cb5m5YuZdtxheBkBGOMBLLe2AJEatmv/W6U1humbPofoJpKHaVTa0sSri4Ktoz/rRBuEiIFUUGVMQjgWmfd958Eyx52s4Fg6gJyB/ru0BJ+zA==',key_name='tempest-keypair-1890511814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='848912b0c0e94d2795bb2332daf1730e',ramdisk_id='',reservation_id='r-riou1f0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-289054175',owner_user_name='tempest-AttachVolumeMultiAttachTest-289054175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:07:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='049d6c8cccfa4ae38d78a88ef5be0f1b',uuid=aa3f5a78-fb82-4e21-8ebf-90bf48a122be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "address": "fa:16:3e:db:08:dd", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b286fbf-a6", "ovs_interfaceid": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:07:02.927105 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converting VIF {"id": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "address": "fa:16:3e:db:08:dd", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b286fbf-a6", "ovs_interfaceid": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:07:02.927731 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:08:dd,bridge_name='br-int',has_traffic_filtering=True,id=2b286fbf-a6fe-4dcc-af12-2521cf154dbb,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b286fbf-a6') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:07:02.928173 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:08:dd,bridge_name='br-int',has_traffic_filtering=True,id=2b286fbf-a6fe-4dcc-af12-2521cf154dbb,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b286fbf-a6') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:07:02.928486 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:02.928729 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:07:02.929020 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:07:02.930143 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:02.930345 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a08c2d0f-6055-534b-950a-af43b4aeaf54', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:07:02.931513 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:02.933274 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:07:02.939560 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:02.942364 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:02.942611 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b286fbf-a6, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:07:02.942924 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2b286fbf-a6, col_values=(('qos', UUID('852bc5ef-1729-4993-9a8a-4417af6fba60')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:07:02.943089 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2b286fbf-a6, col_values=(('external_ids', {'iface-id': '2b286fbf-a6fe-4dcc-af12-2521cf154dbb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:08:dd', 'vm-uuid': 'aa3f5a78-fb82-4e21-8ebf-90bf48a122be'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:07:02.946029 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:02.946029 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:07:02.953379 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:02.953942 np0000001127 nova-compute[98206]: INFO os_vif [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:08:dd,bridge_name='br-int',has_traffic_filtering=True,id=2b286fbf-a6fe-4dcc-af12-2521cf154dbb,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b286fbf-a6')
May 21 02:07:02.975301 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Creating config drive at /opt/stack/data/nova/instances/b646159a-f806-487d-8a14-0aa8e2438f2b/disk.config
May 21 02:07:02.979746 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b646159a-f806-487d-8a14-0aa8e2438f2b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdqz8g8ei {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:03.039526 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b646159a-f806-487d-8a14-0aa8e2438f2b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdqz8g8ei" returned: 0 in 0.060s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:03.140490 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b4781306-1e86-495a-9d40-c1df7c860dab req-1d834d54-c798-4817-8c3d-3b1b53b6664c service nova] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Received event network-changed-59724ac9-1c92-4fdf-a5c9-de82a9453bc6 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:03.140490 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b4781306-1e86-495a-9d40-c1df7c860dab req-1d834d54-c798-4817-8c3d-3b1b53b6664c service nova] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Refreshing instance network info cache due to event network-changed-59724ac9-1c92-4fdf-a5c9-de82a9453bc6. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:07:03.140490 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b4781306-1e86-495a-9d40-c1df7c860dab req-1d834d54-c798-4817-8c3d-3b1b53b6664c service nova] Acquiring lock "refresh_cache-feb908f9-10aa-4ba0-8289-c76a3a6279c7" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:07:03.140490 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b4781306-1e86-495a-9d40-c1df7c860dab req-1d834d54-c798-4817-8c3d-3b1b53b6664c service nova] Acquired lock "refresh_cache-feb908f9-10aa-4ba0-8289-c76a3a6279c7" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:07:03.140490 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-b4781306-1e86-495a-9d40-c1df7c860dab req-1d834d54-c798-4817-8c3d-3b1b53b6664c service nova] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Refreshing network info cache for port 59724ac9-1c92-4fdf-a5c9-de82a9453bc6 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:07:03.141958 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:03.143953 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:03.148898 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:07:03.148968 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Claim successful on node np0000001127
May 21 02:07:03.276955 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-dc4fffb4-0907-4bd6-8d43-a9b442e220b4 req-82ce8838-2bd5-49ff-b96f-1279cbb16a07 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:03.342663 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329223.3422666, 609b1611-3b05-4b86-8bf3-85f16f199d80 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:07:03.343119 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] VM Started (Lifecycle Event)
May 21 02:07:03.347503 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:07:03.348139 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:07:03.352127 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Instance spawned successfully.
May 21 02:07:03.353096 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:07:03.423610 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-dc4fffb4-0907-4bd6-8d43-a9b442e220b4 req-82ce8838-2bd5-49ff-b96f-1279cbb16a07 service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Updated VIF entry in instance network info cache for port 2b286fbf-a6fe-4dcc-af12-2521cf154dbb. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:07:03.424083 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-dc4fffb4-0907-4bd6-8d43-a9b442e220b4 req-82ce8838-2bd5-49ff-b96f-1279cbb16a07 service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Updating instance_info_cache with network_info: [{"id": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "address": "fa:16:3e:db:08:dd", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b286fbf-a6", "ovs_interfaceid": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:07:03.547773 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:03.596051 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:03.645068 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-b4781306-1e86-495a-9d40-c1df7c860dab req-1d834d54-c798-4817-8c3d-3b1b53b6664c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:03.659183 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:03.760984 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:03.778931 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:03.845965 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:07:03.850810 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:07:03.867256 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:03.867256 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:03.867429 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:03.867918 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:03.867918 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:03.868190 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:03.926541 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-dc4fffb4-0907-4bd6-8d43-a9b442e220b4 req-82ce8838-2bd5-49ff-b96f-1279cbb16a07 service nova] Releasing lock "refresh_cache-aa3f5a78-fb82-4e21-8ebf-90bf48a122be" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:07:04.095388 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-b4781306-1e86-495a-9d40-c1df7c860dab req-1d834d54-c798-4817-8c3d-3b1b53b6664c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:04.286676 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-b4781306-1e86-495a-9d40-c1df7c860dab req-1d834d54-c798-4817-8c3d-3b1b53b6664c service nova] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Updated VIF entry in instance network info cache for port 59724ac9-1c92-4fdf-a5c9-de82a9453bc6. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:07:04.286982 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-b4781306-1e86-495a-9d40-c1df7c860dab req-1d834d54-c798-4817-8c3d-3b1b53b6664c service nova] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Updating instance_info_cache with network_info: [{"id": "59724ac9-1c92-4fdf-a5c9-de82a9453bc6", "address": "fa:16:3e:f5:8e:ad", "network": {"id": "460fd532-ef54-4f63-922b-b9d9f73f665f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1504169250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89e0ea7da0f244aab58f9da579e53864", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap59724ac9-1c", "ovs_interfaceid": "59724ac9-1c92-4fdf-a5c9-de82a9453bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:07:04.354605 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:07:04.354605 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329224.354308, 609b1611-3b05-4b86-8bf3-85f16f199d80 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:07:04.355041 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] VM Paused (Lifecycle Event)
May 21 02:07:04.376029 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Took 9.27 seconds to spawn the instance on the hypervisor.
May 21 02:07:04.376557 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:07:04.485136 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:07:04.485136 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:07:04.485136 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No VIF found with MAC fa:16:3e:db:08:dd, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:07:04.485136 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Using config drive
May 21 02:07:04.697174 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-afc09d9b-81fe-4cab-a63b-a90510d0aae3 req-7d0ba0cd-050c-4904-bbc4-862d00bdeb42 service nova] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Received event network-vif-plugged-58f0082f-9f4d-42c5-9569-faf668cc281d {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:04.698045 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-afc09d9b-81fe-4cab-a63b-a90510d0aae3 req-7d0ba0cd-050c-4904-bbc4-862d00bdeb42 service nova] Acquiring lock "609b1611-3b05-4b86-8bf3-85f16f199d80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:04.698045 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-afc09d9b-81fe-4cab-a63b-a90510d0aae3 req-7d0ba0cd-050c-4904-bbc4-862d00bdeb42 service nova] Lock "609b1611-3b05-4b86-8bf3-85f16f199d80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:04.698045 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-afc09d9b-81fe-4cab-a63b-a90510d0aae3 req-7d0ba0cd-050c-4904-bbc4-862d00bdeb42 service nova] Lock "609b1611-3b05-4b86-8bf3-85f16f199d80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:04.698045 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-afc09d9b-81fe-4cab-a63b-a90510d0aae3 req-7d0ba0cd-050c-4904-bbc4-862d00bdeb42 service nova] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] No waiting events found dispatching network-vif-plugged-58f0082f-9f4d-42c5-9569-faf668cc281d {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:07:04.698045 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-afc09d9b-81fe-4cab-a63b-a90510d0aae3 req-7d0ba0cd-050c-4904-bbc4-862d00bdeb42 service nova] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Received unexpected event network-vif-plugged-58f0082f-9f4d-42c5-9569-faf668cc281d for instance with vm_state active and task_state None.
May 21 02:07:04.698045 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-afc09d9b-81fe-4cab-a63b-a90510d0aae3 req-7d0ba0cd-050c-4904-bbc4-862d00bdeb42 service nova] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Received event network-vif-plugged-b3b7dd36-e770-402c-88ef-e5a90396d71f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:04.698045 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-afc09d9b-81fe-4cab-a63b-a90510d0aae3 req-7d0ba0cd-050c-4904-bbc4-862d00bdeb42 service nova] Acquiring lock "b646159a-f806-487d-8a14-0aa8e2438f2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:04.699734 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-afc09d9b-81fe-4cab-a63b-a90510d0aae3 req-7d0ba0cd-050c-4904-bbc4-862d00bdeb42 service nova] Lock "b646159a-f806-487d-8a14-0aa8e2438f2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:04.699734 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-afc09d9b-81fe-4cab-a63b-a90510d0aae3 req-7d0ba0cd-050c-4904-bbc4-862d00bdeb42 service nova] Lock "b646159a-f806-487d-8a14-0aa8e2438f2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:04.699734 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-afc09d9b-81fe-4cab-a63b-a90510d0aae3 req-7d0ba0cd-050c-4904-bbc4-862d00bdeb42 service nova] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Processing event network-vif-plugged-b3b7dd36-e770-402c-88ef-e5a90396d71f {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:07:04.699734 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-afc09d9b-81fe-4cab-a63b-a90510d0aae3 req-7d0ba0cd-050c-4904-bbc4-862d00bdeb42 service nova] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Received event network-vif-plugged-b3b7dd36-e770-402c-88ef-e5a90396d71f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:04.699734 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-afc09d9b-81fe-4cab-a63b-a90510d0aae3 req-7d0ba0cd-050c-4904-bbc4-862d00bdeb42 service nova] Acquiring lock "b646159a-f806-487d-8a14-0aa8e2438f2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:04.699734 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-afc09d9b-81fe-4cab-a63b-a90510d0aae3 req-7d0ba0cd-050c-4904-bbc4-862d00bdeb42 service nova] Lock "b646159a-f806-487d-8a14-0aa8e2438f2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:04.699734 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-afc09d9b-81fe-4cab-a63b-a90510d0aae3 req-7d0ba0cd-050c-4904-bbc4-862d00bdeb42 service nova] Lock "b646159a-f806-487d-8a14-0aa8e2438f2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:04.703617 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-afc09d9b-81fe-4cab-a63b-a90510d0aae3 req-7d0ba0cd-050c-4904-bbc4-862d00bdeb42 service nova] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] No waiting events found dispatching network-vif-plugged-b3b7dd36-e770-402c-88ef-e5a90396d71f {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:07:04.703617 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-afc09d9b-81fe-4cab-a63b-a90510d0aae3 req-7d0ba0cd-050c-4904-bbc4-862d00bdeb42 service nova] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Received unexpected event network-vif-plugged-b3b7dd36-e770-402c-88ef-e5a90396d71f for instance with vm_state building and task_state spawning.
May 21 02:07:04.703617 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:07:04.707728 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:07:04.723139 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Instance spawned successfully.
May 21 02:07:04.724531 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:07:04.730096 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:04.731624 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:04.790724 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b4781306-1e86-495a-9d40-c1df7c860dab req-1d834d54-c798-4817-8c3d-3b1b53b6664c service nova] Releasing lock "refresh_cache-feb908f9-10aa-4ba0-8289-c76a3a6279c7" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:07:04.857825 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:07:04.861122 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329224.8601317, 609b1611-3b05-4b86-8bf3-85f16f199d80 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:07:04.861122 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] VM Resumed (Lifecycle Event)
May 21 02:07:04.889799 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Took 16.89 seconds to build instance.
May 21 02:07:04.992016 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:05.056827 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:07:05.056827 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:07:05.174485 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:07:05.179849 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Creating config drive at /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk.config
May 21 02:07:05.186273 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpptufj2m7 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:05.220266 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1fc59604-3ed3-466b-8b49-49f1c800e490 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "5c34ef68-490d-42c1-8e1a-1913b3b183e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:05.220719 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1fc59604-3ed3-466b-8b49-49f1c800e490 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "5c34ef68-490d-42c1-8e1a-1913b3b183e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:05.221104 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1fc59604-3ed3-466b-8b49-49f1c800e490 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "5c34ef68-490d-42c1-8e1a-1913b3b183e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:05.221323 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1fc59604-3ed3-466b-8b49-49f1c800e490 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "5c34ef68-490d-42c1-8e1a-1913b3b183e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:05.221535 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1fc59604-3ed3-466b-8b49-49f1c800e490 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "5c34ef68-490d-42c1-8e1a-1913b3b183e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:05.226451 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-1fc59604-3ed3-466b-8b49-49f1c800e490 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Terminating instance
May 21 02:07:05.237720 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Took 7.53 seconds to spawn the instance on the hypervisor.
May 21 02:07:05.237951 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:07:05.267495 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpptufj2m7" returned: 0 in 0.079s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:05.365721 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:07:05.375858 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:07:05.392172 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "609b1611-3b05-4b86-8bf3-85f16f199d80" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.398s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:05.559495 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:07:05.730841 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1fc59604-3ed3-466b-8b49-49f1c800e490 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:07:05.759203 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Took 13.62 seconds to build instance.
May 21 02:07:05.784584 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:05.821587 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:05.844875 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:05.876775 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329225.8763611, b646159a-f806-487d-8a14-0aa8e2438f2b => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:07:05.876941 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] VM Started (Lifecycle Event)
May 21 02:07:05.949654 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:06.019116 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:06.027749 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:06.066117 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.924s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:06.066519 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:07:06.074424 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c4c1f2b9-9602-4469-81a6-77b85f69f68a req-a265cd80-3053-4883-a7a5-eec61ace0a23 service nova] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Received event network-vif-unplugged-1f2f0fc8-f7e3-4579-8d3a-53ba1117725c {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:06.074869 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c4c1f2b9-9602-4469-81a6-77b85f69f68a req-a265cd80-3053-4883-a7a5-eec61ace0a23 service nova] Acquiring lock "5c34ef68-490d-42c1-8e1a-1913b3b183e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:06.076183 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c4c1f2b9-9602-4469-81a6-77b85f69f68a req-a265cd80-3053-4883-a7a5-eec61ace0a23 service nova] Lock "5c34ef68-490d-42c1-8e1a-1913b3b183e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:06.080491 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c4c1f2b9-9602-4469-81a6-77b85f69f68a req-a265cd80-3053-4883-a7a5-eec61ace0a23 service nova] Lock "5c34ef68-490d-42c1-8e1a-1913b3b183e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:06.080491 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c4c1f2b9-9602-4469-81a6-77b85f69f68a req-a265cd80-3053-4883-a7a5-eec61ace0a23 service nova] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] No waiting events found dispatching network-vif-unplugged-1f2f0fc8-f7e3-4579-8d3a-53ba1117725c {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:07:06.080491 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c4c1f2b9-9602-4469-81a6-77b85f69f68a req-a265cd80-3053-4883-a7a5-eec61ace0a23 service nova] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Received event network-vif-unplugged-1f2f0fc8-f7e3-4579-8d3a-53ba1117725c for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:07:06.086739 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:06.098060 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:06.136070 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Instance destroyed successfully.
May 21 02:07:06.136700 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-1fc59604-3ed3-466b-8b49-49f1c800e490 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lazy-loading 'resources' on Instance uuid 5c34ef68-490d-42c1-8e1a-1913b3b183e7 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:07:06.225432 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cb821b92-17f8-4fe8-a5d9-64d70fa1f662 req-6dd58e1e-2803-46a5-8e7a-24e48403e185 service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Received event network-vif-plugged-2b286fbf-a6fe-4dcc-af12-2521cf154dbb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:06.225589 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cb821b92-17f8-4fe8-a5d9-64d70fa1f662 req-6dd58e1e-2803-46a5-8e7a-24e48403e185 service nova] Acquiring lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:06.226144 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cb821b92-17f8-4fe8-a5d9-64d70fa1f662 req-6dd58e1e-2803-46a5-8e7a-24e48403e185 service nova] Lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:06.226376 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cb821b92-17f8-4fe8-a5d9-64d70fa1f662 req-6dd58e1e-2803-46a5-8e7a-24e48403e185 service nova] Lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:06.226580 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cb821b92-17f8-4fe8-a5d9-64d70fa1f662 req-6dd58e1e-2803-46a5-8e7a-24e48403e185 service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Processing event network-vif-plugged-2b286fbf-a6fe-4dcc-af12-2521cf154dbb {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:07:06.267037 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:06.269345 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "b646159a-f806-487d-8a14-0aa8e2438f2b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.138s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:06.276617 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:06.380082 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:07:06.387065 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:07:06.577412 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:07:06.580396 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:07:06.580396 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:06.580396 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:06.638152 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:06.643081 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-1fc59604-3ed3-466b-8b49-49f1c800e490 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:06:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-76664382',display_name='tempest-AttachVolumeNegativeTest-server-76664382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumenegativetest-server-76664382',id=50,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFu+X4/AsJbBcSP8JzvjdCL2C/e+lFFYDHf7a98euK3fxi7nuTH9jWju0Br2RKvHSjbXppqO5GDD2jW0WvJTQbTt/o8PFR3x+wd9YCoLwWz4mCv+Lc1THDtgtRM2pAeIw==',key_name='tempest-keypair-320293375',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:06:26Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d3efe4046d6a442d91b3463e2d99fd7b',ramdisk_id='',reservation_id='r-ri2opg4j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1208856611',owner_user_name='tempest-AttachVolumeNegativeTest-1208856611-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:06:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f369771db7dd49da85131c9692833a5a',uuid=5c34ef68-490d-42c1-8e1a-1913b3b183e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f2f0fc8-f7e3-4579-8d3a-53ba1117725c", "address": "fa:16:3e:cc:c2:95", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f2f0fc8-f7", "ovs_interfaceid": "1f2f0fc8-f7e3-4579-8d3a-53ba1117725c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:07:06.650171 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-1fc59604-3ed3-466b-8b49-49f1c800e490 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Converting VIF {"id": "1f2f0fc8-f7e3-4579-8d3a-53ba1117725c", "address": "fa:16:3e:cc:c2:95", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f2f0fc8-f7", "ovs_interfaceid": "1f2f0fc8-f7e3-4579-8d3a-53ba1117725c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:07:06.650171 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-1fc59604-3ed3-466b-8b49-49f1c800e490 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:c2:95,bridge_name='br-int',has_traffic_filtering=True,id=1f2f0fc8-f7e3-4579-8d3a-53ba1117725c,network=Network(f683b2da-ab41-43e1-a9bb-98914089b4d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f2f0fc8-f7') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:07:06.650171 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-1fc59604-3ed3-466b-8b49-49f1c800e490 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:c2:95,bridge_name='br-int',has_traffic_filtering=True,id=1f2f0fc8-f7e3-4579-8d3a-53ba1117725c,network=Network(f683b2da-ab41-43e1-a9bb-98914089b4d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f2f0fc8-f7') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:07:06.655438 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:06.656648 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f2f0fc8-f7, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:07:06.659444 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:06.660393 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:07:06.663245 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:06.665282 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:06.665627 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1443a7f6-7193-4d91-ba31-3d45c77971fb) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:07:06.666696 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:06.667999 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:07:06.678804 np0000001127 nova-compute[98206]: INFO os_vif [None req-1fc59604-3ed3-466b-8b49-49f1c800e490 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:c2:95,bridge_name='br-int',has_traffic_filtering=True,id=1f2f0fc8-f7e3-4579-8d3a-53ba1117725c,network=Network(f683b2da-ab41-43e1-a9bb-98914089b4d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f2f0fc8-f7')
May 21 02:07:06.678804 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-1fc59604-3ed3-466b-8b49-49f1c800e490 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Deleting instance files /opt/stack/data/nova/instances/5c34ef68-490d-42c1-8e1a-1913b3b183e7_del
May 21 02:07:06.678804 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-1fc59604-3ed3-466b-8b49-49f1c800e490 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Deletion of /opt/stack/data/nova/instances/5c34ef68-490d-42c1-8e1a-1913b3b183e7_del complete
May 21 02:07:06.714349 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '09298d250fae40f1adea3cae800dd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549d365926ce49efa4c4bf50c7bbbbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:07:06.889838 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329226.8895044, b646159a-f806-487d-8a14-0aa8e2438f2b => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:07:06.891435 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] VM Paused (Lifecycle Event)
May 21 02:07:07.080159 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:07:07.083424 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:07:07.088521 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:07:07.096275 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Instance spawned successfully.
May 21 02:07:07.098720 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:07:07.187554 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-1fc59604-3ed3-466b-8b49-49f1c800e490 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Took 1.46 seconds to destroy the instance on the hypervisor.
May 21 02:07:07.188285 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-1fc59604-3ed3-466b-8b49-49f1c800e490 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:07:07.188743 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:07:07.189570 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:07:07.189570 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:07.372430 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Successfully created port: 41d7cad8-3b46-47b2-b205-65f7607047cd {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:07:07.394629 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:07:07.397905 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329227.3973858, b646159a-f806-487d-8a14-0aa8e2438f2b => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:07:07.399861 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] VM Resumed (Lifecycle Event)
May 21 02:07:07.451889 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:07.588936 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:07:07.608720 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:07.608968 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:07.609352 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:07.609712 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:07.610042 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:07.610373 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:07.903396 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:07:07.908579 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:07:08.075790 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Successfully updated port: 41d7cad8-3b46-47b2-b205-65f7607047cd {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:07:08.117516 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Took 7.55 seconds to spawn the instance on the hypervisor.
May 21 02:07:08.117988 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:07:08.204888 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-610ea503-050b-42dd-b0af-dd5e0fc30cf9 req-dcdec703-9ddc-49ae-860a-a7d44d95a20b service nova] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Received event network-vif-unplugged-1f2f0fc8-f7e3-4579-8d3a-53ba1117725c {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:08.206697 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-610ea503-050b-42dd-b0af-dd5e0fc30cf9 req-dcdec703-9ddc-49ae-860a-a7d44d95a20b service nova] Acquiring lock "5c34ef68-490d-42c1-8e1a-1913b3b183e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:08.206697 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-610ea503-050b-42dd-b0af-dd5e0fc30cf9 req-dcdec703-9ddc-49ae-860a-a7d44d95a20b service nova] Lock "5c34ef68-490d-42c1-8e1a-1913b3b183e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:08.206909 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-610ea503-050b-42dd-b0af-dd5e0fc30cf9 req-dcdec703-9ddc-49ae-860a-a7d44d95a20b service nova] Lock "5c34ef68-490d-42c1-8e1a-1913b3b183e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:08.206909 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-610ea503-050b-42dd-b0af-dd5e0fc30cf9 req-dcdec703-9ddc-49ae-860a-a7d44d95a20b service nova] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] No waiting events found dispatching network-vif-unplugged-1f2f0fc8-f7e3-4579-8d3a-53ba1117725c {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:07:08.207100 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-610ea503-050b-42dd-b0af-dd5e0fc30cf9 req-dcdec703-9ddc-49ae-860a-a7d44d95a20b service nova] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Received event network-vif-unplugged-1f2f0fc8-f7e3-4579-8d3a-53ba1117725c for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:07:08.207264 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-610ea503-050b-42dd-b0af-dd5e0fc30cf9 req-dcdec703-9ddc-49ae-860a-a7d44d95a20b service nova] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Received event network-changed-b3b7dd36-e770-402c-88ef-e5a90396d71f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:08.207439 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-610ea503-050b-42dd-b0af-dd5e0fc30cf9 req-dcdec703-9ddc-49ae-860a-a7d44d95a20b service nova] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Refreshing instance network info cache due to event network-changed-b3b7dd36-e770-402c-88ef-e5a90396d71f. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:07:08.207638 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-610ea503-050b-42dd-b0af-dd5e0fc30cf9 req-dcdec703-9ddc-49ae-860a-a7d44d95a20b service nova] Acquiring lock "refresh_cache-b646159a-f806-487d-8a14-0aa8e2438f2b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:07:08.208020 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-610ea503-050b-42dd-b0af-dd5e0fc30cf9 req-dcdec703-9ddc-49ae-860a-a7d44d95a20b service nova] Acquired lock "refresh_cache-b646159a-f806-487d-8a14-0aa8e2438f2b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:07:08.208020 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-610ea503-050b-42dd-b0af-dd5e0fc30cf9 req-dcdec703-9ddc-49ae-860a-a7d44d95a20b service nova] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Refreshing network info cache for port b3b7dd36-e770-402c-88ef-e5a90396d71f {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:07:08.321777 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1e91e45e-28ad-414a-8077-28a0b4feb284 req-c6bed7fc-a7cf-4ce8-9ccc-8ac9a6247847 service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Received event network-vif-plugged-2b286fbf-a6fe-4dcc-af12-2521cf154dbb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:08.321777 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1e91e45e-28ad-414a-8077-28a0b4feb284 req-c6bed7fc-a7cf-4ce8-9ccc-8ac9a6247847 service nova] Acquiring lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:08.325499 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1e91e45e-28ad-414a-8077-28a0b4feb284 req-c6bed7fc-a7cf-4ce8-9ccc-8ac9a6247847 service nova] Lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:08.325499 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1e91e45e-28ad-414a-8077-28a0b4feb284 req-c6bed7fc-a7cf-4ce8-9ccc-8ac9a6247847 service nova] Lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:08.325499 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1e91e45e-28ad-414a-8077-28a0b4feb284 req-c6bed7fc-a7cf-4ce8-9ccc-8ac9a6247847 service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] No waiting events found dispatching network-vif-plugged-2b286fbf-a6fe-4dcc-af12-2521cf154dbb {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:07:08.325499 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-1e91e45e-28ad-414a-8077-28a0b4feb284 req-c6bed7fc-a7cf-4ce8-9ccc-8ac9a6247847 service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Received unexpected event network-vif-plugged-2b286fbf-a6fe-4dcc-af12-2521cf154dbb for instance with vm_state active and task_state None.
May 21 02:07:08.325499 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1e91e45e-28ad-414a-8077-28a0b4feb284 req-c6bed7fc-a7cf-4ce8-9ccc-8ac9a6247847 service nova] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Received event network-changed-58f0082f-9f4d-42c5-9569-faf668cc281d {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:08.325499 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1e91e45e-28ad-414a-8077-28a0b4feb284 req-c6bed7fc-a7cf-4ce8-9ccc-8ac9a6247847 service nova] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Refreshing instance network info cache due to event network-changed-58f0082f-9f4d-42c5-9569-faf668cc281d. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:07:08.325499 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1e91e45e-28ad-414a-8077-28a0b4feb284 req-c6bed7fc-a7cf-4ce8-9ccc-8ac9a6247847 service nova] Acquiring lock "refresh_cache-609b1611-3b05-4b86-8bf3-85f16f199d80" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:07:08.325499 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1e91e45e-28ad-414a-8077-28a0b4feb284 req-c6bed7fc-a7cf-4ce8-9ccc-8ac9a6247847 service nova] Acquired lock "refresh_cache-609b1611-3b05-4b86-8bf3-85f16f199d80" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:07:08.325499 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-1e91e45e-28ad-414a-8077-28a0b4feb284 req-c6bed7fc-a7cf-4ce8-9ccc-8ac9a6247847 service nova] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Refreshing network info cache for port 58f0082f-9f4d-42c5-9569-faf668cc281d {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:07:08.411793 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999610929000028 future=<Future at 0x71c05864b6e0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:07:08.412305 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329228.4118357, aa3f5a78-fb82-4e21-8ebf-90bf48a122be => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:07:08.412305 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] VM Started (Lifecycle Event)
May 21 02:07:08.414034 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.997396621999997 future=<Future at 0x71c05864b6e0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:07:08.414195 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.997158431000116 future=<Future at 0x71c05864b6e0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:07:08.578677 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Acquiring lock "refresh_cache-2b990342-3aef-4ea5-a3bb-c776f4dd8567" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:07:08.578812 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Acquired lock "refresh_cache-2b990342-3aef-4ea5-a3bb-c776f4dd8567" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:07:08.578991 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:07:08.600124 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:07:08.601807 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:07:08.602227 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Creating image(s)
May 21 02:07:08.602903 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Acquiring lock "/opt/stack/data/nova/instances/2b990342-3aef-4ea5-a3bb-c776f4dd8567/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:08.603193 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "/opt/stack/data/nova/instances/2b990342-3aef-4ea5-a3bb-c776f4dd8567/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:08.604167 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "/opt/stack/data/nova/instances/2b990342-3aef-4ea5-a3bb-c776f4dd8567/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:08.605001 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:07:08.609421 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:07:08.610864 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:08.647342 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Took 16.30 seconds to build instance.
May 21 02:07:08.685558 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:07:08.711277 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.100s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:08.712195 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:08.712408 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:08.713951 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:07:08.720895 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:07:08.722045 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:08.722783 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-610ea503-050b-42dd-b0af-dd5e0fc30cf9 req-dcdec703-9ddc-49ae-860a-a7d44d95a20b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:08.820831 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.099s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:08.821318 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/2b990342-3aef-4ea5-a3bb-c776f4dd8567/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:08.839541 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-1e91e45e-28ad-414a-8077-28a0b4feb284 req-c6bed7fc-a7cf-4ce8-9ccc-8ac9a6247847 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:08.889159 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/2b990342-3aef-4ea5-a3bb-c776f4dd8567/disk 1073741824" returned: 0 in 0.068s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:08.890458 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.178s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:08.890856 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:08.927858 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:07:08.941090 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:07:09.004905 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.112s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:09.004905 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2b990342-3aef-4ea5-a3bb-c776f4dd8567/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:07:09.004905 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b990342-3aef-4ea5-a3bb-c776f4dd8567/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:09.119049 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b990342-3aef-4ea5-a3bb-c776f4dd8567/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:09.119669 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Cannot resize image /opt/stack/data/nova/instances/2b990342-3aef-4ea5-a3bb-c776f4dd8567/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:07:09.120072 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:07:09.120286 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Ensure instance console log exists: /opt/stack/data/nova/instances/2b990342-3aef-4ea5-a3bb-c776f4dd8567/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:07:09.120637 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:09.120924 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:09.121091 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:09.152493 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.811s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:09.188802 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Took 2.00 seconds to deallocate network for instance.
May 21 02:07:09.213085 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:07:09.440686 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-610ea503-050b-42dd-b0af-dd5e0fc30cf9 req-dcdec703-9ddc-49ae-860a-a7d44d95a20b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:09.452120 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329229.451697, aa3f5a78-fb82-4e21-8ebf-90bf48a122be => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:07:09.452361 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] VM Paused (Lifecycle Event)
May 21 02:07:09.469135 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-1e91e45e-28ad-414a-8077-28a0b4feb284 req-c6bed7fc-a7cf-4ce8-9ccc-8ac9a6247847 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:09.524100 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:09.651712 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-610ea503-050b-42dd-b0af-dd5e0fc30cf9 req-dcdec703-9ddc-49ae-860a-a7d44d95a20b service nova] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Updated VIF entry in instance network info cache for port b3b7dd36-e770-402c-88ef-e5a90396d71f. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:07:09.651919 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-610ea503-050b-42dd-b0af-dd5e0fc30cf9 req-dcdec703-9ddc-49ae-860a-a7d44d95a20b service nova] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Updating instance_info_cache with network_info: [{"id": "b3b7dd36-e770-402c-88ef-e5a90396d71f", "address": "fa:16:3e:dc:c2:65", "network": {"id": "0618d411-0f50-4ee4-80a9-cbd395ea2c77", "bridge": "br-int", "label": "tempest-TestStampPattern-1490281843-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b72317ce75214e619a14739991461c95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b7dd36-e7", "ovs_interfaceid": "b3b7dd36-e770-402c-88ef-e5a90396d71f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:07:09.698757 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1fc59604-3ed3-466b-8b49-49f1c800e490 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:09.698966 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1fc59604-3ed3-466b-8b49-49f1c800e490 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:09.927779 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-1e91e45e-28ad-414a-8077-28a0b4feb284 req-c6bed7fc-a7cf-4ce8-9ccc-8ac9a6247847 service nova] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Updated VIF entry in instance network info cache for port 58f0082f-9f4d-42c5-9569-faf668cc281d. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:07:09.928080 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-1e91e45e-28ad-414a-8077-28a0b4feb284 req-c6bed7fc-a7cf-4ce8-9ccc-8ac9a6247847 service nova] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Updating instance_info_cache with network_info: [{"id": "58f0082f-9f4d-42c5-9569-faf668cc281d", "address": "fa:16:3e:97:bd:d9", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f0082f-9f", "ovs_interfaceid": "58f0082f-9f4d-42c5-9569-faf668cc281d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:07:09.958832 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:07:09.961036 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329229.9607177, aa3f5a78-fb82-4e21-8ebf-90bf48a122be => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:07:09.961219 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] VM Resumed (Lifecycle Event)
May 21 02:07:09.973551 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Updating instance_info_cache with network_info: [{"id": "41d7cad8-3b46-47b2-b205-65f7607047cd", "address": "fa:16:3e:ce:d8:84", "network": {"id": "b32cfb32-7b1e-4cc7-b35b-a86447f00a8a", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-397130825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "549d365926ce49efa4c4bf50c7bbbbaa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d7cad8-3b", "ovs_interfaceid": "41d7cad8-3b46-47b2-b205-65f7607047cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:07:10.154499 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-610ea503-050b-42dd-b0af-dd5e0fc30cf9 req-dcdec703-9ddc-49ae-860a-a7d44d95a20b service nova] Releasing lock "refresh_cache-b646159a-f806-487d-8a14-0aa8e2438f2b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:07:10.287340 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a6db7d6e-e9be-4dfc-a1fd-ffba1c93ae8f req-e167b2c4-3cae-4a75-88bd-2713936a3953 service nova] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Received event network-vif-deleted-1f2f0fc8-f7e3-4579-8d3a-53ba1117725c {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:10.399566 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1fc59604-3ed3-466b-8b49-49f1c800e490 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:07:10.402082 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-1fc59604-3ed3-466b-8b49-49f1c800e490 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:07:10.430666 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1e91e45e-28ad-414a-8077-28a0b4feb284 req-c6bed7fc-a7cf-4ce8-9ccc-8ac9a6247847 service nova] Releasing lock "refresh_cache-609b1611-3b05-4b86-8bf3-85f16f199d80" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:07:10.430892 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1e91e45e-28ad-414a-8077-28a0b4feb284 req-c6bed7fc-a7cf-4ce8-9ccc-8ac9a6247847 service nova] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Received event network-changed-41d7cad8-3b46-47b2-b205-65f7607047cd {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:10.431094 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1e91e45e-28ad-414a-8077-28a0b4feb284 req-c6bed7fc-a7cf-4ce8-9ccc-8ac9a6247847 service nova] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Refreshing instance network info cache due to event network-changed-41d7cad8-3b46-47b2-b205-65f7607047cd. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:07:10.431225 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1e91e45e-28ad-414a-8077-28a0b4feb284 req-c6bed7fc-a7cf-4ce8-9ccc-8ac9a6247847 service nova] Acquiring lock "refresh_cache-2b990342-3aef-4ea5-a3bb-c776f4dd8567" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:07:10.474205 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:07:10.480553 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Releasing lock "refresh_cache-2b990342-3aef-4ea5-a3bb-c776f4dd8567" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:07:10.480553 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Instance network_info: |[{"id": "41d7cad8-3b46-47b2-b205-65f7607047cd", "address": "fa:16:3e:ce:d8:84", "network": {"id": "b32cfb32-7b1e-4cc7-b35b-a86447f00a8a", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-397130825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "549d365926ce49efa4c4bf50c7bbbbaa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d7cad8-3b", "ovs_interfaceid": "41d7cad8-3b46-47b2-b205-65f7607047cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:07:10.481030 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1e91e45e-28ad-414a-8077-28a0b4feb284 req-c6bed7fc-a7cf-4ce8-9ccc-8ac9a6247847 service nova] Acquired lock "refresh_cache-2b990342-3aef-4ea5-a3bb-c776f4dd8567" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:07:10.485408 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:07:10.485589 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-1e91e45e-28ad-414a-8077-28a0b4feb284 req-c6bed7fc-a7cf-4ce8-9ccc-8ac9a6247847 service nova] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Refreshing network info cache for port 41d7cad8-3b46-47b2-b205-65f7607047cd {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:07:10.486167 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Start _get_guest_xml network_info=[{"id": "41d7cad8-3b46-47b2-b205-65f7607047cd", "address": "fa:16:3e:ce:d8:84", "network": {"id": "b32cfb32-7b1e-4cc7-b35b-a86447f00a8a", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-397130825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "549d365926ce49efa4c4bf50c7bbbbaa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d7cad8-3b", "ovs_interfaceid": "41d7cad8-3b46-47b2-b205-65f7607047cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:07:10.491195 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:07:10.492405 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-VolumesBackupsTest-instance-573454998', uuid='2b990342-3aef-4ea5-a3bb-c776f4dd8567'), owner=OwnerMeta(userid='09298d250fae40f1adea3cae800dd569', username='tempest-VolumesBackupsTest-958095449-project-member', projectid='549d365926ce49efa4c4bf50c7bbbbaa', projectname='tempest-VolumesBackupsTest-958095449'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "41d7cad8-3b46-47b2-b205-65f7607047cd", "address": "fa:16:3e:ce:d8:84", "network": {"id": "b32cfb32-7b1e-4cc7-b35b-a86447f00a8a", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-397130825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "549d365926ce49efa4c4bf50c7bbbbaa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d7cad8-3b", "ovs_interfaceid": "41d7cad8-3b46-47b2-b205-65f7607047cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329230.4920156) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:07:10.494008 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:07:10.494270 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:07:10.495049 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:07:10.495199 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:07:10.496207 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:07:10.496511 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:07:10.496674 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:07:10.496774 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:07:10.496880 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:07:10.496972 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:07:10.497075 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:07:10.497203 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:07:10.497297 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:07:10.497398 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:07:10.497516 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:07:10.497653 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:07:10.513733 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:07:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-573454998',display_name='tempest-VolumesBackupsTest-instance-573454998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumesbackupstest-instance-573454998',id=55,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODTnrSfYlLjY+V7nraFwENpg5bQmjf0ijpUgRoewNQoF/FmZb9TUmvTjvT4s5ueJQ8sxHWmnMHawqz0E2O5zNIwl/VaAW+AZ8vdztbc6KTcfPaU4IZa2Z6AOZ7nUXJufg==',key_name='tempest-keypair-1875128130',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='549d365926ce49efa4c4bf50c7bbbbaa',ramdisk_id='',reservation_id='r-wudu8130',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-958095449',owner_user_name='tempest-VolumesBackupsTest-958095449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:07:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09298d250fae40f1adea3cae800dd569',uuid=2b990342-3aef-4ea5-a3bb-c776f4dd8567,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41d7cad8-3b46-47b2-b205-65f7607047cd", "address": "fa:16:3e:ce:d8:84", "network": {"id": "b32cfb32-7b1e-4cc7-b35b-a86447f00a8a", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-397130825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "549d365926ce49efa4c4bf50c7bbbbaa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d7cad8-3b", "ovs_interfaceid": "41d7cad8-3b46-47b2-b205-65f7607047cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:07:10.514194 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Converting VIF {"id": "41d7cad8-3b46-47b2-b205-65f7607047cd", "address": "fa:16:3e:ce:d8:84", "network": {"id": "b32cfb32-7b1e-4cc7-b35b-a86447f00a8a", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-397130825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "549d365926ce49efa4c4bf50c7bbbbaa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d7cad8-3b", "ovs_interfaceid": "41d7cad8-3b46-47b2-b205-65f7607047cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:07:10.514823 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:d8:84,bridge_name='br-int',has_traffic_filtering=True,id=41d7cad8-3b46-47b2-b205-65f7607047cd,network=Network(b32cfb32-7b1e-4cc7-b35b-a86447f00a8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d7cad8-3b') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:07:10.515408 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lazy-loading 'pci_devices' on Instance uuid 2b990342-3aef-4ea5-a3bb-c776f4dd8567 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:07:10.879716 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-01bc56fc-74e7-495b-8fe8-0e50a6ea01c7 req-f982aa4d-64bc-46ea-a940-850a6bd4d8f7 service nova] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Received event network-changed-2df7e0cb-dcdb-4934-82e5-97157bb2e5a5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:10.880585 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-01bc56fc-74e7-495b-8fe8-0e50a6ea01c7 req-f982aa4d-64bc-46ea-a940-850a6bd4d8f7 service nova] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Refreshing instance network info cache due to event network-changed-2df7e0cb-dcdb-4934-82e5-97157bb2e5a5. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:07:10.880585 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-01bc56fc-74e7-495b-8fe8-0e50a6ea01c7 req-f982aa4d-64bc-46ea-a940-850a6bd4d8f7 service nova] Acquiring lock "refresh_cache-b6df4554-8490-4d5a-9d4d-acfd46419cb3" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:07:10.880585 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-01bc56fc-74e7-495b-8fe8-0e50a6ea01c7 req-f982aa4d-64bc-46ea-a940-850a6bd4d8f7 service nova] Acquired lock "refresh_cache-b6df4554-8490-4d5a-9d4d-acfd46419cb3" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:07:10.880585 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-01bc56fc-74e7-495b-8fe8-0e50a6ea01c7 req-f982aa4d-64bc-46ea-a940-850a6bd4d8f7 service nova] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Refreshing network info cache for port 2df7e0cb-dcdb-4934-82e5-97157bb2e5a5 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:07:10.904205 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-1fc59604-3ed3-466b-8b49-49f1c800e490 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:07:10.991572 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-1e91e45e-28ad-414a-8077-28a0b4feb284 req-c6bed7fc-a7cf-4ce8-9ccc-8ac9a6247847 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:11.018612 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] End _get_guest_xml xml=<domain type="qemu">
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:   <uuid>2b990342-3aef-4ea5-a3bb-c776f4dd8567</uuid>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:   <name>instance-00000037</name>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:       <nova:name>tempest-VolumesBackupsTest-instance-573454998</nova:name>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:07:10</nova:creationTime>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:         <nova:user uuid="09298d250fae40f1adea3cae800dd569">tempest-VolumesBackupsTest-958095449-project-member</nova:user>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:         <nova:project uuid="549d365926ce49efa4c4bf50c7bbbbaa">tempest-VolumesBackupsTest-958095449</nova:project>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:         <nova:port uuid="41d7cad8-3b46-47b2-b205-65f7607047cd">
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:     <system>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:       <entry name="serial">2b990342-3aef-4ea5-a3bb-c776f4dd8567</entry>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:       <entry name="uuid">2b990342-3aef-4ea5-a3bb-c776f4dd8567</entry>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:     </system>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:   <os>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:   </os>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:   <features>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:   </features>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:   <devices>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/2b990342-3aef-4ea5-a3bb-c776f4dd8567/disk"/>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:     </disk>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/2b990342-3aef-4ea5-a3bb-c776f4dd8567/disk.config"/>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:     </disk>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:ce:d8:84"/>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:       <target dev="tap41d7cad8-3b"/>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:     </interface>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/2b990342-3aef-4ea5-a3bb-c776f4dd8567/console.log" append="off"/>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:     </serial>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:     <video>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:     </video>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:     </rng>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:   </devices>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]: </domain>
May 21 02:07:11.018612 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:07:11.022579 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Preparing to wait for external event network-vif-plugged-41d7cad8-3b46-47b2-b205-65f7607047cd {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:07:11.022579 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Acquiring lock "2b990342-3aef-4ea5-a3bb-c776f4dd8567-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:11.022579 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "2b990342-3aef-4ea5-a3bb-c776f4dd8567-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:11.022579 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "2b990342-3aef-4ea5-a3bb-c776f4dd8567-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:11.022579 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:07:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-573454998',display_name='tempest-VolumesBackupsTest-instance-573454998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumesbackupstest-instance-573454998',id=55,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODTnrSfYlLjY+V7nraFwENpg5bQmjf0ijpUgRoewNQoF/FmZb9TUmvTjvT4s5ueJQ8sxHWmnMHawqz0E2O5zNIwl/VaAW+AZ8vdztbc6KTcfPaU4IZa2Z6AOZ7nUXJufg==',key_name='tempest-keypair-1875128130',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='549d365926ce49efa4c4bf50c7bbbbaa',ramdisk_id='',reservation_id='r-wudu8130',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-958095449',owner_user_name='tempest-VolumesBackupsTest-958095449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:07:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09298d250fae40f1adea3cae800dd569',uuid=2b990342-3aef-4ea5-a3bb-c776f4dd8567,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41d7cad8-3b46-47b2-b205-65f7607047cd", "address": "fa:16:3e:ce:d8:84", "network": {"id": "b32cfb32-7b1e-4cc7-b35b-a86447f00a8a", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-397130825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "549d365926ce49efa4c4bf50c7bbbbaa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d7cad8-3b", "ovs_interfaceid": "41d7cad8-3b46-47b2-b205-65f7607047cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:07:11.022579 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Converting VIF {"id": "41d7cad8-3b46-47b2-b205-65f7607047cd", "address": "fa:16:3e:ce:d8:84", "network": {"id": "b32cfb32-7b1e-4cc7-b35b-a86447f00a8a", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-397130825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "549d365926ce49efa4c4bf50c7bbbbaa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d7cad8-3b", "ovs_interfaceid": "41d7cad8-3b46-47b2-b205-65f7607047cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:07:11.022579 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:d8:84,bridge_name='br-int',has_traffic_filtering=True,id=41d7cad8-3b46-47b2-b205-65f7607047cd,network=Network(b32cfb32-7b1e-4cc7-b35b-a86447f00a8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d7cad8-3b') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:07:11.022579 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:d8:84,bridge_name='br-int',has_traffic_filtering=True,id=41d7cad8-3b46-47b2-b205-65f7607047cd,network=Network(b32cfb32-7b1e-4cc7-b35b-a86447f00a8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d7cad8-3b') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:07:11.022579 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:11.022579 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:07:11.022579 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:07:11.024648 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:11.025033 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f205d6a6-186c-5d68-a192-a25b5eb1044f', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:07:11.027065 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:11.027803 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:07:11.030660 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:11.031218 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41d7cad8-3b, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:07:11.031480 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap41d7cad8-3b, col_values=(('qos', UUID('67e4e551-8088-4218-bb2a-1a00262391f9')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:07:11.031692 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap41d7cad8-3b, col_values=(('external_ids', {'iface-id': '41d7cad8-3b46-47b2-b205-65f7607047cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:d8:84', 'vm-uuid': '2b990342-3aef-4ea5-a3bb-c776f4dd8567'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:07:11.032963 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:11.034630 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:07:11.041193 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:11.042823 np0000001127 nova-compute[98206]: INFO os_vif [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:d8:84,bridge_name='br-int',has_traffic_filtering=True,id=41d7cad8-3b46-47b2-b205-65f7607047cd,network=Network(b32cfb32-7b1e-4cc7-b35b-a86447f00a8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d7cad8-3b')
May 21 02:07:11.383121 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-01bc56fc-74e7-495b-8fe8-0e50a6ea01c7 req-f982aa4d-64bc-46ea-a940-850a6bd4d8f7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:11.402420 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-1e91e45e-28ad-414a-8077-28a0b4feb284 req-c6bed7fc-a7cf-4ce8-9ccc-8ac9a6247847 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:11.424330 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1fc59604-3ed3-466b-8b49-49f1c800e490 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.725s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:11.528342 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-1fc59604-3ed3-466b-8b49-49f1c800e490 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Deleted allocations for instance 5c34ef68-490d-42c1-8e1a-1913b3b183e7
May 21 02:07:11.600024 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-1e91e45e-28ad-414a-8077-28a0b4feb284 req-c6bed7fc-a7cf-4ce8-9ccc-8ac9a6247847 service nova] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Updated VIF entry in instance network info cache for port 41d7cad8-3b46-47b2-b205-65f7607047cd. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:07:11.600871 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-1e91e45e-28ad-414a-8077-28a0b4feb284 req-c6bed7fc-a7cf-4ce8-9ccc-8ac9a6247847 service nova] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Updating instance_info_cache with network_info: [{"id": "41d7cad8-3b46-47b2-b205-65f7607047cd", "address": "fa:16:3e:ce:d8:84", "network": {"id": "b32cfb32-7b1e-4cc7-b35b-a86447f00a8a", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-397130825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "549d365926ce49efa4c4bf50c7bbbbaa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d7cad8-3b", "ovs_interfaceid": "41d7cad8-3b46-47b2-b205-65f7607047cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:07:11.640455 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:11.821229 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-01bc56fc-74e7-495b-8fe8-0e50a6ea01c7 req-f982aa4d-64bc-46ea-a940-850a6bd4d8f7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:11.932824 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:12.037756 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-01bc56fc-74e7-495b-8fe8-0e50a6ea01c7 req-f982aa4d-64bc-46ea-a940-850a6bd4d8f7 service nova] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Updated VIF entry in instance network info cache for port 2df7e0cb-dcdb-4934-82e5-97157bb2e5a5. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:07:12.039755 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-01bc56fc-74e7-495b-8fe8-0e50a6ea01c7 req-f982aa4d-64bc-46ea-a940-850a6bd4d8f7 service nova] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Updating instance_info_cache with network_info: [{"id": "2df7e0cb-dcdb-4934-82e5-97157bb2e5a5", "address": "fa:16:3e:65:65:57", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df7e0cb-dc", "ovs_interfaceid": "2df7e0cb-dcdb-4934-82e5-97157bb2e5a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:07:12.102958 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1e91e45e-28ad-414a-8077-28a0b4feb284 req-c6bed7fc-a7cf-4ce8-9ccc-8ac9a6247847 service nova] Releasing lock "refresh_cache-2b990342-3aef-4ea5-a3bb-c776f4dd8567" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:07:12.432533 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:12.432533 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:12.543492 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-01bc56fc-74e7-495b-8fe8-0e50a6ea01c7 req-f982aa4d-64bc-46ea-a940-850a6bd4d8f7 service nova] Releasing lock "refresh_cache-b6df4554-8490-4d5a-9d4d-acfd46419cb3" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:07:12.544025 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1fc59604-3ed3-466b-8b49-49f1c800e490 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "5c34ef68-490d-42c1-8e1a-1913b3b183e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.323s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:12.573846 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:07:12.574026 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:07:12.574194 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] No VIF found with MAC fa:16:3e:ce:d8:84, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:07:12.574743 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Using config drive
May 21 02:07:12.933767 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:07:12.995539 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d19fdb39-0b41-4e78-875d-ea40822e7c65 req-566c5f5b-8314-4ab3-b99e-692f855746a7 service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Received event network-changed-2b286fbf-a6fe-4dcc-af12-2521cf154dbb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:12.995539 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d19fdb39-0b41-4e78-875d-ea40822e7c65 req-566c5f5b-8314-4ab3-b99e-692f855746a7 service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Refreshing instance network info cache due to event network-changed-2b286fbf-a6fe-4dcc-af12-2521cf154dbb. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:07:12.995539 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d19fdb39-0b41-4e78-875d-ea40822e7c65 req-566c5f5b-8314-4ab3-b99e-692f855746a7 service nova] Acquiring lock "refresh_cache-aa3f5a78-fb82-4e21-8ebf-90bf48a122be" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:07:12.995539 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d19fdb39-0b41-4e78-875d-ea40822e7c65 req-566c5f5b-8314-4ab3-b99e-692f855746a7 service nova] Acquired lock "refresh_cache-aa3f5a78-fb82-4e21-8ebf-90bf48a122be" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:07:12.995539 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-d19fdb39-0b41-4e78-875d-ea40822e7c65 req-566c5f5b-8314-4ab3-b99e-692f855746a7 service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Refreshing network info cache for port 2b286fbf-a6fe-4dcc-af12-2521cf154dbb {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:07:13.083380 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:13.273059 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Creating config drive at /opt/stack/data/nova/instances/2b990342-3aef-4ea5-a3bb-c776f4dd8567/disk.config
May 21 02:07:13.279497 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2b990342-3aef-4ea5-a3bb-c776f4dd8567/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpj099_lr7 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:13.346788 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2b990342-3aef-4ea5-a3bb-c776f4dd8567/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpj099_lr7" returned: 0 in 0.068s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:13.498417 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-d19fdb39-0b41-4e78-875d-ea40822e7c65 req-566c5f5b-8314-4ab3-b99e-692f855746a7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:13.523773 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:13.524114 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:13.530852 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:07:13.530957 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Claim successful on node np0000001127
May 21 02:07:13.554365 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "0b9a1a2a-77bd-4fe9-ae88-344c193980f5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:13.554810 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "0b9a1a2a-77bd-4fe9-ae88-344c193980f5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:13.849641 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:13.878235 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:13.895188 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-d19fdb39-0b41-4e78-875d-ea40822e7c65 req-566c5f5b-8314-4ab3-b99e-692f855746a7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:13.902041 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:13.978234 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:14.057693 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Detaching volume 53a7a7d6-7bab-4974-8121-00c91a9de3c9
May 21 02:07:14.094864 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-d19fdb39-0b41-4e78-875d-ea40822e7c65 req-566c5f5b-8314-4ab3-b99e-692f855746a7 service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Updated VIF entry in instance network info cache for port 2b286fbf-a6fe-4dcc-af12-2521cf154dbb. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:07:14.095382 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-d19fdb39-0b41-4e78-875d-ea40822e7c65 req-566c5f5b-8314-4ab3-b99e-692f855746a7 service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Updating instance_info_cache with network_info: [{"id": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "address": "fa:16:3e:db:08:dd", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b286fbf-a6", "ovs_interfaceid": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:07:14.141692 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Attempting to driver detach volume 53a7a7d6-7bab-4974-8121-00c91a9de3c9 from mountpoint /dev/vdb
May 21 02:07:14.163249 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Found disk vdb by alias ua-53a7a7d6-7bab-4974-8121-00c91a9de3c9 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:07:14.170438 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Found disk vdb by alias ua-53a7a7d6-7bab-4974-8121-00c91a9de3c9 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:07:14.170732 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Attempting to detach device vdb from instance 0b9a1a2a-77bd-4fe9-ae88-344c193980f5 from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 02:07:14.171798 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:07:14.171798 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:07:14.171798 np0000001127 nova-compute[98206]:   <alias name="ua-53a7a7d6-7bab-4974-8121-00c91a9de3c9"/>
May 21 02:07:14.171798 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-1"/>
May 21 02:07:14.171798 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:07:14.171798 np0000001127 nova-compute[98206]:   <serial>53a7a7d6-7bab-4974-8121-00c91a9de3c9</serial>
May 21 02:07:14.171798 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:07:14.171798 np0000001127 nova-compute[98206]: </disk>
May 21 02:07:14.171798 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:07:14.194734 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Successfully detached device vdb from instance 0b9a1a2a-77bd-4fe9-ae88-344c193980f5 from the persistent domain config.
May 21 02:07:14.194734 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] (1/8): Attempting to detach device vdb with device alias ua-53a7a7d6-7bab-4974-8121-00c91a9de3c9 from instance 0b9a1a2a-77bd-4fe9-ae88-344c193980f5 from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 02:07:14.194734 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:07:14.194734 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:07:14.194734 np0000001127 nova-compute[98206]:   <alias name="ua-53a7a7d6-7bab-4974-8121-00c91a9de3c9"/>
May 21 02:07:14.194734 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-1"/>
May 21 02:07:14.194734 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:07:14.194734 np0000001127 nova-compute[98206]:   <serial>53a7a7d6-7bab-4974-8121-00c91a9de3c9</serial>
May 21 02:07:14.194734 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:07:14.194734 np0000001127 nova-compute[98206]: </disk>
May 21 02:07:14.194734 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:07:14.279897 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:14.286838 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:14.289720 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:14.320746 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:14.600182 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d19fdb39-0b41-4e78-875d-ea40822e7c65 req-566c5f5b-8314-4ab3-b99e-692f855746a7 service nova] Releasing lock "refresh_cache-aa3f5a78-fb82-4e21-8ebf-90bf48a122be" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:07:14.853853 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779329234.8533504, 0b9a1a2a-77bd-4fe9-ae88-344c193980f5 => ua-53a7a7d6-7bab-4974-8121-00c91a9de3c9> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 02:07:14.854535 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-53a7a7d6-7bab-4974-8121-00c91a9de3c9 for instance 0b9a1a2a-77bd-4fe9-ae88-344c193980f5 {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 02:07:14.861320 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Successfully detached device vdb from instance 0b9a1a2a-77bd-4fe9-ae88-344c193980f5 from the live domain config.
May 21 02:07:14.867210 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:07:14.867725 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9', 'iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '53a7a7d6-7bab-4974-8121-00c91a9de3c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:07:14.867948 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:07:14.869058 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:07:14.869538 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9', 'iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '53a7a7d6-7bab-4974-8121-00c91a9de3c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:07:14.869970 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:07:14.912353 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:14.912353 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:14.912353 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:07:14.912353 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:07:14.912353 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:14.912353 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:14.912353 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:14.912353 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:14.912353 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:14.912353 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:14.912353 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:07:14.912744 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:14.912744 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:14.912744 np0000001127 nova-compute[98206]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:07:14.912744 np0000001127 nova-compute[98206]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9 (non-flash)
May 21 02:07:14.912744 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:14.912744 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:14.912744 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:14.912744 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:14.912744 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:14.912744 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:14.912744 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:07:14.913038 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', '103'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9', '106'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435', '115'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36', '117'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '95')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:07:14.913112 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9', '107')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:07:14.915034 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9', '106')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:07:14.916486 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c5bbb00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9'): ({'sdd'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:07:14.916846 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Removing multipathed devices sde, sdd {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:07:14.917934 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Flush multipath device 3300000009c7c166a {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:07:14.952321 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:07:14.969398 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329234.96797, 2b990342-3aef-4ea5-a3bb-c776f4dd8567 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:07:14.969398 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] VM Started (Lifecycle Event)
May 21 02:07:14.997840 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:07:15.040703 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:07:15.040925 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:07:15.044420 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:07:15.059922 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:07:15.060112 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:07:15.073301 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:15.113142 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bf5b8cb7-4642-49e8-a592-9cb5d32a80c9 req-56270be0-037e-48a1-b6ad-907b4af5b9f7 service nova] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Received event network-vif-plugged-41d7cad8-3b46-47b2-b205-65f7607047cd {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:15.114459 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bf5b8cb7-4642-49e8-a592-9cb5d32a80c9 req-56270be0-037e-48a1-b6ad-907b4af5b9f7 service nova] Acquiring lock "2b990342-3aef-4ea5-a3bb-c776f4dd8567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:15.114459 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bf5b8cb7-4642-49e8-a592-9cb5d32a80c9 req-56270be0-037e-48a1-b6ad-907b4af5b9f7 service nova] Lock "2b990342-3aef-4ea5-a3bb-c776f4dd8567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:15.114672 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bf5b8cb7-4642-49e8-a592-9cb5d32a80c9 req-56270be0-037e-48a1-b6ad-907b4af5b9f7 service nova] Lock "2b990342-3aef-4ea5-a3bb-c776f4dd8567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:15.115292 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bf5b8cb7-4642-49e8-a592-9cb5d32a80c9 req-56270be0-037e-48a1-b6ad-907b4af5b9f7 service nova] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Processing event network-vif-plugged-41d7cad8-3b46-47b2-b205-65f7607047cd {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:07:15.116789 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:07:15.118156 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 107, target: iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9, portal: 192.168.40.100,3260]
May 21 02:07:15.118156 np0000001127 nova-compute[98206]: Logout of [sid: 107, target: iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9, portal: 192.168.40.100,3260] successful.
May 21 02:07:15.118156 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:15.124196 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:07:15.128573 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Instance spawned successfully.
May 21 02:07:15.129718 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:07:15.154782 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:15.162090 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:15.176542 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:15.218091 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 106, target: iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9, portal: 192.168.50.100,3260]
May 21 02:07:15.218091 np0000001127 nova-compute[98206]: Logout of [sid: 106, target: iqn.2023-03.storpool.com:os--volume-53a7a7d6-7bab-4974-8121-00c91a9de3c9, portal: 192.168.50.100,3260] successful.
May 21 02:07:15.218091 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:15.240996 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:15.242215 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:07:15.242215 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] <== disconnect_volume: return (374ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:07:15.242215 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:07:15.426181 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:07:15.426421 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:07:15.471927 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:07:15.475448 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:07:15.637239 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:15.637704 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:15.637831 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:15.638160 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:15.638628 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:15.639010 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:15.803323 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lazy-loading 'flavor' on Instance uuid 0b9a1a2a-77bd-4fe9-ae88-344c193980f5 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:07:15.929751 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:07:15.979509 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:07:15.979909 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329235.979627, 2b990342-3aef-4ea5-a3bb-c776f4dd8567 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:07:15.980076 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] VM Paused (Lifecycle Event)
May 21 02:07:16.033201 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:16.145381 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Took 7.54 seconds to spawn the instance on the hypervisor.
May 21 02:07:16.145573 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:07:16.438097 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.914s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:16.438722 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:07:16.483562 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:07:16.486564 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329236.4858196, 2b990342-3aef-4ea5-a3bb-c776f4dd8567 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:07:16.486564 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] VM Resumed (Lifecycle Event)
May 21 02:07:16.643092 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:16.663571 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Took 13.60 seconds to build instance.
May 21 02:07:16.811002 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-009cb150-d91b-4b46-8cd1-1dd8322f2688 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "0b9a1a2a-77bd-4fe9-ae88-344c193980f5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.256s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:16.948048 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:07:16.948297 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:07:16.948647 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:16.948909 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:16.990374 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:07:16.992630 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:07:17.046183 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '049d6c8cccfa4ae38d78a88ef5be0f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848912b0c0e94d2795bb2332daf1730e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:07:17.167271 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "2b990342-3aef-4ea5-a3bb-c776f4dd8567" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.110s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:17.216312 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c1621f10-0155-4051-9409-f81f7bcb43a3 req-4e7dbe6f-8c94-4f48-9094-f726f06ee0a6 service nova] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Received event network-vif-plugged-41d7cad8-3b46-47b2-b205-65f7607047cd {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:17.216568 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c1621f10-0155-4051-9409-f81f7bcb43a3 req-4e7dbe6f-8c94-4f48-9094-f726f06ee0a6 service nova] Acquiring lock "2b990342-3aef-4ea5-a3bb-c776f4dd8567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:17.216727 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c1621f10-0155-4051-9409-f81f7bcb43a3 req-4e7dbe6f-8c94-4f48-9094-f726f06ee0a6 service nova] Lock "2b990342-3aef-4ea5-a3bb-c776f4dd8567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:17.216931 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c1621f10-0155-4051-9409-f81f7bcb43a3 req-4e7dbe6f-8c94-4f48-9094-f726f06ee0a6 service nova] Lock "2b990342-3aef-4ea5-a3bb-c776f4dd8567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:17.217130 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c1621f10-0155-4051-9409-f81f7bcb43a3 req-4e7dbe6f-8c94-4f48-9094-f726f06ee0a6 service nova] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] No waiting events found dispatching network-vif-plugged-41d7cad8-3b46-47b2-b205-65f7607047cd {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:07:17.217222 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-c1621f10-0155-4051-9409-f81f7bcb43a3 req-4e7dbe6f-8c94-4f48-9094-f726f06ee0a6 service nova] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Received unexpected event network-vif-plugged-41d7cad8-3b46-47b2-b205-65f7607047cd for instance with vm_state active and task_state None.
May 21 02:07:17.451020 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:07:17.661440 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-ec822b30-2d59-4439-ac3e-c5d119ab1a75 req-4634c88b-a154-4f17-9a5f-17f53a8623b5 service nova] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Received event network-changed-41d7cad8-3b46-47b2-b205-65f7607047cd {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:17.662222 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-ec822b30-2d59-4439-ac3e-c5d119ab1a75 req-4634c88b-a154-4f17-9a5f-17f53a8623b5 service nova] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Refreshing instance network info cache due to event network-changed-41d7cad8-3b46-47b2-b205-65f7607047cd. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:07:17.662459 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ec822b30-2d59-4439-ac3e-c5d119ab1a75 req-4634c88b-a154-4f17-9a5f-17f53a8623b5 service nova] Acquiring lock "refresh_cache-2b990342-3aef-4ea5-a3bb-c776f4dd8567" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:07:17.662633 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ec822b30-2d59-4439-ac3e-c5d119ab1a75 req-4634c88b-a154-4f17-9a5f-17f53a8623b5 service nova] Acquired lock "refresh_cache-2b990342-3aef-4ea5-a3bb-c776f4dd8567" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:07:17.662803 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-ec822b30-2d59-4439-ac3e-c5d119ab1a75 req-4634c88b-a154-4f17-9a5f-17f53a8623b5 service nova] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Refreshing network info cache for port 41d7cad8-3b46-47b2-b205-65f7607047cd {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:07:17.680322 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Successfully created port: ad1def3b-4657-4632-bd3a-910cdca9a1a4 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:07:17.955748 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:07:18.005379 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-131fb78c-24fd-4862-9b91-4620092cec33 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "0b9a1a2a-77bd-4fe9-ae88-344c193980f5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:18.005379 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-131fb78c-24fd-4862-9b91-4620092cec33 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "0b9a1a2a-77bd-4fe9-ae88-344c193980f5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:18.005379 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-131fb78c-24fd-4862-9b91-4620092cec33 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "0b9a1a2a-77bd-4fe9-ae88-344c193980f5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:18.005379 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-131fb78c-24fd-4862-9b91-4620092cec33 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "0b9a1a2a-77bd-4fe9-ae88-344c193980f5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:18.005379 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-131fb78c-24fd-4862-9b91-4620092cec33 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "0b9a1a2a-77bd-4fe9-ae88-344c193980f5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:18.007337 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-131fb78c-24fd-4862-9b91-4620092cec33 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Terminating instance
May 21 02:07:18.169210 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-ec822b30-2d59-4439-ac3e-c5d119ab1a75 req-4634c88b-a154-4f17-9a5f-17f53a8623b5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:18.391710 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Successfully updated port: ad1def3b-4657-4632-bd3a-910cdca9a1a4 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:07:18.516994 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-131fb78c-24fd-4862-9b91-4620092cec33 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:07:18.543743 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:18.550204 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:18.576709 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:18.598022 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-ec822b30-2d59-4439-ac3e-c5d119ab1a75 req-4634c88b-a154-4f17-9a5f-17f53a8623b5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:18.602990 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:18.753487 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-ec822b30-2d59-4439-ac3e-c5d119ab1a75 req-4634c88b-a154-4f17-9a5f-17f53a8623b5 service nova] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Updated VIF entry in instance network info cache for port 41d7cad8-3b46-47b2-b205-65f7607047cd. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:07:18.753487 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-ec822b30-2d59-4439-ac3e-c5d119ab1a75 req-4634c88b-a154-4f17-9a5f-17f53a8623b5 service nova] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Updating instance_info_cache with network_info: [{"id": "41d7cad8-3b46-47b2-b205-65f7607047cd", "address": "fa:16:3e:ce:d8:84", "network": {"id": "b32cfb32-7b1e-4cc7-b35b-a86447f00a8a", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-397130825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "549d365926ce49efa4c4bf50c7bbbbaa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d7cad8-3b", "ovs_interfaceid": "41d7cad8-3b46-47b2-b205-65f7607047cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:07:18.869768 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.998886684999889 future=<Future at 0x71c07c529370 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:07:18.874577 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Instance destroyed successfully.
May 21 02:07:18.874577 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-131fb78c-24fd-4862-9b91-4620092cec33 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lazy-loading 'resources' on Instance uuid 0b9a1a2a-77bd-4fe9-ae88-344c193980f5 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:07:18.893707 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "refresh_cache-c76064e6-3702-4e67-9d4f-ef67cd4b7b22" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:07:18.893809 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquired lock "refresh_cache-c76064e6-3702-4e67-9d4f-ef67cd4b7b22" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:07:18.893965 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:07:18.970245 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:07:18.971917 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:07:18.972232 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Creating image(s)
May 21 02:07:18.972720 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "/opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:18.973680 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "/opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:18.974261 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "/opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:18.974818 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:07:18.977415 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:07:18.981907 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:19.012801 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:19.138826 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.157s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:19.139337 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:19.139883 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:19.140356 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:07:19.147927 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:07:19.148344 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:19.257619 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ec822b30-2d59-4439-ac3e-c5d119ab1a75 req-4634c88b-a154-4f17-9a5f-17f53a8623b5 service nova] Releasing lock "refresh_cache-2b990342-3aef-4ea5-a3bb-c776f4dd8567" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:07:19.278189 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.130s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:19.279026 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:19.324512 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d903fd51-228d-487a-a3f3-a440c9e47ea1 req-c5c45ff9-97f2-42f5-86ef-e50155079dc8 service nova] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Received event network-vif-unplugged-c34ad5a3-ad20-4671-ab11-bf70edb362b5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:19.325994 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d903fd51-228d-487a-a3f3-a440c9e47ea1 req-c5c45ff9-97f2-42f5-86ef-e50155079dc8 service nova] Acquiring lock "0b9a1a2a-77bd-4fe9-ae88-344c193980f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:19.326382 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d903fd51-228d-487a-a3f3-a440c9e47ea1 req-c5c45ff9-97f2-42f5-86ef-e50155079dc8 service nova] Lock "0b9a1a2a-77bd-4fe9-ae88-344c193980f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:19.326590 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d903fd51-228d-487a-a3f3-a440c9e47ea1 req-c5c45ff9-97f2-42f5-86ef-e50155079dc8 service nova] Lock "0b9a1a2a-77bd-4fe9-ae88-344c193980f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:19.326795 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d903fd51-228d-487a-a3f3-a440c9e47ea1 req-c5c45ff9-97f2-42f5-86ef-e50155079dc8 service nova] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] No waiting events found dispatching network-vif-unplugged-c34ad5a3-ad20-4671-ab11-bf70edb362b5 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:07:19.327005 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d903fd51-228d-487a-a3f3-a440c9e47ea1 req-c5c45ff9-97f2-42f5-86ef-e50155079dc8 service nova] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Received event network-vif-unplugged-c34ad5a3-ad20-4671-ab11-bf70edb362b5 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:07:19.359480 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk 1073741824" returned: 0 in 0.081s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:19.359852 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:19.360214 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:19.378674 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-131fb78c-24fd-4862-9b91-4620092cec33 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:05:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1516566059',display_name='tempest-AttachVolumeNegativeTest-server-1516566059',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumenegativetest-server-1516566059',id=42,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK60GwDzIWkkLsJ3BBXNMI8CjzqiSj2NaE3M377DqyweY8FpCw055CJ+9EjHyXCTQvIxN/w3rXX8eyWN7cnTjBVAJJaVTKSXeH/bg36hBixhd3F+0sX73uTOui3mQrmYYA==',key_name='tempest-keypair-1478153749',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:05:18Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d3efe4046d6a442d91b3463e2d99fd7b',ramdisk_id='',reservation_id='r-a3830dnq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1208856611',owner_user_name='tempest-AttachVolumeNegativeTest-1208856611-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:05:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f369771db7dd49da85131c9692833a5a',uuid=0b9a1a2a-77bd-4fe9-ae88-344c193980f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c34ad5a3-ad20-4671-ab11-bf70edb362b5", "address": "fa:16:3e:e1:2e:46", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34ad5a3-ad", "ovs_interfaceid": "c34ad5a3-ad20-4671-ab11-bf70edb362b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:07:19.379303 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-131fb78c-24fd-4862-9b91-4620092cec33 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Converting VIF {"id": "c34ad5a3-ad20-4671-ab11-bf70edb362b5", "address": "fa:16:3e:e1:2e:46", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34ad5a3-ad", "ovs_interfaceid": "c34ad5a3-ad20-4671-ab11-bf70edb362b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:07:19.380677 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-131fb78c-24fd-4862-9b91-4620092cec33 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:2e:46,bridge_name='br-int',has_traffic_filtering=True,id=c34ad5a3-ad20-4671-ab11-bf70edb362b5,network=Network(f683b2da-ab41-43e1-a9bb-98914089b4d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc34ad5a3-ad') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:07:19.381124 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-131fb78c-24fd-4862-9b91-4620092cec33 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:2e:46,bridge_name='br-int',has_traffic_filtering=True,id=c34ad5a3-ad20-4671-ab11-bf70edb362b5,network=Network(f683b2da-ab41-43e1-a9bb-98914089b4d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc34ad5a3-ad') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:07:19.387199 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:19.388174 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc34ad5a3-ad, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:07:19.389873 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:19.391199 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:19.393561 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:19.393687 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=23e433c0-6afd-4e13-a4c9-8a8a1e957bca) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:07:19.394313 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:19.395173 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:07:19.395223 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:19.403850 np0000001127 nova-compute[98206]: INFO os_vif [None req-131fb78c-24fd-4862-9b91-4620092cec33 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:2e:46,bridge_name='br-int',has_traffic_filtering=True,id=c34ad5a3-ad20-4671-ab11-bf70edb362b5,network=Network(f683b2da-ab41-43e1-a9bb-98914089b4d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc34ad5a3-ad')
May 21 02:07:19.404742 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-131fb78c-24fd-4862-9b91-4620092cec33 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Deleting instance files /opt/stack/data/nova/instances/0b9a1a2a-77bd-4fe9-ae88-344c193980f5_del
May 21 02:07:19.406649 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-131fb78c-24fd-4862-9b91-4620092cec33 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Deletion of /opt/stack/data/nova/instances/0b9a1a2a-77bd-4fe9-ae88-344c193980f5_del complete
May 21 02:07:19.495905 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.136s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:19.497121 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:07:19.497121 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:19.586104 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:07:19.621832 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:19.624036 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Cannot resize image /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:07:19.624421 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:07:19.624623 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Ensure instance console log exists: /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:07:19.632287 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:19.632527 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:19.633290 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:19.790326 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7d0c175f-ac24-4dff-adfb-07555c337524 req-bbdf84f1-897e-4e2b-bc34-61cb208b91d6 service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Received event network-changed-ad1def3b-4657-4632-bd3a-910cdca9a1a4 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:19.790862 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7d0c175f-ac24-4dff-adfb-07555c337524 req-bbdf84f1-897e-4e2b-bc34-61cb208b91d6 service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Refreshing instance network info cache due to event network-changed-ad1def3b-4657-4632-bd3a-910cdca9a1a4. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:07:19.790862 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7d0c175f-ac24-4dff-adfb-07555c337524 req-bbdf84f1-897e-4e2b-bc34-61cb208b91d6 service nova] Acquiring lock "refresh_cache-c76064e6-3702-4e67-9d4f-ef67cd4b7b22" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:07:19.907117 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:19.918395 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-131fb78c-24fd-4862-9b91-4620092cec33 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Took 1.40 seconds to destroy the instance on the hypervisor.
May 21 02:07:19.919328 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-131fb78c-24fd-4862-9b91-4620092cec33 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:07:19.920666 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:07:19.920843 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:07:19.921146 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:20.081354 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:20.248825 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Updating instance_info_cache with network_info: [{"id": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "address": "fa:16:3e:20:ae:96", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1def3b-46", "ovs_interfaceid": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:07:20.753076 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Releasing lock "refresh_cache-c76064e6-3702-4e67-9d4f-ef67cd4b7b22" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:07:20.753076 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Instance network_info: |[{"id": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "address": "fa:16:3e:20:ae:96", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1def3b-46", "ovs_interfaceid": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:07:20.755360 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Start _get_guest_xml network_info=[{"id": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "address": "fa:16:3e:20:ae:96", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1def3b-46", "ovs_interfaceid": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:07:20.756687 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7d0c175f-ac24-4dff-adfb-07555c337524 req-bbdf84f1-897e-4e2b-bc34-61cb208b91d6 service nova] Acquired lock "refresh_cache-c76064e6-3702-4e67-9d4f-ef67cd4b7b22" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:07:20.756882 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-7d0c175f-ac24-4dff-adfb-07555c337524 req-bbdf84f1-897e-4e2b-bc34-61cb208b91d6 service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Refreshing network info cache for port ad1def3b-4657-4632-bd3a-910cdca9a1a4 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:07:20.760043 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:07:20.762134 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='c76064e6-3702-4e67-9d4f-ef67cd4b7b22'), owner=OwnerMeta(userid='049d6c8cccfa4ae38d78a88ef5be0f1b', username='tempest-AttachVolumeMultiAttachTest-289054175-project-member', projectid='848912b0c0e94d2795bb2332daf1730e', projectname='tempest-AttachVolumeMultiAttachTest-289054175'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "address": "fa:16:3e:20:ae:96", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1def3b-46", "ovs_interfaceid": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329240.761139) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:07:20.764264 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:07:20.765038 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:07:20.767532 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:07:20.767900 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:07:20.769235 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:07:20.770198 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:07:20.770418 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:07:20.770620 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:07:20.770907 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:07:20.771120 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:07:20.771290 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:07:20.771441 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:07:20.773769 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:07:20.774360 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:07:20.774598 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:07:20.774810 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:07:20.810914 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:07:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='multiattach-server-1',id=56,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzu+v5yloohnjet+lpl7Cb5m5YuZdtxheBkBGOMBLLe2AJEatmv/W6U1humbPofoJpKHaVTa0sSri4Ktoz/rRBuEiIFUUGVMQjgWmfd958Eyx52s4Fg6gJyB/ru0BJ+zA==',key_name='tempest-keypair-1890511814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='848912b0c0e94d2795bb2332daf1730e',ramdisk_id='',reservation_id='r-5rppg77m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-289054175',owner_user_name='tempest-AttachVolumeMultiAttachTest-289054175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:07:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='049d6c8cccfa4ae38d78a88ef5be0f1b',uuid=c76064e6-3702-4e67-9d4f-ef67cd4b7b22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "address": "fa:16:3e:20:ae:96", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1def3b-46", "ovs_interfaceid": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:07:20.811429 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converting VIF {"id": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "address": "fa:16:3e:20:ae:96", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1def3b-46", "ovs_interfaceid": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:07:20.812022 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:ae:96,bridge_name='br-int',has_traffic_filtering=True,id=ad1def3b-4657-4632-bd3a-910cdca9a1a4,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad1def3b-46') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:07:20.812690 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lazy-loading 'pci_devices' on Instance uuid c76064e6-3702-4e67-9d4f-ef67cd4b7b22 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:07:21.067278 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:07:21.260201 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-7d0c175f-ac24-4dff-adfb-07555c337524 req-bbdf84f1-897e-4e2b-bc34-61cb208b91d6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:21.316402 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] End _get_guest_xml xml=<domain type="qemu">
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:   <uuid>c76064e6-3702-4e67-9d4f-ef67cd4b7b22</uuid>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:   <name>instance-00000038</name>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:       <nova:name>multiattach-server-1</nova:name>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:07:20</nova:creationTime>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:         <nova:user uuid="049d6c8cccfa4ae38d78a88ef5be0f1b">tempest-AttachVolumeMultiAttachTest-289054175-project-member</nova:user>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:         <nova:project uuid="848912b0c0e94d2795bb2332daf1730e">tempest-AttachVolumeMultiAttachTest-289054175</nova:project>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:         <nova:port uuid="ad1def3b-4657-4632-bd3a-910cdca9a1a4">
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:     <system>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:       <entry name="serial">c76064e6-3702-4e67-9d4f-ef67cd4b7b22</entry>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:       <entry name="uuid">c76064e6-3702-4e67-9d4f-ef67cd4b7b22</entry>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:     </system>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:   <os>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:   </os>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:   <features>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:   </features>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:   <devices>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk"/>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:     </disk>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk.config"/>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:     </disk>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:20:ae:96"/>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:       <target dev="tapad1def3b-46"/>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:     </interface>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/console.log" append="off"/>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:     </serial>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:     <video>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:     </video>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:     </rng>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:   </devices>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]: </domain>
May 21 02:07:21.316402 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:07:21.318368 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Preparing to wait for external event network-vif-plugged-ad1def3b-4657-4632-bd3a-910cdca9a1a4 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:07:21.318368 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:21.319361 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:21.319361 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:21.320539 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:07:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='multiattach-server-1',id=56,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzu+v5yloohnjet+lpl7Cb5m5YuZdtxheBkBGOMBLLe2AJEatmv/W6U1humbPofoJpKHaVTa0sSri4Ktoz/rRBuEiIFUUGVMQjgWmfd958Eyx52s4Fg6gJyB/ru0BJ+zA==',key_name='tempest-keypair-1890511814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='848912b0c0e94d2795bb2332daf1730e',ramdisk_id='',reservation_id='r-5rppg77m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-289054175',owner_user_name='tempest-AttachVolumeMultiAttachTest-289054175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:07:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='049d6c8cccfa4ae38d78a88ef5be0f1b',uuid=c76064e6-3702-4e67-9d4f-ef67cd4b7b22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "address": "fa:16:3e:20:ae:96", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1def3b-46", "ovs_interfaceid": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:07:21.321670 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converting VIF {"id": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "address": "fa:16:3e:20:ae:96", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1def3b-46", "ovs_interfaceid": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:07:21.322683 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:ae:96,bridge_name='br-int',has_traffic_filtering=True,id=ad1def3b-4657-4632-bd3a-910cdca9a1a4,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad1def3b-46') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:07:21.324135 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:ae:96,bridge_name='br-int',has_traffic_filtering=True,id=ad1def3b-4657-4632-bd3a-910cdca9a1a4,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad1def3b-46') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:07:21.324135 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:21.325211 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:07:21.325211 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:07:21.326331 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:21.326331 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ec959fd-0777-558d-a3c4-3bbb00f30e44', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:07:21.327129 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:21.328129 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:07:21.329974 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:21.331680 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:21.331812 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad1def3b-46, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:07:21.332431 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapad1def3b-46, col_values=(('qos', UUID('82ebcb54-f62a-476e-8b3f-bce6772df077')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:07:21.332431 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapad1def3b-46, col_values=(('external_ids', {'iface-id': 'ad1def3b-4657-4632-bd3a-910cdca9a1a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:ae:96', 'vm-uuid': 'c76064e6-3702-4e67-9d4f-ef67cd4b7b22'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:07:21.334294 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:21.334961 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:07:21.345234 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:21.345430 np0000001127 nova-compute[98206]: INFO os_vif [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:ae:96,bridge_name='br-int',has_traffic_filtering=True,id=ad1def3b-4657-4632-bd3a-910cdca9a1a4,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad1def3b-46')
May 21 02:07:21.421784 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-4b5cd071-dbde-465c-9a10-9e253d84859e req-ad454d25-9366-4ae6-95c6-ed26f8430a4f service nova] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Received event network-vif-unplugged-c34ad5a3-ad20-4671-ab11-bf70edb362b5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:21.422390 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4b5cd071-dbde-465c-9a10-9e253d84859e req-ad454d25-9366-4ae6-95c6-ed26f8430a4f service nova] Acquiring lock "0b9a1a2a-77bd-4fe9-ae88-344c193980f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:21.422528 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4b5cd071-dbde-465c-9a10-9e253d84859e req-ad454d25-9366-4ae6-95c6-ed26f8430a4f service nova] Lock "0b9a1a2a-77bd-4fe9-ae88-344c193980f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:21.422637 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4b5cd071-dbde-465c-9a10-9e253d84859e req-ad454d25-9366-4ae6-95c6-ed26f8430a4f service nova] Lock "0b9a1a2a-77bd-4fe9-ae88-344c193980f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:21.422678 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-4b5cd071-dbde-465c-9a10-9e253d84859e req-ad454d25-9366-4ae6-95c6-ed26f8430a4f service nova] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] No waiting events found dispatching network-vif-unplugged-c34ad5a3-ad20-4671-ab11-bf70edb362b5 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:07:21.422801 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-4b5cd071-dbde-465c-9a10-9e253d84859e req-ad454d25-9366-4ae6-95c6-ed26f8430a4f service nova] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Received event network-vif-unplugged-c34ad5a3-ad20-4671-ab11-bf70edb362b5 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:07:21.422958 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-4b5cd071-dbde-465c-9a10-9e253d84859e req-ad454d25-9366-4ae6-95c6-ed26f8430a4f service nova] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Received event network-vif-deleted-c34ad5a3-ad20-4671-ab11-bf70edb362b5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:21.571678 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Took 1.65 seconds to deallocate network for instance.
May 21 02:07:21.644581 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:21.742041 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:21.749182 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-7d0c175f-ac24-4dff-adfb-07555c337524 req-bbdf84f1-897e-4e2b-bc34-61cb208b91d6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:21.866248 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bb325db8-6a4a-4dad-b592-50ec6b1dc856 req-d014e1b8-cecd-4be7-aece-a1d9d1b2dc81 service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Received event network-vif-unplugged-ad1def3b-4657-4632-bd3a-910cdca9a1a4 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:21.866248 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bb325db8-6a4a-4dad-b592-50ec6b1dc856 req-d014e1b8-cecd-4be7-aece-a1d9d1b2dc81 service nova] Acquiring lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:21.866248 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bb325db8-6a4a-4dad-b592-50ec6b1dc856 req-d014e1b8-cecd-4be7-aece-a1d9d1b2dc81 service nova] Lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:21.867996 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bb325db8-6a4a-4dad-b592-50ec6b1dc856 req-d014e1b8-cecd-4be7-aece-a1d9d1b2dc81 service nova] Lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:21.867996 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bb325db8-6a4a-4dad-b592-50ec6b1dc856 req-d014e1b8-cecd-4be7-aece-a1d9d1b2dc81 service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] No event matching network-vif-unplugged-ad1def3b-4657-4632-bd3a-910cdca9a1a4 in dict_keys([('network-vif-plugged', 'ad1def3b-4657-4632-bd3a-910cdca9a1a4')]) {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 21 02:07:21.867996 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-bb325db8-6a4a-4dad-b592-50ec6b1dc856 req-d014e1b8-cecd-4be7-aece-a1d9d1b2dc81 service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Received unexpected event network-vif-unplugged-ad1def3b-4657-4632-bd3a-910cdca9a1a4 for instance with vm_state building and task_state spawning.
May 21 02:07:21.901488 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-7d0c175f-ac24-4dff-adfb-07555c337524 req-bbdf84f1-897e-4e2b-bc34-61cb208b91d6 service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Updated VIF entry in instance network info cache for port ad1def3b-4657-4632-bd3a-910cdca9a1a4. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:07:21.901860 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-7d0c175f-ac24-4dff-adfb-07555c337524 req-bbdf84f1-897e-4e2b-bc34-61cb208b91d6 service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Updating instance_info_cache with network_info: [{"id": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "address": "fa:16:3e:20:ae:96", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1def3b-46", "ovs_interfaceid": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:07:22.079385 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-131fb78c-24fd-4862-9b91-4620092cec33 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:22.079621 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-131fb78c-24fd-4862-9b91-4620092cec33 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:22.404183 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7d0c175f-ac24-4dff-adfb-07555c337524 req-bbdf84f1-897e-4e2b-bc34-61cb208b91d6 service nova] Releasing lock "refresh_cache-c76064e6-3702-4e67-9d4f-ef67cd4b7b22" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:07:22.839751 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-131fb78c-24fd-4862-9b91-4620092cec33 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:07:22.840133 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-131fb78c-24fd-4862-9b91-4620092cec33 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:07:22.882245 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:07:22.882771 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:07:22.882771 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No VIF found with MAC fa:16:3e:20:ae:96, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:07:22.883254 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Using config drive
May 21 02:07:23.345910 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-131fb78c-24fd-4862-9b91-4620092cec33 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:07:23.395505 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:23.411910 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0004759049998028786 future=<Future at 0x71c05864b6e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:07:23.412099 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:07:23.412235 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=10.45619025699989 future=<Future at 0x71c07c529370 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:07:23.412294 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=10.456063411999821 future=<Future at 0x71c07c529370 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:07:23.413001 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Emitting event <LifecycleEvent: 1779329228.4112756, 5c34ef68-490d-42c1-8e1a-1913b3b183e7 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:07:23.413210 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] VM Stopped (Lifecycle Event)
May 21 02:07:23.542217 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Creating config drive at /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk.config
May 21 02:07:23.546824 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp59ps6g8s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:23.618661 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp59ps6g8s" returned: 0 in 0.072s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:23.851401 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-131fb78c-24fd-4862-9b91-4620092cec33 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.772s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:23.910872 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-131fb78c-24fd-4862-9b91-4620092cec33 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Deleted allocations for instance 0b9a1a2a-77bd-4fe9-ae88-344c193980f5
May 21 02:07:23.917376 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 5c34ef68-490d-42c1-8e1a-1913b3b183e7] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:07:24.155031 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:24.197571 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:24.295084 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:24.375703 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:24.376869 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:24.923460 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-131fb78c-24fd-4862-9b91-4620092cec33 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "0b9a1a2a-77bd-4fe9-ae88-344c193980f5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.920s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:25.004902 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329245.0040998, c76064e6-3702-4e67-9d4f-ef67cd4b7b22 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:07:25.005227 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] VM Started (Lifecycle Event)
May 21 02:07:25.507751 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:07:25.512131 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329245.5118656, c76064e6-3702-4e67-9d4f-ef67cd4b7b22 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:07:25.512331 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] VM Paused (Lifecycle Event)
May 21 02:07:26.014586 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:07:26.017977 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:07:26.278754 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:26.278982 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:26.335061 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:26.520104 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:07:26.646638 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:26.682005 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c89a7b9e-f1ae-4459-a89b-63adb2512d09 req-da7c01f9-b2da-426a-9d6e-c89ef3d2d8ab service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Received event network-vif-plugged-ad1def3b-4657-4632-bd3a-910cdca9a1a4 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:26.682005 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c89a7b9e-f1ae-4459-a89b-63adb2512d09 req-da7c01f9-b2da-426a-9d6e-c89ef3d2d8ab service nova] Acquiring lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:26.682005 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c89a7b9e-f1ae-4459-a89b-63adb2512d09 req-da7c01f9-b2da-426a-9d6e-c89ef3d2d8ab service nova] Lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:26.682005 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c89a7b9e-f1ae-4459-a89b-63adb2512d09 req-da7c01f9-b2da-426a-9d6e-c89ef3d2d8ab service nova] Lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:26.682005 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c89a7b9e-f1ae-4459-a89b-63adb2512d09 req-da7c01f9-b2da-426a-9d6e-c89ef3d2d8ab service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Processing event network-vif-plugged-ad1def3b-4657-4632-bd3a-910cdca9a1a4 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:07:26.682005 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:07:26.689505 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:07:26.690617 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329246.6867497, c76064e6-3702-4e67-9d4f-ef67cd4b7b22 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:07:26.693461 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] VM Resumed (Lifecycle Event)
May 21 02:07:26.698341 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Instance spawned successfully.
May 21 02:07:26.698826 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:07:26.781841 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:07:27.197319 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:07:27.199887 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:07:27.211250 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:27.211517 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:27.212115 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:27.212200 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:27.212582 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:27.212935 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:27.344422 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:27.344707 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:27.347986 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:07:27.348125 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Claim successful on node np0000001127
May 21 02:07:27.702669 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:07:27.718625 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Took 8.75 seconds to spawn the instance on the hypervisor.
May 21 02:07:27.718825 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:07:28.214152 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "511701d6-fac9-4e15-803d-e9038bd1a018" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:28.214152 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "511701d6-fac9-4e15-803d-e9038bd1a018" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:28.236558 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Took 14.79 seconds to build instance.
May 21 02:07:28.715655 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:07:28.740361 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7be89a0c-2012-4a04-a36b-3d932f97e6ec tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.309s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:28.759845 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-723f43ef-20f3-4388-87dc-dcf41810e8eb req-b0cb1e5a-8316-43ae-b2e8-e0f9da990f3b service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Received event network-vif-plugged-ad1def3b-4657-4632-bd3a-910cdca9a1a4 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:28.760481 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-723f43ef-20f3-4388-87dc-dcf41810e8eb req-b0cb1e5a-8316-43ae-b2e8-e0f9da990f3b service nova] Acquiring lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:28.760576 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-723f43ef-20f3-4388-87dc-dcf41810e8eb req-b0cb1e5a-8316-43ae-b2e8-e0f9da990f3b service nova] Lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:28.760675 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-723f43ef-20f3-4388-87dc-dcf41810e8eb req-b0cb1e5a-8316-43ae-b2e8-e0f9da990f3b service nova] Lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:28.760837 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-723f43ef-20f3-4388-87dc-dcf41810e8eb req-b0cb1e5a-8316-43ae-b2e8-e0f9da990f3b service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] No waiting events found dispatching network-vif-plugged-ad1def3b-4657-4632-bd3a-910cdca9a1a4 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:07:28.761000 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-723f43ef-20f3-4388-87dc-dcf41810e8eb req-b0cb1e5a-8316-43ae-b2e8-e0f9da990f3b service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Received unexpected event network-vif-plugged-ad1def3b-4657-4632-bd3a-910cdca9a1a4 for instance with vm_state active and task_state None.
May 21 02:07:28.896732 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-5fa4b0f4-1a3a-4731-9fcb-21b24886bd47 req-e9a06deb-a1e6-41a9-bee5-aa8e1d6d0cd0 service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Received event network-changed-2b286fbf-a6fe-4dcc-af12-2521cf154dbb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:28.896946 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-5fa4b0f4-1a3a-4731-9fcb-21b24886bd47 req-e9a06deb-a1e6-41a9-bee5-aa8e1d6d0cd0 service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Refreshing instance network info cache due to event network-changed-2b286fbf-a6fe-4dcc-af12-2521cf154dbb. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:07:28.897147 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5fa4b0f4-1a3a-4731-9fcb-21b24886bd47 req-e9a06deb-a1e6-41a9-bee5-aa8e1d6d0cd0 service nova] Acquiring lock "refresh_cache-aa3f5a78-fb82-4e21-8ebf-90bf48a122be" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:07:28.897285 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5fa4b0f4-1a3a-4731-9fcb-21b24886bd47 req-e9a06deb-a1e6-41a9-bee5-aa8e1d6d0cd0 service nova] Acquired lock "refresh_cache-aa3f5a78-fb82-4e21-8ebf-90bf48a122be" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:07:28.897787 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-5fa4b0f4-1a3a-4731-9fcb-21b24886bd47 req-e9a06deb-a1e6-41a9-bee5-aa8e1d6d0cd0 service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Refreshing network info cache for port 2b286fbf-a6fe-4dcc-af12-2521cf154dbb {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:07:29.110313 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:07:29.110588 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:07:29.280604 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:29.399755 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-5fa4b0f4-1a3a-4731-9fcb-21b24886bd47 req-e9a06deb-a1e6-41a9-bee5-aa8e1d6d0cd0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:29.613234 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:07:29.735164 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-5fa4b0f4-1a3a-4731-9fcb-21b24886bd47 req-e9a06deb-a1e6-41a9-bee5-aa8e1d6d0cd0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:29.869004 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-5fa4b0f4-1a3a-4731-9fcb-21b24886bd47 req-e9a06deb-a1e6-41a9-bee5-aa8e1d6d0cd0 service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Updated VIF entry in instance network info cache for port 2b286fbf-a6fe-4dcc-af12-2521cf154dbb. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:07:29.870082 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-5fa4b0f4-1a3a-4731-9fcb-21b24886bd47 req-e9a06deb-a1e6-41a9-bee5-aa8e1d6d0cd0 service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Updating instance_info_cache with network_info: [{"id": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "address": "fa:16:3e:db:08:dd", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b286fbf-a6", "ovs_interfaceid": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:07:30.128452 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.783s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:30.128981 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.848s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:30.129102 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:07:30.134558 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:07:30.134800 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Claim successful on node np0000001127
May 21 02:07:30.372413 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5fa4b0f4-1a3a-4731-9fcb-21b24886bd47 req-e9a06deb-a1e6-41a9-bee5-aa8e1d6d0cd0 service nova] Releasing lock "refresh_cache-aa3f5a78-fb82-4e21-8ebf-90bf48a122be" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:07:30.540876 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:30.541086 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:30.634157 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:07:30.634321 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:07:30.634644 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:30.635092 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:30.716400 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '01cc41344ae640f6aa9c6142252838b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae2ef74a1614eb09e4f71f709f64126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:07:30.975383 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-67fbeca7-b8c3-45c4-a5a4-0bb0697b7397 req-0bd86254-b10b-416b-97b9-5cf75216e0be service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Received event network-changed-ad1def3b-4657-4632-bd3a-910cdca9a1a4 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:30.975541 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-67fbeca7-b8c3-45c4-a5a4-0bb0697b7397 req-0bd86254-b10b-416b-97b9-5cf75216e0be service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Refreshing instance network info cache due to event network-changed-ad1def3b-4657-4632-bd3a-910cdca9a1a4. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:07:30.975752 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-67fbeca7-b8c3-45c4-a5a4-0bb0697b7397 req-0bd86254-b10b-416b-97b9-5cf75216e0be service nova] Acquiring lock "refresh_cache-c76064e6-3702-4e67-9d4f-ef67cd4b7b22" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:07:30.975915 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-67fbeca7-b8c3-45c4-a5a4-0bb0697b7397 req-0bd86254-b10b-416b-97b9-5cf75216e0be service nova] Acquired lock "refresh_cache-c76064e6-3702-4e67-9d4f-ef67cd4b7b22" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:07:30.976076 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-67fbeca7-b8c3-45c4-a5a4-0bb0697b7397 req-0bd86254-b10b-416b-97b9-5cf75216e0be service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Refreshing network info cache for port ad1def3b-4657-4632-bd3a-910cdca9a1a4 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:07:31.044718 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lazy-loading 'flavor' on Instance uuid aa3f5a78-fb82-4e21-8ebf-90bf48a122be {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:07:31.140282 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:07:31.272875 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Successfully created port: a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:07:31.336962 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:31.478320 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-67fbeca7-b8c3-45c4-a5a4-0bb0697b7397 req-0bd86254-b10b-416b-97b9-5cf75216e0be service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:31.648562 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:31.659493 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:07:31.859134 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-67fbeca7-b8c3-45c4-a5a4-0bb0697b7397 req-0bd86254-b10b-416b-97b9-5cf75216e0be service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:31.909701 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Successfully updated port: a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:07:31.972965 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7761fd86-c774-4e15-9786-d68d00fc29d7 req-8ddc53ca-a3cd-4f3b-9630-8d2d53bb4ab2 service nova] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Received event network-changed-a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:31.973033 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7761fd86-c774-4e15-9786-d68d00fc29d7 req-8ddc53ca-a3cd-4f3b-9630-8d2d53bb4ab2 service nova] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Refreshing instance network info cache due to event network-changed-a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:07:31.973253 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7761fd86-c774-4e15-9786-d68d00fc29d7 req-8ddc53ca-a3cd-4f3b-9630-8d2d53bb4ab2 service nova] Acquiring lock "refresh_cache-6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:07:31.973397 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7761fd86-c774-4e15-9786-d68d00fc29d7 req-8ddc53ca-a3cd-4f3b-9630-8d2d53bb4ab2 service nova] Acquired lock "refresh_cache-6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:07:31.973634 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-7761fd86-c774-4e15-9786-d68d00fc29d7 req-8ddc53ca-a3cd-4f3b-9630-8d2d53bb4ab2 service nova] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Refreshing network info cache for port a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:07:32.001871 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:07:32.002034 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:07:32.028692 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-67fbeca7-b8c3-45c4-a5a4-0bb0697b7397 req-0bd86254-b10b-416b-97b9-5cf75216e0be service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Updated VIF entry in instance network info cache for port ad1def3b-4657-4632-bd3a-910cdca9a1a4. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:07:32.028934 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-67fbeca7-b8c3-45c4-a5a4-0bb0697b7397 req-0bd86254-b10b-416b-97b9-5cf75216e0be service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Updating instance_info_cache with network_info: [{"id": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "address": "fa:16:3e:20:ae:96", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1def3b-46", "ovs_interfaceid": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:07:32.052026 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:32.411867 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "refresh_cache-6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:07:32.477629 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-7761fd86-c774-4e15-9786-d68d00fc29d7 req-8ddc53ca-a3cd-4f3b-9630-8d2d53bb4ab2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:32.504923 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:07:32.534669 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-67fbeca7-b8c3-45c4-a5a4-0bb0697b7397 req-0bd86254-b10b-416b-97b9-5cf75216e0be service nova] Releasing lock "refresh_cache-c76064e6-3702-4e67-9d4f-ef67cd4b7b22" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:07:32.559988 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-7761fd86-c774-4e15-9786-d68d00fc29d7 req-8ddc53ca-a3cd-4f3b-9630-8d2d53bb4ab2 service nova] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:07:32.669660 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:07:32.675718 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:07:32.676009 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Creating image(s)
May 21 02:07:32.677070 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "/opt/stack/data/nova/instances/6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:32.677070 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "/opt/stack/data/nova/instances/6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:32.677070 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "/opt/stack/data/nova/instances/6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:32.677547 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:07:32.688962 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:07:32.690898 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:32.785112 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-7761fd86-c774-4e15-9786-d68d00fc29d7 req-8ddc53ca-a3cd-4f3b-9630-8d2d53bb4ab2 service nova] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:07:32.806103 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.115s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:32.806677 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:32.807687 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:32.808190 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:07:32.812248 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:07:32.812783 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:32.902664 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.089s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:32.903559 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:32.972010 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed/disk 1073741824" returned: 0 in 0.068s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:32.972629 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.165s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:32.973103 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:33.025493 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.891s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:33.025493 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:07:33.094955 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.122s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:33.095482 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:07:33.095821 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:33.176212 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:33.176596 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:33.177005 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Attaching volume e7cfdf26-9973-4cc1-8395-11f9ebc98c4b to /dev/vdb
May 21 02:07:33.221034 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:33.221419 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Cannot resize image /opt/stack/data/nova/instances/6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:07:33.221931 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:07:33.222109 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Ensure instance console log exists: /opt/stack/data/nova/instances/6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:07:33.222425 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:33.223003 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:33.223177 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:33.244145 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:07:33.258774 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:07:33.285700 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:33.306505 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7761fd86-c774-4e15-9786-d68d00fc29d7 req-8ddc53ca-a3cd-4f3b-9630-8d2d53bb4ab2 service nova] Releasing lock "refresh_cache-6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:07:33.307397 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquired lock "refresh_cache-6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:07:33.307697 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:07:33.350318 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:07:33.350790 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:07:33.361210 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:07:33.362667 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe0f:28a1', 'fe80::440a:38ff:fe27:fa24', 'fe80::fc16:3eff:fe91:3d5c', 'fe80::a4db:73ff:fe81:949b', 'fe80::fc16:3eff:fefb:4d96', 'fe80::fc16:3eff:fe68:a810', 'fe80::3cc0:a4ff:feab:836e', 'fe80::fc16:3eff:fe65:6557', 'fe80::fc16:3eff:fef5:8ead', 'fe80::fc16:3eff:fe97:bdd9', 'fe80::c44d:25ff:fe10:25cb', 'fe80::fc16:3eff:fedc:c265', 'fe80::fc16:3eff:fedb:8dd', 'fe80::fc16:3eff:fece:d884', 'fe80::7ca5:4ff:fee7:fb0a', 'fe80::fc16:3eff:fe20:ae96'] 
May 21 02:07:33.362891 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:07:33.363031 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:07:33.363490 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:07:33.363848 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Updating existing volume attachment record: 3072686b-5978-4908-9a63-e2ee97562339 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:07:33.532693 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:07:33.533352 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:07:33.535418 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:33.535865 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:33.639054 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f369771db7dd49da85131c9692833a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3efe4046d6a442d91b3463e2d99fd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:07:33.869886 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0014811280002504645 future=<Future at 0x71c07c529370 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:07:33.870028 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:07:33.871063 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Emitting event <LifecycleEvent: 1779329238.8682985, 0b9a1a2a-77bd-4fe9-ae88-344c193980f5 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:07:33.871323 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] VM Stopped (Lifecycle Event)
May 21 02:07:33.889427 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:07:33.936429 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:07:33.937106 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:07:33.937106 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:07:33.937561 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:07:33.937875 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:07:33.954584 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:07:33.955203 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:07:33.956296 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:07:33.956776 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:07:33.957396 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:07:33.957503 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:07:33.973144 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:07:33.973144 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:33.975394 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:07:33.975394 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:33.992152 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b] added
May 21 02:07:33.992152 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:07:33.992152 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:07:33.992152 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:07:33.992152 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:07:33.992152 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:07:33.992152 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:33.993391 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b] added
May 21 02:07:33.993391 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:07:33.993391 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:07:33.993391 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:07:33.993391 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:07:33.993391 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:07:33.993391 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:33.993932 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:07:33.994265 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:07:33.994752 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0376(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:07:33.995041 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0376(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:07:33.995342 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:07:33.995675 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:07:34.038913 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:07:34.077074 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:34.207616 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Successfully created port: 1c6901ce-3b6b-4fd0-8d6f-48252edbae1a {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:07:34.274187 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Updating instance_info_cache with network_info: [{"id": "a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01", "address": "fa:16:3e:b8:d1:01", "network": {"id": "dec0dbdb-dfbe-4a3d-9d29-6add07c9003f", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-775185877-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ae2ef74a1614eb09e4f71f709f64126", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3938f5f-e8", "ovs_interfaceid": "a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:07:34.374203 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-578ac175-89a5-4eba-b18f-24d3e24548f5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 0b9a1a2a-77bd-4fe9-ae88-344c193980f5] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:07:34.545687 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:07:34.770654 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Successfully updated port: 1c6901ce-3b6b-4fd0-8d6f-48252edbae1a {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:07:34.776309 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Releasing lock "refresh_cache-6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:07:34.776622 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Instance network_info: |[{"id": "a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01", "address": "fa:16:3e:b8:d1:01", "network": {"id": "dec0dbdb-dfbe-4a3d-9d29-6add07c9003f", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-775185877-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ae2ef74a1614eb09e4f71f709f64126", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3938f5f-e8", "ovs_interfaceid": "a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:07:34.778808 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Start _get_guest_xml network_info=[{"id": "a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01", "address": "fa:16:3e:b8:d1:01", "network": {"id": "dec0dbdb-dfbe-4a3d-9d29-6add07c9003f", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-775185877-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ae2ef74a1614eb09e4f71f709f64126", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3938f5f-e8", "ovs_interfaceid": "a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:07:34.786875 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:07:34.788341 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-1044373802', uuid='6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed'), owner=OwnerMeta(userid='01cc41344ae640f6aa9c6142252838b2', username='tempest-VolumeMultiattachTests-1039130224-project-member', projectid='4ae2ef74a1614eb09e4f71f709f64126', projectname='tempest-VolumeMultiattachTests-1039130224'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01", "address": "fa:16:3e:b8:d1:01", "network": {"id": "dec0dbdb-dfbe-4a3d-9d29-6add07c9003f", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-775185877-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ae2ef74a1614eb09e4f71f709f64126", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3938f5f-e8", "ovs_interfaceid": "a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329254.7879274) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:07:34.789728 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:07:34.790334 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:07:34.791927 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:07:34.792100 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:07:34.793057 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:07:34.793350 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:07:34.793484 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:07:34.793607 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:07:34.793728 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:07:34.793820 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:07:34.793988 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:07:34.794343 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:07:34.794567 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:07:34.794667 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:07:34.794777 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:07:34.794900 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:07:34.813962 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:07:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1044373802',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumemultiattachtests-server-1044373802',id=57,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG49/r2Ab7Qm1KfDPUwJai4qjLSCzazkse8keaGMf9RDSFnwzlyAfx0W/eKq+/pIZ6H88F7NAAW2g3zgnzAemSR+PHn4ESPDrxs+tFUrSTfyQy6BP7J2Yru23PLQSySpLA==',key_name='tempest-keypair-1913749436',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ae2ef74a1614eb09e4f71f709f64126',ramdisk_id='',reservation_id='r-xw26snxy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1039130224',owner_user_name='tempest-VolumeMultiattachTests-1039130224-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:07:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01cc41344ae640f6aa9c6142252838b2',uuid=6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01", "address": "fa:16:3e:b8:d1:01", "network": {"id": "dec0dbdb-dfbe-4a3d-9d29-6add07c9003f", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-775185877-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ae2ef74a1614eb09e4f71f709f64126", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3938f5f-e8", "ovs_interfaceid": "a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:07:34.814515 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Converting VIF {"id": "a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01", "address": "fa:16:3e:b8:d1:01", "network": {"id": "dec0dbdb-dfbe-4a3d-9d29-6add07c9003f", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-775185877-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ae2ef74a1614eb09e4f71f709f64126", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3938f5f-e8", "ovs_interfaceid": "a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:07:34.815391 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:d1:01,bridge_name='br-int',has_traffic_filtering=True,id=a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01,network=Network(dec0dbdb-dfbe-4a3d-9d29-6add07c9003f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3938f5f-e8') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:07:34.816090 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lazy-loading 'pci_devices' on Instance uuid 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:07:34.844773 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-9382aabe-3e75-4c54-8d5a-2490b9d99902 req-46d43f6a-0199-4c26-bde8-4650e99b8618 service nova] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Received event network-changed-1c6901ce-3b6b-4fd0-8d6f-48252edbae1a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:34.844773 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-9382aabe-3e75-4c54-8d5a-2490b9d99902 req-46d43f6a-0199-4c26-bde8-4650e99b8618 service nova] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Refreshing instance network info cache due to event network-changed-1c6901ce-3b6b-4fd0-8d6f-48252edbae1a. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:07:34.844773 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-9382aabe-3e75-4c54-8d5a-2490b9d99902 req-46d43f6a-0199-4c26-bde8-4650e99b8618 service nova] Acquiring lock "refresh_cache-511701d6-fac9-4e15-803d-e9038bd1a018" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:07:34.844773 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-9382aabe-3e75-4c54-8d5a-2490b9d99902 req-46d43f6a-0199-4c26-bde8-4650e99b8618 service nova] Acquired lock "refresh_cache-511701d6-fac9-4e15-803d-e9038bd1a018" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:07:34.844773 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-9382aabe-3e75-4c54-8d5a-2490b9d99902 req-46d43f6a-0199-4c26-bde8-4650e99b8618 service nova] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Refreshing network info cache for port 1c6901ce-3b6b-4fd0-8d6f-48252edbae1a {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:07:34.995848 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:07:34.997098 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:07:35.013003 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:07:35.013003 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:07:35.025349 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:07:35.025349 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:35.038216 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:35.044422 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:35.060576 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:35.060576 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:35.060576 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:35.060576 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:35.060576 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:35.060576 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:35.060576 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:35.060576 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:35.060576 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:07:35.060994 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:35.060994 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:35.060994 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:35.060994 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:35.060994 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:35.060994 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:35.060994 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:35.060994 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:35.060994 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:07:35.065562 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:35.065562 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:35.065562 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:35.065562 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:35.065562 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:35.065562 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:35.065562 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:35.065562 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:35.065562 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:07:35.065562 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:35.065562 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:35.065562 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:35.065562 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:35.065562 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:35.065562 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:35.065562 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:35.065562 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:35.065562 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:07:35.116095 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b, portal: 192.168.40.100,3260]
May 21 02:07:35.116095 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b, portal: 192.168.40.100,3260] successful.
May 21 02:07:35.116095 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:35.124579 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b, portal: 192.168.50.100,3260]
May 21 02:07:35.124579 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b, portal: 192.168.50.100,3260] successful.
May 21 02:07:35.124579 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:35.132399 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:35.140082 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:35.155731 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:35.155731 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:35.155731 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:35.155731 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:35.155731 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:35.155731 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:35.155731 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:35.155731 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:35.155731 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:35.155731 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:35.155731 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:07:35.156056 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:35.156056 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:35.156056 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:35.156056 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:35.156056 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:35.156056 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:35.156056 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:35.156056 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:35.156056 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:35.156056 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:35.156056 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:07:35.156303 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.201s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:07:35.156423 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:07:35.157719 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] HCTL ('9', '-', '-', 0) found on session 118 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:07:35.157854 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:07:35.170521 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:35.170521 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:35.170521 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:35.170521 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:35.170521 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:35.170521 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:35.170521 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:35.170521 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:35.170521 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:35.170521 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:35.170521 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:07:35.170890 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:35.170890 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:35.170890 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:35.170890 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:35.170890 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:35.170890 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:35.170890 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:35.170890 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:35.170890 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:35.170890 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:35.170890 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:07:35.171145 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.215s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:07:35.171145 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:07:35.172774 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] HCTL ('10', '-', '-', 0) found on session 119 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:07:35.173003 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:07:35.188187 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Searching for a device in session 118 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:07:35.188982 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:07:35.198434 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Searching for a device in session 119 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:07:35.198434 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:07:35.273537 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "refresh_cache-511701d6-fac9-4e15-803d-e9038bd1a018" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:07:35.321574 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] End _get_guest_xml xml=<domain type="qemu">
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:   <uuid>6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed</uuid>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:   <name>instance-00000039</name>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:       <nova:name>tempest-VolumeMultiattachTests-server-1044373802</nova:name>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:07:34</nova:creationTime>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:         <nova:user uuid="01cc41344ae640f6aa9c6142252838b2">tempest-VolumeMultiattachTests-1039130224-project-member</nova:user>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:         <nova:project uuid="4ae2ef74a1614eb09e4f71f709f64126">tempest-VolumeMultiattachTests-1039130224</nova:project>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:         <nova:port uuid="a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01">
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:     <system>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:       <entry name="serial">6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed</entry>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:       <entry name="uuid">6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed</entry>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:     </system>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:   <os>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:   </os>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:   <features>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:   </features>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:   <devices>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed/disk"/>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:     </disk>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed/disk.config"/>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:     </disk>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:b8:d1:01"/>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:       <target dev="tapa3938f5f-e8"/>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:     </interface>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed/console.log" append="off"/>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:     </serial>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:     <video>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:     </video>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:     </rng>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:   </devices>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]: </domain>
May 21 02:07:35.321574 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:07:35.325164 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Preparing to wait for external event network-vif-plugged-a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:07:35.325164 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:35.325164 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:35.325164 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:35.325164 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:07:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1044373802',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumemultiattachtests-server-1044373802',id=57,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG49/r2Ab7Qm1KfDPUwJai4qjLSCzazkse8keaGMf9RDSFnwzlyAfx0W/eKq+/pIZ6H88F7NAAW2g3zgnzAemSR+PHn4ESPDrxs+tFUrSTfyQy6BP7J2Yru23PLQSySpLA==',key_name='tempest-keypair-1913749436',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ae2ef74a1614eb09e4f71f709f64126',ramdisk_id='',reservation_id='r-xw26snxy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1039130224',owner_user_name='tempest-VolumeMultiattachTests-1039130224-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:07:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01cc41344ae640f6aa9c6142252838b2',uuid=6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01", "address": "fa:16:3e:b8:d1:01", "network": {"id": "dec0dbdb-dfbe-4a3d-9d29-6add07c9003f", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-775185877-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ae2ef74a1614eb09e4f71f709f64126", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3938f5f-e8", "ovs_interfaceid": "a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:07:35.325164 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Converting VIF {"id": "a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01", "address": "fa:16:3e:b8:d1:01", "network": {"id": "dec0dbdb-dfbe-4a3d-9d29-6add07c9003f", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-775185877-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ae2ef74a1614eb09e4f71f709f64126", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3938f5f-e8", "ovs_interfaceid": "a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:07:35.325661 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:d1:01,bridge_name='br-int',has_traffic_filtering=True,id=a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01,network=Network(dec0dbdb-dfbe-4a3d-9d29-6add07c9003f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3938f5f-e8') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:07:35.326525 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:d1:01,bridge_name='br-int',has_traffic_filtering=True,id=a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01,network=Network(dec0dbdb-dfbe-4a3d-9d29-6add07c9003f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3938f5f-e8') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:07:35.327117 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:35.327594 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:07:35.328025 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:07:35.329976 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:35.330368 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4e06bf98-18bf-521b-a9e9-934f3a2be15f', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:07:35.335804 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:07:35.344504 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:35.344787 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3938f5f-e8, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:07:35.345238 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa3938f5f-e8, col_values=(('qos', UUID('aec07053-648d-4525-83af-84ac58637dee')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:07:35.345458 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa3938f5f-e8, col_values=(('external_ids', {'iface-id': 'a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:d1:01', 'vm-uuid': '6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:07:35.346604 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-9382aabe-3e75-4c54-8d5a-2490b9d99902 req-46d43f6a-0199-4c26-bde8-4650e99b8618 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:35.348955 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:35.350194 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:07:35.354153 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:35.354725 np0000001127 nova-compute[98206]: INFO os_vif [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:d1:01,bridge_name='br-int',has_traffic_filtering=True,id=a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01,network=Network(dec0dbdb-dfbe-4a3d-9d29-6add07c9003f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3938f5f-e8')
May 21 02:07:35.445856 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-9382aabe-3e75-4c54-8d5a-2490b9d99902 req-46d43f6a-0199-4c26-bde8-4650e99b8618 service nova] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:07:35.557410 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:07:35.558335 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:07:35.558611 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Creating image(s)
May 21 02:07:35.559193 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "/opt/stack/data/nova/instances/511701d6-fac9-4e15-803d-e9038bd1a018/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:35.559414 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "/opt/stack/data/nova/instances/511701d6-fac9-4e15-803d-e9038bd1a018/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:35.559948 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "/opt/stack/data/nova/instances/511701d6-fac9-4e15-803d-e9038bd1a018/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:35.560429 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:07:35.563651 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:07:35.565008 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:35.661107 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-9382aabe-3e75-4c54-8d5a-2490b9d99902 req-46d43f6a-0199-4c26-bde8-4650e99b8618 service nova] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:07:35.663855 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.099s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:35.664702 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:35.665246 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:35.666091 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:07:35.669371 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:07:35.669843 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:35.779224 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.109s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:35.782537 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/511701d6-fac9-4e15-803d-e9038bd1a018/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:35.852248 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/511701d6-fac9-4e15-803d-e9038bd1a018/disk 1073741824" returned: 0 in 0.072s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:35.854541 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:35.854541 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:35.947190 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.094s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:35.947861 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Checking if we can resize image /opt/stack/data/nova/instances/511701d6-fac9-4e15-803d-e9038bd1a018/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:07:35.948228 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511701d6-fac9-4e15-803d-e9038bd1a018/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:35.969773 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:07:36.066593 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511701d6-fac9-4e15-803d-e9038bd1a018/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:36.068096 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Cannot resize image /opt/stack/data/nova/instances/511701d6-fac9-4e15-803d-e9038bd1a018/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:07:36.071379 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:07:36.071379 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Ensure instance console log exists: /opt/stack/data/nova/instances/511701d6-fac9-4e15-803d-e9038bd1a018/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:07:36.071379 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:36.071379 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:36.071379 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:36.165549 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-9382aabe-3e75-4c54-8d5a-2490b9d99902 req-46d43f6a-0199-4c26-bde8-4650e99b8618 service nova] Releasing lock "refresh_cache-511701d6-fac9-4e15-803d-e9038bd1a018" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:07:36.167396 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquired lock "refresh_cache-511701d6-fac9-4e15-803d-e9038bd1a018" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:07:36.167660 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:07:36.650847 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:36.737092 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:07:36.893876 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:07:36.894119 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:07:36.894180 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] No VIF found with MAC fa:16:3e:b8:d1:01, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:07:36.894734 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Using config drive
May 21 02:07:36.948278 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:36.995986 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Found WWN 330000000eb19b356 for multipath device dm-1 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:07:36.996401 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.059s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:07:36.996635 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] <== connect_volume: return (3059ms) {'type': 'block', 'scsi_wwn': '330000000eb19b356', 'path': '/dev/dm-1', 'multipath_id': '330000000eb19b356'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:07:36.996859 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000eb19b356', 'path': '/dev/dm-1', 'multipath_id': '330000000eb19b356'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:07:37.000077 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lazy-loading 'flavor' on Instance uuid aa3f5a78-fb82-4e21-8ebf-90bf48a122be {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:07:37.119158 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Updating instance_info_cache with network_info: [{"id": "1c6901ce-3b6b-4fd0-8d6f-48252edbae1a", "address": "fa:16:3e:f1:4d:aa", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c6901ce-3b", "ovs_interfaceid": "1c6901ce-3b6b-4fd0-8d6f-48252edbae1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:07:37.402862 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:37.503223 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Attempting to attach volume e7cfdf26-9973-4cc1-8395-11f9ebc98c4b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 02:07:37.504932 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] attach device xml: <disk type="block" device="disk">
May 21 02:07:37.504932 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:07:37.504932 np0000001127 nova-compute[98206]:   <alias name="ua-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b"/>
May 21 02:07:37.504932 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-1"/>
May 21 02:07:37.504932 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:07:37.504932 np0000001127 nova-compute[98206]:   <serial>e7cfdf26-9973-4cc1-8395-11f9ebc98c4b</serial>
May 21 02:07:37.504932 np0000001127 nova-compute[98206]:   <shareable/>
May 21 02:07:37.504932 np0000001127 nova-compute[98206]: </disk>
May 21 02:07:37.504932 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 02:07:37.544197 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Creating config drive at /opt/stack/data/nova/instances/6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed/disk.config
May 21 02:07:37.548478 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpatynabzy {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:37.612214 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpatynabzy" returned: 0 in 0.063s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:37.621585 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Releasing lock "refresh_cache-511701d6-fac9-4e15-803d-e9038bd1a018" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:07:37.621585 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Instance network_info: |[{"id": "1c6901ce-3b6b-4fd0-8d6f-48252edbae1a", "address": "fa:16:3e:f1:4d:aa", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c6901ce-3b", "ovs_interfaceid": "1c6901ce-3b6b-4fd0-8d6f-48252edbae1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:07:37.623318 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Start _get_guest_xml network_info=[{"id": "1c6901ce-3b6b-4fd0-8d6f-48252edbae1a", "address": "fa:16:3e:f1:4d:aa", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c6901ce-3b", "ovs_interfaceid": "1c6901ce-3b6b-4fd0-8d6f-48252edbae1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:07:37.632101 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:07:37.633435 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-633693387', uuid='511701d6-fac9-4e15-803d-e9038bd1a018'), owner=OwnerMeta(userid='f369771db7dd49da85131c9692833a5a', username='tempest-AttachVolumeNegativeTest-1208856611-project-member', projectid='d3efe4046d6a442d91b3463e2d99fd7b', projectname='tempest-AttachVolumeNegativeTest-1208856611'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1c6901ce-3b6b-4fd0-8d6f-48252edbae1a", "address": "fa:16:3e:f1:4d:aa", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c6901ce-3b", "ovs_interfaceid": "1c6901ce-3b6b-4fd0-8d6f-48252edbae1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329257.6329582) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:07:37.640366 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:07:37.642049 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:07:37.644082 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:07:37.644124 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:07:37.645530 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:07:37.645909 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:07:37.647127 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:07:37.647238 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:07:37.647509 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:07:37.647567 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:07:37.647718 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:07:37.647900 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:07:37.648207 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:07:37.649291 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:07:37.649869 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:07:37.649869 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:07:37.666209 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:07:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-633693387',display_name='tempest-AttachVolumeNegativeTest-server-633693387',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumenegativetest-server-633693387',id=58,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOoCw0Zi77bKdndf5WZQCRJ6dWaw0wB41CkSLSd22Qv0NCJuBgyD1E1zWuXKCIOu8rDsohVs0s11sVOxRvbV62QPPLtEwSnZxU+jAtDWPZ7XU41nujVouIK92WtHxPZBQg==',key_name='tempest-keypair-528619947',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3efe4046d6a442d91b3463e2d99fd7b',ramdisk_id='',reservation_id='r-qk2ywb7j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1208856611',owner_user_name='tempest-AttachVolumeNegativeTest-1208856611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f369771db7dd49da85131c9692833a5a',uuid=511701d6-fac9-4e15-803d-e9038bd1a018,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c6901ce-3b6b-4fd0-8d6f-48252edbae1a", "address": "fa:16:3e:f1:4d:aa", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c6901ce-3b", "ovs_interfaceid": "1c6901ce-3b6b-4fd0-8d6f-48252edbae1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:07:37.666209 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Converting VIF {"id": "1c6901ce-3b6b-4fd0-8d6f-48252edbae1a", "address": "fa:16:3e:f1:4d:aa", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c6901ce-3b", "ovs_interfaceid": "1c6901ce-3b6b-4fd0-8d6f-48252edbae1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:07:37.666941 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:4d:aa,bridge_name='br-int',has_traffic_filtering=True,id=1c6901ce-3b6b-4fd0-8d6f-48252edbae1a,network=Network(f683b2da-ab41-43e1-a9bb-98914089b4d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c6901ce-3b') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:07:37.667476 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lazy-loading 'pci_devices' on Instance uuid 511701d6-fac9-4e15-803d-e9038bd1a018 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:07:38.079593 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:38.117120 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:38.172176 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] End _get_guest_xml xml=<domain type="qemu">
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:   <uuid>511701d6-fac9-4e15-803d-e9038bd1a018</uuid>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:   <name>instance-0000003a</name>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:       <nova:name>tempest-AttachVolumeNegativeTest-server-633693387</nova:name>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:07:37</nova:creationTime>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:         <nova:user uuid="f369771db7dd49da85131c9692833a5a">tempest-AttachVolumeNegativeTest-1208856611-project-member</nova:user>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:         <nova:project uuid="d3efe4046d6a442d91b3463e2d99fd7b">tempest-AttachVolumeNegativeTest-1208856611</nova:project>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:         <nova:port uuid="1c6901ce-3b6b-4fd0-8d6f-48252edbae1a">
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:     <system>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:       <entry name="serial">511701d6-fac9-4e15-803d-e9038bd1a018</entry>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:       <entry name="uuid">511701d6-fac9-4e15-803d-e9038bd1a018</entry>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:     </system>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:   <os>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:   </os>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:   <features>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:   </features>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:   <devices>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/511701d6-fac9-4e15-803d-e9038bd1a018/disk"/>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:     </disk>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/511701d6-fac9-4e15-803d-e9038bd1a018/disk.config"/>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:     </disk>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:f1:4d:aa"/>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:       <target dev="tap1c6901ce-3b"/>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:     </interface>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/511701d6-fac9-4e15-803d-e9038bd1a018/console.log" append="off"/>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:     </serial>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:     <video>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:     </video>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:     </rng>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:   </devices>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]: </domain>
May 21 02:07:38.172176 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:07:38.178285 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Preparing to wait for external event network-vif-plugged-1c6901ce-3b6b-4fd0-8d6f-48252edbae1a {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:07:38.178285 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "511701d6-fac9-4e15-803d-e9038bd1a018-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:38.178285 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "511701d6-fac9-4e15-803d-e9038bd1a018-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:38.178285 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "511701d6-fac9-4e15-803d-e9038bd1a018-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:38.178285 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:07:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-633693387',display_name='tempest-AttachVolumeNegativeTest-server-633693387',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumenegativetest-server-633693387',id=58,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOoCw0Zi77bKdndf5WZQCRJ6dWaw0wB41CkSLSd22Qv0NCJuBgyD1E1zWuXKCIOu8rDsohVs0s11sVOxRvbV62QPPLtEwSnZxU+jAtDWPZ7XU41nujVouIK92WtHxPZBQg==',key_name='tempest-keypair-528619947',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3efe4046d6a442d91b3463e2d99fd7b',ramdisk_id='',reservation_id='r-qk2ywb7j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1208856611',owner_user_name='tempest-AttachVolumeNegativeTest-1208856611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f369771db7dd49da85131c9692833a5a',uuid=511701d6-fac9-4e15-803d-e9038bd1a018,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c6901ce-3b6b-4fd0-8d6f-48252edbae1a", "address": "fa:16:3e:f1:4d:aa", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c6901ce-3b", "ovs_interfaceid": "1c6901ce-3b6b-4fd0-8d6f-48252edbae1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:07:38.178285 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Converting VIF {"id": "1c6901ce-3b6b-4fd0-8d6f-48252edbae1a", "address": "fa:16:3e:f1:4d:aa", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c6901ce-3b", "ovs_interfaceid": "1c6901ce-3b6b-4fd0-8d6f-48252edbae1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:07:38.178285 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:4d:aa,bridge_name='br-int',has_traffic_filtering=True,id=1c6901ce-3b6b-4fd0-8d6f-48252edbae1a,network=Network(f683b2da-ab41-43e1-a9bb-98914089b4d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c6901ce-3b') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:07:38.178285 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:4d:aa,bridge_name='br-int',has_traffic_filtering=True,id=1c6901ce-3b6b-4fd0-8d6f-48252edbae1a,network=Network(f683b2da-ab41-43e1-a9bb-98914089b4d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c6901ce-3b') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:07:38.178285 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:38.178285 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:07:38.178285 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:07:38.180448 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:38.180678 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aa2f7ce4-7b70-5220-947b-4531d1495f74', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:07:38.184215 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:38.185112 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:07:38.194266 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:38.200519 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:38.200519 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c6901ce-3b, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:07:38.201192 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1c6901ce-3b, col_values=(('qos', UUID('2b98531b-af90-41fe-9df7-d65129b8273e')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:07:38.201540 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1c6901ce-3b, col_values=(('external_ids', {'iface-id': '1c6901ce-3b6b-4fd0-8d6f-48252edbae1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:4d:aa', 'vm-uuid': '511701d6-fac9-4e15-803d-e9038bd1a018'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:07:38.203305 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:38.205915 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:07:38.211897 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:38.213258 np0000001127 nova-compute[98206]: INFO os_vif [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:4d:aa,bridge_name='br-int',has_traffic_filtering=True,id=1c6901ce-3b6b-4fd0-8d6f-48252edbae1a,network=Network(f683b2da-ab41-43e1-a9bb-98914089b4d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c6901ce-3b')
May 21 02:07:38.264830 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:38.351728 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cadb42f1-ea3a-4b3d-96b9-6804e0fda91c req-3db39f8e-57d9-4f17-a05b-b28068bc1419 service nova] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Received event network-vif-plugged-a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:38.351943 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cadb42f1-ea3a-4b3d-96b9-6804e0fda91c req-3db39f8e-57d9-4f17-a05b-b28068bc1419 service nova] Acquiring lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:38.352154 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cadb42f1-ea3a-4b3d-96b9-6804e0fda91c req-3db39f8e-57d9-4f17-a05b-b28068bc1419 service nova] Lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:38.352322 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cadb42f1-ea3a-4b3d-96b9-6804e0fda91c req-3db39f8e-57d9-4f17-a05b-b28068bc1419 service nova] Lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:38.352402 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cadb42f1-ea3a-4b3d-96b9-6804e0fda91c req-3db39f8e-57d9-4f17-a05b-b28068bc1419 service nova] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Processing event network-vif-plugged-a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:07:38.595494 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:38.603664 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:38.606806 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:38.641791 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:38.649744 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:39.086740 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:07:39.087175 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329259.08679, 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:07:39.088488 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] VM Started (Lifecycle Event)
May 21 02:07:39.088670 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:07:39.094839 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Instance spawned successfully.
May 21 02:07:39.095986 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:07:39.192978 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:07:39.193183 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:07:39.193371 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:07:39.193543 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No VIF found with MAC fa:16:3e:db:08:dd, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:07:39.599851 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:07:39.604642 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:07:39.611501 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:39.611974 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:39.612237 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:39.612876 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:39.613233 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:39.613603 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:39.742225 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:07:39.742344 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:07:39.742344 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] No VIF found with MAC fa:16:3e:f1:4d:aa, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:07:39.742775 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Using config drive
May 21 02:07:40.111120 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:07:40.111120 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329260.1107874, 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:07:40.111120 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] VM Paused (Lifecycle Event)
May 21 02:07:40.119662 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Took 7.45 seconds to spawn the instance on the hypervisor.
May 21 02:07:40.120047 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:07:40.251331 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:40.437251 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cf3fa291-a255-4923-b72a-75531b93345e req-9a1eb9a9-0f6e-4013-9389-458d4a235c20 service nova] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Received event network-vif-plugged-a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:40.439009 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cf3fa291-a255-4923-b72a-75531b93345e req-9a1eb9a9-0f6e-4013-9389-458d4a235c20 service nova] Acquiring lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:40.439197 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cf3fa291-a255-4923-b72a-75531b93345e req-9a1eb9a9-0f6e-4013-9389-458d4a235c20 service nova] Lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:40.439319 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cf3fa291-a255-4923-b72a-75531b93345e req-9a1eb9a9-0f6e-4013-9389-458d4a235c20 service nova] Lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:40.439562 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cf3fa291-a255-4923-b72a-75531b93345e req-9a1eb9a9-0f6e-4013-9389-458d4a235c20 service nova] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] No waiting events found dispatching network-vif-plugged-a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:07:40.439809 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-cf3fa291-a255-4923-b72a-75531b93345e req-9a1eb9a9-0f6e-4013-9389-458d4a235c20 service nova] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Received unexpected event network-vif-plugged-a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01 for instance with vm_state active and task_state None.
May 21 02:07:40.455730 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Creating config drive at /opt/stack/data/nova/instances/511701d6-fac9-4e15-803d-e9038bd1a018/disk.config
May 21 02:07:40.460948 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/511701d6-fac9-4e15-803d-e9038bd1a018/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzfvijvsk {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:40.534864 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/511701d6-fac9-4e15-803d-e9038bd1a018/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzfvijvsk" returned: 0 in 0.074s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:40.579727 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:40.580015 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:40.617574 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:07:40.624133 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329260.6237442, 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:07:40.624269 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] VM Resumed (Lifecycle Event)
May 21 02:07:40.633383 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Took 13.34 seconds to build instance.
May 21 02:07:40.783696 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dc22afd8-af07-464f-8312-a2d6a379fe52 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.606s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:41.066405 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:41.085920 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lazy-loading 'flavor' on Instance uuid c76064e6-3702-4e67-9d4f-ef67cd4b7b22 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:07:41.103367 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:41.109575 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:41.128305 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:07:41.137348 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cf61e8ae-3db9-443b-925a-fe775a82c510 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.858s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:41.140062 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:07:41.233052 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:41.457477 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8d86ab30-e030-4b76-b6a1-baf1184ad3ea req-2e47c60a-49ef-4e02-9b6c-f909cd86c03e service nova] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Received event network-vif-plugged-1c6901ce-3b6b-4fd0-8d6f-48252edbae1a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:41.457761 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8d86ab30-e030-4b76-b6a1-baf1184ad3ea req-2e47c60a-49ef-4e02-9b6c-f909cd86c03e service nova] Acquiring lock "511701d6-fac9-4e15-803d-e9038bd1a018-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:41.459111 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8d86ab30-e030-4b76-b6a1-baf1184ad3ea req-2e47c60a-49ef-4e02-9b6c-f909cd86c03e service nova] Lock "511701d6-fac9-4e15-803d-e9038bd1a018-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:41.459299 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8d86ab30-e030-4b76-b6a1-baf1184ad3ea req-2e47c60a-49ef-4e02-9b6c-f909cd86c03e service nova] Lock "511701d6-fac9-4e15-803d-e9038bd1a018-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:41.460328 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8d86ab30-e030-4b76-b6a1-baf1184ad3ea req-2e47c60a-49ef-4e02-9b6c-f909cd86c03e service nova] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Processing event network-vif-plugged-1c6901ce-3b6b-4fd0-8d6f-48252edbae1a {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:07:41.619900 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:41.623640 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:41.635456 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:41.638090 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:41.665416 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:42.102035 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.522s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:42.186283 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329262.1854243, 511701d6-fac9-4e15-803d-e9038bd1a018 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:07:42.186743 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] VM Started (Lifecycle Event)
May 21 02:07:42.187872 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:07:42.193855 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:07:42.197422 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Instance spawned successfully.
May 21 02:07:42.200841 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:07:42.694442 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:07:42.705543 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:07:42.713442 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:42.713789 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:42.714231 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:42.714692 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:42.715066 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:42.715414 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:07:43.121023 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-3c0a31e2-132c-40d4-a5d7-125a08f5879f req-37754688-255c-49ec-8cfd-d74495986d5e service nova] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Received event network-changed-a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:43.121151 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-3c0a31e2-132c-40d4-a5d7-125a08f5879f req-37754688-255c-49ec-8cfd-d74495986d5e service nova] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Refreshing instance network info cache due to event network-changed-a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:07:43.121382 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-3c0a31e2-132c-40d4-a5d7-125a08f5879f req-37754688-255c-49ec-8cfd-d74495986d5e service nova] Acquiring lock "refresh_cache-6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:07:43.121679 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-3c0a31e2-132c-40d4-a5d7-125a08f5879f req-37754688-255c-49ec-8cfd-d74495986d5e service nova] Acquired lock "refresh_cache-6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:07:43.121801 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-3c0a31e2-132c-40d4-a5d7-125a08f5879f req-37754688-255c-49ec-8cfd-d74495986d5e service nova] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Refreshing network info cache for port a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:07:43.208781 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:43.213041 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:07:43.213385 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329263.2131417, 511701d6-fac9-4e15-803d-e9038bd1a018 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:07:43.213551 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] VM Paused (Lifecycle Event)
May 21 02:07:43.221901 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Took 7.66 seconds to spawn the instance on the hypervisor.
May 21 02:07:43.222087 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:07:43.434686 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:43.434686 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:43.434886 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Attaching volume e7cfdf26-9973-4cc1-8395-11f9ebc98c4b to /dev/vdb
May 21 02:07:43.502909 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:07:43.519153 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:07:43.550440 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-63b9f258-83a7-4cfb-8fad-59cffe631321 req-04da7e46-49ec-4003-95f6-1d0bec1742aa service nova] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Received event network-vif-plugged-1c6901ce-3b6b-4fd0-8d6f-48252edbae1a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:43.552537 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-63b9f258-83a7-4cfb-8fad-59cffe631321 req-04da7e46-49ec-4003-95f6-1d0bec1742aa service nova] Acquiring lock "511701d6-fac9-4e15-803d-e9038bd1a018-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:43.552537 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-63b9f258-83a7-4cfb-8fad-59cffe631321 req-04da7e46-49ec-4003-95f6-1d0bec1742aa service nova] Lock "511701d6-fac9-4e15-803d-e9038bd1a018-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:43.552537 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-63b9f258-83a7-4cfb-8fad-59cffe631321 req-04da7e46-49ec-4003-95f6-1d0bec1742aa service nova] Lock "511701d6-fac9-4e15-803d-e9038bd1a018-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:43.552537 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-63b9f258-83a7-4cfb-8fad-59cffe631321 req-04da7e46-49ec-4003-95f6-1d0bec1742aa service nova] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] No waiting events found dispatching network-vif-plugged-1c6901ce-3b6b-4fd0-8d6f-48252edbae1a {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:07:43.553340 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-63b9f258-83a7-4cfb-8fad-59cffe631321 req-04da7e46-49ec-4003-95f6-1d0bec1742aa service nova] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Received unexpected event network-vif-plugged-1c6901ce-3b6b-4fd0-8d6f-48252edbae1a for instance with vm_state active and task_state None.
May 21 02:07:43.566155 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:43.614343 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:07:43.615962 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:07:43.625859 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-3c0a31e2-132c-40d4-a5d7-125a08f5879f req-37754688-255c-49ec-8cfd-d74495986d5e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:43.632514 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:07:43.635884 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe0f:28a1', 'fe80::440a:38ff:fe27:fa24', 'fe80::fc16:3eff:fe91:3d5c', 'fe80::a4db:73ff:fe81:949b', 'fe80::fc16:3eff:fefb:4d96', 'fe80::fc16:3eff:fe68:a810', 'fe80::3cc0:a4ff:feab:836e', 'fe80::fc16:3eff:fe65:6557', 'fe80::fc16:3eff:fef5:8ead', 'fe80::fc16:3eff:fe97:bdd9', 'fe80::c44d:25ff:fe10:25cb', 'fe80::fc16:3eff:fedc:c265', 'fe80::fc16:3eff:fedb:8dd', 'fe80::fc16:3eff:fece:d884', 'fe80::7ca5:4ff:fee7:fb0a', 'fe80::fc16:3eff:fe20:ae96', 'fe80::fc16:3eff:feb8:d101', 'fe80::7045:30ff:fe1a:b99f', 'fe80::fc16:3eff:fef1:4daa', 'fe80::2482:bff:fe1b:902b'] 
May 21 02:07:43.635884 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:07:43.635884 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:07:43.635884 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:07:43.636915 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Updating existing volume attachment record: b5921d70-19e9-4191-a56b-74acacded9cb {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:07:43.718888 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:07:43.726745 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329263.7262387, 511701d6-fac9-4e15-803d-e9038bd1a018 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:07:43.726800 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] VM Resumed (Lifecycle Event)
May 21 02:07:43.741180 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Took 14.52 seconds to build instance.
May 21 02:07:44.018442 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-3c0a31e2-132c-40d4-a5d7-125a08f5879f req-37754688-255c-49ec-8cfd-d74495986d5e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:44.176718 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-3c0a31e2-132c-40d4-a5d7-125a08f5879f req-37754688-255c-49ec-8cfd-d74495986d5e service nova] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Updated VIF entry in instance network info cache for port a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:07:44.177812 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-3c0a31e2-132c-40d4-a5d7-125a08f5879f req-37754688-255c-49ec-8cfd-d74495986d5e service nova] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Updating instance_info_cache with network_info: [{"id": "a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01", "address": "fa:16:3e:b8:d1:01", "network": {"id": "dec0dbdb-dfbe-4a3d-9d29-6add07c9003f", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-775185877-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ae2ef74a1614eb09e4f71f709f64126", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3938f5f-e8", "ovs_interfaceid": "a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:07:44.225697 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:07:44.227831 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:07:44.227831 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:07:44.227831 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:07:44.227831 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:07:44.236546 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:07:44.240292 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:07:44.247825 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dd17926b-05cc-4741-9e1c-e096559ace3a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "511701d6-fac9-4e15-803d-e9038bd1a018" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.034s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:44.251702 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:07:44.252989 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:07:44.253792 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:07:44.254993 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:07:44.254993 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:07:44.254993 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.startup = automatic
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.session.scan = manual
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:07:44.275428 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:07:44.275428 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.startup = automatic
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.session.scan = manual
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:07:44.289766 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:07:44.289766 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:44.306250 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:44.313273 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:44.330864 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:44.330864 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:44.330864 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:44.330864 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:44.330864 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:44.330864 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:44.330864 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:44.330864 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:44.330864 np0000001127 nova-compute[98206]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-afd700df-4d18-43c1-99eb-ffda7212595e (non-flash)
May 21 02:07:44.330864 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:44.330864 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:44.330864 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:07:44.330864 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:44.330864 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:44.330864 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:44.330864 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:44.330864 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:44.330864 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:44.330864 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:44.330864 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:44.330864 np0000001127 nova-compute[98206]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-afd700df-4d18-43c1-99eb-ffda7212595e (non-flash)
May 21 02:07:44.330864 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:44.330864 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:44.330864 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:07:44.330864 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.077s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:07:44.330864 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:07:44.334392 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] HCTL ('9', '0', '0', 0) found on session 118 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:07:44.334618 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Scanning host 9 c: 0, t: 0, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:07:44.335820 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:44.335820 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:44.335820 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:44.335820 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:44.335820 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:44.335820 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:44.335820 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:44.335820 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:44.335820 np0000001127 nova-compute[98206]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-afd700df-4d18-43c1-99eb-ffda7212595e (non-flash)
May 21 02:07:44.335820 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:44.335820 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:44.335820 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:07:44.335820 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:44.335820 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:44.335820 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:44.335820 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:44.335820 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:44.335820 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:44.335820 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:44.335820 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:44.335820 np0000001127 nova-compute[98206]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-afd700df-4d18-43c1-99eb-ffda7212595e (non-flash)
May 21 02:07:44.335820 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:44.335820 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:44.335820 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:07:44.335820 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.081s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:07:44.335820 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:07:44.338037 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] HCTL ('10', '0', '0', 0) found on session 119 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:07:44.338037 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Scanning host 10 c: 0, t: 0, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:07:44.351220 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Searching for a device in session 118 and hctl ('9', '0', '0', 0) yield: sdd {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:07:44.351409 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:07:44.352987 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Searching for a device in session 119 and hctl ('10', '0', '0', 0) yield: sde {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:07:44.352987 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:07:44.418729 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Acquiring lock "b646159a-f806-487d-8a14-0aa8e2438f2b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:44.419198 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "b646159a-f806-487d-8a14-0aa8e2438f2b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:44.679197 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-3c0a31e2-132c-40d4-a5d7-125a08f5879f req-37754688-255c-49ec-8cfd-d74495986d5e service nova] Releasing lock "refresh_cache-6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:07:44.931779 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lazy-loading 'flavor' on Instance uuid b646159a-f806-487d-8a14-0aa8e2438f2b {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:07:45.254275 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:07:45.649388 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-98cf6234-c87a-4e5c-922e-c32c4caae541 req-f67723e1-e253-4613-a354-94605b63f8fd service nova] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Received event network-changed-1c6901ce-3b6b-4fd0-8d6f-48252edbae1a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:45.650038 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-98cf6234-c87a-4e5c-922e-c32c4caae541 req-f67723e1-e253-4613-a354-94605b63f8fd service nova] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Refreshing instance network info cache due to event network-changed-1c6901ce-3b6b-4fd0-8d6f-48252edbae1a. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:07:45.650269 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-98cf6234-c87a-4e5c-922e-c32c4caae541 req-f67723e1-e253-4613-a354-94605b63f8fd service nova] Acquiring lock "refresh_cache-511701d6-fac9-4e15-803d-e9038bd1a018" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:07:45.651535 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-98cf6234-c87a-4e5c-922e-c32c4caae541 req-f67723e1-e253-4613-a354-94605b63f8fd service nova] Acquired lock "refresh_cache-511701d6-fac9-4e15-803d-e9038bd1a018" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:07:45.652300 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-98cf6234-c87a-4e5c-922e-c32c4caae541 req-f67723e1-e253-4613-a354-94605b63f8fd service nova] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Refreshing network info cache for port 1c6901ce-3b6b-4fd0-8d6f-48252edbae1a {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:07:45.938547 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "b646159a-f806-487d-8a14-0aa8e2438f2b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.519s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:46.154773 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-98cf6234-c87a-4e5c-922e-c32c4caae541 req-f67723e1-e253-4613-a354-94605b63f8fd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:46.277589 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Found WWN 330000000eb19b356 for multipath device dm-1 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:07:46.277995 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.051s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:07:46.277995 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] <== connect_volume: return (2051ms) {'type': 'block', 'scsi_wwn': '330000000eb19b356', 'path': '/dev/dm-1', 'multipath_id': '330000000eb19b356'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:07:46.278165 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000eb19b356', 'path': '/dev/dm-1', 'multipath_id': '330000000eb19b356'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:07:46.280939 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lazy-loading 'flavor' on Instance uuid c76064e6-3702-4e67-9d4f-ef67cd4b7b22 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:07:46.541310 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-98cf6234-c87a-4e5c-922e-c32c4caae541 req-f67723e1-e253-4613-a354-94605b63f8fd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:46.670015 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:46.700990 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-98cf6234-c87a-4e5c-922e-c32c4caae541 req-f67723e1-e253-4613-a354-94605b63f8fd service nova] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Updated VIF entry in instance network info cache for port 1c6901ce-3b6b-4fd0-8d6f-48252edbae1a. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:07:46.701389 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-98cf6234-c87a-4e5c-922e-c32c4caae541 req-f67723e1-e253-4613-a354-94605b63f8fd service nova] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Updating instance_info_cache with network_info: [{"id": "1c6901ce-3b6b-4fd0-8d6f-48252edbae1a", "address": "fa:16:3e:f1:4d:aa", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c6901ce-3b", "ovs_interfaceid": "1c6901ce-3b6b-4fd0-8d6f-48252edbae1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:07:46.791494 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Attempting to attach volume e7cfdf26-9973-4cc1-8395-11f9ebc98c4b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 02:07:46.794305 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] attach device xml: <disk type="block" device="disk">
May 21 02:07:46.794305 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:07:46.794305 np0000001127 nova-compute[98206]:   <alias name="ua-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b"/>
May 21 02:07:46.794305 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-1"/>
May 21 02:07:46.794305 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:07:46.794305 np0000001127 nova-compute[98206]:   <serial>e7cfdf26-9973-4cc1-8395-11f9ebc98c4b</serial>
May 21 02:07:46.794305 np0000001127 nova-compute[98206]:   <shareable/>
May 21 02:07:46.794305 np0000001127 nova-compute[98206]: </disk>
May 21 02:07:46.794305 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 02:07:47.075526 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Acquiring lock "b646159a-f806-487d-8a14-0aa8e2438f2b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:47.075526 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "b646159a-f806-487d-8a14-0aa8e2438f2b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:47.075526 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Attaching volume 9fa058ef-88b8-4b67-a74e-94986bafb235 to /dev/vdb
May 21 02:07:47.123243 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:07:47.138724 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:07:47.178056 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:47.207972 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-98cf6234-c87a-4e5c-922e-c32c4caae541 req-f67723e1-e253-4613-a354-94605b63f8fd service nova] Releasing lock "refresh_cache-511701d6-fac9-4e15-803d-e9038bd1a018" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:07:47.232938 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:07:47.232938 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:07:47.245911 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:07:47.247947 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe0f:28a1', 'fe80::440a:38ff:fe27:fa24', 'fe80::fc16:3eff:fe91:3d5c', 'fe80::a4db:73ff:fe81:949b', 'fe80::fc16:3eff:fefb:4d96', 'fe80::fc16:3eff:fe68:a810', 'fe80::3cc0:a4ff:feab:836e', 'fe80::fc16:3eff:fe65:6557', 'fe80::fc16:3eff:fef5:8ead', 'fe80::fc16:3eff:fe97:bdd9', 'fe80::c44d:25ff:fe10:25cb', 'fe80::fc16:3eff:fedc:c265', 'fe80::fc16:3eff:fedb:8dd', 'fe80::fc16:3eff:fece:d884', 'fe80::7ca5:4ff:fee7:fb0a', 'fe80::fc16:3eff:fe20:ae96', 'fe80::fc16:3eff:feb8:d101', 'fe80::7045:30ff:fe1a:b99f', 'fe80::fc16:3eff:fef1:4daa', 'fe80::2482:bff:fe1b:902b'] 
May 21 02:07:47.248116 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:07:47.248300 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:07:47.248788 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:07:47.249180 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Updating existing volume attachment record: d3a04984-1696-4c61-a08e-40950d764ac7 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:07:47.809423 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:07:47.809874 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235', 'iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9fa058ef-88b8-4b67-a74e-94986bafb235', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:07:47.809977 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:07:47.810312 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:07:47.810520 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235', 'iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9fa058ef-88b8-4b67-a74e-94986bafb235', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:07:47.824905 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:07:47.825591 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:07:47.826251 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:07:47.826450 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:07:47.827161 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:07:47.827275 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:07:47.845125 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:07:47.845125 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:47.852057 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:07:47.852057 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:47.860956 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235] added
May 21 02:07:47.860956 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:07:47.860956 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:07:47.860956 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:07:47.860956 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:07:47.860956 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:07:47.860956 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:47.861240 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:07:47.861409 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0349(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:07:47.861640 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:07:47.866946 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235] added
May 21 02:07:47.866946 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:07:47.866946 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:07:47.866946 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:07:47.866946 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:07:47.866946 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:07:47.866946 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:47.867166 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:07:47.868085 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0401(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:07:47.868085 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:07:47.945408 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Acquiring lock "e897b981-cb4b-48b1-a9fe-23c447993d1e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:47.945710 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "e897b981-cb4b-48b1-a9fe-23c447993d1e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:48.209435 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:48.450056 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:07:48.569293 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:07:48.569525 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:07:48.569702 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:07:48.569855 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No VIF found with MAC fa:16:3e:20:ae:96, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:07:48.862052 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:07:48.869554 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:07:48.878059 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:07:48.878059 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:07:48.889092 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:07:48.889092 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:48.896073 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:48.903881 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:48.920275 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:48.920275 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:48.920275 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:48.920275 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:48.920275 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:48.920275 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:48.920275 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:48.920275 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:48.920275 np0000001127 nova-compute[98206]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-afd700df-4d18-43c1-99eb-ffda7212595e (non-flash)
May 21 02:07:48.920275 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:48.920275 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:48.920275 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:07:48.920574 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:48.920574 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:48.920574 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:48.920574 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:48.920574 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:48.920574 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:48.920574 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:48.920574 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:48.920574 np0000001127 nova-compute[98206]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-afd700df-4d18-43c1-99eb-ffda7212595e (non-flash)
May 21 02:07:48.920574 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:48.920574 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:48.920574 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:07:48.923495 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:48.923495 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:48.923495 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:48.923495 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:48.923495 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:48.923495 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:48.923495 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:48.923495 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:48.923495 np0000001127 nova-compute[98206]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-afd700df-4d18-43c1-99eb-ffda7212595e (non-flash)
May 21 02:07:48.923495 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:48.923495 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:48.923495 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:07:48.923495 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:48.923495 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:48.923495 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:48.923495 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:48.923495 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:48.923495 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:48.923495 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:48.923495 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:48.923495 np0000001127 nova-compute[98206]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-afd700df-4d18-43c1-99eb-ffda7212595e (non-flash)
May 21 02:07:48.923495 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:48.923495 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:48.923495 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:07:48.978213 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235, portal: 192.168.40.100,3260]
May 21 02:07:48.978213 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235, portal: 192.168.40.100,3260] successful.
May 21 02:07:48.978213 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:48.990503 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235, portal: 192.168.50.100,3260]
May 21 02:07:48.990503 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235, portal: 192.168.50.100,3260] successful.
May 21 02:07:48.990503 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:48.991971 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:49.010461 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:49.018436 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:49.018436 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:49.018436 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:49.018436 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:49.018436 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:49.018436 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:49.018436 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:49.018436 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:49.018436 np0000001127 nova-compute[98206]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-afd700df-4d18-43c1-99eb-ffda7212595e (non-flash)
May 21 02:07:49.018436 np0000001127 nova-compute[98206]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:07:49.018436 np0000001127 nova-compute[98206]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:07:49.018436 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:49.018436 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:49.018436 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:07:49.020388 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:49.020388 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:49.020388 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:49.020388 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:49.020388 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:49.020388 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:49.020388 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:49.020388 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:49.020388 np0000001127 nova-compute[98206]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-afd700df-4d18-43c1-99eb-ffda7212595e (non-flash)
May 21 02:07:49.020388 np0000001127 nova-compute[98206]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:07:49.020388 np0000001127 nova-compute[98206]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:07:49.020388 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:49.020388 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:49.020388 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:07:49.020999 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.195s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:07:49.021167 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:07:49.024743 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:49.024947 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:49.028511 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:07:49.028655 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Claim successful on node np0000001127
May 21 02:07:49.031297 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] HCTL ('18', '-', '-', 0) found on session 121 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:07:49.031562 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:07:49.036637 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:49.036637 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:49.036637 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:49.036637 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:49.036637 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:49.036637 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:49.036637 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:49.036637 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:49.036637 np0000001127 nova-compute[98206]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-afd700df-4d18-43c1-99eb-ffda7212595e (non-flash)
May 21 02:07:49.036637 np0000001127 nova-compute[98206]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:07:49.036637 np0000001127 nova-compute[98206]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:07:49.036637 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:49.036637 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:49.036637 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:07:49.036637 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:49.036637 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:49.036637 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:49.036637 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:49.036637 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:49.036637 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:49.036637 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:49.036637 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:49.036637 np0000001127 nova-compute[98206]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-afd700df-4d18-43c1-99eb-ffda7212595e (non-flash)
May 21 02:07:49.036637 np0000001127 nova-compute[98206]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:07:49.036637 np0000001127 nova-compute[98206]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:07:49.036637 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:49.036637 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:49.036637 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:07:49.036637 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.208s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:07:49.036637 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:07:49.036637 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] HCTL ('19', '-', '-', 0) found on session 122 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:07:49.036637 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:07:49.059043 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Searching for a device in session 121 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:07:49.059043 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9fa058ef-88b8-4b67-a74e-94986bafb235', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:07:49.071406 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Searching for a device in session 122 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:07:49.071652 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9fa058ef-88b8-4b67-a74e-94986bafb235', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:07:49.735355 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fb620934-551e-46ee-b566-047f2b8df37f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "609b1611-3b05-4b86-8bf3-85f16f199d80" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:49.735585 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fb620934-551e-46ee-b566-047f2b8df37f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "609b1611-3b05-4b86-8bf3-85f16f199d80" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:49.735774 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-fb620934-551e-46ee-b566-047f2b8df37f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:07:49.739711 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-fb620934-551e-46ee-b566-047f2b8df37f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98206) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 21 02:07:49.740305 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-fb620934-551e-46ee-b566-047f2b8df37f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lazy-loading 'flavor' on Instance uuid 609b1611-3b05-4b86-8bf3-85f16f199d80 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:07:49.827786 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:07:50.148372 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-872cc9dc-57b2-43ef-8a74-3cf292918fcc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.714s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:50.678019 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:07:50.678253 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:07:50.777087 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:50.783146 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:50.805495 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:50.811838 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:50.836534 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:07:50.836880 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:07:50.846765 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:50.850763 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:50.858555 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Found WWN 330000000ee6fe8da for multipath device dm-13 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:07:50.858555 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.046s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:07:50.858555 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] <== connect_volume: return (3047ms) {'type': 'block', 'scsi_wwn': '330000000ee6fe8da', 'path': '/dev/dm-13', 'multipath_id': '330000000ee6fe8da'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:07:50.858555 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ee6fe8da', 'path': '/dev/dm-13', 'multipath_id': '330000000ee6fe8da'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:07:50.872154 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lazy-loading 'flavor' on Instance uuid b646159a-f806-487d-8a14-0aa8e2438f2b {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:07:50.982674 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-91148dfa-1f5e-4d36-91d3-6d75813e76b5 req-c15b0011-4b26-4fa3-b350-3557d8c498c1 service nova] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Received event network-vif-unplugged-58f0082f-9f4d-42c5-9569-faf668cc281d {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:50.982866 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-91148dfa-1f5e-4d36-91d3-6d75813e76b5 req-c15b0011-4b26-4fa3-b350-3557d8c498c1 service nova] Acquiring lock "609b1611-3b05-4b86-8bf3-85f16f199d80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:50.983057 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-91148dfa-1f5e-4d36-91d3-6d75813e76b5 req-c15b0011-4b26-4fa3-b350-3557d8c498c1 service nova] Lock "609b1611-3b05-4b86-8bf3-85f16f199d80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:50.983190 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-91148dfa-1f5e-4d36-91d3-6d75813e76b5 req-c15b0011-4b26-4fa3-b350-3557d8c498c1 service nova] Lock "609b1611-3b05-4b86-8bf3-85f16f199d80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:50.983304 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-91148dfa-1f5e-4d36-91d3-6d75813e76b5 req-c15b0011-4b26-4fa3-b350-3557d8c498c1 service nova] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] No waiting events found dispatching network-vif-unplugged-58f0082f-9f4d-42c5-9569-faf668cc281d {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:07:50.983424 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-91148dfa-1f5e-4d36-91d3-6d75813e76b5 req-c15b0011-4b26-4fa3-b350-3557d8c498c1 service nova] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Received unexpected event network-vif-unplugged-58f0082f-9f4d-42c5-9569-faf668cc281d for instance with vm_state active and task_state powering-off.
May 21 02:07:51.158148 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999650291999842 future=<Future at 0x71c05824e630 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:07:51.158148 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999346048000007 future=<Future at 0x71c05824e630 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:07:51.158559 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.99922546400012 future=<Future at 0x71c05824e630 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:07:51.160397 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Instance destroyed successfully.
May 21 02:07:51.163531 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-fb620934-551e-46ee-b566-047f2b8df37f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lazy-loading 'numa_topology' on Instance uuid 609b1611-3b05-4b86-8bf3-85f16f199d80 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:07:51.340800 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:07:51.377685 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Attempting to attach volume 9fa058ef-88b8-4b67-a74e-94986bafb235 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 02:07:51.380193 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] attach device xml: <disk type="block" device="disk">
May 21 02:07:51.380193 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:07:51.380193 np0000001127 nova-compute[98206]:   <alias name="ua-9fa058ef-88b8-4b67-a74e-94986bafb235"/>
May 21 02:07:51.380193 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-13"/>
May 21 02:07:51.380193 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:07:51.380193 np0000001127 nova-compute[98206]:   <serial>9fa058ef-88b8-4b67-a74e-94986bafb235</serial>
May 21 02:07:51.380193 np0000001127 nova-compute[98206]: </disk>
May 21 02:07:51.380193 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 02:07:51.664987 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-fb620934-551e-46ee-b566-047f2b8df37f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Object Instance<609b1611-3b05-4b86-8bf3-85f16f199d80> lazy-loaded attributes: flavor,numa_topology {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:07:51.665269 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-fb620934-551e-46ee-b566-047f2b8df37f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:07:51.670983 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:51.678503 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:07:51.678503 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 21 02:07:51.679894 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:07:51.849084 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.824s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:51.849084 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:07:52.181024 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-fb620934-551e-46ee-b566-047f2b8df37f tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "609b1611-3b05-4b86-8bf3-85f16f199d80" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.445s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:52.275191 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Stashing vm_state: active {{(pid=98206) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 21 02:07:52.355173 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:07:52.355412 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:07:52.355734 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:52.355962 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:52.432059 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0083b33595414e5e8a3a80e7fea274ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0ea7da0f244aab58f9da579e53864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:07:52.677493 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:07:52.678232 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:07:52.858239 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:07:52.886811 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:52.887189 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:52.997938 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Successfully created port: f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:07:53.058760 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:07:53.058883 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:07:53.058974 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:07:53.059081 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] No VIF found with MAC fa:16:3e:dc:c2:65, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:07:53.064917 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-10be8478-5b53-4b3a-864a-e409bf221323 req-4f3540a4-f226-4dc4-bc9a-ad966429d5c9 service nova] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Received event network-vif-unplugged-58f0082f-9f4d-42c5-9569-faf668cc281d {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:53.066754 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-10be8478-5b53-4b3a-864a-e409bf221323 req-4f3540a4-f226-4dc4-bc9a-ad966429d5c9 service nova] Acquiring lock "609b1611-3b05-4b86-8bf3-85f16f199d80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:53.068136 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-10be8478-5b53-4b3a-864a-e409bf221323 req-4f3540a4-f226-4dc4-bc9a-ad966429d5c9 service nova] Lock "609b1611-3b05-4b86-8bf3-85f16f199d80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:53.068261 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-10be8478-5b53-4b3a-864a-e409bf221323 req-4f3540a4-f226-4dc4-bc9a-ad966429d5c9 service nova] Lock "609b1611-3b05-4b86-8bf3-85f16f199d80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:53.068743 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-10be8478-5b53-4b3a-864a-e409bf221323 req-4f3540a4-f226-4dc4-bc9a-ad966429d5c9 service nova] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] No waiting events found dispatching network-vif-unplugged-58f0082f-9f4d-42c5-9569-faf668cc281d {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:07:53.068878 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-10be8478-5b53-4b3a-864a-e409bf221323 req-4f3540a4-f226-4dc4-bc9a-ad966429d5c9 service nova] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Received unexpected event network-vif-unplugged-58f0082f-9f4d-42c5-9569-faf668cc281d for instance with vm_state stopped and task_state None.
May 21 02:07:53.186042 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:53.210527 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:53.362718 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:07:53.406239 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:07:53.406660 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Claim successful on node np0000001127
May 21 02:07:53.707860 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Acquiring lock "2b990342-3aef-4ea5-a3bb-c776f4dd8567" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:53.708074 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "2b990342-3aef-4ea5-a3bb-c776f4dd8567" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:53.716784 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Successfully updated port: f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:07:53.766153 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lazy-loading 'flavor' on Instance uuid 609b1611-3b05-4b86-8bf3-85f16f199d80 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:07:53.784024 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2a2df133-d5cd-4561-a1d5-725950639014 req-3b0d2055-4b79-4128-9d05-bed3dfb768c7 service nova] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Received event network-changed-f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:53.784792 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2a2df133-d5cd-4561-a1d5-725950639014 req-3b0d2055-4b79-4128-9d05-bed3dfb768c7 service nova] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Refreshing instance network info cache due to event network-changed-f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:07:53.785016 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2a2df133-d5cd-4561-a1d5-725950639014 req-3b0d2055-4b79-4128-9d05-bed3dfb768c7 service nova] Acquiring lock "refresh_cache-e897b981-cb4b-48b1-a9fe-23c447993d1e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:07:53.785151 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2a2df133-d5cd-4561-a1d5-725950639014 req-3b0d2055-4b79-4128-9d05-bed3dfb768c7 service nova] Acquired lock "refresh_cache-e897b981-cb4b-48b1-a9fe-23c447993d1e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:07:53.785294 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-2a2df133-d5cd-4561-a1d5-725950639014 req-3b0d2055-4b79-4128-9d05-bed3dfb768c7 service nova] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Refreshing network info cache for port f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:07:53.875644 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Booting with volume 65b64e18-a66f-4a0a-a898-df73bbdf8fdc at /dev/vda
May 21 02:07:53.917402 np0000001127 nova-compute[98206]: INFO nova.compute.resource_tracker [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Updating resource usage from migration e36c9eb2-7bc4-4d53-9029-ee680a5875b8
May 21 02:07:53.940151 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:07:53.952805 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:07:53.984784 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:54.044660 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:07:54.045791 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:07:54.056833 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:07:54.059063 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe0f:28a1', 'fe80::440a:38ff:fe27:fa24', 'fe80::fc16:3eff:fe91:3d5c', 'fe80::a4db:73ff:fe81:949b', 'fe80::fc16:3eff:fefb:4d96', 'fe80::fc16:3eff:fe68:a810', 'fe80::3cc0:a4ff:feab:836e', 'fe80::fc16:3eff:fe65:6557', 'fe80::fc16:3eff:fef5:8ead', 'fe80::fc16:3eff:fedc:c265', 'fe80::fc16:3eff:fedb:8dd', 'fe80::fc16:3eff:fece:d884', 'fe80::7ca5:4ff:fee7:fb0a', 'fe80::fc16:3eff:fe20:ae96', 'fe80::fc16:3eff:feb8:d101', 'fe80::7045:30ff:fe1a:b99f', 'fe80::fc16:3eff:fef1:4daa', 'fe80::2482:bff:fe1b:902b'] 
May 21 02:07:54.059246 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:07:54.060634 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:07:54.061022 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:07:54.061623 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Updating existing volume attachment record: f836769c-14f3-48b1-b1be-80f8a2c4a2fb {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:07:54.221840 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lazy-loading 'flavor' on Instance uuid 2b990342-3aef-4ea5-a3bb-c776f4dd8567 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:07:54.223828 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Acquiring lock "refresh_cache-e897b981-cb4b-48b1-a9fe-23c447993d1e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:07:54.274993 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "refresh_cache-609b1611-3b05-4b86-8bf3-85f16f199d80" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:07:54.274993 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquired lock "refresh_cache-609b1611-3b05-4b86-8bf3-85f16f199d80" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:07:54.275201 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:07:54.275350 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lazy-loading 'info_cache' on Instance uuid 609b1611-3b05-4b86-8bf3-85f16f199d80 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:07:54.288918 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-2a2df133-d5cd-4561-a1d5-725950639014 req-3b0d2055-4b79-4128-9d05-bed3dfb768c7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:54.376830 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-2a2df133-d5cd-4561-a1d5-725950639014 req-3b0d2055-4b79-4128-9d05-bed3dfb768c7 service nova] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:07:54.623728 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-2a2df133-d5cd-4561-a1d5-725950639014 req-3b0d2055-4b79-4128-9d05-bed3dfb768c7 service nova] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:07:54.637056 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0ac3a83a-a53b-4b2f-b293-96cb4ad1f525 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "b646159a-f806-487d-8a14-0aa8e2438f2b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.562s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:54.727675 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Ignoring supplied device name: /dev/vdb
May 21 02:07:54.779029 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Object Instance<609b1611-3b05-4b86-8bf3-85f16f199d80> lazy-loaded attributes: flavor,info_cache {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:07:54.888554 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:07:54.888819 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:07:55.126362 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2a2df133-d5cd-4561-a1d5-725950639014 req-3b0d2055-4b79-4128-9d05-bed3dfb768c7 service nova] Releasing lock "refresh_cache-e897b981-cb4b-48b1-a9fe-23c447993d1e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:07:55.126969 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Acquired lock "refresh_cache-e897b981-cb4b-48b1-a9fe-23c447993d1e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:07:55.127111 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:07:55.234852 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "2b990342-3aef-4ea5-a3bb-c776f4dd8567" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.526s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:55.282324 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:55.391977 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:07:55.667766 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:55.712966 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:07:55.853405 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Updating instance_info_cache with network_info: [{"id": "58f0082f-9f4d-42c5-9569-faf668cc281d", "address": "fa:16:3e:97:bd:d9", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f0082f-9f", "ovs_interfaceid": "58f0082f-9f4d-42c5-9569-faf668cc281d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:07:55.902495 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 3.013s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:55.902495 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Migrating
May 21 02:07:55.902495 np0000001127 nova-compute[98206]: DEBUG nova.compute.rpcapi [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98206) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 21 02:07:55.905209 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 2.720s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:55.905500 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:55.905788 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Auditing locally available compute resources for np0000001127 (node: np0000001127) {{(pid=98206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 21 02:07:55.923296 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:56.075200 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Updating instance_info_cache with network_info: [{"id": "f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd", "address": "fa:16:3e:d6:68:cb", "network": {"id": "460fd532-ef54-4f63-922b-b9d9f73f665f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1504169250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89e0ea7da0f244aab58f9da579e53864", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b5a2fb-d0", "ovs_interfaceid": "f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:07:56.209903 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:07:56.210891 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:07:56.212135 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Creating image(s)
May 21 02:07:56.212135 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Did not create local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 21 02:07:56.212135 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Ensure instance console log exists: /opt/stack/data/nova/instances/e897b981-cb4b-48b1-a9fe-23c447993d1e/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:07:56.212135 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:56.212135 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:56.212135 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:56.354716 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Acquiring lock "2b990342-3aef-4ea5-a3bb-c776f4dd8567" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:56.355305 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "2b990342-3aef-4ea5-a3bb-c776f4dd8567" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:56.355305 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Attaching volume a9d20392-5e79-4e81-8258-a7f8aeef7ea6 to /dev/vdb
May 21 02:07:56.356997 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Releasing lock "refresh_cache-609b1611-3b05-4b86-8bf3-85f16f199d80" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:07:56.420349 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:07:56.426726 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "refresh_cache-aa3f5a78-fb82-4e21-8ebf-90bf48a122be" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:07:56.426726 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquired lock "refresh_cache-aa3f5a78-fb82-4e21-8ebf-90bf48a122be" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:07:56.426726 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:07:56.434087 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:07:56.461079 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:56.519639 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:07:56.520158 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:07:56.530865 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:07:56.532808 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe0f:28a1', 'fe80::440a:38ff:fe27:fa24', 'fe80::fc16:3eff:fe91:3d5c', 'fe80::a4db:73ff:fe81:949b', 'fe80::fc16:3eff:fefb:4d96', 'fe80::fc16:3eff:fe68:a810', 'fe80::3cc0:a4ff:feab:836e', 'fe80::fc16:3eff:fe65:6557', 'fe80::fc16:3eff:fef5:8ead', 'fe80::fc16:3eff:fedc:c265', 'fe80::fc16:3eff:fedb:8dd', 'fe80::fc16:3eff:fece:d884', 'fe80::7ca5:4ff:fee7:fb0a', 'fe80::fc16:3eff:fe20:ae96', 'fe80::fc16:3eff:feb8:d101', 'fe80::7045:30ff:fe1a:b99f', 'fe80::fc16:3eff:fef1:4daa', 'fe80::2482:bff:fe1b:902b'] 
May 21 02:07:56.533008 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:07:56.533008 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:07:56.534725 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:07:56.534725 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Updating existing volume attachment record: 465969d3-cf01-4f11-a7db-d223aba304cb {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:07:56.579209 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Releasing lock "refresh_cache-e897b981-cb4b-48b1-a9fe-23c447993d1e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:07:56.579209 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Instance network_info: |[{"id": "f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd", "address": "fa:16:3e:d6:68:cb", "network": {"id": "460fd532-ef54-4f63-922b-b9d9f73f665f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1504169250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89e0ea7da0f244aab58f9da579e53864", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b5a2fb-d0", "ovs_interfaceid": "f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:07:56.579645 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Start _get_guest_xml network_info=[{"id": "f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd", "address": "fa:16:3e:d6:68:cb", "network": {"id": "460fd532-ef54-4f63-922b-b9d9f73f665f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1504169250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89e0ea7da0f244aab58f9da579e53864", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b5a2fb-d0", "ovs_interfaceid": "f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc', 'iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '65b64e18-a66f-4a0a-a898-df73bbdf8fdc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'e897b981-cb4b-48b1-a9fe-23c447993d1e', 'attached_at': '', 'detached_at': '', 'volume_id': '65b64e18-a66f-4a0a-a898-df73bbdf8fdc', 'serial': '65b64e18-a66f-4a0a-a898-df73bbdf8fdc'}, 'delete_on_termination': False, 'attachment_id': 'f836769c-14f3-48b1-b1be-80f8a2c4a2fb', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:07:56.588028 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:07:56.589626 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-2090104866', uuid='e897b981-cb4b-48b1-a9fe-23c447993d1e'), owner=OwnerMeta(userid='0083b33595414e5e8a3a80e7fea274ba', username='tempest-TestVolumeBootPatternV346-1354384974-project-member', projectid='89e0ea7da0f244aab58f9da579e53864', projectname='tempest-TestVolumeBootPatternV346-1354384974'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd", "address": "fa:16:3e:d6:68:cb", "network": {"id": "460fd532-ef54-4f63-922b-b9d9f73f665f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1504169250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89e0ea7da0f244aab58f9da579e53864", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b5a2fb-d0", "ovs_interfaceid": "f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329276.5889962) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:07:56.591335 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:07:56.591945 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:07:56.595624 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:07:56.595909 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:07:56.596943 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:07:56.597294 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:07:56.597409 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:07:56.597459 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:07:56.597701 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:07:56.597701 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:07:56.597795 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:07:56.597929 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:07:56.598088 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:07:56.598125 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:07:56.598229 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:07:56.598355 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:07:56.614498 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:07:56.617726 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc', 'iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '65b64e18-a66f-4a0a-a898-df73bbdf8fdc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:07:56.617980 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:07:56.618621 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:07:56.618727 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc', 'iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '65b64e18-a66f-4a0a-a898-df73bbdf8fdc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:07:56.639851 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:07:56.641150 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:07:56.641150 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:07:56.642247 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:07:56.642673 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:07:56.643081 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:07:56.658699 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:07:56.658699 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:56.662487 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:07:56.662487 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:56.680981 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc] added
May 21 02:07:56.680981 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:07:56.680981 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:07:56.680981 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:07:56.680981 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:07:56.680981 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:07:56.680981 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:56.681236 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:07:56.681457 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0384(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:07:56.681757 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:07:56.682102 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:56.686420 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc] added
May 21 02:07:56.686420 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:07:56.686420 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:07:56.686420 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:07:56.686420 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:07:56.686420 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:07:56.686420 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:56.686774 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:07:56.687078 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0462(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:07:56.687292 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:07:56.929415 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:56.994309 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:57.112881 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:07:57.113957 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6', 'iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a9d20392-5e79-4e81-8258-a7f8aeef7ea6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:07:57.113957 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:07:57.124877 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:57.128488 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:57.239540 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:57.244519 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:07:57.253290 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b4239c5-84df-4d87-a2d4-fb6192408f58/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:57.365996 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:07:57.381168 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b4239c5-84df-4d87-a2d4-fb6192408f58/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:57.381987 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b4239c5-84df-4d87-a2d4-fb6192408f58/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:57.417776 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Instance destroyed successfully.
May 21 02:07:57.419252 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lazy-loading 'numa_topology' on Instance uuid 609b1611-3b05-4b86-8bf3-85f16f199d80 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:07:57.509887 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b4239c5-84df-4d87-a2d4-fb6192408f58/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:57.515414 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:57.549423 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Updating instance_info_cache with network_info: [{"id": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "address": "fa:16:3e:db:08:dd", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b286fbf-a6", "ovs_interfaceid": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:07:57.624711 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:57.625208 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:57.683210 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:07:57.689144 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:07:57.698924 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:07:57.698924 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:07:57.706464 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:07:57.706464 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:57.718395 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:57.721191 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:57.724213 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-8 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:07:57.729187 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:07:57.729691 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:57.733848 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-7 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:07:57.736333 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b990342-3aef-4ea5-a3bb-c776f4dd8567/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:57.758209 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:07:57.823780 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc, portal: 192.168.50.100,3260]
May 21 02:07:57.823780 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc, portal: 192.168.50.100,3260] successful.
May 21 02:07:57.823780 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:57.833981 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc, portal: 192.168.40.100,3260]
May 21 02:07:57.833981 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc, portal: 192.168.40.100,3260] successful.
May 21 02:07:57.833981 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:57.840854 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:57.850827 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:57.871490 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:57.871490 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:57.871490 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:57.871490 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:57.871490 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:57.871490 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:57.871490 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:57.871490 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:57.871490 np0000001127 nova-compute[98206]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:07:57.871490 np0000001127 nova-compute[98206]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:07:57.871490 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:07:57.871490 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:07:57.871490 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:57.871490 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:57.871490 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:07:57.871490 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:57.871490 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:57.871490 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:57.871490 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:57.871490 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:57.871490 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:57.871490 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:57.871490 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:57.871490 np0000001127 nova-compute[98206]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:07:57.871490 np0000001127 nova-compute[98206]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:07:57.871490 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:07:57.871490 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:07:57.871490 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:57.871490 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:57.871490 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:07:57.871490 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.227s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:07:57.871490 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:07:57.873484 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] HCTL ('17', '-', '-', 0) found on session 123 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:07:57.873694 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:07:57.875345 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:57.875345 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:57.875345 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:57.875345 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:57.875345 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:57.875345 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:57.875345 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:57.875345 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:57.875345 np0000001127 nova-compute[98206]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:07:57.875345 np0000001127 nova-compute[98206]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:07:57.875345 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:07:57.875345 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:07:57.875345 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:57.875345 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:57.875345 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:07:57.875769 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:57.875769 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:07:57.875769 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:57.875769 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:07:57.875769 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:57.875769 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:07:57.875769 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:57.875769 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:07:57.875769 np0000001127 nova-compute[98206]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:07:57.875769 np0000001127 nova-compute[98206]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:07:57.875769 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:07:57.875769 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:07:57.875769 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:57.875769 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:07:57.875769 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:07:57.876152 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.236s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:07:57.876218 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:07:57.878519 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Acquiring lock "b646159a-f806-487d-8a14-0aa8e2438f2b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:57.879043 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] HCTL ('20', '-', '-', 0) found on session 124 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:07:57.879372 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "b646159a-f806-487d-8a14-0aa8e2438f2b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:57.881241 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b990342-3aef-4ea5-a3bb-c776f4dd8567/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:57.881747 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:07:57.883217 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b990342-3aef-4ea5-a3bb-c776f4dd8567/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:57.923199 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Searching for a device in session 123 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:07:57.923199 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '65b64e18-a66f-4a0a-a898-df73bbdf8fdc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:07:57.923199 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Searching for a device in session 124 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:07:57.923199 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '65b64e18-a66f-4a0a-a898-df73bbdf8fdc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:07:57.926876 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Object Instance<609b1611-3b05-4b86-8bf3-85f16f199d80> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:07:57.926876 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lazy-loading 'resources' on Instance uuid 609b1611-3b05-4b86-8bf3-85f16f199d80 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:07:58.000615 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b990342-3aef-4ea5-a3bb-c776f4dd8567/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:58.006163 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:58.057567 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Releasing lock "refresh_cache-aa3f5a78-fb82-4e21-8ebf-90bf48a122be" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:07:58.126917 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:58.127020 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:58.211844 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:58.221371 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:58.226771 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6df4554-8490-4d5a-9d4d-acfd46419cb3/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:58.340804 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6df4554-8490-4d5a-9d4d-acfd46419cb3/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:58.341576 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6df4554-8490-4d5a-9d4d-acfd46419cb3/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:58.416508 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Detaching volume 9fa058ef-88b8-4b67-a74e-94986bafb235
May 21 02:07:58.431260 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Object Instance<609b1611-3b05-4b86-8bf3-85f16f199d80> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:07:58.432461 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:06:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-269447234',display_name='tempest-TestVolumeBootPattern-server-269447234',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpattern-server-269447234',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD77pimAV1eFekdNNNwkDDYOspV1DjTEfg3EMaUFkrngdEQ/pxsYYNODb0KKjbXdzAIBQimySPjMk1dUCykAebV38iqHCRucGJu9wI9IqvxnrGnYQ91hkWS0RnG0pTDGQA==',key_name='tempest-keypair-251449393',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:07:04Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='62ebdb16aee84e22a88dfc8960debd32',ramdisk_id='',reservation_id='r-b8d3jixu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1995806391',owner_user_name='tempest-TestVolumeBootPattern-1995806391-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:07:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4878b5a5bf184852a9ce383caa1c67a4',uuid=609b1611-3b05-4b86-8bf3-85f16f199d80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "58f0082f-9f4d-42c5-9569-faf668cc281d", "address": "fa:16:3e:97:bd:d9", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f0082f-9f", "ovs_interfaceid": "58f0082f-9f4d-42c5-9569-faf668cc281d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:07:58.432745 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converting VIF {"id": "58f0082f-9f4d-42c5-9569-faf668cc281d", "address": "fa:16:3e:97:bd:d9", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f0082f-9f", "ovs_interfaceid": "58f0082f-9f4d-42c5-9569-faf668cc281d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:07:58.433751 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:bd:d9,bridge_name='br-int',has_traffic_filtering=True,id=58f0082f-9f4d-42c5-9569-faf668cc281d,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58f0082f-9f') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:07:58.434703 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:bd:d9,bridge_name='br-int',has_traffic_filtering=True,id=58f0082f-9f4d-42c5-9569-faf668cc281d,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58f0082f-9f') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:07:58.439461 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:58.439897 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58f0082f-9f, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:07:58.442681 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6df4554-8490-4d5a-9d4d-acfd46419cb3/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:58.449676 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:07:58.451881 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:58.452097 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d4ea99b8-22ed-4a46-ab8d-e19ba443f067) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:07:58.453854 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:58.454517 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:07:58.455589 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:58.457955 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b646159a-f806-487d-8a14-0aa8e2438f2b/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:58.461141 np0000001127 nova-compute[98206]: INFO os_vif [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:bd:d9,bridge_name='br-int',has_traffic_filtering=True,id=58f0082f-9f4d-42c5-9569-faf668cc281d,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58f0082f-9f')
May 21 02:07:58.484932 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:07:58.485691 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36', 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9e45da95-d0bd-4a28-859f-96496102cc36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:07:58.485939 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:07:58.494281 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Attempting to driver detach volume 9fa058ef-88b8-4b67-a74e-94986bafb235 from mountpoint /dev/vdb
May 21 02:07:58.499190 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Found disk vdb by alias ua-9fa058ef-88b8-4b67-a74e-94986bafb235 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:07:58.500383 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Found disk vdb by alias ua-9fa058ef-88b8-4b67-a74e-94986bafb235 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:07:58.500613 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Attempting to detach device vdb from instance b646159a-f806-487d-8a14-0aa8e2438f2b from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 02:07:58.500970 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:07:58.500970 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:07:58.500970 np0000001127 nova-compute[98206]:   <alias name="ua-9fa058ef-88b8-4b67-a74e-94986bafb235"/>
May 21 02:07:58.500970 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-13"/>
May 21 02:07:58.500970 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:07:58.500970 np0000001127 nova-compute[98206]:   <serial>9fa058ef-88b8-4b67-a74e-94986bafb235</serial>
May 21 02:07:58.500970 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:07:58.500970 np0000001127 nova-compute[98206]: </disk>
May 21 02:07:58.500970 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:07:58.509151 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Successfully detached device vdb from instance b646159a-f806-487d-8a14-0aa8e2438f2b from the persistent domain config.
May 21 02:07:58.509430 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] (1/8): Attempting to detach device vdb with device alias ua-9fa058ef-88b8-4b67-a74e-94986bafb235 from instance b646159a-f806-487d-8a14-0aa8e2438f2b from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 02:07:58.509793 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:07:58.509793 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:07:58.509793 np0000001127 nova-compute[98206]:   <alias name="ua-9fa058ef-88b8-4b67-a74e-94986bafb235"/>
May 21 02:07:58.509793 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-13"/>
May 21 02:07:58.509793 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:07:58.509793 np0000001127 nova-compute[98206]:   <serial>9fa058ef-88b8-4b67-a74e-94986bafb235</serial>
May 21 02:07:58.509793 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:07:58.509793 np0000001127 nova-compute[98206]: </disk>
May 21 02:07:58.509793 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:07:58.565640 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b646159a-f806-487d-8a14-0aa8e2438f2b/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:58.566221 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b646159a-f806-487d-8a14-0aa8e2438f2b/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:58.644240 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:07:58.665193 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b646159a-f806-487d-8a14-0aa8e2438f2b/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:58.667070 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-13 (vdb) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:07:58.672620 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:07:58.675519 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511701d6-fac9-4e15-803d-e9038bd1a018/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:58.768050 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511701d6-fac9-4e15-803d-e9038bd1a018/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:58.768713 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511701d6-fac9-4e15-803d-e9038bd1a018/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:58.854156 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511701d6-fac9-4e15-803d-e9038bd1a018/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:58.860686 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:58.955477 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:58.956114 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:59.054811 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:59.054811 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:07:59.064106 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:07:59.064106 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:07:59.065247 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779329279.0646853, b646159a-f806-487d-8a14-0aa8e2438f2b => ua-9fa058ef-88b8-4b67-a74e-94986bafb235> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 02:07:59.093151 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-9fa058ef-88b8-4b67-a74e-94986bafb235 for instance b646159a-f806-487d-8a14-0aa8e2438f2b {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 02:07:59.099274 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Successfully detached device vdb from instance b646159a-f806-487d-8a14-0aa8e2438f2b from the live domain config.
May 21 02:07:59.100586 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:07:59.101164 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235', 'iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9fa058ef-88b8-4b67-a74e-94986bafb235', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-13'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:07:59.101348 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:07:59.126354 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "env LANG=C uptime" returned: 0 in 0.062s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:07:59.128879 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Hypervisor/Node resource view: name=np0000001127 free_ram=10290MB free_disk=72.79654312133789GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 21 02:07:59.128879 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:59.128879 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:59.600984 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Starting migrate_disk_and_power_off {{(pid=98206) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 21 02:07:59.626511 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:59.630980 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:59.658635 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:59.678977 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Found WWN 3300000003f954a95 for multipath device dm-14 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:07:59.682684 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.061s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:07:59.682684 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] <== connect_volume: return (3062ms) {'type': 'block', 'scsi_wwn': '3300000003f954a95', 'path': '/dev/dm-14', 'multipath_id': '3300000003f954a95'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:07:59.682684 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003f954a95', 'path': '/dev/dm-14', 'multipath_id': '3300000003f954a95'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:07:59.684609 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.570s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:07:59.684609 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6', 'iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a9d20392-5e79-4e81-8258-a7f8aeef7ea6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:07:59.699014 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:07:59.699833 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:07:59.700494 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:07:59.700494 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:07:59.700775 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:07:59.700922 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:07:59.715711 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:07:59.715711 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:59.724164 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:07:59.724164 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:59.730701 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6] added
May 21 02:07:59.730701 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:07:59.730701 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:07:59.730701 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:07:59.730701 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:07:59.730701 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:07:59.730701 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:59.730939 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:07:59.731039 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0306(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:07:59.731891 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:07:59.735827 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6] added
May 21 02:07:59.735827 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:07:59.735827 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:07:59.735827 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:07:59.735827 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:07:59.735827 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:07:59.735827 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:07:59.735978 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:07:59.736074 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0351(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:07:59.736201 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:07:59.823607 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-9a1410f0-ea6d-4ebc-b951-02d7c0f3e32e req-9b57d15c-e824-4ecb-a119-8a052c9f837e service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Received event network-vif-unplugged-2b286fbf-a6fe-4dcc-af12-2521cf154dbb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:07:59.823926 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-9a1410f0-ea6d-4ebc-b951-02d7c0f3e32e req-9b57d15c-e824-4ecb-a119-8a052c9f837e service nova] Acquiring lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:07:59.824021 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-9a1410f0-ea6d-4ebc-b951-02d7c0f3e32e req-9b57d15c-e824-4ecb-a119-8a052c9f837e service nova] Lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:07:59.824242 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-9a1410f0-ea6d-4ebc-b951-02d7c0f3e32e req-9b57d15c-e824-4ecb-a119-8a052c9f837e service nova] Lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:07:59.826692 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-9a1410f0-ea6d-4ebc-b951-02d7c0f3e32e req-9b57d15c-e824-4ecb-a119-8a052c9f837e service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] No waiting events found dispatching network-vif-unplugged-2b286fbf-a6fe-4dcc-af12-2521cf154dbb {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:07:59.827248 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-9a1410f0-ea6d-4ebc-b951-02d7c0f3e32e req-9b57d15c-e824-4ecb-a119-8a052c9f837e service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Received unexpected event network-vif-unplugged-2b286fbf-a6fe-4dcc-af12-2521cf154dbb for instance with vm_state active and task_state resize_migrating.
May 21 02:07:59.827599 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:59.830874 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:59.949196 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.99970924199988 future=<Future at 0x71c05822d5e0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:07:59.951985 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Instance destroyed successfully.
May 21 02:07:59.952985 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:06:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='multiattach-server-0',id=54,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzu+v5yloohnjet+lpl7Cb5m5YuZdtxheBkBGOMBLLe2AJEatmv/W6U1humbPofoJpKHaVTa0sSri4Ktoz/rRBuEiIFUUGVMQjgWmfd958Eyx52s4Fg6gJyB/ru0BJ+zA==',key_name='tempest-keypair-1890511814',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:07:08Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='848912b0c0e94d2795bb2332daf1730e',ramdisk_id='',reservation_id='r-riou1f0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-289054175',owner_user_name='tempest-AttachVolumeMultiAttachTest-289054175-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:07:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='049d6c8cccfa4ae38d78a88ef5be0f1b',uuid=aa3f5a78-fb82-4e21-8ebf-90bf48a122be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "address": "fa:16:3e:db:08:dd", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "vif_mac": "fa:16:3e:db:08:dd"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b286fbf-a6", "ovs_interfaceid": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:07:59.953257 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converting VIF {"id": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "address": "fa:16:3e:db:08:dd", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "vif_mac": "fa:16:3e:db:08:dd"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b286fbf-a6", "ovs_interfaceid": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:07:59.953945 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:08:dd,bridge_name='br-int',has_traffic_filtering=True,id=2b286fbf-a6fe-4dcc-af12-2521cf154dbb,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b286fbf-a6') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:07:59.954190 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:08:dd,bridge_name='br-int',has_traffic_filtering=True,id=2b286fbf-a6fe-4dcc-af12-2521cf154dbb,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b286fbf-a6') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:07:59.955706 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:59.955943 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b286fbf-a6, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:07:59.959499 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:07:59.960989 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:59.961169 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=852bc5ef-1729-4993-9a8a-4417af6fba60) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:07:59.964962 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:07:59.965646 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:07:59.968649 np0000001127 nova-compute[98206]: INFO os_vif [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:08:dd,bridge_name='br-int',has_traffic_filtering=True,id=2b286fbf-a6fe-4dcc-af12-2521cf154dbb,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b286fbf-a6')
May 21 02:08:00.148629 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Applying migration context for instance aa3f5a78-fb82-4e21-8ebf-90bf48a122be as it has an incoming, in-progress migration e36c9eb2-7bc4-4d53-9029-ee680a5875b8. Migration status is migrating {{(pid=98206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
May 21 02:08:00.150048 np0000001127 nova-compute[98206]: INFO nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Updating resource usage from migration e36c9eb2-7bc4-4d53-9029-ee680a5875b8
May 21 02:08:00.195694 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:07:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-2090104866',display_name='tempest-TestVolumeBootPatternV346-server-2090104866',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpatternv346-server-2090104866',id=59,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpEt4Io3GsQloI3uWy+Fcwyidj5RUQCIS+FO+jXfWfF/jddRfJilIb8g7iwC6UjJIdIQAzwExNMeXVn61OQ/jD5FDPzE2iYyuHTIBhS95owiCL689x29AX8Ud66JK9RFw==',key_name='tempest-keypair-1022747730',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89e0ea7da0f244aab58f9da579e53864',ramdisk_id='',reservation_id='r-6b0g2p98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1354384974',owner_user_name='tempest-TestVolumeBootPatternV346-1354384974-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:07:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0083b33595414e5e8a3a80e7fea274ba',uuid=e897b981-cb4b-48b1-a9fe-23c447993d1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd", "address": "fa:16:3e:d6:68:cb", "network": {"id": "460fd532-ef54-4f63-922b-b9d9f73f665f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1504169250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89e0ea7da0f244aab58f9da579e53864", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b5a2fb-d0", "ovs_interfaceid": "f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:08:00.197243 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Converting VIF {"id": "f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd", "address": "fa:16:3e:d6:68:cb", "network": {"id": "460fd532-ef54-4f63-922b-b9d9f73f665f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1504169250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89e0ea7da0f244aab58f9da579e53864", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b5a2fb-d0", "ovs_interfaceid": "f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:08:00.197923 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:68:cb,bridge_name='br-int',has_traffic_filtering=True,id=f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd,network=Network(460fd532-ef54-4f63-922b-b9d9f73f665f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6b5a2fb-d0') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:08:00.200568 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 6ccaedfe-bec9-4591-b845-acf0cc81d026 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:08:00.200988 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lazy-loading 'pci_devices' on Instance uuid e897b981-cb4b-48b1-a9fe-23c447993d1e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:08:00.201861 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 9b4239c5-84df-4d87-a2d4-fb6192408f58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:08:00.202020 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 45f01b41-a43c-4ddf-aa07-22f8c2c50758 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:08:00.202104 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 16a0cc8d-c65b-4166-ad1a-5318b18ed00e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:08:00.202197 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance b6df4554-8490-4d5a-9d4d-acfd46419cb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:08:00.203282 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance feb908f9-10aa-4ba0-8289-c76a3a6279c7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:08:00.203282 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 609b1611-3b05-4b86-8bf3-85f16f199d80 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:08:00.203282 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance b646159a-f806-487d-8a14-0aa8e2438f2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:08:00.203282 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 2b990342-3aef-4ea5-a3bb-c776f4dd8567 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:08:00.203282 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance c76064e6-3702-4e67-9d4f-ef67cd4b7b22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:08:00.203282 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:08:00.203282 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 511701d6-fac9-4e15-803d-e9038bd1a018 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:08:00.203282 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance e897b981-cb4b-48b1-a9fe-23c447993d1e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:08:00.203282 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Migration e36c9eb2-7bc4-4d53-9029-ee680a5875b8 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 21 02:08:00.203282 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance aa3f5a78-fb82-4e21-8ebf-90bf48a122be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:08:00.203959 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 21 02:08:00.203959 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Final resource view: name=np0000001127 phys_ram=24030MB used_ram=3456MB phys_disk=95GB used_disk=10GB total_vcpus=12 used_vcpus=15 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:07:59 up 38 min,  2 users,  load average: 9.54, 9.36, 5.98\n', 'num_instances': '14', 'num_vm_active': '12', 'num_task_None': '11', 'num_os_type_None': '14', 'num_proj_848912b0c0e94d2795bb2332daf1730e': '5', 'io_workload': '2', 'num_proj_b72317ce75214e619a14739991461c95': '2', 'num_proj_89e0ea7da0f244aab58f9da579e53864': '3', 'num_vm_stopped': '1', 'num_task_powering-on': '1', 'num_proj_62ebdb16aee84e22a88dfc8960debd32': '1', 'num_task_resize_migrating': '1', 'num_proj_549d365926ce49efa4c4bf50c7bbbbaa': '1', 'num_proj_4ae2ef74a1614eb09e4f71f709f64126': '1', 'num_proj_d3efe4046d6a442d91b3463e2d99fd7b': '1', 'num_vm_building': '1', 'num_task_spawning': '1'} {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 21 02:08:00.515442 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Detected multiple connections on this host for volume: e7cfdf26-9973-4cc1-8395-11f9ebc98c4b, skipping target disconnect.
May 21 02:08:00.518673 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:00.635551 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:08:00.636043 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:00.708124 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] End _get_guest_xml xml=<domain type="qemu">
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:   <uuid>e897b981-cb4b-48b1-a9fe-23c447993d1e</uuid>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:   <name>instance-0000003b</name>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:       <nova:name>tempest-TestVolumeBootPatternV346-server-2090104866</nova:name>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:07:56</nova:creationTime>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:       <nova:image uuid="">
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:         <nova:user uuid="0083b33595414e5e8a3a80e7fea274ba">tempest-TestVolumeBootPatternV346-1354384974-project-member</nova:user>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:         <nova:project uuid="89e0ea7da0f244aab58f9da579e53864">tempest-TestVolumeBootPatternV346-1354384974</nova:project>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:       <nova:root type="volume" uuid=""/>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:         <nova:port uuid="f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd">
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:     <system>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:       <entry name="serial">e897b981-cb4b-48b1-a9fe-23c447993d1e</entry>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:       <entry name="uuid">e897b981-cb4b-48b1-a9fe-23c447993d1e</entry>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:     </system>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:   <os>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:   </os>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:   <features>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:   </features>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:   <devices>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/e897b981-cb4b-48b1-a9fe-23c447993d1e/disk.config"/>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:     </disk>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:       <alias name="ua-65b64e18-a66f-4a0a-a898-df73bbdf8fdc"/>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-14"/>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:       <serial>65b64e18-a66f-4a0a-a898-df73bbdf8fdc</serial>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:     </disk>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:d6:68:cb"/>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:       <target dev="tapf6b5a2fb-d0"/>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:     </interface>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/e897b981-cb4b-48b1-a9fe-23c447993d1e/console.log" append="off"/>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:     </serial>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:     <video>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:     </video>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:     </rng>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:   </devices>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]: </domain>
May 21 02:08:00.708124 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:08:00.711146 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Preparing to wait for external event network-vif-plugged-f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:08:00.711845 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Acquiring lock "e897b981-cb4b-48b1-a9fe-23c447993d1e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:00.712407 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "e897b981-cb4b-48b1-a9fe-23c447993d1e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:00.716494 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "e897b981-cb4b-48b1-a9fe-23c447993d1e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:00.716494 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:07:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-2090104866',display_name='tempest-TestVolumeBootPatternV346-server-2090104866',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpatternv346-server-2090104866',id=59,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpEt4Io3GsQloI3uWy+Fcwyidj5RUQCIS+FO+jXfWfF/jddRfJilIb8g7iwC6UjJIdIQAzwExNMeXVn61OQ/jD5FDPzE2iYyuHTIBhS95owiCL689x29AX8Ud66JK9RFw==',key_name='tempest-keypair-1022747730',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89e0ea7da0f244aab58f9da579e53864',ramdisk_id='',reservation_id='r-6b0g2p98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1354384974',owner_user_name='tempest-TestVolumeBootPatternV346-1354384974-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:07:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0083b33595414e5e8a3a80e7fea274ba',uuid=e897b981-cb4b-48b1-a9fe-23c447993d1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd", "address": "fa:16:3e:d6:68:cb", "network": {"id": "460fd532-ef54-4f63-922b-b9d9f73f665f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1504169250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89e0ea7da0f244aab58f9da579e53864", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b5a2fb-d0", "ovs_interfaceid": "f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:08:00.716494 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Converting VIF {"id": "f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd", "address": "fa:16:3e:d6:68:cb", "network": {"id": "460fd532-ef54-4f63-922b-b9d9f73f665f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1504169250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89e0ea7da0f244aab58f9da579e53864", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b5a2fb-d0", "ovs_interfaceid": "f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:08:00.716494 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:68:cb,bridge_name='br-int',has_traffic_filtering=True,id=f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd,network=Network(460fd532-ef54-4f63-922b-b9d9f73f665f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6b5a2fb-d0') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:08:00.716494 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:68:cb,bridge_name='br-int',has_traffic_filtering=True,id=f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd,network=Network(460fd532-ef54-4f63-922b-b9d9f73f665f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6b5a2fb-d0') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:08:00.716985 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:00.718138 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:00.718453 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:08:00.724963 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:00.725165 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '794da1cc-1ea7-5f07-83f4-aea3e7ba6a8b', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:00.729438 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:08:00.732387 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:08:00.736596 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:08:00.737371 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:08:00.737371 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:08:00.740825 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be_resize/disk /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:00.768887 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:00.770961 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf6b5a2fb-d0, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:00.773368 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf6b5a2fb-d0, col_values=(('qos', UUID('425729c9-b3e6-4a95-977a-2d3fe4ca40a5')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:08:00.777451 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:08:00.777451 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf6b5a2fb-d0, col_values=(('external_ids', {'iface-id': 'f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:68:cb', 'vm-uuid': 'e897b981-cb4b-48b1-a9fe-23c447993d1e'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:08:00.783159 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:08:00.783159 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:00.784923 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:08:00.788914 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:00.793697 np0000001127 nova-compute[98206]: INFO os_vif [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:68:cb,bridge_name='br-int',has_traffic_filtering=True,id=f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd,network=Network(460fd532-ef54-4f63-922b-b9d9f73f665f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6b5a2fb-d0')
May 21 02:08:00.796767 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:00.806288 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:00.823651 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:00.823651 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:00.823651 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:00.823651 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:00.823651 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:08:00.823651 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:08:00.823651 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:00.823651 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:00.823651 np0000001127 nova-compute[98206]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:08:00.823651 np0000001127 nova-compute[98206]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:08:00.823651 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:00.823651 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:00.823651 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:00.823651 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:00.823651 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:08:00.823651 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:00.823651 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:00.823651 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:00.823651 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:00.823651 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:08:00.823651 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:08:00.823651 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:00.823651 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:00.823651 np0000001127 nova-compute[98206]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:08:00.823651 np0000001127 nova-compute[98206]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:08:00.823651 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:00.823651 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:00.823651 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:00.823651 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:00.823651 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:08:00.832253 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:00.832253 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:00.832253 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:00.832253 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:00.832253 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:08:00.832253 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:08:00.832253 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:00.832253 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:00.832253 np0000001127 nova-compute[98206]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:08:00.832253 np0000001127 nova-compute[98206]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:08:00.832253 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:00.832253 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:00.832253 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:00.832253 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:00.832253 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:08:00.832851 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:00.832851 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:00.832851 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:00.832851 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:00.832851 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:08:00.832851 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:08:00.832851 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:00.832851 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:00.832851 np0000001127 nova-compute[98206]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:08:00.832851 np0000001127 nova-compute[98206]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:08:00.832851 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:00.832851 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:00.832851 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:00.832851 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:00.832851 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:08:00.871102 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "cp -r /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be_resize/disk /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk" returned: 0 in 0.133s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:08:00.871484 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be_resize/disk.config /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk.config {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:00.896100 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6, portal: 192.168.40.100,3260]
May 21 02:08:00.896100 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6, portal: 192.168.40.100,3260] successful.
May 21 02:08:00.896100 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:00.906048 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6, portal: 192.168.50.100,3260]
May 21 02:08:00.906048 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6, portal: 192.168.50.100,3260] successful.
May 21 02:08:00.906048 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:00.923321 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:00.925553 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "cp -r /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be_resize/disk.config /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk.config" returned: 0 in 0.052s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:08:00.925553 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be_resize/disk.info /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk.info {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:00.944303 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:00.957563 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:00.957563 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:00.957563 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:00.957563 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:00.957563 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:08:00.957563 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:08:00.957563 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:00.957563 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:00.957563 np0000001127 nova-compute[98206]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:08:00.957563 np0000001127 nova-compute[98206]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:08:00.957563 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:00.957563 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:00.957563 np0000001127 nova-compute[98206]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:00.957563 np0000001127 nova-compute[98206]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:00.957563 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:00.957563 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:00.957563 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:08:00.958302 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:00.958302 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:00.958302 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:00.958302 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:00.958302 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:08:00.958302 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:08:00.958302 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:00.958302 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:00.958302 np0000001127 nova-compute[98206]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:08:00.958302 np0000001127 nova-compute[98206]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:08:00.958302 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:00.958302 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:00.958302 np0000001127 nova-compute[98206]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:00.958302 np0000001127 nova-compute[98206]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:00.958302 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:00.958302 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:00.958302 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:08:00.959385 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.259s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:08:00.959385 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:08:00.963281 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] HCTL ('21', '-', '-', 0) found on session 125 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:08:00.963429 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Scanning host 21 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:08:00.974361 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:00.974361 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:00.974361 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:00.974361 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:00.974361 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:08:00.974361 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:08:00.974361 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:00.974361 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:00.974361 np0000001127 nova-compute[98206]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:08:00.974361 np0000001127 nova-compute[98206]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:08:00.974361 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:00.974361 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:00.974361 np0000001127 nova-compute[98206]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:00.974361 np0000001127 nova-compute[98206]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:00.974361 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:00.974361 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:00.974361 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:08:00.974746 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:00.974746 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:00.974746 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:00.974746 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:00.974746 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:08:00.974746 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:08:00.974746 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:00.974746 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:00.974746 np0000001127 nova-compute[98206]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:08:00.974746 np0000001127 nova-compute[98206]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:08:00.974746 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:00.974746 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:00.974746 np0000001127 nova-compute[98206]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:00.974746 np0000001127 nova-compute[98206]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:00.974746 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:00.974746 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:00.974746 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:08:00.975086 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.274s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:08:00.975264 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:08:00.977507 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "cp -r /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be_resize/disk.info /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk.info" returned: 0 in 0.052s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:08:00.978133 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] HCTL ('22', '-', '-', 0) found on session 126 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:08:00.980671 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Scanning host 22 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:08:00.985865 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Searching for a device in session 125 and hctl ['21', '*', '*', 0] yield: sdp {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:08:00.985865 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a9d20392-5e79-4e81-8258-a7f8aeef7ea6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:08:00.999952 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Searching for a device in session 126 and hctl ['22', '*', '*', 0] yield: sdq {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:08:01.000215 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Connected to sdq using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a9d20392-5e79-4e81-8258-a7f8aeef7ea6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:08:01.168052 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:08:01.168396 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:08:01.674233 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:08:01.695616 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:01.701279 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:08:01.907649 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8701df5d-e55f-4f4d-a493-814644d5d74d req-790e8fd1-7559-4f6f-883f-74ad1acf088f service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Received event network-vif-unplugged-2b286fbf-a6fe-4dcc-af12-2521cf154dbb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:01.912228 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8701df5d-e55f-4f4d-a493-814644d5d74d req-790e8fd1-7559-4f6f-883f-74ad1acf088f service nova] Acquiring lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:01.912461 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8701df5d-e55f-4f4d-a493-814644d5d74d req-790e8fd1-7559-4f6f-883f-74ad1acf088f service nova] Lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:01.912663 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8701df5d-e55f-4f4d-a493-814644d5d74d req-790e8fd1-7559-4f6f-883f-74ad1acf088f service nova] Lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:01.912820 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8701df5d-e55f-4f4d-a493-814644d5d74d req-790e8fd1-7559-4f6f-883f-74ad1acf088f service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] No waiting events found dispatching network-vif-unplugged-2b286fbf-a6fe-4dcc-af12-2521cf154dbb {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:08:01.912973 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-8701df5d-e55f-4f4d-a493-814644d5d74d req-790e8fd1-7559-4f6f-883f-74ad1acf088f service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Received unexpected event network-vif-unplugged-2b286fbf-a6fe-4dcc-af12-2521cf154dbb for instance with vm_state active and task_state resize_migrating.
May 21 02:08:02.145624 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:02.145925 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:02.180925 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Compute_service record updated for np0000001127:np0000001127 {{(pid=98206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 21 02:08:02.181147 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.054s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:02.182431 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:08:02.182765 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Cleaning up deleted instances {{(pid=98206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}
May 21 02:08:02.213181 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Port 2b286fbf-a6fe-4dcc-af12-2521cf154dbb binding to destination host np0000001127 is already ACTIVE {{(pid=98206) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3211}}
May 21 02:08:02.321339 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:08:02.321500 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:08:02.321586 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] No VIF found with MAC fa:16:3e:d6:68:cb, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:08:02.321998 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Using config drive
May 21 02:08:02.684844 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] There are 0 instances to clean {{(pid=98206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12092}}
May 21 02:08:02.685248 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:08:02.685248 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98206) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12121}}
May 21 02:08:02.718395 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Found WWN 3300000008fa7ce80 for multipath device dm-17 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:08:02.718538 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:08:02.719905 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 4.234s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:08:02.720292 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] <== connect_volume: return (5606ms) {'type': 'block', 'scsi_wwn': '3300000008fa7ce80', 'path': '/dev/dm-17', 'multipath_id': '3300000008fa7ce80'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:08:02.720484 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36', 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9e45da95-d0bd-4a28-859f-96496102cc36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:08:02.720701 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008fa7ce80', 'path': '/dev/dm-17', 'multipath_id': '3300000008fa7ce80'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:08:02.720831 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:08:02.723317 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lazy-loading 'flavor' on Instance uuid 2b990342-3aef-4ea5-a3bb-c776f4dd8567 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:08:02.767078 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:02.767078 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:02.767078 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:02.767078 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:02.767078 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:08:02.767078 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:08:02.767078 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:02.767078 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:02.767078 np0000001127 nova-compute[98206]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:08:02.767078 np0000001127 nova-compute[98206]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:08:02.767078 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:02.767078 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:02.767078 np0000001127 nova-compute[98206]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:02.767078 np0000001127 nova-compute[98206]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:02.767078 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:02.767078 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:02.767078 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:08:02.768816 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:02.768816 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:02.768816 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:02.768816 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:02.768816 np0000001127 nova-compute[98206]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:08:02.768816 np0000001127 nova-compute[98206]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:08:02.768816 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:02.768816 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:02.768816 np0000001127 nova-compute[98206]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:08:02.768816 np0000001127 nova-compute[98206]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:08:02.768816 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:02.768816 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:02.768816 np0000001127 nova-compute[98206]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:02.768816 np0000001127 nova-compute[98206]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:02.768816 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:02.768816 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:02.768816 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:08:02.768816 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435', '115'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36', '117'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', '118'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', '119'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235', '121'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235', '122'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc', '123'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc', '124'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6', '125'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6', '126'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '95')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:08:02.768816 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36', '116')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:08:02.769626 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36', '117')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:08:02.770759 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c506340>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36'): ({'sdi'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:08:02.771001 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Removing multipathed devices sdi, sdh {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:08:02.772038 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Flush multipath device 330000000bcd06062 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:08:02.827013 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:02.835217 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:08:02.899498 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:08:02.946649 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:08:02.946925 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:08:02.948864 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:08:02.961413 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:08:02.961648 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:08:02.970829 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Creating config drive at /opt/stack/data/nova/instances/e897b981-cb4b-48b1-a9fe-23c447993d1e/disk.config
May 21 02:08:02.975461 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:02.976578 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e897b981-cb4b-48b1-a9fe-23c447993d1e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5snytf7r {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:03.031308 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 116, target: iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36, portal: 192.168.40.100,3260]
May 21 02:08:03.031308 np0000001127 nova-compute[98206]: Logout of [sid: 116, target: iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36, portal: 192.168.40.100,3260] successful.
May 21 02:08:03.031308 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:03.038937 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e897b981-cb4b-48b1-a9fe-23c447993d1e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5snytf7r" returned: 0 in 0.062s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:08:03.056024 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:03.073121 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:03.114449 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 117, target: iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36, portal: 192.168.50.100,3260]
May 21 02:08:03.114449 np0000001127 nova-compute[98206]: Logout of [sid: 117, target: iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36, portal: 192.168.50.100,3260] successful.
May 21 02:08:03.114449 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:03.139285 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:03.139696 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.420s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:08:03.139831 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] <== disconnect_volume: return (4654ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:08:03.139974 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:08:03.142537 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 4.041s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:08:03.143167 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235', 'iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9fa058ef-88b8-4b67-a74e-94986bafb235', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-13'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:08:03.146889 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Start _get_guest_xml network_info=[{"id": "58f0082f-9f4d-42c5-9569-faf668cc281d", "address": "fa:16:3e:97:bd:d9", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f0082f-9f", "ovs_interfaceid": "58f0082f-9f4d-42c5-9569-faf668cc281d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36', 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9e45da95-d0bd-4a28-859f-96496102cc36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, 'status': 'reserved', 'instance': '609b1611-3b05-4b86-8bf3-85f16f199d80', 'attached_at': '', 'detached_at': '', 'volume_id': '9e45da95-d0bd-4a28-859f-96496102cc36', 'serial': '9e45da95-d0bd-4a28-859f-96496102cc36'}, 'delete_on_termination': False, 'attachment_id': '4115dc87-a760-4395-9d58-5798cde4b0e5', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:08:03.147389 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:08:03.151029 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:08:03.152552 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-269447234', uuid='609b1611-3b05-4b86-8bf3-85f16f199d80'), owner=OwnerMeta(userid='4878b5a5bf184852a9ce383caa1c67a4', username='tempest-TestVolumeBootPattern-1995806391-project-member', projectid='62ebdb16aee84e22a88dfc8960debd32', projectname='tempest-TestVolumeBootPattern-1995806391'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "58f0082f-9f4d-42c5-9569-faf668cc281d", "address": "fa:16:3e:97:bd:d9", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f0082f-9f", "ovs_interfaceid": "58f0082f-9f4d-42c5-9569-faf668cc281d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329283.152122) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:08:03.154607 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:08:03.154940 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:08:03.156782 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:08:03.156979 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:08:03.158152 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:08:03.158531 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:08:03.158696 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:08:03.158816 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:08:03.158961 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:08:03.159079 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:08:03.159195 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:08:03.159419 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:08:03.159624 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:08:03.159775 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:08:03.159982 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:08:03.160107 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:08:03.160292 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lazy-loading 'vcpu_model' on Instance uuid 609b1611-3b05-4b86-8bf3-85f16f199d80 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:08:03.187358 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:08:03.188539 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:03.188539 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:03.188539 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:03.188539 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:03.188539 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:03.188539 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:03.188539 np0000001127 nova-compute[98206]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:08:03.188539 np0000001127 nova-compute[98206]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:08:03.188539 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:03.188539 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:03.188539 np0000001127 nova-compute[98206]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:03.188539 np0000001127 nova-compute[98206]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:03.188539 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:03.188539 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:03.188539 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:08:03.189023 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:03.189023 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:03.189023 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:03.189023 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:03.189023 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:03.189023 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:03.189023 np0000001127 nova-compute[98206]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:08:03.189023 np0000001127 nova-compute[98206]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235 (non-flash)
May 21 02:08:03.189023 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:03.189023 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:03.189023 np0000001127 nova-compute[98206]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:03.189023 np0000001127 nova-compute[98206]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:03.189023 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:03.189023 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:03.189023 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:08:03.189023 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435', '115'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', '118'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', '119'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235', '121'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235', '122'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc', '123'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc', '124'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6', '125'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6', '126'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '95')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:08:03.189538 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235', '121')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:08:03.190992 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235', '122')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:08:03.191616 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c0587d96c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235'): ({'sdm'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235'): ({'sdn'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:08:03.191865 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Removing multipathed devices sdm, sdn {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:08:03.192079 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Flush multipath device 330000000ee6fe8da {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:08:03.221786 np0000001127 nova-compute[98206]: DEBUG nova.compute.rpcapi [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98206) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 21 02:08:03.228420 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Attempting to attach volume a9d20392-5e79-4e81-8258-a7f8aeef7ea6 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 02:08:03.233634 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:08:03.237026 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:03.237026 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:03.237026 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:03.237026 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] attach device xml: <disk type="block" device="disk">
May 21 02:08:03.237026 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:08:03.237026 np0000001127 nova-compute[98206]:   <alias name="ua-a9d20392-5e79-4e81-8258-a7f8aeef7ea6"/>
May 21 02:08:03.237026 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-17"/>
May 21 02:08:03.237026 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:08:03.237026 np0000001127 nova-compute[98206]:   <serial>a9d20392-5e79-4e81-8258-a7f8aeef7ea6</serial>
May 21 02:08:03.237026 np0000001127 nova-compute[98206]: </disk>
May 21 02:08:03.237026 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 02:08:03.282307 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:08:03.335598 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Checking to see if SCSI volumes sdm, sdn have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:08:03.335598 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] SCSI volumes sdm, sdn have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:08:03.336128 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Checking to see if device paths {'sdm', 'sdn'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:08:03.349964 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Device paths {'sdm', 'sdn'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:08:03.349964 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:08:03.362366 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:03.402866 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 121, target: iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235, portal: 192.168.40.100,3260]
May 21 02:08:03.402866 np0000001127 nova-compute[98206]: Logout of [sid: 121, target: iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235, portal: 192.168.40.100,3260] successful.
May 21 02:08:03.402866 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:03.430956 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:03.444629 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:03.486425 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 122, target: iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235, portal: 192.168.50.100,3260]
May 21 02:08:03.486425 np0000001127 nova-compute[98206]: Logout of [sid: 122, target: iqn.2023-03.storpool.com:os--volume-9fa058ef-88b8-4b67-a74e-94986bafb235, portal: 192.168.50.100,3260] successful.
May 21 02:08:03.486425 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:03.512520 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:03.512520 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:08:03.512520 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] <== disconnect_volume: return (4410ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:08:03.512520 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:08:03.654741 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:03.662791 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Object Instance<609b1611-3b05-4b86-8bf3-85f16f199d80> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:08:03.679129 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/609b1611-3b05-4b86-8bf3-85f16f199d80/disk.config --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:03.690314 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:03.697154 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:08:03.766491 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:03.774963 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/609b1611-3b05-4b86-8bf3-85f16f199d80/disk.config --force-share --output=json" returned: 0 in 0.095s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:08:03.775126 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "/opt/stack/data/nova/instances/609b1611-3b05-4b86-8bf3-85f16f199d80/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:03.776452 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "/opt/stack/data/nova/instances/609b1611-3b05-4b86-8bf3-85f16f199d80/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:03.776452 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "/opt/stack/data/nova/instances/609b1611-3b05-4b86-8bf3-85f16f199d80/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:03.776452 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:08:03.776674 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36', 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9e45da95-d0bd-4a28-859f-96496102cc36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:08:03.776729 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:08:03.777361 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:08:03.777627 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36', 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9e45da95-d0bd-4a28-859f-96496102cc36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:08:03.798726 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:08:03.799244 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:08:03.800616 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:08:03.800616 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:08:03.800616 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:08:03.800616 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:08:03.817267 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:08:03.817267 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:03.822125 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:08:03.822125 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:03.831756 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36] added
May 21 02:08:03.831756 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:08:03.831756 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:08:03.831756 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:08:03.831756 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:08:03.831756 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:08:03.831756 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:03.832097 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:08:03.832912 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0323(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:08:03.832912 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:08:03.835776 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:03.836786 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36] added
May 21 02:08:03.836786 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:08:03.836786 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:08:03.836786 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:08:03.836786 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:08:03.836786 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:08:03.836786 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:03.837023 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:08:03.839304 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0366(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:08:03.839304 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:08:03.840214 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:03.868567 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-ac3bea08-dad4-4ed0-83a7-89f4c908f3f7 req-e2b07bc7-4cbb-4332-b8ec-0643b691388d service nova] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Received event network-vif-plugged-f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:03.869068 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ac3bea08-dad4-4ed0-83a7-89f4c908f3f7 req-e2b07bc7-4cbb-4332-b8ec-0643b691388d service nova] Acquiring lock "e897b981-cb4b-48b1-a9fe-23c447993d1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:03.869219 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ac3bea08-dad4-4ed0-83a7-89f4c908f3f7 req-e2b07bc7-4cbb-4332-b8ec-0643b691388d service nova] Lock "e897b981-cb4b-48b1-a9fe-23c447993d1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:03.869365 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ac3bea08-dad4-4ed0-83a7-89f4c908f3f7 req-e2b07bc7-4cbb-4332-b8ec-0643b691388d service nova] Lock "e897b981-cb4b-48b1-a9fe-23c447993d1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:03.869482 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-ac3bea08-dad4-4ed0-83a7-89f4c908f3f7 req-e2b07bc7-4cbb-4332-b8ec-0643b691388d service nova] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Processing event network-vif-plugged-f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:08:04.070675 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lazy-loading 'flavor' on Instance uuid b646159a-f806-487d-8a14-0aa8e2438f2b {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:08:04.254755 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:04.324835 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "refresh_cache-aa3f5a78-fb82-4e21-8ebf-90bf48a122be" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:08:04.325024 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquired lock "refresh_cache-aa3f5a78-fb82-4e21-8ebf-90bf48a122be" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:08:04.325230 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:08:04.480732 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329284.4803054, e897b981-cb4b-48b1-a9fe-23c447993d1e => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:08:04.481392 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:08:04.481724 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] VM Started (Lifecycle Event)
May 21 02:08:04.484716 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:08:04.489159 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Instance spawned successfully.
May 21 02:08:04.492490 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:08:04.828099 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:04.833051 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:08:04.837672 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:08:04.847390 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:08:04.847390 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:08:04.863133 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:08:04.863133 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:04.874783 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:04.888242 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:04.896351 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:04.896351 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:04.896351 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:04.896351 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:04.896351 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:04.896351 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:04.896351 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:04.896351 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:04.896351 np0000001127 nova-compute[98206]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:04.896351 np0000001127 nova-compute[98206]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:04.896351 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:04.896351 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:04.896351 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:08:04.896861 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:04.896861 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:04.896861 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:04.896861 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:04.896861 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:04.896861 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:04.896861 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:04.896861 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:04.896861 np0000001127 nova-compute[98206]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:04.896861 np0000001127 nova-compute[98206]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:04.896861 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:04.896861 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:04.896861 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:08:04.915602 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:04.915602 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:04.915602 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:04.915602 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:04.915602 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:04.915602 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:04.915602 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:04.915602 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:04.915602 np0000001127 nova-compute[98206]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:04.915602 np0000001127 nova-compute[98206]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:04.915602 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:04.915602 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:04.915602 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:08:04.919034 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:04.919034 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:04.919034 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:04.919034 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:04.919034 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:04.919034 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:04.919034 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:04.919034 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:04.919034 np0000001127 nova-compute[98206]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:04.919034 np0000001127 nova-compute[98206]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:04.919034 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:04.919034 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:04.919034 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:08:04.946802 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36, portal: 192.168.40.100,3260]
May 21 02:08:04.946802 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36, portal: 192.168.40.100,3260] successful.
May 21 02:08:04.946802 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:04.961553 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:04.976314 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36, portal: 192.168.50.100,3260]
May 21 02:08:04.976314 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36, portal: 192.168.50.100,3260] successful.
May 21 02:08:04.976314 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:04.985258 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:08:04.988898 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:08:04.991743 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:04.991743 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:04.991743 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:04.991743 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:04.991743 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:04.991743 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:04.991743 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:04.991743 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:04.991743 np0000001127 nova-compute[98206]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:04.991743 np0000001127 nova-compute[98206]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:04.991743 np0000001127 nova-compute[98206]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:08:04.991743 np0000001127 nova-compute[98206]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:08:04.991743 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:04.991743 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:04.991743 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:08:04.995031 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:04.995031 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:04.995031 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:04.995031 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:04.995031 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:04.995031 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:04.995031 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:04.995031 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:04.995031 np0000001127 nova-compute[98206]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:04.995031 np0000001127 nova-compute[98206]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:04.995031 np0000001127 nova-compute[98206]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:08:04.995031 np0000001127 nova-compute[98206]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:08:04.995031 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:04.995031 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:04.995031 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:08:04.995580 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.196s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:08:04.995753 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:08:04.996370 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:04.999290 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] HCTL ('13', '-', '-', 0) found on session 127 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:08:04.999441 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:08:05.000372 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:08:05.000600 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:08:05.000977 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:08:05.001262 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:08:05.001599 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:08:05.001921 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:08:05.026507 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:05.026507 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:05.026507 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:05.026507 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:05.026507 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:05.026507 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:05.026507 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:05.026507 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:05.026507 np0000001127 nova-compute[98206]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:05.026507 np0000001127 nova-compute[98206]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:05.026507 np0000001127 nova-compute[98206]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:08:05.026507 np0000001127 nova-compute[98206]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:08:05.026507 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:05.026507 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:05.026507 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:08:05.026507 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:05.026507 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:05.026507 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:05.026507 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:05.026507 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:05.026507 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:05.026507 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:05.026507 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:05.026507 np0000001127 nova-compute[98206]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:05.026507 np0000001127 nova-compute[98206]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:05.026507 np0000001127 nova-compute[98206]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:08:05.026507 np0000001127 nova-compute[98206]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:08:05.026507 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:05.026507 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:05.026507 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:08:05.027609 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.227s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:08:05.027609 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:08:05.027609 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching for a device in session 127 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:08:05.027609 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9e45da95-d0bd-4a28-859f-96496102cc36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:08:05.029298 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] HCTL ('14', '-', '-', 0) found on session 128 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:08:05.029421 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:08:05.049252 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching for a device in session 128 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:08:05.049452 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9e45da95-d0bd-4a28-859f-96496102cc36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:08:05.081979 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-203b3f99-6519-4572-8c28-3b4dcb925dde tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "b646159a-f806-487d-8a14-0aa8e2438f2b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.202s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:05.085320 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:08:05.085457 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:08:05.085624 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:08:05.085700 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] No VIF found with MAC fa:16:3e:ce:d8:84, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:08:05.214195 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6f521ca9-2227-40fd-b4cc-971f1297691b req-7ede5428-cb8c-44f9-9ab1-690257926ed7 service nova] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Received event network-changed-b3b7dd36-e770-402c-88ef-e5a90396d71f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:05.217251 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6f521ca9-2227-40fd-b4cc-971f1297691b req-7ede5428-cb8c-44f9-9ab1-690257926ed7 service nova] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Refreshing instance network info cache due to event network-changed-b3b7dd36-e770-402c-88ef-e5a90396d71f. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:08:05.217251 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6f521ca9-2227-40fd-b4cc-971f1297691b req-7ede5428-cb8c-44f9-9ab1-690257926ed7 service nova] Acquiring lock "refresh_cache-b646159a-f806-487d-8a14-0aa8e2438f2b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:08:05.217251 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6f521ca9-2227-40fd-b4cc-971f1297691b req-7ede5428-cb8c-44f9-9ab1-690257926ed7 service nova] Acquired lock "refresh_cache-b646159a-f806-487d-8a14-0aa8e2438f2b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:08:05.217251 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-6f521ca9-2227-40fd-b4cc-971f1297691b req-7ede5428-cb8c-44f9-9ab1-690257926ed7 service nova] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Refreshing network info cache for port b3b7dd36-e770-402c-88ef-e5a90396d71f {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:08:05.312593 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:05.489479 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Updating instance_info_cache with network_info: [{"id": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "address": "fa:16:3e:db:08:dd", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b286fbf-a6", "ovs_interfaceid": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:08:05.492730 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:08:05.493028 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329285.4928339, e897b981-cb4b-48b1-a9fe-23c447993d1e => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:08:05.493189 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] VM Paused (Lifecycle Event)
May 21 02:08:05.511969 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Took 9.30 seconds to spawn the instance on the hypervisor.
May 21 02:08:05.511969 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:08:05.694860 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:08:05.695072 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:08:05.695247 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:08:05.695444 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:08:05.695698 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 45.98 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:08:05.719054 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-6f521ca9-2227-40fd-b4cc-971f1297691b req-7ede5428-cb8c-44f9-9ab1-690257926ed7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:05.783576 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:05.800908 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:08:05.804888 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-71600993-72e6-487e-8e13-7933c13bc24b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Acquiring lock "b646159a-f806-487d-8a14-0aa8e2438f2b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:05.805075 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-71600993-72e6-487e-8e13-7933c13bc24b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "b646159a-f806-487d-8a14-0aa8e2438f2b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:05.805212 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-71600993-72e6-487e-8e13-7933c13bc24b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Acquiring lock "b646159a-f806-487d-8a14-0aa8e2438f2b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:05.806333 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-71600993-72e6-487e-8e13-7933c13bc24b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "b646159a-f806-487d-8a14-0aa8e2438f2b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:05.806333 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-71600993-72e6-487e-8e13-7933c13bc24b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "b646159a-f806-487d-8a14-0aa8e2438f2b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:05.808738 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-71600993-72e6-487e-8e13-7933c13bc24b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Terminating instance
May 21 02:08:05.941687 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f6d182d3-831c-45ad-b648-7758dcb3433c req-928e6440-8b45-4864-aa51-b91bc08eadfa service nova] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Received event network-vif-plugged-f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:05.941687 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f6d182d3-831c-45ad-b648-7758dcb3433c req-928e6440-8b45-4864-aa51-b91bc08eadfa service nova] Acquiring lock "e897b981-cb4b-48b1-a9fe-23c447993d1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:05.941687 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f6d182d3-831c-45ad-b648-7758dcb3433c req-928e6440-8b45-4864-aa51-b91bc08eadfa service nova] Lock "e897b981-cb4b-48b1-a9fe-23c447993d1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:05.941687 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f6d182d3-831c-45ad-b648-7758dcb3433c req-928e6440-8b45-4864-aa51-b91bc08eadfa service nova] Lock "e897b981-cb4b-48b1-a9fe-23c447993d1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:05.943968 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f6d182d3-831c-45ad-b648-7758dcb3433c req-928e6440-8b45-4864-aa51-b91bc08eadfa service nova] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] No waiting events found dispatching network-vif-plugged-f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:08:05.943968 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-f6d182d3-831c-45ad-b648-7758dcb3433c req-928e6440-8b45-4864-aa51-b91bc08eadfa service nova] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Received unexpected event network-vif-plugged-f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd for instance with vm_state active and task_state None.
May 21 02:08:05.992038 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Releasing lock "refresh_cache-aa3f5a78-fb82-4e21-8ebf-90bf48a122be" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:08:05.996799 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:08:05.999291 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329285.9990563, e897b981-cb4b-48b1-a9fe-23c447993d1e => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:08:05.999447 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] VM Resumed (Lifecycle Event)
May 21 02:08:06.020724 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Took 17.07 seconds to build instance.
May 21 02:08:06.085335 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-6f521ca9-2227-40fd-b4cc-971f1297691b req-7ede5428-cb8c-44f9-9ab1-690257926ed7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:06.158066 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0003722619999280141 future=<Future at 0x71c05824e630 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:06.158066 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:06.158066 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=8.790797538999868 future=<Future at 0x71c05822d5e0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:06.158297 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=8.790710025999942 future=<Future at 0x71c05822d5e0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:06.158502 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Emitting event <LifecycleEvent: 1779329271.1573837, 609b1611-3b05-4b86-8bf3-85f16f199d80 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:08:06.158617 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] VM Stopped (Lifecycle Event)
May 21 02:08:06.214134 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-6f521ca9-2227-40fd-b4cc-971f1297691b req-7ede5428-cb8c-44f9-9ab1-690257926ed7 service nova] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Updated VIF entry in instance network info cache for port b3b7dd36-e770-402c-88ef-e5a90396d71f. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:08:06.214370 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-6f521ca9-2227-40fd-b4cc-971f1297691b req-7ede5428-cb8c-44f9-9ab1-690257926ed7 service nova] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Updating instance_info_cache with network_info: [{"id": "b3b7dd36-e770-402c-88ef-e5a90396d71f", "address": "fa:16:3e:dc:c2:65", "network": {"id": "0618d411-0f50-4ee4-80a9-cbd395ea2c77", "bridge": "br-int", "label": "tempest-TestStampPattern-1490281843-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b72317ce75214e619a14739991461c95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b7dd36-e7", "ovs_interfaceid": "b3b7dd36-e770-402c-88ef-e5a90396d71f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:08:06.316518 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-71600993-72e6-487e-8e13-7933c13bc24b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:08:06.334103 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:06.337375 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:06.367527 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:06.477622 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:06.483706 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:06.502128 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:08:06.502535 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:08:06.507392 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:08:06.516577 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:08:06.522377 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c3ea9fec-ef16-43ff-8847-3ef3d49afa6c tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "e897b981-cb4b-48b1-a9fe-23c447993d1e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.577s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:06.540492 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:06.593876 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:08:06.596502 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:08:06.607835 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:08:06.611851 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe0f:28a1', 'fe80::440a:38ff:fe27:fa24', 'fe80::fc16:3eff:fe91:3d5c', 'fe80::a4db:73ff:fe81:949b', 'fe80::fc16:3eff:fefb:4d96', 'fe80::fc16:3eff:fe68:a810', 'fe80::3cc0:a4ff:feab:836e', 'fe80::fc16:3eff:fe65:6557', 'fe80::fc16:3eff:fef5:8ead', 'fe80::fc16:3eff:fece:d884', 'fe80::7ca5:4ff:fee7:fb0a', 'fe80::fc16:3eff:fe20:ae96', 'fe80::fc16:3eff:feb8:d101', 'fe80::7045:30ff:fe1a:b99f', 'fe80::fc16:3eff:fef1:4daa', 'fe80::2482:bff:fe1b:902b', 'fe80::fc16:3eff:fed6:68cb'] 
May 21 02:08:06.611851 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:08:06.611851 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:08:06.612055 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:08:06.654864 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a2f6d673-e1e7-4207-accc-aedd6f2afefd tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "2b990342-3aef-4ea5-a3bb-c776f4dd8567" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.299s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:06.661687 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:08:06.681950 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Instance destroyed successfully.
May 21 02:08:06.682912 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-71600993-72e6-487e-8e13-7933c13bc24b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lazy-loading 'resources' on Instance uuid b646159a-f806-487d-8a14-0aa8e2438f2b {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:08:06.699810 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:06.716454 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6f521ca9-2227-40fd-b4cc-971f1297691b req-7ede5428-cb8c-44f9-9ab1-690257926ed7 service nova] Releasing lock "refresh_cache-b646159a-f806-487d-8a14-0aa8e2438f2b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:08:06.824909 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Found WWN 330000000bcd06062 for multipath device dm-7 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:08:06.825510 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.048s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:08:06.825775 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] <== connect_volume: return (3049ms) {'type': 'block', 'scsi_wwn': '330000000bcd06062', 'path': '/dev/dm-7', 'multipath_id': '330000000bcd06062'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:08:06.825986 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000bcd06062', 'path': '/dev/dm-7', 'multipath_id': '330000000bcd06062'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:08:07.010672 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999610286999996 future=<Future at 0x71c0586b8a10 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:07.186026 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-71600993-72e6-487e-8e13-7933c13bc24b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:06:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-53523629',display_name='tempest-TestStampPattern-server-53523629',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-teststamppattern-server-53523629',id=53,image_ref='cdde4299-39d3-4183-b073-d9779fd9433a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGf4TQxcgjp3MdbOkpJAxq/86PTabA2Iwtv0x1R12epynbyJ/FSoqTOYMbbXiHEg1FsyJTACHLRLEZYTIrFk0vHyzvn2kQ5rh2NeRgjlpvVyNBNMpcSWAWoXIY5iI4y9Gg==',key_name='tempest-TestStampPattern-1436185249',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:07:05Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b72317ce75214e619a14739991461c95',ramdisk_id='',reservation_id='r-ir04vejp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9b4239c5-84df-4d87-a2d4-fb6192408f58',image_min_disk='1',image_min_ram='0',image_owner_id='b72317ce75214e619a14739991461c95',image_owner_project_name='tempest-TestStampPattern-1911932868',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1911932868-project-member',image_user_id='64aaf3f477c745199d5b7f171309b623',owner_project_name='tempest-TestStampPattern-1911932868',owner_user_name='tempest-TestStampPattern-1911932868-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:07:05Z,user_data=None,user_id='64aaf3f477c745199d5b7f171309b623',uuid=b646159a-f806-487d-8a14-0aa8e2438f2b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3b7dd36-e770-402c-88ef-e5a90396d71f", "address": "fa:16:3e:dc:c2:65", "network": {"id": "0618d411-0f50-4ee4-80a9-cbd395ea2c77", "bridge": "br-int", "label": "tempest-TestStampPattern-1490281843-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b72317ce75214e619a14739991461c95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b7dd36-e7", "ovs_interfaceid": "b3b7dd36-e770-402c-88ef-e5a90396d71f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:08:07.186325 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-71600993-72e6-487e-8e13-7933c13bc24b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Converting VIF {"id": "b3b7dd36-e770-402c-88ef-e5a90396d71f", "address": "fa:16:3e:dc:c2:65", "network": {"id": "0618d411-0f50-4ee4-80a9-cbd395ea2c77", "bridge": "br-int", "label": "tempest-TestStampPattern-1490281843-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b72317ce75214e619a14739991461c95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b7dd36-e7", "ovs_interfaceid": "b3b7dd36-e770-402c-88ef-e5a90396d71f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:08:07.187261 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-71600993-72e6-487e-8e13-7933c13bc24b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:c2:65,bridge_name='br-int',has_traffic_filtering=True,id=b3b7dd36-e770-402c-88ef-e5a90396d71f,network=Network(0618d411-0f50-4ee4-80a9-cbd395ea2c77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3b7dd36-e7') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:08:07.189296 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-71600993-72e6-487e-8e13-7933c13bc24b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:c2:65,bridge_name='br-int',has_traffic_filtering=True,id=b3b7dd36-e770-402c-88ef-e5a90396d71f,network=Network(0618d411-0f50-4ee4-80a9-cbd395ea2c77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3b7dd36-e7') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:08:07.192063 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:07.192396 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3b7dd36-e7, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:07.203018 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:07.203919 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:08:07.204434 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:07.205426 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:07.205654 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=92cfaa9a-f3a0-4e62-970f-2c772d2a575b) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:07.206176 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:07.206535 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:08:07.207582 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:07.212863 np0000001127 nova-compute[98206]: INFO os_vif [None req-71600993-72e6-487e-8e13-7933c13bc24b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:c2:65,bridge_name='br-int',has_traffic_filtering=True,id=b3b7dd36-e770-402c-88ef-e5a90396d71f,network=Network(0618d411-0f50-4ee4-80a9-cbd395ea2c77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3b7dd36-e7')
May 21 02:08:07.215531 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-71600993-72e6-487e-8e13-7933c13bc24b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Deleting instance files /opt/stack/data/nova/instances/b646159a-f806-487d-8a14-0aa8e2438f2b_del
May 21 02:08:07.216619 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-71600993-72e6-487e-8e13-7933c13bc24b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Deletion of /opt/stack/data/nova/instances/b646159a-f806-487d-8a14-0aa8e2438f2b_del complete
May 21 02:08:07.334919 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:06:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-269447234',display_name='tempest-TestVolumeBootPattern-server-269447234',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpattern-server-269447234',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD77pimAV1eFekdNNNwkDDYOspV1DjTEfg3EMaUFkrngdEQ/pxsYYNODb0KKjbXdzAIBQimySPjMk1dUCykAebV38iqHCRucGJu9wI9IqvxnrGnYQ91hkWS0RnG0pTDGQA==',key_name='tempest-keypair-251449393',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:07:04Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='62ebdb16aee84e22a88dfc8960debd32',ramdisk_id='',reservation_id='r-b8d3jixu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1995806391',owner_user_name='tempest-TestVolumeBootPattern-1995806391-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:07:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4878b5a5bf184852a9ce383caa1c67a4',uuid=609b1611-3b05-4b86-8bf3-85f16f199d80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "58f0082f-9f4d-42c5-9569-faf668cc281d", "address": "fa:16:3e:97:bd:d9", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f0082f-9f", "ovs_interfaceid": "58f0082f-9f4d-42c5-9569-faf668cc281d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:08:07.335174 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converting VIF {"id": "58f0082f-9f4d-42c5-9569-faf668cc281d", "address": "fa:16:3e:97:bd:d9", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f0082f-9f", "ovs_interfaceid": "58f0082f-9f4d-42c5-9569-faf668cc281d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:08:07.335905 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:bd:d9,bridge_name='br-int',has_traffic_filtering=True,id=58f0082f-9f4d-42c5-9569-faf668cc281d,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58f0082f-9f') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:08:07.337270 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lazy-loading 'pci_devices' on Instance uuid 609b1611-3b05-4b86-8bf3-85f16f199d80 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:08:07.725684 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-71600993-72e6-487e-8e13-7933c13bc24b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Took 1.41 seconds to destroy the instance on the hypervisor.
May 21 02:08:07.726343 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-71600993-72e6-487e-8e13-7933c13bc24b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:08:07.726619 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:08:07.726760 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:08:07.726988 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:07.776619 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-898f8cf7-d505-498b-9d82-1cf7e18b59b1 req-a7aa8c2d-4dff-4cac-9d74-cd0e6d18b29e service nova] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Received event network-changed-f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:07.778289 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-898f8cf7-d505-498b-9d82-1cf7e18b59b1 req-a7aa8c2d-4dff-4cac-9d74-cd0e6d18b29e service nova] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Refreshing instance network info cache due to event network-changed-f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:08:07.778289 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-898f8cf7-d505-498b-9d82-1cf7e18b59b1 req-a7aa8c2d-4dff-4cac-9d74-cd0e6d18b29e service nova] Acquiring lock "refresh_cache-e897b981-cb4b-48b1-a9fe-23c447993d1e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:08:07.778289 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-898f8cf7-d505-498b-9d82-1cf7e18b59b1 req-a7aa8c2d-4dff-4cac-9d74-cd0e6d18b29e service nova] Acquired lock "refresh_cache-e897b981-cb4b-48b1-a9fe-23c447993d1e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:08:07.778289 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-898f8cf7-d505-498b-9d82-1cf7e18b59b1 req-a7aa8c2d-4dff-4cac-9d74-cd0e6d18b29e service nova] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Refreshing network info cache for port f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:08:07.810929 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:07.839406 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Object Instance<609b1611-3b05-4b86-8bf3-85f16f199d80> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:08:07.840705 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] End _get_guest_xml xml=<domain type="qemu">
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:   <uuid>609b1611-3b05-4b86-8bf3-85f16f199d80</uuid>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:   <name>instance-00000034</name>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:       <nova:name>tempest-TestVolumeBootPattern-server-269447234</nova:name>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:08:03</nova:creationTime>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:       <nova:image uuid="">
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:           <nova:property name="hw_machine_type">pc</nova:property>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:           <nova:property name="hw_video_model">virtio</nova:property>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:         <nova:user uuid="4878b5a5bf184852a9ce383caa1c67a4">tempest-TestVolumeBootPattern-1995806391-project-member</nova:user>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:         <nova:project uuid="62ebdb16aee84e22a88dfc8960debd32">tempest-TestVolumeBootPattern-1995806391</nova:project>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:       <nova:root type="volume" uuid=""/>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:         <nova:port uuid="58f0082f-9f4d-42c5-9569-faf668cc281d">
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:     <system>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:       <entry name="serial">609b1611-3b05-4b86-8bf3-85f16f199d80</entry>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:       <entry name="uuid">609b1611-3b05-4b86-8bf3-85f16f199d80</entry>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:     </system>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:   <os>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:   </os>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:   <features>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:   </features>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:   <devices>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/609b1611-3b05-4b86-8bf3-85f16f199d80/disk.config"/>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:     </disk>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:       <alias name="ua-9e45da95-d0bd-4a28-859f-96496102cc36"/>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-7"/>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:       <serial>9e45da95-d0bd-4a28-859f-96496102cc36</serial>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:     </disk>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:97:bd:d9"/>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:       <target dev="tap58f0082f-9f"/>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:     </interface>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/609b1611-3b05-4b86-8bf3-85f16f199d80/console.log" append="off"/>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:     </serial>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:     <video>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:     </video>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:     </rng>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:   </devices>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]: </domain>
May 21 02:08:07.840705 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:08:07.844032 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] skipping disk /dev/dm-7 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:08:07.844032 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:06:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-269447234',display_name='tempest-TestVolumeBootPattern-server-269447234',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpattern-server-269447234',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD77pimAV1eFekdNNNwkDDYOspV1DjTEfg3EMaUFkrngdEQ/pxsYYNODb0KKjbXdzAIBQimySPjMk1dUCykAebV38iqHCRucGJu9wI9IqvxnrGnYQ91hkWS0RnG0pTDGQA==',key_name='tempest-keypair-251449393',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:07:04Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='62ebdb16aee84e22a88dfc8960debd32',ramdisk_id='',reservation_id='r-b8d3jixu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1995806391',owner_user_name='tempest-TestVolumeBootPattern-1995806391-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:07:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4878b5a5bf184852a9ce383caa1c67a4',uuid=609b1611-3b05-4b86-8bf3-85f16f199d80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "58f0082f-9f4d-42c5-9569-faf668cc281d", "address": "fa:16:3e:97:bd:d9", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f0082f-9f", "ovs_interfaceid": "58f0082f-9f4d-42c5-9569-faf668cc281d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:08:07.844032 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converting VIF {"id": "58f0082f-9f4d-42c5-9569-faf668cc281d", "address": "fa:16:3e:97:bd:d9", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f0082f-9f", "ovs_interfaceid": "58f0082f-9f4d-42c5-9569-faf668cc281d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:08:07.844032 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:bd:d9,bridge_name='br-int',has_traffic_filtering=True,id=58f0082f-9f4d-42c5-9569-faf668cc281d,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58f0082f-9f') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:08:07.844032 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:bd:d9,bridge_name='br-int',has_traffic_filtering=True,id=58f0082f-9f4d-42c5-9569-faf668cc281d,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58f0082f-9f') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:08:07.845181 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:07.845181 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:07.845440 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:08:07.846406 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:07.846406 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '72be94b1-87b8-5b13-932f-ec67b1b675a6', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:07.846966 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:07.847570 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:08:07.848360 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:07.853184 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:07.853412 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58f0082f-9f, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:07.853880 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap58f0082f-9f, col_values=(('qos', UUID('aecefd5f-e199-4d0f-a207-a49740d92d72')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:07.854069 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap58f0082f-9f, col_values=(('external_ids', {'iface-id': '58f0082f-9f4d-42c5-9569-faf668cc281d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:bd:d9', 'vm-uuid': '609b1611-3b05-4b86-8bf3-85f16f199d80'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:07.855235 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:07.856616 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:08:07.865520 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:07.867751 np0000001127 nova-compute[98206]: INFO os_vif [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:bd:d9,bridge_name='br-int',has_traffic_filtering=True,id=58f0082f-9f4d-42c5-9569-faf668cc281d,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58f0082f-9f')
May 21 02:08:07.988384 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Starting finish_migration {{(pid=98206) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 21 02:08:07.989024 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Instance directory exists: not creating {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 21 02:08:07.989231 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Creating image(s)
May 21 02:08:07.990163 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:08.022536 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0829a957-b224-4023-924c-906ca8d24ac0 req-5face7c6-95f3-4441-a237-bf653d0b0398 service nova] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Received event network-vif-unplugged-b3b7dd36-e770-402c-88ef-e5a90396d71f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:08.023118 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0829a957-b224-4023-924c-906ca8d24ac0 req-5face7c6-95f3-4441-a237-bf653d0b0398 service nova] Acquiring lock "b646159a-f806-487d-8a14-0aa8e2438f2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:08.023422 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0829a957-b224-4023-924c-906ca8d24ac0 req-5face7c6-95f3-4441-a237-bf653d0b0398 service nova] Lock "b646159a-f806-487d-8a14-0aa8e2438f2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:08.024117 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0829a957-b224-4023-924c-906ca8d24ac0 req-5face7c6-95f3-4441-a237-bf653d0b0398 service nova] Lock "b646159a-f806-487d-8a14-0aa8e2438f2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:08.024287 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0829a957-b224-4023-924c-906ca8d24ac0 req-5face7c6-95f3-4441-a237-bf653d0b0398 service nova] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] No waiting events found dispatching network-vif-unplugged-b3b7dd36-e770-402c-88ef-e5a90396d71f {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:08:08.024503 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0829a957-b224-4023-924c-906ca8d24ac0 req-5face7c6-95f3-4441-a237-bf653d0b0398 service nova] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Received event network-vif-unplugged-b3b7dd36-e770-402c-88ef-e5a90396d71f for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:08:08.025050 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0829a957-b224-4023-924c-906ca8d24ac0 req-5face7c6-95f3-4441-a237-bf653d0b0398 service nova] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Received event network-vif-unplugged-b3b7dd36-e770-402c-88ef-e5a90396d71f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:08.025050 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0829a957-b224-4023-924c-906ca8d24ac0 req-5face7c6-95f3-4441-a237-bf653d0b0398 service nova] Acquiring lock "b646159a-f806-487d-8a14-0aa8e2438f2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:08.025050 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0829a957-b224-4023-924c-906ca8d24ac0 req-5face7c6-95f3-4441-a237-bf653d0b0398 service nova] Lock "b646159a-f806-487d-8a14-0aa8e2438f2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:08.025382 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0829a957-b224-4023-924c-906ca8d24ac0 req-5face7c6-95f3-4441-a237-bf653d0b0398 service nova] Lock "b646159a-f806-487d-8a14-0aa8e2438f2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:08.025382 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0829a957-b224-4023-924c-906ca8d24ac0 req-5face7c6-95f3-4441-a237-bf653d0b0398 service nova] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] No waiting events found dispatching network-vif-unplugged-b3b7dd36-e770-402c-88ef-e5a90396d71f {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:08:08.025639 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0829a957-b224-4023-924c-906ca8d24ac0 req-5face7c6-95f3-4441-a237-bf653d0b0398 service nova] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Received event network-vif-unplugged-b3b7dd36-e770-402c-88ef-e5a90396d71f for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:08:08.109786 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.119s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:08:08.110238 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:08:08.111611 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:08.146054 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-95bd8c84-42db-4911-a40f-63d3ac85c53e req-311e8708-2855-4013-9b3e-23ef043384b0 service nova] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Received event network-vif-deleted-b3b7dd36-e770-402c-88ef-e5a90396d71f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:08.146320 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-95bd8c84-42db-4911-a40f-63d3ac85c53e req-311e8708-2855-4013-9b3e-23ef043384b0 service nova] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Neutron deleted interface b3b7dd36-e770-402c-88ef-e5a90396d71f; detaching it from the instance and deleting it from the info cache
May 21 02:08:08.146426 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-95bd8c84-42db-4911-a40f-63d3ac85c53e req-311e8708-2855-4013-9b3e-23ef043384b0 service nova] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:08:08.227397 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:08:08.227794 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Cannot resize image /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:08:08.280561 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-898f8cf7-d505-498b-9d82-1cf7e18b59b1 req-a7aa8c2d-4dff-4cac-9d74-cd0e6d18b29e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:08.393159 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:08.419852 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:08.524558 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:08.589939 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:08:08.662317 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-95bd8c84-42db-4911-a40f-63d3ac85c53e req-311e8708-2855-4013-9b3e-23ef043384b0 service nova] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Detach interface failed, port_id=b3b7dd36-e770-402c-88ef-e5a90396d71f, reason: Instance b646159a-f806-487d-8a14-0aa8e2438f2b could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:08:08.730814 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Did not create local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 21 02:08:08.730963 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Ensure instance console log exists: /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:08:08.733307 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:08.733584 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:08.733754 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:08.743149 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-898f8cf7-d505-498b-9d82-1cf7e18b59b1 req-a7aa8c2d-4dff-4cac-9d74-cd0e6d18b29e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:08.743149 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Start _get_guest_xml network_info=[{"id": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "address": "fa:16:3e:db:08:dd", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "vif_mac": "fa:16:3e:db:08:dd"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b286fbf-a6", "ovs_interfaceid": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'aa3f5a78-fb82-4e21-8ebf-90bf48a122be', 'attached_at': '2026-05-21T02:08:07.000000', 'detached_at': '', 'volume_id': 'e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'multiattach': True, 'serial': 'e7cfdf26-9973-4cc1-8395-11f9ebc98c4b'}, 'delete_on_termination': False, 'attachment_id': '9fe1a2b2-d76c-4247-bf57-485030071a4c', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:08:08.756137 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:08:08.757579 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='aa3f5a78-fb82-4e21-8ebf-90bf48a122be'), owner=OwnerMeta(userid='049d6c8cccfa4ae38d78a88ef5be0f1b', username='tempest-AttachVolumeMultiAttachTest-289054175-project-member', projectid='848912b0c0e94d2795bb2332daf1730e', projectname='tempest-AttachVolumeMultiAttachTest-289054175'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "address": "fa:16:3e:db:08:dd", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "vif_mac": "fa:16:3e:db:08:dd"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b286fbf-a6", "ovs_interfaceid": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329288.7570517) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:08:08.762024 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:08:08.762359 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:08:08.767521 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:08:08.767521 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:08:08.768575 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:08:08.768856 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:08:08.769763 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:08:08.769763 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:08:08.769763 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:08:08.769763 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:08:08.769763 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:08:08.770026 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:08:08.770026 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:08:08.770118 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:08:08.770286 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:08:08.770444 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:08:08.785495 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:08.804961 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk.config --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:08.825700 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:08.910061 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk.config --force-share --output=json" returned: 0 in 0.105s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:08:08.911825 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "/opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:08.912114 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "/opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:08.913130 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "/opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:08.913614 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:08:08.914058 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:08:08.914245 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:08:08.951274 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-898f8cf7-d505-498b-9d82-1cf7e18b59b1 req-a7aa8c2d-4dff-4cac-9d74-cd0e6d18b29e service nova] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Updated VIF entry in instance network info cache for port f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:08:08.951830 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-898f8cf7-d505-498b-9d82-1cf7e18b59b1 req-a7aa8c2d-4dff-4cac-9d74-cd0e6d18b29e service nova] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Updating instance_info_cache with network_info: [{"id": "f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd", "address": "fa:16:3e:d6:68:cb", "network": {"id": "460fd532-ef54-4f63-922b-b9d9f73f665f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1504169250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89e0ea7da0f244aab58f9da579e53864", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b5a2fb-d0", "ovs_interfaceid": "f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:08:09.093329 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Took 1.37 seconds to deallocate network for instance.
May 21 02:08:09.383020 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329289.3825731, 609b1611-3b05-4b86-8bf3-85f16f199d80 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:08:09.383389 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Instance event wait completed in 0 seconds for  {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:08:09.383562 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] VM Resumed (Lifecycle Event)
May 21 02:08:09.388624 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Instance rebooted successfully.
May 21 02:08:09.454825 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-898f8cf7-d505-498b-9d82-1cf7e18b59b1 req-a7aa8c2d-4dff-4cac-9d74-cd0e6d18b29e service nova] Releasing lock "refresh_cache-e897b981-cb4b-48b1-a9fe-23c447993d1e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:08:09.603201 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-71600993-72e6-487e-8e13-7933c13bc24b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:09.603499 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-71600993-72e6-487e-8e13-7933c13bc24b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:09.768708 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.854s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:08:09.769330 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:08:09.783413 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:08:09.783895 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:08:09.784317 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:08:09.784764 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:08:09.785104 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:08:09.785336 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.startup = automatic
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.session.scan = manual
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:08:09.799753 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:08:09.799753 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.startup = automatic
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.session.scan = manual
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:08:09.807109 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:08:09.807109 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:09.816247 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:09.822611 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:09.839083 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:09.839083 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:09.839083 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:09.839083 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:09.839083 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:09.839083 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:09.839083 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:09.839083 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:09.839083 np0000001127 nova-compute[98206]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:09.839083 np0000001127 nova-compute[98206]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:09.839083 np0000001127 nova-compute[98206]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:08:09.839083 np0000001127 nova-compute[98206]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:08:09.839083 np0000001127 nova-compute[98206]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6128f9ff-27d4-4b2e-834a-95802c0ec75e (non-flash)
May 21 02:08:09.839083 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:09.839083 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:09.839083 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:08:09.839758 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:09.839758 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:09.839758 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:09.839758 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:09.839758 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:09.839758 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:09.839758 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:09.839758 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:09.839758 np0000001127 nova-compute[98206]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:09.839758 np0000001127 nova-compute[98206]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:09.839758 np0000001127 nova-compute[98206]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:08:09.839758 np0000001127 nova-compute[98206]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:08:09.839758 np0000001127 nova-compute[98206]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6128f9ff-27d4-4b2e-834a-95802c0ec75e (non-flash)
May 21 02:08:09.839758 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:09.839758 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:09.839758 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:08:09.839758 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.055s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:08:09.839758 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:08:09.840843 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] HCTL ('10', '0', '0', 0) found on session 119 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:08:09.840971 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Scanning host 10 c: 0, t: 0, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:08:09.846773 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:09.846773 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:09.846773 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:09.846773 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:09.846773 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:09.846773 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:09.846773 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:09.846773 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:09.846773 np0000001127 nova-compute[98206]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:09.846773 np0000001127 nova-compute[98206]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:09.846773 np0000001127 nova-compute[98206]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:08:09.846773 np0000001127 nova-compute[98206]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:08:09.846773 np0000001127 nova-compute[98206]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6128f9ff-27d4-4b2e-834a-95802c0ec75e (non-flash)
May 21 02:08:09.846773 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:09.846773 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:09.846773 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:08:09.847263 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:09.847263 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:09.847263 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:09.847263 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:09.847263 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:09.847263 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:09.847263 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:09.847263 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:09.847263 np0000001127 nova-compute[98206]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:09.847263 np0000001127 nova-compute[98206]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:09.847263 np0000001127 nova-compute[98206]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:08:09.847263 np0000001127 nova-compute[98206]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:08:09.847263 np0000001127 nova-compute[98206]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6128f9ff-27d4-4b2e-834a-95802c0ec75e (non-flash)
May 21 02:08:09.847263 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:09.847263 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:09.847263 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:08:09.847634 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.062s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:08:09.847634 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:08:09.849003 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] HCTL ('9', '0', '0', 0) found on session 118 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:08:09.849224 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Scanning host 9 c: 0, t: 0, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:08:09.850918 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Searching for a device in session 119 and hctl ('10', '0', '0', 0) yield: sde {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:08:09.851123 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:08:09.860682 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Searching for a device in session 118 and hctl ('9', '0', '0', 0) yield: sdd {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:08:09.860813 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:08:09.887913 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:08:09.891959 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:08:10.083164 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cb49a6d3-4e7a-4e65-a64d-0436526a3802 req-4fc0424c-720f-44ed-a6d1-28ffdbdcacf9 service nova] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Received event network-vif-plugged-58f0082f-9f4d-42c5-9569-faf668cc281d {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:10.083528 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cb49a6d3-4e7a-4e65-a64d-0436526a3802 req-4fc0424c-720f-44ed-a6d1-28ffdbdcacf9 service nova] Acquiring lock "609b1611-3b05-4b86-8bf3-85f16f199d80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:10.083672 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cb49a6d3-4e7a-4e65-a64d-0436526a3802 req-4fc0424c-720f-44ed-a6d1-28ffdbdcacf9 service nova] Lock "609b1611-3b05-4b86-8bf3-85f16f199d80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:10.085317 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cb49a6d3-4e7a-4e65-a64d-0436526a3802 req-4fc0424c-720f-44ed-a6d1-28ffdbdcacf9 service nova] Lock "609b1611-3b05-4b86-8bf3-85f16f199d80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:10.085317 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cb49a6d3-4e7a-4e65-a64d-0436526a3802 req-4fc0424c-720f-44ed-a6d1-28ffdbdcacf9 service nova] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] No waiting events found dispatching network-vif-plugged-58f0082f-9f4d-42c5-9569-faf668cc281d {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:08:10.085317 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-cb49a6d3-4e7a-4e65-a64d-0436526a3802 req-4fc0424c-720f-44ed-a6d1-28ffdbdcacf9 service nova] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Received unexpected event network-vif-plugged-58f0082f-9f4d-42c5-9569-faf668cc281d for instance with vm_state stopped and task_state powering-on.
May 21 02:08:10.085317 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cb49a6d3-4e7a-4e65-a64d-0436526a3802 req-4fc0424c-720f-44ed-a6d1-28ffdbdcacf9 service nova] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Received event network-vif-plugged-58f0082f-9f4d-42c5-9569-faf668cc281d {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:10.085317 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cb49a6d3-4e7a-4e65-a64d-0436526a3802 req-4fc0424c-720f-44ed-a6d1-28ffdbdcacf9 service nova] Acquiring lock "609b1611-3b05-4b86-8bf3-85f16f199d80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:10.085633 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cb49a6d3-4e7a-4e65-a64d-0436526a3802 req-4fc0424c-720f-44ed-a6d1-28ffdbdcacf9 service nova] Lock "609b1611-3b05-4b86-8bf3-85f16f199d80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:10.088634 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cb49a6d3-4e7a-4e65-a64d-0436526a3802 req-4fc0424c-720f-44ed-a6d1-28ffdbdcacf9 service nova] Lock "609b1611-3b05-4b86-8bf3-85f16f199d80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:10.088762 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cb49a6d3-4e7a-4e65-a64d-0436526a3802 req-4fc0424c-720f-44ed-a6d1-28ffdbdcacf9 service nova] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] No waiting events found dispatching network-vif-plugged-58f0082f-9f4d-42c5-9569-faf668cc281d {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:08:10.088891 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-cb49a6d3-4e7a-4e65-a64d-0436526a3802 req-4fc0424c-720f-44ed-a6d1-28ffdbdcacf9 service nova] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Received unexpected event network-vif-plugged-58f0082f-9f4d-42c5-9569-faf668cc281d for instance with vm_state stopped and task_state powering-on.
May 21 02:08:10.399295 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] During sync_power_state the instance has a pending task (powering-on). Skip.
May 21 02:08:10.401159 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329290.400192, 609b1611-3b05-4b86-8bf3-85f16f199d80 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:08:10.401159 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] VM Started (Lifecycle Event)
May 21 02:08:10.477124 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-71600993-72e6-487e-8e13-7933c13bc24b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:08:10.477401 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-71600993-72e6-487e-8e13-7933c13bc24b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:08:10.786672 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:08:10.906520 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:08:10.915149 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:08:10.915398 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:08:10.915799 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] No VIF found with MAC fa:16:3e:97:bd:d9, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:08:10.916346 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-b485fce5-4892-47a8-8930-420ce87523f1 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:08:10.916833 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:08:10.983625 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-71600993-72e6-487e-8e13-7933c13bc24b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:08:11.421286 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] During sync_power_state the instance has a pending task (powering-on). Skip.
May 21 02:08:11.492795 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-71600993-72e6-487e-8e13-7933c13bc24b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.889s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:11.567233 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-71600993-72e6-487e-8e13-7933c13bc24b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Deleted allocations for instance b646159a-f806-487d-8a14-0aa8e2438f2b
May 21 02:08:11.708498 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:12.260995 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-e8ca5d38-2b17-4b52-8e7e-f92de603d2e7 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Get console output
May 21 02:08:12.265306 np0000001127 nova-compute[98206]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
May 21 02:08:12.576544 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-71600993-72e6-487e-8e13-7933c13bc24b tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "b646159a-f806-487d-8a14-0aa8e2438f2b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.771s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:12.856957 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:14.102077 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Acquiring lock "fcada4b6-3630-4322-b6ce-8812b0c4afe9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:14.102504 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Lock "fcada4b6-3630-4322-b6ce-8812b0c4afe9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:14.441160 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "609b1611-3b05-4b86-8bf3-85f16f199d80" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:14.441160 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "609b1611-3b05-4b86-8bf3-85f16f199d80" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:14.441160 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "609b1611-3b05-4b86-8bf3-85f16f199d80-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:14.441160 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "609b1611-3b05-4b86-8bf3-85f16f199d80-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:14.441160 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "609b1611-3b05-4b86-8bf3-85f16f199d80-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:14.441928 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Terminating instance
May 21 02:08:14.604758 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:08:14.947784 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:08:14.949393 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.00046750799992878456 future=<Future at 0x71c05822d5e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:14.950261 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Emitting event <LifecycleEvent: 1779329279.9488075, aa3f5a78-fb82-4e21-8ebf-90bf48a122be => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:08:14.950261 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:14.950261 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] VM Stopped (Lifecycle Event)
May 21 02:08:14.951901 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=7.058518021000054 future=<Future at 0x71c0586b8a10 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:14.951901 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=7.058385895999891 future=<Future at 0x71c0586b8a10 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:14.972171 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:15.003690 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:15.011317 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:15.034698 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:15.042746 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:15.154754 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-78b3524f-58e1-4799-b9e8-518c49ea9e13 req-bfb1914a-255e-4342-8ab9-7664799baedf service nova] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Received event network-vif-unplugged-58f0082f-9f4d-42c5-9569-faf668cc281d {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:15.155101 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-78b3524f-58e1-4799-b9e8-518c49ea9e13 req-bfb1914a-255e-4342-8ab9-7664799baedf service nova] Acquiring lock "609b1611-3b05-4b86-8bf3-85f16f199d80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:15.155289 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-78b3524f-58e1-4799-b9e8-518c49ea9e13 req-bfb1914a-255e-4342-8ab9-7664799baedf service nova] Lock "609b1611-3b05-4b86-8bf3-85f16f199d80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:15.156045 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-78b3524f-58e1-4799-b9e8-518c49ea9e13 req-bfb1914a-255e-4342-8ab9-7664799baedf service nova] Lock "609b1611-3b05-4b86-8bf3-85f16f199d80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:15.156293 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-78b3524f-58e1-4799-b9e8-518c49ea9e13 req-bfb1914a-255e-4342-8ab9-7664799baedf service nova] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] No waiting events found dispatching network-vif-unplugged-58f0082f-9f4d-42c5-9569-faf668cc281d {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:08:15.157032 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-78b3524f-58e1-4799-b9e8-518c49ea9e13 req-bfb1914a-255e-4342-8ab9-7664799baedf service nova] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Received event network-vif-unplugged-58f0082f-9f4d-42c5-9569-faf668cc281d for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:08:15.164450 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:15.165161 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:15.173353 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:08:15.173353 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Claim successful on node np0000001127
May 21 02:08:15.269333 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:15.286266 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999551647999851 future=<Future at 0x71c07c2f8e00 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:15.292019 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Instance destroyed successfully.
May 21 02:08:15.292409 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lazy-loading 'resources' on Instance uuid 609b1611-3b05-4b86-8bf3-85f16f199d80 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:08:15.453915 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:08:15.458573 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:08:15.797608 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:06:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-269447234',display_name='tempest-TestVolumeBootPattern-server-269447234',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpattern-server-269447234',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD77pimAV1eFekdNNNwkDDYOspV1DjTEfg3EMaUFkrngdEQ/pxsYYNODb0KKjbXdzAIBQimySPjMk1dUCykAebV38iqHCRucGJu9wI9IqvxnrGnYQ91hkWS0RnG0pTDGQA==',key_name='tempest-keypair-251449393',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:07:04Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62ebdb16aee84e22a88dfc8960debd32',ramdisk_id='',reservation_id='r-b8d3jixu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1995806391',owner_user_name='tempest-TestVolumeBootPattern-1995806391-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:08:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4878b5a5bf184852a9ce383caa1c67a4',uuid=609b1611-3b05-4b86-8bf3-85f16f199d80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58f0082f-9f4d-42c5-9569-faf668cc281d", "address": "fa:16:3e:97:bd:d9", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f0082f-9f", "ovs_interfaceid": "58f0082f-9f4d-42c5-9569-faf668cc281d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:08:15.797608 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converting VIF {"id": "58f0082f-9f4d-42c5-9569-faf668cc281d", "address": "fa:16:3e:97:bd:d9", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f0082f-9f", "ovs_interfaceid": "58f0082f-9f4d-42c5-9569-faf668cc281d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:08:15.797608 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:bd:d9,bridge_name='br-int',has_traffic_filtering=True,id=58f0082f-9f4d-42c5-9569-faf668cc281d,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58f0082f-9f') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:08:15.797608 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:bd:d9,bridge_name='br-int',has_traffic_filtering=True,id=58f0082f-9f4d-42c5-9569-faf668cc281d,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58f0082f-9f') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:08:15.799291 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:15.799733 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58f0082f-9f, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:15.801186 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:15.806794 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:08:15.807779 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:15.807942 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aecefd5f-e199-4d0f-a207-a49740d92d72) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:15.809104 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:15.811207 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:08:15.814952 np0000001127 nova-compute[98206]: INFO os_vif [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:bd:d9,bridge_name='br-int',has_traffic_filtering=True,id=58f0082f-9f4d-42c5-9569-faf668cc281d,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58f0082f-9f')
May 21 02:08:15.817962 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:08:15.818040 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36', 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9e45da95-d0bd-4a28-859f-96496102cc36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:08:15.821502 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:08:15.896424 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-ec0ff8a5-b533-4fdb-92f8-d172a39764c0 req-ad399823-8290-4b5b-8a7b-b8aec25a6b39 service nova] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Received event network-changed-7475b4a3-11de-43b6-9d83-b59933d9e8db {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:15.900837 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-ec0ff8a5-b533-4fdb-92f8-d172a39764c0 req-ad399823-8290-4b5b-8a7b-b8aec25a6b39 service nova] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Refreshing instance network info cache due to event network-changed-7475b4a3-11de-43b6-9d83-b59933d9e8db. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:08:15.901187 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ec0ff8a5-b533-4fdb-92f8-d172a39764c0 req-ad399823-8290-4b5b-8a7b-b8aec25a6b39 service nova] Acquiring lock "refresh_cache-9b4239c5-84df-4d87-a2d4-fb6192408f58" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:08:15.901311 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ec0ff8a5-b533-4fdb-92f8-d172a39764c0 req-ad399823-8290-4b5b-8a7b-b8aec25a6b39 service nova] Acquired lock "refresh_cache-9b4239c5-84df-4d87-a2d4-fb6192408f58" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:08:15.901735 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-ec0ff8a5-b533-4fdb-92f8-d172a39764c0 req-ad399823-8290-4b5b-8a7b-b8aec25a6b39 service nova] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Refreshing network info cache for port 7475b4a3-11de-43b6-9d83-b59933d9e8db {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:08:15.961711 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 21 02:08:16.404240 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-ec0ff8a5-b533-4fdb-92f8-d172a39764c0 req-ad399823-8290-4b5b-8a7b-b8aec25a6b39 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:16.487244 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d65e2355-27f1-4799-ba8c-c30a8917d411 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Acquiring lock "9b4239c5-84df-4d87-a2d4-fb6192408f58" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:16.487398 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d65e2355-27f1-4799-ba8c-c30a8917d411 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "9b4239c5-84df-4d87-a2d4-fb6192408f58" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:16.487594 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d65e2355-27f1-4799-ba8c-c30a8917d411 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Acquiring lock "9b4239c5-84df-4d87-a2d4-fb6192408f58-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:16.487721 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d65e2355-27f1-4799-ba8c-c30a8917d411 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "9b4239c5-84df-4d87-a2d4-fb6192408f58-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:16.487825 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d65e2355-27f1-4799-ba8c-c30a8917d411 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "9b4239c5-84df-4d87-a2d4-fb6192408f58-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:16.492658 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-d65e2355-27f1-4799-ba8c-c30a8917d411 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Terminating instance
May 21 02:08:16.705115 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:16.817876 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-ec0ff8a5-b533-4fdb-92f8-d172a39764c0 req-ad399823-8290-4b5b-8a7b-b8aec25a6b39 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:17.003545 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d65e2355-27f1-4799-ba8c-c30a8917d411 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:08:17.011989 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-ec0ff8a5-b533-4fdb-92f8-d172a39764c0 req-ad399823-8290-4b5b-8a7b-b8aec25a6b39 service nova] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Updated VIF entry in instance network info cache for port 7475b4a3-11de-43b6-9d83-b59933d9e8db. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:08:17.012284 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-ec0ff8a5-b533-4fdb-92f8-d172a39764c0 req-ad399823-8290-4b5b-8a7b-b8aec25a6b39 service nova] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Updating instance_info_cache with network_info: [{"id": "7475b4a3-11de-43b6-9d83-b59933d9e8db", "address": "fa:16:3e:91:3d:5c", "network": {"id": "0618d411-0f50-4ee4-80a9-cbd395ea2c77", "bridge": "br-int", "label": "tempest-TestStampPattern-1490281843-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b72317ce75214e619a14739991461c95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7475b4a3-11", "ovs_interfaceid": "7475b4a3-11de-43b6-9d83-b59933d9e8db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:08:17.038560 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:17.041465 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:17.052314 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:08:17.052619 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:08:17.067695 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:17.069786 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:17.110263 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:17.247007 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-abec8ac7-b9cf-4161-b49a-dbe8c39e09a7 req-4179756a-142c-4a4b-a270-59557dda11a5 service nova] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Received event network-vif-unplugged-58f0082f-9f4d-42c5-9569-faf668cc281d {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:17.247832 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-abec8ac7-b9cf-4161-b49a-dbe8c39e09a7 req-4179756a-142c-4a4b-a270-59557dda11a5 service nova] Acquiring lock "609b1611-3b05-4b86-8bf3-85f16f199d80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:17.247940 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-abec8ac7-b9cf-4161-b49a-dbe8c39e09a7 req-4179756a-142c-4a4b-a270-59557dda11a5 service nova] Lock "609b1611-3b05-4b86-8bf3-85f16f199d80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:17.248061 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-abec8ac7-b9cf-4161-b49a-dbe8c39e09a7 req-4179756a-142c-4a4b-a270-59557dda11a5 service nova] Lock "609b1611-3b05-4b86-8bf3-85f16f199d80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:17.248204 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-abec8ac7-b9cf-4161-b49a-dbe8c39e09a7 req-4179756a-142c-4a4b-a270-59557dda11a5 service nova] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] No waiting events found dispatching network-vif-unplugged-58f0082f-9f4d-42c5-9569-faf668cc281d {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:08:17.248305 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-abec8ac7-b9cf-4161-b49a-dbe8c39e09a7 req-4179756a-142c-4a4b-a270-59557dda11a5 service nova] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Received event network-vif-unplugged-58f0082f-9f4d-42c5-9569-faf668cc281d for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:08:17.248391 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-abec8ac7-b9cf-4161-b49a-dbe8c39e09a7 req-4179756a-142c-4a4b-a270-59557dda11a5 service nova] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Received event network-vif-unplugged-7475b4a3-11de-43b6-9d83-b59933d9e8db {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:17.248535 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-abec8ac7-b9cf-4161-b49a-dbe8c39e09a7 req-4179756a-142c-4a4b-a270-59557dda11a5 service nova] Acquiring lock "9b4239c5-84df-4d87-a2d4-fb6192408f58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:17.248656 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-abec8ac7-b9cf-4161-b49a-dbe8c39e09a7 req-4179756a-142c-4a4b-a270-59557dda11a5 service nova] Lock "9b4239c5-84df-4d87-a2d4-fb6192408f58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:17.248753 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-abec8ac7-b9cf-4161-b49a-dbe8c39e09a7 req-4179756a-142c-4a4b-a270-59557dda11a5 service nova] Lock "9b4239c5-84df-4d87-a2d4-fb6192408f58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:17.248866 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-abec8ac7-b9cf-4161-b49a-dbe8c39e09a7 req-4179756a-142c-4a4b-a270-59557dda11a5 service nova] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] No waiting events found dispatching network-vif-unplugged-7475b4a3-11de-43b6-9d83-b59933d9e8db {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:08:17.248965 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-abec8ac7-b9cf-4161-b49a-dbe8c39e09a7 req-4179756a-142c-4a4b-a270-59557dda11a5 service nova] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Received event network-vif-unplugged-7475b4a3-11de-43b6-9d83-b59933d9e8db for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:08:17.306384 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:17.315204 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:17.335244 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999709351000092 future=<Future at 0x71c07c776210 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:17.337044 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Instance destroyed successfully.
May 21 02:08:17.337357 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-d65e2355-27f1-4799-ba8c-c30a8917d411 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lazy-loading 'resources' on Instance uuid 9b4239c5-84df-4d87-a2d4-fb6192408f58 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:08:17.519235 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ec0ff8a5-b533-4fdb-92f8-d172a39764c0 req-ad399823-8290-4b5b-8a7b-b8aec25a6b39 service nova] Releasing lock "refresh_cache-9b4239c5-84df-4d87-a2d4-fb6192408f58" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:08:17.555897 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:08:17.829254 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Found WWN 330000000eb19b356 for multipath device dm-1 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:08:17.829690 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 8.061s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:08:17.829888 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] <== connect_volume: return (8915ms) {'type': 'block', 'scsi_wwn': '330000000eb19b356', 'path': '/dev/dm-1', 'multipath_id': '330000000eb19b356'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:08:17.830821 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000eb19b356', 'path': '/dev/dm-1', 'multipath_id': '330000000eb19b356'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:08:17.830821 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.012s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:08:17.831130 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36', 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9e45da95-d0bd-4a28-859f-96496102cc36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:08:17.831320 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:08:17.840793 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-d65e2355-27f1-4799-ba8c-c30a8917d411 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:05:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1203257398',display_name='tempest-TestStampPattern-server-1203257398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-teststamppattern-server-1203257398',id=46,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGf4TQxcgjp3MdbOkpJAxq/86PTabA2Iwtv0x1R12epynbyJ/FSoqTOYMbbXiHEg1FsyJTACHLRLEZYTIrFk0vHyzvn2kQ5rh2NeRgjlpvVyNBNMpcSWAWoXIY5iI4y9Gg==',key_name='tempest-TestStampPattern-1436185249',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:05:43Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b72317ce75214e619a14739991461c95',ramdisk_id='',reservation_id='r-sgpj02lw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1911932868',owner_user_name='tempest-TestStampPattern-1911932868-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:06:50Z,user_data=None,user_id='64aaf3f477c745199d5b7f171309b623',uuid=9b4239c5-84df-4d87-a2d4-fb6192408f58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7475b4a3-11de-43b6-9d83-b59933d9e8db", "address": "fa:16:3e:91:3d:5c", "network": {"id": "0618d411-0f50-4ee4-80a9-cbd395ea2c77", "bridge": "br-int", "label": "tempest-TestStampPattern-1490281843-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b72317ce75214e619a14739991461c95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7475b4a3-11", "ovs_interfaceid": "7475b4a3-11de-43b6-9d83-b59933d9e8db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:08:17.841218 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-d65e2355-27f1-4799-ba8c-c30a8917d411 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Converting VIF {"id": "7475b4a3-11de-43b6-9d83-b59933d9e8db", "address": "fa:16:3e:91:3d:5c", "network": {"id": "0618d411-0f50-4ee4-80a9-cbd395ea2c77", "bridge": "br-int", "label": "tempest-TestStampPattern-1490281843-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b72317ce75214e619a14739991461c95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7475b4a3-11", "ovs_interfaceid": "7475b4a3-11de-43b6-9d83-b59933d9e8db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:08:17.842329 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-d65e2355-27f1-4799-ba8c-c30a8917d411 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:3d:5c,bridge_name='br-int',has_traffic_filtering=True,id=7475b4a3-11de-43b6-9d83-b59933d9e8db,network=Network(0618d411-0f50-4ee4-80a9-cbd395ea2c77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7475b4a3-11') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:08:17.842664 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-d65e2355-27f1-4799-ba8c-c30a8917d411 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:3d:5c,bridge_name='br-int',has_traffic_filtering=True,id=7475b4a3-11de-43b6-9d83-b59933d9e8db,network=Network(0618d411-0f50-4ee4-80a9-cbd395ea2c77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7475b4a3-11') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:08:17.845328 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:17.845688 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7475b4a3-11, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:17.850620 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:08:17.853311 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:17.853609 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=740c9fe7-4869-4ad1-9375-d1b8c83bd5b0) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:17.856364 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:08:17.860095 np0000001127 nova-compute[98206]: INFO os_vif [None req-d65e2355-27f1-4799-ba8c-c30a8917d411 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:3d:5c,bridge_name='br-int',has_traffic_filtering=True,id=7475b4a3-11de-43b6-9d83-b59933d9e8db,network=Network(0618d411-0f50-4ee4-80a9-cbd395ea2c77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7475b4a3-11')
May 21 02:08:17.860382 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-d65e2355-27f1-4799-ba8c-c30a8917d411 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Deleting instance files /opt/stack/data/nova/instances/9b4239c5-84df-4d87-a2d4-fb6192408f58_del
May 21 02:08:17.861592 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-d65e2355-27f1-4799-ba8c-c30a8917d411 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Deletion of /opt/stack/data/nova/instances/9b4239c5-84df-4d87-a2d4-fb6192408f58_del complete
May 21 02:08:17.870755 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:17.870755 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:17.870755 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:17.870755 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:17.870755 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:17.870755 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:17.870755 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:17.870755 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:17.870755 np0000001127 nova-compute[98206]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:17.870755 np0000001127 nova-compute[98206]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:17.870755 np0000001127 nova-compute[98206]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:08:17.870755 np0000001127 nova-compute[98206]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:08:17.870755 np0000001127 nova-compute[98206]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6128f9ff-27d4-4b2e-834a-95802c0ec75e (non-flash)
May 21 02:08:17.870755 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:17.870755 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:17.870755 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:08:17.871244 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:17.871244 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:17.871244 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:17.871244 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:17.871244 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:17.871244 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:17.871244 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:17.871244 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:17.871244 np0000001127 nova-compute[98206]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:17.871244 np0000001127 nova-compute[98206]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:17.871244 np0000001127 nova-compute[98206]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:08:17.871244 np0000001127 nova-compute[98206]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36 (non-flash)
May 21 02:08:17.871244 np0000001127 nova-compute[98206]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6128f9ff-27d4-4b2e-834a-95802c0ec75e (non-flash)
May 21 02:08:17.871244 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:17.871244 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:17.871244 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:08:17.871244 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435', '115'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', '118'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', '119'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc', '123'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc', '124'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6', '125'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6', '126'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36', '127'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36', '128'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6128f9ff-27d4-4b2e-834a-95802c0ec75e', '129'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '95')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:08:17.871672 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36', '127')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:08:17.873718 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36', '128')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:08:17.875220 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c2fdb20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36'): ({'sdi'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:08:17.875478 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Removing multipathed devices sdi, sdh {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:08:17.875781 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Flush multipath device 330000000bcd06062 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:08:17.935982 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:08:17.988125 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:08:18.042261 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:08:18.042518 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:08:18.044351 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:08:18.057107 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:08:18.057107 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:08:18.063109 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.898s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:18.063514 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:08:18.071854 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:18.123423 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 127, target: iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36, portal: 192.168.40.100,3260]
May 21 02:08:18.123423 np0000001127 nova-compute[98206]: Logout of [sid: 127, target: iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36, portal: 192.168.40.100,3260] successful.
May 21 02:08:18.123423 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:18.146168 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:18.162182 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:18.200714 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 128, target: iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36, portal: 192.168.50.100,3260]
May 21 02:08:18.200714 np0000001127 nova-compute[98206]: Logout of [sid: 128, target: iqn.2023-03.storpool.com:os--volume-9e45da95-d0bd-4a28-859f-96496102cc36, portal: 192.168.50.100,3260] successful.
May 21 02:08:18.200714 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:18.222546 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:18.222775 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:08:18.223506 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] <== disconnect_volume: return (2404ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:08:18.223506 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:08:18.223506 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Deleting instance files /opt/stack/data/nova/instances/609b1611-3b05-4b86-8bf3-85f16f199d80_del
May 21 02:08:18.223934 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Deletion of /opt/stack/data/nova/instances/609b1611-3b05-4b86-8bf3-85f16f199d80_del complete
May 21 02:08:18.336330 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:06:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001127',hostname='multiattach-server-0',id=54,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzu+v5yloohnjet+lpl7Cb5m5YuZdtxheBkBGOMBLLe2AJEatmv/W6U1humbPofoJpKHaVTa0sSri4Ktoz/rRBuEiIFUUGVMQjgWmfd958Eyx52s4Fg6gJyB/ru0BJ+zA==',key_name='tempest-keypair-1890511814',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:07:08Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001127',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='848912b0c0e94d2795bb2332daf1730e',ramdisk_id='',reservation_id='r-riou1f0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-289054175',owner_user_name='tempest-AttachVolumeMultiAttachTest-289054175-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:08:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='049d6c8cccfa4ae38d78a88ef5be0f1b',uuid=aa3f5a78-fb82-4e21-8ebf-90bf48a122be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "address": "fa:16:3e:db:08:dd", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "vif_mac": "fa:16:3e:db:08:dd"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b286fbf-a6", "ovs_interfaceid": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:08:18.336624 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converting VIF {"id": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "address": "fa:16:3e:db:08:dd", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "vif_mac": "fa:16:3e:db:08:dd"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b286fbf-a6", "ovs_interfaceid": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:08:18.337192 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:08:dd,bridge_name='br-int',has_traffic_filtering=True,id=2b286fbf-a6fe-4dcc-af12-2521cf154dbb,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b286fbf-a6') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:08:18.339071 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] End _get_guest_xml xml=<domain type="qemu">
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:   <uuid>aa3f5a78-fb82-4e21-8ebf-90bf48a122be</uuid>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:   <name>instance-00000036</name>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:   <memory>262144</memory>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:       <nova:name>multiattach-server-0</nova:name>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:08:08</nova:creationTime>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.micro" id="84">
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:         <nova:memory>256</nova:memory>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:           <nova:property name="hw_machine_type">pc</nova:property>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:           <nova:property name="hw_video_model">virtio</nova:property>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:         <nova:user uuid="049d6c8cccfa4ae38d78a88ef5be0f1b">tempest-AttachVolumeMultiAttachTest-289054175-project-member</nova:user>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:         <nova:project uuid="848912b0c0e94d2795bb2332daf1730e">tempest-AttachVolumeMultiAttachTest-289054175</nova:project>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:         <nova:port uuid="2b286fbf-a6fe-4dcc-af12-2521cf154dbb">
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:     <system>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:       <entry name="serial">aa3f5a78-fb82-4e21-8ebf-90bf48a122be</entry>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:       <entry name="uuid">aa3f5a78-fb82-4e21-8ebf-90bf48a122be</entry>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:     </system>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:   <os>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:   </os>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:   <features>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:   </features>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:   <devices>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk"/>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:     </disk>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk.config"/>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:     </disk>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:       <alias name="ua-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b"/>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-1"/>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:       <target dev="vdb" bus="virtio"/>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:       <serial>e7cfdf26-9973-4cc1-8395-11f9ebc98c4b</serial>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:       <shareable/>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:     </disk>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:db:08:dd"/>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:       <target dev="tap2b286fbf-a6"/>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:     </interface>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/console.log" append="off"/>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:     </serial>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:     <video>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:     </video>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:     </rng>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:   </devices>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]: </domain>
May 21 02:08:18.339071 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:08:18.341363 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:06:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001127',hostname='multiattach-server-0',id=54,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzu+v5yloohnjet+lpl7Cb5m5YuZdtxheBkBGOMBLLe2AJEatmv/W6U1humbPofoJpKHaVTa0sSri4Ktoz/rRBuEiIFUUGVMQjgWmfd958Eyx52s4Fg6gJyB/ru0BJ+zA==',key_name='tempest-keypair-1890511814',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:07:08Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001127',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='848912b0c0e94d2795bb2332daf1730e',ramdisk_id='',reservation_id='r-riou1f0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-289054175',owner_user_name='tempest-AttachVolumeMultiAttachTest-289054175-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:08:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='049d6c8cccfa4ae38d78a88ef5be0f1b',uuid=aa3f5a78-fb82-4e21-8ebf-90bf48a122be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "address": "fa:16:3e:db:08:dd", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "vif_mac": "fa:16:3e:db:08:dd"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b286fbf-a6", "ovs_interfaceid": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:08:18.341363 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converting VIF {"id": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "address": "fa:16:3e:db:08:dd", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "vif_mac": "fa:16:3e:db:08:dd"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b286fbf-a6", "ovs_interfaceid": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:08:18.341636 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:08:dd,bridge_name='br-int',has_traffic_filtering=True,id=2b286fbf-a6fe-4dcc-af12-2521cf154dbb,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b286fbf-a6') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:08:18.341889 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:08:dd,bridge_name='br-int',has_traffic_filtering=True,id=2b286fbf-a6fe-4dcc-af12-2521cf154dbb,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b286fbf-a6') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:08:18.342238 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:18.342587 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:18.342797 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:08:18.344141 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:18.344383 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a08c2d0f-6055-534b-950a-af43b4aeaf54', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:18.346142 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:18.346142 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:08:18.347341 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:18.349654 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:18.349889 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b286fbf-a6, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:18.350272 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2b286fbf-a6, col_values=(('qos', UUID('0251aa81-6430-4766-90a2-a08c48c804e0')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:18.350499 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2b286fbf-a6, col_values=(('external_ids', {'iface-id': '2b286fbf-a6fe-4dcc-af12-2521cf154dbb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:08:dd', 'vm-uuid': 'aa3f5a78-fb82-4e21-8ebf-90bf48a122be'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:18.352191 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:18.352563 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:08:18.358728 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:18.359514 np0000001127 nova-compute[98206]: INFO os_vif [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:08:dd,bridge_name='br-int',has_traffic_filtering=True,id=2b286fbf-a6fe-4dcc-af12-2521cf154dbb,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b286fbf-a6')
May 21 02:08:18.370812 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-d65e2355-27f1-4799-ba8c-c30a8917d411 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Took 1.37 seconds to destroy the instance on the hypervisor.
May 21 02:08:18.372316 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-d65e2355-27f1-4799-ba8c-c30a8917d411 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:08:18.372556 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:08:18.372669 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:08:18.372979 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:18.487896 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:18.570328 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:08:18.570773 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:08:18.570773 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:18.571002 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:18.729302 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f6a74c27fc7e4700b1a3643ac9061351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b0c9e6822548b0b76d6b5dd04a74dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:08:18.736512 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Took 3.79 seconds to destroy the instance on the hypervisor.
May 21 02:08:18.740888 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:08:18.741210 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:08:18.741336 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:08:18.741618 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:18.814589 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:19.073412 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:08:19.247881 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:08:19.331072 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1054c205-35dd-44d5-81f3-474517bdd1ab req-7864a66e-70cf-416e-bef4-1f614fe59ef6 service nova] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Received event network-vif-unplugged-7475b4a3-11de-43b6-9d83-b59933d9e8db {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:19.331857 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1054c205-35dd-44d5-81f3-474517bdd1ab req-7864a66e-70cf-416e-bef4-1f614fe59ef6 service nova] Acquiring lock "9b4239c5-84df-4d87-a2d4-fb6192408f58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:19.332284 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1054c205-35dd-44d5-81f3-474517bdd1ab req-7864a66e-70cf-416e-bef4-1f614fe59ef6 service nova] Lock "9b4239c5-84df-4d87-a2d4-fb6192408f58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:19.332613 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1054c205-35dd-44d5-81f3-474517bdd1ab req-7864a66e-70cf-416e-bef4-1f614fe59ef6 service nova] Lock "9b4239c5-84df-4d87-a2d4-fb6192408f58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:19.332827 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1054c205-35dd-44d5-81f3-474517bdd1ab req-7864a66e-70cf-416e-bef4-1f614fe59ef6 service nova] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] No waiting events found dispatching network-vif-unplugged-7475b4a3-11de-43b6-9d83-b59933d9e8db {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:08:19.332990 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1054c205-35dd-44d5-81f3-474517bdd1ab req-7864a66e-70cf-416e-bef4-1f614fe59ef6 service nova] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Received event network-vif-unplugged-7475b4a3-11de-43b6-9d83-b59933d9e8db for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:08:19.333146 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1054c205-35dd-44d5-81f3-474517bdd1ab req-7864a66e-70cf-416e-bef4-1f614fe59ef6 service nova] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Received event network-vif-deleted-7475b4a3-11de-43b6-9d83-b59933d9e8db {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:19.578008 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:08:19.634133 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Successfully created port: 963445f8-7e0f-4b25-a9a3-d18321b5271e {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:08:19.753541 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Took 1.38 seconds to deallocate network for instance.
May 21 02:08:19.803718 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:08:19.887629 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:08:19.887774 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:08:19.887889 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:08:19.887997 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No VIF found with MAC fa:16:3e:db:08:dd, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:08:19.888639 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Using config drive
May 21 02:08:20.162187 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Successfully updated port: 963445f8-7e0f-4b25-a9a3-d18321b5271e {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:08:20.225157 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-162d332d-3b9d-4bef-8567-601fd9637b75 req-681c4196-05a4-4d50-bb4a-f5979d06bbb4 service nova] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Received event network-changed-963445f8-7e0f-4b25-a9a3-d18321b5271e {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:20.225373 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-162d332d-3b9d-4bef-8567-601fd9637b75 req-681c4196-05a4-4d50-bb4a-f5979d06bbb4 service nova] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Refreshing instance network info cache due to event network-changed-963445f8-7e0f-4b25-a9a3-d18321b5271e. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:08:20.225434 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-162d332d-3b9d-4bef-8567-601fd9637b75 req-681c4196-05a4-4d50-bb4a-f5979d06bbb4 service nova] Acquiring lock "refresh_cache-fcada4b6-3630-4322-b6ce-8812b0c4afe9" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:08:20.225597 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-162d332d-3b9d-4bef-8567-601fd9637b75 req-681c4196-05a4-4d50-bb4a-f5979d06bbb4 service nova] Acquired lock "refresh_cache-fcada4b6-3630-4322-b6ce-8812b0c4afe9" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:08:20.225637 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-162d332d-3b9d-4bef-8567-601fd9637b75 req-681c4196-05a4-4d50-bb4a-f5979d06bbb4 service nova] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Refreshing network info cache for port 963445f8-7e0f-4b25-a9a3-d18321b5271e {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:08:20.261676 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d65e2355-27f1-4799-ba8c-c30a8917d411 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:20.264772 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d65e2355-27f1-4799-ba8c-c30a8917d411 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:20.305359 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Took 1.56 seconds to deallocate network for instance.
May 21 02:08:20.314904 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-d65e2355-27f1-4799-ba8c-c30a8917d411 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Refreshing inventories for resource provider a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 21 02:08:20.348298 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:20.382329 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:20.397516 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-d65e2355-27f1-4799-ba8c-c30a8917d411 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Updating ProviderTree inventory for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 21 02:08:20.397722 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-d65e2355-27f1-4799-ba8c-c30a8917d411 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Updating inventory in ProviderTree for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 21 02:08:20.456806 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:20.464822 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-d65e2355-27f1-4799-ba8c-c30a8917d411 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Refreshing aggregate associations for resource provider a0b7bd56-5a70-4557-8cfd-9f933f412754, aggregates: None {{(pid=98206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 21 02:08:20.540666 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-d65e2355-27f1-4799-ba8c-c30a8917d411 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Refreshing trait associations for resource provider a0b7bd56-5a70-4557-8cfd-9f933f412754, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_ARCH_X86_64,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ARCH_PPC64LE,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,HW_ARCH_X86_64,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ARCH_S390X,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOUND_MODEL_USB,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_SOUND_MODEL_SB16,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_ARCH_RISCV64,COMPUTE_ARCH_MIPSEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ARCH_AARCH64,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_SOUND_MODEL_AC97,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX {{(pid=98206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 21 02:08:20.546738 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:20.550159 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:20.575459 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2e9dd456-50d4-466d-b1de-11258efc58a0 req-1ea7d1c6-f46f-42d4-899e-d61d2526c742 service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Received event network-vif-plugged-2b286fbf-a6fe-4dcc-af12-2521cf154dbb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:20.576490 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2e9dd456-50d4-466d-b1de-11258efc58a0 req-1ea7d1c6-f46f-42d4-899e-d61d2526c742 service nova] Acquiring lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:20.576490 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2e9dd456-50d4-466d-b1de-11258efc58a0 req-1ea7d1c6-f46f-42d4-899e-d61d2526c742 service nova] Lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:20.576490 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2e9dd456-50d4-466d-b1de-11258efc58a0 req-1ea7d1c6-f46f-42d4-899e-d61d2526c742 service nova] Lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:20.576490 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2e9dd456-50d4-466d-b1de-11258efc58a0 req-1ea7d1c6-f46f-42d4-899e-d61d2526c742 service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] No waiting events found dispatching network-vif-plugged-2b286fbf-a6fe-4dcc-af12-2521cf154dbb {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:08:20.577835 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-2e9dd456-50d4-466d-b1de-11258efc58a0 req-1ea7d1c6-f46f-42d4-899e-d61d2526c742 service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Received unexpected event network-vif-plugged-2b286fbf-a6fe-4dcc-af12-2521cf154dbb for instance with vm_state active and task_state resize_finish.
May 21 02:08:20.587811 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:08:20.588707 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:08:20.589192 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Creating image(s)
May 21 02:08:20.589432 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Acquiring lock "/opt/stack/data/nova/instances/fcada4b6-3630-4322-b6ce-8812b0c4afe9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:20.589518 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Lock "/opt/stack/data/nova/instances/fcada4b6-3630-4322-b6ce-8812b0c4afe9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:20.590974 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Lock "/opt/stack/data/nova/instances/fcada4b6-3630-4322-b6ce-8812b0c4afe9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:20.590974 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:08:20.593431 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:08:20.599100 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:20.666086 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Acquiring lock "refresh_cache-fcada4b6-3630-4322-b6ce-8812b0c4afe9" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:08:20.702554 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.103s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:08:20.705139 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:20.705139 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:20.705139 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:08:20.712154 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:08:20.713001 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:20.740954 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-162d332d-3b9d-4bef-8567-601fd9637b75 req-681c4196-05a4-4d50-bb4a-f5979d06bbb4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:20.820993 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.108s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:08:20.821478 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/fcada4b6-3630-4322-b6ce-8812b0c4afe9/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:20.854044 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-162d332d-3b9d-4bef-8567-601fd9637b75 req-681c4196-05a4-4d50-bb4a-f5979d06bbb4 service nova] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:08:20.892937 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/fcada4b6-3630-4322-b6ce-8812b0c4afe9/disk 1073741824" returned: 0 in 0.071s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:08:20.893566 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:20.893872 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:20.919016 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Took 0.61 seconds to detach 1 volumes for instance.
May 21 02:08:21.010532 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.116s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:08:21.011198 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fcada4b6-3630-4322-b6ce-8812b0c4afe9/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:08:21.012084 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcada4b6-3630-4322-b6ce-8812b0c4afe9/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:21.054122 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-162d332d-3b9d-4bef-8567-601fd9637b75 req-681c4196-05a4-4d50-bb4a-f5979d06bbb4 service nova] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:08:21.117987 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcada4b6-3630-4322-b6ce-8812b0c4afe9/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:08:21.118312 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Cannot resize image /opt/stack/data/nova/instances/fcada4b6-3630-4322-b6ce-8812b0c4afe9/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:08:21.118654 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:08:21.118828 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Ensure instance console log exists: /opt/stack/data/nova/instances/fcada4b6-3630-4322-b6ce-8812b0c4afe9/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:08:21.119132 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:21.119357 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:21.119553 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:21.329394 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329301.3289144, aa3f5a78-fb82-4e21-8ebf-90bf48a122be => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:08:21.329607 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] VM Resumed (Lifecycle Event)
May 21 02:08:21.338088 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Instance event wait completed in 0 seconds for  {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:08:21.347604 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Instance running successfully.
May 21 02:08:21.349379 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Failed to set time: agent not configured {{(pid=98206) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 21 02:08:21.349569 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-20ba2dd1-3631-4030-876d-bb8203850e98 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] finish_migration finished successfully. {{(pid=98206) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 21 02:08:21.406171 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c99fc671-05cb-42c2-af2c-ed71e7d7f94b req-6b3d87f5-a1b0-45b3-915e-04e99939d29c service nova] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Received event network-vif-deleted-58f0082f-9f4d-42c5-9569-faf668cc281d {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:21.450345 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:21.514138 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d65e2355-27f1-4799-ba8c-c30a8917d411 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:08:21.514320 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-d65e2355-27f1-4799-ba8c-c30a8917d411 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:08:21.560141 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-162d332d-3b9d-4bef-8567-601fd9637b75 req-681c4196-05a4-4d50-bb4a-f5979d06bbb4 service nova] Releasing lock "refresh_cache-fcada4b6-3630-4322-b6ce-8812b0c4afe9" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:08:21.560524 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Acquired lock "refresh_cache-fcada4b6-3630-4322-b6ce-8812b0c4afe9" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:08:21.560666 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:08:21.717351 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:21.843495 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:08:21.846611 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:08:22.010501 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0004532030002337706 future=<Future at 0x71c0586b8a10 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:22.012125 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Emitting event <LifecycleEvent: 1779329287.0099335, b646159a-f806-487d-8a14-0aa8e2438f2b => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:08:22.012330 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] VM Stopped (Lifecycle Event)
May 21 02:08:22.014123 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:22.014742 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=8.271072874999845 future=<Future at 0x71c07c2f8e00 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:22.014742 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=8.27092196500007 future=<Future at 0x71c07c2f8e00 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:22.017234 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-d65e2355-27f1-4799-ba8c-c30a8917d411 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:08:22.133487 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:08:22.289580 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:22.350961 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 21 02:08:22.351309 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329302.3510814, aa3f5a78-fb82-4e21-8ebf-90bf48a122be => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:08:22.351536 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] VM Started (Lifecycle Event)
May 21 02:08:22.444688 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Updating instance_info_cache with network_info: [{"id": "963445f8-7e0f-4b25-a9a3-d18321b5271e", "address": "fa:16:3e:f0:95:44", "network": {"id": "80d2c5e9-dd42-4109-9563-9e1bc30c577a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e0576bdbcbdb4371809bfe8bd6fe7bb5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap963445f8-7e", "ovs_interfaceid": "963445f8-7e0f-4b25-a9a3-d18321b5271e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:08:22.524117 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b646159a-f806-487d-8a14-0aa8e2438f2b] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:08:22.531028 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d65e2355-27f1-4799-ba8c-c30a8917d411 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.269s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:22.532732 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.082s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:22.594264 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-d65e2355-27f1-4799-ba8c-c30a8917d411 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Deleted allocations for instance 9b4239c5-84df-4d87-a2d4-fb6192408f58
May 21 02:08:22.657901 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c59966c8-dc0c-42cc-add4-cb0622d1d569 req-a27203cd-39ca-4e16-85cb-3608d31c343b service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Received event network-vif-plugged-2b286fbf-a6fe-4dcc-af12-2521cf154dbb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:22.657901 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c59966c8-dc0c-42cc-add4-cb0622d1d569 req-a27203cd-39ca-4e16-85cb-3608d31c343b service nova] Acquiring lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:22.657901 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c59966c8-dc0c-42cc-add4-cb0622d1d569 req-a27203cd-39ca-4e16-85cb-3608d31c343b service nova] Lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:22.657901 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c59966c8-dc0c-42cc-add4-cb0622d1d569 req-a27203cd-39ca-4e16-85cb-3608d31c343b service nova] Lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:22.657901 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c59966c8-dc0c-42cc-add4-cb0622d1d569 req-a27203cd-39ca-4e16-85cb-3608d31c343b service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] No waiting events found dispatching network-vif-plugged-2b286fbf-a6fe-4dcc-af12-2521cf154dbb {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:08:22.657901 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-c59966c8-dc0c-42cc-add4-cb0622d1d569 req-a27203cd-39ca-4e16-85cb-3608d31c343b service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Received unexpected event network-vif-plugged-2b286fbf-a6fe-4dcc-af12-2521cf154dbb for instance with vm_state resized and task_state None.
May 21 02:08:22.858851 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:08:22.861707 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:08:22.955242 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Releasing lock "refresh_cache-fcada4b6-3630-4322-b6ce-8812b0c4afe9" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:08:22.955868 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e6385d11-3ff1-485d-9366-ea76d51c9fea tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:22.956203 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Instance network_info: |[{"id": "963445f8-7e0f-4b25-a9a3-d18321b5271e", "address": "fa:16:3e:f0:95:44", "network": {"id": "80d2c5e9-dd42-4109-9563-9e1bc30c577a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e0576bdbcbdb4371809bfe8bd6fe7bb5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap963445f8-7e", "ovs_interfaceid": "963445f8-7e0f-4b25-a9a3-d18321b5271e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:08:22.956476 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e6385d11-3ff1-485d-9366-ea76d51c9fea tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:22.956681 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e6385d11-3ff1-485d-9366-ea76d51c9fea tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Going to confirm migration 3 {{(pid=98206) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 21 02:08:22.960242 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Start _get_guest_xml network_info=[{"id": "963445f8-7e0f-4b25-a9a3-d18321b5271e", "address": "fa:16:3e:f0:95:44", "network": {"id": "80d2c5e9-dd42-4109-9563-9e1bc30c577a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e0576bdbcbdb4371809bfe8bd6fe7bb5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap963445f8-7e", "ovs_interfaceid": "963445f8-7e0f-4b25-a9a3-d18321b5271e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:08:22.963491 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:08:22.963491 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-VolumesNegativeTest-instance-485287003', uuid='fcada4b6-3630-4322-b6ce-8812b0c4afe9'), owner=OwnerMeta(userid='f6a74c27fc7e4700b1a3643ac9061351', username='tempest-VolumesNegativeTest-1786760828-project-member', projectid='97b0c9e6822548b0b76d6b5dd04a74dd', projectname='tempest-VolumesNegativeTest-1786760828'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "963445f8-7e0f-4b25-a9a3-d18321b5271e", "address": "fa:16:3e:f0:95:44", "network": {"id": "80d2c5e9-dd42-4109-9563-9e1bc30c577a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e0576bdbcbdb4371809bfe8bd6fe7bb5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap963445f8-7e", "ovs_interfaceid": "963445f8-7e0f-4b25-a9a3-d18321b5271e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329302.963081) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:08:22.964584 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:08:22.965046 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:08:22.966002 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:08:22.966177 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:08:22.967140 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:08:22.967601 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:08:22.967718 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:08:22.967911 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:08:22.968007 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:08:22.971511 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:08:22.971511 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:08:22.971511 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:08:22.971511 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:08:22.971511 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:08:22.971511 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:08:22.971511 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:08:22.983790 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:08:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-485287003',display_name='tempest-VolumesNegativeTest-instance-485287003',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumesnegativetest-instance-485287003',id=60,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97b0c9e6822548b0b76d6b5dd04a74dd',ramdisk_id='',reservation_id='r-v0w0vw0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1786760828',owner_user_name='tempest-VolumesNegativeTest-1786760828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:08:20Z,user_data=None,user_id='f6a74c27fc7e4700b1a3643ac9061351',uuid=fcada4b6-3630-4322-b6ce-8812b0c4afe9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "963445f8-7e0f-4b25-a9a3-d18321b5271e", "address": "fa:16:3e:f0:95:44", "network": {"id": "80d2c5e9-dd42-4109-9563-9e1bc30c577a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e0576bdbcbdb4371809bfe8bd6fe7bb5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap963445f8-7e", "ovs_interfaceid": "963445f8-7e0f-4b25-a9a3-d18321b5271e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:08:22.983790 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Converting VIF {"id": "963445f8-7e0f-4b25-a9a3-d18321b5271e", "address": "fa:16:3e:f0:95:44", "network": {"id": "80d2c5e9-dd42-4109-9563-9e1bc30c577a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e0576bdbcbdb4371809bfe8bd6fe7bb5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap963445f8-7e", "ovs_interfaceid": "963445f8-7e0f-4b25-a9a3-d18321b5271e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:08:22.983790 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:95:44,bridge_name='br-int',has_traffic_filtering=True,id=963445f8-7e0f-4b25-a9a3-d18321b5271e,network=Network(80d2c5e9-dd42-4109-9563-9e1bc30c577a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963445f8-7e') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:08:22.983790 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Lazy-loading 'pci_devices' on Instance uuid fcada4b6-3630-4322-b6ce-8812b0c4afe9 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:08:23.101440 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "511701d6-fac9-4e15-803d-e9038bd1a018" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:23.101622 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "511701d6-fac9-4e15-803d-e9038bd1a018" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:23.296713 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:08:23.296965 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:08:23.351347 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:23.462634 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-e6385d11-3ff1-485d-9366-ea76d51c9fea tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:23.487109 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] End _get_guest_xml xml=<domain type="qemu">
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:   <uuid>fcada4b6-3630-4322-b6ce-8812b0c4afe9</uuid>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:   <name>instance-0000003c</name>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:       <nova:name>tempest-VolumesNegativeTest-instance-485287003</nova:name>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:08:22</nova:creationTime>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:         <nova:user uuid="f6a74c27fc7e4700b1a3643ac9061351">tempest-VolumesNegativeTest-1786760828-project-member</nova:user>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:         <nova:project uuid="97b0c9e6822548b0b76d6b5dd04a74dd">tempest-VolumesNegativeTest-1786760828</nova:project>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:         <nova:port uuid="963445f8-7e0f-4b25-a9a3-d18321b5271e">
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="192.168.233.64" ipVersion="4"/>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:     <system>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:       <entry name="serial">fcada4b6-3630-4322-b6ce-8812b0c4afe9</entry>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:       <entry name="uuid">fcada4b6-3630-4322-b6ce-8812b0c4afe9</entry>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:     </system>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:   <os>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:   </os>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:   <features>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:   </features>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:   <devices>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/fcada4b6-3630-4322-b6ce-8812b0c4afe9/disk"/>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:     </disk>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/fcada4b6-3630-4322-b6ce-8812b0c4afe9/disk.config"/>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:     </disk>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:f0:95:44"/>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:       <target dev="tap963445f8-7e"/>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:     </interface>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/fcada4b6-3630-4322-b6ce-8812b0c4afe9/console.log" append="off"/>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:     </serial>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:     <video>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:     </video>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:     </rng>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:   </devices>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]: </domain>
May 21 02:08:23.487109 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:08:23.489413 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Preparing to wait for external event network-vif-plugged-963445f8-7e0f-4b25-a9a3-d18321b5271e {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:08:23.489413 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Acquiring lock "fcada4b6-3630-4322-b6ce-8812b0c4afe9-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:23.489413 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Lock "fcada4b6-3630-4322-b6ce-8812b0c4afe9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:23.489413 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Lock "fcada4b6-3630-4322-b6ce-8812b0c4afe9-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:23.489413 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:08:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-485287003',display_name='tempest-VolumesNegativeTest-instance-485287003',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumesnegativetest-instance-485287003',id=60,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97b0c9e6822548b0b76d6b5dd04a74dd',ramdisk_id='',reservation_id='r-v0w0vw0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1786760828',owner_user_name='tempest-VolumesNegativeTest-1786760828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:08:20Z,user_data=None,user_id='f6a74c27fc7e4700b1a3643ac9061351',uuid=fcada4b6-3630-4322-b6ce-8812b0c4afe9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "963445f8-7e0f-4b25-a9a3-d18321b5271e", "address": "fa:16:3e:f0:95:44", "network": {"id": "80d2c5e9-dd42-4109-9563-9e1bc30c577a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e0576bdbcbdb4371809bfe8bd6fe7bb5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap963445f8-7e", "ovs_interfaceid": "963445f8-7e0f-4b25-a9a3-d18321b5271e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:08:23.491850 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Converting VIF {"id": "963445f8-7e0f-4b25-a9a3-d18321b5271e", "address": "fa:16:3e:f0:95:44", "network": {"id": "80d2c5e9-dd42-4109-9563-9e1bc30c577a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e0576bdbcbdb4371809bfe8bd6fe7bb5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap963445f8-7e", "ovs_interfaceid": "963445f8-7e0f-4b25-a9a3-d18321b5271e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:08:23.492402 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:95:44,bridge_name='br-int',has_traffic_filtering=True,id=963445f8-7e0f-4b25-a9a3-d18321b5271e,network=Network(80d2c5e9-dd42-4109-9563-9e1bc30c577a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963445f8-7e') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:08:23.494882 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:95:44,bridge_name='br-int',has_traffic_filtering=True,id=963445f8-7e0f-4b25-a9a3-d18321b5271e,network=Network(80d2c5e9-dd42-4109-9563-9e1bc30c577a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963445f8-7e') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:08:23.495486 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:23.495994 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:23.497226 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:08:23.498887 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:23.499439 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f967e2f5-a416-5e13-8805-5decaeee7d8e', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:23.500914 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:23.500914 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:08:23.501403 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:23.503279 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:23.503437 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap963445f8-7e, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:23.503781 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap963445f8-7e, col_values=(('qos', UUID('df47e569-dfd4-441b-92fe-1a9de44dec15')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:23.503954 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap963445f8-7e, col_values=(('external_ids', {'iface-id': '963445f8-7e0f-4b25-a9a3-d18321b5271e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:95:44', 'vm-uuid': 'fcada4b6-3630-4322-b6ce-8812b0c4afe9'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:23.504693 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:23.507076 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:08:23.511103 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:23.511917 np0000001127 nova-compute[98206]: INFO os_vif [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:95:44,bridge_name='br-int',has_traffic_filtering=True,id=963445f8-7e0f-4b25-a9a3-d18321b5271e,network=Network(80d2c5e9-dd42-4109-9563-9e1bc30c577a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963445f8-7e')
May 21 02:08:23.536246 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-e6385d11-3ff1-485d-9366-ea76d51c9fea tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:23.536526 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e6385d11-3ff1-485d-9366-ea76d51c9fea tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "refresh_cache-aa3f5a78-fb82-4e21-8ebf-90bf48a122be" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:08:23.536644 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e6385d11-3ff1-485d-9366-ea76d51c9fea tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquired lock "refresh_cache-aa3f5a78-fb82-4e21-8ebf-90bf48a122be" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:08:23.536775 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-e6385d11-3ff1-485d-9366-ea76d51c9fea tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:08:23.536884 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-e6385d11-3ff1-485d-9366-ea76d51c9fea tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lazy-loading 'info_cache' on Instance uuid aa3f5a78-fb82-4e21-8ebf-90bf48a122be {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:08:23.601676 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d65e2355-27f1-4799-ba8c-c30a8917d411 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Lock "9b4239c5-84df-4d87-a2d4-fb6192408f58" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.114s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:23.605279 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lazy-loading 'flavor' on Instance uuid 511701d6-fac9-4e15-803d-e9038bd1a018 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:08:23.794199 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:23.794389 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:23.799847 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:08:24.297974 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lazy-loading 'flavor' on Instance uuid 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:08:24.308927 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.776s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:24.375082 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Deleted allocations for instance 609b1611-3b05-4b86-8bf3-85f16f199d80
May 21 02:08:24.542001 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-e6385d11-3ff1-485d-9366-ea76d51c9fea tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:24.611998 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "511701d6-fac9-4e15-803d-e9038bd1a018" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:24.850722 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-e6385d11-3ff1-485d-9366-ea76d51c9fea tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:24.976807 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-e6385d11-3ff1-485d-9366-ea76d51c9fea tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Updating instance_info_cache with network_info: [{"id": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "address": "fa:16:3e:db:08:dd", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b286fbf-a6", "ovs_interfaceid": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:08:25.029694 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:08:25.029694 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:08:25.029694 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] No VIF found with MAC fa:16:3e:f0:95:44, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:08:25.029694 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Using config drive
May 21 02:08:25.307987 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:25.385255 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4129bf59-148b-4f86-9840-235fa9c11365 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "609b1611-3b05-4b86-8bf3-85f16f199d80" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.946s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:25.481209 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e6385d11-3ff1-485d-9366-ea76d51c9fea tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Releasing lock "refresh_cache-aa3f5a78-fb82-4e21-8ebf-90bf48a122be" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:08:25.481209 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-e6385d11-3ff1-485d-9366-ea76d51c9fea tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lazy-loading 'migration_context' on Instance uuid aa3f5a78-fb82-4e21-8ebf-90bf48a122be {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:08:25.535442 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:25.684435 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Creating config drive at /opt/stack/data/nova/instances/fcada4b6-3630-4322-b6ce-8812b0c4afe9/disk.config
May 21 02:08:25.688107 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fcada4b6-3630-4322-b6ce-8812b0c4afe9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcl5eyymz {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:25.712584 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "511701d6-fac9-4e15-803d-e9038bd1a018" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:25.712909 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "511701d6-fac9-4e15-803d-e9038bd1a018" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:25.713244 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Attaching volume 1f3c63df-64f7-45f8-b14f-f9937dc2bc12 to /dev/vdb
May 21 02:08:25.746743 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fcada4b6-3630-4322-b6ce-8812b0c4afe9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcl5eyymz" returned: 0 in 0.059s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:08:25.775188 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:08:25.787232 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:08:25.815155 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:25.870566 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:08:25.871087 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:08:25.883877 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:08:25.885927 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe0f:28a1', 'fe80::440a:38ff:fe27:fa24', 'fe80::fc16:3eff:fefb:4d96', 'fe80::fc16:3eff:fe68:a810', 'fe80::3cc0:a4ff:feab:836e', 'fe80::fc16:3eff:fe65:6557', 'fe80::fc16:3eff:fef5:8ead', 'fe80::fc16:3eff:fece:d884', 'fe80::7ca5:4ff:fee7:fb0a', 'fe80::fc16:3eff:fe20:ae96', 'fe80::fc16:3eff:feb8:d101', 'fe80::7045:30ff:fe1a:b99f', 'fe80::fc16:3eff:fef1:4daa', 'fe80::2482:bff:fe1b:902b', 'fe80::fc16:3eff:fed6:68cb', 'fe80::fc16:3eff:fedb:8dd'] 
May 21 02:08:25.886083 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:08:25.886175 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:08:25.888334 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:08:25.888334 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Updating existing volume attachment record: d1b52374-40d5-472a-afc2-22c873fa92b4 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:08:25.981875 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-e6385d11-3ff1-485d-9366-ea76d51c9fea tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Object Instance<aa3f5a78-fb82-4e21-8ebf-90bf48a122be> lazy-loaded attributes: info_cache,migration_context {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:08:25.994914 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e6385d11-3ff1-485d-9366-ea76d51c9fea tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:25.995255 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e6385d11-3ff1-485d-9366-ea76d51c9fea tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:26.226428 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:26.299207 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:26.301235 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:26.362650 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:26.427869 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:26.427869 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:26.428051 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Attaching volume ad21d805-0f07-40f2-8238-8fa00d1142e0 to /dev/vdb
May 21 02:08:26.477564 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:08:26.485031 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:08:26.485438 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12', 'iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1f3c63df-64f7-45f8-b14f-f9937dc2bc12', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:08:26.485616 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:08:26.486013 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:08:26.486242 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12', 'iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1f3c63df-64f7-45f8-b14f-f9937dc2bc12', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:08:26.495637 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:08:26.505865 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:08:26.506029 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:08:26.506916 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:08:26.506916 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:08:26.508581 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:08:26.508581 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:08:26.527747 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:08:26.527747 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:26.545215 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:08:26.545215 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:26.552874 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:26.591149 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12] added
May 21 02:08:26.591149 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:08:26.591149 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:08:26.591149 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:08:26.591149 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:08:26.591149 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:08:26.591149 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:26.595463 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:08:26.595926 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12] added
May 21 02:08:26.595926 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:08:26.595926 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:08:26.595926 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:08:26.595926 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:08:26.595926 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:08:26.595926 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:26.596812 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.089(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:08:26.596910 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:08:26.597326 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:08:26.597556 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0888(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:08:26.597857 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:08:26.617000 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:08:26.617826 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:08:26.630092 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:26.632855 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:26.638027 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:08:26.640363 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::61:5bff:fe7c:aa8', 'fe80::fc16:3eff:fe0f:28a1', 'fe80::440a:38ff:fe27:fa24', 'fe80::fc16:3eff:fefb:4d96', 'fe80::fc16:3eff:fe68:a810', 'fe80::3cc0:a4ff:feab:836e', 'fe80::fc16:3eff:fe65:6557', 'fe80::fc16:3eff:fef5:8ead', 'fe80::fc16:3eff:fece:d884', 'fe80::7ca5:4ff:fee7:fb0a', 'fe80::fc16:3eff:fe20:ae96', 'fe80::fc16:3eff:feb8:d101', 'fe80::7045:30ff:fe1a:b99f', 'fe80::fc16:3eff:fef1:4daa', 'fe80::2482:bff:fe1b:902b', 'fe80::fc16:3eff:fed6:68cb', 'fe80::fc16:3eff:fedb:8dd', 'fe80::fc16:3eff:fef0:9544'] 
May 21 02:08:26.640661 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:08:26.640862 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:08:26.641187 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:08:26.641540 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Updating existing volume attachment record: b48f2ff8-46d9-4fda-aa68-72099ecb338e {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:08:26.644707 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:26.664854 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:26.679988 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cceec758-259b-4473-8957-c5433add1095 req-ab8cd81e-dd38-4456-a9e9-db056473819a service nova] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Received event network-vif-plugged-963445f8-7e0f-4b25-a9a3-d18321b5271e {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:26.680299 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cceec758-259b-4473-8957-c5433add1095 req-ab8cd81e-dd38-4456-a9e9-db056473819a service nova] Acquiring lock "fcada4b6-3630-4322-b6ce-8812b0c4afe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:26.680555 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cceec758-259b-4473-8957-c5433add1095 req-ab8cd81e-dd38-4456-a9e9-db056473819a service nova] Lock "fcada4b6-3630-4322-b6ce-8812b0c4afe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:26.680722 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cceec758-259b-4473-8957-c5433add1095 req-ab8cd81e-dd38-4456-a9e9-db056473819a service nova] Lock "fcada4b6-3630-4322-b6ce-8812b0c4afe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:26.680890 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cceec758-259b-4473-8957-c5433add1095 req-ab8cd81e-dd38-4456-a9e9-db056473819a service nova] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Processing event network-vif-plugged-963445f8-7e0f-4b25-a9a3-d18321b5271e {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:08:26.720458 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:27.192867 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329307.1925025, fcada4b6-3630-4322-b6ce-8812b0c4afe9 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:08:27.193015 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] VM Started (Lifecycle Event)
May 21 02:08:27.194788 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:08:27.197872 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:08:27.200390 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Instance spawned successfully.
May 21 02:08:27.200778 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:08:27.219430 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:08:27.219790 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ad21d805-0f07-40f2-8238-8fa00d1142e0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:08:27.219919 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:08:27.251878 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e6385d11-3ff1-485d-9366-ea76d51c9fea tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:08:27.252042 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-e6385d11-3ff1-485d-9366-ea76d51c9fea tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:08:27.289447 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Acquiring lock "2b990342-3aef-4ea5-a3bb-c776f4dd8567" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:27.289701 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "2b990342-3aef-4ea5-a3bb-c776f4dd8567" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:27.597800 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:08:27.598398 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:08:27.614811 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:08:27.614811 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:27.618047 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:08:27.621110 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:08:27.621110 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:27.630644 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:27.637283 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:27.655159 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:27.655159 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:27.655159 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:27.655159 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:27.655159 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:27.655159 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:27.655159 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:27.655159 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:27.655159 np0000001127 nova-compute[98206]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:27.655159 np0000001127 nova-compute[98206]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:27.655159 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:27.655159 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:27.655159 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:08:27.655159 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:27.655159 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:27.655159 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:27.655159 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:27.655159 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:27.655159 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:27.655159 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:27.655159 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:27.655159 np0000001127 nova-compute[98206]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:27.655159 np0000001127 nova-compute[98206]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:27.655159 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:27.655159 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:27.655159 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:08:27.661940 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:27.661940 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:27.661940 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:27.661940 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:27.661940 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:27.661940 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:27.661940 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:27.661940 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:27.661940 np0000001127 nova-compute[98206]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:27.661940 np0000001127 nova-compute[98206]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:27.661940 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:27.661940 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:27.661940 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:08:27.662523 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:27.662523 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:27.662523 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:27.662523 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:27.662523 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:27.662523 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:27.662523 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:27.662523 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:27.662523 np0000001127 nova-compute[98206]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:27.662523 np0000001127 nova-compute[98206]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:27.662523 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:27.662523 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:27.662523 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:08:27.696675 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:08:27.699192 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:08:27.712438 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:08:27.712614 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:08:27.712963 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:08:27.713260 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:08:27.713584 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:08:27.713879 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:08:27.718005 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12, portal: 192.168.40.100,3260]
May 21 02:08:27.718005 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12, portal: 192.168.40.100,3260] successful.
May 21 02:08:27.718005 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:27.722346 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12, portal: 192.168.50.100,3260]
May 21 02:08:27.722346 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12, portal: 192.168.50.100,3260] successful.
May 21 02:08:27.722346 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:27.742745 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:27.744127 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:27.755182 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-e6385d11-3ff1-485d-9366-ea76d51c9fea tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:08:27.773263 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:27.773263 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:27.773263 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:27.773263 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:27.773263 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:27.773263 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:27.773263 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:27.773263 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:27.773263 np0000001127 nova-compute[98206]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:27.773263 np0000001127 nova-compute[98206]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:27.773263 np0000001127 nova-compute[98206]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12 (non-flash)
May 21 02:08:27.773263 np0000001127 nova-compute[98206]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12 (non-flash)
May 21 02:08:27.773263 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:27.773263 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:27.773263 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:08:27.773704 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:27.773704 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:27.773704 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:27.773704 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:27.773704 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:27.773704 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:27.773704 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:27.773704 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:27.773704 np0000001127 nova-compute[98206]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:27.773704 np0000001127 nova-compute[98206]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:27.773704 np0000001127 nova-compute[98206]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12 (non-flash)
May 21 02:08:27.773704 np0000001127 nova-compute[98206]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12 (non-flash)
May 21 02:08:27.773704 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:27.773704 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:27.773704 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:08:27.773935 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.268s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:08:27.775618 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:08:27.775618 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] HCTL ('13', '-', '-', 0) found on session 130 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:08:27.778490 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:08:27.783793 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:27.783793 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:27.783793 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:27.783793 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:27.783793 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:27.783793 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:27.783793 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:27.783793 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:27.783793 np0000001127 nova-compute[98206]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:27.783793 np0000001127 nova-compute[98206]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:27.783793 np0000001127 nova-compute[98206]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12 (non-flash)
May 21 02:08:27.783793 np0000001127 nova-compute[98206]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12 (non-flash)
May 21 02:08:27.783793 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:27.783793 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:27.783793 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:08:27.783793 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:27.783793 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:27.783793 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:27.783793 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:27.783793 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:27.783793 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:27.783793 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:27.783793 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:27.783793 np0000001127 nova-compute[98206]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:27.783793 np0000001127 nova-compute[98206]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:27.783793 np0000001127 nova-compute[98206]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12 (non-flash)
May 21 02:08:27.783793 np0000001127 nova-compute[98206]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12 (non-flash)
May 21 02:08:27.783793 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:27.783793 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:27.783793 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:08:27.784367 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.276s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:08:27.784367 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:08:27.785661 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] HCTL ('14', '-', '-', 0) found on session 131 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:08:27.785661 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:08:27.794485 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Detaching volume a9d20392-5e79-4e81-8258-a7f8aeef7ea6
May 21 02:08:27.810023 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Searching for a device in session 130 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:08:27.810023 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1f3c63df-64f7-45f8-b14f-f9937dc2bc12', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:08:27.810023 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Searching for a device in session 131 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:08:27.810403 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '1f3c63df-64f7-45f8-b14f-f9937dc2bc12', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:08:27.854591 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Attempting to driver detach volume a9d20392-5e79-4e81-8258-a7f8aeef7ea6 from mountpoint /dev/vdb
May 21 02:08:27.864912 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Found disk vdb by alias ua-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:08:27.866452 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Found disk vdb by alias ua-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:08:27.866666 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Attempting to detach device vdb from instance 2b990342-3aef-4ea5-a3bb-c776f4dd8567 from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 02:08:27.866976 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:08:27.866976 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:08:27.866976 np0000001127 nova-compute[98206]:   <alias name="ua-a9d20392-5e79-4e81-8258-a7f8aeef7ea6"/>
May 21 02:08:27.866976 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-17"/>
May 21 02:08:27.866976 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:08:27.866976 np0000001127 nova-compute[98206]:   <serial>a9d20392-5e79-4e81-8258-a7f8aeef7ea6</serial>
May 21 02:08:27.866976 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:08:27.866976 np0000001127 nova-compute[98206]: </disk>
May 21 02:08:27.866976 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:08:27.884777 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Successfully detached device vdb from instance 2b990342-3aef-4ea5-a3bb-c776f4dd8567 from the persistent domain config.
May 21 02:08:27.884777 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] (1/8): Attempting to detach device vdb with device alias ua-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 from instance 2b990342-3aef-4ea5-a3bb-c776f4dd8567 from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 02:08:27.884777 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:08:27.884777 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:08:27.884777 np0000001127 nova-compute[98206]:   <alias name="ua-a9d20392-5e79-4e81-8258-a7f8aeef7ea6"/>
May 21 02:08:27.884777 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-17"/>
May 21 02:08:27.884777 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:08:27.884777 np0000001127 nova-compute[98206]:   <serial>a9d20392-5e79-4e81-8258-a7f8aeef7ea6</serial>
May 21 02:08:27.884777 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:08:27.884777 np0000001127 nova-compute[98206]: </disk>
May 21 02:08:27.884777 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:08:28.203450 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:08:28.203761 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329308.2035556, fcada4b6-3630-4322-b6ce-8812b0c4afe9 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:08:28.203944 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] VM Paused (Lifecycle Event)
May 21 02:08:28.222953 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Took 7.63 seconds to spawn the instance on the hypervisor.
May 21 02:08:28.223201 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:08:28.504498 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 for instance 2b990342-3aef-4ea5-a3bb-c776f4dd8567 {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 02:08:28.504948 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:28.506001 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:08:28.706225 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:08:28.710541 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329308.7094028, fcada4b6-3630-4322-b6ce-8812b0c4afe9 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:08:28.710541 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] VM Resumed (Lifecycle Event)
May 21 02:08:28.734212 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Took 13.62 seconds to build instance.
May 21 02:08:28.746768 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-223d835d-e4ea-4c53-a972-600fbbedb39d req-47743e23-ad74-44a1-877d-cad6ad4979ff service nova] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Received event network-vif-plugged-963445f8-7e0f-4b25-a9a3-d18321b5271e {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:28.748962 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-223d835d-e4ea-4c53-a972-600fbbedb39d req-47743e23-ad74-44a1-877d-cad6ad4979ff service nova] Acquiring lock "fcada4b6-3630-4322-b6ce-8812b0c4afe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:28.749266 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-223d835d-e4ea-4c53-a972-600fbbedb39d req-47743e23-ad74-44a1-877d-cad6ad4979ff service nova] Lock "fcada4b6-3630-4322-b6ce-8812b0c4afe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:28.749477 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-223d835d-e4ea-4c53-a972-600fbbedb39d req-47743e23-ad74-44a1-877d-cad6ad4979ff service nova] Lock "fcada4b6-3630-4322-b6ce-8812b0c4afe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:28.749616 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-223d835d-e4ea-4c53-a972-600fbbedb39d req-47743e23-ad74-44a1-877d-cad6ad4979ff service nova] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] No waiting events found dispatching network-vif-plugged-963445f8-7e0f-4b25-a9a3-d18321b5271e {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:08:28.749886 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-223d835d-e4ea-4c53-a972-600fbbedb39d req-47743e23-ad74-44a1-877d-cad6ad4979ff service nova] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Received unexpected event network-vif-plugged-963445f8-7e0f-4b25-a9a3-d18321b5271e for instance with vm_state active and task_state None.
May 21 02:08:28.771758 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e6385d11-3ff1-485d-9366-ea76d51c9fea tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.776s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:29.214414 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:08:29.219017 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:08:29.236354 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Lock "fcada4b6-3630-4322-b6ce-8812b0c4afe9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.134s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:29.395616 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-e6385d11-3ff1-485d-9366-ea76d51c9fea tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Deleted allocation for migration e36c9eb2-7bc4-4d53-9029-ee680a5875b8
May 21 02:08:29.528414 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Found WWN 3300000000eca3263 for multipath device dm-7 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:08:29.528414 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:08:29.528414 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '3300000000eca3263', 'path': '/dev/dm-7', 'multipath_id': '3300000000eca3263'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:08:29.528414 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000eca3263', 'path': '/dev/dm-7', 'multipath_id': '3300000000eca3263'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:08:29.528414 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.308s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:08:29.528414 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ad21d805-0f07-40f2-8238-8fa00d1142e0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:08:29.531682 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lazy-loading 'flavor' on Instance uuid 511701d6-fac9-4e15-803d-e9038bd1a018 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:08:29.542445 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:08:29.544680 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:08:29.544680 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:08:29.544680 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:08:29.544680 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:08:29.544680 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:08:29.558027 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:08:29.558027 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:29.564196 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:08:29.564196 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:29.575172 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0] added
May 21 02:08:29.575172 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:08:29.575172 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:08:29.575172 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:08:29.575172 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:08:29.575172 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:08:29.575172 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:29.575489 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:08:29.575637 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0312(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:08:29.575853 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:08:29.576625 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0] added
May 21 02:08:29.576625 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:08:29.576625 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:08:29.576625 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:08:29.576625 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:08:29.576625 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:08:29.576625 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:29.576868 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:08:29.577021 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0332(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:08:29.577194 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:08:29.609275 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b6cb16d0-5de2-461b-8b74-ba91f628dda3 tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Acquiring lock "fcada4b6-3630-4322-b6ce-8812b0c4afe9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:29.609570 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b6cb16d0-5de2-461b-8b74-ba91f628dda3 tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Lock "fcada4b6-3630-4322-b6ce-8812b0c4afe9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:29.609821 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b6cb16d0-5de2-461b-8b74-ba91f628dda3 tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Acquiring lock "fcada4b6-3630-4322-b6ce-8812b0c4afe9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:29.610030 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b6cb16d0-5de2-461b-8b74-ba91f628dda3 tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Lock "fcada4b6-3630-4322-b6ce-8812b0c4afe9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:29.610220 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b6cb16d0-5de2-461b-8b74-ba91f628dda3 tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Lock "fcada4b6-3630-4322-b6ce-8812b0c4afe9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:29.612521 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-b6cb16d0-5de2-461b-8b74-ba91f628dda3 tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Terminating instance
May 21 02:08:29.683141 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:29.722849 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] During sync_power_state the instance has a pending task (deleting). Skip.
May 21 02:08:29.723350 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779329309.7228844, 2b990342-3aef-4ea5-a3bb-c776f4dd8567 => ua-a9d20392-5e79-4e81-8258-a7f8aeef7ea6> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 02:08:29.726414 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Successfully detached device vdb from instance 2b990342-3aef-4ea5-a3bb-c776f4dd8567 from the live domain config.
May 21 02:08:29.730232 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:08:29.730549 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6', 'iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a9d20392-5e79-4e81-8258-a7f8aeef7ea6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-17'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:08:29.730668 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:08:29.900690 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e6385d11-3ff1-485d-9366-ea76d51c9fea tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 6.944s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:30.041140 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Attempting to attach volume 1f3c63df-64f7-45f8-b14f-f9937dc2bc12 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 02:08:30.042483 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] attach device xml: <disk type="block" device="disk">
May 21 02:08:30.042483 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:08:30.042483 np0000001127 nova-compute[98206]:   <alias name="ua-1f3c63df-64f7-45f8-b14f-f9937dc2bc12"/>
May 21 02:08:30.042483 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-7"/>
May 21 02:08:30.042483 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:08:30.042483 np0000001127 nova-compute[98206]:   <serial>1f3c63df-64f7-45f8-b14f-f9937dc2bc12</serial>
May 21 02:08:30.042483 np0000001127 nova-compute[98206]: </disk>
May 21 02:08:30.042483 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 02:08:30.115800 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-b6cb16d0-5de2-461b-8b74-ba91f628dda3 tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:08:30.135636 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:30.140496 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:30.162767 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:30.169173 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:30.191566 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:30.288896 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0032264950000353565 future=<Future at 0x71c07c2f8e00 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:30.288996 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:30.289098 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=2.0458099130000846 future=<Future at 0x71c07c776210 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:30.289167 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=2.0457259270001487 future=<Future at 0x71c07c776210 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:30.290009 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Emitting event <LifecycleEvent: 1779329295.285569, 609b1611-3b05-4b86-8bf3-85f16f199d80 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:08:30.290187 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] VM Stopped (Lifecycle Event)
May 21 02:08:30.430412 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:30.469602 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:30.472229 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:30.494103 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999677522000184 future=<Future at 0x71c05856d1f0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:30.494618 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:30.502348 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Instance destroyed successfully.
May 21 02:08:30.503235 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-b6cb16d0-5de2-461b-8b74-ba91f628dda3 tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Lazy-loading 'resources' on Instance uuid fcada4b6-3630-4322-b6ce-8812b0c4afe9 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:08:30.576607 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:08:30.579298 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:08:30.600226 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:08:30.600226 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:08:30.602958 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:08:30.602958 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:30.630404 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:30.634185 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:30.659497 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:30.659497 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:30.659497 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:30.659497 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:30.659497 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:30.659497 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:30.659497 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:30.659497 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:30.659497 np0000001127 nova-compute[98206]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:30.659497 np0000001127 nova-compute[98206]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:30.659497 np0000001127 nova-compute[98206]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12 (non-flash)
May 21 02:08:30.659497 np0000001127 nova-compute[98206]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12 (non-flash)
May 21 02:08:30.659497 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:30.659497 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:30.659497 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:08:30.661589 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:30.661589 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:30.661589 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:30.661589 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:30.661589 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:30.661589 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:30.661589 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:30.661589 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:30.661589 np0000001127 nova-compute[98206]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:30.661589 np0000001127 nova-compute[98206]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:30.661589 np0000001127 nova-compute[98206]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12 (non-flash)
May 21 02:08:30.661589 np0000001127 nova-compute[98206]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12 (non-flash)
May 21 02:08:30.661589 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:30.661589 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:30.661589 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:08:30.674048 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:30.674048 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:30.674048 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:30.674048 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:30.674048 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:30.674048 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:30.674048 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:30.674048 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:30.674048 np0000001127 nova-compute[98206]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:30.674048 np0000001127 nova-compute[98206]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:30.674048 np0000001127 nova-compute[98206]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12 (non-flash)
May 21 02:08:30.674048 np0000001127 nova-compute[98206]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12 (non-flash)
May 21 02:08:30.674048 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:30.674048 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:30.674048 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:08:30.674719 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:30.674719 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:30.674719 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:30.674719 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:30.674719 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:30.674719 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:30.674719 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:30.674719 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:30.674719 np0000001127 nova-compute[98206]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:30.674719 np0000001127 nova-compute[98206]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:30.674719 np0000001127 nova-compute[98206]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12 (non-flash)
May 21 02:08:30.674719 np0000001127 nova-compute[98206]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12 (non-flash)
May 21 02:08:30.674719 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:30.674719 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:30.674719 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:08:30.742046 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0, portal: 192.168.40.100,3260]
May 21 02:08:30.742046 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0, portal: 192.168.40.100,3260] successful.
May 21 02:08:30.742046 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:30.750408 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0, portal: 192.168.50.100,3260]
May 21 02:08:30.750408 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0, portal: 192.168.50.100,3260] successful.
May 21 02:08:30.750408 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:30.762229 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:30.771755 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:30.791159 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:30.791159 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:30.791159 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:30.791159 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:30.791159 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:30.791159 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:30.791159 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:30.791159 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:30.791159 np0000001127 nova-compute[98206]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:30.791159 np0000001127 nova-compute[98206]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:30.791159 np0000001127 nova-compute[98206]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12 (non-flash)
May 21 02:08:30.791159 np0000001127 nova-compute[98206]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12 (non-flash)
May 21 02:08:30.791159 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:30.791159 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:30.791159 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:30.791159 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:30.791159 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:08:30.792254 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:30.792254 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:30.792254 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:30.792254 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:30.792254 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:30.792254 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:30.792254 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:30.792254 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:30.792254 np0000001127 nova-compute[98206]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:30.792254 np0000001127 nova-compute[98206]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:30.792254 np0000001127 nova-compute[98206]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12 (non-flash)
May 21 02:08:30.792254 np0000001127 nova-compute[98206]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12 (non-flash)
May 21 02:08:30.792254 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:30.792254 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:30.792254 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:30.792254 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:30.792254 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:08:30.795075 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.250s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:08:30.795075 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:08:30.795209 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 609b1611-3b05-4b86-8bf3-85f16f199d80] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:08:30.796217 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] HCTL ('18', '-', '-', 0) found on session 132 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:08:30.796547 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:08:30.804117 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:30.804117 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:30.804117 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:30.804117 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:30.804117 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:30.804117 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:30.804117 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:30.804117 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:30.804117 np0000001127 nova-compute[98206]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:30.804117 np0000001127 nova-compute[98206]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:30.804117 np0000001127 nova-compute[98206]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12 (non-flash)
May 21 02:08:30.804117 np0000001127 nova-compute[98206]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12 (non-flash)
May 21 02:08:30.804117 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:30.804117 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:30.804117 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:30.804117 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:30.804117 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:08:30.804626 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:30.804626 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:30.804626 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:30.804626 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:30.804626 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:30.804626 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:30.804626 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:30.804626 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:30.804626 np0000001127 nova-compute[98206]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:30.804626 np0000001127 nova-compute[98206]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:30.804626 np0000001127 nova-compute[98206]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12 (non-flash)
May 21 02:08:30.804626 np0000001127 nova-compute[98206]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12 (non-flash)
May 21 02:08:30.804626 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:30.804626 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:30.804626 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:30.804626 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:30.804626 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:08:30.805098 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.261s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:08:30.805098 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:08:30.807091 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] HCTL ('19', '-', '-', 0) found on session 133 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:08:30.807091 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:08:30.816824 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Searching for a device in session 132 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:08:30.816824 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ad21d805-0f07-40f2-8238-8fa00d1142e0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:08:30.829119 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Searching for a device in session 133 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:08:30.829318 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ad21d805-0f07-40f2-8238-8fa00d1142e0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:08:30.834885 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cf8cdcdd-e439-4fb3-beb8-0fef5bbdf042 req-c2c8424c-da11-4b72-82e2-da5f80fc32cf service nova] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Received event network-vif-unplugged-963445f8-7e0f-4b25-a9a3-d18321b5271e {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:30.838055 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cf8cdcdd-e439-4fb3-beb8-0fef5bbdf042 req-c2c8424c-da11-4b72-82e2-da5f80fc32cf service nova] Acquiring lock "fcada4b6-3630-4322-b6ce-8812b0c4afe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:30.838055 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cf8cdcdd-e439-4fb3-beb8-0fef5bbdf042 req-c2c8424c-da11-4b72-82e2-da5f80fc32cf service nova] Lock "fcada4b6-3630-4322-b6ce-8812b0c4afe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:30.838055 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cf8cdcdd-e439-4fb3-beb8-0fef5bbdf042 req-c2c8424c-da11-4b72-82e2-da5f80fc32cf service nova] Lock "fcada4b6-3630-4322-b6ce-8812b0c4afe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:30.838838 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cf8cdcdd-e439-4fb3-beb8-0fef5bbdf042 req-c2c8424c-da11-4b72-82e2-da5f80fc32cf service nova] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] No waiting events found dispatching network-vif-unplugged-963445f8-7e0f-4b25-a9a3-d18321b5271e {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:08:30.840991 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cf8cdcdd-e439-4fb3-beb8-0fef5bbdf042 req-c2c8424c-da11-4b72-82e2-da5f80fc32cf service nova] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Received event network-vif-unplugged-963445f8-7e0f-4b25-a9a3-d18321b5271e for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:08:30.840991 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cf8cdcdd-e439-4fb3-beb8-0fef5bbdf042 req-c2c8424c-da11-4b72-82e2-da5f80fc32cf service nova] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Received event network-vif-unplugged-963445f8-7e0f-4b25-a9a3-d18321b5271e {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:30.840991 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cf8cdcdd-e439-4fb3-beb8-0fef5bbdf042 req-c2c8424c-da11-4b72-82e2-da5f80fc32cf service nova] Acquiring lock "fcada4b6-3630-4322-b6ce-8812b0c4afe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:30.841886 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cf8cdcdd-e439-4fb3-beb8-0fef5bbdf042 req-c2c8424c-da11-4b72-82e2-da5f80fc32cf service nova] Lock "fcada4b6-3630-4322-b6ce-8812b0c4afe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:30.841886 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cf8cdcdd-e439-4fb3-beb8-0fef5bbdf042 req-c2c8424c-da11-4b72-82e2-da5f80fc32cf service nova] Lock "fcada4b6-3630-4322-b6ce-8812b0c4afe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:30.841886 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cf8cdcdd-e439-4fb3-beb8-0fef5bbdf042 req-c2c8424c-da11-4b72-82e2-da5f80fc32cf service nova] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] No waiting events found dispatching network-vif-unplugged-963445f8-7e0f-4b25-a9a3-d18321b5271e {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:08:30.841886 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cf8cdcdd-e439-4fb3-beb8-0fef5bbdf042 req-c2c8424c-da11-4b72-82e2-da5f80fc32cf service nova] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Received event network-vif-unplugged-963445f8-7e0f-4b25-a9a3-d18321b5271e for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:08:30.881211 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:30.888760 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:30.919211 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:30.924586 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:31.008505 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-b6cb16d0-5de2-461b-8b74-ba91f628dda3 tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:08:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-485287003',display_name='tempest-VolumesNegativeTest-instance-485287003',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumesnegativetest-instance-485287003',id=60,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:08:28Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='97b0c9e6822548b0b76d6b5dd04a74dd',ramdisk_id='',reservation_id='r-v0w0vw0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1786760828',owner_user_name='tempest-VolumesNegativeTest-1786760828-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:08:28Z,user_data=None,user_id='f6a74c27fc7e4700b1a3643ac9061351',uuid=fcada4b6-3630-4322-b6ce-8812b0c4afe9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "963445f8-7e0f-4b25-a9a3-d18321b5271e", "address": "fa:16:3e:f0:95:44", "network": {"id": "80d2c5e9-dd42-4109-9563-9e1bc30c577a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e0576bdbcbdb4371809bfe8bd6fe7bb5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap963445f8-7e", "ovs_interfaceid": "963445f8-7e0f-4b25-a9a3-d18321b5271e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:08:31.008505 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-b6cb16d0-5de2-461b-8b74-ba91f628dda3 tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Converting VIF {"id": "963445f8-7e0f-4b25-a9a3-d18321b5271e", "address": "fa:16:3e:f0:95:44", "network": {"id": "80d2c5e9-dd42-4109-9563-9e1bc30c577a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e0576bdbcbdb4371809bfe8bd6fe7bb5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap963445f8-7e", "ovs_interfaceid": "963445f8-7e0f-4b25-a9a3-d18321b5271e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:08:31.008505 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-b6cb16d0-5de2-461b-8b74-ba91f628dda3 tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:95:44,bridge_name='br-int',has_traffic_filtering=True,id=963445f8-7e0f-4b25-a9a3-d18321b5271e,network=Network(80d2c5e9-dd42-4109-9563-9e1bc30c577a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963445f8-7e') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:08:31.009286 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-b6cb16d0-5de2-461b-8b74-ba91f628dda3 tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:95:44,bridge_name='br-int',has_traffic_filtering=True,id=963445f8-7e0f-4b25-a9a3-d18321b5271e,network=Network(80d2c5e9-dd42-4109-9563-9e1bc30c577a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963445f8-7e') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:08:31.010601 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:31.010601 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap963445f8-7e, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:31.013462 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:08:31.014099 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:31.014945 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:31.015077 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df47e569-dfd4-441b-92fe-1a9de44dec15) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:31.020844 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:08:31.023848 np0000001127 nova-compute[98206]: INFO os_vif [None req-b6cb16d0-5de2-461b-8b74-ba91f628dda3 tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:95:44,bridge_name='br-int',has_traffic_filtering=True,id=963445f8-7e0f-4b25-a9a3-d18321b5271e,network=Network(80d2c5e9-dd42-4109-9563-9e1bc30c577a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963445f8-7e')
May 21 02:08:31.024118 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-b6cb16d0-5de2-461b-8b74-ba91f628dda3 tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Deleting instance files /opt/stack/data/nova/instances/fcada4b6-3630-4322-b6ce-8812b0c4afe9_del
May 21 02:08:31.025631 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-b6cb16d0-5de2-461b-8b74-ba91f628dda3 tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Deletion of /opt/stack/data/nova/instances/fcada4b6-3630-4322-b6ce-8812b0c4afe9_del complete
May 21 02:08:31.064425 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:31.087886 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:31.404722 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-77a7c656-a268-4386-829e-2274742ac92b req-e89ee13d-f289-4c5c-ab55-c38ae0ffa5a8 service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Received event network-changed-ad1def3b-4657-4632-bd3a-910cdca9a1a4 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:31.404856 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-77a7c656-a268-4386-829e-2274742ac92b req-e89ee13d-f289-4c5c-ab55-c38ae0ffa5a8 service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Refreshing instance network info cache due to event network-changed-ad1def3b-4657-4632-bd3a-910cdca9a1a4. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:08:31.405084 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-77a7c656-a268-4386-829e-2274742ac92b req-e89ee13d-f289-4c5c-ab55-c38ae0ffa5a8 service nova] Acquiring lock "refresh_cache-c76064e6-3702-4e67-9d4f-ef67cd4b7b22" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:08:31.405418 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-77a7c656-a268-4386-829e-2274742ac92b req-e89ee13d-f289-4c5c-ab55-c38ae0ffa5a8 service nova] Acquired lock "refresh_cache-c76064e6-3702-4e67-9d4f-ef67cd4b7b22" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:08:31.405516 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-77a7c656-a268-4386-829e-2274742ac92b req-e89ee13d-f289-4c5c-ab55-c38ae0ffa5a8 service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Refreshing network info cache for port ad1def3b-4657-4632-bd3a-910cdca9a1a4 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:08:31.535994 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-b6cb16d0-5de2-461b-8b74-ba91f628dda3 tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Took 1.42 seconds to destroy the instance on the hypervisor.
May 21 02:08:31.536662 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-b6cb16d0-5de2-461b-8b74-ba91f628dda3 tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:08:31.537020 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:08:31.537140 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:08:31.537456 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:31.548210 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:08:31.659617 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:31.712087 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:08:31.712225 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:08:31.712261 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:08:31.712407 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] No VIF found with MAC fa:16:3e:f1:4d:aa, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:08:31.722865 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:31.907363 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-77a7c656-a268-4386-829e-2274742ac92b req-e89ee13d-f289-4c5c-ab55-c38ae0ffa5a8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:31.977623 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "fee00c99-3aa9-48fc-874c-f69035ce9219" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:31.978021 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "fee00c99-3aa9-48fc-874c-f69035ce9219" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:32.200252 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-77a7c656-a268-4386-829e-2274742ac92b req-e89ee13d-f289-4c5c-ab55-c38ae0ffa5a8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:32.335311 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.00028155400013929466 future=<Future at 0x71c07c776210 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:32.335489 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:32.335804 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Emitting event <LifecycleEvent: 1779329297.3348515, 9b4239c5-84df-4d87-a2d4-fb6192408f58 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:08:32.335910 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=13.157558129000336 future=<Future at 0x71c05856d1f0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:32.336963 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] VM Stopped (Lifecycle Event)
May 21 02:08:32.337038 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=13.156459352000184 future=<Future at 0x71c05856d1f0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:32.373032 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-77a7c656-a268-4386-829e-2274742ac92b req-e89ee13d-f289-4c5c-ab55-c38ae0ffa5a8 service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Updated VIF entry in instance network info cache for port ad1def3b-4657-4632-bd3a-910cdca9a1a4. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:08:32.373261 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-77a7c656-a268-4386-829e-2274742ac92b req-e89ee13d-f289-4c5c-ab55-c38ae0ffa5a8 service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Updating instance_info_cache with network_info: [{"id": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "address": "fa:16:3e:20:ae:96", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1def3b-46", "ovs_interfaceid": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:08:32.397968 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:08:32.482745 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:08:32.565379 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Found WWN 3300000006bd64122 for multipath device dm-11 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:08:32.566216 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:08:32.566590 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] <== connect_volume: return (5346ms) {'type': 'block', 'scsi_wwn': '3300000006bd64122', 'path': '/dev/dm-11', 'multipath_id': '3300000006bd64122'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:08:32.566993 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.836s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:08:32.567383 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006bd64122', 'path': '/dev/dm-11', 'multipath_id': '3300000006bd64122'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:08:32.567719 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6', 'iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a9d20392-5e79-4e81-8258-a7f8aeef7ea6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-17'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:08:32.567915 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:08:32.570140 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lazy-loading 'flavor' on Instance uuid 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:08:32.603789 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:32.603789 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:32.603789 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:32.603789 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:32.603789 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:32.603789 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:32.603789 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:32.603789 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:32.603789 np0000001127 nova-compute[98206]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:32.603789 np0000001127 nova-compute[98206]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:32.603789 np0000001127 nova-compute[98206]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12 (non-flash)
May 21 02:08:32.603789 np0000001127 nova-compute[98206]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12 (non-flash)
May 21 02:08:32.603789 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:32.603789 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:32.603789 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:32.603789 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:32.603789 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:08:32.604389 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:32.604389 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:32.604389 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:32.604389 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:32.604389 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:32.604389 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:32.604389 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:32.604389 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:32.604389 np0000001127 nova-compute[98206]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:32.604389 np0000001127 nova-compute[98206]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6 (non-flash)
May 21 02:08:32.604389 np0000001127 nova-compute[98206]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12 (non-flash)
May 21 02:08:32.604389 np0000001127 nova-compute[98206]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12 (non-flash)
May 21 02:08:32.604389 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:32.604389 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:32.604389 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:32.604389 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:32.604389 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:08:32.604389 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435', '115'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', '118'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', '119'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc', '123'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc', '124'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6', '125'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6', '126'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12', '130'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12', '131'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', '132'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', '133'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '95')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:08:32.604389 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6', '125')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:08:32.605673 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6', '126')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:08:32.607082 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c0584044a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6'): ({'sdp'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6'): ({'sdq'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:08:32.607368 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Removing multipathed devices sdq, sdp {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:08:32.607783 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Flush multipath device 3300000008fa7ce80 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:08:32.641831 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Remove SCSI device /dev/sdq with /sys/block/sdq/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:08:32.699273 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Remove SCSI device /dev/sdp with /sys/block/sdp/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:08:32.746159 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Checking to see if SCSI volumes sdq, sdp have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:08:32.746329 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] SCSI volumes sdq, sdp have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:08:32.747788 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Checking to see if device paths {'sdq', 'sdp'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:08:32.760328 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Device paths {'sdq', 'sdp'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:08:32.760504 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:08:32.776648 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:32.821817 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 125, target: iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6, portal: 192.168.40.100,3260]
May 21 02:08:32.821817 np0000001127 nova-compute[98206]: Logout of [sid: 125, target: iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6, portal: 192.168.40.100,3260] successful.
May 21 02:08:32.821817 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:32.838580 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-67fc8d82-3d4c-4147-a31a-0a839ebbb511 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 9b4239c5-84df-4d87-a2d4-fb6192408f58] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:08:32.847659 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:32.860649 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:32.874955 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-77a7c656-a268-4386-829e-2274742ac92b req-e89ee13d-f289-4c5c-ab55-c38ae0ffa5a8 service nova] Releasing lock "refresh_cache-c76064e6-3702-4e67-9d4f-ef67cd4b7b22" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:08:32.900054 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Took 1.36 seconds to deallocate network for instance.
May 21 02:08:32.906567 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 126, target: iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6, portal: 192.168.50.100,3260]
May 21 02:08:32.906567 np0000001127 nova-compute[98206]: Logout of [sid: 126, target: iqn.2023-03.storpool.com:os--volume-a9d20392-5e79-4e81-8258-a7f8aeef7ea6, portal: 192.168.50.100,3260] successful.
May 21 02:08:32.906567 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:32.919259 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-94f10f33-a7c5-4293-b03f-a934b200b0f4 req-263c0d1d-7861-402c-857d-ab9205419bb7 service nova] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Received event network-vif-plugged-963445f8-7e0f-4b25-a9a3-d18321b5271e {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:32.919721 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-94f10f33-a7c5-4293-b03f-a934b200b0f4 req-263c0d1d-7861-402c-857d-ab9205419bb7 service nova] Acquiring lock "fcada4b6-3630-4322-b6ce-8812b0c4afe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:32.919960 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-94f10f33-a7c5-4293-b03f-a934b200b0f4 req-263c0d1d-7861-402c-857d-ab9205419bb7 service nova] Lock "fcada4b6-3630-4322-b6ce-8812b0c4afe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:32.920143 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-94f10f33-a7c5-4293-b03f-a934b200b0f4 req-263c0d1d-7861-402c-857d-ab9205419bb7 service nova] Lock "fcada4b6-3630-4322-b6ce-8812b0c4afe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:32.920402 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-94f10f33-a7c5-4293-b03f-a934b200b0f4 req-263c0d1d-7861-402c-857d-ab9205419bb7 service nova] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] No waiting events found dispatching network-vif-plugged-963445f8-7e0f-4b25-a9a3-d18321b5271e {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:08:32.920602 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-94f10f33-a7c5-4293-b03f-a934b200b0f4 req-263c0d1d-7861-402c-857d-ab9205419bb7 service nova] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Received unexpected event network-vif-plugged-963445f8-7e0f-4b25-a9a3-d18321b5271e for instance with vm_state active and task_state deleting.
May 21 02:08:32.920784 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-94f10f33-a7c5-4293-b03f-a934b200b0f4 req-263c0d1d-7861-402c-857d-ab9205419bb7 service nova] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Received event network-vif-plugged-963445f8-7e0f-4b25-a9a3-d18321b5271e {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:32.920956 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-94f10f33-a7c5-4293-b03f-a934b200b0f4 req-263c0d1d-7861-402c-857d-ab9205419bb7 service nova] Acquiring lock "fcada4b6-3630-4322-b6ce-8812b0c4afe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:32.921132 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-94f10f33-a7c5-4293-b03f-a934b200b0f4 req-263c0d1d-7861-402c-857d-ab9205419bb7 service nova] Lock "fcada4b6-3630-4322-b6ce-8812b0c4afe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:32.921403 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-94f10f33-a7c5-4293-b03f-a934b200b0f4 req-263c0d1d-7861-402c-857d-ab9205419bb7 service nova] Lock "fcada4b6-3630-4322-b6ce-8812b0c4afe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:32.923273 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-94f10f33-a7c5-4293-b03f-a934b200b0f4 req-263c0d1d-7861-402c-857d-ab9205419bb7 service nova] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] No waiting events found dispatching network-vif-plugged-963445f8-7e0f-4b25-a9a3-d18321b5271e {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:08:32.923273 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-94f10f33-a7c5-4293-b03f-a934b200b0f4 req-263c0d1d-7861-402c-857d-ab9205419bb7 service nova] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Received unexpected event network-vif-plugged-963445f8-7e0f-4b25-a9a3-d18321b5271e for instance with vm_state active and task_state deleting.
May 21 02:08:32.923273 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-94f10f33-a7c5-4293-b03f-a934b200b0f4 req-263c0d1d-7861-402c-857d-ab9205419bb7 service nova] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Received event network-vif-unplugged-963445f8-7e0f-4b25-a9a3-d18321b5271e {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:32.923273 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-94f10f33-a7c5-4293-b03f-a934b200b0f4 req-263c0d1d-7861-402c-857d-ab9205419bb7 service nova] Acquiring lock "fcada4b6-3630-4322-b6ce-8812b0c4afe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:32.923273 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-94f10f33-a7c5-4293-b03f-a934b200b0f4 req-263c0d1d-7861-402c-857d-ab9205419bb7 service nova] Lock "fcada4b6-3630-4322-b6ce-8812b0c4afe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:32.923273 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-94f10f33-a7c5-4293-b03f-a934b200b0f4 req-263c0d1d-7861-402c-857d-ab9205419bb7 service nova] Lock "fcada4b6-3630-4322-b6ce-8812b0c4afe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:32.923273 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-94f10f33-a7c5-4293-b03f-a934b200b0f4 req-263c0d1d-7861-402c-857d-ab9205419bb7 service nova] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] No waiting events found dispatching network-vif-unplugged-963445f8-7e0f-4b25-a9a3-d18321b5271e {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:08:32.923273 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-94f10f33-a7c5-4293-b03f-a934b200b0f4 req-263c0d1d-7861-402c-857d-ab9205419bb7 service nova] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Received event network-vif-unplugged-963445f8-7e0f-4b25-a9a3-d18321b5271e for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:08:32.923273 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-94f10f33-a7c5-4293-b03f-a934b200b0f4 req-263c0d1d-7861-402c-857d-ab9205419bb7 service nova] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Received event network-vif-unplugged-963445f8-7e0f-4b25-a9a3-d18321b5271e {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:32.923273 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-94f10f33-a7c5-4293-b03f-a934b200b0f4 req-263c0d1d-7861-402c-857d-ab9205419bb7 service nova] Acquiring lock "fcada4b6-3630-4322-b6ce-8812b0c4afe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:32.923273 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-94f10f33-a7c5-4293-b03f-a934b200b0f4 req-263c0d1d-7861-402c-857d-ab9205419bb7 service nova] Lock "fcada4b6-3630-4322-b6ce-8812b0c4afe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:32.923710 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-94f10f33-a7c5-4293-b03f-a934b200b0f4 req-263c0d1d-7861-402c-857d-ab9205419bb7 service nova] Lock "fcada4b6-3630-4322-b6ce-8812b0c4afe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:32.923710 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-94f10f33-a7c5-4293-b03f-a934b200b0f4 req-263c0d1d-7861-402c-857d-ab9205419bb7 service nova] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] No waiting events found dispatching network-vif-unplugged-963445f8-7e0f-4b25-a9a3-d18321b5271e {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:08:32.924653 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-94f10f33-a7c5-4293-b03f-a934b200b0f4 req-263c0d1d-7861-402c-857d-ab9205419bb7 service nova] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Received event network-vif-unplugged-963445f8-7e0f-4b25-a9a3-d18321b5271e for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:08:32.935832 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:32.936119 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:08:32.936275 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] <== disconnect_volume: return (3205ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:08:32.936429 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:08:33.039880 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:33.039880 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:33.045356 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:08:33.045626 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Claim successful on node np0000001127
May 21 02:08:33.073605 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Attempting to attach volume ad21d805-0f07-40f2-8238-8fa00d1142e0 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 02:08:33.076911 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] attach device xml: <disk type="block" device="disk">
May 21 02:08:33.076911 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:08:33.076911 np0000001127 nova-compute[98206]:   <alias name="ua-ad21d805-0f07-40f2-8238-8fa00d1142e0"/>
May 21 02:08:33.076911 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-11"/>
May 21 02:08:33.076911 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:08:33.076911 np0000001127 nova-compute[98206]:   <serial>ad21d805-0f07-40f2-8238-8fa00d1142e0</serial>
May 21 02:08:33.076911 np0000001127 nova-compute[98206]: </disk>
May 21 02:08:33.076911 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 02:08:33.267009 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-346395f9-3a18-405f-ac25-30fc408a8ead tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "511701d6-fac9-4e15-803d-e9038bd1a018" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.554s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:33.409898 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b6cb16d0-5de2-461b-8b74-ba91f628dda3 tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:33.465720 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6f231021-7e13-4dc1-96ac-e47ca7e31e50 req-48005b94-b897-400a-8818-da9904fe6c38 service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Received event network-changed-2b286fbf-a6fe-4dcc-af12-2521cf154dbb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:33.465720 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6f231021-7e13-4dc1-96ac-e47ca7e31e50 req-48005b94-b897-400a-8818-da9904fe6c38 service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Refreshing instance network info cache due to event network-changed-2b286fbf-a6fe-4dcc-af12-2521cf154dbb. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:08:33.465720 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6f231021-7e13-4dc1-96ac-e47ca7e31e50 req-48005b94-b897-400a-8818-da9904fe6c38 service nova] Acquiring lock "refresh_cache-aa3f5a78-fb82-4e21-8ebf-90bf48a122be" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:08:33.465720 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6f231021-7e13-4dc1-96ac-e47ca7e31e50 req-48005b94-b897-400a-8818-da9904fe6c38 service nova] Acquired lock "refresh_cache-aa3f5a78-fb82-4e21-8ebf-90bf48a122be" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:08:33.465720 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-6f231021-7e13-4dc1-96ac-e47ca7e31e50 req-48005b94-b897-400a-8818-da9904fe6c38 service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Refreshing network info cache for port 2b286fbf-a6fe-4dcc-af12-2521cf154dbb {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:08:33.490972 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lazy-loading 'flavor' on Instance uuid 2b990342-3aef-4ea5-a3bb-c776f4dd8567 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:08:33.762011 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "511701d6-fac9-4e15-803d-e9038bd1a018" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:33.762156 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "511701d6-fac9-4e15-803d-e9038bd1a018" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:33.969802 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-6f231021-7e13-4dc1-96ac-e47ca7e31e50 req-48005b94-b897-400a-8818-da9904fe6c38 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:34.268042 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Detaching volume 1f3c63df-64f7-45f8-b14f-f9937dc2bc12
May 21 02:08:34.332165 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Attempting to driver detach volume 1f3c63df-64f7-45f8-b14f-f9937dc2bc12 from mountpoint /dev/vdb
May 21 02:08:34.343231 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Found disk vdb by alias ua-1f3c63df-64f7-45f8-b14f-f9937dc2bc12 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:08:34.345271 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Found disk vdb by alias ua-1f3c63df-64f7-45f8-b14f-f9937dc2bc12 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:08:34.345337 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Attempting to detach device vdb from instance 511701d6-fac9-4e15-803d-e9038bd1a018 from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 02:08:34.347049 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:08:34.347049 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:08:34.347049 np0000001127 nova-compute[98206]:   <alias name="ua-1f3c63df-64f7-45f8-b14f-f9937dc2bc12"/>
May 21 02:08:34.347049 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-7"/>
May 21 02:08:34.347049 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:08:34.347049 np0000001127 nova-compute[98206]:   <serial>1f3c63df-64f7-45f8-b14f-f9937dc2bc12</serial>
May 21 02:08:34.347049 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:08:34.347049 np0000001127 nova-compute[98206]: </disk>
May 21 02:08:34.347049 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:08:34.354162 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Successfully detached device vdb from instance 511701d6-fac9-4e15-803d-e9038bd1a018 from the persistent domain config.
May 21 02:08:34.354344 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] (1/8): Attempting to detach device vdb with device alias ua-1f3c63df-64f7-45f8-b14f-f9937dc2bc12 from instance 511701d6-fac9-4e15-803d-e9038bd1a018 from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 02:08:34.354670 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:08:34.354670 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:08:34.354670 np0000001127 nova-compute[98206]:   <alias name="ua-1f3c63df-64f7-45f8-b14f-f9937dc2bc12"/>
May 21 02:08:34.354670 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-7"/>
May 21 02:08:34.354670 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:08:34.354670 np0000001127 nova-compute[98206]:   <serial>1f3c63df-64f7-45f8-b14f-f9937dc2bc12</serial>
May 21 02:08:34.354670 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:08:34.354670 np0000001127 nova-compute[98206]: </disk>
May 21 02:08:34.354670 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:08:34.426495 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-6f231021-7e13-4dc1-96ac-e47ca7e31e50 req-48005b94-b897-400a-8818-da9904fe6c38 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:34.498666 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bfec4f0b-2bf6-4cf9-9285-f9f7f2e63eb4 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "2b990342-3aef-4ea5-a3bb-c776f4dd8567" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.209s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:34.591837 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-6f231021-7e13-4dc1-96ac-e47ca7e31e50 req-48005b94-b897-400a-8818-da9904fe6c38 service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Updated VIF entry in instance network info cache for port 2b286fbf-a6fe-4dcc-af12-2521cf154dbb. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:08:34.595026 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-6f231021-7e13-4dc1-96ac-e47ca7e31e50 req-48005b94-b897-400a-8818-da9904fe6c38 service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Updating instance_info_cache with network_info: [{"id": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "address": "fa:16:3e:db:08:dd", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b286fbf-a6", "ovs_interfaceid": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:08:34.730750 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:08:34.733488 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:08:34.733488 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:08:34.733488 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] No VIF found with MAC fa:16:3e:b8:d1:01, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:08:34.827168 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-55ad27ea-9639-4c55-9266-b42f28a9dff3 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Acquiring lock "2b990342-3aef-4ea5-a3bb-c776f4dd8567" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:34.827615 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-55ad27ea-9639-4c55-9266-b42f28a9dff3 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "2b990342-3aef-4ea5-a3bb-c776f4dd8567" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:34.827997 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-55ad27ea-9639-4c55-9266-b42f28a9dff3 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Acquiring lock "2b990342-3aef-4ea5-a3bb-c776f4dd8567-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:34.828254 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-55ad27ea-9639-4c55-9266-b42f28a9dff3 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "2b990342-3aef-4ea5-a3bb-c776f4dd8567-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:34.829560 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-55ad27ea-9639-4c55-9266-b42f28a9dff3 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "2b990342-3aef-4ea5-a3bb-c776f4dd8567-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:34.836496 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-55ad27ea-9639-4c55-9266-b42f28a9dff3 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Terminating instance
May 21 02:08:34.876930 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:08:34.877120 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:08:34.880669 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:34.897124 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779329314.8967369, 511701d6-fac9-4e15-803d-e9038bd1a018 => ua-1f3c63df-64f7-45f8-b14f-f9937dc2bc12> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 02:08:34.898418 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-1f3c63df-64f7-45f8-b14f-f9937dc2bc12 for instance 511701d6-fac9-4e15-803d-e9038bd1a018 {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 02:08:34.901399 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Successfully detached device vdb from instance 511701d6-fac9-4e15-803d-e9038bd1a018 from the live domain config.
May 21 02:08:34.903056 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:08:34.903324 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12', 'iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1f3c63df-64f7-45f8-b14f-f9937dc2bc12', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:08:34.903597 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:08:34.903951 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:08:34.904192 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12', 'iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1f3c63df-64f7-45f8-b14f-f9937dc2bc12', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:08:34.904320 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:08:34.937855 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:34.937855 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:34.937855 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:34.937855 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:34.937855 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:34.937855 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:34.937855 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:34.937855 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:34.937855 np0000001127 nova-compute[98206]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12 (non-flash)
May 21 02:08:34.937855 np0000001127 nova-compute[98206]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12 (non-flash)
May 21 02:08:34.937855 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:34.937855 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:34.937855 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:34.937855 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:34.937855 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:08:34.938243 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:34.938243 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:34.938243 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:34.938243 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:34.938243 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:34.938243 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:34.938243 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:34.938243 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:34.938243 np0000001127 nova-compute[98206]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12 (non-flash)
May 21 02:08:34.938243 np0000001127 nova-compute[98206]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12 (non-flash)
May 21 02:08:34.938243 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:34.938243 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:34.938243 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:34.938243 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:34.938243 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:08:34.938243 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435', '115'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', '118'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', '119'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc', '123'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc', '124'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12', '130'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12', '131'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', '132'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', '133'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '95')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:08:34.938243 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12', '130')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:08:34.940250 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12', '131')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:08:34.940343 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c2fc680>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12'): ({'sdi'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:08:34.940537 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Removing multipathed devices sdi, sdh {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:08:34.940760 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Flush multipath device 3300000000eca3263 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:08:34.975053 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:08:35.026115 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:08:35.064965 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:08:35.065083 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:08:35.066438 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:08:35.079854 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:08:35.080001 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:08:35.095072 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:35.097545 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6f231021-7e13-4dc1-96ac-e47ca7e31e50 req-48005b94-b897-400a-8818-da9904fe6c38 service nova] Releasing lock "refresh_cache-aa3f5a78-fb82-4e21-8ebf-90bf48a122be" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:08:35.097723 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6f231021-7e13-4dc1-96ac-e47ca7e31e50 req-48005b94-b897-400a-8818-da9904fe6c38 service nova] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Received event network-vif-deleted-963445f8-7e0f-4b25-a9a3-d18321b5271e {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:35.142882 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 130, target: iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12, portal: 192.168.40.100,3260]
May 21 02:08:35.142882 np0000001127 nova-compute[98206]: Logout of [sid: 130, target: iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12, portal: 192.168.40.100,3260] successful.
May 21 02:08:35.142882 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:35.164997 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:35.179241 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:35.225717 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 131, target: iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12, portal: 192.168.50.100,3260]
May 21 02:08:35.225717 np0000001127 nova-compute[98206]: Logout of [sid: 131, target: iqn.2023-03.storpool.com:os--volume-1f3c63df-64f7-45f8-b14f-f9937dc2bc12, portal: 192.168.50.100,3260] successful.
May 21 02:08:35.225717 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:35.250659 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:35.250659 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:08:35.250659 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] <== disconnect_volume: return (344ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:08:35.250659 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:08:35.352956 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-55ad27ea-9639-4c55-9266-b42f28a9dff3 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:08:35.375596 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:35.380341 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:08:35.387581 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:35.407131 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:35.410759 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:35.438934 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:35.439760 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:35.613548 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e1759185-39af-4441-abd3-9104b8cbebe5 req-29bcce55-0bf6-4405-b5ca-d20d2fa7b0a6 service nova] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Received event network-vif-unplugged-41d7cad8-3b46-47b2-b205-65f7607047cd {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:35.616708 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e1759185-39af-4441-abd3-9104b8cbebe5 req-29bcce55-0bf6-4405-b5ca-d20d2fa7b0a6 service nova] Acquiring lock "2b990342-3aef-4ea5-a3bb-c776f4dd8567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:35.616708 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e1759185-39af-4441-abd3-9104b8cbebe5 req-29bcce55-0bf6-4405-b5ca-d20d2fa7b0a6 service nova] Lock "2b990342-3aef-4ea5-a3bb-c776f4dd8567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:35.616708 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e1759185-39af-4441-abd3-9104b8cbebe5 req-29bcce55-0bf6-4405-b5ca-d20d2fa7b0a6 service nova] Lock "2b990342-3aef-4ea5-a3bb-c776f4dd8567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:35.616708 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e1759185-39af-4441-abd3-9104b8cbebe5 req-29bcce55-0bf6-4405-b5ca-d20d2fa7b0a6 service nova] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] No waiting events found dispatching network-vif-unplugged-41d7cad8-3b46-47b2-b205-65f7607047cd {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:08:35.616708 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e1759185-39af-4441-abd3-9104b8cbebe5 req-29bcce55-0bf6-4405-b5ca-d20d2fa7b0a6 service nova] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Received event network-vif-unplugged-41d7cad8-3b46-47b2-b205-65f7607047cd for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:08:35.714158 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999688662999688 future=<Future at 0x71c05822e4e0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:35.716320 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Instance destroyed successfully.
May 21 02:08:35.717101 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-55ad27ea-9639-4c55-9266-b42f28a9dff3 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lazy-loading 'resources' on Instance uuid 2b990342-3aef-4ea5-a3bb-c776f4dd8567 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:08:35.822555 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lazy-loading 'flavor' on Instance uuid 511701d6-fac9-4e15-803d-e9038bd1a018 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:08:35.889822 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.850s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:35.891022 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b6cb16d0-5de2-461b-8b74-ba91f628dda3 tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.480s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:35.891733 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:08:36.016984 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:36.220978 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-55ad27ea-9639-4c55-9266-b42f28a9dff3 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:07:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-573454998',display_name='tempest-VolumesBackupsTest-instance-573454998',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumesbackupstest-instance-573454998',id=55,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODTnrSfYlLjY+V7nraFwENpg5bQmjf0ijpUgRoewNQoF/FmZb9TUmvTjvT4s5ueJQ8sxHWmnMHawqz0E2O5zNIwl/VaAW+AZ8vdztbc6KTcfPaU4IZa2Z6AOZ7nUXJufg==',key_name='tempest-keypair-1875128130',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:07:16Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='549d365926ce49efa4c4bf50c7bbbbaa',ramdisk_id='',reservation_id='r-wudu8130',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-958095449',owner_user_name='tempest-VolumesBackupsTest-958095449-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:07:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09298d250fae40f1adea3cae800dd569',uuid=2b990342-3aef-4ea5-a3bb-c776f4dd8567,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41d7cad8-3b46-47b2-b205-65f7607047cd", "address": "fa:16:3e:ce:d8:84", "network": {"id": "b32cfb32-7b1e-4cc7-b35b-a86447f00a8a", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-397130825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "549d365926ce49efa4c4bf50c7bbbbaa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d7cad8-3b", "ovs_interfaceid": "41d7cad8-3b46-47b2-b205-65f7607047cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:08:36.221961 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-55ad27ea-9639-4c55-9266-b42f28a9dff3 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Converting VIF {"id": "41d7cad8-3b46-47b2-b205-65f7607047cd", "address": "fa:16:3e:ce:d8:84", "network": {"id": "b32cfb32-7b1e-4cc7-b35b-a86447f00a8a", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-397130825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "549d365926ce49efa4c4bf50c7bbbbaa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d7cad8-3b", "ovs_interfaceid": "41d7cad8-3b46-47b2-b205-65f7607047cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:08:36.225793 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-55ad27ea-9639-4c55-9266-b42f28a9dff3 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:d8:84,bridge_name='br-int',has_traffic_filtering=True,id=41d7cad8-3b46-47b2-b205-65f7607047cd,network=Network(b32cfb32-7b1e-4cc7-b35b-a86447f00a8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d7cad8-3b') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:08:36.226103 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-55ad27ea-9639-4c55-9266-b42f28a9dff3 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:d8:84,bridge_name='br-int',has_traffic_filtering=True,id=41d7cad8-3b46-47b2-b205-65f7607047cd,network=Network(b32cfb32-7b1e-4cc7-b35b-a86447f00a8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d7cad8-3b') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:08:36.227123 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:36.227374 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41d7cad8-3b, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:36.229603 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:08:36.230760 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:36.230925 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=67e4e551-8088-4218-bb2a-1a00262391f9) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:36.232351 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:08:36.236176 np0000001127 nova-compute[98206]: INFO os_vif [None req-55ad27ea-9639-4c55-9266-b42f28a9dff3 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:d8:84,bridge_name='br-int',has_traffic_filtering=True,id=41d7cad8-3b46-47b2-b205-65f7607047cd,network=Network(b32cfb32-7b1e-4cc7-b35b-a86447f00a8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d7cad8-3b')
May 21 02:08:36.236532 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-55ad27ea-9639-4c55-9266-b42f28a9dff3 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Deleting instance files /opt/stack/data/nova/instances/2b990342-3aef-4ea5-a3bb-c776f4dd8567_del
May 21 02:08:36.237689 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-55ad27ea-9639-4c55-9266-b42f28a9dff3 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Deletion of /opt/stack/data/nova/instances/2b990342-3aef-4ea5-a3bb-c776f4dd8567_del complete
May 21 02:08:36.309388 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3ace5bd5-13f3-40b3-9d8b-5cd0957baeba tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.881s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:36.400142 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:08:36.401235 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:08:36.401623 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:36.401935 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:36.506774 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4878b5a5bf184852a9ce383caa1c67a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ebdb16aee84e22a88dfc8960debd32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:08:36.661124 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b6cb16d0-5de2-461b-8b74-ba91f628dda3 tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:08:36.661392 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-b6cb16d0-5de2-461b-8b74-ba91f628dda3 tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:08:36.726248 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:36.743843 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-55ad27ea-9639-4c55-9266-b42f28a9dff3 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Took 1.39 seconds to destroy the instance on the hypervisor.
May 21 02:08:36.744441 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-55ad27ea-9639-4c55-9266-b42f28a9dff3 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:08:36.744879 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:08:36.745156 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:08:36.745585 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:36.828915 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f6d72f91-40d3-4632-813a-31d77fba0810 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "511701d6-fac9-4e15-803d-e9038bd1a018" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.067s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:36.857871 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:36.904561 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:08:36.915091 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:36.915091 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:37.034298 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Successfully created port: b752adc4-968b-4fd5-9374-5e01373120a9 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:08:37.089463 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e9db5ac1-971e-4c26-9092-bff315d0ad60 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "511701d6-fac9-4e15-803d-e9038bd1a018" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:37.089463 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e9db5ac1-971e-4c26-9092-bff315d0ad60 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "511701d6-fac9-4e15-803d-e9038bd1a018" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:37.089463 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e9db5ac1-971e-4c26-9092-bff315d0ad60 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "511701d6-fac9-4e15-803d-e9038bd1a018-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:37.089463 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e9db5ac1-971e-4c26-9092-bff315d0ad60 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "511701d6-fac9-4e15-803d-e9038bd1a018-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:37.089463 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e9db5ac1-971e-4c26-9092-bff315d0ad60 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "511701d6-fac9-4e15-803d-e9038bd1a018-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:37.093777 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-e9db5ac1-971e-4c26-9092-bff315d0ad60 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Terminating instance
May 21 02:08:37.151404 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:37.164827 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-b6cb16d0-5de2-461b-8b74-ba91f628dda3 tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:08:37.407315 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:08:37.421236 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lazy-loading 'flavor' on Instance uuid 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:08:37.427920 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-49ec50ad-ead8-4341-b39a-c60e3b82ea4c req-4b3ab0cd-514a-4ac4-b627-a9bb1624a7e9 service nova] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Received event network-vif-deleted-41d7cad8-3b46-47b2-b205-65f7607047cd {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:37.428086 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-49ec50ad-ead8-4341-b39a-c60e3b82ea4c req-4b3ab0cd-514a-4ac4-b627-a9bb1624a7e9 service nova] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Neutron deleted interface 41d7cad8-3b46-47b2-b205-65f7607047cd; detaching it from the instance and deleting it from the info cache
May 21 02:08:37.430076 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-49ec50ad-ead8-4341-b39a-c60e3b82ea4c req-4b3ab0cd-514a-4ac4-b627-a9bb1624a7e9 service nova] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:08:37.597897 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e9db5ac1-971e-4c26-9092-bff315d0ad60 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:08:37.621359 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:37.621359 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:37.646025 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:37.648266 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:37.669529 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:37.672326 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b6cb16d0-5de2-461b-8b74-ba91f628dda3 tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.782s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:37.679610 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:37.700724 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-448dc3a5-5c7a-4e65-9dc1-f98ff51679db req-fd1f2ff2-5ac3-443f-a866-b32c261db53f service nova] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Received event network-vif-unplugged-41d7cad8-3b46-47b2-b205-65f7607047cd {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:37.700809 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-448dc3a5-5c7a-4e65-9dc1-f98ff51679db req-fd1f2ff2-5ac3-443f-a866-b32c261db53f service nova] Acquiring lock "2b990342-3aef-4ea5-a3bb-c776f4dd8567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:37.701192 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-448dc3a5-5c7a-4e65-9dc1-f98ff51679db req-fd1f2ff2-5ac3-443f-a866-b32c261db53f service nova] Lock "2b990342-3aef-4ea5-a3bb-c776f4dd8567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:37.701192 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-448dc3a5-5c7a-4e65-9dc1-f98ff51679db req-fd1f2ff2-5ac3-443f-a866-b32c261db53f service nova] Lock "2b990342-3aef-4ea5-a3bb-c776f4dd8567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:37.701321 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-448dc3a5-5c7a-4e65-9dc1-f98ff51679db req-fd1f2ff2-5ac3-443f-a866-b32c261db53f service nova] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] No waiting events found dispatching network-vif-unplugged-41d7cad8-3b46-47b2-b205-65f7607047cd {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:08:37.701400 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-448dc3a5-5c7a-4e65-9dc1-f98ff51679db req-fd1f2ff2-5ac3-443f-a866-b32c261db53f service nova] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Received event network-vif-unplugged-41d7cad8-3b46-47b2-b205-65f7607047cd for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:08:37.749219 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-b6cb16d0-5de2-461b-8b74-ba91f628dda3 tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Deleted allocations for instance fcada4b6-3630-4322-b6ce-8812b0c4afe9
May 21 02:08:37.840994 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Successfully updated port: b752adc4-968b-4fd5-9374-5e01373120a9 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:08:37.863070 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:08:37.912390 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Booting with volume snapshot a8e08497-0d9d-490b-9acd-be68128fcf83 at /dev/vda
May 21 02:08:37.939985 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-49ec50ad-ead8-4341-b39a-c60e3b82ea4c req-4b3ab0cd-514a-4ac4-b627-a9bb1624a7e9 service nova] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Detach interface failed, port_id=41d7cad8-3b46-47b2-b205-65f7607047cd, reason: Instance 2b990342-3aef-4ea5-a3bb-c776f4dd8567 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:08:37.959357 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999700895999922 future=<Future at 0x71c058489eb0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:37.962392 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Instance destroyed successfully.
May 21 02:08:37.963013 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-e9db5ac1-971e-4c26-9092-bff315d0ad60 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lazy-loading 'resources' on Instance uuid 511701d6-fac9-4e15-803d-e9038bd1a018 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:08:38.343264 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "refresh_cache-fee00c99-3aa9-48fc-874c-f69035ce9219" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:08:38.343693 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquired lock "refresh_cache-fee00c99-3aa9-48fc-874c-f69035ce9219" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:08:38.343693 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:08:38.364777 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Took 1.62 seconds to deallocate network for instance.
May 21 02:08:38.428071 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:38.465692 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-e9db5ac1-971e-4c26-9092-bff315d0ad60 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:07:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-633693387',display_name='tempest-AttachVolumeNegativeTest-server-633693387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumenegativetest-server-633693387',id=58,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOoCw0Zi77bKdndf5WZQCRJ6dWaw0wB41CkSLSd22Qv0NCJuBgyD1E1zWuXKCIOu8rDsohVs0s11sVOxRvbV62QPPLtEwSnZxU+jAtDWPZ7XU41nujVouIK92WtHxPZBQg==',key_name='tempest-keypair-528619947',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:07:43Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d3efe4046d6a442d91b3463e2d99fd7b',ramdisk_id='',reservation_id='r-qk2ywb7j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1208856611',owner_user_name='tempest-AttachVolumeNegativeTest-1208856611-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:07:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f369771db7dd49da85131c9692833a5a',uuid=511701d6-fac9-4e15-803d-e9038bd1a018,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c6901ce-3b6b-4fd0-8d6f-48252edbae1a", "address": "fa:16:3e:f1:4d:aa", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c6901ce-3b", "ovs_interfaceid": "1c6901ce-3b6b-4fd0-8d6f-48252edbae1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:08:38.466073 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-e9db5ac1-971e-4c26-9092-bff315d0ad60 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Converting VIF {"id": "1c6901ce-3b6b-4fd0-8d6f-48252edbae1a", "address": "fa:16:3e:f1:4d:aa", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c6901ce-3b", "ovs_interfaceid": "1c6901ce-3b6b-4fd0-8d6f-48252edbae1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:08:38.466276 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-e9db5ac1-971e-4c26-9092-bff315d0ad60 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:4d:aa,bridge_name='br-int',has_traffic_filtering=True,id=1c6901ce-3b6b-4fd0-8d6f-48252edbae1a,network=Network(f683b2da-ab41-43e1-a9bb-98914089b4d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c6901ce-3b') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:08:38.466502 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-e9db5ac1-971e-4c26-9092-bff315d0ad60 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:4d:aa,bridge_name='br-int',has_traffic_filtering=True,id=1c6901ce-3b6b-4fd0-8d6f-48252edbae1a,network=Network(f683b2da-ab41-43e1-a9bb-98914089b4d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c6901ce-3b') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:08:38.468806 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:38.468806 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c6901ce-3b, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:38.471222 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:38.472972 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:08:38.473602 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:38.473782 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2b98531b-af90-41fe-9df7-d65129b8273e) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:38.474565 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:38.475283 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:38.475283 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:08:38.476051 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:38.477242 np0000001127 nova-compute[98206]: INFO os_vif [None req-e9db5ac1-971e-4c26-9092-bff315d0ad60 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:4d:aa,bridge_name='br-int',has_traffic_filtering=True,id=1c6901ce-3b6b-4fd0-8d6f-48252edbae1a,network=Network(f683b2da-ab41-43e1-a9bb-98914089b4d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c6901ce-3b')
May 21 02:08:38.477518 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-e9db5ac1-971e-4c26-9092-bff315d0ad60 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Deleting instance files /opt/stack/data/nova/instances/511701d6-fac9-4e15-803d-e9038bd1a018_del
May 21 02:08:38.478177 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-e9db5ac1-971e-4c26-9092-bff315d0ad60 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Deletion of /opt/stack/data/nova/instances/511701d6-fac9-4e15-803d-e9038bd1a018_del complete
May 21 02:08:38.758760 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b6cb16d0-5de2-461b-8b74-ba91f628dda3 tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Lock "fcada4b6-3630-4322-b6ce-8812b0c4afe9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.149s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:38.870030 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-55ad27ea-9639-4c55-9266-b42f28a9dff3 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:38.870817 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-55ad27ea-9639-4c55-9266-b42f28a9dff3 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:38.944649 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:08:38.987626 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-e9db5ac1-971e-4c26-9092-bff315d0ad60 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Took 1.39 seconds to destroy the instance on the hypervisor.
May 21 02:08:38.988507 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-e9db5ac1-971e-4c26-9092-bff315d0ad60 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:08:38.988968 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:08:38.988968 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:08:38.989096 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:39.083220 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:39.187504 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:39.393257 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Updating instance_info_cache with network_info: [{"id": "b752adc4-968b-4fd5-9374-5e01373120a9", "address": "fa:16:3e:2d:a4:3e", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb752adc4-96", "ovs_interfaceid": "b752adc4-968b-4fd5-9374-5e01373120a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:08:39.501722 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-afe46562-a8ba-4172-9250-aab22265a750 req-68476a86-0452-458e-aee6-b1cdc3b71cf4 service nova] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Received event network-vif-unplugged-1c6901ce-3b6b-4fd0-8d6f-48252edbae1a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:39.501872 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-afe46562-a8ba-4172-9250-aab22265a750 req-68476a86-0452-458e-aee6-b1cdc3b71cf4 service nova] Acquiring lock "511701d6-fac9-4e15-803d-e9038bd1a018-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:39.502033 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-afe46562-a8ba-4172-9250-aab22265a750 req-68476a86-0452-458e-aee6-b1cdc3b71cf4 service nova] Lock "511701d6-fac9-4e15-803d-e9038bd1a018-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:39.502142 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-afe46562-a8ba-4172-9250-aab22265a750 req-68476a86-0452-458e-aee6-b1cdc3b71cf4 service nova] Lock "511701d6-fac9-4e15-803d-e9038bd1a018-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:39.502283 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-afe46562-a8ba-4172-9250-aab22265a750 req-68476a86-0452-458e-aee6-b1cdc3b71cf4 service nova] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] No waiting events found dispatching network-vif-unplugged-1c6901ce-3b6b-4fd0-8d6f-48252edbae1a {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:08:39.502390 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-afe46562-a8ba-4172-9250-aab22265a750 req-68476a86-0452-458e-aee6-b1cdc3b71cf4 service nova] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Received event network-vif-unplugged-1c6901ce-3b6b-4fd0-8d6f-48252edbae1a for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:08:39.502510 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-afe46562-a8ba-4172-9250-aab22265a750 req-68476a86-0452-458e-aee6-b1cdc3b71cf4 service nova] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Received event network-vif-unplugged-1c6901ce-3b6b-4fd0-8d6f-48252edbae1a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:39.502641 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-afe46562-a8ba-4172-9250-aab22265a750 req-68476a86-0452-458e-aee6-b1cdc3b71cf4 service nova] Acquiring lock "511701d6-fac9-4e15-803d-e9038bd1a018-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:39.502769 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-afe46562-a8ba-4172-9250-aab22265a750 req-68476a86-0452-458e-aee6-b1cdc3b71cf4 service nova] Lock "511701d6-fac9-4e15-803d-e9038bd1a018-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:39.502871 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-afe46562-a8ba-4172-9250-aab22265a750 req-68476a86-0452-458e-aee6-b1cdc3b71cf4 service nova] Lock "511701d6-fac9-4e15-803d-e9038bd1a018-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:39.502977 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-afe46562-a8ba-4172-9250-aab22265a750 req-68476a86-0452-458e-aee6-b1cdc3b71cf4 service nova] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] No waiting events found dispatching network-vif-unplugged-1c6901ce-3b6b-4fd0-8d6f-48252edbae1a {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:08:39.503075 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-afe46562-a8ba-4172-9250-aab22265a750 req-68476a86-0452-458e-aee6-b1cdc3b71cf4 service nova] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Received event network-vif-unplugged-1c6901ce-3b6b-4fd0-8d6f-48252edbae1a for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:08:39.554511 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:39.554874 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:39.554944 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Attaching volume cb424a76-1c22-49d9-a6a1-638c98c702b7 to /dev/vdc
May 21 02:08:39.611687 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:08:39.636645 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:08:39.664482 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-36211851-bb8a-4a8d-abc5-c7b418b045db req-fc64c67d-c914-4251-8137-73dff3d2d69d service nova] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Received event network-vif-deleted-1c6901ce-3b6b-4fd0-8d6f-48252edbae1a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:39.665944 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-36211851-bb8a-4a8d-abc5-c7b418b045db req-fc64c67d-c914-4251-8137-73dff3d2d69d service nova] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Neutron deleted interface 1c6901ce-3b6b-4fd0-8d6f-48252edbae1a; detaching it from the instance and deleting it from the info cache
May 21 02:08:39.666143 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-36211851-bb8a-4a8d-abc5-c7b418b045db req-fc64c67d-c914-4251-8137-73dff3d2d69d service nova] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:08:39.669027 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:39.707621 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-55ad27ea-9639-4c55-9266-b42f28a9dff3 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:08:39.707689 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-55ad27ea-9639-4c55-9266-b42f28a9dff3 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:08:39.732116 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:08:39.732328 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:08:39.744102 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:08:39.745591 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe0f:28a1', 'fe80::440a:38ff:fe27:fa24', 'fe80::fc16:3eff:fefb:4d96', 'fe80::fc16:3eff:fe68:a810', 'fe80::3cc0:a4ff:feab:836e', 'fe80::fc16:3eff:fe65:6557', 'fe80::fc16:3eff:fef5:8ead', 'fe80::fc16:3eff:fe20:ae96', 'fe80::fc16:3eff:feb8:d101', 'fe80::7045:30ff:fe1a:b99f', 'fe80::fc16:3eff:fed6:68cb', 'fe80::fc16:3eff:fedb:8dd'] 
May 21 02:08:39.745749 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:08:39.745893 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:08:39.746177 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:08:39.746550 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Updating existing volume attachment record: 4c18a62a-d9a4-42ea-90ec-30fbdbb4a9e5 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:08:39.772311 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-37b2b063-9f52-4cff-8c3d-2784b2b52ab1 req-d90eaae3-4944-457d-8f57-aa9d02e773dd service nova] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Received event network-changed-b752adc4-968b-4fd5-9374-5e01373120a9 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:39.772541 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-37b2b063-9f52-4cff-8c3d-2784b2b52ab1 req-d90eaae3-4944-457d-8f57-aa9d02e773dd service nova] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Refreshing instance network info cache due to event network-changed-b752adc4-968b-4fd5-9374-5e01373120a9. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:08:39.772714 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-37b2b063-9f52-4cff-8c3d-2784b2b52ab1 req-d90eaae3-4944-457d-8f57-aa9d02e773dd service nova] Acquiring lock "refresh_cache-fee00c99-3aa9-48fc-874c-f69035ce9219" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:08:39.897948 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Releasing lock "refresh_cache-fee00c99-3aa9-48fc-874c-f69035ce9219" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:08:39.897948 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Instance network_info: |[{"id": "b752adc4-968b-4fd5-9374-5e01373120a9", "address": "fa:16:3e:2d:a4:3e", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb752adc4-96", "ovs_interfaceid": "b752adc4-968b-4fd5-9374-5e01373120a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:08:39.898226 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-37b2b063-9f52-4cff-8c3d-2784b2b52ab1 req-d90eaae3-4944-457d-8f57-aa9d02e773dd service nova] Acquired lock "refresh_cache-fee00c99-3aa9-48fc-874c-f69035ce9219" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:08:39.898418 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-37b2b063-9f52-4cff-8c3d-2784b2b52ab1 req-d90eaae3-4944-457d-8f57-aa9d02e773dd service nova] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Refreshing network info cache for port b752adc4-968b-4fd5-9374-5e01373120a9 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:08:40.113584 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:08:40.203826 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-36211851-bb8a-4a8d-abc5-c7b418b045db req-fc64c67d-c914-4251-8137-73dff3d2d69d service nova] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Detach interface failed, port_id=1c6901ce-3b6b-4fd0-8d6f-48252edbae1a, reason: Instance 511701d6-fac9-4e15-803d-e9038bd1a018 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:08:40.214103 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-55ad27ea-9639-4c55-9266-b42f28a9dff3 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:08:40.354155 np0000001127 nova-compute[98206]: DEBUG os_brick.encryptors [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cb424a76-1c22-49d9-a6a1-638c98c702b7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed', 'attached_at': '', 'detached_at': '', 'volume_id': 'cb424a76-1c22-49d9-a6a1-638c98c702b7', 'serial': 'cb424a76-1c22-49d9-a6a1-638c98c702b7'} {{(pid=98206) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 21 02:08:40.356047 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:08:40.356484 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cb424a76-1c22-49d9-a6a1-638c98c702b7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:08:40.356676 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:08:40.357061 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:08:40.357248 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cb424a76-1c22-49d9-a6a1-638c98c702b7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:08:40.369464 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:08:40.370124 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:08:40.370808 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:08:40.371006 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:08:40.371524 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:08:40.371755 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:08:40.384495 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:08:40.384495 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:40.390022 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:08:40.390022 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:40.397630 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7] added
May 21 02:08:40.397630 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:08:40.397630 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:08:40.397630 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:08:40.397630 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:08:40.397630 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:08:40.397630 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:40.398180 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:08:40.399055 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0269(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:08:40.399055 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:08:40.400576 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-37b2b063-9f52-4cff-8c3d-2784b2b52ab1 req-d90eaae3-4944-457d-8f57-aa9d02e773dd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:40.402723 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7] added
May 21 02:08:40.402723 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:08:40.402723 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:08:40.402723 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:08:40.402723 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:08:40.402723 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:08:40.402723 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:40.402956 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:08:40.403113 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0313(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:08:40.403337 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:08:40.627114 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Took 1.64 seconds to deallocate network for instance.
May 21 02:08:40.720585 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-55ad27ea-9639-4c55-9266-b42f28a9dff3 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.850s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:40.752268 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-37b2b063-9f52-4cff-8c3d-2784b2b52ab1 req-d90eaae3-4944-457d-8f57-aa9d02e773dd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:40.814692 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-55ad27ea-9639-4c55-9266-b42f28a9dff3 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Deleted allocations for instance 2b990342-3aef-4ea5-a3bb-c776f4dd8567
May 21 02:08:40.897801 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:40.932763 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-37b2b063-9f52-4cff-8c3d-2784b2b52ab1 req-d90eaae3-4944-457d-8f57-aa9d02e773dd service nova] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Updated VIF entry in instance network info cache for port b752adc4-968b-4fd5-9374-5e01373120a9. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:08:40.933118 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-37b2b063-9f52-4cff-8c3d-2784b2b52ab1 req-d90eaae3-4944-457d-8f57-aa9d02e773dd service nova] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Updating instance_info_cache with network_info: [{"id": "b752adc4-968b-4fd5-9374-5e01373120a9", "address": "fa:16:3e:2d:a4:3e", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb752adc4-96", "ovs_interfaceid": "b752adc4-968b-4fd5-9374-5e01373120a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:08:41.137428 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e9db5ac1-971e-4c26-9092-bff315d0ad60 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:41.137609 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e9db5ac1-971e-4c26-9092-bff315d0ad60 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:41.398973 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:08:41.403729 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:08:41.411788 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:08:41.411788 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:08:41.419147 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:08:41.419147 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:41.426832 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:41.435936 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:41.440833 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-37b2b063-9f52-4cff-8c3d-2784b2b52ab1 req-d90eaae3-4944-457d-8f57-aa9d02e773dd service nova] Releasing lock "refresh_cache-fee00c99-3aa9-48fc-874c-f69035ce9219" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:08:41.446271 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:41.446271 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:41.446271 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:41.446271 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:41.446271 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:41.446271 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:41.446271 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:41.446271 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:41.446271 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:41.446271 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:41.446271 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:41.446271 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:41.446271 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:08:41.446271 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:41.446271 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:41.446271 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:41.446271 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:41.446271 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:41.446271 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:41.446271 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:41.446271 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:41.446271 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:41.446271 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:41.446271 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:41.446271 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:41.446271 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:08:41.450208 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:08:41.461110 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:41.461110 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:41.461110 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:41.461110 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:41.461110 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:41.461110 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:41.461110 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:41.461110 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:41.461110 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:41.461110 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:41.461110 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:41.461110 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:41.461110 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:08:41.461626 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:41.461626 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:41.461626 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:41.461626 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:41.461626 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:41.461626 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:41.461626 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:41.461626 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:41.461626 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:41.461626 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:41.461626 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:41.461626 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:41.461626 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:08:41.470772 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:08:41.498898 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:41.522801 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7, portal: 192.168.40.100,3260]
May 21 02:08:41.522801 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7, portal: 192.168.40.100,3260] successful.
May 21 02:08:41.522801 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:41.526777 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7, portal: 192.168.50.100,3260]
May 21 02:08:41.526777 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7, portal: 192.168.50.100,3260] successful.
May 21 02:08:41.526777 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:41.540964 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:41.548875 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:08:41.548875 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:08:41.550960 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:41.560756 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:08:41.563726 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe0f:28a1', 'fe80::440a:38ff:fe27:fa24', 'fe80::fc16:3eff:fefb:4d96', 'fe80::fc16:3eff:fe68:a810', 'fe80::3cc0:a4ff:feab:836e', 'fe80::fc16:3eff:fe65:6557', 'fe80::fc16:3eff:fef5:8ead', 'fe80::fc16:3eff:fe20:ae96', 'fe80::fc16:3eff:feb8:d101', 'fe80::7045:30ff:fe1a:b99f', 'fe80::fc16:3eff:fed6:68cb', 'fe80::fc16:3eff:fedb:8dd'] 
May 21 02:08:41.563726 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:08:41.563726 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:08:41.563726 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:08:41.563726 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Updating existing volume attachment record: bcaf5f77-1c0a-4072-bd18-613107f46b60 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:08:41.568553 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:41.568553 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:41.568553 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:41.568553 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:41.568553 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:41.568553 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:41.568553 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:41.568553 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:41.568553 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:41.568553 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:41.568553 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:41.568553 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:41.568553 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:41.568553 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:41.568553 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:08:41.569688 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:41.569688 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:41.569688 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:41.569688 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:41.569688 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:41.569688 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:41.569688 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:41.569688 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:41.569688 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:41.569688 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:41.569688 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:41.569688 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:41.569688 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:41.569688 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:41.569688 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:08:41.570845 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.199s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:08:41.570845 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:08:41.572508 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] HCTL ('14', '-', '-', 0) found on session 135 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:08:41.573016 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:08:41.579151 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:41.579151 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:41.579151 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:41.579151 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:41.579151 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:41.579151 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:41.579151 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:41.579151 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:41.579151 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:41.579151 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:41.579151 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:41.579151 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:41.579151 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:41.579151 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:41.579151 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:08:41.579605 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:41.579605 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:41.579605 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:41.579605 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:41.579605 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:41.579605 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:41.579605 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:41.579605 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:41.579605 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:41.579605 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:41.579605 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:41.579605 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:41.579605 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:41.579605 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:41.579605 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:08:41.579605 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.209s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:08:41.580053 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:08:41.585004 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] HCTL ('13', '-', '-', 0) found on session 134 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:08:41.585157 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:08:41.595794 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Searching for a device in session 135 and hctl ['14', '*', '*', 0] yield: sdh {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:08:41.595794 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cb424a76-1c22-49d9-a6a1-638c98c702b7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:08:41.605405 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Searching for a device in session 134 and hctl ['13', '*', '*', 0] yield: None {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:08:41.733068 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:41.824053 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-55ad27ea-9639-4c55-9266-b42f28a9dff3 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "2b990342-3aef-4ea5-a3bb-c776f4dd8567" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.996s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:41.827515 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e9db5ac1-971e-4c26-9092-bff315d0ad60 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:08:41.827763 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-e9db5ac1-971e-4c26-9092-bff315d0ad60 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:08:42.330639 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-e9db5ac1-971e-4c26-9092-bff315d0ad60 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:08:42.606130 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Searching for a device in session 134 and hctl ['13', '*', '*', 0] yield: sdi {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:08:42.606647 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'cb424a76-1c22-49d9-a6a1-638c98c702b7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:08:42.838412 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e9db5ac1-971e-4c26-9092-bff315d0ad60 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.700s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:42.872337 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:42.902719 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-e9db5ac1-971e-4c26-9092-bff315d0ad60 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Deleted allocations for instance 511701d6-fac9-4e15-803d-e9038bd1a018
May 21 02:08:43.392453 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Found WWN 3300000004d8c0e31 for multipath device dm-7 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:08:43.392453 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:08:43.392453 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '3300000004d8c0e31', 'path': '/dev/disk/by-id/os-brick+dev+dm-7', 'multipath_id': '3300000004d8c0e31'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:08:43.392453 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004d8c0e31', 'path': '/dev/disk/by-id/os-brick+dev+dm-7', 'multipath_id': '3300000004d8c0e31'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:08:43.393282 np0000001127 nova-compute[98206]: WARNING stevedore.named [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 21 02:08:43.393762 np0000001127 nova-compute[98206]: WARNING castellan.key_manager [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 21 02:08:43.393762 np0000001127 nova-compute[98206]: WARNING nova.keymgr.conf_key_mgr [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 21 02:08:43.416072 np0000001127 nova-compute[98206]: WARNING os_brick.encryptors.luks [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 21 02:08:43.416583 np0000001127 nova-compute[98206]: WARNING stevedore.named [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 21 02:08:43.416800 np0000001127 nova-compute[98206]: WARNING castellan.key_manager [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 21 02:08:43.416967 np0000001127 nova-compute[98206]: WARNING nova.keymgr.conf_key_mgr [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 21 02:08:43.417573 np0000001127 nova-compute[98206]: DEBUG os_brick.encryptors [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x71c058462270>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cb424a76-1c22-49d9-a6a1-638c98c702b7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-7'}, 'status': 'reserved', 'instance': '6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed', 'attached_at': '', 'detached_at': '', 'volume_id': 'cb424a76-1c22-49d9-a6a1-638c98c702b7', 'serial': 'cb424a76-1c22-49d9-a6a1-638c98c702b7'} {{(pid=98206) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 21 02:08:43.417726 np0000001127 nova-compute[98206]: DEBUG os_brick.encryptors.luks [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] formatting encrypted volume /dev/dm-7 {{(pid=98206) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 21 02:08:43.475451 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:43.745660 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:08:43.747016 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:08:43.752303 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Creating image(s)
May 21 02:08:43.752303 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Did not create local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 21 02:08:43.752303 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Ensure instance console log exists: /opt/stack/data/nova/instances/fee00c99-3aa9-48fc-874c-f69035ce9219/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:08:43.752303 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:43.752303 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:43.752303 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:43.752303 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Start _get_guest_xml network_info=[{"id": "b752adc4-968b-4fd5-9374-5e01373120a9", "address": "fa:16:3e:2d:a4:3e", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb752adc4-96", "ovs_interfaceid": "b752adc4-968b-4fd5-9374-5e01373120a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a', 'iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9916d0d0-81d9-4d75-85e6-0193172abe8a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'fee00c99-3aa9-48fc-874c-f69035ce9219', 'attached_at': '', 'detached_at': '', 'volume_id': '9916d0d0-81d9-4d75-85e6-0193172abe8a', 'serial': '9916d0d0-81d9-4d75-85e6-0193172abe8a'}, 'delete_on_termination': True, 'attachment_id': 'bcaf5f77-1c0a-4072-bd18-613107f46b60', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:08:43.758365 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:08:43.759769 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1847986399', uuid='fee00c99-3aa9-48fc-874c-f69035ce9219'), owner=OwnerMeta(userid='4878b5a5bf184852a9ce383caa1c67a4', username='tempest-TestVolumeBootPattern-1995806391-project-member', projectid='62ebdb16aee84e22a88dfc8960debd32', projectname='tempest-TestVolumeBootPattern-1995806391'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b752adc4-968b-4fd5-9374-5e01373120a9", "address": "fa:16:3e:2d:a4:3e", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb752adc4-96", "ovs_interfaceid": "b752adc4-968b-4fd5-9374-5e01373120a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329323.759376) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:08:43.762021 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:08:43.762762 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:08:43.763605 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:08:43.763605 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:08:43.764574 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:08:43.764911 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:08:43.765076 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:08:43.765191 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:08:43.765349 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:08:43.765461 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:08:43.765596 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:08:43.765785 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:08:43.765916 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:08:43.766052 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:08:43.766181 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:08:43.766333 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:08:43.780315 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:08:43.780701 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a', 'iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9916d0d0-81d9-4d75-85e6-0193172abe8a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:08:43.780901 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:08:43.781492 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:08:43.781737 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a', 'iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9916d0d0-81d9-4d75-85e6-0193172abe8a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:08:43.797121 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:08:43.797959 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:08:43.799846 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:08:43.800412 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:08:43.800760 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:08:43.801001 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:08:43.820221 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:08:43.820221 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:43.828005 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:08:43.828005 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:43.839010 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a] added
May 21 02:08:43.839010 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:08:43.839010 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:08:43.839010 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:08:43.839010 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:08:43.839010 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:08:43.839010 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:43.839010 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:08:43.839010 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0355(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:08:43.839010 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:08:43.841563 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a] added
May 21 02:08:43.841563 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:08:43.841563 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:08:43.841563 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:08:43.841563 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:08:43.841563 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:08:43.841563 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:43.842518 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:08:43.842518 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0419(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:08:43.842518 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:08:43.913884 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e9db5ac1-971e-4c26-9092-bff315d0ad60 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "511701d6-fac9-4e15-803d-e9038bd1a018" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.826s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:44.626132 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Acquiring lock "e897b981-cb4b-48b1-a9fe-23c447993d1e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:44.626294 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "e897b981-cb4b-48b1-a9fe-23c447993d1e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:44.626462 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Acquiring lock "e897b981-cb4b-48b1-a9fe-23c447993d1e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:44.626599 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "e897b981-cb4b-48b1-a9fe-23c447993d1e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:44.626710 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "e897b981-cb4b-48b1-a9fe-23c447993d1e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:44.630632 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Terminating instance
May 21 02:08:44.837703 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:08:44.842717 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:08:44.853439 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:08:44.853439 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:08:44.862663 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:08:44.862663 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:44.876832 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:44.882552 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:44.899595 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:44.899595 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:44.899595 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:44.899595 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:44.899595 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:44.899595 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:44.899595 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:44.899595 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:44.899595 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:44.899595 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:44.899595 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:44.899595 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:44.899595 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:44.899595 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:44.899595 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:08:44.900379 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:44.900379 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:44.900379 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:44.900379 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:44.900379 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:44.900379 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:44.900379 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:44.900379 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:44.900379 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:44.900379 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:44.900379 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:44.900379 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:44.900379 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:44.900379 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:44.900379 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:08:44.912148 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:44.912148 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:44.912148 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:44.912148 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:44.912148 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:44.912148 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:44.912148 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:44.912148 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:44.912148 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:44.912148 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:44.912148 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:44.912148 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:44.912148 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:44.912148 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:44.912148 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:08:44.912803 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:44.912803 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:44.912803 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:44.912803 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:44.912803 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:44.912803 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:44.912803 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:44.912803 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:44.912803 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:44.912803 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:44.912803 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:44.912803 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:44.912803 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:44.912803 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:44.912803 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:08:44.964681 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a, portal: 192.168.50.100,3260]
May 21 02:08:44.964681 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a, portal: 192.168.50.100,3260] successful.
May 21 02:08:44.964681 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:44.972991 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a, portal: 192.168.40.100,3260]
May 21 02:08:44.972991 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a, portal: 192.168.40.100,3260] successful.
May 21 02:08:44.972991 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:44.981692 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:44.989996 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:45.015570 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:45.015570 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:45.015570 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:45.015570 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:45.015570 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:45.015570 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:45.015570 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:45.015570 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:45.015570 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:45.015570 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:45.015570 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:45.015570 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:45.015570 np0000001127 nova-compute[98206]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a (non-flash)
May 21 02:08:45.015570 np0000001127 nova-compute[98206]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a (non-flash)
May 21 02:08:45.015570 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:45.015570 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:45.015570 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:08:45.015570 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:45.015570 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:45.015570 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:45.015570 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:45.015570 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:45.015570 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:45.015570 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:45.015570 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:45.015570 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:45.015570 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:45.015570 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:45.015570 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:45.015570 np0000001127 nova-compute[98206]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a (non-flash)
May 21 02:08:45.015570 np0000001127 nova-compute[98206]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a (non-flash)
May 21 02:08:45.015570 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:45.015570 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:45.015570 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:08:45.015570 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.212s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:08:45.015570 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:08:45.015570 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] HCTL ('21', '-', '-', 0) found on session 136 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:08:45.018741 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Scanning host 21 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:08:45.019649 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:45.019649 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:45.019649 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:45.019649 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:45.019649 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:45.019649 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:45.019649 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:45.019649 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:45.019649 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:45.019649 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:45.019649 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:45.019649 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:45.019649 np0000001127 nova-compute[98206]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a (non-flash)
May 21 02:08:45.019649 np0000001127 nova-compute[98206]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a (non-flash)
May 21 02:08:45.019649 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:45.019649 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:45.019649 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:08:45.020742 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:45.020742 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:45.020742 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:45.020742 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:45.020742 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:45.020742 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:45.020742 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:45.020742 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:45.020742 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:45.020742 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:45.020742 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:45.020742 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:45.020742 np0000001127 nova-compute[98206]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a (non-flash)
May 21 02:08:45.020742 np0000001127 nova-compute[98206]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a (non-flash)
May 21 02:08:45.020742 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:45.020742 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:45.020742 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:08:45.020742 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.222s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:08:45.020742 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:08:45.022870 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] HCTL ('22', '-', '-', 0) found on session 137 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:08:45.023046 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Scanning host 22 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:08:45.039185 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching for a device in session 136 and hctl ['21', '*', '*', 0] yield: sdp {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:08:45.039185 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9916d0d0-81d9-4d75-85e6-0193172abe8a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:08:45.051147 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching for a device in session 137 and hctl ['22', '*', '*', 0] yield: sdq {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:08:45.051974 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to sdq using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9916d0d0-81d9-4d75-85e6-0193172abe8a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:08:45.133686 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:08:45.170407 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:45.176095 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:45.215972 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:45.363856 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:45.370210 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:45.445098 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:45.456421 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:45.472587 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999657243999991 future=<Future at 0x71c058463e90 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:45.475164 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Instance destroyed successfully.
May 21 02:08:45.476481 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lazy-loading 'resources' on Instance uuid e897b981-cb4b-48b1-a9fe-23c447993d1e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:08:45.495936 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0024170940000658447 future=<Future at 0x71c05856d1f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:45.496037 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:45.496133 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=5.2170745630000965 future=<Future at 0x71c05822e4e0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:45.496190 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=5.216995356000098 future=<Future at 0x71c05822e4e0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:45.496831 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] Emitting event <LifecycleEvent: 1779329310.493406, fcada4b6-3630-4322-b6ce-8812b0c4afe9 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:08:45.497127 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] VM Stopped (Lifecycle Event)
May 21 02:08:45.801275 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:08:45.979364 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:07:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-2090104866',display_name='tempest-TestVolumeBootPatternV346-server-2090104866',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpatternv346-server-2090104866',id=59,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpEt4Io3GsQloI3uWy+Fcwyidj5RUQCIS+FO+jXfWfF/jddRfJilIb8g7iwC6UjJIdIQAzwExNMeXVn61OQ/jD5FDPzE2iYyuHTIBhS95owiCL689x29AX8Ud66JK9RFw==',key_name='tempest-keypair-1022747730',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:08:05Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89e0ea7da0f244aab58f9da579e53864',ramdisk_id='',reservation_id='r-6b0g2p98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-1354384974',owner_user_name='tempest-TestVolumeBootPatternV346-1354384974-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:08:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0083b33595414e5e8a3a80e7fea274ba',uuid=e897b981-cb4b-48b1-a9fe-23c447993d1e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd", "address": "fa:16:3e:d6:68:cb", "network": {"id": "460fd532-ef54-4f63-922b-b9d9f73f665f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1504169250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89e0ea7da0f244aab58f9da579e53864", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b5a2fb-d0", "ovs_interfaceid": "f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:08:45.979924 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Converting VIF {"id": "f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd", "address": "fa:16:3e:d6:68:cb", "network": {"id": "460fd532-ef54-4f63-922b-b9d9f73f665f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1504169250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89e0ea7da0f244aab58f9da579e53864", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b5a2fb-d0", "ovs_interfaceid": "f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:08:45.984043 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:68:cb,bridge_name='br-int',has_traffic_filtering=True,id=f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd,network=Network(460fd532-ef54-4f63-922b-b9d9f73f665f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6b5a2fb-d0') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:08:45.984381 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:68:cb,bridge_name='br-int',has_traffic_filtering=True,id=f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd,network=Network(460fd532-ef54-4f63-922b-b9d9f73f665f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6b5a2fb-d0') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:08:45.986425 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:45.986632 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6b5a2fb-d0, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:45.987534 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:45.988683 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:08:45.989732 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:45.990570 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:45.990815 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=425729c9-b3e6-4a95-977a-2d3fe4ca40a5) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:45.991423 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:45.991643 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:08:45.992145 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:45.995673 np0000001127 nova-compute[98206]: INFO os_vif [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:68:cb,bridge_name='br-int',has_traffic_filtering=True,id=f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd,network=Network(460fd532-ef54-4f63-922b-b9d9f73f665f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6b5a2fb-d0')
May 21 02:08:45.998956 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:08:45.998956 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc', 'iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '65b64e18-a66f-4a0a-a898-df73bbdf8fdc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:08:45.998956 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:08:46.000518 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d54bb252-b352-410c-94ac-dea3820df534 tempest-TestStampPattern-1911932868 tempest-TestStampPattern-1911932868-project-member] [instance: fcada4b6-3630-4322-b6ce-8812b0c4afe9] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:08:46.736233 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:46.825060 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Found WWN 33000000094d019b4 for multipath device dm-12 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:08:46.825402 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.044s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:08:46.825592 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] <== connect_volume: return (3044ms) {'type': 'block', 'scsi_wwn': '33000000094d019b4', 'path': '/dev/dm-12', 'multipath_id': '33000000094d019b4'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:08:46.825717 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000094d019b4', 'path': '/dev/dm-12', 'multipath_id': '33000000094d019b4'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:08:46.826923 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.830s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:08:46.827096 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc', 'iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '65b64e18-a66f-4a0a-a898-df73bbdf8fdc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:08:46.827543 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:08:46.869713 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:46.869713 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:46.869713 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:46.869713 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:46.869713 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:46.869713 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:46.869713 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:46.869713 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:46.869713 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:46.869713 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:46.869713 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:46.869713 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:46.869713 np0000001127 nova-compute[98206]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a (non-flash)
May 21 02:08:46.869713 np0000001127 nova-compute[98206]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a (non-flash)
May 21 02:08:46.869713 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:46.869713 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:46.869713 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:08:46.870187 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:46.870187 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:46.870187 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:46.870187 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:46.870187 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:46.870187 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:46.870187 np0000001127 nova-compute[98206]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:46.870187 np0000001127 nova-compute[98206]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc (non-flash)
May 21 02:08:46.870187 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:46.870187 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:46.870187 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:46.870187 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:46.870187 np0000001127 nova-compute[98206]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a (non-flash)
May 21 02:08:46.870187 np0000001127 nova-compute[98206]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a (non-flash)
May 21 02:08:46.870187 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:46.870187 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:46.870187 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:08:46.870187 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435', '115'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', '118'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', '119'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc', '123'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc', '124'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', '132'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', '133'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', '134'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', '135'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a', '136'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a', '137'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '95')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:08:46.870749 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc', '124')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:08:46.872333 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc', '123')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:08:46.873849 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c73f1a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc'): ({'sdo'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc'): ({'sdl'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:08:46.874088 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Removing multipathed devices sdo, sdl {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:08:46.874321 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Flush multipath device 3300000003f954a95 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:08:46.927889 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:08:46.978949 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:08:47.021391 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Checking to see if SCSI volumes sdo, sdl have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:08:47.021741 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] SCSI volumes sdo, sdl have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:08:47.023934 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Checking to see if device paths {'sdo', 'sdl'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:08:47.036025 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Device paths {'sdo', 'sdl'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:08:47.036323 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:08:47.050062 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:47.095764 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 124, target: iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc, portal: 192.168.40.100,3260]
May 21 02:08:47.095764 np0000001127 nova-compute[98206]: Logout of [sid: 124, target: iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc, portal: 192.168.40.100,3260] successful.
May 21 02:08:47.095764 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:47.126043 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:47.140269 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:47.185992 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 123, target: iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc, portal: 192.168.50.100,3260]
May 21 02:08:47.185992 np0000001127 nova-compute[98206]: Logout of [sid: 123, target: iqn.2023-03.storpool.com:os--volume-65b64e18-a66f-4a0a-a898-df73bbdf8fdc, portal: 192.168.50.100,3260] successful.
May 21 02:08:47.185992 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:47.209768 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:47.209986 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:08:47.210102 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] <== disconnect_volume: return (1213ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:08:47.210255 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:08:47.210539 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Deleting instance files /opt/stack/data/nova/instances/e897b981-cb4b-48b1-a9fe-23c447993d1e_del
May 21 02:08:47.211061 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Deletion of /opt/stack/data/nova/instances/e897b981-cb4b-48b1-a9fe-23c447993d1e_del complete
May 21 02:08:47.332119 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:08:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1847986399',display_name='tempest-TestVolumeBootPattern-server-1847986399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpattern-server-1847986399',id=61,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62ebdb16aee84e22a88dfc8960debd32',ramdisk_id='',reservation_id='r-ip26pged',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1995806391',owner_user_name='tempest-TestVolumeBootPattern-1995806391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:08:37Z,user_data=None,user_id='4878b5a5bf184852a9ce383caa1c67a4',uuid=fee00c99-3aa9-48fc-874c-f69035ce9219,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b752adc4-968b-4fd5-9374-5e01373120a9", "address": "fa:16:3e:2d:a4:3e", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb752adc4-96", "ovs_interfaceid": "b752adc4-968b-4fd5-9374-5e01373120a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:08:47.332405 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converting VIF {"id": "b752adc4-968b-4fd5-9374-5e01373120a9", "address": "fa:16:3e:2d:a4:3e", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb752adc4-96", "ovs_interfaceid": "b752adc4-968b-4fd5-9374-5e01373120a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:08:47.332892 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:a4:3e,bridge_name='br-int',has_traffic_filtering=True,id=b752adc4-968b-4fd5-9374-5e01373120a9,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb752adc4-96') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:08:47.333746 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lazy-loading 'pci_devices' on Instance uuid fee00c99-3aa9-48fc-874c-f69035ce9219 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:08:47.386289 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "0d5857fd-c96f-444b-ac06-634d1c81a32a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:47.386558 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "0d5857fd-c96f-444b-ac06-634d1c81a32a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:47.543039 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Secret XML: <secret ephemeral="no" private="no">
May 21 02:08:47.543039 np0000001127 nova-compute[98206]:   <usage type="volume">
May 21 02:08:47.543039 np0000001127 nova-compute[98206]:     <volume>cb424a76-1c22-49d9-a6a1-638c98c702b7</volume>
May 21 02:08:47.543039 np0000001127 nova-compute[98206]:   </usage>
May 21 02:08:47.543039 np0000001127 nova-compute[98206]: </secret>
May 21 02:08:47.543039 np0000001127 nova-compute[98206]:  {{(pid=98206) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 21 02:08:47.557320 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lazy-loading 'flavor' on Instance uuid 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:08:47.720290 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Took 2.59 seconds to destroy the instance on the hypervisor.
May 21 02:08:47.721859 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:08:47.722159 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:08:47.722328 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:08:47.723142 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:47.783239 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:47.836664 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] End _get_guest_xml xml=<domain type="qemu">
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:   <uuid>fee00c99-3aa9-48fc-874c-f69035ce9219</uuid>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:   <name>instance-0000003d</name>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:       <nova:name>tempest-TestVolumeBootPattern-server-1847986399</nova:name>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:08:43</nova:creationTime>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:       <nova:image uuid="">
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:         <nova:user uuid="4878b5a5bf184852a9ce383caa1c67a4">tempest-TestVolumeBootPattern-1995806391-project-member</nova:user>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:         <nova:project uuid="62ebdb16aee84e22a88dfc8960debd32">tempest-TestVolumeBootPattern-1995806391</nova:project>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:       <nova:root type="volume" uuid=""/>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:         <nova:port uuid="b752adc4-968b-4fd5-9374-5e01373120a9">
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:     <system>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:       <entry name="serial">fee00c99-3aa9-48fc-874c-f69035ce9219</entry>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:       <entry name="uuid">fee00c99-3aa9-48fc-874c-f69035ce9219</entry>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:     </system>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:   <os>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:   </os>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:   <features>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:   </features>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:   <devices>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/fee00c99-3aa9-48fc-874c-f69035ce9219/disk.config"/>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:     </disk>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:       <alias name="ua-9916d0d0-81d9-4d75-85e6-0193172abe8a"/>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-12"/>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:       <serial>9916d0d0-81d9-4d75-85e6-0193172abe8a</serial>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:     </disk>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:2d:a4:3e"/>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:       <target dev="tapb752adc4-96"/>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:     </interface>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/fee00c99-3aa9-48fc-874c-f69035ce9219/console.log" append="off"/>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:     </serial>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:     <video>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:     </video>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:     </rng>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:   </devices>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]: </domain>
May 21 02:08:47.836664 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:08:47.839423 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Preparing to wait for external event network-vif-plugged-b752adc4-968b-4fd5-9374-5e01373120a9 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:08:47.839423 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "fee00c99-3aa9-48fc-874c-f69035ce9219-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:47.839423 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "fee00c99-3aa9-48fc-874c-f69035ce9219-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:47.839423 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "fee00c99-3aa9-48fc-874c-f69035ce9219-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:47.839423 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:08:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1847986399',display_name='tempest-TestVolumeBootPattern-server-1847986399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpattern-server-1847986399',id=61,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62ebdb16aee84e22a88dfc8960debd32',ramdisk_id='',reservation_id='r-ip26pged',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1995806391',owner_user_name='tempest-TestVolumeBootPattern-1995806391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:08:37Z,user_data=None,user_id='4878b5a5bf184852a9ce383caa1c67a4',uuid=fee00c99-3aa9-48fc-874c-f69035ce9219,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b752adc4-968b-4fd5-9374-5e01373120a9", "address": "fa:16:3e:2d:a4:3e", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb752adc4-96", "ovs_interfaceid": "b752adc4-968b-4fd5-9374-5e01373120a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:08:47.839423 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converting VIF {"id": "b752adc4-968b-4fd5-9374-5e01373120a9", "address": "fa:16:3e:2d:a4:3e", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb752adc4-96", "ovs_interfaceid": "b752adc4-968b-4fd5-9374-5e01373120a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:08:47.839818 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:a4:3e,bridge_name='br-int',has_traffic_filtering=True,id=b752adc4-968b-4fd5-9374-5e01373120a9,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb752adc4-96') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:08:47.839818 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:a4:3e,bridge_name='br-int',has_traffic_filtering=True,id=b752adc4-968b-4fd5-9374-5e01373120a9,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb752adc4-96') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:08:47.840003 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:47.840261 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:47.840574 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:08:47.841497 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:47.841717 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c17e86a0-40c2-5f7d-a84b-48a353ff7a1b', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:47.842674 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:47.843681 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:08:47.845602 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:47.845750 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb752adc4-96, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:47.846086 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb752adc4-96, col_values=(('qos', UUID('6e8d85f4-c7eb-4cf3-96aa-faf25098b9b5')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:47.846243 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb752adc4-96, col_values=(('external_ids', {'iface-id': 'b752adc4-968b-4fd5-9374-5e01373120a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:a4:3e', 'vm-uuid': 'fee00c99-3aa9-48fc-874c-f69035ce9219'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:47.847001 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:47.849075 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:08:47.853573 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:47.854250 np0000001127 nova-compute[98206]: INFO os_vif [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:a4:3e,bridge_name='br-int',has_traffic_filtering=True,id=b752adc4-968b-4fd5-9374-5e01373120a9,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb752adc4-96')
May 21 02:08:47.888334 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:08:47.969020 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-aa450344-6df7-4e6a-aaf3-bb5632cd4b84 req-401ff4b5-c95d-428f-ae6c-efc5258ab33b service nova] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Received event network-vif-unplugged-f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:47.969981 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-aa450344-6df7-4e6a-aaf3-bb5632cd4b84 req-401ff4b5-c95d-428f-ae6c-efc5258ab33b service nova] Acquiring lock "e897b981-cb4b-48b1-a9fe-23c447993d1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:47.970247 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-aa450344-6df7-4e6a-aaf3-bb5632cd4b84 req-401ff4b5-c95d-428f-ae6c-efc5258ab33b service nova] Lock "e897b981-cb4b-48b1-a9fe-23c447993d1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:47.970412 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-aa450344-6df7-4e6a-aaf3-bb5632cd4b84 req-401ff4b5-c95d-428f-ae6c-efc5258ab33b service nova] Lock "e897b981-cb4b-48b1-a9fe-23c447993d1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:47.970595 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-aa450344-6df7-4e6a-aaf3-bb5632cd4b84 req-401ff4b5-c95d-428f-ae6c-efc5258ab33b service nova] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] No waiting events found dispatching network-vif-unplugged-f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:08:47.971478 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-aa450344-6df7-4e6a-aaf3-bb5632cd4b84 req-401ff4b5-c95d-428f-ae6c-efc5258ab33b service nova] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Received event network-vif-unplugged-f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:08:48.060261 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Attempting to attach volume cb424a76-1c22-49d9-a6a1-638c98c702b7 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 02:08:48.061831 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] attach device xml: <disk type="block" device="disk">
May 21 02:08:48.061831 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:08:48.061831 np0000001127 nova-compute[98206]:   <alias name="ua-cb424a76-1c22-49d9-a6a1-638c98c702b7"/>
May 21 02:08:48.061831 np0000001127 nova-compute[98206]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-7"/>
May 21 02:08:48.061831 np0000001127 nova-compute[98206]:   <target dev="vdc" bus="virtio"/>
May 21 02:08:48.061831 np0000001127 nova-compute[98206]:   <serial>cb424a76-1c22-49d9-a6a1-638c98c702b7</serial>
May 21 02:08:48.061831 np0000001127 nova-compute[98206]:   <encryption format="luks">
May 21 02:08:48.061831 np0000001127 nova-compute[98206]:     <secret type="passphrase" uuid="cb3781d6-4a8e-4e46-a5da-a1d44d155255"/>
May 21 02:08:48.061831 np0000001127 nova-compute[98206]:   </encryption>
May 21 02:08:48.061831 np0000001127 nova-compute[98206]: </disk>
May 21 02:08:48.061831 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 02:08:48.296905 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7ff9154c-d9d9-4a75-9b2e-0cbd6a9217b5 req-076e0c3e-8dc4-432f-884c-204908fcf656 service nova] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Received event network-vif-deleted-f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:48.297063 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-7ff9154c-d9d9-4a75-9b2e-0cbd6a9217b5 req-076e0c3e-8dc4-432f-884c-204908fcf656 service nova] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Neutron deleted interface f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd; detaching it from the instance and deleting it from the info cache
May 21 02:08:48.298735 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-7ff9154c-d9d9-4a75-9b2e-0cbd6a9217b5 req-076e0c3e-8dc4-432f-884c-204908fcf656 service nova] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:08:48.472602 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:48.472826 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:48.477478 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:08:48.477633 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Claim successful on node np0000001127
May 21 02:08:48.746567 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:08:48.807453 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7ff9154c-d9d9-4a75-9b2e-0cbd6a9217b5 req-076e0c3e-8dc4-432f-884c-204908fcf656 service nova] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Detach interface failed, port_id=f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd, reason: Instance e897b981-cb4b-48b1-a9fe-23c447993d1e could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:08:49.119030 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:49.248682 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Took 1.53 seconds to deallocate network for instance.
May 21 02:08:49.378274 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:08:49.378422 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:08:49.378580 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] No VIF found with MAC fa:16:3e:2d:a4:3e, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:08:49.379646 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Using config drive
May 21 02:08:49.801279 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Took 0.55 seconds to detach 1 volumes for instance.
May 21 02:08:49.885397 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:50.058190 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6d8b3f37-e6b7-441f-8041-a7d55d439f8f req-47d3bd86-2c75-4276-88fa-eaa2e58935eb service nova] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Received event network-vif-unplugged-f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:50.058333 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6d8b3f37-e6b7-441f-8041-a7d55d439f8f req-47d3bd86-2c75-4276-88fa-eaa2e58935eb service nova] Acquiring lock "e897b981-cb4b-48b1-a9fe-23c447993d1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:50.058581 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6d8b3f37-e6b7-441f-8041-a7d55d439f8f req-47d3bd86-2c75-4276-88fa-eaa2e58935eb service nova] Lock "e897b981-cb4b-48b1-a9fe-23c447993d1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:50.058756 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-6d8b3f37-e6b7-441f-8041-a7d55d439f8f req-47d3bd86-2c75-4276-88fa-eaa2e58935eb service nova] Lock "e897b981-cb4b-48b1-a9fe-23c447993d1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:50.062875 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Creating config drive at /opt/stack/data/nova/instances/fee00c99-3aa9-48fc-874c-f69035ce9219/disk.config
May 21 02:08:50.063452 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-6d8b3f37-e6b7-441f-8041-a7d55d439f8f req-47d3bd86-2c75-4276-88fa-eaa2e58935eb service nova] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] No waiting events found dispatching network-vif-unplugged-f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:08:50.063747 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-6d8b3f37-e6b7-441f-8041-a7d55d439f8f req-47d3bd86-2c75-4276-88fa-eaa2e58935eb service nova] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Received unexpected event network-vif-unplugged-f6b5a2fb-d04a-461d-9ca3-7fb3a5bdaddd for instance with vm_state deleted and task_state None.
May 21 02:08:50.073783 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fee00c99-3aa9-48fc-874c-f69035ce9219/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6cjbjhlj {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:50.129483 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fee00c99-3aa9-48fc-874c-f69035ce9219/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6cjbjhlj" returned: 0 in 0.055s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:08:50.137159 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:08:50.137753 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:08:50.314238 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:50.561917 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:50.587138 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:50.588107 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:50.641038 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:08:50.649488 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:08:50.649488 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:08:50.649488 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:08:50.649488 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:08:50.649488 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] No VIF found with MAC fa:16:3e:b8:d1:01, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:08:50.680983 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:50.716036 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.002797730000111187 future=<Future at 0x71c05822e4e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:50.720367 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:50.720367 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=2.2392247419998057 future=<Future at 0x71c058489eb0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:50.720367 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=2.2391249359998255 future=<Future at 0x71c058489eb0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:50.720538 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Emitting event <LifecycleEvent: 1779329315.7131324, 2b990342-3aef-4ea5-a3bb-c776f4dd8567 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:08:50.720756 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] VM Stopped (Lifecycle Event)
May 21 02:08:50.953199 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:50.967318 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:50.967318 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:50.985281 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:51.152344 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.678s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:51.152344 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:08:51.154521 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.840s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:51.224756 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 2b990342-3aef-4ea5-a3bb-c776f4dd8567] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:08:51.405768 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:51.466210 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329331.4658453, fee00c99-3aa9-48fc-874c-f69035ce9219 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:08:51.466384 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] VM Started (Lifecycle Event)
May 21 02:08:51.663187 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:08:51.667074 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:08:51.667368 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:51.667727 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:51.676093 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:08:51.678124 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:08:51.678124 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 21 02:08:51.678124 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.87 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:08:51.738996 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:51.760324 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f369771db7dd49da85131c9692833a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3efe4046d6a442d91b3463e2d99fd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:08:51.775292 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:08:51.775292 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:08:51.970819 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:08:51.976009 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329331.975657, fee00c99-3aa9-48fc-874c-f69035ce9219 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:08:51.976189 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] VM Paused (Lifecycle Event)
May 21 02:08:52.146604 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d05079b1-42bf-4977-b3b9-aec01ef730b3 req-40a06a21-492b-445c-b7b2-5b790db2e0b6 service nova] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Received event network-vif-plugged-b752adc4-968b-4fd5-9374-5e01373120a9 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:52.147461 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d05079b1-42bf-4977-b3b9-aec01ef730b3 req-40a06a21-492b-445c-b7b2-5b790db2e0b6 service nova] Acquiring lock "fee00c99-3aa9-48fc-874c-f69035ce9219-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:52.147856 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d05079b1-42bf-4977-b3b9-aec01ef730b3 req-40a06a21-492b-445c-b7b2-5b790db2e0b6 service nova] Lock "fee00c99-3aa9-48fc-874c-f69035ce9219-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:52.148550 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d05079b1-42bf-4977-b3b9-aec01ef730b3 req-40a06a21-492b-445c-b7b2-5b790db2e0b6 service nova] Lock "fee00c99-3aa9-48fc-874c-f69035ce9219-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:52.148550 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d05079b1-42bf-4977-b3b9-aec01ef730b3 req-40a06a21-492b-445c-b7b2-5b790db2e0b6 service nova] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Processing event network-vif-plugged-b752adc4-968b-4fd5-9374-5e01373120a9 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:08:52.149120 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:08:52.155363 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:08:52.162398 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Instance spawned successfully.
May 21 02:08:52.162398 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:08:52.167833 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:08:52.253381 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-51779f60-1b64-409c-b21c-cfdf669bd2d5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.699s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:52.278785 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:08:52.483483 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:08:52.490539 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329332.490225, fee00c99-3aa9-48fc-874c-f69035ce9219 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:08:52.490807 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] VM Resumed (Lifecycle Event)
May 21 02:08:52.511316 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Successfully created port: 9f18bc65-626b-4448-9473-4f9c7f843775 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:08:52.552972 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:08:52.552972 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.12 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:08:52.671677 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:08:52.676486 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:08:52.677206 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:08:52.677840 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:08:52.678359 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:08:52.678689 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:08:52.678915 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:08:52.788950 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.635s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:52.848103 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:52.877336 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Deleted allocations for instance e897b981-cb4b-48b1-a9fe-23c447993d1e
May 21 02:08:52.959540 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0004337260002102994 future=<Future at 0x71c058489eb0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:52.959661 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:52.960003 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=7.512140351000198 future=<Future at 0x71c058463e90 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:52.964498 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Emitting event <LifecycleEvent: 1779329317.9589787, 511701d6-fac9-4e15-803d-e9038bd1a018 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:08:52.964498 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=7.510535114000049 future=<Future at 0x71c058463e90 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:52.964498 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] VM Stopped (Lifecycle Event)
May 21 02:08:52.997395 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:08:53.000242 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:08:53.187013 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Took 9.44 seconds to spawn the instance on the hypervisor.
May 21 02:08:53.187445 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:08:53.232099 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:53.232605 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:53.303384 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Successfully updated port: 9f18bc65-626b-4448-9473-4f9c7f843775 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:08:53.340798 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Stashing vm_state: active {{(pid=98206) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 21 02:08:53.471419 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: 511701d6-fac9-4e15-803d-e9038bd1a018] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:08:53.504003 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:08:53.676114 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:08:53.689481 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:08:53.690102 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:08:53.690362 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Creating image(s)
May 21 02:08:53.690880 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d5857fd-c96f-444b-ac06-634d1c81a32a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:53.691099 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "/opt/stack/data/nova/instances/0d5857fd-c96f-444b-ac06-634d1c81a32a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:53.692763 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "/opt/stack/data/nova/instances/0d5857fd-c96f-444b-ac06-634d1c81a32a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:53.692905 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:08:53.697243 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:08:53.698689 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:53.734392 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Took 20.75 seconds to build instance.
May 21 02:08:53.740868 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lazy-loading 'flavor' on Instance uuid 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:08:53.789340 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.091s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:08:53.789783 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:53.790414 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:53.792491 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:08:53.794379 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:08:53.794858 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:53.812624 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "refresh_cache-0d5857fd-c96f-444b-ac06-634d1c81a32a" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:08:53.815793 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquired lock "refresh_cache-0d5857fd-c96f-444b-ac06-634d1c81a32a" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:08:53.815793 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:08:53.893974 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4e979d18-4e8d-4a8f-b4cd-bf7c02eca160 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "e897b981-cb4b-48b1-a9fe-23c447993d1e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.268s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:53.906118 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.111s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:08:53.908596 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/0d5857fd-c96f-444b-ac06-634d1c81a32a/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:53.928707 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:53.929336 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:53.992267 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/0d5857fd-c96f-444b-ac06-634d1c81a32a/disk 1073741824" returned: 0 in 0.085s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:08:53.995278 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:53.995278 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:54.109380 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.114s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:08:54.113488 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0d5857fd-c96f-444b-ac06-634d1c81a32a/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:08:54.113488 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5857fd-c96f-444b-ac06-634d1c81a32a/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:54.191326 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:54.205406 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5857fd-c96f-444b-ac06-634d1c81a32a/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:08:54.207357 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Cannot resize image /opt/stack/data/nova/instances/0d5857fd-c96f-444b-ac06-634d1c81a32a/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:08:54.207357 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:08:54.207357 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Ensure instance console log exists: /opt/stack/data/nova/instances/0d5857fd-c96f-444b-ac06-634d1c81a32a/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:08:54.207357 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:54.207357 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:54.207357 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:54.223675 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e0493dc4-4efa-4650-b51f-a533f43f0dde req-cb8ec54e-29c2-45f6-bee9-c7dea5f43f17 service nova] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Received event network-vif-plugged-b752adc4-968b-4fd5-9374-5e01373120a9 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:54.223895 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e0493dc4-4efa-4650-b51f-a533f43f0dde req-cb8ec54e-29c2-45f6-bee9-c7dea5f43f17 service nova] Acquiring lock "fee00c99-3aa9-48fc-874c-f69035ce9219-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:54.224034 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e0493dc4-4efa-4650-b51f-a533f43f0dde req-cb8ec54e-29c2-45f6-bee9-c7dea5f43f17 service nova] Lock "fee00c99-3aa9-48fc-874c-f69035ce9219-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:54.224679 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e0493dc4-4efa-4650-b51f-a533f43f0dde req-cb8ec54e-29c2-45f6-bee9-c7dea5f43f17 service nova] Lock "fee00c99-3aa9-48fc-874c-f69035ce9219-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:54.225153 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e0493dc4-4efa-4650-b51f-a533f43f0dde req-cb8ec54e-29c2-45f6-bee9-c7dea5f43f17 service nova] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] No waiting events found dispatching network-vif-plugged-b752adc4-968b-4fd5-9374-5e01373120a9 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:08:54.225542 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-e0493dc4-4efa-4650-b51f-a533f43f0dde req-cb8ec54e-29c2-45f6-bee9-c7dea5f43f17 service nova] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Received unexpected event network-vif-plugged-b752adc4-968b-4fd5-9374-5e01373120a9 for instance with vm_state active and task_state None.
May 21 02:08:54.225732 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e0493dc4-4efa-4650-b51f-a533f43f0dde req-cb8ec54e-29c2-45f6-bee9-c7dea5f43f17 service nova] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Received event network-changed-9f18bc65-626b-4448-9473-4f9c7f843775 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:54.225919 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e0493dc4-4efa-4650-b51f-a533f43f0dde req-cb8ec54e-29c2-45f6-bee9-c7dea5f43f17 service nova] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Refreshing instance network info cache due to event network-changed-9f18bc65-626b-4448-9473-4f9c7f843775. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:08:54.226109 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e0493dc4-4efa-4650-b51f-a533f43f0dde req-cb8ec54e-29c2-45f6-bee9-c7dea5f43f17 service nova] Acquiring lock "refresh_cache-0d5857fd-c96f-444b-ac06-634d1c81a32a" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:08:54.243635 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "fee00c99-3aa9-48fc-874c-f69035ce9219" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.265s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:54.412975 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:08:54.453584 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:08:54.453765 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Claim successful on node np0000001127
May 21 02:08:54.631726 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:54.750531 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.517s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:54.830069 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Updating instance_info_cache with network_info: [{"id": "9f18bc65-626b-4448-9473-4f9c7f843775", "address": "fa:16:3e:21:79:93", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f18bc65-62", "ovs_interfaceid": "9f18bc65-626b-4448-9473-4f9c7f843775", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:08:54.959611 np0000001127 nova-compute[98206]: INFO nova.compute.resource_tracker [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Updating resource usage from migration 3751531b-f553-4ae3-8a7e-d3129d69b197
May 21 02:08:55.179910 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "fee00c99-3aa9-48fc-874c-f69035ce9219" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:55.180201 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "fee00c99-3aa9-48fc-874c-f69035ce9219" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:55.180512 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "fee00c99-3aa9-48fc-874c-f69035ce9219-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:55.180692 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "fee00c99-3aa9-48fc-874c-f69035ce9219-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:55.180857 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "fee00c99-3aa9-48fc-874c-f69035ce9219-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:55.186062 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:55.187968 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Terminating instance
May 21 02:08:55.340153 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Releasing lock "refresh_cache-0d5857fd-c96f-444b-ac06-634d1c81a32a" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:08:55.340153 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Instance network_info: |[{"id": "9f18bc65-626b-4448-9473-4f9c7f843775", "address": "fa:16:3e:21:79:93", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f18bc65-62", "ovs_interfaceid": "9f18bc65-626b-4448-9473-4f9c7f843775", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:08:55.340153 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e0493dc4-4efa-4650-b51f-a533f43f0dde req-cb8ec54e-29c2-45f6-bee9-c7dea5f43f17 service nova] Acquired lock "refresh_cache-0d5857fd-c96f-444b-ac06-634d1c81a32a" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:08:55.341908 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Start _get_guest_xml network_info=[{"id": "9f18bc65-626b-4448-9473-4f9c7f843775", "address": "fa:16:3e:21:79:93", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f18bc65-62", "ovs_interfaceid": "9f18bc65-626b-4448-9473-4f9c7f843775", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:08:55.345833 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-e0493dc4-4efa-4650-b51f-a533f43f0dde req-cb8ec54e-29c2-45f6-bee9-c7dea5f43f17 service nova] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Refreshing network info cache for port 9f18bc65-626b-4448-9473-4f9c7f843775 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:08:55.356268 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:08:55.359539 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-1258357069', uuid='0d5857fd-c96f-444b-ac06-634d1c81a32a'), owner=OwnerMeta(userid='f369771db7dd49da85131c9692833a5a', username='tempest-AttachVolumeNegativeTest-1208856611-project-member', projectid='d3efe4046d6a442d91b3463e2d99fd7b', projectname='tempest-AttachVolumeNegativeTest-1208856611'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9f18bc65-626b-4448-9473-4f9c7f843775", "address": "fa:16:3e:21:79:93", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f18bc65-62", "ovs_interfaceid": "9f18bc65-626b-4448-9473-4f9c7f843775", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329335.3579454) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:08:55.364686 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:08:55.365907 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:08:55.367787 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:08:55.368360 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:08:55.371387 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:08:55.371818 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:08:55.372071 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:08:55.372242 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:08:55.372538 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:08:55.372750 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:08:55.373054 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:08:55.373648 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:08:55.373919 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:08:55.374095 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:08:55.374317 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:08:55.374520 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:08:55.401485 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:08:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1258357069',display_name='tempest-AttachVolumeNegativeTest-server-1258357069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumenegativetest-server-1258357069',id=62,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuSulnR0t8rSNEHDvjjezWR8Lw0VnEPBeyObMZ5jlTILCU6V+KyU8V8owCnpN+zSBe7JDbAHTSWy1G9HNfvF7ryGkBTjRdWxE4OSO4dopQFhQt+X/gEyxW4AUt9lfz/PQ==',key_name='tempest-keypair-838003393',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3efe4046d6a442d91b3463e2d99fd7b',ramdisk_id='',reservation_id='r-y2trp3ol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1208856611',owner_user_name='tempest-AttachVolumeNegativeTest-1208856611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:08:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f369771db7dd49da85131c9692833a5a',uuid=0d5857fd-c96f-444b-ac06-634d1c81a32a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f18bc65-626b-4448-9473-4f9c7f843775", "address": "fa:16:3e:21:79:93", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f18bc65-62", "ovs_interfaceid": "9f18bc65-626b-4448-9473-4f9c7f843775", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:08:55.401752 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Converting VIF {"id": "9f18bc65-626b-4448-9473-4f9c7f843775", "address": "fa:16:3e:21:79:93", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f18bc65-62", "ovs_interfaceid": "9f18bc65-626b-4448-9473-4f9c7f843775", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:08:55.402482 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:79:93,bridge_name='br-int',has_traffic_filtering=True,id=9f18bc65-626b-4448-9473-4f9c7f843775,network=Network(f683b2da-ab41-43e1-a9bb-98914089b4d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f18bc65-62') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:08:55.403114 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d5857fd-c96f-444b-ac06-634d1c81a32a {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:08:55.665534 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:08:55.665756 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:08:55.698424 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:08:55.718402 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:55.721436 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:55.744635 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:55.746826 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:55.779336 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:55.781325 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:55.846382 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-e0493dc4-4efa-4650-b51f-a533f43f0dde req-cb8ec54e-29c2-45f6-bee9-c7dea5f43f17 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:55.916504 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] End _get_guest_xml xml=<domain type="qemu">
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:   <uuid>0d5857fd-c96f-444b-ac06-634d1c81a32a</uuid>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:   <name>instance-0000003e</name>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1258357069</nova:name>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:08:55</nova:creationTime>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:         <nova:user uuid="f369771db7dd49da85131c9692833a5a">tempest-AttachVolumeNegativeTest-1208856611-project-member</nova:user>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:         <nova:project uuid="d3efe4046d6a442d91b3463e2d99fd7b">tempest-AttachVolumeNegativeTest-1208856611</nova:project>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:         <nova:port uuid="9f18bc65-626b-4448-9473-4f9c7f843775">
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:     <system>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:       <entry name="serial">0d5857fd-c96f-444b-ac06-634d1c81a32a</entry>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:       <entry name="uuid">0d5857fd-c96f-444b-ac06-634d1c81a32a</entry>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:     </system>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:   <os>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:   </os>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:   <features>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:   </features>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:   <devices>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/0d5857fd-c96f-444b-ac06-634d1c81a32a/disk"/>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:     </disk>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/0d5857fd-c96f-444b-ac06-634d1c81a32a/disk.config"/>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:     </disk>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:21:79:93"/>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:       <target dev="tap9f18bc65-62"/>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:     </interface>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/0d5857fd-c96f-444b-ac06-634d1c81a32a/console.log" append="off"/>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:     </serial>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:     <video>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:     </video>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:     </rng>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:   </devices>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]: </domain>
May 21 02:08:55.916504 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:08:55.916504 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Preparing to wait for external event network-vif-plugged-9f18bc65-626b-4448-9473-4f9c7f843775 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:08:55.916504 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "0d5857fd-c96f-444b-ac06-634d1c81a32a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:55.916504 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "0d5857fd-c96f-444b-ac06-634d1c81a32a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:55.921851 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "0d5857fd-c96f-444b-ac06-634d1c81a32a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:55.921851 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:08:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1258357069',display_name='tempest-AttachVolumeNegativeTest-server-1258357069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumenegativetest-server-1258357069',id=62,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuSulnR0t8rSNEHDvjjezWR8Lw0VnEPBeyObMZ5jlTILCU6V+KyU8V8owCnpN+zSBe7JDbAHTSWy1G9HNfvF7ryGkBTjRdWxE4OSO4dopQFhQt+X/gEyxW4AUt9lfz/PQ==',key_name='tempest-keypair-838003393',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3efe4046d6a442d91b3463e2d99fd7b',ramdisk_id='',reservation_id='r-y2trp3ol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1208856611',owner_user_name='tempest-AttachVolumeNegativeTest-1208856611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:08:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f369771db7dd49da85131c9692833a5a',uuid=0d5857fd-c96f-444b-ac06-634d1c81a32a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f18bc65-626b-4448-9473-4f9c7f843775", "address": "fa:16:3e:21:79:93", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f18bc65-62", "ovs_interfaceid": "9f18bc65-626b-4448-9473-4f9c7f843775", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:08:55.922364 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:55.922448 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:55.923014 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Converting VIF {"id": "9f18bc65-626b-4448-9473-4f9c7f843775", "address": "fa:16:3e:21:79:93", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f18bc65-62", "ovs_interfaceid": "9f18bc65-626b-4448-9473-4f9c7f843775", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:08:55.924429 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:79:93,bridge_name='br-int',has_traffic_filtering=True,id=9f18bc65-626b-4448-9473-4f9c7f843775,network=Network(f683b2da-ab41-43e1-a9bb-98914089b4d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f18bc65-62') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:08:55.924627 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:79:93,bridge_name='br-int',has_traffic_filtering=True,id=9f18bc65-626b-4448-9473-4f9c7f843775,network=Network(f683b2da-ab41-43e1-a9bb-98914089b4d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f18bc65-62') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:08:55.925396 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Attaching volume f5dc8530-4090-49a6-897f-ad627f9d7515 to /dev/vdd
May 21 02:08:55.927008 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:55.927790 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:55.927790 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:08:55.931656 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:55.931858 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fd6d2469-7ad9-50d2-8764-fa1dfc02e246', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:55.933454 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:55.933786 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:08:55.939859 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:55.942637 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:55.949696 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f18bc65-62, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:55.950203 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9f18bc65-62, col_values=(('qos', UUID('d08b8bb6-abda-4aef-8c9c-bf619fc2e0df')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:55.950768 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9f18bc65-62, col_values=(('external_ids', {'iface-id': '9f18bc65-626b-4448-9473-4f9c7f843775', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:79:93', 'vm-uuid': '0d5857fd-c96f-444b-ac06-634d1c81a32a'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:55.952082 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:55.954241 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:08:55.963612 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:55.964931 np0000001127 nova-compute[98206]: INFO os_vif [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:79:93,bridge_name='br-int',has_traffic_filtering=True,id=9f18bc65-626b-4448-9473-4f9c7f843775,network=Network(f683b2da-ab41-43e1-a9bb-98914089b4d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f18bc65-62')
May 21 02:08:55.998391 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:08:56.014112 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:08:56.049493 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:56.068061 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:56.085545 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:56.099242 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.99944887799984 future=<Future at 0x71c05858e1e0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:56.102039 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:08:56.103899 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:08:56.112946 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Instance destroyed successfully.
May 21 02:08:56.116141 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lazy-loading 'resources' on Instance uuid fee00c99-3aa9-48fc-874c-f69035ce9219 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:08:56.129590 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:08:56.133310 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe0f:28a1', 'fe80::440a:38ff:fe27:fa24', 'fe80::fc16:3eff:fefb:4d96', 'fe80::fc16:3eff:fe68:a810', 'fe80::3cc0:a4ff:feab:836e', 'fe80::fc16:3eff:fe65:6557', 'fe80::fc16:3eff:fef5:8ead', 'fe80::fc16:3eff:fe20:ae96', 'fe80::fc16:3eff:feb8:d101', 'fe80::7045:30ff:fe1a:b99f', 'fe80::fc16:3eff:fedb:8dd'] 
May 21 02:08:56.133310 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:08:56.133310 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:08:56.133310 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:08:56.133310 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Updating existing volume attachment record: fb176326-9a4e-48fb-bc7b-69831cd06497 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:08:56.172914 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:08:56.401861 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-e0493dc4-4efa-4650-b51f-a533f43f0dde req-cb8ec54e-29c2-45f6-bee9-c7dea5f43f17 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:56.538565 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-e0493dc4-4efa-4650-b51f-a533f43f0dde req-cb8ec54e-29c2-45f6-bee9-c7dea5f43f17 service nova] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Updated VIF entry in instance network info cache for port 9f18bc65-626b-4448-9473-4f9c7f843775. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:08:56.538565 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-e0493dc4-4efa-4650-b51f-a533f43f0dde req-cb8ec54e-29c2-45f6-bee9-c7dea5f43f17 service nova] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Updating instance_info_cache with network_info: [{"id": "9f18bc65-626b-4448-9473-4f9c7f843775", "address": "fa:16:3e:21:79:93", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f18bc65-62", "ovs_interfaceid": "9f18bc65-626b-4448-9473-4f9c7f843775", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:08:56.640966 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:08:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1847986399',display_name='tempest-TestVolumeBootPattern-server-1847986399',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpattern-server-1847986399',id=61,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:08:53Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62ebdb16aee84e22a88dfc8960debd32',ramdisk_id='',reservation_id='r-ip26pged',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1995806391',owner_user_name='tempest-TestVolumeBootPattern-1995806391-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:08:53Z,user_data=None,user_id='4878b5a5bf184852a9ce383caa1c67a4',uuid=fee00c99-3aa9-48fc-874c-f69035ce9219,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b752adc4-968b-4fd5-9374-5e01373120a9", "address": "fa:16:3e:2d:a4:3e", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb752adc4-96", "ovs_interfaceid": "b752adc4-968b-4fd5-9374-5e01373120a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:08:56.640966 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converting VIF {"id": "b752adc4-968b-4fd5-9374-5e01373120a9", "address": "fa:16:3e:2d:a4:3e", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb752adc4-96", "ovs_interfaceid": "b752adc4-968b-4fd5-9374-5e01373120a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:08:56.640966 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:a4:3e,bridge_name='br-int',has_traffic_filtering=True,id=b752adc4-968b-4fd5-9374-5e01373120a9,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb752adc4-96') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:08:56.640966 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:a4:3e,bridge_name='br-int',has_traffic_filtering=True,id=b752adc4-968b-4fd5-9374-5e01373120a9,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb752adc4-96') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:08:56.641284 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:56.641516 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb752adc4-96, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:56.642889 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:56.645514 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:08:56.649425 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:56.653859 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:56.653859 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6e8d85f4-c7eb-4cf3-96aa-faf25098b9b5) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:56.653859 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:08:56.659001 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:56.664304 np0000001127 nova-compute[98206]: INFO os_vif [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:a4:3e,bridge_name='br-int',has_traffic_filtering=True,id=b752adc4-968b-4fd5-9374-5e01373120a9,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb752adc4-96')
May 21 02:08:56.666065 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:08:56.667537 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a', 'iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9916d0d0-81d9-4d75-85e6-0193172abe8a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:08:56.667537 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:08:56.667537 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:08:56.668617 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a', 'iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9916d0d0-81d9-4d75-85e6-0193172abe8a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:08:56.668617 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:08:56.685937 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.757s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:56.686205 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Migrating
May 21 02:08:56.686444 np0000001127 nova-compute[98206]: DEBUG nova.compute.rpcapi [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98206) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 21 02:08:56.691912 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 2.503s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:56.692154 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:56.695371 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Auditing locally available compute resources for np0000001127 (node: np0000001127) {{(pid=98206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 21 02:08:56.720460 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:56.720460 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:56.720460 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:56.720460 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:56.720460 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:56.720460 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:56.720460 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:56.720460 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:56.720460 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:56.720460 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:56.720460 np0000001127 nova-compute[98206]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a (non-flash)
May 21 02:08:56.720460 np0000001127 nova-compute[98206]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a (non-flash)
May 21 02:08:56.720460 np0000001127 nova-compute[98206]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5d0a6c6-38e9-40fa-a971-fa388b0bb356 (non-flash)
May 21 02:08:56.720460 np0000001127 nova-compute[98206]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-391b7a46-1762-42ea-9695-5275e49ea497 (non-flash)
May 21 02:08:56.720460 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:56.720460 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:56.720460 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:08:56.720460 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:56.720460 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:56.720460 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:56.720460 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:56.720460 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:56.720460 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:56.720460 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:56.720460 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:56.720460 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:56.720460 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:56.720460 np0000001127 nova-compute[98206]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a (non-flash)
May 21 02:08:56.720460 np0000001127 nova-compute[98206]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a (non-flash)
May 21 02:08:56.720460 np0000001127 nova-compute[98206]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5d0a6c6-38e9-40fa-a971-fa388b0bb356 (non-flash)
May 21 02:08:56.720460 np0000001127 nova-compute[98206]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-391b7a46-1762-42ea-9695-5275e49ea497 (non-flash)
May 21 02:08:56.720460 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:56.720460 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:56.720460 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:08:56.720460 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435', '115'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', '118'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', '119'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', '132'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', '133'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', '134'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', '135'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a', '136'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a', '137'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e5d0a6c6-38e9-40fa-a971-fa388b0bb356', '138'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-391b7a46-1762-42ea-9695-5275e49ea497', '139'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '95')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:08:56.722785 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a', '137')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:08:56.724315 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:08:56.725387 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515', 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5dc8530-4090-49a6-897f-ad627f9d7515', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:08:56.726796 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:08:56.727808 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a', '136')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:08:56.729760 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c5bbba0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a'): ({'sdq'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a'): ({'sdp'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:08:56.730758 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Removing multipathed devices sdq, sdp {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:08:56.731660 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Flush multipath device 33000000094d019b4 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:08:56.741300 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:56.789442 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Remove SCSI device /dev/sdq with /sys/block/sdq/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:08:56.855274 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Remove SCSI device /dev/sdp with /sys/block/sdp/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:08:56.916731 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Checking to see if SCSI volumes sdq, sdp have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:08:56.917022 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] SCSI volumes sdq, sdp have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:08:56.919179 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Checking to see if device paths {'sdq', 'sdp'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:08:56.932121 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Device paths {'sdq', 'sdp'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:08:56.932786 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:08:56.947864 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:56.991857 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 137, target: iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a, portal: 192.168.40.100,3260]
May 21 02:08:56.991857 np0000001127 nova-compute[98206]: Logout of [sid: 137, target: iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a, portal: 192.168.40.100,3260] successful.
May 21 02:08:56.991857 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:57.021539 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:57.036741 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:57.038172 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e0493dc4-4efa-4650-b51f-a533f43f0dde req-cb8ec54e-29c2-45f6-bee9-c7dea5f43f17 service nova] Releasing lock "refresh_cache-0d5857fd-c96f-444b-ac06-634d1c81a32a" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:08:57.090439 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 136, target: iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a, portal: 192.168.50.100,3260]
May 21 02:08:57.090439 np0000001127 nova-compute[98206]: Logout of [sid: 136, target: iqn.2023-03.storpool.com:os--volume-9916d0d0-81d9-4d75-85e6-0193172abe8a, portal: 192.168.50.100,3260] successful.
May 21 02:08:57.090439 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:57.122980 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:57.123496 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.456s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:08:57.123496 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] <== disconnect_volume: return (456ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:08:57.123496 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:08:57.123793 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Deleting instance files /opt/stack/data/nova/instances/fee00c99-3aa9-48fc-874c-f69035ce9219_del
May 21 02:08:57.124493 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Deletion of /opt/stack/data/nova/instances/fee00c99-3aa9-48fc-874c-f69035ce9219_del complete
May 21 02:08:57.128659 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.402s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:08:57.128659 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515', 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5dc8530-4090-49a6-897f-ad627f9d7515', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:08:57.142775 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:08:57.143696 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:08:57.144326 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:08:57.144576 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:08:57.145530 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:08:57.145748 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:08:57.161881 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:08:57.161881 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:57.168999 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:08:57.168999 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:57.176530 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515] added
May 21 02:08:57.176530 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:08:57.176530 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:08:57.176530 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:08:57.176530 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:08:57.176530 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:08:57.176530 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:57.176741 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:08:57.176915 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0324(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:08:57.177066 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:08:57.182959 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515] added
May 21 02:08:57.182959 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:08:57.182959 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:08:57.182959 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:08:57.182959 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:08:57.182959 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:08:57.182959 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:57.182959 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:08:57.182959 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0368(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:08:57.182959 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:08:57.223169 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "refresh_cache-c76064e6-3702-4e67-9d4f-ef67cd4b7b22" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:08:57.223275 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquired lock "refresh_cache-c76064e6-3702-4e67-9d4f-ef67cd4b7b22" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:08:57.223400 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:08:57.322600 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:57.501067 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:08:57.501400 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:08:57.501400 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] No VIF found with MAC fa:16:3e:21:79:93, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:08:57.502077 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Using config drive
May 21 02:08:57.620917 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-28be7920-014f-4abd-8ed9-b710fff45d9a req-65926d6d-5fdd-4306-89bf-9599f52d40d5 service nova] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Received event network-vif-unplugged-b752adc4-968b-4fd5-9374-5e01373120a9 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:57.622918 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-28be7920-014f-4abd-8ed9-b710fff45d9a req-65926d6d-5fdd-4306-89bf-9599f52d40d5 service nova] Acquiring lock "fee00c99-3aa9-48fc-874c-f69035ce9219-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:57.623175 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-28be7920-014f-4abd-8ed9-b710fff45d9a req-65926d6d-5fdd-4306-89bf-9599f52d40d5 service nova] Lock "fee00c99-3aa9-48fc-874c-f69035ce9219-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:57.623922 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-28be7920-014f-4abd-8ed9-b710fff45d9a req-65926d6d-5fdd-4306-89bf-9599f52d40d5 service nova] Lock "fee00c99-3aa9-48fc-874c-f69035ce9219-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:57.624663 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-28be7920-014f-4abd-8ed9-b710fff45d9a req-65926d6d-5fdd-4306-89bf-9599f52d40d5 service nova] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] No waiting events found dispatching network-vif-unplugged-b752adc4-968b-4fd5-9374-5e01373120a9 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:08:57.625275 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-28be7920-014f-4abd-8ed9-b710fff45d9a req-65926d6d-5fdd-4306-89bf-9599f52d40d5 service nova] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Received event network-vif-unplugged-b752adc4-968b-4fd5-9374-5e01373120a9 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:08:57.634678 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Took 1.94 seconds to destroy the instance on the hypervisor.
May 21 02:08:57.635428 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:08:57.636329 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:08:57.636329 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:08:57.636329 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:57.725795 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:57.741519 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:57.778687 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:57.879010 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:08:57.879649 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:57.987704 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Acquiring lock "feb908f9-10aa-4ba0-8289-c76a3a6279c7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:57.987986 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "feb908f9-10aa-4ba0-8289-c76a3a6279c7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:57.988337 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Acquiring lock "feb908f9-10aa-4ba0-8289-c76a3a6279c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:57.988486 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "feb908f9-10aa-4ba0-8289-c76a3a6279c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:57.988656 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "feb908f9-10aa-4ba0-8289-c76a3a6279c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:57.996354 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Terminating instance
May 21 02:08:57.998531 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:08:57.999538 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:08:58.010450 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:58.014448 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:58.123697 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:08:58.124197 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:58.161186 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-3e2bf70d-4562-446e-8179-cff2c89bd549 req-0e4d99e7-eb6f-43e7-aa3d-edc919fc1644 service nova] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Received event network-vif-deleted-b752adc4-968b-4fd5-9374-5e01373120a9 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:58.161442 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-3e2bf70d-4562-446e-8179-cff2c89bd549 req-0e4d99e7-eb6f-43e7-aa3d-edc919fc1644 service nova] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Neutron deleted interface b752adc4-968b-4fd5-9374-5e01373120a9; detaching it from the instance and deleting it from the info cache
May 21 02:08:58.161728 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-3e2bf70d-4562-446e-8179-cff2c89bd549 req-0e4d99e7-eb6f-43e7-aa3d-edc919fc1644 service nova] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:08:58.180778 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:08:58.184581 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:08:58.200859 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:08:58.200859 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:08:58.209748 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:08:58.209748 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:58.218553 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:58.224973 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:08:58.225719 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-11 (vdb) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:08:58.225719 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-7 (vdc) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:08:58.232653 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:58.233921 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-8 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:08:58.242020 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Creating config drive at /opt/stack/data/nova/instances/0d5857fd-c96f-444b-ac06-634d1c81a32a/disk.config
May 21 02:08:58.244158 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:08:58.247818 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5857fd-c96f-444b-ac06-634d1c81a32a/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:58.267483 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:58.267483 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:58.267483 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:58.267483 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:58.267483 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:58.267483 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:58.267483 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:58.267483 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:58.267483 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:58.267483 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:58.267483 np0000001127 nova-compute[98206]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5d0a6c6-38e9-40fa-a971-fa388b0bb356 (non-flash)
May 21 02:08:58.267483 np0000001127 nova-compute[98206]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-391b7a46-1762-42ea-9695-5275e49ea497 (non-flash)
May 21 02:08:58.267483 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:58.267483 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:58.267483 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:08:58.268079 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:58.268079 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:58.268079 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:58.268079 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:58.268079 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:58.268079 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:58.268079 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:58.268079 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:58.268079 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:58.268079 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:58.268079 np0000001127 nova-compute[98206]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5d0a6c6-38e9-40fa-a971-fa388b0bb356 (non-flash)
May 21 02:08:58.268079 np0000001127 nova-compute[98206]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-391b7a46-1762-42ea-9695-5275e49ea497 (non-flash)
May 21 02:08:58.268079 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:58.268079 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:58.268079 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:08:58.269129 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:58.269129 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:58.269129 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:58.269129 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:58.269129 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:58.269129 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:58.269129 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:58.269129 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:58.269129 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:58.269129 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:58.269129 np0000001127 nova-compute[98206]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5d0a6c6-38e9-40fa-a971-fa388b0bb356 (non-flash)
May 21 02:08:58.269129 np0000001127 nova-compute[98206]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-391b7a46-1762-42ea-9695-5275e49ea497 (non-flash)
May 21 02:08:58.269129 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:58.269129 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:58.269129 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:08:58.269129 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:58.269129 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:58.269129 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:58.269129 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:58.269129 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:58.269129 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:58.269129 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:58.269129 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:58.269129 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:58.269129 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:58.269129 np0000001127 nova-compute[98206]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5d0a6c6-38e9-40fa-a971-fa388b0bb356 (non-flash)
May 21 02:08:58.269129 np0000001127 nova-compute[98206]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-391b7a46-1762-42ea-9695-5275e49ea497 (non-flash)
May 21 02:08:58.269129 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:58.269129 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:58.269129 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:08:58.277398 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:08:58.286768 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0d5857fd-c96f-444b-ac06-634d1c81a32a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpayzm8i8b {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:58.347732 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5857fd-c96f-444b-ac06-634d1c81a32a/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:08:58.348703 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5857fd-c96f-444b-ac06-634d1c81a32a/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:58.367817 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0d5857fd-c96f-444b-ac06-634d1c81a32a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpayzm8i8b" returned: 0 in 0.080s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:08:58.405571 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515, portal: 192.168.50.100,3260]
May 21 02:08:58.405571 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515, portal: 192.168.50.100,3260] successful.
May 21 02:08:58.405571 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:58.420401 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:58.445507 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:58.445507 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:58.445507 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:58.445507 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:58.445507 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:58.445507 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:58.445507 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:58.445507 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:58.445507 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:58.445507 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:58.445507 np0000001127 nova-compute[98206]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5d0a6c6-38e9-40fa-a971-fa388b0bb356 (non-flash)
May 21 02:08:58.445507 np0000001127 nova-compute[98206]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-391b7a46-1762-42ea-9695-5275e49ea497 (non-flash)
May 21 02:08:58.445507 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,0 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:08:58.445507 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:08:58.445507 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:58.445507 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:58.445507 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:08:58.446294 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:58.446294 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:58.446294 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:58.446294 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:58.446294 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:58.446294 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:58.446294 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:58.446294 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:58.446294 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:58.446294 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:58.446294 np0000001127 nova-compute[98206]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5d0a6c6-38e9-40fa-a971-fa388b0bb356 (non-flash)
May 21 02:08:58.446294 np0000001127 nova-compute[98206]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-391b7a46-1762-42ea-9695-5275e49ea497 (non-flash)
May 21 02:08:58.446294 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,0 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:08:58.446294 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:08:58.446294 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:58.446294 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:58.446294 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:08:58.446294 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.301s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:08:58.446294 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:08:58.448175 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] HCTL ('22', '-', '-', 0) found on session 141 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:08:58.448297 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Scanning host 22 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:08:58.469903 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Searching for a device in session 141 and hctl ['22', '*', '*', 0] yield: sdp {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:08:58.469903 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f5dc8530-4090-49a6-897f-ad627f9d7515', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:08:58.477936 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5857fd-c96f-444b-ac06-634d1c81a32a/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:08:58.485432 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:58.506007 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:08:58.541227 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Updating instance_info_cache with network_info: [{"id": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "address": "fa:16:3e:20:ae:96", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1def3b-46", "ovs_interfaceid": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:08:58.550871 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:58.573041 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:58.581811 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:08:58.591266 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:08:58.591841 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:58.678261 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-3e2bf70d-4562-446e-8179-cff2c89bd549 req-0e4d99e7-eb6f-43e7-aa3d-edc919fc1644 service nova] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Detach interface failed, port_id=b752adc4-968b-4fd5-9374-5e01373120a9, reason: Instance fee00c99-3aa9-48fc-874c-f69035ce9219 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:08:58.711012 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:08:58.715138 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6df4554-8490-4d5a-9d4d-acfd46419cb3/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:58.750525 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-4c50bc57-30df-481b-afa7-80ad70074aae req-44ad336a-f0fd-47ff-a183-0f4d3f94342d service nova] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Received event network-vif-unplugged-59724ac9-1c92-4fdf-a5c9-de82a9453bc6 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:58.752037 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4c50bc57-30df-481b-afa7-80ad70074aae req-44ad336a-f0fd-47ff-a183-0f4d3f94342d service nova] Acquiring lock "feb908f9-10aa-4ba0-8289-c76a3a6279c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:58.752037 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4c50bc57-30df-481b-afa7-80ad70074aae req-44ad336a-f0fd-47ff-a183-0f4d3f94342d service nova] Lock "feb908f9-10aa-4ba0-8289-c76a3a6279c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:58.752037 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4c50bc57-30df-481b-afa7-80ad70074aae req-44ad336a-f0fd-47ff-a183-0f4d3f94342d service nova] Lock "feb908f9-10aa-4ba0-8289-c76a3a6279c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:58.752037 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-4c50bc57-30df-481b-afa7-80ad70074aae req-44ad336a-f0fd-47ff-a183-0f4d3f94342d service nova] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] No waiting events found dispatching network-vif-unplugged-59724ac9-1c92-4fdf-a5c9-de82a9453bc6 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:08:58.752037 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-4c50bc57-30df-481b-afa7-80ad70074aae req-44ad336a-f0fd-47ff-a183-0f4d3f94342d service nova] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Received event network-vif-unplugged-59724ac9-1c92-4fdf-a5c9-de82a9453bc6 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:08:58.762441 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:58.773355 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:58.816232 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6df4554-8490-4d5a-9d4d-acfd46419cb3/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:08:58.816880 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6df4554-8490-4d5a-9d4d-acfd46419cb3/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:58.934722 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6df4554-8490-4d5a-9d4d-acfd46419cb3/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:08:58.939063 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Error from libvirt while getting description of instance-0000003d: [Error Code 42] Domain not found: no domain with matching uuid 'fee00c99-3aa9-48fc-874c-f69035ce9219' (instance-0000003d): libvirt.libvirtError: Domain not found: no domain with matching uuid 'fee00c99-3aa9-48fc-874c-f69035ce9219' (instance-0000003d)
May 21 02:08:58.942263 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:08:58.944777 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:59.040211 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999208451999948 future=<Future at 0x71c07c7aae40 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:08:59.048164 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Releasing lock "refresh_cache-c76064e6-3702-4e67-9d4f-ef67cd4b7b22" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:08:59.053867 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:59.064153 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Instance destroyed successfully.
May 21 02:08:59.064153 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lazy-loading 'resources' on Instance uuid feb908f9-10aa-4ba0-8289-c76a3a6279c7 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:08:59.073024 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:08:59.073024 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:59.093318 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Took 1.45 seconds to deallocate network for instance.
May 21 02:08:59.108955 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:59.190299 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:08:59.190729 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:08:59.195136 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:59.197676 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:08:59.200793 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:08:59.265576 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "env LANG=C uptime" returned: 0 in 0.066s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:08:59.266179 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Hypervisor/Node resource view: name=np0000001127 free_ram=11280MB free_disk=72.89348602294922GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 21 02:08:59.266328 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:59.266611 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:59.390738 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515, portal: 192.168.40.100,3260]
May 21 02:08:59.390738 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515, portal: 192.168.40.100,3260] successful.
May 21 02:08:59.390738 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:59.403978 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:08:59.427669 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:59.427669 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:59.427669 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:59.427669 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:59.427669 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:59.427669 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:59.427669 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:59.427669 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:59.427669 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:59.427669 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:59.427669 np0000001127 nova-compute[98206]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5d0a6c6-38e9-40fa-a971-fa388b0bb356 (non-flash)
May 21 02:08:59.427669 np0000001127 nova-compute[98206]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-391b7a46-1762-42ea-9695-5275e49ea497 (non-flash)
May 21 02:08:59.427669 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:08:59.427669 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:08:59.427669 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:59.427669 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:59.427669 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:08:59.428129 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:59.428129 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:08:59.428129 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:59.428129 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:08:59.428129 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:59.428129 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:08:59.428129 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:59.428129 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:08:59.428129 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:59.428129 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:08:59.428129 np0000001127 nova-compute[98206]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5d0a6c6-38e9-40fa-a971-fa388b0bb356 (non-flash)
May 21 02:08:59.428129 np0000001127 nova-compute[98206]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-391b7a46-1762-42ea-9695-5275e49ea497 (non-flash)
May 21 02:08:59.428129 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:08:59.428129 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:08:59.428129 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:59.428129 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:08:59.428129 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:08:59.428573 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.284s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:08:59.428743 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:08:59.430828 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] HCTL ('21', '-', '-', 0) found on session 140 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:08:59.430986 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Scanning host 21 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:08:59.449815 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Searching for a device in session 140 and hctl ['21', '*', '*', 0] yield: sdq {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:08:59.449815 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Connected to sdq using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5dc8530-4090-49a6-897f-ad627f9d7515', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:08:59.487799 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:59.497867 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:59.501134 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:59.528635 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:59.537726 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:59.588008 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:06:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-891374816',display_name='tempest-TestVolumeBootPatternV346-server-891374816',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpatternv346-server-891374816',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBclrTkdYWcg7wYv1sFfFNpc1Ib37K10WPzdS5tiiV8cvq1InEqjgIitIWUAZpitwxd9II4iGKxlZmi34SZNU4+GgmWYChQfrkginL0AO/ukukJQYm1189+G1jlwKhhLfw==',key_name='tempest-keypair-1297469579',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:07:00Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89e0ea7da0f244aab58f9da579e53864',ramdisk_id='',reservation_id='r-im1o600w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-1354384974',owner_user_name='tempest-TestVolumeBootPatternV346-1354384974-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:07:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0083b33595414e5e8a3a80e7fea274ba',uuid=feb908f9-10aa-4ba0-8289-c76a3a6279c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59724ac9-1c92-4fdf-a5c9-de82a9453bc6", "address": "fa:16:3e:f5:8e:ad", "network": {"id": "460fd532-ef54-4f63-922b-b9d9f73f665f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1504169250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89e0ea7da0f244aab58f9da579e53864", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap59724ac9-1c", "ovs_interfaceid": "59724ac9-1c92-4fdf-a5c9-de82a9453bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:08:59.588246 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Converting VIF {"id": "59724ac9-1c92-4fdf-a5c9-de82a9453bc6", "address": "fa:16:3e:f5:8e:ad", "network": {"id": "460fd532-ef54-4f63-922b-b9d9f73f665f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1504169250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89e0ea7da0f244aab58f9da579e53864", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap59724ac9-1c", "ovs_interfaceid": "59724ac9-1c92-4fdf-a5c9-de82a9453bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:08:59.589074 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:8e:ad,bridge_name='br-int',has_traffic_filtering=True,id=59724ac9-1c92-4fdf-a5c9-de82a9453bc6,network=Network(460fd532-ef54-4f63-922b-b9d9f73f665f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59724ac9-1c') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:08:59.589373 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:8e:ad,bridge_name='br-int',has_traffic_filtering=True,id=59724ac9-1c92-4fdf-a5c9-de82a9453bc6,network=Network(460fd532-ef54-4f63-922b-b9d9f73f665f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59724ac9-1c') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:08:59.591634 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:59.591724 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59724ac9-1c, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:59.593041 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:59.594057 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:08:59.595756 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:59.596992 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:59.597212 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2bed4f88-c9ce-4c0f-a2d9-ddffd75aaf56) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:08:59.598722 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:59.599844 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:08:59.600655 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:08:59.603319 np0000001127 nova-compute[98206]: INFO os_vif [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:8e:ad,bridge_name='br-int',has_traffic_filtering=True,id=59724ac9-1c92-4fdf-a5c9-de82a9453bc6,network=Network(460fd532-ef54-4f63-922b-b9d9f73f665f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59724ac9-1c')
May 21 02:08:59.607350 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:08:59.607350 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435', 'iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ece91188-02a7-416e-acb0-f751583ab435', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:08:59.607583 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:08:59.681229 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-23e67c92-9dc4-4a0a-ad94-95fdf13488e0 req-bdbb54ce-d280-468f-834a-ce94e9c56001 service nova] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Received event network-vif-unplugged-b752adc4-968b-4fd5-9374-5e01373120a9 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:08:59.681371 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-23e67c92-9dc4-4a0a-ad94-95fdf13488e0 req-bdbb54ce-d280-468f-834a-ce94e9c56001 service nova] Acquiring lock "fee00c99-3aa9-48fc-874c-f69035ce9219-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:08:59.681704 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-23e67c92-9dc4-4a0a-ad94-95fdf13488e0 req-bdbb54ce-d280-468f-834a-ce94e9c56001 service nova] Lock "fee00c99-3aa9-48fc-874c-f69035ce9219-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:08:59.681704 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-23e67c92-9dc4-4a0a-ad94-95fdf13488e0 req-bdbb54ce-d280-468f-834a-ce94e9c56001 service nova] Lock "fee00c99-3aa9-48fc-874c-f69035ce9219-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:08:59.681704 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-23e67c92-9dc4-4a0a-ad94-95fdf13488e0 req-bdbb54ce-d280-468f-834a-ce94e9c56001 service nova] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] No waiting events found dispatching network-vif-unplugged-b752adc4-968b-4fd5-9374-5e01373120a9 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:08:59.681848 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-23e67c92-9dc4-4a0a-ad94-95fdf13488e0 req-bdbb54ce-d280-468f-834a-ce94e9c56001 service nova] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Received event network-vif-unplugged-b752adc4-968b-4fd5-9374-5e01373120a9 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:08:59.698123 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Took 0.60 seconds to detach 1 volumes for instance.
May 21 02:08:59.702356 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Deleting volume: 9916d0d0-81d9-4d75-85e6-0193172abe8a {{(pid=98206) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 21 02:09:00.008564 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329340.0081804, 0d5857fd-c96f-444b-ac06-634d1c81a32a => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:09:00.008867 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] VM Started (Lifecycle Event)
May 21 02:09:00.183441 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:09:00.261354 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:00.293796 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Applying migration context for instance c76064e6-3702-4e67-9d4f-ef67cd4b7b22 as it has an incoming, in-progress migration 3751531b-f553-4ae3-8a7e-d3129d69b197. Migration status is migrating {{(pid=98206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
May 21 02:09:00.295111 np0000001127 nova-compute[98206]: INFO nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Updating resource usage from migration 3751531b-f553-4ae3-8a7e-d3129d69b197
May 21 02:09:00.376324 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 6ccaedfe-bec9-4591-b845-acf0cc81d026 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:09:00.376513 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 45f01b41-a43c-4ddf-aa07-22f8c2c50758 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:09:00.376562 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 16a0cc8d-c65b-4166-ad1a-5318b18ed00e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:09:00.376621 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance b6df4554-8490-4d5a-9d4d-acfd46419cb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:09:00.376739 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance feb908f9-10aa-4ba0-8289-c76a3a6279c7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:09:00.376901 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:09:00.377064 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance aa3f5a78-fb82-4e21-8ebf-90bf48a122be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:09:00.377494 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance fee00c99-3aa9-48fc-874c-f69035ce9219 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:09:00.377494 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 0d5857fd-c96f-444b-ac06-634d1c81a32a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:09:00.377494 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Migration 3751531b-f553-4ae3-8a7e-d3129d69b197 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 21 02:09:00.377650 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance c76064e6-3702-4e67-9d4f-ef67cd4b7b22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:09:00.378570 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 21 02:09:00.378570 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Final resource view: name=np0000001127 phys_ram=24030MB used_ram=2752MB phys_disk=95GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:08:59 up 39 min,  2 users,  load average: 9.95, 9.51, 6.25\n', 'num_instances': '10', 'num_vm_active': '9', 'num_task_None': '6', 'num_os_type_None': '10', 'num_proj_848912b0c0e94d2795bb2332daf1730e': '5', 'io_workload': '2', 'num_proj_89e0ea7da0f244aab58f9da579e53864': '2', 'num_task_deleting': '2', 'num_task_resize_prep': '1', 'num_proj_4ae2ef74a1614eb09e4f71f709f64126': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_d3efe4046d6a442d91b3463e2d99fd7b': '1', 'num_proj_62ebdb16aee84e22a88dfc8960debd32': '1'} {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 21 02:09:00.473778 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0010656889999154373 future=<Future at 0x71c058463e90 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:09:00.474337 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] Emitting event <LifecycleEvent: 1779329325.472033, e897b981-cb4b-48b1-a9fe-23c447993d1e => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:09:00.474463 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] VM Stopped (Lifecycle Event)
May 21 02:09:00.475711 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:09:00.475846 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=10.62235790099976 future=<Future at 0x71c05858e1e0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:09:00.475926 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=10.622267392999674 future=<Future at 0x71c05858e1e0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:09:00.511645 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:09:00.517750 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329340.517294, 0d5857fd-c96f-444b-ac06-634d1c81a32a => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:09:00.517842 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] VM Paused (Lifecycle Event)
May 21 02:09:00.570393 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Starting migrate_disk_and_power_off {{(pid=98206) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 21 02:09:00.592048 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:00.602425 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:00.617976 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:00.752596 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:00.760022 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:00.819979 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-90fa6361-36e8-45aa-8b45-c8b8ec1a00a8 req-914c9cb7-d962-4dd3-bb8d-031a53668027 service nova] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Received event network-vif-unplugged-59724ac9-1c92-4fdf-a5c9-de82a9453bc6 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:09:00.821498 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-90fa6361-36e8-45aa-8b45-c8b8ec1a00a8 req-914c9cb7-d962-4dd3-bb8d-031a53668027 service nova] Acquiring lock "feb908f9-10aa-4ba0-8289-c76a3a6279c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:00.821498 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-90fa6361-36e8-45aa-8b45-c8b8ec1a00a8 req-914c9cb7-d962-4dd3-bb8d-031a53668027 service nova] Lock "feb908f9-10aa-4ba0-8289-c76a3a6279c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:00.821498 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-90fa6361-36e8-45aa-8b45-c8b8ec1a00a8 req-914c9cb7-d962-4dd3-bb8d-031a53668027 service nova] Lock "feb908f9-10aa-4ba0-8289-c76a3a6279c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:00.821498 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-90fa6361-36e8-45aa-8b45-c8b8ec1a00a8 req-914c9cb7-d962-4dd3-bb8d-031a53668027 service nova] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] No waiting events found dispatching network-vif-unplugged-59724ac9-1c92-4fdf-a5c9-de82a9453bc6 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:09:00.821498 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-90fa6361-36e8-45aa-8b45-c8b8ec1a00a8 req-914c9cb7-d962-4dd3-bb8d-031a53668027 service nova] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Received event network-vif-unplugged-59724ac9-1c92-4fdf-a5c9-de82a9453bc6 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:09:00.911505 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Instance destroyed successfully.
May 21 02:09:00.915530 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:07:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='multiattach-server-1',id=56,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzu+v5yloohnjet+lpl7Cb5m5YuZdtxheBkBGOMBLLe2AJEatmv/W6U1humbPofoJpKHaVTa0sSri4Ktoz/rRBuEiIFUUGVMQjgWmfd958Eyx52s4Fg6gJyB/ru0BJ+zA==',key_name='tempest-keypair-1890511814',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:07:27Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='848912b0c0e94d2795bb2332daf1730e',ramdisk_id='',reservation_id='r-5rppg77m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-289054175',owner_user_name='tempest-AttachVolumeMultiAttachTest-289054175-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:08:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='049d6c8cccfa4ae38d78a88ef5be0f1b',uuid=c76064e6-3702-4e67-9d4f-ef67cd4b7b22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "address": "fa:16:3e:20:ae:96", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "vif_mac": "fa:16:3e:20:ae:96"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1def3b-46", "ovs_interfaceid": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:09:00.915754 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converting VIF {"id": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "address": "fa:16:3e:20:ae:96", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "vif_mac": "fa:16:3e:20:ae:96"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1def3b-46", "ovs_interfaceid": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:09:00.916254 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:ae:96,bridge_name='br-int',has_traffic_filtering=True,id=ad1def3b-4657-4632-bd3a-910cdca9a1a4,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad1def3b-46') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:09:00.916530 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:ae:96,bridge_name='br-int',has_traffic_filtering=True,id=ad1def3b-4657-4632-bd3a-910cdca9a1a4,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad1def3b-46') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:09:00.917485 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:00.917640 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad1def3b-46, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:09:00.927025 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:00.927864 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:09:00.928550 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:00.929176 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:00.929301 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=82ebcb54-f62a-476e-8b3f-bce6772df077) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:09:00.929685 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:00.930098 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:09:00.930541 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:00.932196 np0000001127 nova-compute[98206]: INFO os_vif [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:ae:96,bridge_name='br-int',has_traffic_filtering=True,id=ad1def3b-4657-4632-bd3a-910cdca9a1a4,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad1def3b-46')
May 21 02:09:00.959845 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:09:00.960110 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:09:00.979556 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-30e865d3-3288-4a4f-9f10-95027988cfdf tempest-VolumesNegativeTest-1786760828 tempest-VolumesNegativeTest-1786760828-project-member] [instance: e897b981-cb4b-48b1-a9fe-23c447993d1e] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:09:01.024563 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:09:01.026950 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:09:01.095898 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Acquiring lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:01.096085 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:01.198313 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Found WWN 1StorPooliSCSI_DISK_1034578903445799118 for multipath device dm-12 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:09:01.198646 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.071s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:09:01.198825 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] <== connect_volume: return (4472ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799118', 'path': '/dev/dm-12', 'multipath_id': '1StorPooliSCSI_DISK_1034578903445799118'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:09:01.198978 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799118', 'path': '/dev/dm-12', 'multipath_id': '1StorPooliSCSI_DISK_1034578903445799118'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:09:01.199458 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.592s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:09:01.199814 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435', 'iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ece91188-02a7-416e-acb0-f751583ab435', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:09:01.199986 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:09:01.202360 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lazy-loading 'flavor' on Instance uuid 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:09:01.234446 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:09:01.234446 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:09:01.234446 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:09:01.234446 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:09:01.234446 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:01.234446 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:01.234446 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:01.234446 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:01.234446 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:01.234446 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:01.234446 np0000001127 nova-compute[98206]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5d0a6c6-38e9-40fa-a971-fa388b0bb356 (non-flash)
May 21 02:09:01.234446 np0000001127 nova-compute[98206]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-391b7a46-1762-42ea-9695-5275e49ea497 (non-flash)
May 21 02:09:01.234446 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:01.234446 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:01.234446 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:01.234446 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:01.234446 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:09:01.235099 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:09:01.235099 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:09:01.235099 np0000001127 nova-compute[98206]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:09:01.235099 np0000001127 nova-compute[98206]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435 (non-flash)
May 21 02:09:01.235099 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:01.235099 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:01.235099 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:01.235099 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:01.235099 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:01.235099 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:01.235099 np0000001127 nova-compute[98206]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5d0a6c6-38e9-40fa-a971-fa388b0bb356 (non-flash)
May 21 02:09:01.235099 np0000001127 nova-compute[98206]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-391b7a46-1762-42ea-9695-5275e49ea497 (non-flash)
May 21 02:09:01.235099 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:01.235099 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:01.235099 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:01.235099 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:01.235099 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:09:01.235099 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435', '115'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', '118'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', '119'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', '132'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', '133'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', '134'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', '135'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e5d0a6c6-38e9-40fa-a971-fa388b0bb356', '138'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-391b7a46-1762-42ea-9695-5275e49ea497', '139'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515', '140'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515', '141'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '95')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:09:01.235099 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435', '114')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:09:01.236346 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435', '115')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:09:01.237933 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c7afd80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435'): ({'sdg'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:09:01.238147 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Removing multipathed devices sdg, sdf {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:09:01.238419 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Flush multipath device 330000000ea85bcea {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:09:01.297730 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:09:01.348093 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:09:01.392947 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:09:01.393185 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:09:01.395892 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:09:01.408201 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:09:01.408344 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:09:01.422351 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:01.464726 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:09:01.470233 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Detected multiple connections on this host for volume: e7cfdf26-9973-4cc1-8395-11f9ebc98c4b, skipping target disconnect.
May 21 02:09:01.471357 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 114, target: iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435, portal: 192.168.40.100,3260]
May 21 02:09:01.471357 np0000001127 nova-compute[98206]: Logout of [sid: 114, target: iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435, portal: 192.168.40.100,3260] successful.
May 21 02:09:01.471357 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:01.476851 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:01.502776 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:01.516112 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:01.531492 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:09:01.532181 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999761257000046 future=<Future at 0x71c058489eb0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:09:01.567283 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 115, target: iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435, portal: 192.168.50.100,3260]
May 21 02:09:01.567283 np0000001127 nova-compute[98206]: Logout of [sid: 115, target: iqn.2023-03.storpool.com:os--volume-ece91188-02a7-416e-acb0-f751583ab435, portal: 192.168.50.100,3260] successful.
May 21 02:09:01.567283 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:01.580652 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:09:01.582821 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:01.596582 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:01.597597 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:09:01.597871 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] <== disconnect_volume: return (1990ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:09:01.598207 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:09:01.598794 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Deleting instance files /opt/stack/data/nova/instances/feb908f9-10aa-4ba0-8289-c76a3a6279c7_del
May 21 02:09:01.600156 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:09:01.605627 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Deletion of /opt/stack/data/nova/instances/feb908f9-10aa-4ba0-8289-c76a3a6279c7_del complete
May 21 02:09:01.686270 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:09:01.686616 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:09:01.687145 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22_resize/disk /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:01.709257 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Attempting to attach volume f5dc8530-4090-49a6-897f-ad627f9d7515 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 02:09:01.715134 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] attach device xml: <disk type="block" device="disk">
May 21 02:09:01.715134 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:09:01.715134 np0000001127 nova-compute[98206]:   <alias name="ua-f5dc8530-4090-49a6-897f-ad627f9d7515"/>
May 21 02:09:01.715134 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-12"/>
May 21 02:09:01.715134 np0000001127 nova-compute[98206]:   <target dev="vdd" bus="virtio"/>
May 21 02:09:01.715134 np0000001127 nova-compute[98206]:   <serial>f5dc8530-4090-49a6-897f-ad627f9d7515</serial>
May 21 02:09:01.715134 np0000001127 nova-compute[98206]:   <shareable/>
May 21 02:09:01.715134 np0000001127 nova-compute[98206]: </disk>
May 21 02:09:01.715134 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 02:09:01.743389 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:01.819227 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "cp -r /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22_resize/disk /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk" returned: 0 in 0.132s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:09:01.821156 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22_resize/disk.config /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk.config {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:01.879254 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "cp -r /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22_resize/disk.config /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk.config" returned: 0 in 0.059s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:09:01.879801 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22_resize/disk.info /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk.info {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:01.921706 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-da8f83b6-a606-4425-bdc6-08c2304992ee req-59c0d2a9-383c-4be4-b788-aab7843b6ae9 service nova] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Received event network-vif-plugged-9f18bc65-626b-4448-9473-4f9c7f843775 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:09:01.921890 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-da8f83b6-a606-4425-bdc6-08c2304992ee req-59c0d2a9-383c-4be4-b788-aab7843b6ae9 service nova] Acquiring lock "0d5857fd-c96f-444b-ac06-634d1c81a32a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:01.922575 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-da8f83b6-a606-4425-bdc6-08c2304992ee req-59c0d2a9-383c-4be4-b788-aab7843b6ae9 service nova] Lock "0d5857fd-c96f-444b-ac06-634d1c81a32a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:01.922575 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-da8f83b6-a606-4425-bdc6-08c2304992ee req-59c0d2a9-383c-4be4-b788-aab7843b6ae9 service nova] Lock "0d5857fd-c96f-444b-ac06-634d1c81a32a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:01.922575 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-da8f83b6-a606-4425-bdc6-08c2304992ee req-59c0d2a9-383c-4be4-b788-aab7843b6ae9 service nova] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Processing event network-vif-plugged-9f18bc65-626b-4448-9473-4f9c7f843775 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:09:01.923322 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:09:01.928155 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:09:01.932889 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329341.9308615, 0d5857fd-c96f-444b-ac06-634d1c81a32a => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:09:01.934138 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] VM Resumed (Lifecycle Event)
May 21 02:09:01.942924 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "cp -r /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22_resize/disk.info /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk.info" returned: 0 in 0.062s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:09:01.945641 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Instance spawned successfully.
May 21 02:09:01.945945 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:09:01.973490 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Compute_service record updated for np0000001127:np0000001127 {{(pid=98206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 21 02:09:01.973852 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.707s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:01.974464 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.713s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:01.975304 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:09:02.117144 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Took 3.61 seconds to destroy the instance on the hypervisor.
May 21 02:09:02.117911 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:09:02.118281 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:09:02.118399 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:09:02.118643 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:02.204355 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:02.229828 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:02.443493 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:09:02.457555 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:09:02.470645 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:09:02.470645 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:09:02.471021 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:09:02.471339 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:09:02.471774 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:09:02.472155 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:09:02.762153 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-fca67375-b61a-41b8-84d7-f9762d471943 req-2306576a-d168-47e6-9a22-b0576d441a4c service nova] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Received event network-vif-deleted-59724ac9-1c92-4fdf-a5c9-de82a9453bc6 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:09:02.766089 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-fca67375-b61a-41b8-84d7-f9762d471943 req-2306576a-d168-47e6-9a22-b0576d441a4c service nova] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Neutron deleted interface 59724ac9-1c92-4fdf-a5c9-de82a9453bc6; detaching it from the instance and deleting it from the info cache
May 21 02:09:02.766089 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-fca67375-b61a-41b8-84d7-f9762d471943 req-2306576a-d168-47e6-9a22-b0576d441a4c service nova] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:09:02.767722 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:09:02.767908 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:09:02.975485 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:09:02.975485 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:09:02.975710 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:09:02.976275 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:09:02.976546 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:09:02.976786 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 48.70 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:09:02.980961 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:09:02.982786 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Took 9.29 seconds to spawn the instance on the hypervisor.
May 21 02:09:02.982969 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:09:03.132545 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:03.132858 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:03.201552 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:09:03.266404 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Port ad1def3b-4657-4632-bd3a-910cdca9a1a4 binding to destination host np0000001127 is already ACTIVE {{(pid=98206) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3211}}
May 21 02:09:03.270936 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:09:03.281602 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-fca67375-b61a-41b8-84d7-f9762d471943 req-2306576a-d168-47e6-9a22-b0576d441a4c service nova] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Detach interface failed, port_id=59724ac9-1c92-4fdf-a5c9-de82a9453bc6, reason: Instance feb908f9-10aa-4ba0-8289-c76a3a6279c7 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:09:03.422011 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:09:03.422134 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:09:03.422238 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:09:03.422351 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] No BDM found with device name vdd, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:09:03.422455 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:09:03.422589 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] No VIF found with MAC fa:16:3e:b8:d1:01, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:09:03.492016 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Took 15.10 seconds to build instance.
May 21 02:09:03.704684 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Took 1.59 seconds to deallocate network for instance.
May 21 02:09:03.782294 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.808s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:03.783436 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.578s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:03.792109 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:09:03.792264 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Claim successful on node np0000001127
May 21 02:09:03.844911 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Deleted allocations for instance fee00c99-3aa9-48fc-874c-f69035ce9219
May 21 02:09:03.994426 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a7696eb1-fafa-4535-a0aa-fa7ce496001a tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "0d5857fd-c96f-444b-ac06-634d1c81a32a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.608s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:04.044362 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-fe389980-b87a-48e6-8dd4-0fc3feb01dd2 req-67310b36-abe0-4485-a47b-486cba9eb87a service nova] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Received event network-vif-plugged-9f18bc65-626b-4448-9473-4f9c7f843775 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:09:04.044555 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fe389980-b87a-48e6-8dd4-0fc3feb01dd2 req-67310b36-abe0-4485-a47b-486cba9eb87a service nova] Acquiring lock "0d5857fd-c96f-444b-ac06-634d1c81a32a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:04.044712 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fe389980-b87a-48e6-8dd4-0fc3feb01dd2 req-67310b36-abe0-4485-a47b-486cba9eb87a service nova] Lock "0d5857fd-c96f-444b-ac06-634d1c81a32a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:04.044828 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fe389980-b87a-48e6-8dd4-0fc3feb01dd2 req-67310b36-abe0-4485-a47b-486cba9eb87a service nova] Lock "0d5857fd-c96f-444b-ac06-634d1c81a32a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:04.044943 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-fe389980-b87a-48e6-8dd4-0fc3feb01dd2 req-67310b36-abe0-4485-a47b-486cba9eb87a service nova] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] No waiting events found dispatching network-vif-plugged-9f18bc65-626b-4448-9473-4f9c7f843775 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:09:04.045886 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-fe389980-b87a-48e6-8dd4-0fc3feb01dd2 req-67310b36-abe0-4485-a47b-486cba9eb87a service nova] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Received unexpected event network-vif-plugged-9f18bc65-626b-4448-9473-4f9c7f843775 for instance with vm_state active and task_state None.
May 21 02:09:04.045886 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-fe389980-b87a-48e6-8dd4-0fc3feb01dd2 req-67310b36-abe0-4485-a47b-486cba9eb87a service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Received event network-vif-unplugged-ad1def3b-4657-4632-bd3a-910cdca9a1a4 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:09:04.045886 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fe389980-b87a-48e6-8dd4-0fc3feb01dd2 req-67310b36-abe0-4485-a47b-486cba9eb87a service nova] Acquiring lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:04.046082 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fe389980-b87a-48e6-8dd4-0fc3feb01dd2 req-67310b36-abe0-4485-a47b-486cba9eb87a service nova] Lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:04.046316 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fe389980-b87a-48e6-8dd4-0fc3feb01dd2 req-67310b36-abe0-4485-a47b-486cba9eb87a service nova] Lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:04.046456 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-fe389980-b87a-48e6-8dd4-0fc3feb01dd2 req-67310b36-abe0-4485-a47b-486cba9eb87a service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] No waiting events found dispatching network-vif-unplugged-ad1def3b-4657-4632-bd3a-910cdca9a1a4 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:09:04.046734 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-fe389980-b87a-48e6-8dd4-0fc3feb01dd2 req-67310b36-abe0-4485-a47b-486cba9eb87a service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Received unexpected event network-vif-unplugged-ad1def3b-4657-4632-bd3a-910cdca9a1a4 for instance with vm_state active and task_state resize_migrated.
May 21 02:09:04.046909 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-fe389980-b87a-48e6-8dd4-0fc3feb01dd2 req-67310b36-abe0-4485-a47b-486cba9eb87a service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Received event network-vif-unplugged-ad1def3b-4657-4632-bd3a-910cdca9a1a4 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:09:04.047095 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fe389980-b87a-48e6-8dd4-0fc3feb01dd2 req-67310b36-abe0-4485-a47b-486cba9eb87a service nova] Acquiring lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:04.047281 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fe389980-b87a-48e6-8dd4-0fc3feb01dd2 req-67310b36-abe0-4485-a47b-486cba9eb87a service nova] Lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:04.047459 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fe389980-b87a-48e6-8dd4-0fc3feb01dd2 req-67310b36-abe0-4485-a47b-486cba9eb87a service nova] Lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:04.047680 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-fe389980-b87a-48e6-8dd4-0fc3feb01dd2 req-67310b36-abe0-4485-a47b-486cba9eb87a service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] No waiting events found dispatching network-vif-unplugged-ad1def3b-4657-4632-bd3a-910cdca9a1a4 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:09:04.047780 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-fe389980-b87a-48e6-8dd4-0fc3feb01dd2 req-67310b36-abe0-4485-a47b-486cba9eb87a service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Received unexpected event network-vif-unplugged-ad1def3b-4657-4632-bd3a-910cdca9a1a4 for instance with vm_state active and task_state resize_migrated.
May 21 02:09:04.275751 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Took 0.57 seconds to detach 1 volumes for instance.
May 21 02:09:04.279449 np0000001127 nova-compute[98206]: DEBUG nova.compute.rpcapi [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98206) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 21 02:09:04.289717 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:04.289893 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:04.290025 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:04.788696 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:04.856857 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-da697a8b-2d54-472b-a083-ab765042f1d8 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "fee00c99-3aa9-48fc-874c-f69035ce9219" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.677s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:04.934752 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2d132198-abe3-4523-bd84-d9f7e11b0688 req-d867f1fe-8a2b-43b2-bf92-071d10715cb5 service nova] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Received event network-changed-9f18bc65-626b-4448-9473-4f9c7f843775 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:09:04.934931 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2d132198-abe3-4523-bd84-d9f7e11b0688 req-d867f1fe-8a2b-43b2-bf92-071d10715cb5 service nova] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Refreshing instance network info cache due to event network-changed-9f18bc65-626b-4448-9473-4f9c7f843775. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:09:04.935100 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2d132198-abe3-4523-bd84-d9f7e11b0688 req-d867f1fe-8a2b-43b2-bf92-071d10715cb5 service nova] Acquiring lock "refresh_cache-0d5857fd-c96f-444b-ac06-634d1c81a32a" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:09:04.935192 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2d132198-abe3-4523-bd84-d9f7e11b0688 req-d867f1fe-8a2b-43b2-bf92-071d10715cb5 service nova] Acquired lock "refresh_cache-0d5857fd-c96f-444b-ac06-634d1c81a32a" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:09:04.935348 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-2d132198-abe3-4523-bd84-d9f7e11b0688 req-d867f1fe-8a2b-43b2-bf92-071d10715cb5 service nova] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Refreshing network info cache for port 9f18bc65-626b-4448-9473-4f9c7f843775 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:09:04.994366 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cb78d077-37fa-4fb6-913f-182b1daeeeaa tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.071s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:05.177629 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:09:05.308701 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:05.433867 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "refresh_cache-c76064e6-3702-4e67-9d4f-ef67cd4b7b22" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:09:05.433867 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquired lock "refresh_cache-c76064e6-3702-4e67-9d4f-ef67cd4b7b22" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:09:05.433867 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:09:05.440268 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-2d132198-abe3-4523-bd84-d9f7e11b0688 req-d867f1fe-8a2b-43b2-bf92-071d10715cb5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:05.484007 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:09:05.484673 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:09:05.873679 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-2d132198-abe3-4523-bd84-d9f7e11b0688 req-d867f1fe-8a2b-43b2-bf92-071d10715cb5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:05.930390 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:05.935185 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:05.987411 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:09:06.135280 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-2d132198-abe3-4523-bd84-d9f7e11b0688 req-d867f1fe-8a2b-43b2-bf92-071d10715cb5 service nova] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Updated VIF entry in instance network info cache for port 9f18bc65-626b-4448-9473-4f9c7f843775. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:09:06.135582 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-2d132198-abe3-4523-bd84-d9f7e11b0688 req-d867f1fe-8a2b-43b2-bf92-071d10715cb5 service nova] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Updating instance_info_cache with network_info: [{"id": "9f18bc65-626b-4448-9473-4f9c7f843775", "address": "fa:16:3e:21:79:93", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f18bc65-62", "ovs_interfaceid": "9f18bc65-626b-4448-9473-4f9c7f843775", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:09:06.298908 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:06.438874 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Updating instance_info_cache with network_info: [{"id": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "address": "fa:16:3e:20:ae:96", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1def3b-46", "ovs_interfaceid": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:09:06.499605 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.717s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:06.500312 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.711s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:06.500982 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:09:06.637568 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2d132198-abe3-4523-bd84-d9f7e11b0688 req-d867f1fe-8a2b-43b2-bf92-071d10715cb5 service nova] Releasing lock "refresh_cache-0d5857fd-c96f-444b-ac06-634d1c81a32a" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:09:06.745796 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:06.941323 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Releasing lock "refresh_cache-c76064e6-3702-4e67-9d4f-ef67cd4b7b22" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:09:07.015959 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:09:07.015959 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:09:07.017619 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:07.017619 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:07.106871 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7f41e316b794454ba2d5e899e35fc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c062763c08b4e5190a5351babe96c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:09:07.149999 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:09:07.150215 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:09:07.449806 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:09:07.463177 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:09:07.489217 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:07.522079 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:09:07.547306 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:09:07.547306 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:09:07.556440 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:09:07.558751 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe21:7993', 'fe80::2482:bff:fe1b:902b', 'fe80::fc16:3eff:fe0f:28a1', 'fe80::440a:38ff:fe27:fa24', 'fe80::fc16:3eff:fefb:4d96', 'fe80::fc16:3eff:fe68:a810', 'fe80::3cc0:a4ff:feab:836e', 'fe80::fc16:3eff:fe65:6557', 'fe80::fc16:3eff:feb8:d101', 'fe80::7045:30ff:fe1a:b99f', 'fe80::fc16:3eff:fedb:8dd'] 
May 21 02:09:07.558869 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:09:07.558977 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:09:07.559217 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:09:07.654987 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:09:07.692232 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Successfully created port: 7a096ac2-9c5b-4618-87c1-f2400619040e {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:09:08.034020 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:09:08.165801 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.666s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:08.242174 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Deleted allocations for instance feb908f9-10aa-4ba0-8289-c76a3a6279c7
May 21 02:09:08.370840 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Successfully updated port: 7a096ac2-9c5b-4618-87c1-f2400619040e {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:09:08.424102 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-3a25e735-1560-40d7-bf57-ce9f6ede4750 req-6acdafd7-0ca6-4bd4-a8c9-6e9c482b985a service nova] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Received event network-changed-7a096ac2-9c5b-4618-87c1-f2400619040e {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:09:08.424102 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-3a25e735-1560-40d7-bf57-ce9f6ede4750 req-6acdafd7-0ca6-4bd4-a8c9-6e9c482b985a service nova] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Refreshing instance network info cache due to event network-changed-7a096ac2-9c5b-4618-87c1-f2400619040e. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:09:08.424248 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-3a25e735-1560-40d7-bf57-ce9f6ede4750 req-6acdafd7-0ca6-4bd4-a8c9-6e9c482b985a service nova] Acquiring lock "refresh_cache-0c15c9f3-e0d2-4d6d-9144-b9760c55be0e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:09:08.424299 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-3a25e735-1560-40d7-bf57-ce9f6ede4750 req-6acdafd7-0ca6-4bd4-a8c9-6e9c482b985a service nova] Acquired lock "refresh_cache-0c15c9f3-e0d2-4d6d-9144-b9760c55be0e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:09:08.424393 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-3a25e735-1560-40d7-bf57-ce9f6ede4750 req-6acdafd7-0ca6-4bd4-a8c9-6e9c482b985a service nova] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Refreshing network info cache for port 7a096ac2-9c5b-4618-87c1-f2400619040e {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:09:08.477098 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "10c50913-8b08-402c-8ece-87c7521ce785" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:08.478744 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "10c50913-8b08-402c-8ece-87c7521ce785" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:08.707197 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Starting finish_migration {{(pid=98206) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 21 02:09:08.709205 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Instance directory exists: not creating {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 21 02:09:08.709312 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Creating image(s)
May 21 02:09:08.710007 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:08.804172 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.094s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:09:08.804910 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:09:08.805190 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:08.876411 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Acquiring lock "refresh_cache-0c15c9f3-e0d2-4d6d-9144-b9760c55be0e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:09:08.901860 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:09:08.902220 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Cannot resize image /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:09:08.929362 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-3a25e735-1560-40d7-bf57-ce9f6ede4750 req-6acdafd7-0ca6-4bd4-a8c9-6e9c482b985a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:08.979927 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:09:08.993655 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-3a25e735-1560-40d7-bf57-ce9f6ede4750 req-6acdafd7-0ca6-4bd4-a8c9-6e9c482b985a service nova] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:09:09.042723 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:09:09.043844 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:09:09.044077 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Creating image(s)
May 21 02:09:09.044543 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Acquiring lock "/opt/stack/data/nova/instances/0c15c9f3-e0d2-4d6d-9144-b9760c55be0e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:09.044698 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "/opt/stack/data/nova/instances/0c15c9f3-e0d2-4d6d-9144-b9760c55be0e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:09.045151 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "/opt/stack/data/nova/instances/0c15c9f3-e0d2-4d6d-9144-b9760c55be0e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:09.045726 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:09:09.048795 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:09:09.049843 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:09.143412 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.093s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:09:09.143412 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:09.143752 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:09.145627 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:09:09.146787 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:09:09.146924 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:09.171614 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-3a25e735-1560-40d7-bf57-ce9f6ede4750 req-6acdafd7-0ca6-4bd4-a8c9-6e9c482b985a service nova] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:09:09.246987 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.100s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:09:09.247390 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/0c15c9f3-e0d2-4d6d-9144-b9760c55be0e/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:09.272919 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5a9d0d06-ebd2-4125-a992-56351070fe1a tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "feb908f9-10aa-4ba0-8289-c76a3a6279c7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.285s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:09.312749 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/0c15c9f3-e0d2-4d6d-9144-b9760c55be0e/disk 1073741824" returned: 0 in 0.065s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:09:09.313172 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.169s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:09.313523 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:09.407492 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Did not create local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 21 02:09:09.407492 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Ensure instance console log exists: /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:09:09.407492 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:09.407492 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:09.407492 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:09.410169 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Start _get_guest_xml network_info=[{"id": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "address": "fa:16:3e:20:ae:96", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "vif_mac": "fa:16:3e:20:ae:96"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1def3b-46", "ovs_interfaceid": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'c76064e6-3702-4e67-9d4f-ef67cd4b7b22', 'attached_at': '2026-05-21T02:09:08.000000', 'detached_at': '', 'volume_id': 'e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'multiattach': True, 'serial': 'e7cfdf26-9973-4cc1-8395-11f9ebc98c4b'}, 'delete_on_termination': False, 'attachment_id': 'c7ae668f-1e04-4388-b1b4-9fc59b86b161', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:09:09.411482 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.097s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:09:09.411482 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0c15c9f3-e0d2-4d6d-9144-b9760c55be0e/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:09:09.411650 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c15c9f3-e0d2-4d6d-9144-b9760c55be0e/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:09.431324 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:09:09.434371 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='c76064e6-3702-4e67-9d4f-ef67cd4b7b22'), owner=OwnerMeta(userid='049d6c8cccfa4ae38d78a88ef5be0f1b', username='tempest-AttachVolumeMultiAttachTest-289054175-project-member', projectid='848912b0c0e94d2795bb2332daf1730e', projectname='tempest-AttachVolumeMultiAttachTest-289054175'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "address": "fa:16:3e:20:ae:96", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "vif_mac": "fa:16:3e:20:ae:96"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1def3b-46", "ovs_interfaceid": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329349.433655) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:09:09.436255 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:09:09.436994 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:09:09.439380 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:09:09.442486 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:09:09.442486 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:09:09.442486 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:09:09.442486 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:09:09.442486 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:09:09.442486 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:09:09.442486 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:09:09.442486 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:09:09.442486 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:09:09.446028 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:09:09.446346 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:09:09.446554 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:09:09.446740 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:09:09.458493 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk.config --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:09.502811 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c15c9f3-e0d2-4d6d-9144-b9760c55be0e/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:09:09.503211 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Cannot resize image /opt/stack/data/nova/instances/0c15c9f3-e0d2-4d6d-9144-b9760c55be0e/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:09:09.503556 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:09:09.503742 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Ensure instance console log exists: /opt/stack/data/nova/instances/0c15c9f3-e0d2-4d6d-9144-b9760c55be0e/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:09:09.504038 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:09.504274 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:09.504411 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:09.550690 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:09.550882 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:09.551914 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk.config --force-share --output=json" returned: 0 in 0.094s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:09:09.552300 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "/opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:09.554893 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "/opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:09.554893 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "/opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:09.554893 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:09:09.554893 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:09:09.554893 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:09:09.554893 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:09:09.554893 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:09:09.557392 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:09:09.557922 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Claim successful on node np0000001127
May 21 02:09:09.575704 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:09:09.576345 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:09:09.576893 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:09:09.577259 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:09:09.577572 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:09:09.577930 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.startup = automatic
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.session.scan = manual
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:09:09.593327 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:09:09.593327 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.startup = automatic
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.session.scan = manual
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:09:09.601316 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:09:09.601316 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:09.608795 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:09.617322 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:09.634949 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:09:09.634949 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:09:09.634949 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:09.634949 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:09.634949 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:09.634949 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:09.634949 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:09.634949 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:09.634949 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:09.634949 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:09.634949 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:09.634949 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:09.634949 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:09:09.636906 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:09:09.636906 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:09:09.636906 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:09.636906 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:09.636906 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:09.636906 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:09.636906 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:09.636906 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:09.636906 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:09.636906 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:09.636906 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:09.636906 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:09.636906 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:09:09.636906 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.059s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:09:09.636906 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:09:09.636906 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] HCTL ('9', '0', '0', 0) found on session 118 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:09:09.636906 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Scanning host 9 c: 0, t: 0, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:09:09.642978 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:09:09.642978 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:09:09.642978 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:09.642978 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:09.642978 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:09.642978 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:09.642978 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:09.642978 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:09.642978 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:09.642978 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:09.642978 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:09.642978 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:09.642978 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:09:09.643386 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:09:09.643386 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:09:09.643386 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:09.643386 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:09.643386 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:09.643386 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:09.643386 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:09.643386 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:09.643386 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:09.643386 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:09.643386 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:09.643386 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:09.643386 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:09:09.643386 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.066s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:09:09.643700 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:09:09.644266 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] HCTL ('10', '0', '0', 0) found on session 119 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:09:09.644371 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Scanning host 10 c: 0, t: 0, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:09:09.652326 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Searching for a device in session 118 and hctl ('9', '0', '0', 0) yield: sdd {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:09:09.652326 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:09:09.654356 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Searching for a device in session 119 and hctl ('10', '0', '0', 0) yield: sde {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:09:09.656884 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:09:09.674858 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-3a25e735-1560-40d7-bf57-ce9f6ede4750 req-6acdafd7-0ca6-4bd4-a8c9-6e9c482b985a service nova] Releasing lock "refresh_cache-0c15c9f3-e0d2-4d6d-9144-b9760c55be0e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:09:09.675406 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Acquired lock "refresh_cache-0c15c9f3-e0d2-4d6d-9144-b9760c55be0e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:09:09.675643 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:09:10.249126 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:09:10.415234 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:10.564823 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Updating instance_info_cache with network_info: [{"id": "7a096ac2-9c5b-4618-87c1-f2400619040e", "address": "fa:16:3e:5c:a9:0d", "network": {"id": "b49de03c-44bf-47f0-a925-60ba84dd5b07", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-970460078-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c062763c08b4e5190a5351babe96c84", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a096ac2-9c", "ovs_interfaceid": "7a096ac2-9c5b-4618-87c1-f2400619040e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:09:10.578106 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:09:10.932048 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:11.067128 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Releasing lock "refresh_cache-0c15c9f3-e0d2-4d6d-9144-b9760c55be0e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:09:11.067496 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Instance network_info: |[{"id": "7a096ac2-9c5b-4618-87c1-f2400619040e", "address": "fa:16:3e:5c:a9:0d", "network": {"id": "b49de03c-44bf-47f0-a925-60ba84dd5b07", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-970460078-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c062763c08b4e5190a5351babe96c84", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a096ac2-9c", "ovs_interfaceid": "7a096ac2-9c5b-4618-87c1-f2400619040e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:09:11.069520 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Start _get_guest_xml network_info=[{"id": "7a096ac2-9c5b-4618-87c1-f2400619040e", "address": "fa:16:3e:5c:a9:0d", "network": {"id": "b49de03c-44bf-47f0-a925-60ba84dd5b07", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-970460078-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c062763c08b4e5190a5351babe96c84", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a096ac2-9c", "ovs_interfaceid": "7a096ac2-9c5b-4618-87c1-f2400619040e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:09:11.072306 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:09:11.073441 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-TestServerVolumeAttachmentScenario-server-903781839', uuid='0c15c9f3-e0d2-4d6d-9144-b9760c55be0e'), owner=OwnerMeta(userid='7f41e316b794454ba2d5e899e35fc154', username='tempest-TestServerVolumeAttachmentScenario-514659065-project-member', projectid='7c062763c08b4e5190a5351babe96c84', projectname='tempest-TestServerVolumeAttachmentScenario-514659065'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7a096ac2-9c5b-4618-87c1-f2400619040e", "address": "fa:16:3e:5c:a9:0d", "network": {"id": "b49de03c-44bf-47f0-a925-60ba84dd5b07", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-970460078-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c062763c08b4e5190a5351babe96c84", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a096ac2-9c", "ovs_interfaceid": "7a096ac2-9c5b-4618-87c1-f2400619040e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329351.0731115) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:09:11.075267 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:09:11.075568 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:09:11.076862 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:09:11.077062 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:09:11.077964 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:09:11.078282 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:09:11.078457 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:09:11.078582 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:09:11.078698 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:09:11.078816 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:09:11.078905 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:09:11.079090 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:09:11.079236 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:09:11.079377 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:09:11.079496 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:09:11.079636 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:09:11.091733 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:09:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-903781839',display_name='tempest-TestServerVolumeAttachmentScenario-server-903781839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testservervolumeattachmentscenario-server-903781839',id=63,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQ13y+fEQre9dN8ccQIUYUkIACQC1d81+JDt1eBi/8pm7CUlFyus848PraEdW1zLrSXtgtmDdCNFkekZUupOjk3//3gMviOfdglWKSEo11V+1CnvS8WWMpfl3T+LTP5PA==',key_name='tempest-keypair-1330436068',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c062763c08b4e5190a5351babe96c84',ramdisk_id='',reservation_id='r-k4edly4i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-514659065',owner_user_name='tempest-TestServerVolumeAttachmentScenario-514659065-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:09:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f41e316b794454ba2d5e899e35fc154',uuid=0c15c9f3-e0d2-4d6d-9144-b9760c55be0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a096ac2-9c5b-4618-87c1-f2400619040e", "address": "fa:16:3e:5c:a9:0d", "network": {"id": "b49de03c-44bf-47f0-a925-60ba84dd5b07", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-970460078-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c062763c08b4e5190a5351babe96c84", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a096ac2-9c", "ovs_interfaceid": "7a096ac2-9c5b-4618-87c1-f2400619040e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:09:11.091923 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Converting VIF {"id": "7a096ac2-9c5b-4618-87c1-f2400619040e", "address": "fa:16:3e:5c:a9:0d", "network": {"id": "b49de03c-44bf-47f0-a925-60ba84dd5b07", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-970460078-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c062763c08b4e5190a5351babe96c84", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a096ac2-9c", "ovs_interfaceid": "7a096ac2-9c5b-4618-87c1-f2400619040e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:09:11.092489 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:a9:0d,bridge_name='br-int',has_traffic_filtering=True,id=7a096ac2-9c5b-4618-87c1-f2400619040e,network=Network(b49de03c-44bf-47f0-a925-60ba84dd5b07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a096ac2-9c') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:09:11.093213 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:09:11.099587 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.00069461000020965 future=<Future at 0x71c05858e1e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:09:11.099587 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:09:11.099587 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=2.939287282999885 future=<Future at 0x71c07c7aae40 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:09:11.099587 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=2.9391952829996626 future=<Future at 0x71c07c7aae40 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:09:11.099962 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Emitting event <LifecycleEvent: 1779329336.0980954, fee00c99-3aa9-48fc-874c-f69035ce9219 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:09:11.100122 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] VM Stopped (Lifecycle Event)
May 21 02:09:11.169657 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:09:11.170018 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:09:11.593350 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Found WWN 330000000eb19b356 for multipath device dm-1 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:09:11.593802 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.039s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:09:11.593802 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] <== connect_volume: return (2040ms) {'type': 'block', 'scsi_wwn': '330000000eb19b356', 'path': '/dev/dm-1', 'multipath_id': '330000000eb19b356'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:09:11.593960 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000eb19b356', 'path': '/dev/dm-1', 'multipath_id': '330000000eb19b356'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:09:11.599184 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] End _get_guest_xml xml=<domain type="qemu">
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:   <uuid>0c15c9f3-e0d2-4d6d-9144-b9760c55be0e</uuid>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:   <name>instance-0000003f</name>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-903781839</nova:name>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:09:11</nova:creationTime>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:         <nova:user uuid="7f41e316b794454ba2d5e899e35fc154">tempest-TestServerVolumeAttachmentScenario-514659065-project-member</nova:user>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:         <nova:project uuid="7c062763c08b4e5190a5351babe96c84">tempest-TestServerVolumeAttachmentScenario-514659065</nova:project>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:         <nova:port uuid="7a096ac2-9c5b-4618-87c1-f2400619040e">
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:     <system>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:       <entry name="serial">0c15c9f3-e0d2-4d6d-9144-b9760c55be0e</entry>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:       <entry name="uuid">0c15c9f3-e0d2-4d6d-9144-b9760c55be0e</entry>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:     </system>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:   <os>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:   </os>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:   <features>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:   </features>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:   <devices>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/0c15c9f3-e0d2-4d6d-9144-b9760c55be0e/disk"/>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:     </disk>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/0c15c9f3-e0d2-4d6d-9144-b9760c55be0e/disk.config"/>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:     </disk>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:5c:a9:0d"/>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:       <target dev="tap7a096ac2-9c"/>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:     </interface>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/0c15c9f3-e0d2-4d6d-9144-b9760c55be0e/console.log" append="off"/>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:     </serial>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:     <video>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:     </video>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:     </rng>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:   </devices>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]: </domain>
May 21 02:09:11.599184 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:09:11.601500 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Preparing to wait for external event network-vif-plugged-7a096ac2-9c5b-4618-87c1-f2400619040e {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:09:11.601500 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Acquiring lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:11.601500 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:11.601500 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:11.601500 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:09:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-903781839',display_name='tempest-TestServerVolumeAttachmentScenario-server-903781839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testservervolumeattachmentscenario-server-903781839',id=63,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQ13y+fEQre9dN8ccQIUYUkIACQC1d81+JDt1eBi/8pm7CUlFyus848PraEdW1zLrSXtgtmDdCNFkekZUupOjk3//3gMviOfdglWKSEo11V+1CnvS8WWMpfl3T+LTP5PA==',key_name='tempest-keypair-1330436068',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c062763c08b4e5190a5351babe96c84',ramdisk_id='',reservation_id='r-k4edly4i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-514659065',owner_user_name='tempest-TestServerVolumeAttachmentScenario-514659065-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:09:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f41e316b794454ba2d5e899e35fc154',uuid=0c15c9f3-e0d2-4d6d-9144-b9760c55be0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a096ac2-9c5b-4618-87c1-f2400619040e", "address": "fa:16:3e:5c:a9:0d", "network": {"id": "b49de03c-44bf-47f0-a925-60ba84dd5b07", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-970460078-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c062763c08b4e5190a5351babe96c84", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a096ac2-9c", "ovs_interfaceid": "7a096ac2-9c5b-4618-87c1-f2400619040e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:09:11.601500 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Converting VIF {"id": "7a096ac2-9c5b-4618-87c1-f2400619040e", "address": "fa:16:3e:5c:a9:0d", "network": {"id": "b49de03c-44bf-47f0-a925-60ba84dd5b07", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-970460078-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c062763c08b4e5190a5351babe96c84", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a096ac2-9c", "ovs_interfaceid": "7a096ac2-9c5b-4618-87c1-f2400619040e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:09:11.601797 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:a9:0d,bridge_name='br-int',has_traffic_filtering=True,id=7a096ac2-9c5b-4618-87c1-f2400619040e,network=Network(b49de03c-44bf-47f0-a925-60ba84dd5b07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a096ac2-9c') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:09:11.601834 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:a9:0d,bridge_name='br-int',has_traffic_filtering=True,id=7a096ac2-9c5b-4618-87c1-f2400619040e,network=Network(b49de03c-44bf-47f0-a925-60ba84dd5b07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a096ac2-9c') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:09:11.602836 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:11.602836 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:09:11.602836 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:09:11.603994 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:11.604263 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e716ed01-552b-5e42-9aaa-eaccd40d098e', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:09:11.605756 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:11.606136 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:09:11.607297 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: fee00c99-3aa9-48fc-874c-f69035ce9219] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:09:11.607483 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:11.609454 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:11.609672 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a096ac2-9c, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:09:11.610141 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a096ac2-9c, col_values=(('qos', UUID('5cf74066-59ce-40c0-acd6-059cbe5fedf6')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:09:11.610312 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a096ac2-9c, col_values=(('external_ids', {'iface-id': '7a096ac2-9c5b-4618-87c1-f2400619040e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:a9:0d', 'vm-uuid': '0c15c9f3-e0d2-4d6d-9144-b9760c55be0e'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:09:11.612386 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:11.613159 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:09:11.619072 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:11.619646 np0000001127 nova-compute[98206]: INFO os_vif [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:a9:0d,bridge_name='br-int',has_traffic_filtering=True,id=7a096ac2-9c5b-4618-87c1-f2400619040e,network=Network(b49de03c-44bf-47f0-a925-60ba84dd5b07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a096ac2-9c')
May 21 02:09:11.674957 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:09:11.746395 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:11.812940 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "cec9e114-b934-4de6-b0f0-586cd34a59bd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:11.813207 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "cec9e114-b934-4de6-b0f0-586cd34a59bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:12.105732 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:07:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001127',hostname='multiattach-server-1',id=56,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzu+v5yloohnjet+lpl7Cb5m5YuZdtxheBkBGOMBLLe2AJEatmv/W6U1humbPofoJpKHaVTa0sSri4Ktoz/rRBuEiIFUUGVMQjgWmfd958Eyx52s4Fg6gJyB/ru0BJ+zA==',key_name='tempest-keypair-1890511814',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:07:27Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001127',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='848912b0c0e94d2795bb2332daf1730e',ramdisk_id='',reservation_id='r-5rppg77m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-289054175',owner_user_name='tempest-AttachVolumeMultiAttachTest-289054175-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:09:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='049d6c8cccfa4ae38d78a88ef5be0f1b',uuid=c76064e6-3702-4e67-9d4f-ef67cd4b7b22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "address": "fa:16:3e:20:ae:96", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "vif_mac": "fa:16:3e:20:ae:96"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1def3b-46", "ovs_interfaceid": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:09:12.106030 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converting VIF {"id": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "address": "fa:16:3e:20:ae:96", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "vif_mac": "fa:16:3e:20:ae:96"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1def3b-46", "ovs_interfaceid": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:09:12.106609 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:ae:96,bridge_name='br-int',has_traffic_filtering=True,id=ad1def3b-4657-4632-bd3a-910cdca9a1a4,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad1def3b-46') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:09:12.110746 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] End _get_guest_xml xml=<domain type="qemu">
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:   <uuid>c76064e6-3702-4e67-9d4f-ef67cd4b7b22</uuid>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:   <name>instance-00000038</name>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:   <memory>262144</memory>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:       <nova:name>multiattach-server-1</nova:name>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:09:09</nova:creationTime>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.micro" id="84">
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:         <nova:memory>256</nova:memory>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:           <nova:property name="hw_machine_type">pc</nova:property>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:           <nova:property name="hw_video_model">virtio</nova:property>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:         <nova:user uuid="049d6c8cccfa4ae38d78a88ef5be0f1b">tempest-AttachVolumeMultiAttachTest-289054175-project-member</nova:user>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:         <nova:project uuid="848912b0c0e94d2795bb2332daf1730e">tempest-AttachVolumeMultiAttachTest-289054175</nova:project>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:         <nova:port uuid="ad1def3b-4657-4632-bd3a-910cdca9a1a4">
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:     <system>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:       <entry name="serial">c76064e6-3702-4e67-9d4f-ef67cd4b7b22</entry>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:       <entry name="uuid">c76064e6-3702-4e67-9d4f-ef67cd4b7b22</entry>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:     </system>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:   <os>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:   </os>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:   <features>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:   </features>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:   <devices>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk"/>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:     </disk>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk.config"/>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:     </disk>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:       <alias name="ua-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b"/>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-1"/>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:       <target dev="vdb" bus="virtio"/>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:       <serial>e7cfdf26-9973-4cc1-8395-11f9ebc98c4b</serial>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:       <shareable/>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:     </disk>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:20:ae:96"/>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:       <target dev="tapad1def3b-46"/>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:     </interface>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/console.log" append="off"/>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:     </serial>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:     <video>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:     </video>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:     </rng>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:   </devices>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]: </domain>
May 21 02:09:12.110746 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:09:12.113010 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:07:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001127',hostname='multiattach-server-1',id=56,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzu+v5yloohnjet+lpl7Cb5m5YuZdtxheBkBGOMBLLe2AJEatmv/W6U1humbPofoJpKHaVTa0sSri4Ktoz/rRBuEiIFUUGVMQjgWmfd958Eyx52s4Fg6gJyB/ru0BJ+zA==',key_name='tempest-keypair-1890511814',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:07:27Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001127',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='848912b0c0e94d2795bb2332daf1730e',ramdisk_id='',reservation_id='r-5rppg77m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-289054175',owner_user_name='tempest-AttachVolumeMultiAttachTest-289054175-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:09:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='049d6c8cccfa4ae38d78a88ef5be0f1b',uuid=c76064e6-3702-4e67-9d4f-ef67cd4b7b22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "address": "fa:16:3e:20:ae:96", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "vif_mac": "fa:16:3e:20:ae:96"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1def3b-46", "ovs_interfaceid": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:09:12.113010 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converting VIF {"id": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "address": "fa:16:3e:20:ae:96", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "vif_mac": "fa:16:3e:20:ae:96"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1def3b-46", "ovs_interfaceid": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:09:12.113010 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:ae:96,bridge_name='br-int',has_traffic_filtering=True,id=ad1def3b-4657-4632-bd3a-910cdca9a1a4,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad1def3b-46') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:09:12.113010 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:ae:96,bridge_name='br-int',has_traffic_filtering=True,id=ad1def3b-4657-4632-bd3a-910cdca9a1a4,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad1def3b-46') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:09:12.115340 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:12.115620 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:09:12.115850 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:09:12.116869 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:12.117093 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ec959fd-0777-558d-a3c4-3bbb00f30e44', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:09:12.118205 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:12.119484 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:09:12.124723 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:12.130981 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:12.132611 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad1def3b-46, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:09:12.133156 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapad1def3b-46, col_values=(('qos', UUID('fb988ddf-e578-4f00-a8e8-dd60c70f8584')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:09:12.133390 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapad1def3b-46, col_values=(('external_ids', {'iface-id': 'ad1def3b-4657-4632-bd3a-910cdca9a1a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:ae:96', 'vm-uuid': 'c76064e6-3702-4e67-9d4f-ef67cd4b7b22'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:09:12.136050 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:09:12.146262 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:12.146817 np0000001127 nova-compute[98206]: INFO os_vif [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:ae:96,bridge_name='br-int',has_traffic_filtering=True,id=ad1def3b-4657-4632-bd3a-910cdca9a1a4,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad1def3b-46')
May 21 02:09:12.185221 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.634s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:12.186351 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:09:12.317324 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:09:12.692184 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:09:12.692697 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:09:12.692951 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:12.693239 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:12.768653 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Acquiring lock "45f01b41-a43c-4ddf-aa07-22f8c2c50758" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:12.768927 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "45f01b41-a43c-4ddf-aa07-22f8c2c50758" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:12.769201 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Acquiring lock "45f01b41-a43c-4ddf-aa07-22f8c2c50758-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:12.769383 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "45f01b41-a43c-4ddf-aa07-22f8c2c50758-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:12.769922 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "45f01b41-a43c-4ddf-aa07-22f8c2c50758-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:12.773117 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Terminating instance
May 21 02:09:12.791403 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '01cc41344ae640f6aa9c6142252838b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae2ef74a1614eb09e4f71f709f64126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:09:12.876122 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:12.876329 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:12.882627 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:09:12.882873 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Claim successful on node np0000001127
May 21 02:09:13.138540 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:09:13.138703 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:09:13.139492 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] No VIF found with MAC fa:16:3e:5c:a9:0d, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:09:13.139492 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Using config drive
May 21 02:09:13.194621 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:09:13.277265 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:09:13.308123 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:13.312334 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:13.336761 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:13.374909 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Successfully created port: a149f43d-6c97-4b80-9bd8-353fb7be0630 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:09:13.377858 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:13.586865 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8f75774c-b5bb-4c57-9d37-adc33db89b74 req-5a7abe93-0df1-4ce9-8071-22b733504a8d service nova] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Received event network-vif-unplugged-75b84cf5-3aac-411c-acc8-a12b14a9f98a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:09:13.586865 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8f75774c-b5bb-4c57-9d37-adc33db89b74 req-5a7abe93-0df1-4ce9-8071-22b733504a8d service nova] Acquiring lock "45f01b41-a43c-4ddf-aa07-22f8c2c50758-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:13.586865 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8f75774c-b5bb-4c57-9d37-adc33db89b74 req-5a7abe93-0df1-4ce9-8071-22b733504a8d service nova] Lock "45f01b41-a43c-4ddf-aa07-22f8c2c50758-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:13.586865 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8f75774c-b5bb-4c57-9d37-adc33db89b74 req-5a7abe93-0df1-4ce9-8071-22b733504a8d service nova] Lock "45f01b41-a43c-4ddf-aa07-22f8c2c50758-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:13.586865 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8f75774c-b5bb-4c57-9d37-adc33db89b74 req-5a7abe93-0df1-4ce9-8071-22b733504a8d service nova] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] No waiting events found dispatching network-vif-unplugged-75b84cf5-3aac-411c-acc8-a12b14a9f98a {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:09:13.586865 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8f75774c-b5bb-4c57-9d37-adc33db89b74 req-5a7abe93-0df1-4ce9-8071-22b733504a8d service nova] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Received event network-vif-unplugged-75b84cf5-3aac-411c-acc8-a12b14a9f98a for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:09:13.624487 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999656533000234 future=<Future at 0x71c07c5d51f0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:09:13.626903 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Instance destroyed successfully.
May 21 02:09:13.627500 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lazy-loading 'resources' on Instance uuid 45f01b41-a43c-4ddf-aa07-22f8c2c50758 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:09:13.644438 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:13.670791 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:09:13.670979 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:09:13.671179 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:09:13.671283 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No VIF found with MAC fa:16:3e:20:ae:96, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:09:13.671930 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Using config drive
May 21 02:09:13.700647 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:09:13.826998 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Creating config drive at /opt/stack/data/nova/instances/0c15c9f3-e0d2-4d6d-9144-b9760c55be0e/disk.config
May 21 02:09:13.831772 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0c15c9f3-e0d2-4d6d-9144-b9760c55be0e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxobpyvsy {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:13.889522 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0c15c9f3-e0d2-4d6d-9144-b9760c55be0e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxobpyvsy" returned: 0 in 0.056s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:09:13.955968 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Successfully updated port: a149f43d-6c97-4b80-9bd8-353fb7be0630 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:09:14.021336 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-3efaba43-6865-4534-8b51-c83034bad84b req-23c03a17-da7d-473c-9410-3b23795f74aa service nova] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Received event network-changed-a149f43d-6c97-4b80-9bd8-353fb7be0630 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:09:14.021718 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-3efaba43-6865-4534-8b51-c83034bad84b req-23c03a17-da7d-473c-9410-3b23795f74aa service nova] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Refreshing instance network info cache due to event network-changed-a149f43d-6c97-4b80-9bd8-353fb7be0630. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:09:14.021921 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-3efaba43-6865-4534-8b51-c83034bad84b req-23c03a17-da7d-473c-9410-3b23795f74aa service nova] Acquiring lock "refresh_cache-10c50913-8b08-402c-8ece-87c7521ce785" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:09:14.022058 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-3efaba43-6865-4534-8b51-c83034bad84b req-23c03a17-da7d-473c-9410-3b23795f74aa service nova] Acquired lock "refresh_cache-10c50913-8b08-402c-8ece-87c7521ce785" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:09:14.022219 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-3efaba43-6865-4534-8b51-c83034bad84b req-23c03a17-da7d-473c-9410-3b23795f74aa service nova] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Refreshing network info cache for port a149f43d-6c97-4b80-9bd8-353fb7be0630 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:09:14.039051 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.00045680900029765326 future=<Future at 0x71c07c7aae40 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:09:14.039796 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Emitting event <LifecycleEvent: 1779329339.0384197, feb908f9-10aa-4ba0-8289-c76a3a6279c7 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:09:14.041028 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:09:14.041248 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] VM Stopped (Lifecycle Event)
May 21 02:09:14.042445 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=2.4894566650000343 future=<Future at 0x71c058489eb0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:09:14.043335 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=2.4885666440000023 future=<Future at 0x71c058489eb0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:09:14.130885 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:05:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1190516628',display_name='tempest-TestVolumeBootPatternV346-server-1190516628',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpatternv346-server-1190516628',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhquHOJAY7QotjYy2HAWitc6rV9lQkf+vLPGZ1M5EWGWaD/LpdqqS3/jOkdchMOpWlNKqHVY6azcL9bcMNaE5y+/NqN74KQvQ6f0zqKwmTC8Qd1i76heeAQRoE8JyWgMQ==',key_name='tempest-keypair-2037732520',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:05:57Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89e0ea7da0f244aab58f9da579e53864',ramdisk_id='',reservation_id='r-mg1djcvs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-1354384974',owner_user_name='tempest-TestVolumeBootPatternV346-1354384974-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:05:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0083b33595414e5e8a3a80e7fea274ba',uuid=45f01b41-a43c-4ddf-aa07-22f8c2c50758,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75b84cf5-3aac-411c-acc8-a12b14a9f98a", "address": "fa:16:3e:68:a8:10", "network": {"id": "460fd532-ef54-4f63-922b-b9d9f73f665f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1504169250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89e0ea7da0f244aab58f9da579e53864", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75b84cf5-3a", "ovs_interfaceid": "75b84cf5-3aac-411c-acc8-a12b14a9f98a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:09:14.131197 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Converting VIF {"id": "75b84cf5-3aac-411c-acc8-a12b14a9f98a", "address": "fa:16:3e:68:a8:10", "network": {"id": "460fd532-ef54-4f63-922b-b9d9f73f665f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1504169250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89e0ea7da0f244aab58f9da579e53864", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75b84cf5-3a", "ovs_interfaceid": "75b84cf5-3aac-411c-acc8-a12b14a9f98a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:09:14.132370 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:a8:10,bridge_name='br-int',has_traffic_filtering=True,id=75b84cf5-3aac-411c-acc8-a12b14a9f98a,network=Network(460fd532-ef54-4f63-922b-b9d9f73f665f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75b84cf5-3a') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:09:14.132803 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:a8:10,bridge_name='br-int',has_traffic_filtering=True,id=75b84cf5-3aac-411c-acc8-a12b14a9f98a,network=Network(460fd532-ef54-4f63-922b-b9d9f73f665f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75b84cf5-3a') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:09:14.134542 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:14.134872 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75b84cf5-3a, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:09:14.136683 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:14.137852 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:09:14.150968 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:14.156759 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:14.156992 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=efc915ed-d2d3-4668-88cc-a37f4ef18f30) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:09:14.158516 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:14.158516 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:09:14.171819 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:14.175308 np0000001127 nova-compute[98206]: INFO os_vif [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:a8:10,bridge_name='br-int',has_traffic_filtering=True,id=75b84cf5-3aac-411c-acc8-a12b14a9f98a,network=Network(460fd532-ef54-4f63-922b-b9d9f73f665f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75b84cf5-3a')
May 21 02:09:14.178216 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:09:14.178682 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd65b4beb-8e98-46fc-b1d2-4193962d5bb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:09:14.178849 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:09:14.459405 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "refresh_cache-10c50913-8b08-402c-8ece-87c7521ce785" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:09:14.525306 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-3efaba43-6865-4534-8b51-c83034bad84b req-23c03a17-da7d-473c-9410-3b23795f74aa service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:14.546140 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: feb908f9-10aa-4ba0-8289-c76a3a6279c7] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:09:14.553955 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:14.593558 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:14.602542 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:09:14.602785 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:09:14.640399 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-3efaba43-6865-4534-8b51-c83034bad84b req-23c03a17-da7d-473c-9410-3b23795f74aa service nova] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:09:14.662233 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:14.693102 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:14.716499 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:09:14.716499 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:09:14.716499 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Creating image(s)
May 21 02:09:14.716499 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "/opt/stack/data/nova/instances/10c50913-8b08-402c-8ece-87c7521ce785/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:14.717214 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "/opt/stack/data/nova/instances/10c50913-8b08-402c-8ece-87c7521ce785/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:14.717214 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "/opt/stack/data/nova/instances/10c50913-8b08-402c-8ece-87c7521ce785/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:14.717673 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:09:14.721331 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:09:14.722220 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:14.756368 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:14.774128 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:14.850684 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.128s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:09:14.851506 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:14.851703 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:14.853625 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:09:14.858866 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:09:14.860111 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:14.911297 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-3efaba43-6865-4534-8b51-c83034bad84b req-23c03a17-da7d-473c-9410-3b23795f74aa service nova] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:09:14.915266 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:14.980220 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.120s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:09:14.981245 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/10c50913-8b08-402c-8ece-87c7521ce785/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:15.057100 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/10c50913-8b08-402c-8ece-87c7521ce785/disk 1073741824" returned: 0 in 0.075s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:09:15.057804 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:15.058234 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:15.108662 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:09:15.171205 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:15.171205 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:15.171205 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:15.171205 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.113s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:09:15.171629 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Checking if we can resize image /opt/stack/data/nova/instances/10c50913-8b08-402c-8ece-87c7521ce785/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:09:15.173679 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c50913-8b08-402c-8ece-87c7521ce785/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:15.198393 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:15.273027 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c50913-8b08-402c-8ece-87c7521ce785/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:09:15.275952 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Cannot resize image /opt/stack/data/nova/instances/10c50913-8b08-402c-8ece-87c7521ce785/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:09:15.275952 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:09:15.275952 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Ensure instance console log exists: /opt/stack/data/nova/instances/10c50913-8b08-402c-8ece-87c7521ce785/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:09:15.275952 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:15.275952 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:15.275952 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:15.419493 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-3efaba43-6865-4534-8b51-c83034bad84b req-23c03a17-da7d-473c-9410-3b23795f74aa service nova] Releasing lock "refresh_cache-10c50913-8b08-402c-8ece-87c7521ce785" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:09:15.421572 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquired lock "refresh_cache-10c50913-8b08-402c-8ece-87c7521ce785" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:09:15.424482 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:09:15.621276 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.745s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:15.621734 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:09:15.643774 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329355.6433964, 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:09:15.643893 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] VM Started (Lifecycle Event)
May 21 02:09:15.704327 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-dd30e339-9eea-48f8-85af-8c2881734f79 req-ca242a7e-42bd-4bbe-8ea6-4a3a365d0c71 service nova] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Received event network-vif-unplugged-75b84cf5-3aac-411c-acc8-a12b14a9f98a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:09:15.705119 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-dd30e339-9eea-48f8-85af-8c2881734f79 req-ca242a7e-42bd-4bbe-8ea6-4a3a365d0c71 service nova] Acquiring lock "45f01b41-a43c-4ddf-aa07-22f8c2c50758-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:15.705541 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-dd30e339-9eea-48f8-85af-8c2881734f79 req-ca242a7e-42bd-4bbe-8ea6-4a3a365d0c71 service nova] Lock "45f01b41-a43c-4ddf-aa07-22f8c2c50758-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:15.705768 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-dd30e339-9eea-48f8-85af-8c2881734f79 req-ca242a7e-42bd-4bbe-8ea6-4a3a365d0c71 service nova] Lock "45f01b41-a43c-4ddf-aa07-22f8c2c50758-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:15.706007 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-dd30e339-9eea-48f8-85af-8c2881734f79 req-ca242a7e-42bd-4bbe-8ea6-4a3a365d0c71 service nova] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] No waiting events found dispatching network-vif-unplugged-75b84cf5-3aac-411c-acc8-a12b14a9f98a {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:09:15.706237 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-dd30e339-9eea-48f8-85af-8c2881734f79 req-ca242a7e-42bd-4bbe-8ea6-4a3a365d0c71 service nova] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Received event network-vif-unplugged-75b84cf5-3aac-411c-acc8-a12b14a9f98a for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:09:15.706455 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-dd30e339-9eea-48f8-85af-8c2881734f79 req-ca242a7e-42bd-4bbe-8ea6-4a3a365d0c71 service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Received event network-vif-plugged-ad1def3b-4657-4632-bd3a-910cdca9a1a4 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:09:15.706737 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-dd30e339-9eea-48f8-85af-8c2881734f79 req-ca242a7e-42bd-4bbe-8ea6-4a3a365d0c71 service nova] Acquiring lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:15.709406 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-dd30e339-9eea-48f8-85af-8c2881734f79 req-ca242a7e-42bd-4bbe-8ea6-4a3a365d0c71 service nova] Lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:15.709406 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-dd30e339-9eea-48f8-85af-8c2881734f79 req-ca242a7e-42bd-4bbe-8ea6-4a3a365d0c71 service nova] Lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:15.709406 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-dd30e339-9eea-48f8-85af-8c2881734f79 req-ca242a7e-42bd-4bbe-8ea6-4a3a365d0c71 service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] No waiting events found dispatching network-vif-plugged-ad1def3b-4657-4632-bd3a-910cdca9a1a4 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:09:15.709406 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-dd30e339-9eea-48f8-85af-8c2881734f79 req-ca242a7e-42bd-4bbe-8ea6-4a3a365d0c71 service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Received unexpected event network-vif-plugged-ad1def3b-4657-4632-bd3a-910cdca9a1a4 for instance with vm_state active and task_state resize_finish.
May 21 02:09:15.709406 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-dd30e339-9eea-48f8-85af-8c2881734f79 req-ca242a7e-42bd-4bbe-8ea6-4a3a365d0c71 service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Received event network-vif-plugged-ad1def3b-4657-4632-bd3a-910cdca9a1a4 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:09:15.709406 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-dd30e339-9eea-48f8-85af-8c2881734f79 req-ca242a7e-42bd-4bbe-8ea6-4a3a365d0c71 service nova] Acquiring lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:15.709406 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-dd30e339-9eea-48f8-85af-8c2881734f79 req-ca242a7e-42bd-4bbe-8ea6-4a3a365d0c71 service nova] Lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:15.709406 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-dd30e339-9eea-48f8-85af-8c2881734f79 req-ca242a7e-42bd-4bbe-8ea6-4a3a365d0c71 service nova] Lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:15.709406 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-dd30e339-9eea-48f8-85af-8c2881734f79 req-ca242a7e-42bd-4bbe-8ea6-4a3a365d0c71 service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] No waiting events found dispatching network-vif-plugged-ad1def3b-4657-4632-bd3a-910cdca9a1a4 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:09:15.709406 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-dd30e339-9eea-48f8-85af-8c2881734f79 req-ca242a7e-42bd-4bbe-8ea6-4a3a365d0c71 service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Received unexpected event network-vif-plugged-ad1def3b-4657-4632-bd3a-910cdca9a1a4 for instance with vm_state active and task_state resize_finish.
May 21 02:09:15.709406 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-dd30e339-9eea-48f8-85af-8c2881734f79 req-ca242a7e-42bd-4bbe-8ea6-4a3a365d0c71 service nova] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Received event network-vif-plugged-7a096ac2-9c5b-4618-87c1-f2400619040e {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:09:15.709406 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-dd30e339-9eea-48f8-85af-8c2881734f79 req-ca242a7e-42bd-4bbe-8ea6-4a3a365d0c71 service nova] Acquiring lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:15.709406 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-dd30e339-9eea-48f8-85af-8c2881734f79 req-ca242a7e-42bd-4bbe-8ea6-4a3a365d0c71 service nova] Lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:15.709406 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-dd30e339-9eea-48f8-85af-8c2881734f79 req-ca242a7e-42bd-4bbe-8ea6-4a3a365d0c71 service nova] Lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:15.709406 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-dd30e339-9eea-48f8-85af-8c2881734f79 req-ca242a7e-42bd-4bbe-8ea6-4a3a365d0c71 service nova] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Processing event network-vif-plugged-7a096ac2-9c5b-4618-87c1-f2400619040e {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:09:15.709406 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-dd30e339-9eea-48f8-85af-8c2881734f79 req-ca242a7e-42bd-4bbe-8ea6-4a3a365d0c71 service nova] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Received event network-vif-plugged-7a096ac2-9c5b-4618-87c1-f2400619040e {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:09:15.709406 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-dd30e339-9eea-48f8-85af-8c2881734f79 req-ca242a7e-42bd-4bbe-8ea6-4a3a365d0c71 service nova] Acquiring lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:15.709406 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-dd30e339-9eea-48f8-85af-8c2881734f79 req-ca242a7e-42bd-4bbe-8ea6-4a3a365d0c71 service nova] Lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:15.709406 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-dd30e339-9eea-48f8-85af-8c2881734f79 req-ca242a7e-42bd-4bbe-8ea6-4a3a365d0c71 service nova] Lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:15.709406 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-dd30e339-9eea-48f8-85af-8c2881734f79 req-ca242a7e-42bd-4bbe-8ea6-4a3a365d0c71 service nova] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] No waiting events found dispatching network-vif-plugged-7a096ac2-9c5b-4618-87c1-f2400619040e {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:09:15.709406 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-dd30e339-9eea-48f8-85af-8c2881734f79 req-ca242a7e-42bd-4bbe-8ea6-4a3a365d0c71 service nova] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Received unexpected event network-vif-plugged-7a096ac2-9c5b-4618-87c1-f2400619040e for instance with vm_state building and task_state spawning.
May 21 02:09:15.710268 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:09:15.714694 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:09:15.718715 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Instance spawned successfully.
May 21 02:09:15.719243 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:09:15.739139 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Instance event wait completed in 0 seconds for  {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:09:15.744682 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Instance running successfully.
May 21 02:09:15.744682 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Failed to set time: agent not configured {{(pid=98206) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 21 02:09:15.744682 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f44c9501-8d05-46cb-8044-b643c71dc913 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] finish_migration finished successfully. {{(pid=98206) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 21 02:09:16.002893 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:09:16.129604 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:09:16.129905 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:09:16.130996 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:16.132661 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:16.147826 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:09:16.152253 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:09:16.231087 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:16.241764 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4878b5a5bf184852a9ce383caa1c67a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ebdb16aee84e22a88dfc8960debd32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:09:16.243372 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:09:16.243544 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:09:16.244067 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:09:16.244285 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:09:16.244649 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:09:16.244878 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:09:16.248820 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.070s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:09:16.249201 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd65b4beb-8e98-46fc-b1d2-4193962d5bb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:09:16.249495 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:09:16.306317 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:09:16.306317 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:09:16.306317 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:16.306317 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:16.306317 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:16.306317 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:16.306317 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:16.306317 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:16.306317 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:16.306317 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:16.306317 np0000001127 nova-compute[98206]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:16.306317 np0000001127 nova-compute[98206]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1e21ff6-120b-4e53-9a40-4d6981d32e62 (non-flash)
May 21 02:09:16.306317 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:16.306317 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:16.306317 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:09:16.308100 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:09:16.308100 np0000001127 nova-compute[98206]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9 (non-flash)
May 21 02:09:16.308100 np0000001127 nova-compute[98206]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:16.308100 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:16.308100 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:16.308100 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:16.308100 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:16.308100 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:16.308100 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:16.308100 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:16.308100 np0000001127 nova-compute[98206]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:16.308100 np0000001127 nova-compute[98206]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1e21ff6-120b-4e53-9a40-4d6981d32e62 (non-flash)
May 21 02:09:16.308100 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:16.308100 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:16.308100 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:09:16.308100 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', '118'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', '119'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', '132'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', '133'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', '134'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', '135'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515', '140'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515', '141'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a', '142'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1e21ff6-120b-4e53-9a40-4d6981d32e62', '143'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '95')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:09:16.308100 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', '102')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:09:16.309225 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9', '103')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:09:16.310009 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c0587d8180>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9'): ({'sdk'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:09:16.310182 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Removing multipathed devices sdk, sdj {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:09:16.310293 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Flush multipath device 3300000006ec347e2 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:09:16.388997 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:09:16.430803 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:09:16.439180 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Updating instance_info_cache with network_info: [{"id": "a149f43d-6c97-4b80-9bd8-353fb7be0630", "address": "fa:16:3e:2c:b3:6f", "network": {"id": "dec0dbdb-dfbe-4a3d-9d29-6add07c9003f", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-775185877-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ae2ef74a1614eb09e4f71f709f64126", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa149f43d-6c", "ovs_interfaceid": "a149f43d-6c97-4b80-9bd8-353fb7be0630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:09:16.477927 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:09:16.478170 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:09:16.480241 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:09:16.494566 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:09:16.494924 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:09:16.511989 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:16.532422 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0005024229999435192 future=<Future at 0x71c058489eb0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:09:16.532615 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:09:16.532975 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Emitting event <LifecycleEvent: 1779329341.5317998, c76064e6-3702-4e67-9d4f-ef67cd4b7b22 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:09:16.533120 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=12.090967406000345 future=<Future at 0x71c07c5d51f0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:09:16.533211 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=12.090866168000048 future=<Future at 0x71c07c5d51f0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:09:16.536659 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] VM Stopped (Lifecycle Event)
May 21 02:09:16.563276 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 102, target: iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9, portal: 192.168.40.100,3260]
May 21 02:09:16.563276 np0000001127 nova-compute[98206]: Logout of [sid: 102, target: iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9, portal: 192.168.40.100,3260] successful.
May 21 02:09:16.563276 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:16.589869 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:16.601488 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:16.634994 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:09:16.656655 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 103, target: iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9, portal: 192.168.50.100,3260]
May 21 02:09:16.656655 np0000001127 nova-compute[98206]: Logout of [sid: 103, target: iqn.2023-03.storpool.com:os--volume-d65b4beb-8e98-46fc-b1d2-4193962d5bb9, portal: 192.168.50.100,3260] successful.
May 21 02:09:16.656655 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:16.658239 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:09:16.658531 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329356.6583147, 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:09:16.658686 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] VM Paused (Lifecycle Event)
May 21 02:09:16.689236 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:16.691539 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.441s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:09:16.691539 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] <== disconnect_volume: return (2511ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:09:16.691539 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:09:16.691539 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Deleting instance files /opt/stack/data/nova/instances/45f01b41-a43c-4ddf-aa07-22f8c2c50758_del
May 21 02:09:16.691539 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Deletion of /opt/stack/data/nova/instances/45f01b41-a43c-4ddf-aa07-22f8c2c50758_del complete
May 21 02:09:16.750032 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:16.753079 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Took 7.71 seconds to spawn the instance on the hypervisor.
May 21 02:09:16.753079 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:09:16.876201 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Successfully created port: 5142d614-fe12-4ae6-a0ed-8c5658b5505b {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:09:16.941485 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Releasing lock "refresh_cache-10c50913-8b08-402c-8ece-87c7521ce785" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:09:16.941485 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Instance network_info: |[{"id": "a149f43d-6c97-4b80-9bd8-353fb7be0630", "address": "fa:16:3e:2c:b3:6f", "network": {"id": "dec0dbdb-dfbe-4a3d-9d29-6add07c9003f", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-775185877-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ae2ef74a1614eb09e4f71f709f64126", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa149f43d-6c", "ovs_interfaceid": "a149f43d-6c97-4b80-9bd8-353fb7be0630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:09:16.943426 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Start _get_guest_xml network_info=[{"id": "a149f43d-6c97-4b80-9bd8-353fb7be0630", "address": "fa:16:3e:2c:b3:6f", "network": {"id": "dec0dbdb-dfbe-4a3d-9d29-6add07c9003f", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-775185877-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ae2ef74a1614eb09e4f71f709f64126", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa149f43d-6c", "ovs_interfaceid": "a149f43d-6c97-4b80-9bd8-353fb7be0630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:09:16.950493 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:09:16.950493 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-1258436483', uuid='10c50913-8b08-402c-8ece-87c7521ce785'), owner=OwnerMeta(userid='01cc41344ae640f6aa9c6142252838b2', username='tempest-VolumeMultiattachTests-1039130224-project-member', projectid='4ae2ef74a1614eb09e4f71f709f64126', projectname='tempest-VolumeMultiattachTests-1039130224'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a149f43d-6c97-4b80-9bd8-353fb7be0630", "address": "fa:16:3e:2c:b3:6f", "network": {"id": "dec0dbdb-dfbe-4a3d-9d29-6add07c9003f", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-775185877-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ae2ef74a1614eb09e4f71f709f64126", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa149f43d-6c", "ovs_interfaceid": "a149f43d-6c97-4b80-9bd8-353fb7be0630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329356.9496682) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:09:16.951793 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:09:16.952292 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:09:16.954314 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:09:16.954671 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:09:16.955705 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:09:16.956100 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:09:16.956438 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:09:16.956642 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:09:16.956825 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:09:16.956987 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:09:16.957134 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:09:16.957322 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:09:16.957523 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:09:16.957735 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:09:16.957934 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:09:16.958118 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:09:16.967982 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:09:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1258436483',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumemultiattachtests-server-1258436483',id=64,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG49/r2Ab7Qm1KfDPUwJai4qjLSCzazkse8keaGMf9RDSFnwzlyAfx0W/eKq+/pIZ6H88F7NAAW2g3zgnzAemSR+PHn4ESPDrxs+tFUrSTfyQy6BP7J2Yru23PLQSySpLA==',key_name='tempest-keypair-1913749436',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ae2ef74a1614eb09e4f71f709f64126',ramdisk_id='',reservation_id='r-ufnata00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1039130224',owner_user_name='tempest-VolumeMultiattachTests-1039130224-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:09:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01cc41344ae640f6aa9c6142252838b2',uuid=10c50913-8b08-402c-8ece-87c7521ce785,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a149f43d-6c97-4b80-9bd8-353fb7be0630", "address": "fa:16:3e:2c:b3:6f", "network": {"id": "dec0dbdb-dfbe-4a3d-9d29-6add07c9003f", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-775185877-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ae2ef74a1614eb09e4f71f709f64126", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa149f43d-6c", "ovs_interfaceid": "a149f43d-6c97-4b80-9bd8-353fb7be0630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:09:16.970114 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Converting VIF {"id": "a149f43d-6c97-4b80-9bd8-353fb7be0630", "address": "fa:16:3e:2c:b3:6f", "network": {"id": "dec0dbdb-dfbe-4a3d-9d29-6add07c9003f", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-775185877-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ae2ef74a1614eb09e4f71f709f64126", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa149f43d-6c", "ovs_interfaceid": "a149f43d-6c97-4b80-9bd8-353fb7be0630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:09:16.970114 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:b3:6f,bridge_name='br-int',has_traffic_filtering=True,id=a149f43d-6c97-4b80-9bd8-353fb7be0630,network=Network(dec0dbdb-dfbe-4a3d-9d29-6add07c9003f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa149f43d-6c') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:09:16.970114 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lazy-loading 'pci_devices' on Instance uuid 10c50913-8b08-402c-8ece-87c7521ce785 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:09:17.039043 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:09:17.142280 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:09:17.162786 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:09:17.176147 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329357.1748354, 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:09:17.176147 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] VM Resumed (Lifecycle Event)
May 21 02:09:17.199843 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Took 3.92 seconds to destroy the instance on the hypervisor.
May 21 02:09:17.200595 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:09:17.203317 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:09:17.203317 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:09:17.203317 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:17.280565 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-481ff279-85b1-45f7-9dc5-46bc1f76fc69 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:17.282056 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Took 15.17 seconds to build instance.
May 21 02:09:17.286575 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-481ff279-85b1-45f7-9dc5-46bc1f76fc69 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:17.287246 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-481ff279-85b1-45f7-9dc5-46bc1f76fc69 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Going to confirm migration 4 {{(pid=98206) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 21 02:09:17.290352 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:17.427405 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Successfully updated port: 5142d614-fe12-4ae6-a0ed-8c5658b5505b {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:09:17.472243 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] End _get_guest_xml xml=<domain type="qemu">
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:   <uuid>10c50913-8b08-402c-8ece-87c7521ce785</uuid>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:   <name>instance-00000040</name>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:       <nova:name>tempest-VolumeMultiattachTests-server-1258436483</nova:name>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:09:16</nova:creationTime>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:         <nova:user uuid="01cc41344ae640f6aa9c6142252838b2">tempest-VolumeMultiattachTests-1039130224-project-member</nova:user>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:         <nova:project uuid="4ae2ef74a1614eb09e4f71f709f64126">tempest-VolumeMultiattachTests-1039130224</nova:project>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:         <nova:port uuid="a149f43d-6c97-4b80-9bd8-353fb7be0630">
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:     <system>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:       <entry name="serial">10c50913-8b08-402c-8ece-87c7521ce785</entry>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:       <entry name="uuid">10c50913-8b08-402c-8ece-87c7521ce785</entry>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:     </system>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:   <os>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:   </os>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:   <features>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:   </features>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:   <devices>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/10c50913-8b08-402c-8ece-87c7521ce785/disk"/>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:     </disk>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/10c50913-8b08-402c-8ece-87c7521ce785/disk.config"/>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:     </disk>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:2c:b3:6f"/>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:       <target dev="tapa149f43d-6c"/>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:     </interface>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/10c50913-8b08-402c-8ece-87c7521ce785/console.log" append="off"/>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:     </serial>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:     <video>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:     </video>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:     </rng>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:   </devices>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]: </domain>
May 21 02:09:17.472243 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:09:17.474626 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Preparing to wait for external event network-vif-plugged-a149f43d-6c97-4b80-9bd8-353fb7be0630 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:09:17.474626 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "10c50913-8b08-402c-8ece-87c7521ce785-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:17.474626 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "10c50913-8b08-402c-8ece-87c7521ce785-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:17.474626 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "10c50913-8b08-402c-8ece-87c7521ce785-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:17.474626 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:09:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1258436483',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumemultiattachtests-server-1258436483',id=64,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG49/r2Ab7Qm1KfDPUwJai4qjLSCzazkse8keaGMf9RDSFnwzlyAfx0W/eKq+/pIZ6H88F7NAAW2g3zgnzAemSR+PHn4ESPDrxs+tFUrSTfyQy6BP7J2Yru23PLQSySpLA==',key_name='tempest-keypair-1913749436',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ae2ef74a1614eb09e4f71f709f64126',ramdisk_id='',reservation_id='r-ufnata00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1039130224',owner_user_name='tempest-VolumeMultiattachTests-1039130224-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:09:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01cc41344ae640f6aa9c6142252838b2',uuid=10c50913-8b08-402c-8ece-87c7521ce785,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a149f43d-6c97-4b80-9bd8-353fb7be0630", "address": "fa:16:3e:2c:b3:6f", "network": {"id": "dec0dbdb-dfbe-4a3d-9d29-6add07c9003f", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-775185877-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ae2ef74a1614eb09e4f71f709f64126", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa149f43d-6c", "ovs_interfaceid": "a149f43d-6c97-4b80-9bd8-353fb7be0630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:09:17.474626 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Converting VIF {"id": "a149f43d-6c97-4b80-9bd8-353fb7be0630", "address": "fa:16:3e:2c:b3:6f", "network": {"id": "dec0dbdb-dfbe-4a3d-9d29-6add07c9003f", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-775185877-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ae2ef74a1614eb09e4f71f709f64126", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa149f43d-6c", "ovs_interfaceid": "a149f43d-6c97-4b80-9bd8-353fb7be0630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:09:17.474626 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:b3:6f,bridge_name='br-int',has_traffic_filtering=True,id=a149f43d-6c97-4b80-9bd8-353fb7be0630,network=Network(dec0dbdb-dfbe-4a3d-9d29-6add07c9003f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa149f43d-6c') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:09:17.474626 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:b3:6f,bridge_name='br-int',has_traffic_filtering=True,id=a149f43d-6c97-4b80-9bd8-353fb7be0630,network=Network(dec0dbdb-dfbe-4a3d-9d29-6add07c9003f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa149f43d-6c') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:09:17.477098 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:17.477478 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:09:17.477784 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:09:17.479560 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:17.487465 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0dd1096a-456e-59cb-b771-58ed48c6eb85', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:09:17.488296 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f10e1185-de41-4c6d-bf80-592bf22ec8a0 req-e064bcee-8da7-4325-a17a-3dd48c5a64d4 service nova] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Received event network-changed-5142d614-fe12-4ae6-a0ed-8c5658b5505b {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:09:17.488494 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f10e1185-de41-4c6d-bf80-592bf22ec8a0 req-e064bcee-8da7-4325-a17a-3dd48c5a64d4 service nova] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Refreshing instance network info cache due to event network-changed-5142d614-fe12-4ae6-a0ed-8c5658b5505b. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:09:17.488690 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f10e1185-de41-4c6d-bf80-592bf22ec8a0 req-e064bcee-8da7-4325-a17a-3dd48c5a64d4 service nova] Acquiring lock "refresh_cache-cec9e114-b934-4de6-b0f0-586cd34a59bd" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:09:17.488808 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f10e1185-de41-4c6d-bf80-592bf22ec8a0 req-e064bcee-8da7-4325-a17a-3dd48c5a64d4 service nova] Acquired lock "refresh_cache-cec9e114-b934-4de6-b0f0-586cd34a59bd" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:09:17.488924 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-f10e1185-de41-4c6d-bf80-592bf22ec8a0 req-e064bcee-8da7-4325-a17a-3dd48c5a64d4 service nova] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Refreshing network info cache for port 5142d614-fe12-4ae6-a0ed-8c5658b5505b {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:09:17.490616 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:17.491638 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:09:17.495974 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:17.496168 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa149f43d-6c, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:09:17.496577 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa149f43d-6c, col_values=(('qos', UUID('816990c0-d861-4d62-8309-abd9be33135c')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:09:17.496783 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa149f43d-6c, col_values=(('external_ids', {'iface-id': 'a149f43d-6c97-4b80-9bd8-353fb7be0630', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:b3:6f', 'vm-uuid': '10c50913-8b08-402c-8ece-87c7521ce785'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:09:17.498684 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:17.500199 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:09:17.505999 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:17.507067 np0000001127 nova-compute[98206]: INFO os_vif [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:b3:6f,bridge_name='br-int',has_traffic_filtering=True,id=a149f43d-6c97-4b80-9bd8-353fb7be0630,network=Network(dec0dbdb-dfbe-4a3d-9d29-6add07c9003f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa149f43d-6c')
May 21 02:09:17.646698 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Booting with volume 7ea6075d-0c38-4100-9259-e68a64fa39fe at /dev/vda
May 21 02:09:17.677686 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:09:17.680452 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:09:17.692437 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:09:17.706506 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:09:17.741973 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:17.790032 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.693s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:17.801747 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-481ff279-85b1-45f7-9dc5-46bc1f76fc69 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:17.805124 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:09:17.805355 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:09:17.815172 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:09:17.816336 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe21:7993', 'fe80::2482:bff:fe1b:902b', 'fe80::fc16:3eff:fe20:ae96', 'fe80::fc16:3eff:fe5c:a90d', 'fe80::786b:86ff:fe32:8f96', 'fe80::fc16:3eff:fe0f:28a1', 'fe80::440a:38ff:fe27:fa24', 'fe80::fc16:3eff:fefb:4d96', 'fe80::fc16:3eff:fe65:6557', 'fe80::fc16:3eff:feb8:d101', 'fe80::7045:30ff:fe1a:b99f', 'fe80::fc16:3eff:fedb:8dd'] 
May 21 02:09:17.816455 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:09:17.816580 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:09:17.820268 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:09:17.820422 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Updating existing volume attachment record: 313d1a49-06b3-4b7f-ac7b-0c274f3c47c7 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:09:17.830635 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1d4b234c-75f2-4377-a2ac-f8476047ec02 req-73b64f33-cb1e-474a-b043-2daebe311cdc service nova] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Received event network-vif-deleted-75b84cf5-3aac-411c-acc8-a12b14a9f98a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:09:17.830831 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-1d4b234c-75f2-4377-a2ac-f8476047ec02 req-73b64f33-cb1e-474a-b043-2daebe311cdc service nova] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Neutron deleted interface 75b84cf5-3aac-411c-acc8-a12b14a9f98a; detaching it from the instance and deleting it from the info cache
May 21 02:09:17.831025 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-1d4b234c-75f2-4377-a2ac-f8476047ec02 req-73b64f33-cb1e-474a-b043-2daebe311cdc service nova] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:09:17.928921 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "refresh_cache-cec9e114-b934-4de6-b0f0-586cd34a59bd" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:09:17.934914 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-481ff279-85b1-45f7-9dc5-46bc1f76fc69 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:17.934914 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-481ff279-85b1-45f7-9dc5-46bc1f76fc69 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "refresh_cache-c76064e6-3702-4e67-9d4f-ef67cd4b7b22" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:09:17.934914 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-481ff279-85b1-45f7-9dc5-46bc1f76fc69 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquired lock "refresh_cache-c76064e6-3702-4e67-9d4f-ef67cd4b7b22" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:09:17.934914 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-481ff279-85b1-45f7-9dc5-46bc1f76fc69 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:09:17.934914 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-481ff279-85b1-45f7-9dc5-46bc1f76fc69 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lazy-loading 'info_cache' on Instance uuid c76064e6-3702-4e67-9d4f-ef67cd4b7b22 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:09:17.993376 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-f10e1185-de41-4c6d-bf80-592bf22ec8a0 req-e064bcee-8da7-4325-a17a-3dd48c5a64d4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:18.076300 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-f10e1185-de41-4c6d-bf80-592bf22ec8a0 req-e064bcee-8da7-4325-a17a-3dd48c5a64d4 service nova] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:09:18.185871 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329358.1855154, c76064e6-3702-4e67-9d4f-ef67cd4b7b22 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:09:18.186389 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] VM Resumed (Lifecycle Event)
May 21 02:09:18.246267 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-f10e1185-de41-4c6d-bf80-592bf22ec8a0 req-e064bcee-8da7-4325-a17a-3dd48c5a64d4 service nova] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:09:18.267876 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:09:18.341178 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1d4b234c-75f2-4377-a2ac-f8476047ec02 req-73b64f33-cb1e-474a-b043-2daebe311cdc service nova] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Detach interface failed, port_id=75b84cf5-3aac-411c-acc8-a12b14a9f98a, reason: Instance 45f01b41-a43c-4ddf-aa07-22f8c2c50758 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:09:18.688316 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:09:18.690571 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:09:18.748228 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f10e1185-de41-4c6d-bf80-592bf22ec8a0 req-e064bcee-8da7-4325-a17a-3dd48c5a64d4 service nova] Releasing lock "refresh_cache-cec9e114-b934-4de6-b0f0-586cd34a59bd" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:09:18.748464 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquired lock "refresh_cache-cec9e114-b934-4de6-b0f0-586cd34a59bd" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:09:18.748579 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:09:18.772173 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Took 1.57 seconds to deallocate network for instance.
May 21 02:09:18.944062 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-481ff279-85b1-45f7-9dc5-46bc1f76fc69 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:19.042668 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:09:19.042668 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:09:19.042668 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] No VIF found with MAC fa:16:3e:2c:b3:6f, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:09:19.043223 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Using config drive
May 21 02:09:19.194067 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329359.1936002, c76064e6-3702-4e67-9d4f-ef67cd4b7b22 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:09:19.194252 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] VM Started (Lifecycle Event)
May 21 02:09:19.252459 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-481ff279-85b1-45f7-9dc5-46bc1f76fc69 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:19.333991 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:09:19.342359 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Took 0.57 seconds to detach 1 volumes for instance.
May 21 02:09:19.431510 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-481ff279-85b1-45f7-9dc5-46bc1f76fc69 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Updating instance_info_cache with network_info: [{"id": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "address": "fa:16:3e:20:ae:96", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1def3b-46", "ovs_interfaceid": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:09:19.547457 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:19.553918 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:19.560131 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d8af701e-3b73-4d17-84d8-898f6b98c1e0 req-788599a7-42a4-4e29-b69a-e34de8d48e0e service nova] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Received event network-changed-7a096ac2-9c5b-4618-87c1-f2400619040e {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:09:19.560288 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d8af701e-3b73-4d17-84d8-898f6b98c1e0 req-788599a7-42a4-4e29-b69a-e34de8d48e0e service nova] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Refreshing instance network info cache due to event network-changed-7a096ac2-9c5b-4618-87c1-f2400619040e. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:09:19.562907 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d8af701e-3b73-4d17-84d8-898f6b98c1e0 req-788599a7-42a4-4e29-b69a-e34de8d48e0e service nova] Acquiring lock "refresh_cache-0c15c9f3-e0d2-4d6d-9144-b9760c55be0e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:09:19.563016 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d8af701e-3b73-4d17-84d8-898f6b98c1e0 req-788599a7-42a4-4e29-b69a-e34de8d48e0e service nova] Acquired lock "refresh_cache-0c15c9f3-e0d2-4d6d-9144-b9760c55be0e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:09:19.563124 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-d8af701e-3b73-4d17-84d8-898f6b98c1e0 req-788599a7-42a4-4e29-b69a-e34de8d48e0e service nova] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Refreshing network info cache for port 7a096ac2-9c5b-4618-87c1-f2400619040e {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:09:19.697195 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:09:19.701651 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:09:19.723225 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Creating config drive at /opt/stack/data/nova/instances/10c50913-8b08-402c-8ece-87c7521ce785/disk.config
May 21 02:09:19.727567 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/10c50913-8b08-402c-8ece-87c7521ce785/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbg2cccw4 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:19.749385 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Updating instance_info_cache with network_info: [{"id": "5142d614-fe12-4ae6-a0ed-8c5658b5505b", "address": "fa:16:3e:30:16:4f", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5142d614-fe", "ovs_interfaceid": "5142d614-fe12-4ae6-a0ed-8c5658b5505b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:09:19.811346 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/10c50913-8b08-402c-8ece-87c7521ce785/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbg2cccw4" returned: 0 in 0.083s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:09:19.853457 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:19.853673 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:19.936994 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-481ff279-85b1-45f7-9dc5-46bc1f76fc69 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Releasing lock "refresh_cache-c76064e6-3702-4e67-9d4f-ef67cd4b7b22" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:09:19.938803 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-481ff279-85b1-45f7-9dc5-46bc1f76fc69 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lazy-loading 'migration_context' on Instance uuid c76064e6-3702-4e67-9d4f-ef67cd4b7b22 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:09:19.943789 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:09:19.945442 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:09:19.946341 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Creating image(s)
May 21 02:09:19.946817 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Did not create local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 21 02:09:19.947019 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Ensure instance console log exists: /opt/stack/data/nova/instances/cec9e114-b934-4de6-b0f0-586cd34a59bd/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:09:19.947341 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:19.947577 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:19.947988 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:20.066207 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-d8af701e-3b73-4d17-84d8-898f6b98c1e0 req-788599a7-42a4-4e29-b69a-e34de8d48e0e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:20.253490 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Releasing lock "refresh_cache-cec9e114-b934-4de6-b0f0-586cd34a59bd" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:09:20.253490 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Instance network_info: |[{"id": "5142d614-fe12-4ae6-a0ed-8c5658b5505b", "address": "fa:16:3e:30:16:4f", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5142d614-fe", "ovs_interfaceid": "5142d614-fe12-4ae6-a0ed-8c5658b5505b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:09:20.254519 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Start _get_guest_xml network_info=[{"id": "5142d614-fe12-4ae6-a0ed-8c5658b5505b", "address": "fa:16:3e:30:16:4f", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5142d614-fe", "ovs_interfaceid": "5142d614-fe12-4ae6-a0ed-8c5658b5505b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7ea6075d-0c38-4100-9259-e68a64fa39fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'cec9e114-b934-4de6-b0f0-586cd34a59bd', 'attached_at': '', 'detached_at': '', 'volume_id': '7ea6075d-0c38-4100-9259-e68a64fa39fe', 'serial': '7ea6075d-0c38-4100-9259-e68a64fa39fe'}, 'delete_on_termination': True, 'attachment_id': '313d1a49-06b3-4b7f-ac7b-0c274f3c47c7', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:09:20.264154 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:09:20.269527 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-volume-backed-server-613838180', uuid='cec9e114-b934-4de6-b0f0-586cd34a59bd'), owner=OwnerMeta(userid='4878b5a5bf184852a9ce383caa1c67a4', username='tempest-TestVolumeBootPattern-1995806391-project-member', projectid='62ebdb16aee84e22a88dfc8960debd32', projectname='tempest-TestVolumeBootPattern-1995806391'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5142d614-fe12-4ae6-a0ed-8c5658b5505b", "address": "fa:16:3e:30:16:4f", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5142d614-fe", "ovs_interfaceid": "5142d614-fe12-4ae6-a0ed-8c5658b5505b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329360.268065) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:09:20.269527 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:20.286378 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:09:20.286378 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:09:20.288523 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:09:20.288810 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:09:20.290388 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:09:20.291483 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:09:20.291483 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:09:20.291483 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:09:20.291483 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:09:20.292219 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:09:20.292219 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:09:20.292219 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:09:20.292364 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:09:20.292437 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:09:20.292606 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:09:20.292776 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:09:20.303708 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:20.319267 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:09:20.319949 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7ea6075d-0c38-4100-9259-e68a64fa39fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:09:20.320190 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:09:20.320820 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:09:20.320909 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7ea6075d-0c38-4100-9259-e68a64fa39fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:09:20.345226 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:09:20.345916 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:09:20.346353 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:09:20.346573 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:09:20.347541 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:09:20.347541 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:09:20.366296 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:09:20.366296 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:20.372768 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:09:20.372768 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:20.385071 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe] added
May 21 02:09:20.385071 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:09:20.385071 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:09:20.385071 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:09:20.385071 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:09:20.385071 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:09:20.385071 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:20.385431 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:09:20.389499 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.039(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:09:20.389499 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:09:20.393128 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe] added
May 21 02:09:20.393128 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:09:20.393128 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:09:20.393128 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:09:20.393128 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:09:20.393128 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:09:20.393128 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:20.393339 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:09:20.393460 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0462(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:09:20.393632 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:09:20.423898 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:20.445991 np0000001127 nova-compute[98206]: DEBUG nova.objects.base [None req-481ff279-85b1-45f7-9dc5-46bc1f76fc69 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Object Instance<c76064e6-3702-4e67-9d4f-ef67cd4b7b22> lazy-loaded attributes: info_cache,migration_context {{(pid=98206) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 21 02:09:20.452822 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-481ff279-85b1-45f7-9dc5-46bc1f76fc69 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:20.512741 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:20.514199 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:20.622009 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-d8af701e-3b73-4d17-84d8-898f6b98c1e0 req-788599a7-42a4-4e29-b69a-e34de8d48e0e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:20.635354 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:09:20.635668 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:09:20.780316 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:20.856492 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-d8af701e-3b73-4d17-84d8-898f6b98c1e0 req-788599a7-42a4-4e29-b69a-e34de8d48e0e service nova] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Updated VIF entry in instance network info cache for port 7a096ac2-9c5b-4618-87c1-f2400619040e. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:09:20.856492 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-d8af701e-3b73-4d17-84d8-898f6b98c1e0 req-788599a7-42a4-4e29-b69a-e34de8d48e0e service nova] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Updating instance_info_cache with network_info: [{"id": "7a096ac2-9c5b-4618-87c1-f2400619040e", "address": "fa:16:3e:5c:a9:0d", "network": {"id": "b49de03c-44bf-47f0-a925-60ba84dd5b07", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-970460078-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c062763c08b4e5190a5351babe96c84", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a096ac2-9c", "ovs_interfaceid": "7a096ac2-9c5b-4618-87c1-f2400619040e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:09:21.138705 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:09:21.232167 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329361.2318375, 10c50913-8b08-402c-8ece-87c7521ce785 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:09:21.232361 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] VM Started (Lifecycle Event)
May 21 02:09:21.360498 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d8af701e-3b73-4d17-84d8-898f6b98c1e0 req-788599a7-42a4-4e29-b69a-e34de8d48e0e service nova] Releasing lock "refresh_cache-0c15c9f3-e0d2-4d6d-9144-b9760c55be0e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:09:21.388623 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:09:21.394063 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:09:21.406683 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:09:21.406683 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:09:21.414070 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:09:21.414070 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:21.424232 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:21.431700 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:21.441056 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:21.441056 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:21.441056 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:21.441056 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:21.441056 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:21.441056 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:21.441056 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:21.441056 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:21.441056 np0000001127 nova-compute[98206]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:21.441056 np0000001127 nova-compute[98206]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1e21ff6-120b-4e53-9a40-4d6981d32e62 (non-flash)
May 21 02:09:21.441056 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:21.441056 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:21.441056 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:09:21.441459 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:21.441459 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:21.441459 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:21.441459 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:21.441459 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:21.441459 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:21.441459 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:21.441459 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:21.441459 np0000001127 nova-compute[98206]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:21.441459 np0000001127 nova-compute[98206]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1e21ff6-120b-4e53-9a40-4d6981d32e62 (non-flash)
May 21 02:09:21.441459 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:21.441459 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:21.441459 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:09:21.452209 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:21.452209 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:21.452209 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:21.452209 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:21.452209 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:21.452209 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:21.452209 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:21.452209 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:21.452209 np0000001127 nova-compute[98206]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:21.452209 np0000001127 nova-compute[98206]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1e21ff6-120b-4e53-9a40-4d6981d32e62 (non-flash)
May 21 02:09:21.452209 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:21.452209 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:21.452209 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:09:21.452697 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:21.452697 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:21.452697 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:21.452697 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:21.452697 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:21.452697 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:21.452697 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:21.452697 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:21.452697 np0000001127 nova-compute[98206]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:21.452697 np0000001127 nova-compute[98206]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1e21ff6-120b-4e53-9a40-4d6981d32e62 (non-flash)
May 21 02:09:21.452697 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:21.452697 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:21.452697 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:09:21.503595 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe, portal: 192.168.40.100,3260]
May 21 02:09:21.503595 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe, portal: 192.168.40.100,3260] successful.
May 21 02:09:21.503595 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:21.519492 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:21.525859 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe, portal: 192.168.50.100,3260]
May 21 02:09:21.525859 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe, portal: 192.168.50.100,3260] successful.
May 21 02:09:21.525859 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:21.538359 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:21.539103 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:21.539103 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:21.539103 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:21.539103 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:21.539103 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:21.539103 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:21.539103 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:21.539103 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:21.539103 np0000001127 nova-compute[98206]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:21.539103 np0000001127 nova-compute[98206]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1e21ff6-120b-4e53-9a40-4d6981d32e62 (non-flash)
May 21 02:09:21.539103 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:21.539103 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:21.539103 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:21.539103 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:21.539103 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:09:21.539436 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:21.539436 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:21.539436 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:21.539436 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:21.539436 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:21.539436 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:21.539436 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:21.539436 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:21.539436 np0000001127 nova-compute[98206]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:21.539436 np0000001127 nova-compute[98206]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1e21ff6-120b-4e53-9a40-4d6981d32e62 (non-flash)
May 21 02:09:21.539436 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:21.539436 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:21.539436 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:21.539436 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:21.539436 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:09:21.539715 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.193s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:09:21.539715 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:09:21.541236 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] HCTL ('15', '-', '-', 0) found on session 144 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:09:21.541395 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:09:21.557795 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching for a device in session 144 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:09:21.558167 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7ea6075d-0c38-4100-9259-e68a64fa39fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:09:21.562018 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:21.562018 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:21.562018 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:21.562018 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:21.562018 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:21.562018 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:21.562018 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:21.562018 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:21.562018 np0000001127 nova-compute[98206]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:21.562018 np0000001127 nova-compute[98206]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1e21ff6-120b-4e53-9a40-4d6981d32e62 (non-flash)
May 21 02:09:21.562018 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:21.562018 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:21.562018 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:21.562018 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:21.562018 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:09:21.562371 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:21.562371 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:21.562371 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:21.562371 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:21.562371 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:21.562371 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:21.562371 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:21.562371 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:21.562371 np0000001127 nova-compute[98206]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:21.562371 np0000001127 nova-compute[98206]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1e21ff6-120b-4e53-9a40-4d6981d32e62 (non-flash)
May 21 02:09:21.562371 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:21.562371 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:21.562371 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:21.562371 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:21.562371 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:09:21.562698 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.216s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:09:21.562698 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:09:21.564020 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] HCTL ('16', '-', '-', 0) found on session 145 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:09:21.564149 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:09:21.582834 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching for a device in session 145 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:09:21.582981 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7ea6075d-0c38-4100-9259-e68a64fa39fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:09:21.629579 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7ea48c8f-ae53-48ff-a0a2-4ae5ca0520fe req-b5c9fc8c-b257-4d23-95d5-301fa00203d3 service nova] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Received event network-vif-plugged-a149f43d-6c97-4b80-9bd8-353fb7be0630 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:09:21.629822 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7ea48c8f-ae53-48ff-a0a2-4ae5ca0520fe req-b5c9fc8c-b257-4d23-95d5-301fa00203d3 service nova] Acquiring lock "10c50913-8b08-402c-8ece-87c7521ce785-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:21.630040 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7ea48c8f-ae53-48ff-a0a2-4ae5ca0520fe req-b5c9fc8c-b257-4d23-95d5-301fa00203d3 service nova] Lock "10c50913-8b08-402c-8ece-87c7521ce785-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:21.630439 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7ea48c8f-ae53-48ff-a0a2-4ae5ca0520fe req-b5c9fc8c-b257-4d23-95d5-301fa00203d3 service nova] Lock "10c50913-8b08-402c-8ece-87c7521ce785-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:21.630606 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7ea48c8f-ae53-48ff-a0a2-4ae5ca0520fe req-b5c9fc8c-b257-4d23-95d5-301fa00203d3 service nova] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Processing event network-vif-plugged-a149f43d-6c97-4b80-9bd8-353fb7be0630 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:09:21.630727 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7ea48c8f-ae53-48ff-a0a2-4ae5ca0520fe req-b5c9fc8c-b257-4d23-95d5-301fa00203d3 service nova] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Received event network-vif-plugged-a149f43d-6c97-4b80-9bd8-353fb7be0630 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:09:21.630842 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7ea48c8f-ae53-48ff-a0a2-4ae5ca0520fe req-b5c9fc8c-b257-4d23-95d5-301fa00203d3 service nova] Acquiring lock "10c50913-8b08-402c-8ece-87c7521ce785-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:21.631002 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7ea48c8f-ae53-48ff-a0a2-4ae5ca0520fe req-b5c9fc8c-b257-4d23-95d5-301fa00203d3 service nova] Lock "10c50913-8b08-402c-8ece-87c7521ce785-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:21.631087 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7ea48c8f-ae53-48ff-a0a2-4ae5ca0520fe req-b5c9fc8c-b257-4d23-95d5-301fa00203d3 service nova] Lock "10c50913-8b08-402c-8ece-87c7521ce785-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:21.631639 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7ea48c8f-ae53-48ff-a0a2-4ae5ca0520fe req-b5c9fc8c-b257-4d23-95d5-301fa00203d3 service nova] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] No waiting events found dispatching network-vif-plugged-a149f43d-6c97-4b80-9bd8-353fb7be0630 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:09:21.631639 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-7ea48c8f-ae53-48ff-a0a2-4ae5ca0520fe req-b5c9fc8c-b257-4d23-95d5-301fa00203d3 service nova] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Received unexpected event network-vif-plugged-a149f43d-6c97-4b80-9bd8-353fb7be0630 for instance with vm_state building and task_state spawning.
May 21 02:09:21.632600 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:09:21.635405 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:09:21.637641 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Instance spawned successfully.
May 21 02:09:21.638002 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:09:21.646456 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.793s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:21.648071 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-481ff279-85b1-45f7-9dc5-46bc1f76fc69 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 1.194s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:21.726095 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Deleted allocations for instance 45f01b41-a43c-4ddf-aa07-22f8c2c50758
May 21 02:09:21.734708 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:09:21.741400 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:09:21.758796 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:22.150646 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:09:22.151035 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:09:22.151201 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:09:22.151435 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:09:22.151778 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:09:22.151990 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:09:22.247585 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:09:22.247706 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329362.2475555, 10c50913-8b08-402c-8ece-87c7521ce785 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:09:22.247825 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] VM Paused (Lifecycle Event)
May 21 02:09:22.347730 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:09:22.497975 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:22.659350 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Took 7.94 seconds to spawn the instance on the hypervisor.
May 21 02:09:22.659350 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:09:22.730525 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-481ff279-85b1-45f7-9dc5-46bc1f76fc69 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:09:22.730720 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-481ff279-85b1-45f7-9dc5-46bc1f76fc69 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:09:22.739391 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f136a422-5918-47f2-9ed7-eddd9c64a379 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Lock "45f01b41-a43c-4ddf-aa07-22f8c2c50758" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.970s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:22.754329 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:09:22.756390 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329362.7561867, 10c50913-8b08-402c-8ece-87c7521ce785 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:09:22.756524 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] VM Resumed (Lifecycle Event)
May 21 02:09:23.169533 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Took 13.68 seconds to build instance.
May 21 02:09:23.233269 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-481ff279-85b1-45f7-9dc5-46bc1f76fc69 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:09:23.261786 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:09:23.262710 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:09:23.367611 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Found WWN 330000000305eda9d for multipath device dm-4 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:09:23.367914 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.047s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:09:23.368091 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] <== connect_volume: return (3048ms) {'type': 'block', 'scsi_wwn': '330000000305eda9d', 'path': '/dev/dm-4', 'multipath_id': '330000000305eda9d'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:09:23.368206 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000305eda9d', 'path': '/dev/dm-4', 'multipath_id': '330000000305eda9d'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:09:23.675455 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0a712c9a-ea1b-4e2a-ab6c-85d235a54526 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "10c50913-8b08-402c-8ece-87c7521ce785" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.198s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:23.873703 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:09:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-613838180',display_name='tempest-TestVolumeBootPattern-volume-backed-server-613838180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpattern-volume-backed-server-613838180',id=65,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOh+EZ2+GqsugxvV48SXUFbhnnqWDhW4QWVbmtidsehsHFgubQolVOqcHhu9DZ5RbLUZKULuJ6XaLkn3xM/E2q+WSWqLkPn0fo2YUhxbA/iavkEae7ZiB+lt00S1b4tMyQ==',key_name='tempest-keypair-1504145938',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62ebdb16aee84e22a88dfc8960debd32',ramdisk_id='',reservation_id='r-bxtqzzv5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1995806391',owner_user_name='tempest-TestVolumeBootPattern-1995806391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:09:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4878b5a5bf184852a9ce383caa1c67a4',uuid=cec9e114-b934-4de6-b0f0-586cd34a59bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5142d614-fe12-4ae6-a0ed-8c5658b5505b", "address": "fa:16:3e:30:16:4f", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5142d614-fe", "ovs_interfaceid": "5142d614-fe12-4ae6-a0ed-8c5658b5505b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:09:23.874036 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converting VIF {"id": "5142d614-fe12-4ae6-a0ed-8c5658b5505b", "address": "fa:16:3e:30:16:4f", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5142d614-fe", "ovs_interfaceid": "5142d614-fe12-4ae6-a0ed-8c5658b5505b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:09:23.874670 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:16:4f,bridge_name='br-int',has_traffic_filtering=True,id=5142d614-fe12-4ae6-a0ed-8c5658b5505b,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5142d614-fe') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:09:23.875329 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lazy-loading 'pci_devices' on Instance uuid cec9e114-b934-4de6-b0f0-586cd34a59bd {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:09:24.246155 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-481ff279-85b1-45f7-9dc5-46bc1f76fc69 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.599s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:24.284589 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-616d3ccb-0335-4682-9623-6e71076432b9 req-e5cc50a6-00de-49f7-96bd-a35f98d26905 service nova] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Received event network-changed-a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:09:24.284589 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-616d3ccb-0335-4682-9623-6e71076432b9 req-e5cc50a6-00de-49f7-96bd-a35f98d26905 service nova] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Refreshing instance network info cache due to event network-changed-a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:09:24.284589 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-616d3ccb-0335-4682-9623-6e71076432b9 req-e5cc50a6-00de-49f7-96bd-a35f98d26905 service nova] Acquiring lock "refresh_cache-6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:09:24.284589 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-616d3ccb-0335-4682-9623-6e71076432b9 req-e5cc50a6-00de-49f7-96bd-a35f98d26905 service nova] Acquired lock "refresh_cache-6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:09:24.284589 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-616d3ccb-0335-4682-9623-6e71076432b9 req-e5cc50a6-00de-49f7-96bd-a35f98d26905 service nova] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Refreshing network info cache for port a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:09:24.379285 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] End _get_guest_xml xml=<domain type="qemu">
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:   <uuid>cec9e114-b934-4de6-b0f0-586cd34a59bd</uuid>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:   <name>instance-00000041</name>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-613838180</nova:name>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:09:20</nova:creationTime>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:       <nova:image uuid="">
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:         <nova:user uuid="4878b5a5bf184852a9ce383caa1c67a4">tempest-TestVolumeBootPattern-1995806391-project-member</nova:user>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:         <nova:project uuid="62ebdb16aee84e22a88dfc8960debd32">tempest-TestVolumeBootPattern-1995806391</nova:project>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:       <nova:root type="volume" uuid=""/>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:         <nova:port uuid="5142d614-fe12-4ae6-a0ed-8c5658b5505b">
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:     <system>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:       <entry name="serial">cec9e114-b934-4de6-b0f0-586cd34a59bd</entry>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:       <entry name="uuid">cec9e114-b934-4de6-b0f0-586cd34a59bd</entry>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:     </system>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:   <os>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:   </os>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:   <features>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:   </features>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:   <devices>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/cec9e114-b934-4de6-b0f0-586cd34a59bd/disk.config"/>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:     </disk>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:       <alias name="ua-7ea6075d-0c38-4100-9259-e68a64fa39fe"/>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-4"/>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:       <serial>7ea6075d-0c38-4100-9259-e68a64fa39fe</serial>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:     </disk>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:30:16:4f"/>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:       <target dev="tap5142d614-fe"/>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:     </interface>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/cec9e114-b934-4de6-b0f0-586cd34a59bd/console.log" append="off"/>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:     </serial>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:     <video>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:     </video>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:     </rng>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:   </devices>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]: </domain>
May 21 02:09:24.379285 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:09:24.379285 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Preparing to wait for external event network-vif-plugged-5142d614-fe12-4ae6-a0ed-8c5658b5505b {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:09:24.381480 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "cec9e114-b934-4de6-b0f0-586cd34a59bd-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:24.381480 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "cec9e114-b934-4de6-b0f0-586cd34a59bd-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:24.381480 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "cec9e114-b934-4de6-b0f0-586cd34a59bd-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:24.381480 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:09:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-613838180',display_name='tempest-TestVolumeBootPattern-volume-backed-server-613838180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpattern-volume-backed-server-613838180',id=65,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOh+EZ2+GqsugxvV48SXUFbhnnqWDhW4QWVbmtidsehsHFgubQolVOqcHhu9DZ5RbLUZKULuJ6XaLkn3xM/E2q+WSWqLkPn0fo2YUhxbA/iavkEae7ZiB+lt00S1b4tMyQ==',key_name='tempest-keypair-1504145938',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62ebdb16aee84e22a88dfc8960debd32',ramdisk_id='',reservation_id='r-bxtqzzv5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1995806391',owner_user_name='tempest-TestVolumeBootPattern-1995806391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:09:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4878b5a5bf184852a9ce383caa1c67a4',uuid=cec9e114-b934-4de6-b0f0-586cd34a59bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5142d614-fe12-4ae6-a0ed-8c5658b5505b", "address": "fa:16:3e:30:16:4f", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5142d614-fe", "ovs_interfaceid": "5142d614-fe12-4ae6-a0ed-8c5658b5505b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:09:24.381684 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converting VIF {"id": "5142d614-fe12-4ae6-a0ed-8c5658b5505b", "address": "fa:16:3e:30:16:4f", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5142d614-fe", "ovs_interfaceid": "5142d614-fe12-4ae6-a0ed-8c5658b5505b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:09:24.382360 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:16:4f,bridge_name='br-int',has_traffic_filtering=True,id=5142d614-fe12-4ae6-a0ed-8c5658b5505b,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5142d614-fe') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:09:24.382730 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:16:4f,bridge_name='br-int',has_traffic_filtering=True,id=5142d614-fe12-4ae6-a0ed-8c5658b5505b,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5142d614-fe') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:09:24.384077 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:24.384380 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:09:24.384536 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:09:24.385478 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:24.385625 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd8912e10-3007-5273-9728-1e89dc8536ef', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:09:24.390627 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:24.390627 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:09:24.390627 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:24.394434 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:24.394601 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5142d614-fe, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:09:24.394907 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5142d614-fe, col_values=(('qos', UUID('ee0b2260-18cf-4729-b83e-73772ef407f1')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:09:24.395072 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5142d614-fe, col_values=(('external_ids', {'iface-id': '5142d614-fe12-4ae6-a0ed-8c5658b5505b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:16:4f', 'vm-uuid': 'cec9e114-b934-4de6-b0f0-586cd34a59bd'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:09:24.398627 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:24.400249 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:09:24.403162 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:24.404010 np0000001127 nova-compute[98206]: INFO os_vif [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:16:4f,bridge_name='br-int',has_traffic_filtering=True,id=5142d614-fe12-4ae6-a0ed-8c5658b5505b,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5142d614-fe')
May 21 02:09:24.789502 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-616d3ccb-0335-4682-9623-6e71076432b9 req-e5cc50a6-00de-49f7-96bd-a35f98d26905 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:24.908676 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-481ff279-85b1-45f7-9dc5-46bc1f76fc69 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Deleted allocation for migration 3751531b-f553-4ae3-8a7e-d3129d69b197
May 21 02:09:25.152010 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-616d3ccb-0335-4682-9623-6e71076432b9 req-e5cc50a6-00de-49f7-96bd-a35f98d26905 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:25.332217 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-616d3ccb-0335-4682-9623-6e71076432b9 req-e5cc50a6-00de-49f7-96bd-a35f98d26905 service nova] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Updated VIF entry in instance network info cache for port a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:09:25.332580 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-616d3ccb-0335-4682-9623-6e71076432b9 req-e5cc50a6-00de-49f7-96bd-a35f98d26905 service nova] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Updating instance_info_cache with network_info: [{"id": "a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01", "address": "fa:16:3e:b8:d1:01", "network": {"id": "dec0dbdb-dfbe-4a3d-9d29-6add07c9003f", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-775185877-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ae2ef74a1614eb09e4f71f709f64126", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3938f5f-e8", "ovs_interfaceid": "a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:09:25.413009 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-481ff279-85b1-45f7-9dc5-46bc1f76fc69 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 8.131s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:25.740958 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-31e196bc-7283-433f-8582-19b981f4e336 req-2bfa1498-5247-457e-a795-fae9f877120d service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Received event network-changed-2b286fbf-a6fe-4dcc-af12-2521cf154dbb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:09:25.741113 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-31e196bc-7283-433f-8582-19b981f4e336 req-2bfa1498-5247-457e-a795-fae9f877120d service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Refreshing instance network info cache due to event network-changed-2b286fbf-a6fe-4dcc-af12-2521cf154dbb. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:09:25.741298 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-31e196bc-7283-433f-8582-19b981f4e336 req-2bfa1498-5247-457e-a795-fae9f877120d service nova] Acquiring lock "refresh_cache-aa3f5a78-fb82-4e21-8ebf-90bf48a122be" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:09:25.741352 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-31e196bc-7283-433f-8582-19b981f4e336 req-2bfa1498-5247-457e-a795-fae9f877120d service nova] Acquired lock "refresh_cache-aa3f5a78-fb82-4e21-8ebf-90bf48a122be" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:09:25.741462 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-31e196bc-7283-433f-8582-19b981f4e336 req-2bfa1498-5247-457e-a795-fae9f877120d service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Refreshing network info cache for port 2b286fbf-a6fe-4dcc-af12-2521cf154dbb {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:09:25.835728 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-616d3ccb-0335-4682-9623-6e71076432b9 req-e5cc50a6-00de-49f7-96bd-a35f98d26905 service nova] Releasing lock "refresh_cache-6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:09:25.944790 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:09:25.944882 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:09:25.945070 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] No VIF found with MAC fa:16:3e:30:16:4f, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:09:25.945341 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Using config drive
May 21 02:09:26.030547 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:26.248376 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-31e196bc-7283-433f-8582-19b981f4e336 req-2bfa1498-5247-457e-a795-fae9f877120d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:26.369447 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7fedb8d6-f01e-4785-83fb-378a65e5ba4e req-026fe168-02cb-41d6-be84-39693ad2f2b6 service nova] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Received event network-changed-a149f43d-6c97-4b80-9bd8-353fb7be0630 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:09:26.370223 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7fedb8d6-f01e-4785-83fb-378a65e5ba4e req-026fe168-02cb-41d6-be84-39693ad2f2b6 service nova] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Refreshing instance network info cache due to event network-changed-a149f43d-6c97-4b80-9bd8-353fb7be0630. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:09:26.370223 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7fedb8d6-f01e-4785-83fb-378a65e5ba4e req-026fe168-02cb-41d6-be84-39693ad2f2b6 service nova] Acquiring lock "refresh_cache-10c50913-8b08-402c-8ece-87c7521ce785" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:09:26.370223 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7fedb8d6-f01e-4785-83fb-378a65e5ba4e req-026fe168-02cb-41d6-be84-39693ad2f2b6 service nova] Acquired lock "refresh_cache-10c50913-8b08-402c-8ece-87c7521ce785" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:09:26.370223 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-7fedb8d6-f01e-4785-83fb-378a65e5ba4e req-026fe168-02cb-41d6-be84-39693ad2f2b6 service nova] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Refreshing network info cache for port a149f43d-6c97-4b80-9bd8-353fb7be0630 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:09:26.451591 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:26.596498 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Creating config drive at /opt/stack/data/nova/instances/cec9e114-b934-4de6-b0f0-586cd34a59bd/disk.config
May 21 02:09:26.599386 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cec9e114-b934-4de6-b0f0-586cd34a59bd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpui_ppgc1 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:26.654190 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cec9e114-b934-4de6-b0f0-586cd34a59bd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpui_ppgc1" returned: 0 in 0.054s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:09:26.685597 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-31e196bc-7283-433f-8582-19b981f4e336 req-2bfa1498-5247-457e-a795-fae9f877120d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:26.761946 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:26.867777 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-31e196bc-7283-433f-8582-19b981f4e336 req-2bfa1498-5247-457e-a795-fae9f877120d service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Updated VIF entry in instance network info cache for port 2b286fbf-a6fe-4dcc-af12-2521cf154dbb. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:09:26.867777 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-31e196bc-7283-433f-8582-19b981f4e336 req-2bfa1498-5247-457e-a795-fae9f877120d service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Updating instance_info_cache with network_info: [{"id": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "address": "fa:16:3e:db:08:dd", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b286fbf-a6", "ovs_interfaceid": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:09:26.873101 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-7fedb8d6-f01e-4785-83fb-378a65e5ba4e req-026fe168-02cb-41d6-be84-39693ad2f2b6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:27.112448 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:27.148573 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:27.152342 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:27.240411 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-7fedb8d6-f01e-4785-83fb-378a65e5ba4e req-026fe168-02cb-41d6-be84-39693ad2f2b6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:27.248230 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:27.369127 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-31e196bc-7283-433f-8582-19b981f4e336 req-2bfa1498-5247-457e-a795-fae9f877120d service nova] Releasing lock "refresh_cache-aa3f5a78-fb82-4e21-8ebf-90bf48a122be" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:09:27.388915 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-5428ea07-361c-42c0-8e17-ab90eaaae056 req-7cd33945-84aa-419a-89fa-2e89a0e499db service nova] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Received event network-vif-plugged-5142d614-fe12-4ae6-a0ed-8c5658b5505b {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:09:27.388915 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5428ea07-361c-42c0-8e17-ab90eaaae056 req-7cd33945-84aa-419a-89fa-2e89a0e499db service nova] Acquiring lock "cec9e114-b934-4de6-b0f0-586cd34a59bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:27.389430 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5428ea07-361c-42c0-8e17-ab90eaaae056 req-7cd33945-84aa-419a-89fa-2e89a0e499db service nova] Lock "cec9e114-b934-4de6-b0f0-586cd34a59bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:27.389430 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5428ea07-361c-42c0-8e17-ab90eaaae056 req-7cd33945-84aa-419a-89fa-2e89a0e499db service nova] Lock "cec9e114-b934-4de6-b0f0-586cd34a59bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:27.389652 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-5428ea07-361c-42c0-8e17-ab90eaaae056 req-7cd33945-84aa-419a-89fa-2e89a0e499db service nova] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Processing event network-vif-plugged-5142d614-fe12-4ae6-a0ed-8c5658b5505b {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:09:27.442227 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-7fedb8d6-f01e-4785-83fb-378a65e5ba4e req-026fe168-02cb-41d6-be84-39693ad2f2b6 service nova] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Updated VIF entry in instance network info cache for port a149f43d-6c97-4b80-9bd8-353fb7be0630. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:09:27.442227 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-7fedb8d6-f01e-4785-83fb-378a65e5ba4e req-026fe168-02cb-41d6-be84-39693ad2f2b6 service nova] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Updating instance_info_cache with network_info: [{"id": "a149f43d-6c97-4b80-9bd8-353fb7be0630", "address": "fa:16:3e:2c:b3:6f", "network": {"id": "dec0dbdb-dfbe-4a3d-9d29-6add07c9003f", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-775185877-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ae2ef74a1614eb09e4f71f709f64126", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa149f43d-6c", "ovs_interfaceid": "a149f43d-6c97-4b80-9bd8-353fb7be0630", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:09:27.547273 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:27.551369 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:27.580035 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:27.830115 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cb9acdfb-d47d-41d0-a0c4-bd1642e7192e req-fbdf3a52-66fc-4069-8337-7f351e94104c service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Received event network-changed-ad1def3b-4657-4632-bd3a-910cdca9a1a4 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:09:27.832322 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cb9acdfb-d47d-41d0-a0c4-bd1642e7192e req-fbdf3a52-66fc-4069-8337-7f351e94104c service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Refreshing instance network info cache due to event network-changed-ad1def3b-4657-4632-bd3a-910cdca9a1a4. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:09:27.832322 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cb9acdfb-d47d-41d0-a0c4-bd1642e7192e req-fbdf3a52-66fc-4069-8337-7f351e94104c service nova] Acquiring lock "refresh_cache-c76064e6-3702-4e67-9d4f-ef67cd4b7b22" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:09:27.832322 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cb9acdfb-d47d-41d0-a0c4-bd1642e7192e req-fbdf3a52-66fc-4069-8337-7f351e94104c service nova] Acquired lock "refresh_cache-c76064e6-3702-4e67-9d4f-ef67cd4b7b22" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:09:27.832322 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-cb9acdfb-d47d-41d0-a0c4-bd1642e7192e req-fbdf3a52-66fc-4069-8337-7f351e94104c service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Refreshing network info cache for port ad1def3b-4657-4632-bd3a-910cdca9a1a4 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:09:27.948891 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7fedb8d6-f01e-4785-83fb-378a65e5ba4e req-026fe168-02cb-41d6-be84-39693ad2f2b6 service nova] Releasing lock "refresh_cache-10c50913-8b08-402c-8ece-87c7521ce785" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:09:28.069535 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:09:28.071011 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329368.070601, cec9e114-b934-4de6-b0f0-586cd34a59bd => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:09:28.071195 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] VM Started (Lifecycle Event)
May 21 02:09:28.072935 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:09:28.079264 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Instance spawned successfully.
May 21 02:09:28.079943 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:09:28.309038 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:28.334494 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-cb9acdfb-d47d-41d0-a0c4-bd1642e7192e req-fbdf3a52-66fc-4069-8337-7f351e94104c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:28.576640 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:09:28.588187 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:09:28.596462 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:09:28.596462 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:09:28.596462 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:09:28.596462 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:09:28.596462 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:09:28.597978 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:09:28.624943 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0008016899996619031 future=<Future at 0x71c07c5d51f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:09:28.625089 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:09:28.625456 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Emitting event <LifecycleEvent: 1779329353.6239793, 45f01b41-a43c-4ddf-aa07-22f8c2c50758 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:09:28.625632 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] VM Stopped (Lifecycle Event)
May 21 02:09:28.752559 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-cb9acdfb-d47d-41d0-a0c4-bd1642e7192e req-fbdf3a52-66fc-4069-8337-7f351e94104c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:28.940522 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-cb9acdfb-d47d-41d0-a0c4-bd1642e7192e req-fbdf3a52-66fc-4069-8337-7f351e94104c service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Updated VIF entry in instance network info cache for port ad1def3b-4657-4632-bd3a-910cdca9a1a4. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:09:28.940835 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-cb9acdfb-d47d-41d0-a0c4-bd1642e7192e req-fbdf3a52-66fc-4069-8337-7f351e94104c service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Updating instance_info_cache with network_info: [{"id": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "address": "fa:16:3e:20:ae:96", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1def3b-46", "ovs_interfaceid": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:09:29.092976 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:09:29.093363 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329369.09305, cec9e114-b934-4de6-b0f0-586cd34a59bd => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:09:29.093568 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] VM Paused (Lifecycle Event)
May 21 02:09:29.113986 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Took 9.17 seconds to spawn the instance on the hypervisor.
May 21 02:09:29.114208 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:09:29.132012 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 45f01b41-a43c-4ddf-aa07-22f8c2c50758] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:09:29.397544 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:29.442907 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cb9acdfb-d47d-41d0-a0c4-bd1642e7192e req-fbdf3a52-66fc-4069-8337-7f351e94104c service nova] Releasing lock "refresh_cache-c76064e6-3702-4e67-9d4f-ef67cd4b7b22" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:09:29.453178 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-5059489a-e5e2-4bb2-a477-db8634d16fa5 req-257254e1-e2b0-4f5d-b93e-f6b0b6b65f69 service nova] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Received event network-vif-plugged-5142d614-fe12-4ae6-a0ed-8c5658b5505b {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:09:29.453178 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5059489a-e5e2-4bb2-a477-db8634d16fa5 req-257254e1-e2b0-4f5d-b93e-f6b0b6b65f69 service nova] Acquiring lock "cec9e114-b934-4de6-b0f0-586cd34a59bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:29.453178 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5059489a-e5e2-4bb2-a477-db8634d16fa5 req-257254e1-e2b0-4f5d-b93e-f6b0b6b65f69 service nova] Lock "cec9e114-b934-4de6-b0f0-586cd34a59bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:29.453178 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5059489a-e5e2-4bb2-a477-db8634d16fa5 req-257254e1-e2b0-4f5d-b93e-f6b0b6b65f69 service nova] Lock "cec9e114-b934-4de6-b0f0-586cd34a59bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:29.453178 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-5059489a-e5e2-4bb2-a477-db8634d16fa5 req-257254e1-e2b0-4f5d-b93e-f6b0b6b65f69 service nova] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] No waiting events found dispatching network-vif-plugged-5142d614-fe12-4ae6-a0ed-8c5658b5505b {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:09:29.453178 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-5059489a-e5e2-4bb2-a477-db8634d16fa5 req-257254e1-e2b0-4f5d-b93e-f6b0b6b65f69 service nova] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Received unexpected event network-vif-plugged-5142d614-fe12-4ae6-a0ed-8c5658b5505b for instance with vm_state active and task_state None.
May 21 02:09:29.596265 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:09:29.598682 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329369.5984178, cec9e114-b934-4de6-b0f0-586cd34a59bd => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:09:29.598847 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] VM Resumed (Lifecycle Event)
May 21 02:09:29.630635 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Took 16.81 seconds to build instance.
May 21 02:09:30.159586 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:09:30.159586 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:09:30.159586 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cd4c4a1d-78a7-4ed2-8e17-4b071a05e0a5 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "cec9e114-b934-4de6-b0f0-586cd34a59bd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.319s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:31.502096 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b25b4f78-e3fc-4e21-9c73-57847f8b43c5 req-ef0b46e9-f4dc-4b9b-9f5c-04b351699fda service nova] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Received event network-changed-5142d614-fe12-4ae6-a0ed-8c5658b5505b {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:09:31.502628 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b25b4f78-e3fc-4e21-9c73-57847f8b43c5 req-ef0b46e9-f4dc-4b9b-9f5c-04b351699fda service nova] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Refreshing instance network info cache due to event network-changed-5142d614-fe12-4ae6-a0ed-8c5658b5505b. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:09:31.502628 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b25b4f78-e3fc-4e21-9c73-57847f8b43c5 req-ef0b46e9-f4dc-4b9b-9f5c-04b351699fda service nova] Acquiring lock "refresh_cache-cec9e114-b934-4de6-b0f0-586cd34a59bd" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:09:31.502628 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b25b4f78-e3fc-4e21-9c73-57847f8b43c5 req-ef0b46e9-f4dc-4b9b-9f5c-04b351699fda service nova] Acquired lock "refresh_cache-cec9e114-b934-4de6-b0f0-586cd34a59bd" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:09:31.502977 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-b25b4f78-e3fc-4e21-9c73-57847f8b43c5 req-ef0b46e9-f4dc-4b9b-9f5c-04b351699fda service nova] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Refreshing network info cache for port 5142d614-fe12-4ae6-a0ed-8c5658b5505b {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:09:31.671505 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Acquiring lock "3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:31.671505 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Lock "3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:31.762185 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:32.006131 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-b25b4f78-e3fc-4e21-9c73-57847f8b43c5 req-ef0b46e9-f4dc-4b9b-9f5c-04b351699fda service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:32.176501 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:09:32.416237 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-b25b4f78-e3fc-4e21-9c73-57847f8b43c5 req-ef0b46e9-f4dc-4b9b-9f5c-04b351699fda service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:32.590556 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-b25b4f78-e3fc-4e21-9c73-57847f8b43c5 req-ef0b46e9-f4dc-4b9b-9f5c-04b351699fda service nova] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Updated VIF entry in instance network info cache for port 5142d614-fe12-4ae6-a0ed-8c5658b5505b. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:09:32.591027 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-b25b4f78-e3fc-4e21-9c73-57847f8b43c5 req-ef0b46e9-f4dc-4b9b-9f5c-04b351699fda service nova] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Updating instance_info_cache with network_info: [{"id": "5142d614-fe12-4ae6-a0ed-8c5658b5505b", "address": "fa:16:3e:30:16:4f", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5142d614-fe", "ovs_interfaceid": "5142d614-fe12-4ae6-a0ed-8c5658b5505b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:09:32.751239 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:32.751450 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:32.754887 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:09:32.755021 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Claim successful on node np0000001127
May 21 02:09:33.093330 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b25b4f78-e3fc-4e21-9c73-57847f8b43c5 req-ef0b46e9-f4dc-4b9b-9f5c-04b351699fda service nova] Releasing lock "refresh_cache-cec9e114-b934-4de6-b0f0-586cd34a59bd" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:09:34.400004 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:34.421615 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:09:34.421867 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:09:34.924733 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:09:35.433514 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.682s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:35.434142 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:09:35.939256 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:09:35.939763 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:09:35.940042 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:35.940294 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:36.042735 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5616bae090404a2dbbe6b2486102cf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1646ca3e5bf3425ca0bd66c5a50c996b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:09:36.442715 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:09:36.564656 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Successfully created port: 73bc542d-2c3b-4675-8361-9e2bd49f52fe {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:09:36.764798 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:36.946383 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:09:37.267925 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Successfully updated port: 73bc542d-2c3b-4675-8361-9e2bd49f52fe {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:09:37.318736 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8ca05da5-67ac-4b38-ad29-c29188f0a99b req-3017a5fc-1a88-4efd-a035-b8f8a831f1fa service nova] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Received event network-changed-73bc542d-2c3b-4675-8361-9e2bd49f52fe {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:09:37.319214 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8ca05da5-67ac-4b38-ad29-c29188f0a99b req-3017a5fc-1a88-4efd-a035-b8f8a831f1fa service nova] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Refreshing instance network info cache due to event network-changed-73bc542d-2c3b-4675-8361-9e2bd49f52fe. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:09:37.319444 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8ca05da5-67ac-4b38-ad29-c29188f0a99b req-3017a5fc-1a88-4efd-a035-b8f8a831f1fa service nova] Acquiring lock "refresh_cache-3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:09:37.319603 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8ca05da5-67ac-4b38-ad29-c29188f0a99b req-3017a5fc-1a88-4efd-a035-b8f8a831f1fa service nova] Acquired lock "refresh_cache-3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:09:37.320027 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-8ca05da5-67ac-4b38-ad29-c29188f0a99b req-3017a5fc-1a88-4efd-a035-b8f8a831f1fa service nova] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Refreshing network info cache for port 73bc542d-2c3b-4675-8361-9e2bd49f52fe {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:09:37.451622 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Booting with volume 61affb01-e1ac-45d2-938c-e506a523047a at /dev/vda
May 21 02:09:37.494558 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:09:37.509037 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:09:37.531145 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:37.577789 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:09:37.578093 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:09:37.587702 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:09:37.589328 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe21:7993', 'fe80::2482:bff:fe1b:902b', 'fe80::fc16:3eff:fe20:ae96', 'fe80::fc16:3eff:fe5c:a90d', 'fe80::786b:86ff:fe32:8f96', 'fe80::fc16:3eff:fe2c:b36f', 'fe80::fc16:3eff:fe30:164f', 'fe80::c44d:25ff:fe10:25cb', 'fe80::fc16:3eff:fe0f:28a1', 'fe80::440a:38ff:fe27:fa24', 'fe80::fc16:3eff:fefb:4d96', 'fe80::fc16:3eff:fe65:6557', 'fe80::fc16:3eff:feb8:d101', 'fe80::7045:30ff:fe1a:b99f', 'fe80::fc16:3eff:fedb:8dd'] 
May 21 02:09:37.589518 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:09:37.589609 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:09:37.589866 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] <== get_connector_properties: return (95ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:09:37.590097 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Updating existing volume attachment record: 65da7512-ecb8-4259-b7c4-60e4e463f06c {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:09:37.773320 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Acquiring lock "refresh_cache-3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:09:37.823087 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-8ca05da5-67ac-4b38-ad29-c29188f0a99b req-3017a5fc-1a88-4efd-a035-b8f8a831f1fa service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:37.883681 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-8ca05da5-67ac-4b38-ad29-c29188f0a99b req-3017a5fc-1a88-4efd-a035-b8f8a831f1fa service nova] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:09:38.021950 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-8ca05da5-67ac-4b38-ad29-c29188f0a99b req-3017a5fc-1a88-4efd-a035-b8f8a831f1fa service nova] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:09:38.524150 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8ca05da5-67ac-4b38-ad29-c29188f0a99b req-3017a5fc-1a88-4efd-a035-b8f8a831f1fa service nova] Releasing lock "refresh_cache-3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:09:38.524758 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Acquired lock "refresh_cache-3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:09:38.524958 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:09:39.092252 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:09:39.245285 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:39.402249 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:39.426733 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Updating instance_info_cache with network_info: [{"id": "73bc542d-2c3b-4675-8361-9e2bd49f52fe", "address": "fa:16:3e:ce:28:ea", "network": {"id": "e7b16641-1745-4249-9b74-305029a60f3f", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-685232721-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1646ca3e5bf3425ca0bd66c5a50c996b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bc542d-2c", "ovs_interfaceid": "73bc542d-2c3b-4675-8361-9e2bd49f52fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:09:39.733060 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:09:39.734094 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:09:39.734334 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Creating image(s)
May 21 02:09:39.734632 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Did not create local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 21 02:09:39.734832 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Ensure instance console log exists: /opt/stack/data/nova/instances/3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:09:39.735055 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:39.735260 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:39.735424 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:39.929004 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Releasing lock "refresh_cache-3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:09:39.929369 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Instance network_info: |[{"id": "73bc542d-2c3b-4675-8361-9e2bd49f52fe", "address": "fa:16:3e:ce:28:ea", "network": {"id": "e7b16641-1745-4249-9b74-305029a60f3f", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-685232721-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1646ca3e5bf3425ca0bd66c5a50c996b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bc542d-2c", "ovs_interfaceid": "73bc542d-2c3b-4675-8361-9e2bd49f52fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:09:39.931228 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Start _get_guest_xml network_info=[{"id": "73bc542d-2c3b-4675-8361-9e2bd49f52fe", "address": "fa:16:3e:ce:28:ea", "network": {"id": "e7b16641-1745-4249-9b74-305029a60f3f", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-685232721-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1646ca3e5bf3425ca0bd66c5a50c996b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bc542d-2c", "ovs_interfaceid": "73bc542d-2c3b-4675-8361-9e2bd49f52fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a', 'iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '61affb01-e1ac-45d2-938c-e506a523047a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2', 'attached_at': '', 'detached_at': '', 'volume_id': '61affb01-e1ac-45d2-938c-e506a523047a', 'serial': '61affb01-e1ac-45d2-938c-e506a523047a'}, 'delete_on_termination': False, 'attachment_id': '65da7512-ecb8-4259-b7c4-60e4e463f06c', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:09:39.947270 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:09:39.951703 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBackupRestore-server-646773334', uuid='3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2'), owner=OwnerMeta(userid='5616bae090404a2dbbe6b2486102cf7f', username='tempest-TestVolumeBackupRestore-233752250-project-member', projectid='1646ca3e5bf3425ca0bd66c5a50c996b', projectname='tempest-TestVolumeBackupRestore-233752250'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "73bc542d-2c3b-4675-8361-9e2bd49f52fe", "address": "fa:16:3e:ce:28:ea", "network": {"id": "e7b16641-1745-4249-9b74-305029a60f3f", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-685232721-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1646ca3e5bf3425ca0bd66c5a50c996b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bc542d-2c", "ovs_interfaceid": "73bc542d-2c3b-4675-8361-9e2bd49f52fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329379.9503684) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:09:39.956234 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:09:39.957609 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:09:39.961250 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:09:39.962061 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:09:39.965271 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:09:39.966183 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:09:39.966842 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:09:39.967083 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:09:39.967834 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:09:39.969397 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:09:39.970406 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:09:39.971611 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:09:39.974512 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:09:39.975265 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:09:39.975937 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:09:39.976695 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:09:40.006555 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:09:40.006965 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a', 'iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '61affb01-e1ac-45d2-938c-e506a523047a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:09:40.007198 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:09:40.007616 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:09:40.007916 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a', 'iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '61affb01-e1ac-45d2-938c-e506a523047a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:09:40.019861 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:09:40.020020 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:09:40.020629 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:09:40.020888 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:09:40.021347 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:09:40.021607 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:09:40.032315 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:09:40.032315 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:40.038636 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:09:40.038636 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:40.044687 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a] added
May 21 02:09:40.044687 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:09:40.044687 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:09:40.044687 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:09:40.044687 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:09:40.044687 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:09:40.044687 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:40.044904 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:09:40.045494 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0243(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:09:40.045494 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:09:40.051726 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a] added
May 21 02:09:40.051726 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:09:40.051726 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:09:40.051726 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:09:40.051726 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:09:40.051726 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:09:40.051726 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:40.051923 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:09:40.052124 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0305(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:09:40.052273 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:09:41.045946 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:09:41.052711 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:09:41.065237 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:09:41.065237 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:09:41.071718 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:09:41.071718 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:41.085820 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:41.095514 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:41.115790 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:41.115790 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:41.115790 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:41.115790 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:41.115790 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:41.115790 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:41.115790 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:41.115790 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:41.115790 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:41.115790 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:41.115790 np0000001127 nova-compute[98206]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14778ff8-38ab-488d-be23-e6cef32d9159 (non-flash)
May 21 02:09:41.115790 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:41.115790 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:41.115790 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:09:41.115790 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] iscsi session list stdout=tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:41.115790 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:41.115790 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:41.115790 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:41.115790 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:41.115790 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:41.115790 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:41.115790 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:41.115790 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:41.115790 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:41.115790 np0000001127 nova-compute[98206]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14778ff8-38ab-488d-be23-e6cef32d9159 (non-flash)
May 21 02:09:41.115790 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:41.115790 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:41.115790 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:09:41.150320 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:41.150320 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:41.150320 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:41.150320 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:41.150320 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:41.150320 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:41.150320 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:41.150320 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:41.150320 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:41.150320 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:41.150320 np0000001127 nova-compute[98206]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14778ff8-38ab-488d-be23-e6cef32d9159 (non-flash)
May 21 02:09:41.150320 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:41.150320 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:41.150320 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:09:41.150320 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] iscsi session list stdout=tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:41.150320 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:41.150320 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:41.150320 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:41.150320 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:41.150320 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:41.150320 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:41.150320 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:41.150320 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:41.150320 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:41.150320 np0000001127 nova-compute[98206]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14778ff8-38ab-488d-be23-e6cef32d9159 (non-flash)
May 21 02:09:41.150320 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:41.150320 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:41.150320 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:09:41.172562 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a, portal: 192.168.40.100,3260]
May 21 02:09:41.172562 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a, portal: 192.168.40.100,3260] successful.
May 21 02:09:41.172562 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:41.194325 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:41.213409 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a, portal: 192.168.50.100,3260]
May 21 02:09:41.213409 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a, portal: 192.168.50.100,3260] successful.
May 21 02:09:41.213409 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:41.223552 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:41.223552 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:41.223552 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:41.223552 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:41.223552 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:41.223552 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:41.223552 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:41.223552 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:41.223552 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:41.223552 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:41.223552 np0000001127 nova-compute[98206]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14778ff8-38ab-488d-be23-e6cef32d9159 (non-flash)
May 21 02:09:41.223552 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:41.223552 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:41.223552 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:41.223552 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:41.223552 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:09:41.223552 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] iscsi session list stdout=tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:41.223552 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:41.223552 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:41.223552 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:41.223552 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:41.223552 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:41.223552 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:41.223552 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:41.223552 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:41.223552 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:41.223552 np0000001127 nova-compute[98206]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14778ff8-38ab-488d-be23-e6cef32d9159 (non-flash)
May 21 02:09:41.223552 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:41.223552 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:41.223552 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:41.223552 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:41.223552 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:09:41.223552 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.202s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:09:41.223552 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:09:41.223552 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] HCTL ('12', '-', '-', 0) found on session 147 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:09:41.223552 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:09:41.230678 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:41.245692 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Searching for a device in session 147 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:09:41.245692 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '61affb01-e1ac-45d2-938c-e506a523047a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:09:41.258204 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:41.258204 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:41.258204 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:41.258204 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:41.258204 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:41.258204 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:41.258204 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:41.258204 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:41.258204 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:41.258204 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:41.258204 np0000001127 nova-compute[98206]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14778ff8-38ab-488d-be23-e6cef32d9159 (non-flash)
May 21 02:09:41.258204 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:41.258204 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:41.258204 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:41.258204 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:41.258204 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:09:41.259266 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] iscsi session list stdout=tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:41.259266 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:41.259266 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:41.259266 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:41.259266 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:41.259266 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:41.259266 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:41.259266 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:41.259266 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:41.259266 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:41.259266 np0000001127 nova-compute[98206]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14778ff8-38ab-488d-be23-e6cef32d9159 (non-flash)
May 21 02:09:41.259266 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:41.259266 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:41.259266 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:41.259266 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:41.259266 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:09:41.259266 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.237s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:09:41.259266 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:09:41.261170 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] HCTL ('17', '-', '-', 0) found on session 148 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:09:41.261226 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:09:41.288452 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Searching for a device in session 148 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:09:41.288452 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '61affb01-e1ac-45d2-938c-e506a523047a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:09:41.766552 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:42.021984 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:09:42.579939 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "0d5857fd-c96f-444b-ac06-634d1c81a32a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:42.580290 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "0d5857fd-c96f-444b-ac06-634d1c81a32a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:42.590666 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lazy-loading 'flavor' on Instance uuid 0d5857fd-c96f-444b-ac06-634d1c81a32a {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:09:43.039141 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Found WWN 3300000008c5a8f96 for multipath device dm-8 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:09:43.039141 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:09:43.039141 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '3300000008c5a8f96', 'path': '/dev/dm-8', 'multipath_id': '3300000008c5a8f96'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:09:43.039372 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008c5a8f96', 'path': '/dev/dm-8', 'multipath_id': '3300000008c5a8f96'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:09:43.545838 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:09:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-646773334',display_name='tempest-TestVolumeBackupRestore-server-646773334',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebackuprestore-server-646773334',id=66,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjyTngBb9j+YLiWPk1+cRCtu9sygtLJo5dbpOI44z933QpUYnXoQ69XTpNIPHEtOoptikmp9dysWmNswygmNgc2SMTxiJKJunsuTHW1eRdOgwWJdDSu/wDic167oxz7/g==',key_name='tempest-TestVolumeBackupRestore-227864388',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1646ca3e5bf3425ca0bd66c5a50c996b',ramdisk_id='',reservation_id='r-7yw44dkt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBackupRestore-233752250',owner_user_name='tempest-TestVolumeBackupRestore-233752250-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:09:37Z,user_data=None,user_id='5616bae090404a2dbbe6b2486102cf7f',uuid=3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73bc542d-2c3b-4675-8361-9e2bd49f52fe", "address": "fa:16:3e:ce:28:ea", "network": {"id": "e7b16641-1745-4249-9b74-305029a60f3f", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-685232721-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1646ca3e5bf3425ca0bd66c5a50c996b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bc542d-2c", "ovs_interfaceid": "73bc542d-2c3b-4675-8361-9e2bd49f52fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:09:43.546094 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Converting VIF {"id": "73bc542d-2c3b-4675-8361-9e2bd49f52fe", "address": "fa:16:3e:ce:28:ea", "network": {"id": "e7b16641-1745-4249-9b74-305029a60f3f", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-685232721-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1646ca3e5bf3425ca0bd66c5a50c996b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bc542d-2c", "ovs_interfaceid": "73bc542d-2c3b-4675-8361-9e2bd49f52fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:09:43.546958 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:28:ea,bridge_name='br-int',has_traffic_filtering=True,id=73bc542d-2c3b-4675-8361-9e2bd49f52fe,network=Network(e7b16641-1745-4249-9b74-305029a60f3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bc542d-2c') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:09:43.547727 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Lazy-loading 'pci_devices' on Instance uuid 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:09:43.597684 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "0d5857fd-c96f-444b-ac06-634d1c81a32a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.017s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:44.051792 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] End _get_guest_xml xml=<domain type="qemu">
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:   <uuid>3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2</uuid>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:   <name>instance-00000042</name>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:       <nova:name>tempest-TestVolumeBackupRestore-server-646773334</nova:name>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:09:39</nova:creationTime>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:       <nova:image uuid="">
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:         <nova:user uuid="5616bae090404a2dbbe6b2486102cf7f">tempest-TestVolumeBackupRestore-233752250-project-member</nova:user>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:         <nova:project uuid="1646ca3e5bf3425ca0bd66c5a50c996b">tempest-TestVolumeBackupRestore-233752250</nova:project>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:       <nova:root type="volume" uuid=""/>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:         <nova:port uuid="73bc542d-2c3b-4675-8361-9e2bd49f52fe">
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:     <system>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:       <entry name="serial">3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2</entry>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:       <entry name="uuid">3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2</entry>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:     </system>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:   <os>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:   </os>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:   <features>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:   </features>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:   <devices>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2/disk.config"/>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:     </disk>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:       <alias name="ua-61affb01-e1ac-45d2-938c-e506a523047a"/>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-8"/>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:       <serial>61affb01-e1ac-45d2-938c-e506a523047a</serial>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:     </disk>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:ce:28:ea"/>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:       <target dev="tap73bc542d-2c"/>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:     </interface>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2/console.log" append="off"/>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:     </serial>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:     <video>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:     </video>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:     </rng>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:   </devices>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]: </domain>
May 21 02:09:44.051792 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:09:44.054630 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Preparing to wait for external event network-vif-plugged-73bc542d-2c3b-4675-8361-9e2bd49f52fe {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:09:44.054630 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Acquiring lock "3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:44.054630 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Lock "3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:44.054630 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Lock "3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:44.054794 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:09:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-646773334',display_name='tempest-TestVolumeBackupRestore-server-646773334',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebackuprestore-server-646773334',id=66,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjyTngBb9j+YLiWPk1+cRCtu9sygtLJo5dbpOI44z933QpUYnXoQ69XTpNIPHEtOoptikmp9dysWmNswygmNgc2SMTxiJKJunsuTHW1eRdOgwWJdDSu/wDic167oxz7/g==',key_name='tempest-TestVolumeBackupRestore-227864388',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1646ca3e5bf3425ca0bd66c5a50c996b',ramdisk_id='',reservation_id='r-7yw44dkt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBackupRestore-233752250',owner_user_name='tempest-TestVolumeBackupRestore-233752250-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:09:37Z,user_data=None,user_id='5616bae090404a2dbbe6b2486102cf7f',uuid=3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73bc542d-2c3b-4675-8361-9e2bd49f52fe", "address": "fa:16:3e:ce:28:ea", "network": {"id": "e7b16641-1745-4249-9b74-305029a60f3f", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-685232721-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1646ca3e5bf3425ca0bd66c5a50c996b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bc542d-2c", "ovs_interfaceid": "73bc542d-2c3b-4675-8361-9e2bd49f52fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:09:44.054928 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Converting VIF {"id": "73bc542d-2c3b-4675-8361-9e2bd49f52fe", "address": "fa:16:3e:ce:28:ea", "network": {"id": "e7b16641-1745-4249-9b74-305029a60f3f", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-685232721-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1646ca3e5bf3425ca0bd66c5a50c996b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bc542d-2c", "ovs_interfaceid": "73bc542d-2c3b-4675-8361-9e2bd49f52fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:09:44.056070 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:28:ea,bridge_name='br-int',has_traffic_filtering=True,id=73bc542d-2c3b-4675-8361-9e2bd49f52fe,network=Network(e7b16641-1745-4249-9b74-305029a60f3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bc542d-2c') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:09:44.056070 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:28:ea,bridge_name='br-int',has_traffic_filtering=True,id=73bc542d-2c3b-4675-8361-9e2bd49f52fe,network=Network(e7b16641-1745-4249-9b74-305029a60f3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bc542d-2c') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:09:44.056070 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:44.056070 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:09:44.056909 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:09:44.059483 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:44.059622 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ce962251-d97a-51ad-9966-50b5aed4c692', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:09:44.060364 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:44.061040 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:09:44.061517 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:44.065708 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:44.065861 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73bc542d-2c, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:09:44.066144 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap73bc542d-2c, col_values=(('qos', UUID('4ca72b7d-f62d-43c0-82b0-fc9623db5d24')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:09:44.066275 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap73bc542d-2c, col_values=(('external_ids', {'iface-id': '73bc542d-2c3b-4675-8361-9e2bd49f52fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:28:ea', 'vm-uuid': '3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:09:44.067078 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:44.068904 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:09:44.082525 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:44.083430 np0000001127 nova-compute[98206]: INFO os_vif [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:28:ea,bridge_name='br-int',has_traffic_filtering=True,id=73bc542d-2c3b-4675-8361-9e2bd49f52fe,network=Network(e7b16641-1745-4249-9b74-305029a60f3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bc542d-2c')
May 21 02:09:44.697287 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "0d5857fd-c96f-444b-ac06-634d1c81a32a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:44.697846 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "0d5857fd-c96f-444b-ac06-634d1c81a32a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:44.697916 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Attaching volume 3c50adb2-177d-460b-bcd1-733d4ca823cf to /dev/vdb
May 21 02:09:44.747029 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:09:44.757965 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:09:44.780175 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:44.827116 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:09:44.827534 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:09:44.839625 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:09:44.841212 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe21:7993', 'fe80::2482:bff:fe1b:902b', 'fe80::fc16:3eff:fe20:ae96', 'fe80::fc16:3eff:fe5c:a90d', 'fe80::786b:86ff:fe32:8f96', 'fe80::fc16:3eff:fe2c:b36f', 'fe80::fc16:3eff:fe30:164f', 'fe80::c44d:25ff:fe10:25cb', 'fe80::fc16:3eff:fe0f:28a1', 'fe80::440a:38ff:fe27:fa24', 'fe80::fc16:3eff:fefb:4d96', 'fe80::fc16:3eff:fe65:6557', 'fe80::fc16:3eff:feb8:d101', 'fe80::7045:30ff:fe1a:b99f', 'fe80::fc16:3eff:fedb:8dd'] 
May 21 02:09:44.841331 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:09:44.841539 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:09:44.841690 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] <== get_connector_properties: return (94ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:09:44.841969 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Updating existing volume attachment record: edd86cb3-7783-4009-b68c-f06d4796ee4b {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:09:45.412933 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:09:45.414253 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf', 'iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3c50adb2-177d-460b-bcd1-733d4ca823cf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:09:45.414379 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:09:45.415152 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:09:45.415328 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf', 'iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3c50adb2-177d-460b-bcd1-733d4ca823cf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:09:45.432320 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:09:45.433053 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:09:45.433485 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:09:45.433658 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:09:45.434288 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:09:45.434534 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:09:45.448712 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:09:45.448712 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:45.455379 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:09:45.455379 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:45.468373 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf] added
May 21 02:09:45.468373 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:09:45.468373 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:09:45.468373 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:09:45.468373 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:09:45.468373 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:09:45.468373 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:45.468652 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:09:45.468759 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.035(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:09:45.469394 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:09:45.470813 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf] added
May 21 02:09:45.470813 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:09:45.470813 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:09:45.470813 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:09:45.470813 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:09:45.470813 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:09:45.470813 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:45.471055 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:09:45.471185 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0366(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:09:45.471345 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:09:45.614587 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:09:45.615330 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:09:45.616554 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] No VIF found with MAC fa:16:3e:ce:28:ea, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:09:45.620639 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Using config drive
May 21 02:09:45.916907 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ff86125f-7836-4515-afa2-f8190ace2e2d tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:45.917366 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ff86125f-7836-4515-afa2-f8190ace2e2d tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:46.132316 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:46.339754 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Creating config drive at /opt/stack/data/nova/instances/3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2/disk.config
May 21 02:09:46.342697 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsc0drt82 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:46.398792 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsc0drt82" returned: 0 in 0.056s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:09:46.420206 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-ff86125f-7836-4515-afa2-f8190ace2e2d tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Detaching volume e7cfdf26-9973-4cc1-8395-11f9ebc98c4b
May 21 02:09:46.469641 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:09:46.470488 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-ff86125f-7836-4515-afa2-f8190ace2e2d tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Attempting to driver detach volume e7cfdf26-9973-4cc1-8395-11f9ebc98c4b from mountpoint /dev/vdb
May 21 02:09:46.471657 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:09:46.479965 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ff86125f-7836-4515-afa2-f8190ace2e2d tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Found disk vdb by alias ua-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:09:46.481401 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ff86125f-7836-4515-afa2-f8190ace2e2d tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Found disk vdb by alias ua-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:09:46.481548 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ff86125f-7836-4515-afa2-f8190ace2e2d tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Attempting to detach device vdb from instance aa3f5a78-fb82-4e21-8ebf-90bf48a122be from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 02:09:46.481839 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-ff86125f-7836-4515-afa2-f8190ace2e2d tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:09:46.481839 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:09:46.481839 np0000001127 nova-compute[98206]:   <alias name="ua-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b"/>
May 21 02:09:46.481839 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-1"/>
May 21 02:09:46.481839 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:09:46.481839 np0000001127 nova-compute[98206]:   <serial>e7cfdf26-9973-4cc1-8395-11f9ebc98c4b</serial>
May 21 02:09:46.481839 np0000001127 nova-compute[98206]:   <shareable/>
May 21 02:09:46.481839 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 21 02:09:46.481839 np0000001127 nova-compute[98206]: </disk>
May 21 02:09:46.481839 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:09:46.482981 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:09:46.482981 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:46.489651 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-ff86125f-7836-4515-afa2-f8190ace2e2d tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Successfully detached device vdb from instance aa3f5a78-fb82-4e21-8ebf-90bf48a122be from the persistent domain config.
May 21 02:09:46.489921 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ff86125f-7836-4515-afa2-f8190ace2e2d tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] (1/8): Attempting to detach device vdb with device alias ua-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b from instance aa3f5a78-fb82-4e21-8ebf-90bf48a122be from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 02:09:46.490184 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-ff86125f-7836-4515-afa2-f8190ace2e2d tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:09:46.490184 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:09:46.490184 np0000001127 nova-compute[98206]:   <alias name="ua-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b"/>
May 21 02:09:46.490184 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-1"/>
May 21 02:09:46.490184 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:09:46.490184 np0000001127 nova-compute[98206]:   <serial>e7cfdf26-9973-4cc1-8395-11f9ebc98c4b</serial>
May 21 02:09:46.490184 np0000001127 nova-compute[98206]:   <shareable/>
May 21 02:09:46.490184 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 21 02:09:46.490184 np0000001127 nova-compute[98206]: </disk>
May 21 02:09:46.490184 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:09:46.491160 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:09:46.491160 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:46.500658 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:46.507682 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:46.522462 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:46.522462 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:46.522462 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:46.522462 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:46.522462 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:46.522462 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:46.522462 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:46.522462 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:46.522462 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:46.522462 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:46.522462 np0000001127 nova-compute[98206]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14778ff8-38ab-488d-be23-e6cef32d9159 (non-flash)
May 21 02:09:46.522462 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:46.522462 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:46.522462 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:46.522462 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:46.522462 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:09:46.523325 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsi session list stdout=tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:46.523325 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:46.523325 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:46.523325 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:46.523325 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:46.523325 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:46.523325 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:46.523325 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:46.523325 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:46.523325 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:46.523325 np0000001127 nova-compute[98206]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14778ff8-38ab-488d-be23-e6cef32d9159 (non-flash)
May 21 02:09:46.523325 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:46.523325 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:46.523325 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:46.523325 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:46.523325 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:09:46.530765 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:46.530765 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:46.530765 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:46.530765 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:46.530765 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:46.530765 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:46.530765 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:46.530765 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:46.530765 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:46.530765 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:46.530765 np0000001127 nova-compute[98206]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14778ff8-38ab-488d-be23-e6cef32d9159 (non-flash)
May 21 02:09:46.530765 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:46.530765 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:46.530765 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:46.530765 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:46.530765 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:09:46.531228 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsi session list stdout=tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:46.531228 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:46.531228 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:46.531228 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:46.531228 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:46.531228 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:46.531228 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:46.531228 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:46.531228 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:46.531228 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:46.531228 np0000001127 nova-compute[98206]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14778ff8-38ab-488d-be23-e6cef32d9159 (non-flash)
May 21 02:09:46.531228 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:46.531228 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:46.531228 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:46.531228 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:46.531228 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:09:46.618450 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf, portal: 192.168.50.100,3260]
May 21 02:09:46.618450 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf, portal: 192.168.50.100,3260] successful.
May 21 02:09:46.618450 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:46.635127 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:46.661585 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:46.661585 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:46.661585 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:46.661585 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:46.661585 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:46.661585 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:46.661585 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:46.661585 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:46.661585 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:46.661585 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:46.661585 np0000001127 nova-compute[98206]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14778ff8-38ab-488d-be23-e6cef32d9159 (non-flash)
May 21 02:09:46.661585 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:46.661585 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:46.661585 np0000001127 nova-compute[98206]: tcp: [149] 192.168.40.100:3260,0 iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf (non-flash)
May 21 02:09:46.661585 np0000001127 nova-compute[98206]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf (non-flash)
May 21 02:09:46.661585 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:46.661585 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:46.661585 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:09:46.662213 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsi session list stdout=tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:46.662213 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:46.662213 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:46.662213 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:46.662213 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:46.662213 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:46.662213 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:46.662213 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:46.662213 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:46.662213 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:46.662213 np0000001127 nova-compute[98206]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14778ff8-38ab-488d-be23-e6cef32d9159 (non-flash)
May 21 02:09:46.662213 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:46.662213 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:46.662213 np0000001127 nova-compute[98206]: tcp: [149] 192.168.40.100:3260,0 iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf (non-flash)
May 21 02:09:46.662213 np0000001127 nova-compute[98206]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf (non-flash)
May 21 02:09:46.662213 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:46.662213 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:46.662213 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:09:46.662873 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.228s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:09:46.662873 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:09:46.664901 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] HCTL ('23', '-', '-', 0) found on session 150 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:09:46.665116 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Scanning host 23 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:09:46.685741 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:46.687969 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Searching for a device in session 150 and hctl ['23', '*', '*', 0] yield: sdo {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:09:46.687969 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3c50adb2-177d-460b-bcd1-733d4ca823cf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:09:46.768674 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:46.926987 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:46.956609 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:46.959815 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:47.050938 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:47.155282 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779329387.1549544, aa3f5a78-fb82-4e21-8ebf-90bf48a122be => ua-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 02:09:47.157753 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ff86125f-7836-4515-afa2-f8190ace2e2d tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b for instance aa3f5a78-fb82-4e21-8ebf-90bf48a122be {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 02:09:47.166758 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-ff86125f-7836-4515-afa2-f8190ace2e2d tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Successfully detached device vdb from instance aa3f5a78-fb82-4e21-8ebf-90bf48a122be from the live domain config.
May 21 02:09:47.243453 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-5c8bd1a6-24b3-4654-bcfa-ccd5a0b8f089 req-ddc5363b-c1cb-4c97-b295-4f187ba023cd service nova] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Received event network-vif-plugged-73bc542d-2c3b-4675-8361-9e2bd49f52fe {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:09:47.245207 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5c8bd1a6-24b3-4654-bcfa-ccd5a0b8f089 req-ddc5363b-c1cb-4c97-b295-4f187ba023cd service nova] Acquiring lock "3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:47.245544 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5c8bd1a6-24b3-4654-bcfa-ccd5a0b8f089 req-ddc5363b-c1cb-4c97-b295-4f187ba023cd service nova] Lock "3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:47.245770 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5c8bd1a6-24b3-4654-bcfa-ccd5a0b8f089 req-ddc5363b-c1cb-4c97-b295-4f187ba023cd service nova] Lock "3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:47.245948 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-5c8bd1a6-24b3-4654-bcfa-ccd5a0b8f089 req-ddc5363b-c1cb-4c97-b295-4f187ba023cd service nova] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Processing event network-vif-plugged-73bc542d-2c3b-4675-8361-9e2bd49f52fe {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:09:47.292814 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:47.298087 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:47.330029 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:47.604832 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf, portal: 192.168.40.100,3260]
May 21 02:09:47.604832 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf, portal: 192.168.40.100,3260] successful.
May 21 02:09:47.604832 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:47.616205 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:47.653834 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:47.653834 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:47.653834 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:47.653834 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:47.653834 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:47.653834 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:47.653834 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:47.653834 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:47.653834 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:47.653834 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:47.653834 np0000001127 nova-compute[98206]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14778ff8-38ab-488d-be23-e6cef32d9159 (non-flash)
May 21 02:09:47.653834 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:47.653834 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:47.653834 np0000001127 nova-compute[98206]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf (non-flash)
May 21 02:09:47.653834 np0000001127 nova-compute[98206]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf (non-flash)
May 21 02:09:47.653834 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:47.653834 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:47.653834 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:09:47.654262 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsi session list stdout=tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:47.654262 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:47.654262 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:47.654262 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:47.654262 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:47.654262 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:47.654262 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:47.654262 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:47.654262 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:47.654262 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:47.654262 np0000001127 nova-compute[98206]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14778ff8-38ab-488d-be23-e6cef32d9159 (non-flash)
May 21 02:09:47.654262 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:47.654262 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:47.654262 np0000001127 nova-compute[98206]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf (non-flash)
May 21 02:09:47.654262 np0000001127 nova-compute[98206]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf (non-flash)
May 21 02:09:47.654262 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:47.654262 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:47.654262 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:09:47.654262 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.221s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:09:47.654262 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:09:47.655482 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] HCTL ('20', '-', '-', 0) found on session 149 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:09:47.655601 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:09:47.677179 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Searching for a device in session 149 and hctl ['20', '*', '*', 0] yield: sdr {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:09:47.677423 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Connected to sdr using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3c50adb2-177d-460b-bcd1-733d4ca823cf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:09:47.724081 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-ff86125f-7836-4515-afa2-f8190ace2e2d tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Detected multiple connections on this host for volume: e7cfdf26-9973-4cc1-8395-11f9ebc98c4b, skipping target disconnect.
May 21 02:09:47.962724 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329387.9617014, 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:09:47.963142 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] VM Started (Lifecycle Event)
May 21 02:09:47.965807 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:09:47.973477 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:09:47.978191 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Instance spawned successfully.
May 21 02:09:47.978662 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:09:48.288569 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-ff86125f-7836-4515-afa2-f8190ace2e2d tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lazy-loading 'flavor' on Instance uuid aa3f5a78-fb82-4e21-8ebf-90bf48a122be {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:09:48.469239 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:09:48.475029 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:09:48.507564 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Found WWN 330000000ce9c366d for multipath device dm-13 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:09:48.507808 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.093s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:09:48.508030 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] <== connect_volume: return (3093ms) {'type': 'block', 'scsi_wwn': '330000000ce9c366d', 'path': '/dev/dm-13', 'multipath_id': '330000000ce9c366d'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:09:48.508180 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ce9c366d', 'path': '/dev/dm-13', 'multipath_id': '330000000ce9c366d'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:09:48.524147 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lazy-loading 'flavor' on Instance uuid 0d5857fd-c96f-444b-ac06-634d1c81a32a {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:09:48.531275 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:09:48.535583 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:09:48.539437 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:09:48.542302 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:09:48.549349 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:09:48.553661 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:09:48.707084 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:48.984900 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:09:48.985392 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329388.9849787, 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:09:48.985392 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] VM Paused (Lifecycle Event)
May 21 02:09:49.047519 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Attempting to attach volume 3c50adb2-177d-460b-bcd1-733d4ca823cf with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 02:09:49.049030 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] attach device xml: <disk type="block" device="disk">
May 21 02:09:49.049030 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:09:49.049030 np0000001127 nova-compute[98206]:   <alias name="ua-3c50adb2-177d-460b-bcd1-733d4ca823cf"/>
May 21 02:09:49.049030 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-13"/>
May 21 02:09:49.049030 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:09:49.049030 np0000001127 nova-compute[98206]:   <serial>3c50adb2-177d-460b-bcd1-733d4ca823cf</serial>
May 21 02:09:49.049030 np0000001127 nova-compute[98206]: </disk>
May 21 02:09:49.049030 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 02:09:49.068182 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Took 9.33 seconds to spawn the instance on the hypervisor.
May 21 02:09:49.068182 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:09:49.068182 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:49.289391 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:49.289614 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:49.300204 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ff86125f-7836-4515-afa2-f8190ace2e2d tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.382s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:49.316794 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0d252a21-6e2f-451c-8a83-7482fc12136c req-51d71d0e-d795-4065-a21f-50c835b0f787 service nova] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Received event network-vif-plugged-73bc542d-2c3b-4675-8361-9e2bd49f52fe {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:09:49.317091 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0d252a21-6e2f-451c-8a83-7482fc12136c req-51d71d0e-d795-4065-a21f-50c835b0f787 service nova] Acquiring lock "3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:49.317713 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0d252a21-6e2f-451c-8a83-7482fc12136c req-51d71d0e-d795-4065-a21f-50c835b0f787 service nova] Lock "3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:49.318786 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0d252a21-6e2f-451c-8a83-7482fc12136c req-51d71d0e-d795-4065-a21f-50c835b0f787 service nova] Lock "3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:49.318980 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0d252a21-6e2f-451c-8a83-7482fc12136c req-51d71d0e-d795-4065-a21f-50c835b0f787 service nova] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] No waiting events found dispatching network-vif-plugged-73bc542d-2c3b-4675-8361-9e2bd49f52fe {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:09:49.319550 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-0d252a21-6e2f-451c-8a83-7482fc12136c req-51d71d0e-d795-4065-a21f-50c835b0f787 service nova] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Received unexpected event network-vif-plugged-73bc542d-2c3b-4675-8361-9e2bd49f52fe for instance with vm_state active and task_state None.
May 21 02:09:49.488405 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:09:49.491001 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329389.4906857, 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:09:49.491177 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] VM Resumed (Lifecycle Event)
May 21 02:09:49.580893 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Took 16.89 seconds to build instance.
May 21 02:09:49.793366 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Detaching volume e7cfdf26-9973-4cc1-8395-11f9ebc98c4b
May 21 02:09:49.853024 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Attempting to driver detach volume e7cfdf26-9973-4cc1-8395-11f9ebc98c4b from mountpoint /dev/vdb
May 21 02:09:49.860620 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Found disk vdb by alias ua-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:09:49.862039 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Found disk vdb by alias ua-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:09:49.862205 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Attempting to detach device vdb from instance c76064e6-3702-4e67-9d4f-ef67cd4b7b22 from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 02:09:49.862501 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:09:49.862501 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:09:49.862501 np0000001127 nova-compute[98206]:   <alias name="ua-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b"/>
May 21 02:09:49.862501 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-1"/>
May 21 02:09:49.862501 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:09:49.862501 np0000001127 nova-compute[98206]:   <serial>e7cfdf26-9973-4cc1-8395-11f9ebc98c4b</serial>
May 21 02:09:49.862501 np0000001127 nova-compute[98206]:   <shareable/>
May 21 02:09:49.862501 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 21 02:09:49.862501 np0000001127 nova-compute[98206]: </disk>
May 21 02:09:49.862501 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:09:49.873353 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Successfully detached device vdb from instance c76064e6-3702-4e67-9d4f-ef67cd4b7b22 from the persistent domain config.
May 21 02:09:49.873544 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] (1/8): Attempting to detach device vdb with device alias ua-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b from instance c76064e6-3702-4e67-9d4f-ef67cd4b7b22 from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 02:09:49.875876 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:09:49.875876 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:09:49.875876 np0000001127 nova-compute[98206]:   <alias name="ua-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b"/>
May 21 02:09:49.875876 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-1"/>
May 21 02:09:49.875876 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:09:49.875876 np0000001127 nova-compute[98206]:   <serial>e7cfdf26-9973-4cc1-8395-11f9ebc98c4b</serial>
May 21 02:09:49.875876 np0000001127 nova-compute[98206]:   <shareable/>
May 21 02:09:49.875876 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 21 02:09:49.875876 np0000001127 nova-compute[98206]: </disk>
May 21 02:09:49.875876 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:09:49.993812 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:09:49.998638 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:09:50.083004 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9b4ce033-a2e3-49c6-9b4c-356295420f01 tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Lock "3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.412s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:50.747042 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:09:50.747192 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:09:50.747341 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:09:50.747515 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] No VIF found with MAC fa:16:3e:21:79:93, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:09:51.676038 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:09:51.676515 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 21 02:09:51.677995 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:09:51.774716 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:52.012067 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-008812ab-d14f-41cc-8242-659842b9232a req-c7421821-8dca-410a-8ffb-613852c485ae service nova] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Received event network-changed-73bc542d-2c3b-4675-8361-9e2bd49f52fe {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:09:52.012397 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-008812ab-d14f-41cc-8242-659842b9232a req-c7421821-8dca-410a-8ffb-613852c485ae service nova] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Refreshing instance network info cache due to event network-changed-73bc542d-2c3b-4675-8361-9e2bd49f52fe. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:09:52.012508 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-008812ab-d14f-41cc-8242-659842b9232a req-c7421821-8dca-410a-8ffb-613852c485ae service nova] Acquiring lock "refresh_cache-3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:09:52.012655 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-008812ab-d14f-41cc-8242-659842b9232a req-c7421821-8dca-410a-8ffb-613852c485ae service nova] Acquired lock "refresh_cache-3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:09:52.015905 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-008812ab-d14f-41cc-8242-659842b9232a req-c7421821-8dca-410a-8ffb-613852c485ae service nova] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Refreshing network info cache for port 73bc542d-2c3b-4675-8361-9e2bd49f52fe {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:09:52.303903 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0a3c1372-cf26-4cf3-98d1-0deec2c1de14 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "0d5857fd-c96f-444b-ac06-634d1c81a32a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.606s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:52.385531 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:52.525367 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-008812ab-d14f-41cc-8242-659842b9232a req-c7421821-8dca-410a-8ffb-613852c485ae service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:52.670024 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "0d5857fd-c96f-444b-ac06-634d1c81a32a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:52.671094 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "0d5857fd-c96f-444b-ac06-634d1c81a32a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:52.903330 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-008812ab-d14f-41cc-8242-659842b9232a req-c7421821-8dca-410a-8ffb-613852c485ae service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:53.084187 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-008812ab-d14f-41cc-8242-659842b9232a req-c7421821-8dca-410a-8ffb-613852c485ae service nova] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Updated VIF entry in instance network info cache for port 73bc542d-2c3b-4675-8361-9e2bd49f52fe. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:09:53.084591 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-008812ab-d14f-41cc-8242-659842b9232a req-c7421821-8dca-410a-8ffb-613852c485ae service nova] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Updating instance_info_cache with network_info: [{"id": "73bc542d-2c3b-4675-8361-9e2bd49f52fe", "address": "fa:16:3e:ce:28:ea", "network": {"id": "e7b16641-1745-4249-9b74-305029a60f3f", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-685232721-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1646ca3e5bf3425ca0bd66c5a50c996b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bc542d-2c", "ovs_interfaceid": "73bc542d-2c3b-4675-8361-9e2bd49f52fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:09:53.177201 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Detaching volume 3c50adb2-177d-460b-bcd1-733d4ca823cf
May 21 02:09:53.243207 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Attempting to driver detach volume 3c50adb2-177d-460b-bcd1-733d4ca823cf from mountpoint /dev/vdb
May 21 02:09:53.254920 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Found disk vdb by alias ua-3c50adb2-177d-460b-bcd1-733d4ca823cf {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:09:53.264316 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Found disk vdb by alias ua-3c50adb2-177d-460b-bcd1-733d4ca823cf {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:09:53.267872 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Attempting to detach device vdb from instance 0d5857fd-c96f-444b-ac06-634d1c81a32a from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 02:09:53.268244 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:09:53.268244 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:09:53.268244 np0000001127 nova-compute[98206]:   <alias name="ua-3c50adb2-177d-460b-bcd1-733d4ca823cf"/>
May 21 02:09:53.268244 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-13"/>
May 21 02:09:53.268244 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:09:53.268244 np0000001127 nova-compute[98206]:   <serial>3c50adb2-177d-460b-bcd1-733d4ca823cf</serial>
May 21 02:09:53.268244 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:09:53.268244 np0000001127 nova-compute[98206]: </disk>
May 21 02:09:53.268244 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:09:53.278623 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Successfully detached device vdb from instance 0d5857fd-c96f-444b-ac06-634d1c81a32a from the persistent domain config.
May 21 02:09:53.278861 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] (1/8): Attempting to detach device vdb with device alias ua-3c50adb2-177d-460b-bcd1-733d4ca823cf from instance 0d5857fd-c96f-444b-ac06-634d1c81a32a from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 02:09:53.279225 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:09:53.279225 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:09:53.279225 np0000001127 nova-compute[98206]:   <alias name="ua-3c50adb2-177d-460b-bcd1-733d4ca823cf"/>
May 21 02:09:53.279225 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-13"/>
May 21 02:09:53.279225 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:09:53.279225 np0000001127 nova-compute[98206]:   <serial>3c50adb2-177d-460b-bcd1-733d4ca823cf</serial>
May 21 02:09:53.279225 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:09:53.279225 np0000001127 nova-compute[98206]: </disk>
May 21 02:09:53.279225 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:09:53.334588 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779329393.333587, c76064e6-3702-4e67-9d4f-ef67cd4b7b22 => ua-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 02:09:53.337371 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b for instance c76064e6-3702-4e67-9d4f-ef67cd4b7b22 {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 02:09:53.341187 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Successfully detached device vdb from instance c76064e6-3702-4e67-9d4f-ef67cd4b7b22 from the live domain config.
May 21 02:09:53.393222 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:09:53.393564 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:09:53.393736 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:09:53.394291 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:09:53.394602 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:09:53.394761 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:09:53.433189 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:53.433189 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:53.433189 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:53.433189 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:53.433189 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:53.433189 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:53.433189 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:53.433189 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:53.433189 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:53.433189 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:53.433189 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:53.433189 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:53.433189 np0000001127 nova-compute[98206]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf (non-flash)
May 21 02:09:53.433189 np0000001127 nova-compute[98206]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf (non-flash)
May 21 02:09:53.433189 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:53.433189 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:53.433189 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:09:53.433641 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsi session list stdout=tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:53.433641 np0000001127 nova-compute[98206]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b (non-flash)
May 21 02:09:53.433641 np0000001127 nova-compute[98206]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:53.433641 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:53.433641 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:53.433641 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:53.433641 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:53.433641 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:53.433641 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:53.433641 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:53.433641 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:53.433641 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:53.433641 np0000001127 nova-compute[98206]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf (non-flash)
May 21 02:09:53.433641 np0000001127 nova-compute[98206]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf (non-flash)
May 21 02:09:53.433641 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:53.433641 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:53.433641 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:09:53.433641 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', '118'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', '119'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', '132'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', '133'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', '134'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', '135'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515', '140'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515', '141'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', '144'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', '145'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a', '147'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a', '148'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf', '149'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf', '150'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '95')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:09:53.433641 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', '118')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:09:53.434780 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b', '119')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:09:53.435735 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c05826d440>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b'): ({'sde'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:09:53.435915 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Removing multipathed devices sdd, sde {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:09:53.436136 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Flush multipath device 330000000eb19b356 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:09:53.467092 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:09:53.513392 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:09:53.558131 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:09:53.558131 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:09:53.559050 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:09:53.574792 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:09:53.575072 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:09:53.586513 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-008812ab-d14f-41cc-8242-659842b9232a req-c7421821-8dca-410a-8ffb-613852c485ae service nova] Releasing lock "refresh_cache-3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:09:53.588780 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:53.634412 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 118, target: iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b, portal: 192.168.40.100,3260]
May 21 02:09:53.634412 np0000001127 nova-compute[98206]: Logout of [sid: 118, target: iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b, portal: 192.168.40.100,3260] successful.
May 21 02:09:53.634412 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:53.665829 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:53.677071 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:09:53.677911 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:09:53.680139 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:53.731654 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 119, target: iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b, portal: 192.168.50.100,3260]
May 21 02:09:53.731654 np0000001127 nova-compute[98206]: Logout of [sid: 119, target: iqn.2023-03.storpool.com:os--volume-e7cfdf26-9973-4cc1-8395-11f9ebc98c4b, portal: 192.168.50.100,3260] successful.
May 21 02:09:53.731654 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:53.758031 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:53.758304 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:09:53.758465 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] <== disconnect_volume: return (364ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:09:53.758642 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:09:53.846063 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779329393.8457084, 0d5857fd-c96f-444b-ac06-634d1c81a32a => ua-3c50adb2-177d-460b-bcd1-733d4ca823cf> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 02:09:53.847267 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-3c50adb2-177d-460b-bcd1-733d4ca823cf for instance 0d5857fd-c96f-444b-ac06-634d1c81a32a {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 02:09:53.850834 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Successfully detached device vdb from instance 0d5857fd-c96f-444b-ac06-634d1c81a32a from the live domain config.
May 21 02:09:53.852776 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:09:53.853108 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf', 'iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3c50adb2-177d-460b-bcd1-733d4ca823cf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-13'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:09:53.853274 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:09:53.853661 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:09:53.855004 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf', 'iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3c50adb2-177d-460b-bcd1-733d4ca823cf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-13'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:09:53.855175 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:09:53.893857 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:53.893857 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:53.893857 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:53.893857 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:53.893857 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:53.893857 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:53.893857 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:53.893857 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:53.893857 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:53.893857 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:53.893857 np0000001127 nova-compute[98206]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf (non-flash)
May 21 02:09:53.893857 np0000001127 nova-compute[98206]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf (non-flash)
May 21 02:09:53.893857 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:53.893857 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:53.893857 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:09:53.894368 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsi session list stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:53.894368 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:09:53.894368 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:53.894368 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:09:53.894368 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:53.894368 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:09:53.894368 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:53.894368 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:09:53.894368 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:53.894368 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:09:53.894368 np0000001127 nova-compute[98206]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf (non-flash)
May 21 02:09:53.894368 np0000001127 nova-compute[98206]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf (non-flash)
May 21 02:09:53.894368 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:53.894368 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:09:53.894368 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:09:53.894368 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', '132'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', '133'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', '134'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', '135'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515', '140'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515', '141'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', '144'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', '145'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a', '147'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a', '148'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf', '149'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf', '150'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '95')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:09:53.894368 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf', '149')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:09:53.895559 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf', '150')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:09:53.897189 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c058574ae0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf'): ({'sdr'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf'): ({'sdo'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:09:53.897416 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Removing multipathed devices sdo, sdr {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:09:53.897721 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Flush multipath device 330000000ce9c366d {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:09:53.934290 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:09:53.980143 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Remove SCSI device /dev/sdr with /sys/block/sdr/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:09:54.028702 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Checking to see if SCSI volumes sdo, sdr have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:09:54.028910 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] SCSI volumes sdo, sdr have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:09:54.030180 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Checking to see if device paths {'sdo', 'sdr'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:09:54.047997 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Device paths {'sdo', 'sdr'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:09:54.048130 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:09:54.065044 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:54.071053 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:54.091558 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-31901a04-731a-4d96-952d-29c177e26bbd req-3a3c9ed1-a9b1-4924-8264-0daf4b1a314e service nova] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Received event network-changed-73bc542d-2c3b-4675-8361-9e2bd49f52fe {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:09:54.095641 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-31901a04-731a-4d96-952d-29c177e26bbd req-3a3c9ed1-a9b1-4924-8264-0daf4b1a314e service nova] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Refreshing instance network info cache due to event network-changed-73bc542d-2c3b-4675-8361-9e2bd49f52fe. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:09:54.095641 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-31901a04-731a-4d96-952d-29c177e26bbd req-3a3c9ed1-a9b1-4924-8264-0daf4b1a314e service nova] Acquiring lock "refresh_cache-3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:09:54.095641 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-31901a04-731a-4d96-952d-29c177e26bbd req-3a3c9ed1-a9b1-4924-8264-0daf4b1a314e service nova] Acquired lock "refresh_cache-3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:09:54.095641 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-31901a04-731a-4d96-952d-29c177e26bbd req-3a3c9ed1-a9b1-4924-8264-0daf4b1a314e service nova] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Refreshing network info cache for port 73bc542d-2c3b-4675-8361-9e2bd49f52fe {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:09:54.111440 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 149, target: iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf, portal: 192.168.40.100,3260]
May 21 02:09:54.111440 np0000001127 nova-compute[98206]: Logout of [sid: 149, target: iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf, portal: 192.168.40.100,3260] successful.
May 21 02:09:54.111440 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:54.141267 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:54.156448 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:54.184352 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:54.185799 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:54.186084 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:54.186269 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Auditing locally available compute resources for np0000001127 (node: np0000001127) {{(pid=98206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 21 02:09:54.201919 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 150, target: iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf, portal: 192.168.50.100,3260]
May 21 02:09:54.201919 np0000001127 nova-compute[98206]: Logout of [sid: 150, target: iqn.2023-03.storpool.com:os--volume-3c50adb2-177d-460b-bcd1-733d4ca823cf, portal: 192.168.50.100,3260] successful.
May 21 02:09:54.201919 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:54.234578 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:09:54.234926 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:09:54.235241 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] <== disconnect_volume: return (381ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:09:54.235241 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:09:54.344873 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lazy-loading 'flavor' on Instance uuid c76064e6-3702-4e67-9d4f-ef67cd4b7b22 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:09:54.416765 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Acquiring lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:54.417173 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:54.588240 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:54.598390 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-31901a04-731a-4d96-952d-29c177e26bbd req-3a3c9ed1-a9b1-4924-8264-0daf4b1a314e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:54.796148 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lazy-loading 'flavor' on Instance uuid 0d5857fd-c96f-444b-ac06-634d1c81a32a {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:09:54.921205 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lazy-loading 'flavor' on Instance uuid 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:09:54.976933 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-31901a04-731a-4d96-952d-29c177e26bbd req-3a3c9ed1-a9b1-4924-8264-0daf4b1a314e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:55.122065 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-31901a04-731a-4d96-952d-29c177e26bbd req-3a3c9ed1-a9b1-4924-8264-0daf4b1a314e service nova] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Updated VIF entry in instance network info cache for port 73bc542d-2c3b-4675-8361-9e2bd49f52fe. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:09:55.125141 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-31901a04-731a-4d96-952d-29c177e26bbd req-3a3c9ed1-a9b1-4924-8264-0daf4b1a314e service nova] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Updating instance_info_cache with network_info: [{"id": "73bc542d-2c3b-4675-8361-9e2bd49f52fe", "address": "fa:16:3e:ce:28:ea", "network": {"id": "e7b16641-1745-4249-9b74-305029a60f3f", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-685232721-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1646ca3e5bf3425ca0bd66c5a50c996b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bc542d-2c", "ovs_interfaceid": "73bc542d-2c3b-4675-8361-9e2bd49f52fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:09:55.235361 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:55.352046 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-73fda288-c0b7-49a1-8822-01de35c5b842 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.062s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:55.354970 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:09:55.355778 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:55.457432 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:09:55.468008 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:09:55.473127 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:55.580607 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:09:55.581043 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:55.627559 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-31901a04-731a-4d96-952d-29c177e26bbd req-3a3c9ed1-a9b1-4924-8264-0daf4b1a314e service nova] Releasing lock "refresh_cache-3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:09:55.627880 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-31901a04-731a-4d96-952d-29c177e26bbd req-3a3c9ed1-a9b1-4924-8264-0daf4b1a314e service nova] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Received event network-changed-73bc542d-2c3b-4675-8361-9e2bd49f52fe {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:09:55.628017 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-31901a04-731a-4d96-952d-29c177e26bbd req-3a3c9ed1-a9b1-4924-8264-0daf4b1a314e service nova] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Refreshing instance network info cache due to event network-changed-73bc542d-2c3b-4675-8361-9e2bd49f52fe. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:09:55.628206 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-31901a04-731a-4d96-952d-29c177e26bbd req-3a3c9ed1-a9b1-4924-8264-0daf4b1a314e service nova] Acquiring lock "refresh_cache-3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:09:55.628311 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-31901a04-731a-4d96-952d-29c177e26bbd req-3a3c9ed1-a9b1-4924-8264-0daf4b1a314e service nova] Acquired lock "refresh_cache-3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:09:55.628415 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-31901a04-731a-4d96-952d-29c177e26bbd req-3a3c9ed1-a9b1-4924-8264-0daf4b1a314e service nova] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Refreshing network info cache for port 73bc542d-2c3b-4675-8361-9e2bd49f52fe {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:09:55.669873 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:09:55.670293 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-11 (vdb) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:09:55.670369 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-7 (vdc) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:09:55.670507 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-12 (vdd) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:09:55.676266 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c50913-8b08-402c-8ece-87c7521ce785/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:55.775392 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c50913-8b08-402c-8ece-87c7521ce785/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:09:55.776000 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c50913-8b08-402c-8ece-87c7521ce785/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:55.807176 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7c725e71-b958-409a-a0c6-06980ba0aff9 tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "0d5857fd-c96f-444b-ac06-634d1c81a32a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.135s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:55.899088 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c50913-8b08-402c-8ece-87c7521ce785/disk --force-share --output=json" returned: 0 in 0.123s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:09:55.904891 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5857fd-c96f-444b-ac06-634d1c81a32a/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:55.931763 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.514s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:55.996678 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5857fd-c96f-444b-ac06-634d1c81a32a/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:09:55.997219 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5857fd-c96f-444b-ac06-634d1c81a32a/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:56.014074 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1818c00a-159c-4be6-8cf6-61e85feaf11c tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "0d5857fd-c96f-444b-ac06-634d1c81a32a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:56.014460 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1818c00a-159c-4be6-8cf6-61e85feaf11c tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "0d5857fd-c96f-444b-ac06-634d1c81a32a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:56.015485 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1818c00a-159c-4be6-8cf6-61e85feaf11c tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "0d5857fd-c96f-444b-ac06-634d1c81a32a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:56.015485 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1818c00a-159c-4be6-8cf6-61e85feaf11c tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "0d5857fd-c96f-444b-ac06-634d1c81a32a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:56.015485 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1818c00a-159c-4be6-8cf6-61e85feaf11c tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "0d5857fd-c96f-444b-ac06-634d1c81a32a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:56.020947 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-1818c00a-159c-4be6-8cf6-61e85feaf11c tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Terminating instance
May 21 02:09:56.098379 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5857fd-c96f-444b-ac06-634d1c81a32a/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:09:56.102957 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:56.145171 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-31901a04-731a-4d96-952d-29c177e26bbd req-3a3c9ed1-a9b1-4924-8264-0daf4b1a314e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:56.214954 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:09:56.215389 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:56.327727 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:09:56.335254 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6df4554-8490-4d5a-9d4d-acfd46419cb3/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:56.443260 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6df4554-8490-4d5a-9d4d-acfd46419cb3/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:09:56.443260 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6df4554-8490-4d5a-9d4d-acfd46419cb3/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:56.527808 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1818c00a-159c-4be6-8cf6-61e85feaf11c tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:09:56.538809 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6df4554-8490-4d5a-9d4d-acfd46419cb3/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:09:56.542368 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c15c9f3-e0d2-4d6d-9144-b9760c55be0e/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:56.571389 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:56.580898 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-31901a04-731a-4d96-952d-29c177e26bbd req-3a3c9ed1-a9b1-4924-8264-0daf4b1a314e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:56.588331 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:56.608671 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:56.609756 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:56.639864 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c15c9f3-e0d2-4d6d-9144-b9760c55be0e/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:09:56.640406 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c15c9f3-e0d2-4d6d-9144-b9760c55be0e/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:56.760797 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c15c9f3-e0d2-4d6d-9144-b9760c55be0e/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:09:56.765426 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0bba4514-2021-4bdc-ab2f-d53a627927c0 req-8c72dc1c-fddd-4131-8719-5f8abb777c45 service nova] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Received event network-vif-unplugged-9f18bc65-626b-4448-9473-4f9c7f843775 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:09:56.767757 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0bba4514-2021-4bdc-ab2f-d53a627927c0 req-8c72dc1c-fddd-4131-8719-5f8abb777c45 service nova] Acquiring lock "0d5857fd-c96f-444b-ac06-634d1c81a32a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:56.769068 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0bba4514-2021-4bdc-ab2f-d53a627927c0 req-8c72dc1c-fddd-4131-8719-5f8abb777c45 service nova] Lock "0d5857fd-c96f-444b-ac06-634d1c81a32a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:56.769289 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0bba4514-2021-4bdc-ab2f-d53a627927c0 req-8c72dc1c-fddd-4131-8719-5f8abb777c45 service nova] Lock "0d5857fd-c96f-444b-ac06-634d1c81a32a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:56.769551 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0bba4514-2021-4bdc-ab2f-d53a627927c0 req-8c72dc1c-fddd-4131-8719-5f8abb777c45 service nova] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] No waiting events found dispatching network-vif-unplugged-9f18bc65-626b-4448-9473-4f9c7f843775 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:09:56.772896 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:09:56.773609 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0bba4514-2021-4bdc-ab2f-d53a627927c0 req-8c72dc1c-fddd-4131-8719-5f8abb777c45 service nova] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Received event network-vif-unplugged-9f18bc65-626b-4448-9473-4f9c7f843775 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:09:56.776059 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-8 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:09:56.779684 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:56.787496 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:56.847554 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-31901a04-731a-4d96-952d-29c177e26bbd req-3a3c9ed1-a9b1-4924-8264-0daf4b1a314e service nova] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Updated VIF entry in instance network info cache for port 73bc542d-2c3b-4675-8361-9e2bd49f52fe. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:09:56.849885 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-31901a04-731a-4d96-952d-29c177e26bbd req-3a3c9ed1-a9b1-4924-8264-0daf4b1a314e service nova] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Updating instance_info_cache with network_info: [{"id": "73bc542d-2c3b-4675-8361-9e2bd49f52fe", "address": "fa:16:3e:ce:28:ea", "network": {"id": "e7b16641-1745-4249-9b74-305029a60f3f", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-685232721-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1646ca3e5bf3425ca0bd66c5a50c996b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bc542d-2c", "ovs_interfaceid": "73bc542d-2c3b-4675-8361-9e2bd49f52fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:09:56.882937 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999667693999982 future=<Future at 0x71c05827f650 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:09:56.883941 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.998646710999765 future=<Future at 0x71c05827f650 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:09:56.884035 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.998516328999813 future=<Future at 0x71c05827f650 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:09:56.885582 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Instance destroyed successfully.
May 21 02:09:56.886245 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-1818c00a-159c-4be6-8cf6-61e85feaf11c tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lazy-loading 'resources' on Instance uuid 0d5857fd-c96f-444b-ac06-634d1c81a32a {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:09:56.919131 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:09:56.919399 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:57.022077 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Acquiring lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:57.027101 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.005s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:57.027530 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Attaching volume bef1cca2-1e4a-42c7-99af-ce84d5bcad43 to /dev/vdb
May 21 02:09:57.032452 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:09:57.041979 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:09:57.043405 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:57.109596 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:09:57.112811 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "env LANG=C uptime" returned: 0 in 0.069s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:09:57.113236 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Hypervisor/Node resource view: name=np0000001127 free_ram=10523MB free_disk=72.76341247558594GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 21 02:09:57.113463 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:57.113839 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:57.124429 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:09:57.150896 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:09:57.199491 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:09:57.199831 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:09:57.213273 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:09:57.216299 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe20:ae96', 'fe80::fc16:3eff:fe5c:a90d', 'fe80::786b:86ff:fe32:8f96', 'fe80::fc16:3eff:fe2c:b36f', 'fe80::fc16:3eff:fe30:164f', 'fe80::c44d:25ff:fe10:25cb', 'fe80::fc16:3eff:fece:28ea', 'fe80::7878:aaff:fe51:47c7', 'fe80::fc16:3eff:fe0f:28a1', 'fe80::440a:38ff:fe27:fa24', 'fe80::fc16:3eff:fefb:4d96', 'fe80::fc16:3eff:fe65:6557', 'fe80::fc16:3eff:feb8:d101', 'fe80::7045:30ff:fe1a:b99f', 'fe80::fc16:3eff:fedb:8dd'] 
May 21 02:09:57.216558 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:09:57.216762 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:09:57.217038 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:09:57.217325 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Updating existing volume attachment record: 2665bed2-7fbd-4ad6-9c07-aa458b256e71 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:09:57.353627 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-31901a04-731a-4d96-952d-29c177e26bbd req-3a3c9ed1-a9b1-4924-8264-0daf4b1a314e service nova] Releasing lock "refresh_cache-3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:09:57.390160 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-1818c00a-159c-4be6-8cf6-61e85feaf11c tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:08:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1258357069',display_name='tempest-AttachVolumeNegativeTest-server-1258357069',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumenegativetest-server-1258357069',id=62,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuSulnR0t8rSNEHDvjjezWR8Lw0VnEPBeyObMZ5jlTILCU6V+KyU8V8owCnpN+zSBe7JDbAHTSWy1G9HNfvF7ryGkBTjRdWxE4OSO4dopQFhQt+X/gEyxW4AUt9lfz/PQ==',key_name='tempest-keypair-838003393',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:09:02Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d3efe4046d6a442d91b3463e2d99fd7b',ramdisk_id='',reservation_id='r-y2trp3ol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1208856611',owner_user_name='tempest-AttachVolumeNegativeTest-1208856611-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:09:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f369771db7dd49da85131c9692833a5a',uuid=0d5857fd-c96f-444b-ac06-634d1c81a32a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f18bc65-626b-4448-9473-4f9c7f843775", "address": "fa:16:3e:21:79:93", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f18bc65-62", "ovs_interfaceid": "9f18bc65-626b-4448-9473-4f9c7f843775", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:09:57.390437 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-1818c00a-159c-4be6-8cf6-61e85feaf11c tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Converting VIF {"id": "9f18bc65-626b-4448-9473-4f9c7f843775", "address": "fa:16:3e:21:79:93", "network": {"id": "f683b2da-ab41-43e1-a9bb-98914089b4d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-914313679-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3efe4046d6a442d91b3463e2d99fd7b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f18bc65-62", "ovs_interfaceid": "9f18bc65-626b-4448-9473-4f9c7f843775", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:09:57.391336 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-1818c00a-159c-4be6-8cf6-61e85feaf11c tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:79:93,bridge_name='br-int',has_traffic_filtering=True,id=9f18bc65-626b-4448-9473-4f9c7f843775,network=Network(f683b2da-ab41-43e1-a9bb-98914089b4d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f18bc65-62') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:09:57.392886 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-1818c00a-159c-4be6-8cf6-61e85feaf11c tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:79:93,bridge_name='br-int',has_traffic_filtering=True,id=9f18bc65-626b-4448-9473-4f9c7f843775,network=Network(f683b2da-ab41-43e1-a9bb-98914089b4d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f18bc65-62') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:09:57.394887 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:57.395442 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f18bc65-62, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:09:57.396483 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:57.398034 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:09:57.399063 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:57.399206 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d08b8bb6-abda-4aef-8c9c-bf619fc2e0df) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:09:57.399603 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:09:57.400462 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:09:57.403303 np0000001127 nova-compute[98206]: INFO os_vif [None req-1818c00a-159c-4be6-8cf6-61e85feaf11c tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:79:93,bridge_name='br-int',has_traffic_filtering=True,id=9f18bc65-626b-4448-9473-4f9c7f843775,network=Network(f683b2da-ab41-43e1-a9bb-98914089b4d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f18bc65-62')
May 21 02:09:57.403707 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-1818c00a-159c-4be6-8cf6-61e85feaf11c tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Deleting instance files /opt/stack/data/nova/instances/0d5857fd-c96f-444b-ac06-634d1c81a32a_del
May 21 02:09:57.404662 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-1818c00a-159c-4be6-8cf6-61e85feaf11c tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Deletion of /opt/stack/data/nova/instances/0d5857fd-c96f-444b-ac06-634d1c81a32a_del complete
May 21 02:09:57.781879 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:09:57.782287 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43', 'iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bef1cca2-1e4a-42c7-99af-ce84d5bcad43', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:09:57.782454 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:09:57.911324 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-1818c00a-159c-4be6-8cf6-61e85feaf11c tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Took 1.39 seconds to destroy the instance on the hypervisor.
May 21 02:09:57.912021 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-1818c00a-159c-4be6-8cf6-61e85feaf11c tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:09:57.912418 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:09:57.912568 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:09:57.912906 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:58.026671 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:09:58.194276 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 6ccaedfe-bec9-4591-b845-acf0cc81d026 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:09:58.195247 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "eb1c328c-f707-4f0d-90b5-ab5b268bf05a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:58.195687 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 16a0cc8d-c65b-4166-ad1a-5318b18ed00e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:09:58.195687 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "eb1c328c-f707-4f0d-90b5-ab5b268bf05a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:58.197898 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance b6df4554-8490-4d5a-9d4d-acfd46419cb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:09:58.198046 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:09:58.198218 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance aa3f5a78-fb82-4e21-8ebf-90bf48a122be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:09:58.198302 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 0d5857fd-c96f-444b-ac06-634d1c81a32a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:09:58.198452 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance c76064e6-3702-4e67-9d4f-ef67cd4b7b22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:09:58.199034 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:09:58.199372 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 10c50913-8b08-402c-8ece-87c7521ce785 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:09:58.199534 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance cec9e114-b934-4de6-b0f0-586cd34a59bd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:09:58.199661 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:09:58.510515 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-9632e865-0adf-4063-8094-e9ace0e5e747 req-640ff60c-1a09-410b-b4fa-2a5844093ce4 service nova] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Received event network-vif-deleted-9f18bc65-626b-4448-9473-4f9c7f843775 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:09:58.510698 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-9632e865-0adf-4063-8094-e9ace0e5e747 req-640ff60c-1a09-410b-b4fa-2a5844093ce4 service nova] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Neutron deleted interface 9f18bc65-626b-4448-9473-4f9c7f843775; detaching it from the instance and deleting it from the info cache
May 21 02:09:58.510843 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-9632e865-0adf-4063-8094-e9ace0e5e747 req-640ff60c-1a09-410b-b4fa-2a5844093ce4 service nova] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:09:58.699729 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:09:58.703210 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance eb1c328c-f707-4f0d-90b5-ab5b268bf05a has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 21 02:09:58.703540 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 21 02:09:58.704805 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Final resource view: name=np0000001127 phys_ram=24030MB used_ram=2752MB phys_disk=95GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:09:57 up 40 min,  2 users,  load average: 8.80, 9.22, 6.35\n', 'num_instances': '11', 'num_vm_active': '11', 'num_task_None': '10', 'num_os_type_None': '11', 'num_proj_848912b0c0e94d2795bb2332daf1730e': '5', 'io_workload': '0', 'num_proj_4ae2ef74a1614eb09e4f71f709f64126': '2', 'num_task_deleting': '1', 'num_proj_d3efe4046d6a442d91b3463e2d99fd7b': '1', 'num_proj_7c062763c08b4e5190a5351babe96c84': '1', 'num_proj_62ebdb16aee84e22a88dfc8960debd32': '1', 'num_proj_1646ca3e5bf3425ca0bd66c5a50c996b': '1'} {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 21 02:09:58.837015 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b87e5db9-83c6-4715-81fb-e9a077ed6001 req-a5ffeae9-5fae-420a-8eaa-a07a4b4e7873 service nova] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Received event network-vif-unplugged-9f18bc65-626b-4448-9473-4f9c7f843775 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:09:58.839492 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b87e5db9-83c6-4715-81fb-e9a077ed6001 req-a5ffeae9-5fae-420a-8eaa-a07a4b4e7873 service nova] Acquiring lock "0d5857fd-c96f-444b-ac06-634d1c81a32a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:58.839492 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b87e5db9-83c6-4715-81fb-e9a077ed6001 req-a5ffeae9-5fae-420a-8eaa-a07a4b4e7873 service nova] Lock "0d5857fd-c96f-444b-ac06-634d1c81a32a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:09:58.839492 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b87e5db9-83c6-4715-81fb-e9a077ed6001 req-a5ffeae9-5fae-420a-8eaa-a07a4b4e7873 service nova] Lock "0d5857fd-c96f-444b-ac06-634d1c81a32a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:09:58.839492 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b87e5db9-83c6-4715-81fb-e9a077ed6001 req-a5ffeae9-5fae-420a-8eaa-a07a4b4e7873 service nova] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] No waiting events found dispatching network-vif-unplugged-9f18bc65-626b-4448-9473-4f9c7f843775 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:09:58.839492 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b87e5db9-83c6-4715-81fb-e9a077ed6001 req-a5ffeae9-5fae-420a-8eaa-a07a4b4e7873 service nova] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Received event network-vif-unplugged-9f18bc65-626b-4448-9473-4f9c7f843775 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:09:58.960422 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:09:59.018424 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-9632e865-0adf-4063-8094-e9ace0e5e747 req-640ff60c-1a09-410b-b4fa-2a5844093ce4 service nova] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Detach interface failed, port_id=9f18bc65-626b-4448-9473-4f9c7f843775, reason: Instance 0d5857fd-c96f-444b-ac06-634d1c81a32a could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:09:59.263843 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:09:59.281647 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:09:59.281851 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:09:59.464060 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Took 1.55 seconds to deallocate network for instance.
May 21 02:09:59.784216 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:09:59.969383 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1818c00a-159c-4be6-8cf6-61e85feaf11c tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:00.290288 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Compute_service record updated for np0000001127:np0000001127 {{(pid=98206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 21 02:10:00.290793 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.177s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:00.290793 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.027s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:00.290943 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:10:00.293784 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:10:00.293873 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Claim successful on node np0000001127
May 21 02:10:00.439975 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.657s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:10:00.440654 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43', 'iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bef1cca2-1e4a-42c7-99af-ce84d5bcad43', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:10:00.455803 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:10:00.456490 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:10:00.456908 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:10:00.457104 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:10:00.457548 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:10:00.457736 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:10:00.473962 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:10:00.473962 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:10:00.484373 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:10:00.484373 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:10:00.495662 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43] added
May 21 02:10:00.495662 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:10:00.495662 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:10:00.495662 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:10:00.495662 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:10:00.495662 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:10:00.495662 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:10:00.495662 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:10:00.495662 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0377(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:10:00.495662 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:10:00.498183 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43] added
May 21 02:10:00.498183 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:10:00.498183 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:10:00.498183 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:10:00.498183 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:10:00.498183 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:10:00.498183 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:10:00.498356 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:10:00.498442 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0413(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:10:00.498580 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:10:01.290003 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:10:01.291423 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:10:01.291423 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:10:01.291423 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:10:01.291423 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:10:01.291423 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 51.38 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:10:01.392993 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "10c50913-8b08-402c-8ece-87c7521ce785" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:01.393822 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "10c50913-8b08-402c-8ece-87c7521ce785" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:01.558077 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:10:01.559361 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:10:01.574991 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:10:01.574991 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:10:01.581393 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:10:01.581393 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:10:01.590899 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:10:01.596458 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:10:01.615804 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:01.615804 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:01.615804 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:01.615804 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:01.615804 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:01.615804 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:01.615804 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:01.615804 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:01.615804 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:01.615804 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:01.615804 np0000001127 nova-compute[98206]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27947d44-c589-46c2-9814-1a611596d86a (non-flash)
May 21 02:10:01.615804 np0000001127 nova-compute[98206]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:10:01.615804 np0000001127 nova-compute[98206]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:10:01.615804 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:01.615804 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:01.615804 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:10:01.616310 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsi session list stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:01.616310 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:01.616310 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:01.616310 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:01.616310 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:01.616310 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:01.616310 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:01.616310 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:01.616310 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:01.616310 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:01.616310 np0000001127 nova-compute[98206]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27947d44-c589-46c2-9814-1a611596d86a (non-flash)
May 21 02:10:01.616310 np0000001127 nova-compute[98206]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:10:01.616310 np0000001127 nova-compute[98206]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:10:01.616310 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:01.616310 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:01.616310 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:10:01.624358 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:01.624358 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:01.624358 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:01.624358 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:01.624358 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:01.624358 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:01.624358 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:01.624358 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:01.624358 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:01.624358 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:01.624358 np0000001127 nova-compute[98206]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27947d44-c589-46c2-9814-1a611596d86a (non-flash)
May 21 02:10:01.624358 np0000001127 nova-compute[98206]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:10:01.624358 np0000001127 nova-compute[98206]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:10:01.624358 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:01.624358 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:01.624358 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:10:01.625009 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsi session list stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:01.625009 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:01.625009 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:01.625009 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:01.625009 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:01.625009 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:01.625009 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:01.625009 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:01.625009 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:01.625009 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:01.625009 np0000001127 nova-compute[98206]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27947d44-c589-46c2-9814-1a611596d86a (non-flash)
May 21 02:10:01.625009 np0000001127 nova-compute[98206]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:10:01.625009 np0000001127 nova-compute[98206]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:10:01.625009 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:01.625009 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:01.625009 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:10:01.693054 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43, portal: 192.168.40.100,3260]
May 21 02:10:01.693054 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43, portal: 192.168.40.100,3260] successful.
May 21 02:10:01.693054 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:10:01.704102 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43, portal: 192.168.50.100,3260]
May 21 02:10:01.704102 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43, portal: 192.168.50.100,3260] successful.
May 21 02:10:01.704102 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:10:01.716297 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:10:01.722450 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:10:01.745024 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:01.745024 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:01.745024 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:01.745024 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:01.745024 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:01.745024 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:01.745024 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:01.745024 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:01.745024 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:01.745024 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:01.745024 np0000001127 nova-compute[98206]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27947d44-c589-46c2-9814-1a611596d86a (non-flash)
May 21 02:10:01.745024 np0000001127 nova-compute[98206]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:10:01.745024 np0000001127 nova-compute[98206]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:10:01.745024 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:01.745024 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:01.745024 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:01.745024 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:01.745024 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:10:01.746061 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsi session list stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:01.746061 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:01.746061 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:01.746061 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:01.746061 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:01.746061 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:01.746061 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:01.746061 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:01.746061 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:01.746061 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:01.746061 np0000001127 nova-compute[98206]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27947d44-c589-46c2-9814-1a611596d86a (non-flash)
May 21 02:10:01.746061 np0000001127 nova-compute[98206]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:10:01.746061 np0000001127 nova-compute[98206]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:10:01.746061 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:01.746061 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:01.746061 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:01.746061 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:01.746061 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:10:01.746061 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.289s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:10:01.746061 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:10:01.751253 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] HCTL ('20', '-', '-', 0) found on session 154 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:10:01.751253 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:10:01.759147 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:01.759147 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:01.759147 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:01.759147 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:01.759147 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:01.759147 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:01.759147 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:01.759147 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:01.759147 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:01.759147 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:01.759147 np0000001127 nova-compute[98206]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27947d44-c589-46c2-9814-1a611596d86a (non-flash)
May 21 02:10:01.759147 np0000001127 nova-compute[98206]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:10:01.759147 np0000001127 nova-compute[98206]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:10:01.759147 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:01.759147 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:01.759147 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:01.759147 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:01.759147 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:10:01.760943 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsi session list stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:01.760943 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:01.760943 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:01.760943 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:01.760943 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:01.760943 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:01.760943 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:01.760943 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:01.760943 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:01.760943 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:01.760943 np0000001127 nova-compute[98206]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27947d44-c589-46c2-9814-1a611596d86a (non-flash)
May 21 02:10:01.760943 np0000001127 nova-compute[98206]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:10:01.760943 np0000001127 nova-compute[98206]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:10:01.760943 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:01.760943 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:01.760943 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:01.760943 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:01.760943 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:10:01.760943 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.302s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:10:01.760943 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:10:01.763251 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] HCTL ('23', '-', '-', 0) found on session 155 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:10:01.763251 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Scanning host 23 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:10:01.775166 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Searching for a device in session 154 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:10:01.775166 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bef1cca2-1e4a-42c7-99af-ce84d5bcad43', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:10:01.788243 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:01.794716 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Searching for a device in session 155 and hctl ['23', '*', '*', 0] yield: sdr {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:10:01.795231 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Connected to sdr using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'bef1cca2-1e4a-42c7-99af-ce84d5bcad43', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:10:01.900018 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lazy-loading 'flavor' on Instance uuid 10c50913-8b08-402c-8ece-87c7521ce785 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:10:02.215187 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:10:02.215361 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:10:02.400040 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:02.558976 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:10:02.717812 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:10:02.908044 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "10c50913-8b08-402c-8ece-87c7521ce785" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.515s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:03.226345 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.936s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:03.226635 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:10:03.228058 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1818c00a-159c-4be6-8cf6-61e85feaf11c tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 3.259s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:03.574121 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Found WWN 33000000057fa8ba9 for multipath device dm-13 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:10:03.574650 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.135s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:10:03.574650 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] <== connect_volume: return (5791ms) {'type': 'block', 'scsi_wwn': '33000000057fa8ba9', 'path': '/dev/dm-13', 'multipath_id': '33000000057fa8ba9'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:10:03.574778 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000057fa8ba9', 'path': '/dev/dm-13', 'multipath_id': '33000000057fa8ba9'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:10:03.582510 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lazy-loading 'flavor' on Instance uuid 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:10:03.736186 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:10:03.738115 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:10:03.738578 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:10:03.738798 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:10:03.822992 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '049d6c8cccfa4ae38d78a88ef5be0f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848912b0c0e94d2795bb2332daf1730e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:10:03.828868 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1818c00a-159c-4be6-8cf6-61e85feaf11c tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:10:03.829043 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-1818c00a-159c-4be6-8cf6-61e85feaf11c tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:10:03.981207 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "10c50913-8b08-402c-8ece-87c7521ce785" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:03.981346 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "10c50913-8b08-402c-8ece-87c7521ce785" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:03.981561 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Attaching volume f5dc8530-4090-49a6-897f-ad627f9d7515 to /dev/vdb
May 21 02:10:04.031340 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:10:04.044889 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:10:04.072865 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:10:04.093819 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Attempting to attach volume bef1cca2-1e4a-42c7-99af-ce84d5bcad43 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 02:10:04.101956 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] attach device xml: <disk type="block" device="disk">
May 21 02:10:04.101956 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:10:04.101956 np0000001127 nova-compute[98206]:   <alias name="ua-bef1cca2-1e4a-42c7-99af-ce84d5bcad43"/>
May 21 02:10:04.101956 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-13"/>
May 21 02:10:04.101956 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:10:04.101956 np0000001127 nova-compute[98206]:   <serial>bef1cca2-1e4a-42c7-99af-ce84d5bcad43</serial>
May 21 02:10:04.101956 np0000001127 nova-compute[98206]: </disk>
May 21 02:10:04.101956 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 02:10:04.122379 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:10:04.122710 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:10:04.130801 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:10:04.132905 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe20:ae96', 'fe80::fc16:3eff:fe5c:a90d', 'fe80::786b:86ff:fe32:8f96', 'fe80::fc16:3eff:fe2c:b36f', 'fe80::fc16:3eff:fe30:164f', 'fe80::c44d:25ff:fe10:25cb', 'fe80::fc16:3eff:fece:28ea', 'fe80::7878:aaff:fe51:47c7', 'fe80::fc16:3eff:fe0f:28a1', 'fe80::440a:38ff:fe27:fa24', 'fe80::fc16:3eff:fefb:4d96', 'fe80::fc16:3eff:fe65:6557', 'fe80::fc16:3eff:feb8:d101', 'fe80::7045:30ff:fe1a:b99f', 'fe80::fc16:3eff:fedb:8dd'] 
May 21 02:10:04.133049 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:10:04.133187 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:10:04.133484 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] <== get_connector_properties: return (101ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:10:04.133952 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Updating existing volume attachment record: 6e6c95c8-fd38-4bc3-9001-0589fe63fc14 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:10:04.240781 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:10:04.333237 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-1818c00a-159c-4be6-8cf6-61e85feaf11c tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:10:04.359453 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Successfully created port: 3689adc9-295c-4c3e-b86e-161f565799ae {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:10:04.719212 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:10:04.719684 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515', 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5dc8530-4090-49a6-897f-ad627f9d7515', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:10:04.719851 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:10:04.720313 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:10:04.720516 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515', 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5dc8530-4090-49a6-897f-ad627f9d7515', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:10:04.732512 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:10:04.733292 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:10:04.733569 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:10:04.733852 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:10:04.736463 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:10:04.736463 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:10:04.747561 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.startup = automatic
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.session.scan = manual
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:10:04.753642 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:10:04.753642 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.startup = automatic
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.session.scan = manual
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:10:04.758367 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:10:04.758367 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:10:04.775451 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:10:04.779332 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:10:04.804802 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:04.804802 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:04.804802 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:04.804802 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:04.804802 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:04.804802 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:04.804802 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:04.804802 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:04.804802 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:04.804802 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:04.804802 np0000001127 nova-compute[98206]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27947d44-c589-46c2-9814-1a611596d86a (non-flash)
May 21 02:10:04.804802 np0000001127 nova-compute[98206]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:10:04.804802 np0000001127 nova-compute[98206]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:10:04.804802 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:04.804802 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:04.804802 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:04.804802 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:04.804802 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:10:04.805832 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsi session list stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:04.805832 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:04.805832 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:04.805832 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:04.805832 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:04.805832 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:04.805832 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:04.805832 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:04.805832 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:04.805832 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:04.805832 np0000001127 nova-compute[98206]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27947d44-c589-46c2-9814-1a611596d86a (non-flash)
May 21 02:10:04.805832 np0000001127 nova-compute[98206]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:10:04.805832 np0000001127 nova-compute[98206]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:10:04.805832 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:04.805832 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:04.805832 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:04.805832 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:04.805832 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:10:04.805832 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.072s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:10:04.805832 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:10:04.808791 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] HCTL ('21', '0', '0', 0) found on session 140 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:10:04.808964 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Scanning host 21 c: 0, t: 0, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:10:04.809718 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:04.809718 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:04.809718 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:04.809718 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:04.809718 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:04.809718 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:04.809718 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:04.809718 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:04.809718 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:04.809718 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:04.809718 np0000001127 nova-compute[98206]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27947d44-c589-46c2-9814-1a611596d86a (non-flash)
May 21 02:10:04.809718 np0000001127 nova-compute[98206]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:10:04.809718 np0000001127 nova-compute[98206]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:10:04.809718 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:04.809718 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:04.809718 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:04.809718 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:04.809718 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:10:04.810562 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsi session list stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:04.810562 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:04.810562 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:04.810562 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:04.810562 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:04.810562 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:04.810562 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:04.810562 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:04.810562 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:04.810562 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:04.810562 np0000001127 nova-compute[98206]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27947d44-c589-46c2-9814-1a611596d86a (non-flash)
May 21 02:10:04.810562 np0000001127 nova-compute[98206]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:10:04.810562 np0000001127 nova-compute[98206]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:10:04.810562 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:04.810562 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:04.810562 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:04.810562 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:04.810562 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:10:04.811081 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.077s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:10:04.811837 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:10:04.813077 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] HCTL ('22', '0', '0', 0) found on session 141 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:10:04.813233 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Scanning host 22 c: 0, t: 0, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:10:04.821463 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Searching for a device in session 140 and hctl ('21', '0', '0', 0) yield: sdq {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:10:04.821463 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Connected to sdq using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5dc8530-4090-49a6-897f-ad627f9d7515', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:10:04.823950 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Searching for a device in session 141 and hctl ('22', '0', '0', 0) yield: sdp {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:10:04.824107 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f5dc8530-4090-49a6-897f-ad627f9d7515', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:10:04.840822 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1818c00a-159c-4be6-8cf6-61e85feaf11c tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.613s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:04.897252 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Successfully updated port: 3689adc9-295c-4c3e-b86e-161f565799ae {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:10:04.904882 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-1818c00a-159c-4be6-8cf6-61e85feaf11c tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Deleted allocations for instance 0d5857fd-c96f-444b-ac06-634d1c81a32a
May 21 02:10:04.949207 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-12d56039-5bbf-4677-b0f3-0b33eeefd8a6 req-8dd54268-211f-4041-b6b0-215a347f9061 service nova] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Received event network-changed-3689adc9-295c-4c3e-b86e-161f565799ae {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:10:04.949783 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-12d56039-5bbf-4677-b0f3-0b33eeefd8a6 req-8dd54268-211f-4041-b6b0-215a347f9061 service nova] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Refreshing instance network info cache due to event network-changed-3689adc9-295c-4c3e-b86e-161f565799ae. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:10:04.949951 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-12d56039-5bbf-4677-b0f3-0b33eeefd8a6 req-8dd54268-211f-4041-b6b0-215a347f9061 service nova] Acquiring lock "refresh_cache-eb1c328c-f707-4f0d-90b5-ab5b268bf05a" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:10:04.952847 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-12d56039-5bbf-4677-b0f3-0b33eeefd8a6 req-8dd54268-211f-4041-b6b0-215a347f9061 service nova] Acquired lock "refresh_cache-eb1c328c-f707-4f0d-90b5-ab5b268bf05a" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:10:04.952847 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-12d56039-5bbf-4677-b0f3-0b33eeefd8a6 req-8dd54268-211f-4041-b6b0-215a347f9061 service nova] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Refreshing network info cache for port 3689adc9-295c-4c3e-b86e-161f565799ae {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:10:05.256686 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Booting with volume 6a1268db-f070-4554-9c26-573e6882fc48 at /dev/vda
May 21 02:10:05.325146 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:10:05.337874 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:10:05.362410 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:10:05.402654 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "refresh_cache-eb1c328c-f707-4f0d-90b5-ab5b268bf05a" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:10:05.412351 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:10:05.412843 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:10:05.421523 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:10:05.423417 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe20:ae96', 'fe80::fc16:3eff:fe5c:a90d', 'fe80::786b:86ff:fe32:8f96', 'fe80::fc16:3eff:fe2c:b36f', 'fe80::fc16:3eff:fe30:164f', 'fe80::c44d:25ff:fe10:25cb', 'fe80::fc16:3eff:fece:28ea', 'fe80::7878:aaff:fe51:47c7', 'fe80::fc16:3eff:fe0f:28a1', 'fe80::440a:38ff:fe27:fa24', 'fe80::fc16:3eff:fefb:4d96', 'fe80::fc16:3eff:fe65:6557', 'fe80::fc16:3eff:feb8:d101', 'fe80::7045:30ff:fe1a:b99f', 'fe80::fc16:3eff:fedb:8dd'] 
May 21 02:10:05.423611 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:10:05.423773 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:10:05.424083 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:10:05.424356 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Updating existing volume attachment record: 8ad2f1ac-07b0-480e-bea3-7c270917a852 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:10:05.452100 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-12d56039-5bbf-4677-b0f3-0b33eeefd8a6 req-8dd54268-211f-4041-b6b0-215a347f9061 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:10:05.541942 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-12d56039-5bbf-4677-b0f3-0b33eeefd8a6 req-8dd54268-211f-4041-b6b0-215a347f9061 service nova] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:10:05.692498 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-12d56039-5bbf-4677-b0f3-0b33eeefd8a6 req-8dd54268-211f-4041-b6b0-215a347f9061 service nova] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:10:05.735814 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:10:05.783789 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:10:05.783910 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:10:05.784012 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:10:05.784115 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] No VIF found with MAC fa:16:3e:5c:a9:0d, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:10:05.915985 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1818c00a-159c-4be6-8cf6-61e85feaf11c tempest-AttachVolumeNegativeTest-1208856611 tempest-AttachVolumeNegativeTest-1208856611-project-member] Lock "0d5857fd-c96f-444b-ac06-634d1c81a32a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.901s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:06.194223 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-12d56039-5bbf-4677-b0f3-0b33eeefd8a6 req-8dd54268-211f-4041-b6b0-215a347f9061 service nova] Releasing lock "refresh_cache-eb1c328c-f707-4f0d-90b5-ab5b268bf05a" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:10:06.195005 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquired lock "refresh_cache-eb1c328c-f707-4f0d-90b5-ab5b268bf05a" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:10:06.195153 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:10:06.752171 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Found WWN 330000000b8ca6778 for multipath device dm-12 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:10:06.752622 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.032s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:10:06.752721 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] <== connect_volume: return (2032ms) {'type': 'block', 'scsi_wwn': '330000000b8ca6778', 'path': '/dev/dm-12', 'multipath_id': '330000000b8ca6778'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:10:06.752889 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b8ca6778', 'path': '/dev/dm-12', 'multipath_id': '330000000b8ca6778'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:10:06.755388 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lazy-loading 'flavor' on Instance uuid 10c50913-8b08-402c-8ece-87c7521ce785 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:10:06.764404 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:10:06.805058 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:06.922612 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:10:07.061141 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Updating instance_info_cache with network_info: [{"id": "3689adc9-295c-4c3e-b86e-161f565799ae", "address": "fa:16:3e:a3:6c:54", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3689adc9-29", "ovs_interfaceid": "3689adc9-295c-4c3e-b86e-161f565799ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:10:07.260459 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Attempting to attach volume f5dc8530-4090-49a6-897f-ad627f9d7515 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 02:10:07.261946 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] attach device xml: <disk type="block" device="disk">
May 21 02:10:07.261946 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:10:07.261946 np0000001127 nova-compute[98206]:   <alias name="ua-f5dc8530-4090-49a6-897f-ad627f9d7515"/>
May 21 02:10:07.261946 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-12"/>
May 21 02:10:07.261946 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:10:07.261946 np0000001127 nova-compute[98206]:   <serial>f5dc8530-4090-49a6-897f-ad627f9d7515</serial>
May 21 02:10:07.261946 np0000001127 nova-compute[98206]:   <shareable/>
May 21 02:10:07.261946 np0000001127 nova-compute[98206]: </disk>
May 21 02:10:07.261946 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 02:10:07.344353 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f71beaa2-260d-409e-a3f3-7e2b77589485 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.317s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:07.400817 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:07.520312 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:10:07.521263 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:10:07.521483 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Creating image(s)
May 21 02:10:07.521770 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Did not create local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 21 02:10:07.521943 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Ensure instance console log exists: /opt/stack/data/nova/instances/eb1c328c-f707-4f0d-90b5-ab5b268bf05a/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:10:07.522176 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:07.522368 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:07.522776 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:07.564387 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Releasing lock "refresh_cache-eb1c328c-f707-4f0d-90b5-ab5b268bf05a" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:10:07.564749 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Instance network_info: |[{"id": "3689adc9-295c-4c3e-b86e-161f565799ae", "address": "fa:16:3e:a3:6c:54", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3689adc9-29", "ovs_interfaceid": "3689adc9-295c-4c3e-b86e-161f565799ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:10:07.565288 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Start _get_guest_xml network_info=[{"id": "3689adc9-295c-4c3e-b86e-161f565799ae", "address": "fa:16:3e:a3:6c:54", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3689adc9-29", "ovs_interfaceid": "3689adc9-295c-4c3e-b86e-161f565799ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48', 'iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6a1268db-f070-4554-9c26-573e6882fc48', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'eb1c328c-f707-4f0d-90b5-ab5b268bf05a', 'attached_at': '', 'detached_at': '', 'volume_id': '6a1268db-f070-4554-9c26-573e6882fc48', 'serial': '6a1268db-f070-4554-9c26-573e6882fc48', 'multiattach': True}, 'delete_on_termination': False, 'attachment_id': '8ad2f1ac-07b0-480e-bea3-7c270917a852', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:10:07.571166 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:10:07.572290 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-131757601', uuid='eb1c328c-f707-4f0d-90b5-ab5b268bf05a'), owner=OwnerMeta(userid='049d6c8cccfa4ae38d78a88ef5be0f1b', username='tempest-AttachVolumeMultiAttachTest-289054175-project-member', projectid='848912b0c0e94d2795bb2332daf1730e', projectname='tempest-AttachVolumeMultiAttachTest-289054175'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3689adc9-295c-4c3e-b86e-161f565799ae", "address": "fa:16:3e:a3:6c:54", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3689adc9-29", "ovs_interfaceid": "3689adc9-295c-4c3e-b86e-161f565799ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329407.5719547) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:10:07.573935 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:10:07.574380 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:10:07.575544 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:10:07.575738 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:10:07.576762 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:10:07.577192 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:10:07.577192 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:10:07.577319 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:10:07.577402 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:10:07.577508 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:10:07.577607 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:10:07.577766 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:10:07.577865 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:10:07.577976 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:10:07.578057 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:10:07.578162 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:10:07.589358 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:10:07.589792 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48', 'iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6a1268db-f070-4554-9c26-573e6882fc48', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:10:07.589926 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:10:07.590317 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:10:07.590529 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48', 'iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6a1268db-f070-4554-9c26-573e6882fc48', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:10:07.607599 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:10:07.608304 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:10:07.609029 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:10:07.609236 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:10:07.609834 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:10:07.609924 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:10:07.626501 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:10:07.626501 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:10:07.633909 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:10:07.633909 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:10:07.642044 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48] added
May 21 02:10:07.642044 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:10:07.642044 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:10:07.642044 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:10:07.642044 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:10:07.642044 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:10:07.642044 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:10:07.642308 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:10:07.642528 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0332(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:10:07.642788 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:10:07.646086 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48] added
May 21 02:10:07.646086 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:10:07.646086 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:10:07.646086 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:10:07.646086 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:10:07.646086 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:10:07.646086 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:10:07.646305 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:10:07.646509 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0366(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:10:07.646734 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:10:08.643272 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:10:08.647264 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:10:08.656380 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:10:08.656380 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:10:08.666591 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:10:08.666591 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:10:08.671305 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:10:08.678997 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:10:08.692765 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:08.692765 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:08.692765 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:08.692765 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:08.692765 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:08.692765 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:08.692765 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:08.692765 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:08.692765 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:08.692765 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:08.692765 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:08.692765 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:08.692765 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:08.692765 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:08.692765 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:10:08.693326 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsi session list stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:08.693326 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:08.693326 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:08.693326 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:08.693326 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:08.693326 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:08.693326 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:08.693326 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:08.693326 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:08.693326 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:08.693326 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:08.693326 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:08.693326 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:08.693326 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:08.693326 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:10:08.703618 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:08.703618 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:08.703618 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:08.703618 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:08.703618 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:08.703618 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:08.703618 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:08.703618 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:08.703618 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:08.703618 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:08.703618 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:08.703618 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:08.703618 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:08.703618 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:08.703618 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:10:08.704006 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsi session list stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:08.704006 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:08.704006 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:08.704006 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:08.704006 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:08.704006 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:08.704006 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:08.704006 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:08.704006 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:08.704006 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:08.704006 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:08.704006 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:08.704006 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:08.704006 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:08.704006 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:10:08.754613 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48, portal: 192.168.50.100,3260]
May 21 02:10:08.754613 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48, portal: 192.168.50.100,3260] successful.
May 21 02:10:08.754613 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:10:08.763664 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48, portal: 192.168.40.100,3260]
May 21 02:10:08.763664 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48, portal: 192.168.40.100,3260] successful.
May 21 02:10:08.763664 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:10:08.769209 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:10:08.773090 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Acquiring lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:08.773259 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:08.775806 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:10:08.792954 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:08.792954 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:08.792954 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:08.792954 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:08.792954 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:08.792954 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:08.792954 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:08.792954 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:08.792954 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:08.792954 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:08.792954 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:08.792954 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:08.792954 np0000001127 nova-compute[98206]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48 (non-flash)
May 21 02:10:08.792954 np0000001127 nova-compute[98206]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48 (non-flash)
May 21 02:10:08.792954 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:08.792954 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:08.792954 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:10:08.793429 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsi session list stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:08.793429 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:08.793429 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:08.793429 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:08.793429 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:08.793429 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:08.793429 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:08.793429 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:08.793429 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:08.793429 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:08.793429 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:08.793429 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:08.793429 np0000001127 nova-compute[98206]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48 (non-flash)
May 21 02:10:08.793429 np0000001127 nova-compute[98206]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48 (non-flash)
May 21 02:10:08.793429 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:08.793429 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:08.793429 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:10:08.793773 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.185s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:10:08.793773 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:10:08.795676 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] HCTL ('9', '-', '-', 0) found on session 156 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:10:08.795676 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:10:08.801411 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:08.801411 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:08.801411 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:08.801411 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:08.801411 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:08.801411 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:08.801411 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:08.801411 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:08.801411 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:08.801411 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:08.801411 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:08.801411 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:08.801411 np0000001127 nova-compute[98206]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48 (non-flash)
May 21 02:10:08.801411 np0000001127 nova-compute[98206]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48 (non-flash)
May 21 02:10:08.801411 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:08.801411 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:08.801411 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:10:08.801411 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsi session list stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:08.801411 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:08.801411 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:08.801411 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:08.801411 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:08.801411 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:08.801411 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:08.801411 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:08.801411 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:08.801411 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:08.801411 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:08.801411 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:08.801411 np0000001127 nova-compute[98206]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48 (non-flash)
May 21 02:10:08.801411 np0000001127 nova-compute[98206]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48 (non-flash)
May 21 02:10:08.801411 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:08.801411 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:08.801411 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:10:08.801411 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.191s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:10:08.801411 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:10:08.804909 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] HCTL ('10', '-', '-', 0) found on session 157 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:10:08.804909 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:10:08.810872 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Searching for a device in session 156 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:10:08.811162 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6a1268db-f070-4554-9c26-573e6882fc48', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:10:08.824383 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Searching for a device in session 157 and hctl ['10', '*', '*', 0] yield: None {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:10:08.910291 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:10:08.910487 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:10:08.910592 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:10:08.911733 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] No VIF found with MAC fa:16:3e:2c:b3:6f, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:10:09.277717 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lazy-loading 'flavor' on Instance uuid 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:10:09.823094 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Searching for a device in session 157 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:10:09.823538 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6a1268db-f070-4554-9c26-573e6882fc48', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:10:10.282516 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:10.467074 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-b38fc8be-3650-4c1c-97b0-433c070066c5 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "10c50913-8b08-402c-8ece-87c7521ce785" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.485s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:10.502073 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "02fd9da8-f514-4e1b-8bd5-bfc8ae21753c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:10.502404 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "02fd9da8-f514-4e1b-8bd5-bfc8ae21753c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:10.634232 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Found WWN 330000000a5f75a33 for multipath device dm-1 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:10:10.634601 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.044s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:10:10.634807 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] <== connect_volume: return (3045ms) {'type': 'block', 'scsi_wwn': '330000000a5f75a33', 'path': '/dev/dm-1', 'multipath_id': '330000000a5f75a33'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:10:10.635326 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a5f75a33', 'path': '/dev/dm-1', 'multipath_id': '330000000a5f75a33'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:10:11.004841 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:10:11.147219 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:09:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-131757601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumemultiattachtest-server-131757601',id=67,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='848912b0c0e94d2795bb2332daf1730e',ramdisk_id='',reservation_id='r-c2hjji70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-289054175',owner_user_name='tempest-AttachVolumeMultiAttachTest-289054175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:10:05Z,user_data=None,user_id='049d6c8cccfa4ae38d78a88ef5be0f1b',uuid=eb1c328c-f707-4f0d-90b5-ab5b268bf05a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3689adc9-295c-4c3e-b86e-161f565799ae", "address": "fa:16:3e:a3:6c:54", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3689adc9-29", "ovs_interfaceid": "3689adc9-295c-4c3e-b86e-161f565799ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:10:11.147480 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converting VIF {"id": "3689adc9-295c-4c3e-b86e-161f565799ae", "address": "fa:16:3e:a3:6c:54", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3689adc9-29", "ovs_interfaceid": "3689adc9-295c-4c3e-b86e-161f565799ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:10:11.147830 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:6c:54,bridge_name='br-int',has_traffic_filtering=True,id=3689adc9-295c-4c3e-b86e-161f565799ae,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3689adc9-29') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:10:11.148299 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lazy-loading 'pci_devices' on Instance uuid eb1c328c-f707-4f0d-90b5-ab5b268bf05a {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:10:11.372062 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Acquiring lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:11.372265 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:11.372443 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Attaching volume ca0f98f5-6310-483f-ab8f-43913cc3338c to /dev/vdc
May 21 02:10:11.413591 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:10:11.425697 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:10:11.450329 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:10:11.497822 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:10:11.498086 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:10:11.507370 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:10:11.509867 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe20:ae96', 'fe80::fc16:3eff:fe5c:a90d', 'fe80::786b:86ff:fe32:8f96', 'fe80::fc16:3eff:fe2c:b36f', 'fe80::fc16:3eff:fe30:164f', 'fe80::c44d:25ff:fe10:25cb', 'fe80::fc16:3eff:fece:28ea', 'fe80::7878:aaff:fe51:47c7', 'fe80::fc16:3eff:fe0f:28a1', 'fe80::440a:38ff:fe27:fa24', 'fe80::fc16:3eff:fefb:4d96', 'fe80::fc16:3eff:fe65:6557', 'fe80::fc16:3eff:feb8:d101', 'fe80::7045:30ff:fe1a:b99f', 'fe80::fc16:3eff:fedb:8dd'] 
May 21 02:10:11.510040 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:10:11.510085 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:10:11.510296 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] <== get_connector_properties: return (96ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:10:11.510590 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Updating existing volume attachment record: c6c6cf98-3511-41af-af2b-6ad9ca742403 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:10:11.589603 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:11.590005 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:11.596296 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:10:11.596296 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Claim successful on node np0000001127
May 21 02:10:11.652160 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] End _get_guest_xml xml=<domain type="qemu">
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:   <uuid>eb1c328c-f707-4f0d-90b5-ab5b268bf05a</uuid>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:   <name>instance-00000043</name>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:       <nova:name>tempest-AttachVolumeMultiAttachTest-server-131757601</nova:name>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:10:07</nova:creationTime>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:       <nova:image uuid="">
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:         <nova:user uuid="049d6c8cccfa4ae38d78a88ef5be0f1b">tempest-AttachVolumeMultiAttachTest-289054175-project-member</nova:user>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:         <nova:project uuid="848912b0c0e94d2795bb2332daf1730e">tempest-AttachVolumeMultiAttachTest-289054175</nova:project>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:       <nova:root type="volume" uuid=""/>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:         <nova:port uuid="3689adc9-295c-4c3e-b86e-161f565799ae">
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:     <system>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:       <entry name="serial">eb1c328c-f707-4f0d-90b5-ab5b268bf05a</entry>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:       <entry name="uuid">eb1c328c-f707-4f0d-90b5-ab5b268bf05a</entry>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:     </system>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:   <os>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:   </os>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:   <features>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:   </features>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:   <devices>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/eb1c328c-f707-4f0d-90b5-ab5b268bf05a/disk.config"/>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:     </disk>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:       <alias name="ua-6a1268db-f070-4554-9c26-573e6882fc48"/>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-1"/>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:       <serial>6a1268db-f070-4554-9c26-573e6882fc48</serial>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:       <shareable/>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:     </disk>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:a3:6c:54"/>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:       <target dev="tap3689adc9-29"/>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:     </interface>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/eb1c328c-f707-4f0d-90b5-ab5b268bf05a/console.log" append="off"/>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:     </serial>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:     <video>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:     </video>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:     </rng>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:   </devices>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]: </domain>
May 21 02:10:11.652160 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:10:11.653991 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Preparing to wait for external event network-vif-plugged-3689adc9-295c-4c3e-b86e-161f565799ae {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:10:11.653991 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "eb1c328c-f707-4f0d-90b5-ab5b268bf05a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:11.653991 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "eb1c328c-f707-4f0d-90b5-ab5b268bf05a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:11.653991 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "eb1c328c-f707-4f0d-90b5-ab5b268bf05a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:11.653991 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:09:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-131757601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumemultiattachtest-server-131757601',id=67,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='848912b0c0e94d2795bb2332daf1730e',ramdisk_id='',reservation_id='r-c2hjji70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-289054175',owner_user_name='tempest-AttachVolumeMultiAttachTest-289054175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:10:05Z,user_data=None,user_id='049d6c8cccfa4ae38d78a88ef5be0f1b',uuid=eb1c328c-f707-4f0d-90b5-ab5b268bf05a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3689adc9-295c-4c3e-b86e-161f565799ae", "address": "fa:16:3e:a3:6c:54", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3689adc9-29", "ovs_interfaceid": "3689adc9-295c-4c3e-b86e-161f565799ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:10:11.653991 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converting VIF {"id": "3689adc9-295c-4c3e-b86e-161f565799ae", "address": "fa:16:3e:a3:6c:54", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3689adc9-29", "ovs_interfaceid": "3689adc9-295c-4c3e-b86e-161f565799ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:10:11.654289 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:6c:54,bridge_name='br-int',has_traffic_filtering=True,id=3689adc9-295c-4c3e-b86e-161f565799ae,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3689adc9-29') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:10:11.654517 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:6c:54,bridge_name='br-int',has_traffic_filtering=True,id=3689adc9-295c-4c3e-b86e-161f565799ae,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3689adc9-29') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:10:11.654976 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:11.655308 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:10:11.655655 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:10:11.656785 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:11.656935 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '418c955d-5414-588f-9ae1-4fe0e81b8b0c', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:10:11.671063 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:11.671450 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:10:11.671723 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:11.675200 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:11.675369 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3689adc9-29, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:10:11.675749 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3689adc9-29, col_values=(('qos', UUID('81b35e9c-ac0c-4d36-84b4-33574e9182ab')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:10:11.675903 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3689adc9-29, col_values=(('external_ids', {'iface-id': '3689adc9-295c-4c3e-b86e-161f565799ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:6c:54', 'vm-uuid': 'eb1c328c-f707-4f0d-90b5-ab5b268bf05a'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:10:11.677490 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:11.679123 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:10:11.683393 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:11.683860 np0000001127 nova-compute[98206]: INFO os_vif [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:6c:54,bridge_name='br-int',has_traffic_filtering=True,id=3689adc9-295c-4c3e-b86e-161f565799ae,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3689adc9-29')
May 21 02:10:11.883150 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0005174910002097022 future=<Future at 0x71c05827f650 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:10:11.883806 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Emitting event <LifecycleEvent: 1779329396.8824594, 0d5857fd-c96f-444b-ac06-634d1c81a32a => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:10:11.884043 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:10:11.884239 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] VM Stopped (Lifecycle Event)
May 21 02:10:11.905367 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:11.908387 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:12.085069 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:10:12.085569 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c', 'iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ca0f98f5-6310-483f-ab8f-43913cc3338c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:10:12.085745 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:10:12.086067 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:10:12.086285 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c', 'iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ca0f98f5-6310-483f-ab8f-43913cc3338c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:10:12.105692 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:10:12.106394 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:10:12.107574 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "840919c9-6bf6-47ac-bb9c-35ea24494c2e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:12.107845 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "840919c9-6bf6-47ac-bb9c-35ea24494c2e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:12.113288 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.008s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:10:12.113593 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:10:12.117015 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.008s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:10:12.117387 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:10:12.132783 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:10:12.132783 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:10:12.137606 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:10:12.137606 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:10:12.145649 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c] added
May 21 02:10:12.145649 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:10:12.145649 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:10:12.145649 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:10:12.145649 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:10:12.145649 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:10:12.145649 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:10:12.145929 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:10:12.146093 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0325(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:10:12.146278 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:10:12.151620 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c] added
May 21 02:10:12.151620 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:10:12.151620 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:10:12.151620 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:10:12.151620 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:10:12.151620 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:10:12.151620 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:10:12.151784 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:10:12.151907 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0346(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:10:12.152073 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:10:12.298752 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f4d8aae1-6f9b-4121-8347-2bc1bc2410bc tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "10c50913-8b08-402c-8ece-87c7521ce785" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:12.298969 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f4d8aae1-6f9b-4121-8347-2bc1bc2410bc tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "10c50913-8b08-402c-8ece-87c7521ce785" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:12.387120 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: 0d5857fd-c96f-444b-ac06-634d1c81a32a] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:10:12.613400 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:10:12.801148 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-f4d8aae1-6f9b-4121-8347-2bc1bc2410bc tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Detaching volume f5dc8530-4090-49a6-897f-ad627f9d7515
May 21 02:10:12.868909 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-f4d8aae1-6f9b-4121-8347-2bc1bc2410bc tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Attempting to driver detach volume f5dc8530-4090-49a6-897f-ad627f9d7515 from mountpoint /dev/vdb
May 21 02:10:12.874445 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f4d8aae1-6f9b-4121-8347-2bc1bc2410bc tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Found disk vdb by alias ua-f5dc8530-4090-49a6-897f-ad627f9d7515 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:10:12.875062 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f4d8aae1-6f9b-4121-8347-2bc1bc2410bc tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Found disk vdb by alias ua-f5dc8530-4090-49a6-897f-ad627f9d7515 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:10:12.875214 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f4d8aae1-6f9b-4121-8347-2bc1bc2410bc tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Attempting to detach device vdb from instance 10c50913-8b08-402c-8ece-87c7521ce785 from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 02:10:12.875506 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-f4d8aae1-6f9b-4121-8347-2bc1bc2410bc tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:10:12.875506 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:10:12.875506 np0000001127 nova-compute[98206]:   <alias name="ua-f5dc8530-4090-49a6-897f-ad627f9d7515"/>
May 21 02:10:12.875506 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-12"/>
May 21 02:10:12.875506 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:10:12.875506 np0000001127 nova-compute[98206]:   <serial>f5dc8530-4090-49a6-897f-ad627f9d7515</serial>
May 21 02:10:12.875506 np0000001127 nova-compute[98206]:   <shareable/>
May 21 02:10:12.875506 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:10:12.875506 np0000001127 nova-compute[98206]: </disk>
May 21 02:10:12.875506 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:10:12.882235 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-f4d8aae1-6f9b-4121-8347-2bc1bc2410bc tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Successfully detached device vdb from instance 10c50913-8b08-402c-8ece-87c7521ce785 from the persistent domain config.
May 21 02:10:12.882400 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f4d8aae1-6f9b-4121-8347-2bc1bc2410bc tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] (1/8): Attempting to detach device vdb with device alias ua-f5dc8530-4090-49a6-897f-ad627f9d7515 from instance 10c50913-8b08-402c-8ece-87c7521ce785 from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 02:10:12.882776 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-f4d8aae1-6f9b-4121-8347-2bc1bc2410bc tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:10:12.882776 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:10:12.882776 np0000001127 nova-compute[98206]:   <alias name="ua-f5dc8530-4090-49a6-897f-ad627f9d7515"/>
May 21 02:10:12.882776 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-12"/>
May 21 02:10:12.882776 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:10:12.882776 np0000001127 nova-compute[98206]:   <serial>f5dc8530-4090-49a6-897f-ad627f9d7515</serial>
May 21 02:10:12.882776 np0000001127 nova-compute[98206]:   <shareable/>
May 21 02:10:12.882776 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:10:12.882776 np0000001127 nova-compute[98206]: </disk>
May 21 02:10:12.882776 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:10:13.148488 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:10:13.152952 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:10:13.162625 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:10:13.162625 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:10:13.170668 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:10:13.170668 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:10:13.179124 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:10:13.186599 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:10:13.204597 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:10:13.205419 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:10:13.205582 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] No VIF found with MAC fa:16:3e:a3:6c:54, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:10:13.207168 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:13.207787 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Using config drive
May 21 02:10:13.209477 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:13.209477 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:13.209477 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:13.209477 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:13.209477 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:13.209477 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:13.209477 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:13.209477 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:13.209477 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:13.209477 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:13.209477 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:13.209477 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:13.209477 np0000001127 nova-compute[98206]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48 (non-flash)
May 21 02:10:13.209477 np0000001127 nova-compute[98206]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48 (non-flash)
May 21 02:10:13.209477 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:13.209477 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:13.209477 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:10:13.209841 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsi session list stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:13.209841 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:13.209841 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:13.209841 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:13.209841 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:13.209841 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:13.209841 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:13.209841 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:13.209841 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:13.209841 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:13.209841 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:13.209841 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:13.209841 np0000001127 nova-compute[98206]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48 (non-flash)
May 21 02:10:13.209841 np0000001127 nova-compute[98206]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48 (non-flash)
May 21 02:10:13.209841 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:13.209841 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:13.209841 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:10:13.217898 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:13.217898 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:13.217898 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:13.217898 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:13.217898 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:13.217898 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:13.217898 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:13.217898 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:13.217898 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:13.217898 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:13.217898 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:13.217898 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:13.217898 np0000001127 nova-compute[98206]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48 (non-flash)
May 21 02:10:13.217898 np0000001127 nova-compute[98206]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48 (non-flash)
May 21 02:10:13.217898 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:13.217898 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:13.217898 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:10:13.217898 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsi session list stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:13.217898 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:13.217898 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:13.217898 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:13.217898 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:13.217898 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:13.217898 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:13.217898 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:13.217898 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:13.217898 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:13.217898 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:13.217898 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:13.217898 np0000001127 nova-compute[98206]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48 (non-flash)
May 21 02:10:13.217898 np0000001127 nova-compute[98206]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48 (non-flash)
May 21 02:10:13.217898 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:13.217898 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:13.217898 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:10:13.283009 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c, portal: 192.168.40.100,3260]
May 21 02:10:13.283009 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c, portal: 192.168.40.100,3260] successful.
May 21 02:10:13.283009 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:10:13.288592 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c, portal: 192.168.50.100,3260]
May 21 02:10:13.288592 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c, portal: 192.168.50.100,3260] successful.
May 21 02:10:13.288592 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:10:13.298410 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:10:13.310168 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:10:13.324995 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:13.324995 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:13.324995 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:13.324995 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:13.324995 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:13.324995 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:13.324995 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:13.324995 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:13.324995 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:13.324995 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:13.324995 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:13.324995 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:13.324995 np0000001127 nova-compute[98206]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48 (non-flash)
May 21 02:10:13.324995 np0000001127 nova-compute[98206]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48 (non-flash)
May 21 02:10:13.324995 np0000001127 nova-compute[98206]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c (non-flash)
May 21 02:10:13.324995 np0000001127 nova-compute[98206]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c (non-flash)
May 21 02:10:13.324995 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:13.324995 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:13.324995 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:10:13.325451 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsi session list stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:13.325451 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:13.325451 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:13.325451 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:13.325451 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:13.325451 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:13.325451 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:13.325451 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:13.325451 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:13.325451 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:13.325451 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:13.325451 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:13.325451 np0000001127 nova-compute[98206]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48 (non-flash)
May 21 02:10:13.325451 np0000001127 nova-compute[98206]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48 (non-flash)
May 21 02:10:13.325451 np0000001127 nova-compute[98206]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c (non-flash)
May 21 02:10:13.325451 np0000001127 nova-compute[98206]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c (non-flash)
May 21 02:10:13.325451 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:13.325451 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:13.325451 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:10:13.325821 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.212s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:10:13.325821 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:10:13.328824 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:10:13.329040 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:10:13.333182 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] HCTL ('11', '-', '-', 0) found on session 158 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:10:13.333182 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:10:13.343367 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:13.343367 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:13.343367 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:13.343367 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:13.343367 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:13.343367 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:13.343367 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:13.343367 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:13.343367 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:13.343367 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:13.343367 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:13.343367 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:13.343367 np0000001127 nova-compute[98206]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48 (non-flash)
May 21 02:10:13.343367 np0000001127 nova-compute[98206]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48 (non-flash)
May 21 02:10:13.343367 np0000001127 nova-compute[98206]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c (non-flash)
May 21 02:10:13.343367 np0000001127 nova-compute[98206]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c (non-flash)
May 21 02:10:13.343367 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:13.343367 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:13.343367 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:10:13.344393 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsi session list stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:13.344393 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:13.344393 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:13.344393 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:13.344393 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:13.344393 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:13.344393 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:13.344393 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:13.344393 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:13.344393 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:13.344393 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:13.344393 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:13.344393 np0000001127 nova-compute[98206]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48 (non-flash)
May 21 02:10:13.344393 np0000001127 nova-compute[98206]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48 (non-flash)
May 21 02:10:13.344393 np0000001127 nova-compute[98206]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c (non-flash)
May 21 02:10:13.344393 np0000001127 nova-compute[98206]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c (non-flash)
May 21 02:10:13.344393 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:13.344393 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:13.344393 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:10:13.345422 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.232s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:10:13.345981 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:10:13.359757 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] HCTL ('24', '-', '-', 0) found on session 159 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:10:13.359757 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Searching for a device in session 158 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:10:13.359757 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Scanning host 24 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:10:13.359757 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ca0f98f5-6310-483f-ab8f-43913cc3338c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:10:13.377205 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Searching for a device in session 159 and hctl ['24', '*', '*', 0] yield: None {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:10:13.437996 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779329413.4376218, 10c50913-8b08-402c-8ece-87c7521ce785 => ua-f5dc8530-4090-49a6-897f-ad627f9d7515> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 02:10:13.440395 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f4d8aae1-6f9b-4121-8347-2bc1bc2410bc tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-f5dc8530-4090-49a6-897f-ad627f9d7515 for instance 10c50913-8b08-402c-8ece-87c7521ce785 {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 02:10:13.444846 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-f4d8aae1-6f9b-4121-8347-2bc1bc2410bc tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Successfully detached device vdb from instance 10c50913-8b08-402c-8ece-87c7521ce785 from the live domain config.
May 21 02:10:13.713071 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:10:13.829981 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Creating config drive at /opt/stack/data/nova/instances/eb1c328c-f707-4f0d-90b5-ab5b268bf05a/disk.config
May 21 02:10:13.831775 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:10:13.838379 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/eb1c328c-f707-4f0d-90b5-ab5b268bf05a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp18x6l55q {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:10:13.906455 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/eb1c328c-f707-4f0d-90b5-ab5b268bf05a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp18x6l55q" returned: 0 in 0.068s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:10:13.994670 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-f4d8aae1-6f9b-4121-8347-2bc1bc2410bc tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Detected multiple connections on this host for volume: f5dc8530-4090-49a6-897f-ad627f9d7515, skipping target disconnect.
May 21 02:10:14.331826 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:14.338243 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.748s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:14.338775 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:10:14.343689 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.136s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:14.349411 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:10:14.350486 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Claim successful on node np0000001127
May 21 02:10:14.365040 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:14.377700 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Searching for a device in session 159 and hctl ['24', '*', '*', 0] yield: sds {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:10:14.377979 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Connected to sds using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ca0f98f5-6310-483f-ab8f-43913cc3338c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:10:14.470709 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:14.526971 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:14.529636 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:14.540688 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a1be10f9-ad69-4e5d-a6b0-07093bf61ae7 req-7cce6f88-f9fe-4640-961d-a7f6300eea12 service nova] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Received event network-vif-plugged-3689adc9-295c-4c3e-b86e-161f565799ae {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:10:14.540688 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a1be10f9-ad69-4e5d-a6b0-07093bf61ae7 req-7cce6f88-f9fe-4640-961d-a7f6300eea12 service nova] Acquiring lock "eb1c328c-f707-4f0d-90b5-ab5b268bf05a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:14.540958 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a1be10f9-ad69-4e5d-a6b0-07093bf61ae7 req-7cce6f88-f9fe-4640-961d-a7f6300eea12 service nova] Lock "eb1c328c-f707-4f0d-90b5-ab5b268bf05a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:14.541103 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a1be10f9-ad69-4e5d-a6b0-07093bf61ae7 req-7cce6f88-f9fe-4640-961d-a7f6300eea12 service nova] Lock "eb1c328c-f707-4f0d-90b5-ab5b268bf05a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:14.541258 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a1be10f9-ad69-4e5d-a6b0-07093bf61ae7 req-7cce6f88-f9fe-4640-961d-a7f6300eea12 service nova] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Processing event network-vif-plugged-3689adc9-295c-4c3e-b86e-161f565799ae {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:10:14.560519 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-f4d8aae1-6f9b-4121-8347-2bc1bc2410bc tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lazy-loading 'flavor' on Instance uuid 10c50913-8b08-402c-8ece-87c7521ce785 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:10:14.849734 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:10:14.850235 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:10:14.850772 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:10:14.851311 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:10:14.948005 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '68fd64fea5a84a0bbb1d09de7d76709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a45856efe44aa92f802f146b17616', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:10:15.129379 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Found WWN 33000000082c27a30 for multipath device dm-16 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:10:15.129939 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.044s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:10:15.130113 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] <== connect_volume: return (3044ms) {'type': 'block', 'scsi_wwn': '33000000082c27a30', 'path': '/dev/dm-16', 'multipath_id': '33000000082c27a30'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:10:15.130258 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000082c27a30', 'path': '/dev/dm-16', 'multipath_id': '33000000082c27a30'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:10:15.134717 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lazy-loading 'flavor' on Instance uuid 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:10:15.212629 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329415.211147, eb1c328c-f707-4f0d-90b5-ab5b268bf05a => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:10:15.212629 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:10:15.212629 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] VM Started (Lifecycle Event)
May 21 02:10:15.216355 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:10:15.220183 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Instance spawned successfully.
May 21 02:10:15.220183 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:10:15.352013 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:10:15.537818 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Successfully created port: 73cedad7-cb27-466f-9b50-2f39f6ce0275 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:10:15.543849 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "10c50913-8b08-402c-8ece-87c7521ce785" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:15.570057 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f4d8aae1-6f9b-4121-8347-2bc1bc2410bc tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "10c50913-8b08-402c-8ece-87c7521ce785" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.271s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:15.571288 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "10c50913-8b08-402c-8ece-87c7521ce785" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.028s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:15.573201 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "10c50913-8b08-402c-8ece-87c7521ce785-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:15.573340 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "10c50913-8b08-402c-8ece-87c7521ce785-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:15.573482 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "10c50913-8b08-402c-8ece-87c7521ce785-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:15.576031 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Terminating instance
May 21 02:10:15.638304 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Attempting to attach volume ca0f98f5-6310-483f-ab8f-43913cc3338c with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 02:10:15.640869 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] attach device xml: <disk type="block" device="disk">
May 21 02:10:15.640869 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:10:15.640869 np0000001127 nova-compute[98206]:   <alias name="ua-ca0f98f5-6310-483f-ab8f-43913cc3338c"/>
May 21 02:10:15.640869 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-16"/>
May 21 02:10:15.640869 np0000001127 nova-compute[98206]:   <target dev="vdc" bus="virtio"/>
May 21 02:10:15.640869 np0000001127 nova-compute[98206]:   <serial>ca0f98f5-6310-483f-ab8f-43913cc3338c</serial>
May 21 02:10:15.640869 np0000001127 nova-compute[98206]: </disk>
May 21 02:10:15.640869 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 02:10:15.716862 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:10:15.725158 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:10:15.732736 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:10:15.732853 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:10:15.733117 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:10:15.733272 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:10:15.733447 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:10:15.733759 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:10:15.856752 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:10:16.079652 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:10:16.102354 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:16.107642 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:16.141709 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:10:16.141709 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:10:16.141709 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:16.164053 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Successfully updated port: 73cedad7-cb27-466f-9b50-2f39f6ce0275 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:10:16.222205 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e1231ba9-9fc5-4d5d-abb4-19a24a89d4b4 req-8f983b3a-dec9-4791-9144-55d4986472b3 service nova] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Received event network-changed-73cedad7-cb27-466f-9b50-2f39f6ce0275 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:10:16.222439 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e1231ba9-9fc5-4d5d-abb4-19a24a89d4b4 req-8f983b3a-dec9-4791-9144-55d4986472b3 service nova] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Refreshing instance network info cache due to event network-changed-73cedad7-cb27-466f-9b50-2f39f6ce0275. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:10:16.222690 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e1231ba9-9fc5-4d5d-abb4-19a24a89d4b4 req-8f983b3a-dec9-4791-9144-55d4986472b3 service nova] Acquiring lock "refresh_cache-02fd9da8-f514-4e1b-8bd5-bfc8ae21753c" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:10:16.222824 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e1231ba9-9fc5-4d5d-abb4-19a24a89d4b4 req-8f983b3a-dec9-4791-9144-55d4986472b3 service nova] Acquired lock "refresh_cache-02fd9da8-f514-4e1b-8bd5-bfc8ae21753c" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:10:16.223359 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-e1231ba9-9fc5-4d5d-abb4-19a24a89d4b4 req-8f983b3a-dec9-4791-9144-55d4986472b3 service nova] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Refreshing network info cache for port 73cedad7-cb27-466f-9b50-2f39f6ce0275 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:10:16.231300 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:10:16.231300 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329416.2298357, eb1c328c-f707-4f0d-90b5-ab5b268bf05a => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:10:16.231300 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] VM Paused (Lifecycle Event)
May 21 02:10:16.242443 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Took 8.72 seconds to spawn the instance on the hypervisor.
May 21 02:10:16.242974 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:10:16.292793 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:16.299131 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:16.445977 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Instance destroyed successfully.
May 21 02:10:16.447565 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lazy-loading 'resources' on Instance uuid 10c50913-8b08-402c-8ece-87c7521ce785 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:10:16.627458 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-599279ed-0970-4df6-a6f7-100b81286fba req-93de0735-6e51-44db-aa51-d7302b2eab42 service nova] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Received event network-vif-plugged-3689adc9-295c-4c3e-b86e-161f565799ae {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:10:16.627767 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-599279ed-0970-4df6-a6f7-100b81286fba req-93de0735-6e51-44db-aa51-d7302b2eab42 service nova] Acquiring lock "eb1c328c-f707-4f0d-90b5-ab5b268bf05a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:16.627983 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-599279ed-0970-4df6-a6f7-100b81286fba req-93de0735-6e51-44db-aa51-d7302b2eab42 service nova] Lock "eb1c328c-f707-4f0d-90b5-ab5b268bf05a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:16.628158 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-599279ed-0970-4df6-a6f7-100b81286fba req-93de0735-6e51-44db-aa51-d7302b2eab42 service nova] Lock "eb1c328c-f707-4f0d-90b5-ab5b268bf05a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:16.628308 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-599279ed-0970-4df6-a6f7-100b81286fba req-93de0735-6e51-44db-aa51-d7302b2eab42 service nova] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] No waiting events found dispatching network-vif-plugged-3689adc9-295c-4c3e-b86e-161f565799ae {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:10:16.628461 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-599279ed-0970-4df6-a6f7-100b81286fba req-93de0735-6e51-44db-aa51-d7302b2eab42 service nova] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Received unexpected event network-vif-plugged-3689adc9-295c-4c3e-b86e-161f565799ae for instance with vm_state active and task_state None.
May 21 02:10:16.643149 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:10:16.668682 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "refresh_cache-02fd9da8-f514-4e1b-8bd5-bfc8ae21753c" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:10:16.678436 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:16.727544 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-e1231ba9-9fc5-4d5d-abb4-19a24a89d4b4 req-8f983b3a-dec9-4791-9144-55d4986472b3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:10:16.733183 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:10:16.739890 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329416.739542, eb1c328c-f707-4f0d-90b5-ab5b268bf05a => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:10:16.740097 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] VM Resumed (Lifecycle Event)
May 21 02:10:16.759073 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Took 17.55 seconds to build instance.
May 21 02:10:16.773973 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Acquiring lock "3767becb-caf4-47ee-904f-112069ee8dba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:16.774151 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "3767becb-caf4-47ee-904f-112069ee8dba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:16.807639 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-e1231ba9-9fc5-4d5d-abb4-19a24a89d4b4 req-8f983b3a-dec9-4791-9144-55d4986472b3 service nova] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:10:16.871189 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:10:16.871189 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:10:16.871189 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Creating image(s)
May 21 02:10:16.872070 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "/opt/stack/data/nova/instances/02fd9da8-f514-4e1b-8bd5-bfc8ae21753c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:16.872536 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "/opt/stack/data/nova/instances/02fd9da8-f514-4e1b-8bd5-bfc8ae21753c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:16.873950 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "/opt/stack/data/nova/instances/02fd9da8-f514-4e1b-8bd5-bfc8ae21753c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:16.873950 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:10:16.876602 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:10:16.877807 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:10:16.910095 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:16.950900 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:09:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1258436483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumemultiattachtests-server-1258436483',id=64,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG49/r2Ab7Qm1KfDPUwJai4qjLSCzazkse8keaGMf9RDSFnwzlyAfx0W/eKq+/pIZ6H88F7NAAW2g3zgnzAemSR+PHn4ESPDrxs+tFUrSTfyQy6BP7J2Yru23PLQSySpLA==',key_name='tempest-keypair-1913749436',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:09:22Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ae2ef74a1614eb09e4f71f709f64126',ramdisk_id='',reservation_id='r-ufnata00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-1039130224',owner_user_name='tempest-VolumeMultiattachTests-1039130224-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:09:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01cc41344ae640f6aa9c6142252838b2',uuid=10c50913-8b08-402c-8ece-87c7521ce785,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a149f43d-6c97-4b80-9bd8-353fb7be0630", "address": "fa:16:3e:2c:b3:6f", "network": {"id": "dec0dbdb-dfbe-4a3d-9d29-6add07c9003f", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-775185877-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ae2ef74a1614eb09e4f71f709f64126", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa149f43d-6c", "ovs_interfaceid": "a149f43d-6c97-4b80-9bd8-353fb7be0630", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:10:16.951223 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Converting VIF {"id": "a149f43d-6c97-4b80-9bd8-353fb7be0630", "address": "fa:16:3e:2c:b3:6f", "network": {"id": "dec0dbdb-dfbe-4a3d-9d29-6add07c9003f", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-775185877-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ae2ef74a1614eb09e4f71f709f64126", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa149f43d-6c", "ovs_interfaceid": "a149f43d-6c97-4b80-9bd8-353fb7be0630", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:10:16.951780 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:b3:6f,bridge_name='br-int',has_traffic_filtering=True,id=a149f43d-6c97-4b80-9bd8-353fb7be0630,network=Network(dec0dbdb-dfbe-4a3d-9d29-6add07c9003f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa149f43d-6c') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:10:16.952090 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:b3:6f,bridge_name='br-int',has_traffic_filtering=True,id=a149f43d-6c97-4b80-9bd8-353fb7be0630,network=Network(dec0dbdb-dfbe-4a3d-9d29-6add07c9003f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa149f43d-6c') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:10:16.953456 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:16.953783 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa149f43d-6c, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:10:16.955089 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:16.956228 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:10:16.957207 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:16.957366 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=816990c0-d861-4d62-8309-abd9be33135c) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:10:16.957883 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:16.958487 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:10:16.958759 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:16.961120 np0000001127 nova-compute[98206]: INFO os_vif [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:b3:6f,bridge_name='br-int',has_traffic_filtering=True,id=a149f43d-6c97-4b80-9bd8-353fb7be0630,network=Network(dec0dbdb-dfbe-4a3d-9d29-6add07c9003f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa149f43d-6c')
May 21 02:10:16.977706 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-e1231ba9-9fc5-4d5d-abb4-19a24a89d4b4 req-8f983b3a-dec9-4791-9144-55d4986472b3 service nova] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:10:16.999605 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.122s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:10:16.999967 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:17.000385 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:17.000791 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:10:17.004524 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:10:17.005816 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:10:17.007106 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:10:17.007433 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515', 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5dc8530-4090-49a6-897f-ad627f9d7515', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:10:17.007607 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:10:17.019719 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.011s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:10:17.020619 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515', 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5dc8530-4090-49a6-897f-ad627f9d7515', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:10:17.020891 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:10:17.067411 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:17.067411 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:17.067411 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:17.067411 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:17.067411 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:17.067411 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:17.067411 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:17.067411 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:17.067411 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:17.067411 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:17.067411 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:17.067411 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:17.067411 np0000001127 nova-compute[98206]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48 (non-flash)
May 21 02:10:17.067411 np0000001127 nova-compute[98206]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48 (non-flash)
May 21 02:10:17.067411 np0000001127 nova-compute[98206]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c (non-flash)
May 21 02:10:17.067411 np0000001127 nova-compute[98206]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c (non-flash)
May 21 02:10:17.067411 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:17.067411 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:17.067411 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:10:17.068653 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsi session list stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:17.068653 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:10:17.068653 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:17.068653 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:10:17.068653 np0000001127 nova-compute[98206]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:17.068653 np0000001127 nova-compute[98206]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515 (non-flash)
May 21 02:10:17.068653 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:17.068653 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:10:17.068653 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:17.068653 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:10:17.068653 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:17.068653 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:10:17.068653 np0000001127 nova-compute[98206]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48 (non-flash)
May 21 02:10:17.068653 np0000001127 nova-compute[98206]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48 (non-flash)
May 21 02:10:17.068653 np0000001127 nova-compute[98206]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c (non-flash)
May 21 02:10:17.068653 np0000001127 nova-compute[98206]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c (non-flash)
May 21 02:10:17.068653 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:17.068653 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:10:17.068653 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:10:17.068653 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', '132'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', '133'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', '134'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', '135'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515', '140'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515', '141'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', '144'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', '145'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a', '147'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a', '148'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43', '154'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43', '155'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48', '156'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48', '157'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c', '158'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c', '159'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '95')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:10:17.068653 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515', '140')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:10:17.069293 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515', '141')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:10:17.070389 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c058565a80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515'): ({'sdq'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515'): ({'sdp'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:10:17.072912 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Removing multipathed devices sdq, sdp {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:10:17.073764 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Flush multipath device 330000000b8ca6778 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:10:17.109937 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.104s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:10:17.110347 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/02fd9da8-f514-4e1b-8bd5-bfc8ae21753c/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:10:17.155665 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.808s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:17.156764 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:10:17.185921 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/02fd9da8-f514-4e1b-8bd5-bfc8ae21753c/disk 1073741824" returned: 0 in 0.075s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:10:17.186304 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.186s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:17.186614 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:10:17.244185 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:10:17.250698 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:10:17.263506 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "eb1c328c-f707-4f0d-90b5-ab5b268bf05a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.068s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:17.276903 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:10:17.285244 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.098s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:10:17.287504 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Checking if we can resize image /opt/stack/data/nova/instances/02fd9da8-f514-4e1b-8bd5-bfc8ae21753c/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:10:17.287504 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02fd9da8-f514-4e1b-8bd5-bfc8ae21753c/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:10:17.352797 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:10:17.352983 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:10:17.352983 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:10:17.353141 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:10:17.353222 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] No VIF found with MAC fa:16:3e:5c:a9:0d, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:10:17.385283 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02fd9da8-f514-4e1b-8bd5-bfc8ae21753c/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:10:17.387779 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Cannot resize image /opt/stack/data/nova/instances/02fd9da8-f514-4e1b-8bd5-bfc8ae21753c/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:10:17.388099 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:10:17.391786 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Ensure instance console log exists: /opt/stack/data/nova/instances/02fd9da8-f514-4e1b-8bd5-bfc8ae21753c/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:10:17.391786 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:17.391786 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:17.391786 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:17.482396 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e1231ba9-9fc5-4d5d-abb4-19a24a89d4b4 req-8f983b3a-dec9-4791-9144-55d4986472b3 service nova] Releasing lock "refresh_cache-02fd9da8-f514-4e1b-8bd5-bfc8ae21753c" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:10:17.482740 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquired lock "refresh_cache-02fd9da8-f514-4e1b-8bd5-bfc8ae21753c" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:10:17.482740 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:10:17.665536 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:10:17.667442 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:10:17.667669 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:10:17.668024 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:10:17.669201 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:10:17.740264 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4878b5a5bf184852a9ce383caa1c67a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ebdb16aee84e22a88dfc8960debd32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:10:17.754851 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999602772999879 future=<Future at 0x71c05862f9b0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:10:17.756250 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.998178813000322 future=<Future at 0x71c05862f9b0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:10:17.756366 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.998039465000147 future=<Future at 0x71c05862f9b0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:10:17.854372 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:17.854583 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:17.858241 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:10:17.859320 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Claim successful on node np0000001127
May 21 02:10:18.059163 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:10:18.170983 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:10:18.218884 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Successfully created port: a8a17868-6e90-432e-b126-c5af5a09ae6b {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:10:18.291042 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:10:18.294954 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-fd565e99-e5ce-41f0-93a3-eea9c8cb54c1 req-d3e0679c-51ed-4442-bb58-f2e37120ca2c service nova] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Received event network-vif-unplugged-a149f43d-6c97-4b80-9bd8-353fb7be0630 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:10:18.295421 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fd565e99-e5ce-41f0-93a3-eea9c8cb54c1 req-d3e0679c-51ed-4442-bb58-f2e37120ca2c service nova] Acquiring lock "10c50913-8b08-402c-8ece-87c7521ce785-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:18.295706 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fd565e99-e5ce-41f0-93a3-eea9c8cb54c1 req-d3e0679c-51ed-4442-bb58-f2e37120ca2c service nova] Lock "10c50913-8b08-402c-8ece-87c7521ce785-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:18.295917 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fd565e99-e5ce-41f0-93a3-eea9c8cb54c1 req-d3e0679c-51ed-4442-bb58-f2e37120ca2c service nova] Lock "10c50913-8b08-402c-8ece-87c7521ce785-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:18.296124 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-fd565e99-e5ce-41f0-93a3-eea9c8cb54c1 req-d3e0679c-51ed-4442-bb58-f2e37120ca2c service nova] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] No waiting events found dispatching network-vif-unplugged-a149f43d-6c97-4b80-9bd8-353fb7be0630 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:10:18.296329 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-fd565e99-e5ce-41f0-93a3-eea9c8cb54c1 req-d3e0679c-51ed-4442-bb58-f2e37120ca2c service nova] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Received event network-vif-unplugged-a149f43d-6c97-4b80-9bd8-353fb7be0630 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:10:18.296939 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-fd565e99-e5ce-41f0-93a3-eea9c8cb54c1 req-d3e0679c-51ed-4442-bb58-f2e37120ca2c service nova] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Received event network-vif-unplugged-a149f43d-6c97-4b80-9bd8-353fb7be0630 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:10:18.297160 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fd565e99-e5ce-41f0-93a3-eea9c8cb54c1 req-d3e0679c-51ed-4442-bb58-f2e37120ca2c service nova] Acquiring lock "10c50913-8b08-402c-8ece-87c7521ce785-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:18.297524 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fd565e99-e5ce-41f0-93a3-eea9c8cb54c1 req-d3e0679c-51ed-4442-bb58-f2e37120ca2c service nova] Lock "10c50913-8b08-402c-8ece-87c7521ce785-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:18.297720 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-fd565e99-e5ce-41f0-93a3-eea9c8cb54c1 req-d3e0679c-51ed-4442-bb58-f2e37120ca2c service nova] Lock "10c50913-8b08-402c-8ece-87c7521ce785-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:18.297890 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-fd565e99-e5ce-41f0-93a3-eea9c8cb54c1 req-d3e0679c-51ed-4442-bb58-f2e37120ca2c service nova] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] No waiting events found dispatching network-vif-unplugged-a149f43d-6c97-4b80-9bd8-353fb7be0630 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:10:18.298143 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-fd565e99-e5ce-41f0-93a3-eea9c8cb54c1 req-d3e0679c-51ed-4442-bb58-f2e37120ca2c service nova] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Received event network-vif-unplugged-a149f43d-6c97-4b80-9bd8-353fb7be0630 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:10:18.526071 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Updating instance_info_cache with network_info: [{"id": "73cedad7-cb27-466f-9b50-2f39f6ce0275", "address": "fa:16:3e:a1:86:24", "network": {"id": "68132179-7a2d-4b6f-bc7a-da8f937a9fb2", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1224285668-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "517a45856efe44aa92f802f146b17616", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73cedad7-cb", "ovs_interfaceid": "73cedad7-cb27-466f-9b50-2f39f6ce0275", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:10:18.676652 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Booting with volume snapshot 76183a04-b6c0-463e-ab2d-bc06d360513b at /dev/vda
May 21 02:10:18.872519 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Successfully updated port: a8a17868-6e90-432e-b126-c5af5a09ae6b {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:10:18.961996 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a036ffb4-b412-4d05-9add-df2c9ffaf0c4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.589s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:19.028155 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Releasing lock "refresh_cache-02fd9da8-f514-4e1b-8bd5-bfc8ae21753c" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:10:19.028387 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Instance network_info: |[{"id": "73cedad7-cb27-466f-9b50-2f39f6ce0275", "address": "fa:16:3e:a1:86:24", "network": {"id": "68132179-7a2d-4b6f-bc7a-da8f937a9fb2", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1224285668-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "517a45856efe44aa92f802f146b17616", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73cedad7-cb", "ovs_interfaceid": "73cedad7-cb27-466f-9b50-2f39f6ce0275", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:10:19.030832 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Start _get_guest_xml network_info=[{"id": "73cedad7-cb27-466f-9b50-2f39f6ce0275", "address": "fa:16:3e:a1:86:24", "network": {"id": "68132179-7a2d-4b6f-bc7a-da8f937a9fb2", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1224285668-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "517a45856efe44aa92f802f146b17616", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73cedad7-cb", "ovs_interfaceid": "73cedad7-cb27-466f-9b50-2f39f6ce0275", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:10:19.042403 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:10:19.043971 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1392099481', uuid='02fd9da8-f514-4e1b-8bd5-bfc8ae21753c'), owner=OwnerMeta(userid='68fd64fea5a84a0bbb1d09de7d76709c', username='tempest-TestEncryptedCinderVolumes-1523380334-project-member', projectid='517a45856efe44aa92f802f146b17616', projectname='tempest-TestEncryptedCinderVolumes-1523380334'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "73cedad7-cb27-466f-9b50-2f39f6ce0275", "address": "fa:16:3e:a1:86:24", "network": {"id": "68132179-7a2d-4b6f-bc7a-da8f937a9fb2", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1224285668-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "517a45856efe44aa92f802f146b17616", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73cedad7-cb", "ovs_interfaceid": "73cedad7-cb27-466f-9b50-2f39f6ce0275", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329419.043518) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:10:19.047272 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:10:19.047855 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:10:19.052565 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:10:19.052988 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:10:19.054174 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:10:19.054590 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:10:19.054775 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:10:19.054888 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:10:19.055032 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:10:19.055133 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:10:19.055589 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:10:19.055777 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:10:19.055919 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:10:19.056909 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:10:19.057054 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:10:19.057213 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:10:19.074668 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:10:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1392099481',display_name='tempest-TestEncryptedCinderVolumes-server-1392099481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testencryptedcindervolumes-server-1392099481',id=68,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPFkX7UV4mHln3a/uGQfatBLK2clN7H3IAr1QF0u5i0PnEYyD30XeDLj3teHetQ+AOB/iBr3O0cLCWJ5gSP5gTSRchXH+aPm6uprrkUllgoTrfowfNBxxi/gw9shRScx5A==',key_name='tempest-keypair-741803298',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='517a45856efe44aa92f802f146b17616',ramdisk_id='',reservation_id='r-atvvjlqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1523380334',owner_user_name='tempest-TestEncryptedCinderVolumes-1523380334-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:10:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68fd64fea5a84a0bbb1d09de7d76709c',uuid=02fd9da8-f514-4e1b-8bd5-bfc8ae21753c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73cedad7-cb27-466f-9b50-2f39f6ce0275", "address": "fa:16:3e:a1:86:24", "network": {"id": "68132179-7a2d-4b6f-bc7a-da8f937a9fb2", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1224285668-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "517a45856efe44aa92f802f146b17616", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73cedad7-cb", "ovs_interfaceid": "73cedad7-cb27-466f-9b50-2f39f6ce0275", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:10:19.074879 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Converting VIF {"id": "73cedad7-cb27-466f-9b50-2f39f6ce0275", "address": "fa:16:3e:a1:86:24", "network": {"id": "68132179-7a2d-4b6f-bc7a-da8f937a9fb2", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1224285668-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "517a45856efe44aa92f802f146b17616", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73cedad7-cb", "ovs_interfaceid": "73cedad7-cb27-466f-9b50-2f39f6ce0275", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:10:19.076746 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:86:24,bridge_name='br-int',has_traffic_filtering=True,id=73cedad7-cb27-466f-9b50-2f39f6ce0275,network=Network(68132179-7a2d-4b6f-bc7a-da8f937a9fb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73cedad7-cb') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:10:19.076870 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lazy-loading 'pci_devices' on Instance uuid 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:10:19.374499 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "refresh_cache-840919c9-6bf6-47ac-bb9c-35ea24494c2e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:10:19.374641 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquired lock "refresh_cache-840919c9-6bf6-47ac-bb9c-35ea24494c2e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:10:19.374743 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:10:19.398446 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Acquiring lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:19.398723 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:19.526641 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-40a1da85-ca97-4bc2-991d-f754a218a63c req-970c5780-1342-4ba2-a2fd-eef94555bbc4 service nova] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Received event network-changed-73bc542d-2c3b-4675-8361-9e2bd49f52fe {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:10:19.526641 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-40a1da85-ca97-4bc2-991d-f754a218a63c req-970c5780-1342-4ba2-a2fd-eef94555bbc4 service nova] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Refreshing instance network info cache due to event network-changed-73bc542d-2c3b-4675-8361-9e2bd49f52fe. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:10:19.526641 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-40a1da85-ca97-4bc2-991d-f754a218a63c req-970c5780-1342-4ba2-a2fd-eef94555bbc4 service nova] Acquiring lock "refresh_cache-3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:10:19.528618 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-40a1da85-ca97-4bc2-991d-f754a218a63c req-970c5780-1342-4ba2-a2fd-eef94555bbc4 service nova] Acquired lock "refresh_cache-3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:10:19.529324 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-40a1da85-ca97-4bc2-991d-f754a218a63c req-970c5780-1342-4ba2-a2fd-eef94555bbc4 service nova] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Refreshing network info cache for port 73bc542d-2c3b-4675-8361-9e2bd49f52fe {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:10:19.580043 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] End _get_guest_xml xml=<domain type="qemu">
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:   <uuid>02fd9da8-f514-4e1b-8bd5-bfc8ae21753c</uuid>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:   <name>instance-00000044</name>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1392099481</nova:name>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:10:19</nova:creationTime>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:         <nova:user uuid="68fd64fea5a84a0bbb1d09de7d76709c">tempest-TestEncryptedCinderVolumes-1523380334-project-member</nova:user>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:         <nova:project uuid="517a45856efe44aa92f802f146b17616">tempest-TestEncryptedCinderVolumes-1523380334</nova:project>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:         <nova:port uuid="73cedad7-cb27-466f-9b50-2f39f6ce0275">
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:     <system>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:       <entry name="serial">02fd9da8-f514-4e1b-8bd5-bfc8ae21753c</entry>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:       <entry name="uuid">02fd9da8-f514-4e1b-8bd5-bfc8ae21753c</entry>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:     </system>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:   <os>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:   </os>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:   <features>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:   </features>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:   <devices>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/02fd9da8-f514-4e1b-8bd5-bfc8ae21753c/disk"/>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:     </disk>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/02fd9da8-f514-4e1b-8bd5-bfc8ae21753c/disk.config"/>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:     </disk>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:a1:86:24"/>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:       <target dev="tap73cedad7-cb"/>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:     </interface>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/02fd9da8-f514-4e1b-8bd5-bfc8ae21753c/console.log" append="off"/>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:     </serial>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:     <video>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:     </video>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:     </rng>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:   </devices>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]: </domain>
May 21 02:10:19.580043 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:10:19.583135 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Preparing to wait for external event network-vif-plugged-73cedad7-cb27-466f-9b50-2f39f6ce0275 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:10:19.584928 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "02fd9da8-f514-4e1b-8bd5-bfc8ae21753c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:19.584928 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "02fd9da8-f514-4e1b-8bd5-bfc8ae21753c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:19.584928 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "02fd9da8-f514-4e1b-8bd5-bfc8ae21753c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:19.586395 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:10:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1392099481',display_name='tempest-TestEncryptedCinderVolumes-server-1392099481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testencryptedcindervolumes-server-1392099481',id=68,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPFkX7UV4mHln3a/uGQfatBLK2clN7H3IAr1QF0u5i0PnEYyD30XeDLj3teHetQ+AOB/iBr3O0cLCWJ5gSP5gTSRchXH+aPm6uprrkUllgoTrfowfNBxxi/gw9shRScx5A==',key_name='tempest-keypair-741803298',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='517a45856efe44aa92f802f146b17616',ramdisk_id='',reservation_id='r-atvvjlqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1523380334',owner_user_name='tempest-TestEncryptedCinderVolumes-1523380334-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:10:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68fd64fea5a84a0bbb1d09de7d76709c',uuid=02fd9da8-f514-4e1b-8bd5-bfc8ae21753c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73cedad7-cb27-466f-9b50-2f39f6ce0275", "address": "fa:16:3e:a1:86:24", "network": {"id": "68132179-7a2d-4b6f-bc7a-da8f937a9fb2", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1224285668-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "517a45856efe44aa92f802f146b17616", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73cedad7-cb", "ovs_interfaceid": "73cedad7-cb27-466f-9b50-2f39f6ce0275", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:10:19.586395 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Converting VIF {"id": "73cedad7-cb27-466f-9b50-2f39f6ce0275", "address": "fa:16:3e:a1:86:24", "network": {"id": "68132179-7a2d-4b6f-bc7a-da8f937a9fb2", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1224285668-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "517a45856efe44aa92f802f146b17616", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73cedad7-cb", "ovs_interfaceid": "73cedad7-cb27-466f-9b50-2f39f6ce0275", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:10:19.586395 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:86:24,bridge_name='br-int',has_traffic_filtering=True,id=73cedad7-cb27-466f-9b50-2f39f6ce0275,network=Network(68132179-7a2d-4b6f-bc7a-da8f937a9fb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73cedad7-cb') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:10:19.587702 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:86:24,bridge_name='br-int',has_traffic_filtering=True,id=73cedad7-cb27-466f-9b50-2f39f6ce0275,network=Network(68132179-7a2d-4b6f-bc7a-da8f937a9fb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73cedad7-cb') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:10:19.588157 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:19.588659 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:10:19.588998 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:10:19.596412 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:19.597013 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd0c260a4-2f9b-5ed3-b2c6-5a896f5b5055', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:10:19.598317 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:19.600217 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:10:19.606577 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:19.606826 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73cedad7-cb, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:10:19.607229 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap73cedad7-cb, col_values=(('qos', UUID('729a7b2f-bb79-4b8b-9911-6c0ae31c0f1a')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:10:19.607402 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap73cedad7-cb, col_values=(('external_ids', {'iface-id': '73cedad7-cb27-466f-9b50-2f39f6ce0275', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:86:24', 'vm-uuid': '02fd9da8-f514-4e1b-8bd5-bfc8ae21753c'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:10:19.608399 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:19.611264 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:10:19.618385 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:19.627027 np0000001127 nova-compute[98206]: INFO os_vif [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:86:24,bridge_name='br-int',has_traffic_filtering=True,id=73cedad7-cb27-466f-9b50-2f39f6ce0275,network=Network(68132179-7a2d-4b6f-bc7a-da8f937a9fb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73cedad7-cb')
May 21 02:10:19.660708 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:10:19.661035 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:10:19.902407 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Detaching volume ca0f98f5-6310-483f-ab8f-43913cc3338c
May 21 02:10:19.953062 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:10:19.958669 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Attempting to driver detach volume ca0f98f5-6310-483f-ab8f-43913cc3338c from mountpoint /dev/vdc
May 21 02:10:19.965987 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Found disk vdc by alias ua-ca0f98f5-6310-483f-ab8f-43913cc3338c {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:10:19.967955 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Found disk vdc by alias ua-ca0f98f5-6310-483f-ab8f-43913cc3338c {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:10:19.967955 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Attempting to detach device vdc from instance 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 02:10:19.967955 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:10:19.967955 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:10:19.967955 np0000001127 nova-compute[98206]:   <alias name="ua-ca0f98f5-6310-483f-ab8f-43913cc3338c"/>
May 21 02:10:19.967955 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-16"/>
May 21 02:10:19.967955 np0000001127 nova-compute[98206]:   <target dev="vdc" bus="virtio"/>
May 21 02:10:19.967955 np0000001127 nova-compute[98206]:   <serial>ca0f98f5-6310-483f-ab8f-43913cc3338c</serial>
May 21 02:10:19.967955 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 21 02:10:19.967955 np0000001127 nova-compute[98206]: </disk>
May 21 02:10:19.967955 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:10:19.977281 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Successfully detached device vdc from instance 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e from the persistent domain config.
May 21 02:10:19.978185 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] (1/8): Attempting to detach device vdc with device alias ua-ca0f98f5-6310-483f-ab8f-43913cc3338c from instance 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 02:10:19.978185 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:10:19.978185 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:10:19.978185 np0000001127 nova-compute[98206]:   <alias name="ua-ca0f98f5-6310-483f-ab8f-43913cc3338c"/>
May 21 02:10:19.978185 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-16"/>
May 21 02:10:19.978185 np0000001127 nova-compute[98206]:   <target dev="vdc" bus="virtio"/>
May 21 02:10:19.978185 np0000001127 nova-compute[98206]:   <serial>ca0f98f5-6310-483f-ab8f-43913cc3338c</serial>
May 21 02:10:19.978185 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 21 02:10:19.978185 np0000001127 nova-compute[98206]: </disk>
May 21 02:10:19.978185 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:10:19.995642 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Acquiring lock "3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:19.995908 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Lock "3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:19.996143 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Acquiring lock "3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:19.996334 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Lock "3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:19.996531 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Lock "3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:20.007561 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Terminating instance
May 21 02:10:20.036985 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-40a1da85-ca97-4bc2-991d-f754a218a63c req-970c5780-1342-4ba2-a2fd-eef94555bbc4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:10:20.137566 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:10:20.168039 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:10:20.363307 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-093b5588-2256-4a32-bb22-4ca3e5a167e3 req-ce65a27c-8aba-418d-9937-2625ba30af4a service nova] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Received event network-changed-a8a17868-6e90-432e-b126-c5af5a09ae6b {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:10:20.363916 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-093b5588-2256-4a32-bb22-4ca3e5a167e3 req-ce65a27c-8aba-418d-9937-2625ba30af4a service nova] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Refreshing instance network info cache due to event network-changed-a8a17868-6e90-432e-b126-c5af5a09ae6b. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:10:20.364052 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-093b5588-2256-4a32-bb22-4ca3e5a167e3 req-ce65a27c-8aba-418d-9937-2625ba30af4a service nova] Acquiring lock "refresh_cache-840919c9-6bf6-47ac-bb9c-35ea24494c2e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:10:20.366077 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Updating instance_info_cache with network_info: [{"id": "a8a17868-6e90-432e-b126-c5af5a09ae6b", "address": "fa:16:3e:d1:2c:6c", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a17868-6e", "ovs_interfaceid": "a8a17868-6e90-432e-b126-c5af5a09ae6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:10:20.468570 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-40a1da85-ca97-4bc2-991d-f754a218a63c req-970c5780-1342-4ba2-a2fd-eef94555bbc4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:10:20.515171 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:10:20.515359 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779329420.515141, 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e => ua-ca0f98f5-6310-483f-ab8f-43913cc3338c> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 02:10:20.517107 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-ca0f98f5-6310-483f-ab8f-43913cc3338c for instance 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 02:10:20.520329 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Successfully detached device vdc from instance 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e from the live domain config.
May 21 02:10:20.524021 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:10:20.524273 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c', 'iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ca0f98f5-6310-483f-ab8f-43913cc3338c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-16'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:10:20.524417 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:10:20.545331 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:20.548066 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:20.573238 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:20.574943 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:20.602948 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "eb1c328c-f707-4f0d-90b5-ab5b268bf05a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:20.603172 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "eb1c328c-f707-4f0d-90b5-ab5b268bf05a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:20.603388 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "eb1c328c-f707-4f0d-90b5-ab5b268bf05a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:20.603676 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "eb1c328c-f707-4f0d-90b5-ab5b268bf05a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:20.603826 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "eb1c328c-f707-4f0d-90b5-ab5b268bf05a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:20.611747 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Terminating instance
May 21 02:10:20.613310 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:20.655313 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-40a1da85-ca97-4bc2-991d-f754a218a63c req-970c5780-1342-4ba2-a2fd-eef94555bbc4 service nova] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Updated VIF entry in instance network info cache for port 73bc542d-2c3b-4675-8361-9e2bd49f52fe. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:10:20.655684 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-40a1da85-ca97-4bc2-991d-f754a218a63c req-970c5780-1342-4ba2-a2fd-eef94555bbc4 service nova] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Updating instance_info_cache with network_info: [{"id": "73bc542d-2c3b-4675-8361-9e2bd49f52fe", "address": "fa:16:3e:ce:28:ea", "network": {"id": "e7b16641-1745-4249-9b74-305029a60f3f", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-685232721-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1646ca3e5bf3425ca0bd66c5a50c996b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bc542d-2c", "ovs_interfaceid": "73bc542d-2c3b-4675-8361-9e2bd49f52fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:10:20.678837 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.824s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:20.679323 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:10:20.842038 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999728787000095 future=<Future at 0x71c0a255c6b0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:10:20.845018 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Instance destroyed successfully.
May 21 02:10:20.845805 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Lazy-loading 'resources' on Instance uuid 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:10:20.869709 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Releasing lock "refresh_cache-840919c9-6bf6-47ac-bb9c-35ea24494c2e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:10:20.870584 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Instance network_info: |[{"id": "a8a17868-6e90-432e-b126-c5af5a09ae6b", "address": "fa:16:3e:d1:2c:6c", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a17868-6e", "ovs_interfaceid": "a8a17868-6e90-432e-b126-c5af5a09ae6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:10:20.870584 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-093b5588-2256-4a32-bb22-4ca3e5a167e3 req-ce65a27c-8aba-418d-9937-2625ba30af4a service nova] Acquired lock "refresh_cache-840919c9-6bf6-47ac-bb9c-35ea24494c2e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:10:20.871624 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-093b5588-2256-4a32-bb22-4ca3e5a167e3 req-ce65a27c-8aba-418d-9937-2625ba30af4a service nova] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Refreshing network info cache for port a8a17868-6e90-432e-b126-c5af5a09ae6b {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:10:21.116159 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:10:21.144128 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:21.146751 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:21.157687 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-40a1da85-ca97-4bc2-991d-f754a218a63c req-970c5780-1342-4ba2-a2fd-eef94555bbc4 service nova] Releasing lock "refresh_cache-3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:10:21.160217 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:10:21.160217 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:10:21.160402 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] No VIF found with MAC fa:16:3e:a1:86:24, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:10:21.161326 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Using config drive
May 21 02:10:21.170537 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:21.185678 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:10:21.185875 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:10:21.186054 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:10:21.186452 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:10:21.250849 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '09298d250fae40f1adea3cae800dd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549d365926ce49efa4c4bf50c7bbbbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:10:21.289680 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-9abb55f8-5922-404d-8ca1-90756f55ba18 req-d8c8fd8d-a7fb-4cc2-b243-c018cd751d2e service nova] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Received event network-vif-unplugged-3689adc9-295c-4c3e-b86e-161f565799ae {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:10:21.290037 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-9abb55f8-5922-404d-8ca1-90756f55ba18 req-d8c8fd8d-a7fb-4cc2-b243-c018cd751d2e service nova] Acquiring lock "eb1c328c-f707-4f0d-90b5-ab5b268bf05a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:21.290228 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-9abb55f8-5922-404d-8ca1-90756f55ba18 req-d8c8fd8d-a7fb-4cc2-b243-c018cd751d2e service nova] Lock "eb1c328c-f707-4f0d-90b5-ab5b268bf05a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:21.290360 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-9abb55f8-5922-404d-8ca1-90756f55ba18 req-d8c8fd8d-a7fb-4cc2-b243-c018cd751d2e service nova] Lock "eb1c328c-f707-4f0d-90b5-ab5b268bf05a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:21.290537 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-9abb55f8-5922-404d-8ca1-90756f55ba18 req-d8c8fd8d-a7fb-4cc2-b243-c018cd751d2e service nova] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] No waiting events found dispatching network-vif-unplugged-3689adc9-295c-4c3e-b86e-161f565799ae {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:10:21.290667 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-9abb55f8-5922-404d-8ca1-90756f55ba18 req-d8c8fd8d-a7fb-4cc2-b243-c018cd751d2e service nova] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Received event network-vif-unplugged-3689adc9-295c-4c3e-b86e-161f565799ae for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:10:21.294583 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:21.307186 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:21.348336 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:09:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-646773334',display_name='tempest-TestVolumeBackupRestore-server-646773334',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebackuprestore-server-646773334',id=66,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjyTngBb9j+YLiWPk1+cRCtu9sygtLJo5dbpOI44z933QpUYnXoQ69XTpNIPHEtOoptikmp9dysWmNswygmNgc2SMTxiJKJunsuTHW1eRdOgwWJdDSu/wDic167oxz7/g==',key_name='tempest-TestVolumeBackupRestore-227864388',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:09:49Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1646ca3e5bf3425ca0bd66c5a50c996b',ramdisk_id='',reservation_id='r-7yw44dkt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBackupRestore-233752250',owner_user_name='tempest-TestVolumeBackupRestore-233752250-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:09:49Z,user_data=None,user_id='5616bae090404a2dbbe6b2486102cf7f',uuid=3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73bc542d-2c3b-4675-8361-9e2bd49f52fe", "address": "fa:16:3e:ce:28:ea", "network": {"id": "e7b16641-1745-4249-9b74-305029a60f3f", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-685232721-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1646ca3e5bf3425ca0bd66c5a50c996b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bc542d-2c", "ovs_interfaceid": "73bc542d-2c3b-4675-8361-9e2bd49f52fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:10:21.348582 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Converting VIF {"id": "73bc542d-2c3b-4675-8361-9e2bd49f52fe", "address": "fa:16:3e:ce:28:ea", "network": {"id": "e7b16641-1745-4249-9b74-305029a60f3f", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-685232721-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1646ca3e5bf3425ca0bd66c5a50c996b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bc542d-2c", "ovs_interfaceid": "73bc542d-2c3b-4675-8361-9e2bd49f52fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:10:21.349139 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:28:ea,bridge_name='br-int',has_traffic_filtering=True,id=73bc542d-2c3b-4675-8361-9e2bd49f52fe,network=Network(e7b16641-1745-4249-9b74-305029a60f3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bc542d-2c') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:10:21.349346 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:28:ea,bridge_name='br-int',has_traffic_filtering=True,id=73bc542d-2c3b-4675-8361-9e2bd49f52fe,network=Network(e7b16641-1745-4249-9b74-305029a60f3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bc542d-2c') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:10:21.351906 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:21.351906 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73bc542d-2c, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:10:21.353273 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:21.354260 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:10:21.363759 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:21.364814 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:21.365045 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4ca72b7d-f62d-43c0-82b0-fc9623db5d24) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:10:21.365682 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:21.366408 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:10:21.374054 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-093b5588-2256-4a32-bb22-4ca3e5a167e3 req-ce65a27c-8aba-418d-9937-2625ba30af4a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:10:21.376304 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:21.377974 np0000001127 nova-compute[98206]: INFO os_vif [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:28:ea,bridge_name='br-int',has_traffic_filtering=True,id=73bc542d-2c3b-4675-8361-9e2bd49f52fe,network=Network(e7b16641-1745-4249-9b74-305029a60f3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bc542d-2c')
May 21 02:10:21.382744 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:10:21.383238 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a', 'iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '61affb01-e1ac-45d2-938c-e506a523047a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:10:21.383342 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:10:21.440350 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999731843000063 future=<Future at 0x71c07c5e9c40 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:10:21.444714 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Instance destroyed successfully.
May 21 02:10:21.445196 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lazy-loading 'resources' on Instance uuid eb1c328c-f707-4f0d-90b5-ab5b268bf05a {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:10:21.667508 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:10:21.671970 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-093b5588-2256-4a32-bb22-4ca3e5a167e3 req-ce65a27c-8aba-418d-9937-2625ba30af4a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:10:21.688313 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:10:21.766919 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Successfully created port: ad59f56d-4c95-4f01-8318-98360ae0fe9a {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:10:21.813032 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Creating config drive at /opt/stack/data/nova/instances/02fd9da8-f514-4e1b-8bd5-bfc8ae21753c/disk.config
May 21 02:10:21.817678 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/02fd9da8-f514-4e1b-8bd5-bfc8ae21753c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfvic2k40 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:10:21.848356 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-093b5588-2256-4a32-bb22-4ca3e5a167e3 req-ce65a27c-8aba-418d-9937-2625ba30af4a service nova] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Updated VIF entry in instance network info cache for port a8a17868-6e90-432e-b126-c5af5a09ae6b. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:10:21.849110 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-093b5588-2256-4a32-bb22-4ca3e5a167e3 req-ce65a27c-8aba-418d-9937-2625ba30af4a service nova] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Updating instance_info_cache with network_info: [{"id": "a8a17868-6e90-432e-b126-c5af5a09ae6b", "address": "fa:16:3e:d1:2c:6c", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a17868-6e", "ovs_interfaceid": "a8a17868-6e90-432e-b126-c5af5a09ae6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:10:21.876628 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/02fd9da8-f514-4e1b-8bd5-bfc8ae21753c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfvic2k40" returned: 0 in 0.059s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:10:21.908794 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:21.948307 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:09:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-131757601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumemultiattachtest-server-131757601',id=67,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:10:16Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='848912b0c0e94d2795bb2332daf1730e',ramdisk_id='',reservation_id='r-c2hjji70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-289054175',owner_user_name='tempest-AttachVolumeMultiAttachTest-289054175-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:10:16Z,user_data=None,user_id='049d6c8cccfa4ae38d78a88ef5be0f1b',uuid=eb1c328c-f707-4f0d-90b5-ab5b268bf05a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3689adc9-295c-4c3e-b86e-161f565799ae", "address": "fa:16:3e:a3:6c:54", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3689adc9-29", "ovs_interfaceid": "3689adc9-295c-4c3e-b86e-161f565799ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:10:21.948497 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converting VIF {"id": "3689adc9-295c-4c3e-b86e-161f565799ae", "address": "fa:16:3e:a3:6c:54", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3689adc9-29", "ovs_interfaceid": "3689adc9-295c-4c3e-b86e-161f565799ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:10:21.949113 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:6c:54,bridge_name='br-int',has_traffic_filtering=True,id=3689adc9-295c-4c3e-b86e-161f565799ae,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3689adc9-29') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:10:21.949328 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:6c:54,bridge_name='br-int',has_traffic_filtering=True,id=3689adc9-295c-4c3e-b86e-161f565799ae,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3689adc9-29') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:10:21.950666 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:21.950913 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3689adc9-29, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:10:21.952174 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:21.953401 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:10:21.958105 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:21.958822 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:21.958980 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=81b35e9c-ac0c-4d36-84b4-33574e9182ab) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:10:21.959373 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:21.959801 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:10:21.964415 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:21.966266 np0000001127 nova-compute[98206]: INFO os_vif [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:6c:54,bridge_name='br-int',has_traffic_filtering=True,id=3689adc9-295c-4c3e-b86e-161f565799ae,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3689adc9-29')
May 21 02:10:22.001680 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:10:22.002206 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48', 'iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6a1268db-f070-4554-9c26-573e6882fc48', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:10:22.002293 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:10:22.191661 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:10:22.223326 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:10:22.231131 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Successfully updated port: ad59f56d-4c95-4f01-8318-98360ae0fe9a {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:10:22.234884 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:10:22.259027 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:10:22.281953 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-19717223-9cc2-4d56-acb4-68b2bab037fc req-d05257ab-646f-4d10-9578-381f4a4958fb service nova] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Received event network-changed-ad59f56d-4c95-4f01-8318-98360ae0fe9a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:10:22.282567 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-19717223-9cc2-4d56-acb4-68b2bab037fc req-d05257ab-646f-4d10-9578-381f4a4958fb service nova] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Refreshing instance network info cache due to event network-changed-ad59f56d-4c95-4f01-8318-98360ae0fe9a. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:10:22.282944 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-19717223-9cc2-4d56-acb4-68b2bab037fc req-d05257ab-646f-4d10-9578-381f4a4958fb service nova] Acquiring lock "refresh_cache-3767becb-caf4-47ee-904f-112069ee8dba" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:10:22.283105 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-19717223-9cc2-4d56-acb4-68b2bab037fc req-d05257ab-646f-4d10-9578-381f4a4958fb service nova] Acquired lock "refresh_cache-3767becb-caf4-47ee-904f-112069ee8dba" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:10:22.283266 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-19717223-9cc2-4d56-acb4-68b2bab037fc req-d05257ab-646f-4d10-9578-381f4a4958fb service nova] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Refreshing network info cache for port ad59f56d-4c95-4f01-8318-98360ae0fe9a {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:10:22.292722 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:22.309203 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:10:22.309501 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:10:22.317104 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:22.318880 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:22.321186 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:10:22.322736 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe20:ae96', 'fe80::fc16:3eff:fe5c:a90d', 'fe80::786b:86ff:fe32:8f96', 'fe80::fc16:3eff:fe30:164f', 'fe80::c44d:25ff:fe10:25cb', 'fe80::fc16:3eff:fea1:8624', 'fe80::fc16:3eff:fe0f:28a1', 'fe80::440a:38ff:fe27:fa24', 'fe80::fc16:3eff:fefb:4d96', 'fe80::fc16:3eff:fe65:6557', 'fe80::fc16:3eff:feb8:d101', 'fe80::7045:30ff:fe1a:b99f', 'fe80::fc16:3eff:fedb:8dd'] 
May 21 02:10:22.322736 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:10:22.322908 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:10:22.323081 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] <== get_connector_properties: return (99ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:10:22.323256 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Updating existing volume attachment record: 5ec29bf6-aa6e-44cc-9f1d-3503d6f953f7 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:10:22.356123 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-093b5588-2256-4a32-bb22-4ca3e5a167e3 req-ce65a27c-8aba-418d-9937-2625ba30af4a service nova] Releasing lock "refresh_cache-840919c9-6bf6-47ac-bb9c-35ea24494c2e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:10:22.404453 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:22.427572 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b9f2be68-d160-4b53-87d8-99eaff12e968 req-59c390df-d18a-4dff-9216-7e51a697edbb service nova] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Received event network-vif-unplugged-73bc542d-2c3b-4675-8361-9e2bd49f52fe {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:10:22.427887 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b9f2be68-d160-4b53-87d8-99eaff12e968 req-59c390df-d18a-4dff-9216-7e51a697edbb service nova] Acquiring lock "3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:22.428067 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b9f2be68-d160-4b53-87d8-99eaff12e968 req-59c390df-d18a-4dff-9216-7e51a697edbb service nova] Lock "3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:22.428203 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b9f2be68-d160-4b53-87d8-99eaff12e968 req-59c390df-d18a-4dff-9216-7e51a697edbb service nova] Lock "3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:22.428341 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b9f2be68-d160-4b53-87d8-99eaff12e968 req-59c390df-d18a-4dff-9216-7e51a697edbb service nova] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] No waiting events found dispatching network-vif-unplugged-73bc542d-2c3b-4675-8361-9e2bd49f52fe {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:10:22.428507 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b9f2be68-d160-4b53-87d8-99eaff12e968 req-59c390df-d18a-4dff-9216-7e51a697edbb service nova] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Received event network-vif-unplugged-73bc542d-2c3b-4675-8361-9e2bd49f52fe for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:10:22.428654 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b9f2be68-d160-4b53-87d8-99eaff12e968 req-59c390df-d18a-4dff-9216-7e51a697edbb service nova] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Received event network-vif-unplugged-73bc542d-2c3b-4675-8361-9e2bd49f52fe {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:10:22.429217 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b9f2be68-d160-4b53-87d8-99eaff12e968 req-59c390df-d18a-4dff-9216-7e51a697edbb service nova] Acquiring lock "3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:22.429217 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b9f2be68-d160-4b53-87d8-99eaff12e968 req-59c390df-d18a-4dff-9216-7e51a697edbb service nova] Lock "3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:22.429217 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b9f2be68-d160-4b53-87d8-99eaff12e968 req-59c390df-d18a-4dff-9216-7e51a697edbb service nova] Lock "3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:22.429379 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b9f2be68-d160-4b53-87d8-99eaff12e968 req-59c390df-d18a-4dff-9216-7e51a697edbb service nova] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] No waiting events found dispatching network-vif-unplugged-73bc542d-2c3b-4675-8361-9e2bd49f52fe {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:10:22.429541 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b9f2be68-d160-4b53-87d8-99eaff12e968 req-59c390df-d18a-4dff-9216-7e51a697edbb service nova] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Received event network-vif-unplugged-73bc542d-2c3b-4675-8361-9e2bd49f52fe for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:10:22.602379 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:22.605105 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:22.608044 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:22.637542 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:22.735207 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Acquiring lock "refresh_cache-3767becb-caf4-47ee-904f-112069ee8dba" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:10:22.786153 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-19717223-9cc2-4d56-acb4-68b2bab037fc req-d05257ab-646f-4d10-9578-381f4a4958fb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:10:22.856658 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-19717223-9cc2-4d56-acb4-68b2bab037fc req-d05257ab-646f-4d10-9578-381f4a4958fb service nova] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:10:22.999303 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-19717223-9cc2-4d56-acb4-68b2bab037fc req-d05257ab-646f-4d10-9578-381f4a4958fb service nova] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:10:23.078850 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329423.0783753, 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:10:23.079546 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] VM Started (Lifecycle Event)
May 21 02:10:23.203205 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:10:23.204365 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:10:23.204649 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Creating image(s)
May 21 02:10:23.205110 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Acquiring lock "/opt/stack/data/nova/instances/3767becb-caf4-47ee-904f-112069ee8dba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:23.205312 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "/opt/stack/data/nova/instances/3767becb-caf4-47ee-904f-112069ee8dba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:23.205789 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "/opt/stack/data/nova/instances/3767becb-caf4-47ee-904f-112069ee8dba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:23.206281 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:10:23.208952 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:10:23.211508 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:10:23.296513 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.086s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:10:23.296938 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:23.297389 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:23.297842 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:10:23.300478 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:10:23.300821 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:10:23.356861 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1b40ee3c-5f8e-4f64-8a31-b183bd06d5ce req-d5f4d292-9023-41eb-894d-bb516096a0d8 service nova] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Received event network-vif-unplugged-3689adc9-295c-4c3e-b86e-161f565799ae {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:10:23.357769 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1b40ee3c-5f8e-4f64-8a31-b183bd06d5ce req-d5f4d292-9023-41eb-894d-bb516096a0d8 service nova] Acquiring lock "eb1c328c-f707-4f0d-90b5-ab5b268bf05a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:23.357948 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1b40ee3c-5f8e-4f64-8a31-b183bd06d5ce req-d5f4d292-9023-41eb-894d-bb516096a0d8 service nova] Lock "eb1c328c-f707-4f0d-90b5-ab5b268bf05a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:23.358066 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1b40ee3c-5f8e-4f64-8a31-b183bd06d5ce req-d5f4d292-9023-41eb-894d-bb516096a0d8 service nova] Lock "eb1c328c-f707-4f0d-90b5-ab5b268bf05a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:23.358181 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1b40ee3c-5f8e-4f64-8a31-b183bd06d5ce req-d5f4d292-9023-41eb-894d-bb516096a0d8 service nova] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] No waiting events found dispatching network-vif-unplugged-3689adc9-295c-4c3e-b86e-161f565799ae {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:10:23.358286 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1b40ee3c-5f8e-4f64-8a31-b183bd06d5ce req-d5f4d292-9023-41eb-894d-bb516096a0d8 service nova] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Received event network-vif-unplugged-3689adc9-295c-4c3e-b86e-161f565799ae for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:10:23.411308 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.110s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:10:23.411666 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/3767becb-caf4-47ee-904f-112069ee8dba/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:10:23.469037 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/3767becb-caf4-47ee-904f-112069ee8dba/disk 1073741824" returned: 0 in 0.057s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:10:23.469392 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.172s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:23.469796 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:10:23.481619 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:23.502181 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-19717223-9cc2-4d56-acb4-68b2bab037fc req-d05257ab-646f-4d10-9578-381f4a4958fb service nova] Releasing lock "refresh_cache-3767becb-caf4-47ee-904f-112069ee8dba" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:10:23.503095 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Acquired lock "refresh_cache-3767becb-caf4-47ee-904f-112069ee8dba" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:10:23.503366 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:10:23.573139 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.103s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:10:23.573501 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3767becb-caf4-47ee-904f-112069ee8dba/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:10:23.573734 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3767becb-caf4-47ee-904f-112069ee8dba/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:10:23.587344 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:10:23.594748 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329423.594356, 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:10:23.594892 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] VM Paused (Lifecycle Event)
May 21 02:10:23.671853 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3767becb-caf4-47ee-904f-112069ee8dba/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:10:23.672164 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Cannot resize image /opt/stack/data/nova/instances/3767becb-caf4-47ee-904f-112069ee8dba/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:10:23.672521 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:10:23.672658 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Ensure instance console log exists: /opt/stack/data/nova/instances/3767becb-caf4-47ee-904f-112069ee8dba/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:10:23.672937 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:23.673123 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:23.673249 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:24.067377 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:10:24.098332 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:10:24.100660 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:10:24.233337 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:10:24.338630 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bd659ad9-0908-417b-9633-3f20a04d2871 req-60ea60ae-fe68-4084-a6e2-e128e355b806 service nova] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Received event network-vif-plugged-73cedad7-cb27-466f-9b50-2f39f6ce0275 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:10:24.338991 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bd659ad9-0908-417b-9633-3f20a04d2871 req-60ea60ae-fe68-4084-a6e2-e128e355b806 service nova] Acquiring lock "02fd9da8-f514-4e1b-8bd5-bfc8ae21753c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:24.338991 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bd659ad9-0908-417b-9633-3f20a04d2871 req-60ea60ae-fe68-4084-a6e2-e128e355b806 service nova] Lock "02fd9da8-f514-4e1b-8bd5-bfc8ae21753c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:24.339151 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bd659ad9-0908-417b-9633-3f20a04d2871 req-60ea60ae-fe68-4084-a6e2-e128e355b806 service nova] Lock "02fd9da8-f514-4e1b-8bd5-bfc8ae21753c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:24.339235 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bd659ad9-0908-417b-9633-3f20a04d2871 req-60ea60ae-fe68-4084-a6e2-e128e355b806 service nova] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Processing event network-vif-plugged-73cedad7-cb27-466f-9b50-2f39f6ce0275 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:10:24.339370 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bd659ad9-0908-417b-9633-3f20a04d2871 req-60ea60ae-fe68-4084-a6e2-e128e355b806 service nova] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Received event network-vif-plugged-73cedad7-cb27-466f-9b50-2f39f6ce0275 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:10:24.339544 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bd659ad9-0908-417b-9633-3f20a04d2871 req-60ea60ae-fe68-4084-a6e2-e128e355b806 service nova] Acquiring lock "02fd9da8-f514-4e1b-8bd5-bfc8ae21753c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:24.339699 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bd659ad9-0908-417b-9633-3f20a04d2871 req-60ea60ae-fe68-4084-a6e2-e128e355b806 service nova] Lock "02fd9da8-f514-4e1b-8bd5-bfc8ae21753c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:24.340069 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:10:24.340268 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bd659ad9-0908-417b-9633-3f20a04d2871 req-60ea60ae-fe68-4084-a6e2-e128e355b806 service nova] Lock "02fd9da8-f514-4e1b-8bd5-bfc8ae21753c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:24.340370 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bd659ad9-0908-417b-9633-3f20a04d2871 req-60ea60ae-fe68-4084-a6e2-e128e355b806 service nova] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] No waiting events found dispatching network-vif-plugged-73cedad7-cb27-466f-9b50-2f39f6ce0275 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:10:24.340613 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-bd659ad9-0908-417b-9633-3f20a04d2871 req-60ea60ae-fe68-4084-a6e2-e128e355b806 service nova] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Received unexpected event network-vif-plugged-73cedad7-cb27-466f-9b50-2f39f6ce0275 for instance with vm_state building and task_state spawning.
May 21 02:10:24.343022 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:10:24.345299 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Instance spawned successfully.
May 21 02:10:24.345590 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:10:24.360701 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Updating instance_info_cache with network_info: [{"id": "ad59f56d-4c95-4f01-8318-98360ae0fe9a", "address": "fa:16:3e:0b:89:15", "network": {"id": "b32cfb32-7b1e-4cc7-b35b-a86447f00a8a", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-397130825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "549d365926ce49efa4c4bf50c7bbbbaa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad59f56d-4c", "ovs_interfaceid": "ad59f56d-4c95-4f01-8318-98360ae0fe9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:10:24.446534 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:10:24.446534 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:10:24.446534 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Creating image(s)
May 21 02:10:24.446534 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Did not create local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 21 02:10:24.446534 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Ensure instance console log exists: /opt/stack/data/nova/instances/840919c9-6bf6-47ac-bb9c-35ea24494c2e/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:10:24.446534 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:24.446534 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:24.446764 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:24.447251 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Start _get_guest_xml network_info=[{"id": "a8a17868-6e90-432e-b126-c5af5a09ae6b", "address": "fa:16:3e:d1:2c:6c", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a17868-6e", "ovs_interfaceid": "a8a17868-6e90-432e-b126-c5af5a09ae6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2026-05-21T02:10:08Z,direct_url=<?>,disk_format='raw',id=00f5ee93-ecd7-4a41-a40a-795483f1a463,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-200023170',owner='62ebdb16aee84e22a88dfc8960debd32',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2026-05-21T02:10:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903', 'iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f8c00b3-1afb-4240-993e-fddb4a8e3903', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '840919c9-6bf6-47ac-bb9c-35ea24494c2e', 'attached_at': '', 'detached_at': '', 'volume_id': '2f8c00b3-1afb-4240-993e-fddb4a8e3903', 'serial': '2f8c00b3-1afb-4240-993e-fddb4a8e3903'}, 'delete_on_termination': True, 'attachment_id': '5ec29bf6-aa6e-44cc-9f1d-3503d6f953f7', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:10:24.458579 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:10:24.459919 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-image-snapshot-server-998070334', uuid='840919c9-6bf6-47ac-bb9c-35ea24494c2e'), owner=OwnerMeta(userid='4878b5a5bf184852a9ce383caa1c67a4', username='tempest-TestVolumeBootPattern-1995806391-project-member', projectid='62ebdb16aee84e22a88dfc8960debd32', projectname='tempest-TestVolumeBootPattern-1995806391'), image=ImageMeta(id='00f5ee93-ecd7-4a41-a40a-795483f1a463', name=None, container_format='bare', disk_format='raw', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio', 'img_bdm_v2': True, 'img_root_device_name': '/dev/vda'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a8a17868-6e90-432e-b126-c5af5a09ae6b", "address": "fa:16:3e:d1:2c:6c", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a17868-6e", "ovs_interfaceid": "a8a17868-6e90-432e-b126-c5af5a09ae6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329424.4594529) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:10:24.462487 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:10:24.462803 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:10:24.463794 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:10:24.463985 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:10:24.464881 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:10:24.465231 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2026-05-21T02:10:08Z,direct_url=<?>,disk_format='raw',id=00f5ee93-ecd7-4a41-a40a-795483f1a463,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-200023170',owner='62ebdb16aee84e22a88dfc8960debd32',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2026-05-21T02:10:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:10:24.465386 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:10:24.465558 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:10:24.465786 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:10:24.465878 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:10:24.466034 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:10:24.466226 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:10:24.466443 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:10:24.466684 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:10:24.466814 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:10:24.466970 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:10:24.480332 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:10:24.480748 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903', 'iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f8c00b3-1afb-4240-993e-fddb4a8e3903', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:10:24.480916 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:10:24.602836 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:10:24.603184 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329424.6029437, 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:10:24.603359 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] VM Resumed (Lifecycle Event)
May 21 02:10:24.853955 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:10:24.854452 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:10:24.855066 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:10:24.855418 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:10:24.856005 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:10:24.856518 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:10:24.862409 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Releasing lock "refresh_cache-3767becb-caf4-47ee-904f-112069ee8dba" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:10:24.862823 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Instance network_info: |[{"id": "ad59f56d-4c95-4f01-8318-98360ae0fe9a", "address": "fa:16:3e:0b:89:15", "network": {"id": "b32cfb32-7b1e-4cc7-b35b-a86447f00a8a", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-397130825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "549d365926ce49efa4c4bf50c7bbbbaa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad59f56d-4c", "ovs_interfaceid": "ad59f56d-4c95-4f01-8318-98360ae0fe9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:10:24.864345 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Start _get_guest_xml network_info=[{"id": "ad59f56d-4c95-4f01-8318-98360ae0fe9a", "address": "fa:16:3e:0b:89:15", "network": {"id": "b32cfb32-7b1e-4cc7-b35b-a86447f00a8a", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-397130825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "549d365926ce49efa4c4bf50c7bbbbaa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad59f56d-4c", "ovs_interfaceid": "ad59f56d-4c95-4f01-8318-98360ae0fe9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:10:24.866817 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:10:24.867870 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-VolumesBackupsTest-instance-603958284', uuid='3767becb-caf4-47ee-904f-112069ee8dba'), owner=OwnerMeta(userid='09298d250fae40f1adea3cae800dd569', username='tempest-VolumesBackupsTest-958095449-project-member', projectid='549d365926ce49efa4c4bf50c7bbbbaa', projectname='tempest-VolumesBackupsTest-958095449'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ad59f56d-4c95-4f01-8318-98360ae0fe9a", "address": "fa:16:3e:0b:89:15", "network": {"id": "b32cfb32-7b1e-4cc7-b35b-a86447f00a8a", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-397130825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "549d365926ce49efa4c4bf50c7bbbbaa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad59f56d-4c", "ovs_interfaceid": "ad59f56d-4c95-4f01-8318-98360ae0fe9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329424.8675485) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:10:24.869281 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:10:24.869690 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:10:24.870857 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:10:24.870964 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:10:24.871889 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:10:24.872267 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:10:24.872442 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:10:24.872567 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:10:24.872738 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:10:24.872805 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:10:24.872896 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:10:24.873066 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:10:24.873125 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:10:24.873212 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:10:24.873306 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:10:24.873410 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:10:24.883192 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:10:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-603958284',display_name='tempest-VolumesBackupsTest-instance-603958284',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumesbackupstest-instance-603958284',id=70,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcMaSezxAnMN9aofKRkvyGEx7twQaGovCL/qkU9m3Mh/orSqA5mCm20sOvFR1OnAZ9lhJSfg6gTjaWGvxoU4NdN1BvCeaj/fAatr/pvLSc/cZbhud9JkvhZU1k1c+to7w==',key_name='tempest-keypair-758588982',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='549d365926ce49efa4c4bf50c7bbbbaa',ramdisk_id='',reservation_id='r-zq044hm3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-958095449',owner_user_name='tempest-VolumesBackupsTest-958095449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:10:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09298d250fae40f1adea3cae800dd569',uuid=3767becb-caf4-47ee-904f-112069ee8dba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad59f56d-4c95-4f01-8318-98360ae0fe9a", "address": "fa:16:3e:0b:89:15", "network": {"id": "b32cfb32-7b1e-4cc7-b35b-a86447f00a8a", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-397130825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "549d365926ce49efa4c4bf50c7bbbbaa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad59f56d-4c", "ovs_interfaceid": "ad59f56d-4c95-4f01-8318-98360ae0fe9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:10:24.883502 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Converting VIF {"id": "ad59f56d-4c95-4f01-8318-98360ae0fe9a", "address": "fa:16:3e:0b:89:15", "network": {"id": "b32cfb32-7b1e-4cc7-b35b-a86447f00a8a", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-397130825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "549d365926ce49efa4c4bf50c7bbbbaa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad59f56d-4c", "ovs_interfaceid": "ad59f56d-4c95-4f01-8318-98360ae0fe9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:10:24.884021 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:89:15,bridge_name='br-int',has_traffic_filtering=True,id=ad59f56d-4c95-4f01-8318-98360ae0fe9a,network=Network(b32cfb32-7b1e-4cc7-b35b-a86447f00a8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad59f56d-4c') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:10:24.884599 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lazy-loading 'pci_devices' on Instance uuid 3767becb-caf4-47ee-904f-112069ee8dba {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:10:25.105696 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:10:25.108903 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:10:25.362667 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Took 8.49 seconds to spawn the instance on the hypervisor.
May 21 02:10:25.362802 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:10:25.389344 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] End _get_guest_xml xml=<domain type="qemu">
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:   <uuid>3767becb-caf4-47ee-904f-112069ee8dba</uuid>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:   <name>instance-00000046</name>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:       <nova:name>tempest-VolumesBackupsTest-instance-603958284</nova:name>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:10:24</nova:creationTime>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:         <nova:user uuid="09298d250fae40f1adea3cae800dd569">tempest-VolumesBackupsTest-958095449-project-member</nova:user>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:         <nova:project uuid="549d365926ce49efa4c4bf50c7bbbbaa">tempest-VolumesBackupsTest-958095449</nova:project>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:         <nova:port uuid="ad59f56d-4c95-4f01-8318-98360ae0fe9a">
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:     <system>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:       <entry name="serial">3767becb-caf4-47ee-904f-112069ee8dba</entry>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:       <entry name="uuid">3767becb-caf4-47ee-904f-112069ee8dba</entry>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:     </system>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:   <os>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:   </os>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:   <features>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:   </features>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:   <devices>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/3767becb-caf4-47ee-904f-112069ee8dba/disk"/>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:     </disk>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/3767becb-caf4-47ee-904f-112069ee8dba/disk.config"/>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:     </disk>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:0b:89:15"/>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:       <target dev="tapad59f56d-4c"/>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:     </interface>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/3767becb-caf4-47ee-904f-112069ee8dba/console.log" append="off"/>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:     </serial>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:     <video>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:     </video>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:     </rng>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:   </devices>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]: </domain>
May 21 02:10:25.389344 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:10:25.389344 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Preparing to wait for external event network-vif-plugged-ad59f56d-4c95-4f01-8318-98360ae0fe9a {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:10:25.389344 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Acquiring lock "3767becb-caf4-47ee-904f-112069ee8dba-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:25.389344 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "3767becb-caf4-47ee-904f-112069ee8dba-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:25.389344 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "3767becb-caf4-47ee-904f-112069ee8dba-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:25.389344 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:10:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-603958284',display_name='tempest-VolumesBackupsTest-instance-603958284',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumesbackupstest-instance-603958284',id=70,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcMaSezxAnMN9aofKRkvyGEx7twQaGovCL/qkU9m3Mh/orSqA5mCm20sOvFR1OnAZ9lhJSfg6gTjaWGvxoU4NdN1BvCeaj/fAatr/pvLSc/cZbhud9JkvhZU1k1c+to7w==',key_name='tempest-keypair-758588982',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='549d365926ce49efa4c4bf50c7bbbbaa',ramdisk_id='',reservation_id='r-zq044hm3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-958095449',owner_user_name='tempest-VolumesBackupsTest-958095449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:10:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09298d250fae40f1adea3cae800dd569',uuid=3767becb-caf4-47ee-904f-112069ee8dba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad59f56d-4c95-4f01-8318-98360ae0fe9a", "address": "fa:16:3e:0b:89:15", "network": {"id": "b32cfb32-7b1e-4cc7-b35b-a86447f00a8a", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-397130825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "549d365926ce49efa4c4bf50c7bbbbaa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad59f56d-4c", "ovs_interfaceid": "ad59f56d-4c95-4f01-8318-98360ae0fe9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:10:25.389344 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Converting VIF {"id": "ad59f56d-4c95-4f01-8318-98360ae0fe9a", "address": "fa:16:3e:0b:89:15", "network": {"id": "b32cfb32-7b1e-4cc7-b35b-a86447f00a8a", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-397130825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "549d365926ce49efa4c4bf50c7bbbbaa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad59f56d-4c", "ovs_interfaceid": "ad59f56d-4c95-4f01-8318-98360ae0fe9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:10:25.389344 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:89:15,bridge_name='br-int',has_traffic_filtering=True,id=ad59f56d-4c95-4f01-8318-98360ae0fe9a,network=Network(b32cfb32-7b1e-4cc7-b35b-a86447f00a8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad59f56d-4c') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:10:25.389344 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:89:15,bridge_name='br-int',has_traffic_filtering=True,id=ad59f56d-4c95-4f01-8318-98360ae0fe9a,network=Network(b32cfb32-7b1e-4cc7-b35b-a86447f00a8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad59f56d-4c') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:10:25.392135 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:25.392562 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:10:25.392862 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:10:25.393923 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:25.394056 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e4d7eca4-3015-5234-8f94-7b3a4c810d86', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:10:25.409355 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:25.409355 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:10:25.411753 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:25.411945 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad59f56d-4c, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:10:25.412320 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapad59f56d-4c, col_values=(('qos', UUID('869de088-9bf1-4c13-9f88-6c2c51c08887')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:10:25.412500 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapad59f56d-4c, col_values=(('external_ids', {'iface-id': 'ad59f56d-4c95-4f01-8318-98360ae0fe9a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:89:15', 'vm-uuid': '3767becb-caf4-47ee-904f-112069ee8dba'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:10:25.413205 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:25.414288 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:10:25.419109 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:25.420431 np0000001127 nova-compute[98206]: INFO os_vif [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:89:15,bridge_name='br-int',has_traffic_filtering=True,id=ad59f56d-4c95-4f01-8318-98360ae0fe9a,network=Network(b32cfb32-7b1e-4cc7-b35b-a86447f00a8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad59f56d-4c')
May 21 02:10:25.611047 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:10:25.871557 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Took 14.36 seconds to build instance.
May 21 02:10:26.373098 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "02fd9da8-f514-4e1b-8bd5-bfc8ae21753c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.871s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:26.909760 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:26.935921 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:10:26.936031 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:10:26.936182 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] No VIF found with MAC fa:16:3e:0b:89:15, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:10:26.936717 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Using config drive
May 21 02:10:27.355707 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-49ea7513-a272-451f-90c6-6b23f1f4f96f req-26786d12-9c04-4fd1-b63b-02b5e8ae1411 service nova] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Received event network-changed-73cedad7-cb27-466f-9b50-2f39f6ce0275 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:10:27.356076 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-49ea7513-a272-451f-90c6-6b23f1f4f96f req-26786d12-9c04-4fd1-b63b-02b5e8ae1411 service nova] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Refreshing instance network info cache due to event network-changed-73cedad7-cb27-466f-9b50-2f39f6ce0275. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:10:27.356148 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-49ea7513-a272-451f-90c6-6b23f1f4f96f req-26786d12-9c04-4fd1-b63b-02b5e8ae1411 service nova] Acquiring lock "refresh_cache-02fd9da8-f514-4e1b-8bd5-bfc8ae21753c" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:10:27.356269 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-49ea7513-a272-451f-90c6-6b23f1f4f96f req-26786d12-9c04-4fd1-b63b-02b5e8ae1411 service nova] Acquired lock "refresh_cache-02fd9da8-f514-4e1b-8bd5-bfc8ae21753c" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:10:27.356335 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-49ea7513-a272-451f-90c6-6b23f1f4f96f req-26786d12-9c04-4fd1-b63b-02b5e8ae1411 service nova] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Refreshing network info cache for port 73cedad7-cb27-466f-9b50-2f39f6ce0275 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:10:27.444372 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:10:27.577162 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Creating config drive at /opt/stack/data/nova/instances/3767becb-caf4-47ee-904f-112069ee8dba/disk.config
May 21 02:10:27.581160 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3767becb-caf4-47ee-904f-112069ee8dba/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzudesih6 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:10:27.657291 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3767becb-caf4-47ee-904f-112069ee8dba/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzudesih6" returned: 0 in 0.076s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:10:27.861448 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-49ea7513-a272-451f-90c6-6b23f1f4f96f req-26786d12-9c04-4fd1-b63b-02b5e8ae1411 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:10:28.098194 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:28.132244 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:28.195240 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-49ea7513-a272-451f-90c6-6b23f1f4f96f req-26786d12-9c04-4fd1-b63b-02b5e8ae1411 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:10:28.216433 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:28.309690 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2e98a7b1-2355-4d3d-b02a-9bf56f5b63c3 req-ab90cd96-9324-4bbd-937c-f86be69b2720 service nova] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Received event network-vif-plugged-ad59f56d-4c95-4f01-8318-98360ae0fe9a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:10:28.309924 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2e98a7b1-2355-4d3d-b02a-9bf56f5b63c3 req-ab90cd96-9324-4bbd-937c-f86be69b2720 service nova] Acquiring lock "3767becb-caf4-47ee-904f-112069ee8dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:28.310125 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2e98a7b1-2355-4d3d-b02a-9bf56f5b63c3 req-ab90cd96-9324-4bbd-937c-f86be69b2720 service nova] Lock "3767becb-caf4-47ee-904f-112069ee8dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:28.310292 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2e98a7b1-2355-4d3d-b02a-9bf56f5b63c3 req-ab90cd96-9324-4bbd-937c-f86be69b2720 service nova] Lock "3767becb-caf4-47ee-904f-112069ee8dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:28.310445 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2e98a7b1-2355-4d3d-b02a-9bf56f5b63c3 req-ab90cd96-9324-4bbd-937c-f86be69b2720 service nova] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Processing event network-vif-plugged-ad59f56d-4c95-4f01-8318-98360ae0fe9a {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:10:28.372275 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-49ea7513-a272-451f-90c6-6b23f1f4f96f req-26786d12-9c04-4fd1-b63b-02b5e8ae1411 service nova] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Updated VIF entry in instance network info cache for port 73cedad7-cb27-466f-9b50-2f39f6ce0275. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:10:28.372773 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-49ea7513-a272-451f-90c6-6b23f1f4f96f req-26786d12-9c04-4fd1-b63b-02b5e8ae1411 service nova] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Updating instance_info_cache with network_info: [{"id": "73cedad7-cb27-466f-9b50-2f39f6ce0275", "address": "fa:16:3e:a1:86:24", "network": {"id": "68132179-7a2d-4b6f-bc7a-da8f937a9fb2", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1224285668-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "517a45856efe44aa92f802f146b17616", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73cedad7-cb", "ovs_interfaceid": "73cedad7-cb27-466f-9b50-2f39f6ce0275", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:10:28.450714 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:28.452801 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:28.457127 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:28.480351 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:28.875694 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-49ea7513-a272-451f-90c6-6b23f1f4f96f req-26786d12-9c04-4fd1-b63b-02b5e8ae1411 service nova] Releasing lock "refresh_cache-02fd9da8-f514-4e1b-8bd5-bfc8ae21753c" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:10:28.917845 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:10:28.918503 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329428.9180853, 3767becb-caf4-47ee-904f-112069ee8dba => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:10:28.918675 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] VM Started (Lifecycle Event)
May 21 02:10:28.921901 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:10:28.924495 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Instance spawned successfully.
May 21 02:10:28.925572 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:10:29.423494 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:10:29.425510 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:10:29.432339 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:10:29.432544 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:10:29.432919 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:10:29.433236 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:10:29.433622 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:10:29.433979 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:10:29.927631 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:10:29.927995 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329429.9277136, 3767becb-caf4-47ee-904f-112069ee8dba => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:10:29.928050 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] VM Paused (Lifecycle Event)
May 21 02:10:29.940865 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Took 6.74 seconds to spawn the instance on the hypervisor.
May 21 02:10:29.941189 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:10:30.413925 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c1943628-05f1-4241-be72-85a43b8f8f88 req-b9434e0d-e953-43e2-a4cb-37b5f7f8558d service nova] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Received event network-vif-plugged-ad59f56d-4c95-4f01-8318-98360ae0fe9a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:10:30.415597 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c1943628-05f1-4241-be72-85a43b8f8f88 req-b9434e0d-e953-43e2-a4cb-37b5f7f8558d service nova] Acquiring lock "3767becb-caf4-47ee-904f-112069ee8dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:30.415597 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c1943628-05f1-4241-be72-85a43b8f8f88 req-b9434e0d-e953-43e2-a4cb-37b5f7f8558d service nova] Lock "3767becb-caf4-47ee-904f-112069ee8dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:30.415597 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c1943628-05f1-4241-be72-85a43b8f8f88 req-b9434e0d-e953-43e2-a4cb-37b5f7f8558d service nova] Lock "3767becb-caf4-47ee-904f-112069ee8dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:30.415597 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c1943628-05f1-4241-be72-85a43b8f8f88 req-b9434e0d-e953-43e2-a4cb-37b5f7f8558d service nova] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] No waiting events found dispatching network-vif-plugged-ad59f56d-4c95-4f01-8318-98360ae0fe9a {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:10:30.415597 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-c1943628-05f1-4241-be72-85a43b8f8f88 req-b9434e0d-e953-43e2-a4cb-37b5f7f8558d service nova] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Received unexpected event network-vif-plugged-ad59f56d-4c95-4f01-8318-98360ae0fe9a for instance with vm_state active and task_state None.
May 21 02:10:30.415597 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:30.430463 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:10:30.432746 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329430.432489, 3767becb-caf4-47ee-904f-112069ee8dba => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:10:30.432911 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] VM Resumed (Lifecycle Event)
May 21 02:10:30.450531 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Took 12.67 seconds to build instance.
May 21 02:10:30.937227 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:10:30.943210 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:10:30.952647 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "3767becb-caf4-47ee-904f-112069ee8dba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.178s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:31.912109 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:32.475875 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d2579cfc-c720-47e8-beff-6a10ac2d69a1 req-889c1b5c-3980-4189-b73a-47b34da372d2 service nova] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Received event network-changed-ad59f56d-4c95-4f01-8318-98360ae0fe9a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:10:32.476332 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d2579cfc-c720-47e8-beff-6a10ac2d69a1 req-889c1b5c-3980-4189-b73a-47b34da372d2 service nova] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Refreshing instance network info cache due to event network-changed-ad59f56d-4c95-4f01-8318-98360ae0fe9a. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:10:32.476332 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d2579cfc-c720-47e8-beff-6a10ac2d69a1 req-889c1b5c-3980-4189-b73a-47b34da372d2 service nova] Acquiring lock "refresh_cache-3767becb-caf4-47ee-904f-112069ee8dba" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:10:32.476332 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d2579cfc-c720-47e8-beff-6a10ac2d69a1 req-889c1b5c-3980-4189-b73a-47b34da372d2 service nova] Acquired lock "refresh_cache-3767becb-caf4-47ee-904f-112069ee8dba" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:10:32.476510 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-d2579cfc-c720-47e8-beff-6a10ac2d69a1 req-889c1b5c-3980-4189-b73a-47b34da372d2 service nova] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Refreshing network info cache for port ad59f56d-4c95-4f01-8318-98360ae0fe9a {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:10:32.754918 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.00045920399998067296 future=<Future at 0x71c05862f9b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:10:32.755334 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Emitting event <LifecycleEvent: 1779329417.7543278, 10c50913-8b08-402c-8ece-87c7521ce785 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:10:32.755548 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:10:32.755751 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] VM Stopped (Lifecycle Event)
May 21 02:10:32.756882 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=3.0848760779999793 future=<Future at 0x71c0a255c6b0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:10:32.757023 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=3.0847014340001806 future=<Future at 0x71c0a255c6b0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:10:32.979055 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-d2579cfc-c720-47e8-beff-6a10ac2d69a1 req-889c1b5c-3980-4189-b73a-47b34da372d2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:10:33.245980 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-d2579cfc-c720-47e8-beff-6a10ac2d69a1 req-889c1b5c-3980-4189-b73a-47b34da372d2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:10:33.258542 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:10:33.260239 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: deleting, current DB power_state: 1, VM power_state: 4 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:10:33.385862 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-d2579cfc-c720-47e8-beff-6a10ac2d69a1 req-889c1b5c-3980-4189-b73a-47b34da372d2 service nova] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Updated VIF entry in instance network info cache for port ad59f56d-4c95-4f01-8318-98360ae0fe9a. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:10:33.386146 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-d2579cfc-c720-47e8-beff-6a10ac2d69a1 req-889c1b5c-3980-4189-b73a-47b34da372d2 service nova] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Updating instance_info_cache with network_info: [{"id": "ad59f56d-4c95-4f01-8318-98360ae0fe9a", "address": "fa:16:3e:0b:89:15", "network": {"id": "b32cfb32-7b1e-4cc7-b35b-a86447f00a8a", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-397130825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "549d365926ce49efa4c4bf50c7bbbbaa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad59f56d-4c", "ovs_interfaceid": "ad59f56d-4c95-4f01-8318-98360ae0fe9a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:10:33.762260 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] During sync_power_state the instance has a pending task (deleting). Skip.
May 21 02:10:33.889307 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d2579cfc-c720-47e8-beff-6a10ac2d69a1 req-889c1b5c-3980-4189-b73a-47b34da372d2 service nova] Releasing lock "refresh_cache-3767becb-caf4-47ee-904f-112069ee8dba" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:10:35.417292 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:35.842968 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0012014499998258543 future=<Future at 0x71c0a255c6b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:10:35.843521 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Emitting event <LifecycleEvent: 1779329420.8416543, 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:10:35.843702 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:10:35.843903 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] VM Stopped (Lifecycle Event)
May 21 02:10:35.845108 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=0.5949714409998705 future=<Future at 0x71c07c5e9c40 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:10:35.845222 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=0.5948413199998868 future=<Future at 0x71c07c5e9c40 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:10:36.346729 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:10:36.349097 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: deleting, current DB power_state: 1, VM power_state: 4 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:10:36.441697 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.001614745000097173 future=<Future at 0x71c07c5e9c40 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:10:36.442268 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Emitting event <LifecycleEvent: 1779329421.439994, eb1c328c-f707-4f0d-90b5-ab5b268bf05a => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:10:36.442384 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] VM Stopped (Lifecycle Event)
May 21 02:10:36.443961 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:10:36.853874 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] During sync_power_state the instance has a pending task (deleting). Skip.
May 21 02:10:36.921445 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:36.945045 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:10:36.947418 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: deleting, current DB power_state: 1, VM power_state: 4 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:10:37.450153 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] During sync_power_state the instance has a pending task (deleting). Skip.
May 21 02:10:40.418216 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:41.933728 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:45.419713 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:46.945236 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:50.421625 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:51.947199 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:52.678112 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:10:52.678296 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 21 02:10:52.678598 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:10:53.676024 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:10:53.676574 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:10:54.182122 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:54.182122 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:54.182122 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:54.182122 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Auditing locally available compute resources for np0000001127 (node: np0000001127) {{(pid=98206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 21 02:10:55.223917 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:10:55.317511 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:10:55.317966 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:10:55.405489 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:10:55.410280 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02fd9da8-f514-4e1b-8bd5-bfc8ae21753c/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:10:55.426161 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:55.497119 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02fd9da8-f514-4e1b-8bd5-bfc8ae21753c/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:10:55.497628 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02fd9da8-f514-4e1b-8bd5-bfc8ae21753c/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:10:55.594496 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02fd9da8-f514-4e1b-8bd5-bfc8ae21753c/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:10:55.599157 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:10:55.600603 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:10:55.603107 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:10:55.692140 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:10:55.692762 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:10:55.781923 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:10:55.782328 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-11 (vdb) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:10:55.782438 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-7 (vdc) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:10:55.782546 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-12 (vdd) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:10:55.786773 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c50913-8b08-402c-8ece-87c7521ce785/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:10:55.876116 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c50913-8b08-402c-8ece-87c7521ce785/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:10:55.876665 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c50913-8b08-402c-8ece-87c7521ce785/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:10:55.968701 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c50913-8b08-402c-8ece-87c7521ce785/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:10:55.973944 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:10:56.067990 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:10:56.068606 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:10:56.165549 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:10:56.171594 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:10:56.173379 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6df4554-8490-4d5a-9d4d-acfd46419cb3/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:10:56.268167 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6df4554-8490-4d5a-9d4d-acfd46419cb3/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:10:56.269974 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6df4554-8490-4d5a-9d4d-acfd46419cb3/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:10:56.360748 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6df4554-8490-4d5a-9d4d-acfd46419cb3/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:10:56.366614 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c15c9f3-e0d2-4d6d-9144-b9760c55be0e/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:10:56.458696 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c15c9f3-e0d2-4d6d-9144-b9760c55be0e/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:10:56.459311 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c15c9f3-e0d2-4d6d-9144-b9760c55be0e/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:10:56.556612 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c15c9f3-e0d2-4d6d-9144-b9760c55be0e/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:10:56.557275 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-13 (vdb) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:10:56.561217 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:10:56.661771 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:10:56.662271 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:10:56.761570 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:10:56.766980 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-8 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:10:56.768566 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3767becb-caf4-47ee-904f-112069ee8dba/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:10:56.881686 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3767becb-caf4-47ee-904f-112069ee8dba/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:10:56.882154 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3767becb-caf4-47ee-904f-112069ee8dba/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:10:56.903814 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Acquiring lock "3767becb-caf4-47ee-904f-112069ee8dba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:56.904145 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "3767becb-caf4-47ee-904f-112069ee8dba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:56.948759 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:10:56.973829 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3767becb-caf4-47ee-904f-112069ee8dba/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:10:56.978126 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:10:56.978975 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:10:57.025604 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "env LANG=C uptime" returned: 0 in 0.046s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:10:57.025937 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Hypervisor/Node resource view: name=np0000001127 free_ram=10879MB free_disk=72.71209716796875GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 21 02:10:57.026102 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:57.026394 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:57.410511 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lazy-loading 'flavor' on Instance uuid 3767becb-caf4-47ee-904f-112069ee8dba {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:10:57.913180 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Ignoring supplied device name: /dev/vdb
May 21 02:10:58.086550 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 6ccaedfe-bec9-4591-b845-acf0cc81d026 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:10:58.086669 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 16a0cc8d-c65b-4166-ad1a-5318b18ed00e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:10:58.086815 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance b6df4554-8490-4d5a-9d4d-acfd46419cb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:10:58.086910 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:10:58.086983 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance aa3f5a78-fb82-4e21-8ebf-90bf48a122be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:10:58.087062 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance c76064e6-3702-4e67-9d4f-ef67cd4b7b22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:10:58.087137 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:10:58.087232 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 10c50913-8b08-402c-8ece-87c7521ce785 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:10:58.087308 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance cec9e114-b934-4de6-b0f0-586cd34a59bd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:10:58.087382 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:10:58.087457 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance eb1c328c-f707-4f0d-90b5-ab5b268bf05a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:10:58.087585 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:10:58.087660 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 840919c9-6bf6-47ac-bb9c-35ea24494c2e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:10:58.087735 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 3767becb-caf4-47ee-904f-112069ee8dba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:10:58.087921 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 21 02:10:58.088031 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Final resource view: name=np0000001127 phys_ram=24030MB used_ram=3328MB phys_disk=95GB used_disk=9GB total_vcpus=12 used_vcpus=14 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:10:57 up 41 min,  2 users,  load average: 6.21, 8.43, 6.26\n', 'num_instances': '14', 'num_vm_active': '13', 'num_task_None': '10', 'num_os_type_None': '14', 'num_proj_848912b0c0e94d2795bb2332daf1730e': '6', 'io_workload': '1', 'num_proj_4ae2ef74a1614eb09e4f71f709f64126': '2', 'num_proj_7c062763c08b4e5190a5351babe96c84': '1', 'num_task_deleting': '3', 'num_proj_62ebdb16aee84e22a88dfc8960debd32': '2', 'num_proj_1646ca3e5bf3425ca0bd66c5a50c996b': '1', 'num_proj_517a45856efe44aa92f802f146b17616': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_549d365926ce49efa4c4bf50c7bbbbaa': '1'} {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 21 02:10:58.415491 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "3767becb-caf4-47ee-904f-112069ee8dba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:58.667127 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:10:58.667488 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:10:59.170699 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:10:59.487343 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Acquiring lock "3767becb-caf4-47ee-904f-112069ee8dba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:10:59.487836 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "3767becb-caf4-47ee-904f-112069ee8dba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:10:59.487836 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Attaching volume 25afd690-442e-4fa0-ac9b-3d9a82c6403f to /dev/vdb
May 21 02:10:59.546036 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:10:59.556492 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:10:59.575347 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:10:59.616348 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:10:59.616645 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:10:59.624201 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:10:59.627048 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe20:ae96', 'fe80::fc16:3eff:fe5c:a90d', 'fe80::786b:86ff:fe32:8f96', 'fe80::fc16:3eff:fe30:164f', 'fe80::c44d:25ff:fe10:25cb', 'fe80::fc16:3eff:fea1:8624', 'fe80::582b:67ff:fe35:1299', 'fe80::fc16:3eff:fe0b:8915', 'fe80::7ca5:4ff:fee7:fb0a', 'fe80::fc16:3eff:fe0f:28a1', 'fe80::440a:38ff:fe27:fa24', 'fe80::fc16:3eff:fefb:4d96', 'fe80::fc16:3eff:fe65:6557', 'fe80::fc16:3eff:feb8:d101', 'fe80::7045:30ff:fe1a:b99f', 'fe80::fc16:3eff:fedb:8dd'] 
May 21 02:10:59.627166 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:10:59.627314 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:10:59.627576 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] <== get_connector_properties: return (80ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:10:59.627838 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Updating existing volume attachment record: 206d869f-c2f0-4384-b1fb-dbc0a74f2eb5 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:10:59.677097 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Compute_service record updated for np0000001127:np0000001127 {{(pid=98206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 21 02:10:59.677339 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.651s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:10:59.677674 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.87 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:11:00.175274 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:11:00.175608 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f', 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '25afd690-442e-4fa0-ac9b-3d9a82c6403f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:11:00.175747 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:11:00.429099 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:01.552744 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:11:01.553207 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:11:01.553259 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:11:01.553454 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:11:01.553626 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:11:01.553791 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:11:01.554054 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 51.12 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:11:01.950424 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:03.790227 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "02fd9da8-f514-4e1b-8bd5-bfc8ae21753c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:03.790716 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "02fd9da8-f514-4e1b-8bd5-bfc8ae21753c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:04.294581 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lazy-loading 'flavor' on Instance uuid 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:11:05.180149 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:11:05.300690 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "02fd9da8-f514-4e1b-8bd5-bfc8ae21753c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:05.432747 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:06.394160 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "02fd9da8-f514-4e1b-8bd5-bfc8ae21753c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:06.394608 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "02fd9da8-f514-4e1b-8bd5-bfc8ae21753c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:06.394608 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Attaching volume f33552f3-023a-4c38-89b4-db5ba0c2c687 to /dev/vdb
May 21 02:11:06.434227 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:11:06.446247 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:11:06.468729 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:11:06.514017 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:11:06.514294 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:11:06.523135 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:11:06.524637 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe20:ae96', 'fe80::fc16:3eff:fe5c:a90d', 'fe80::786b:86ff:fe32:8f96', 'fe80::fc16:3eff:fe30:164f', 'fe80::c44d:25ff:fe10:25cb', 'fe80::fc16:3eff:fea1:8624', 'fe80::582b:67ff:fe35:1299', 'fe80::fc16:3eff:fe0b:8915', 'fe80::7ca5:4ff:fee7:fb0a', 'fe80::fc16:3eff:fe0f:28a1', 'fe80::440a:38ff:fe27:fa24', 'fe80::fc16:3eff:fefb:4d96', 'fe80::fc16:3eff:fe65:6557', 'fe80::fc16:3eff:feb8:d101', 'fe80::7045:30ff:fe1a:b99f', 'fe80::fc16:3eff:fedb:8dd'] 
May 21 02:11:06.524750 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:11:06.524831 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:11:06.525030 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] <== get_connector_properties: return (90ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:11:06.525309 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Updating existing volume attachment record: 174b3dd5-b839-4deb-a353-0cdbef0487be {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:11:06.952341 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:07.096332 np0000001127 nova-compute[98206]: DEBUG os_brick.encryptors [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687', 'iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f33552f3-023a-4c38-89b4-db5ba0c2c687', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '02fd9da8-f514-4e1b-8bd5-bfc8ae21753c', 'attached_at': '', 'detached_at': '', 'volume_id': 'f33552f3-023a-4c38-89b4-db5ba0c2c687', 'serial': 'f33552f3-023a-4c38-89b4-db5ba0c2c687'} {{(pid=98206) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 21 02:11:07.099561 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:11:07.099873 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687', 'iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f33552f3-023a-4c38-89b4-db5ba0c2c687', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:11:07.099998 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:11:10.436021 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:15.437243 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:17.110922 np0000001127 nova-compute[98206]: WARNING os_brick.exception [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Flushing 330000000b8ca6778 failed: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 21 02:11:17.111370 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Remove SCSI device /dev/sdq with /sys/block/sdq/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:11:17.155879 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Remove SCSI device /dev/sdp with /sys/block/sdp/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:11:17.211802 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Checking to see if SCSI volumes sdq, sdp have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:11:17.211988 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] SCSI volumes sdq, sdp have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:11:17.213714 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Checking to see if device paths {'sdq', 'sdp'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:11:17.224785 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Device paths {'sdq', 'sdp'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:11:17.224983 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:11:17.237287 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:17.283587 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 140, target: iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515, portal: 192.168.40.100,3260]
May 21 02:11:17.283587 np0000001127 nova-compute[98206]: Logout of [sid: 140, target: iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515, portal: 192.168.40.100,3260] successful.
May 21 02:11:17.283587 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:17.309130 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:17.320762 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:17.367134 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 141, target: iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515, portal: 192.168.50.100,3260]
May 21 02:11:17.367134 np0000001127 nova-compute[98206]: Logout of [sid: 141, target: iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515, portal: 192.168.50.100,3260] successful.
May 21 02:11:17.367134 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:17.394005 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:17.394140 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Removing multipath device map 330000000b8ca6778 to stop multipathd from monitoring the device. {{(pid=98206) _cleanup_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1009}}
May 21 02:11:17.394351 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Multipath 330000000b8ca6778 no longer present {{(pid=98206) multipath_del_map /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:894}}
May 21 02:11:17.394575 np0000001127 nova-compute[98206]: WARNING os_brick.initiator.connectors.iscsi [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] There were errors removing {'sdq', 'sdp'}, leftovers may remain in the system
May 21 02:11:17.394799 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 60.376s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:11:17.396901 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] <== disconnect_volume: exception (60387ms)
May 21 02:11:17.396901 np0000001127 nova-compute[98206]: Chained Exception #1
May 21 02:11:17.396901 np0000001127 nova-compute[98206]:         Traceback (most recent call last):
May 21 02:11:17.396901 np0000001127 nova-compute[98206]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py", line 396, in remove_connection
May 21 02:11:17.396901 np0000001127 nova-compute[98206]:             self.flush_multipath_device(multipath_name)
May 21 02:11:17.396901 np0000001127 nova-compute[98206]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py", line 475, in flush_multipath_device
May 21 02:11:17.396901 np0000001127 nova-compute[98206]:             self._execute('multipath', '-f', device_map_name, run_as_root=True,
May 21 02:11:17.396901 np0000001127 nova-compute[98206]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/os_brick/executor.py", line 53, in _execute
May 21 02:11:17.396901 np0000001127 nova-compute[98206]:             result = self.__execute(*args, **kwargs)
May 21 02:11:17.396901 np0000001127 nova-compute[98206]:                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 21 02:11:17.396901 np0000001127 nova-compute[98206]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 173, in execute
May 21 02:11:17.396901 np0000001127 nova-compute[98206]:             return execute_root(*cmd, **kwargs)
May 21 02:11:17.396901 np0000001127 nova-compute[98206]:                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 21 02:11:17.396901 np0000001127 nova-compute[98206]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 315, in _wrap
May 21 02:11:17.396901 np0000001127 nova-compute[98206]:             return self.channel.remote_call(name, args, kwargs, r_call_timeout)
May 21 02:11:17.396901 np0000001127 nova-compute[98206]:                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 21 02:11:17.396901 np0000001127 nova-compute[98206]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 266, in remote_call
May 21 02:11:17.396901 np0000001127 nova-compute[98206]:             raise exc_type(*result[2])
May 21 02:11:17.396901 np0000001127 nova-compute[98206]:         oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 21 02:11:17.396901 np0000001127 nova-compute[98206]:         Command: multipath -f 330000000b8ca6778
May 21 02:11:17.396901 np0000001127 nova-compute[98206]:         Exit code: 1
May 21 02:11:17.396901 np0000001127 nova-compute[98206]:         Stdout: ''
May 21 02:11:17.396901 np0000001127 nova-compute[98206]:         Stderr: '2472.476495 | 330000000b8ca6778: map in use\n'
May 21 02:11:17.396901 np0000001127 nova-compute[98206]:          {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:188}}
May 21 02:11:17.397513 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 56.871s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:11:17.397646 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Ignoring Volume Error on vol f5dc8530-4090-49a6-897f-ad627f9d7515 during delete
May 21 02:11:17.397646 np0000001127 nova-compute[98206]: Chained Exception #1
May 21 02:11:17.397646 np0000001127 nova-compute[98206]:         Traceback (most recent call last):
May 21 02:11:17.397646 np0000001127 nova-compute[98206]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py", line 396, in remove_connection
May 21 02:11:17.397646 np0000001127 nova-compute[98206]:             self.flush_multipath_device(multipath_name)
May 21 02:11:17.397646 np0000001127 nova-compute[98206]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py", line 475, in flush_multipath_device
May 21 02:11:17.397646 np0000001127 nova-compute[98206]:             self._execute('multipath', '-f', device_map_name, run_as_root=True,
May 21 02:11:17.397646 np0000001127 nova-compute[98206]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/os_brick/executor.py", line 53, in _execute
May 21 02:11:17.397646 np0000001127 nova-compute[98206]:             result = self.__execute(*args, **kwargs)
May 21 02:11:17.397646 np0000001127 nova-compute[98206]:                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 21 02:11:17.397646 np0000001127 nova-compute[98206]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 173, in execute
May 21 02:11:17.397646 np0000001127 nova-compute[98206]:             return execute_root(*cmd, **kwargs)
May 21 02:11:17.397646 np0000001127 nova-compute[98206]:                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 21 02:11:17.397646 np0000001127 nova-compute[98206]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 315, in _wrap
May 21 02:11:17.397646 np0000001127 nova-compute[98206]:             return self.channel.remote_call(name, args, kwargs, r_call_timeout)
May 21 02:11:17.397646 np0000001127 nova-compute[98206]:                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 21 02:11:17.397646 np0000001127 nova-compute[98206]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 266, in remote_call
May 21 02:11:17.397646 np0000001127 nova-compute[98206]:             raise exc_type(*result[2])
May 21 02:11:17.397646 np0000001127 nova-compute[98206]:         oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 21 02:11:17.397646 np0000001127 nova-compute[98206]:         Command: multipath -f 330000000b8ca6778
May 21 02:11:17.397646 np0000001127 nova-compute[98206]:         Exit code: 1
May 21 02:11:17.397646 np0000001127 nova-compute[98206]:         Stdout: ''
May 21 02:11:17.397646 np0000001127 nova-compute[98206]:         Stderr: '2472.476495 | 330000000b8ca6778: map in use\n'
May 21 02:11:17.397646 np0000001127 nova-compute[98206]:         : os_brick.exception.ExceptionChainer:
May 21 02:11:17.398307 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c', 'iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ca0f98f5-6310-483f-ab8f-43913cc3338c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-16'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:11:17.398307 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:11:17.398484 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Deleting instance files /opt/stack/data/nova/instances/10c50913-8b08-402c-8ece-87c7521ce785_del
May 21 02:11:17.399166 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Deletion of /opt/stack/data/nova/instances/10c50913-8b08-402c-8ece-87c7521ce785_del complete
May 21 02:11:17.429733 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:17.429733 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:17.429733 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:17.429733 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:17.429733 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:17.429733 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:17.429733 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:11:17.429733 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:11:17.429733 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:17.429733 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:17.429733 np0000001127 nova-compute[98206]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48 (non-flash)
May 21 02:11:17.429733 np0000001127 nova-compute[98206]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48 (non-flash)
May 21 02:11:17.429733 np0000001127 nova-compute[98206]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c (non-flash)
May 21 02:11:17.429733 np0000001127 nova-compute[98206]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c (non-flash)
May 21 02:11:17.429733 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:17.429733 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:17.429733 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:11:17.430324 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsi session list stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:17.430324 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:17.430324 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:17.430324 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:17.430324 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:17.430324 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:17.430324 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:11:17.430324 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:11:17.430324 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:17.430324 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:17.430324 np0000001127 nova-compute[98206]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48 (non-flash)
May 21 02:11:17.430324 np0000001127 nova-compute[98206]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48 (non-flash)
May 21 02:11:17.430324 np0000001127 nova-compute[98206]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c (non-flash)
May 21 02:11:17.430324 np0000001127 nova-compute[98206]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c (non-flash)
May 21 02:11:17.430324 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:17.430324 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:17.430324 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:11:17.430324 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', '132'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', '133'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', '134'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', '135'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', '144'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', '145'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a', '147'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a', '148'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43', '154'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43', '155'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48', '156'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48', '157'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c', '158'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c', '159'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '95')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:11:17.430324 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c', '158')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:11:17.431616 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c', '159')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:11:17.432688 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c5074c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c'): ({'sds'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:11:17.432897 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Removing multipathed devices sds, sdf {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:11:17.433113 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Flush multipath device 33000000082c27a30 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:11:17.466994 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Remove SCSI device /dev/sds with /sys/block/sds/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:11:17.517953 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:11:17.561069 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Checking to see if SCSI volumes sds, sdf have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:11:17.561290 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] SCSI volumes sds, sdf have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:11:17.563644 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Checking to see if device paths {'sds', 'sdf'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:11:17.576904 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Device paths {'sds', 'sdf'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:11:17.577144 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:11:17.588886 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:17.628419 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 158, target: iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c, portal: 192.168.40.100,3260]
May 21 02:11:17.628419 np0000001127 nova-compute[98206]: Logout of [sid: 158, target: iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c, portal: 192.168.40.100,3260] successful.
May 21 02:11:17.628419 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:17.652827 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:17.666490 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:17.712633 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 159, target: iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c, portal: 192.168.50.100,3260]
May 21 02:11:17.712633 np0000001127 nova-compute[98206]: Logout of [sid: 159, target: iqn.2023-03.storpool.com:os--volume-ca0f98f5-6310-483f-ab8f-43913cc3338c, portal: 192.168.50.100,3260] successful.
May 21 02:11:17.712633 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:17.734877 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:17.735158 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:11:17.735288 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] <== disconnect_volume: return (57210ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:11:17.735405 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:11:17.735977 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 56.353s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:11:17.736296 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a', 'iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '61affb01-e1ac-45d2-938c-e506a523047a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:11:17.736432 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:11:17.767302 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:17.767302 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:17.767302 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:17.767302 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:17.767302 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:17.767302 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:17.767302 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:11:17.767302 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:11:17.767302 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:17.767302 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:17.767302 np0000001127 nova-compute[98206]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48 (non-flash)
May 21 02:11:17.767302 np0000001127 nova-compute[98206]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48 (non-flash)
May 21 02:11:17.767302 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:17.767302 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:17.767302 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:11:17.767669 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] iscsi session list stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:17.767669 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:17.767669 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:17.767669 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:17.767669 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:17.767669 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:17.767669 np0000001127 nova-compute[98206]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:11:17.767669 np0000001127 nova-compute[98206]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a (non-flash)
May 21 02:11:17.767669 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:17.767669 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:17.767669 np0000001127 nova-compute[98206]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48 (non-flash)
May 21 02:11:17.767669 np0000001127 nova-compute[98206]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48 (non-flash)
May 21 02:11:17.767669 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:17.767669 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:17.767669 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:11:17.768042 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', '132'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', '133'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', '134'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', '135'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', '144'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', '145'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a', '147'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a', '148'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43', '154'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43', '155'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48', '156'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48', '157'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '95')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:11:17.768042 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a', '147')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:11:17.769206 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a', '148')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:11:17.770377 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c505f80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a'): ({'sdl'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:11:17.770666 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Removing multipathed devices sdg, sdl {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:11:17.770925 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Flush multipath device 3300000008c5a8f96 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:11:17.832608 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:11:17.872230 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:11:17.906775 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Took 61.83 seconds to destroy the instance on the hypervisor.
May 21 02:11:17.907618 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:11:17.908063 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:11:17.908223 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:11:17.908612 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:11:17.921572 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Checking to see if SCSI volumes sdg, sdl have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:11:17.921572 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] SCSI volumes sdg, sdl have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:11:17.922681 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Checking to see if device paths {'sdg', 'sdl'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:11:17.935509 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Device paths {'sdg', 'sdl'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:11:17.935509 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:11:17.946574 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:17.982491 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:11:17.990594 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 147, target: iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a, portal: 192.168.40.100,3260]
May 21 02:11:17.990594 np0000001127 nova-compute[98206]: Logout of [sid: 147, target: iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a, portal: 192.168.40.100,3260] successful.
May 21 02:11:17.990594 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:18.010400 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:18.022299 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:18.057686 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 148, target: iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a, portal: 192.168.50.100,3260]
May 21 02:11:18.057686 np0000001127 nova-compute[98206]: Logout of [sid: 148, target: iqn.2023-03.storpool.com:os--volume-61affb01-e1ac-45d2-938c-e506a523047a, portal: 192.168.50.100,3260] successful.
May 21 02:11:18.057686 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:18.082400 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:18.082759 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:11:18.082951 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] <== disconnect_volume: return (56699ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:11:18.083314 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:11:18.083781 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 56.081s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:11:18.084253 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48', 'iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6a1268db-f070-4554-9c26-573e6882fc48', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:11:18.084423 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:11:18.084792 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Deleting instance files /opt/stack/data/nova/instances/3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2_del
May 21 02:11:18.085477 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Deletion of /opt/stack/data/nova/instances/3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2_del complete
May 21 02:11:18.121817 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:18.121817 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:18.121817 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:18.121817 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:18.121817 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:18.121817 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:18.121817 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:18.121817 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:18.121817 np0000001127 nova-compute[98206]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48 (non-flash)
May 21 02:11:18.121817 np0000001127 nova-compute[98206]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48 (non-flash)
May 21 02:11:18.121817 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:18.121817 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:18.121817 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:11:18.122431 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsi session list stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:18.122431 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:18.122431 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:18.122431 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:18.122431 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:18.122431 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:18.122431 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:18.122431 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:18.122431 np0000001127 nova-compute[98206]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48 (non-flash)
May 21 02:11:18.122431 np0000001127 nova-compute[98206]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48 (non-flash)
May 21 02:11:18.122431 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:18.122431 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:18.122431 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:11:18.122431 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', '132'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', '133'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', '134'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', '135'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', '144'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', '145'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43', '154'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43', '155'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48', '156'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48', '157'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '95')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:11:18.122431 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48', '157')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:11:18.124593 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48', '156')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:11:18.125907 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c76c0e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48'): ({'sdd'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:11:18.126143 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Removing multipathed devices sde, sdd {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:11:18.126394 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Flush multipath device 330000000a5f75a33 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:11:18.190953 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:11:18.259041 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:11:18.282327 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lazy-loading 'flavor' on Instance uuid 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:11:18.310923 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:11:18.311175 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:11:18.312911 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:11:18.325874 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:11:18.326139 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:11:18.338578 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:18.359257 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:18.373745 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 157, target: iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48, portal: 192.168.40.100,3260]
May 21 02:11:18.373745 np0000001127 nova-compute[98206]: Logout of [sid: 157, target: iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48, portal: 192.168.40.100,3260] successful.
May 21 02:11:18.373745 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:18.398423 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:18.411787 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:18.444702 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 156, target: iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48, portal: 192.168.50.100,3260]
May 21 02:11:18.444702 np0000001127 nova-compute[98206]: Logout of [sid: 156, target: iqn.2023-03.storpool.com:os--volume-6a1268db-f070-4554-9c26-573e6882fc48, portal: 192.168.50.100,3260] successful.
May 21 02:11:18.444702 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:18.464652 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:18.465002 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:11:18.465151 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] <== disconnect_volume: return (56462ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:11:18.465288 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:11:18.466207 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Deleting instance files /opt/stack/data/nova/instances/eb1c328c-f707-4f0d-90b5-ab5b268bf05a_del
May 21 02:11:18.467311 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 53.986s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:11:18.469486 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8a954859-fde3-4dc7-8366-d96e8a781658 req-e9931a56-7a63-43ac-9d08-3febf22ccb37 service nova] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Received event network-vif-deleted-a149f43d-6c97-4b80-9bd8-353fb7be0630 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:11:18.469772 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-8a954859-fde3-4dc7-8366-d96e8a781658 req-e9931a56-7a63-43ac-9d08-3febf22ccb37 service nova] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Neutron deleted interface a149f43d-6c97-4b80-9bd8-353fb7be0630; detaching it from the instance and deleting it from the info cache
May 21 02:11:18.469975 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Deletion of /opt/stack/data/nova/instances/eb1c328c-f707-4f0d-90b5-ab5b268bf05a_del complete
May 21 02:11:18.472786 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903', 'iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f8c00b3-1afb-4240-993e-fddb4a8e3903', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:11:18.473322 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-8a954859-fde3-4dc7-8366-d96e8a781658 req-e9931a56-7a63-43ac-9d08-3febf22ccb37 service nova] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:11:18.486696 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:11:18.487402 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:11:18.491895 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:11:18.492123 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:11:18.493566 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:11:18.493566 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:11:18.504816 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:11:18.504816 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:18.509431 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:11:18.509431 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:18.516233 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903] added
May 21 02:11:18.516233 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:11:18.516233 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:11:18.516233 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:11:18.516233 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:11:18.516233 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:11:18.516233 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:18.516460 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:11:18.516743 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0246(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:11:18.517068 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:11:18.520973 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903] added
May 21 02:11:18.520973 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:11:18.520973 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:11:18.520973 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:11:18.520973 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:11:18.520973 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:11:18.520973 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:18.521142 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:11:18.521355 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0286(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:11:18.521656 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:11:18.591811 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Took 58.08 seconds to destroy the instance on the hypervisor.
May 21 02:11:18.592875 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:11:18.593290 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:11:18.593414 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:11:18.593676 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:11:18.652698 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:11:18.894554 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:11:18.899624 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-103823e0-055d-4a73-b3df-65ba8fbc8087 req-ed562355-d42d-4dbf-9f1f-379dc134ad1a service nova] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Received event network-vif-deleted-73bc542d-2c3b-4675-8361-9e2bd49f52fe {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:11:18.899812 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-103823e0-055d-4a73-b3df-65ba8fbc8087 req-ed562355-d42d-4dbf-9f1f-379dc134ad1a service nova] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Neutron deleted interface 73bc542d-2c3b-4675-8361-9e2bd49f52fe; detaching it from the instance and deleting it from the info cache
May 21 02:11:18.900024 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-103823e0-055d-4a73-b3df-65ba8fbc8087 req-ed562355-d42d-4dbf-9f1f-379dc134ad1a service nova] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:11:18.978486 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Took 57.86 seconds to destroy the instance on the hypervisor.
May 21 02:11:18.979266 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8a954859-fde3-4dc7-8366-d96e8a781658 req-e9931a56-7a63-43ac-9d08-3febf22ccb37 service nova] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Detach interface failed, port_id=a149f43d-6c97-4b80-9bd8-353fb7be0630, reason: Instance 10c50913-8b08-402c-8ece-87c7521ce785 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:11:18.979795 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:11:18.980125 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:11:18.980445 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:11:18.980668 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:11:19.036887 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:11:19.288381 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ba251f93-1278-4340-9dac-a7e6d9098ba4 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 59.890s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:19.316412 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-293c7847-a4fc-459f-986d-913e13c54aa3 req-76a6a254-0964-4f7d-ac5a-ff2de67a1244 service nova] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Received event network-vif-deleted-3689adc9-295c-4c3e-b86e-161f565799ae {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:11:19.316664 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-293c7847-a4fc-459f-986d-913e13c54aa3 req-76a6a254-0964-4f7d-ac5a-ff2de67a1244 service nova] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Neutron deleted interface 3689adc9-295c-4c3e-b86e-161f565799ae; detaching it from the instance and deleting it from the info cache
May 21 02:11:19.316826 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-293c7847-a4fc-459f-986d-913e13c54aa3 req-76a6a254-0964-4f7d-ac5a-ff2de67a1244 service nova] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:11:19.344062 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:11:19.396461 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Took 1.49 seconds to deallocate network for instance.
May 21 02:11:19.406265 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-103823e0-055d-4a73-b3df-65ba8fbc8087 req-ed562355-d42d-4dbf-9f1f-379dc134ad1a service nova] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Detach interface failed, port_id=73bc542d-2c3b-4675-8361-9e2bd49f52fe, reason: Instance 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:11:19.411164 np0000001127 nova-compute[98206]: WARNING nova.volume.cinder [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Attachment 6e6c95c8-fd38-4bc3-9001-0589fe63fc14 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 6e6c95c8-fd38-4bc3-9001-0589fe63fc14. (HTTP 404) (Request-ID: req-4a5b0ff2-fb0d-40a5-9cba-35df468f2a0e)
May 21 02:11:19.411462 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 10c50913-8b08-402c-8ece-87c7521ce785] Took 0.01 seconds to detach 1 volumes for instance.
May 21 02:11:19.517528 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:11:19.522017 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:11:19.530390 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:11:19.530390 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:11:19.537130 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:11:19.537130 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:19.542771 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:19.549755 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:19.560061 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:19.560061 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:19.560061 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:19.560061 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:19.560061 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:19.560061 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:19.560061 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:19.560061 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:19.560061 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:19.560061 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:19.560061 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:11:19.560430 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:19.560430 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:19.560430 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:19.560430 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:19.560430 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:19.560430 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:19.560430 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:19.560430 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:19.560430 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:19.560430 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:19.560430 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:11:19.566700 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:19.566700 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:19.566700 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:19.566700 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:19.566700 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:19.566700 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:19.566700 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:19.566700 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:19.566700 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:19.566700 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:19.566700 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:11:19.567098 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:19.567098 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:19.567098 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:19.567098 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:19.567098 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:19.567098 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:19.567098 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:19.567098 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:19.567098 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:19.567098 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:19.567098 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:11:19.604798 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903, portal: 192.168.40.100,3260]
May 21 02:11:19.604798 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903, portal: 192.168.40.100,3260] successful.
May 21 02:11:19.604798 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:19.612300 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903, portal: 192.168.50.100,3260]
May 21 02:11:19.612300 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903, portal: 192.168.50.100,3260] successful.
May 21 02:11:19.612300 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:19.618128 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:19.624414 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:19.637051 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:19.637051 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:19.637051 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:19.637051 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:19.637051 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:19.637051 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:19.637051 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:19.637051 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:19.637051 np0000001127 nova-compute[98206]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:19.637051 np0000001127 nova-compute[98206]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:19.637051 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:19.637051 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:19.637051 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:11:19.637354 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:19.637354 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:19.637354 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:19.637354 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:19.637354 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:19.637354 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:19.637354 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:19.637354 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:19.637354 np0000001127 nova-compute[98206]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:19.637354 np0000001127 nova-compute[98206]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:19.637354 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:19.637354 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:19.637354 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:11:19.637583 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.146s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:11:19.637583 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:11:19.638644 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] HCTL ('9', '-', '-', 0) found on session 160 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:11:19.638764 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:11:19.643572 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:19.643572 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:19.643572 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:19.643572 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:19.643572 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:19.643572 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:19.643572 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:19.643572 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:19.643572 np0000001127 nova-compute[98206]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:19.643572 np0000001127 nova-compute[98206]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:19.643572 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:19.643572 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:19.643572 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:11:19.643815 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:19.643815 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:19.643815 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:19.643815 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:19.643815 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:19.643815 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:19.643815 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:19.643815 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:19.643815 np0000001127 nova-compute[98206]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:19.643815 np0000001127 nova-compute[98206]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:19.643815 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:19.643815 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:19.643815 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:11:19.644020 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.152s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:11:19.644172 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:11:19.645415 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] HCTL ('10', '-', '-', 0) found on session 161 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:11:19.645558 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:11:19.654348 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching for a device in session 160 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:11:19.654525 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f8c00b3-1afb-4240-993e-fddb4a8e3903', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:11:19.661154 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching for a device in session 161 and hctl ['10', '*', '*', 0] yield: None {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:11:19.735847 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:11:19.775829 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Acquiring lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:19.775960 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:19.820704 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-293c7847-a4fc-459f-986d-913e13c54aa3 req-76a6a254-0964-4f7d-ac5a-ff2de67a1244 service nova] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Detach interface failed, port_id=3689adc9-295c-4c3e-b86e-161f565799ae, reason: Instance eb1c328c-f707-4f0d-90b5-ab5b268bf05a could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:11:19.847139 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Took 1.25 seconds to deallocate network for instance.
May 21 02:11:19.916610 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:19.916769 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:20.238549 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Took 1.26 seconds to deallocate network for instance.
May 21 02:11:20.278422 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Detaching volume bef1cca2-1e4a-42c7-99af-ce84d5bcad43
May 21 02:11:20.324386 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Attempting to driver detach volume bef1cca2-1e4a-42c7-99af-ce84d5bcad43 from mountpoint /dev/vdb
May 21 02:11:20.328899 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Found disk vdb by alias ua-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:11:20.330294 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Found disk vdb by alias ua-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:11:20.330431 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Attempting to detach device vdb from instance 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 02:11:20.330745 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:11:20.330745 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:11:20.330745 np0000001127 nova-compute[98206]:   <alias name="ua-bef1cca2-1e4a-42c7-99af-ce84d5bcad43"/>
May 21 02:11:20.330745 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-13"/>
May 21 02:11:20.330745 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:11:20.330745 np0000001127 nova-compute[98206]:   <serial>bef1cca2-1e4a-42c7-99af-ce84d5bcad43</serial>
May 21 02:11:20.330745 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:11:20.330745 np0000001127 nova-compute[98206]: </disk>
May 21 02:11:20.330745 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:11:20.337314 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Successfully detached device vdb from instance 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e from the persistent domain config.
May 21 02:11:20.337314 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] (1/8): Attempting to detach device vdb with device alias ua-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 from instance 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 02:11:20.337634 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:11:20.337634 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:11:20.337634 np0000001127 nova-compute[98206]:   <alias name="ua-bef1cca2-1e4a-42c7-99af-ce84d5bcad43"/>
May 21 02:11:20.337634 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-13"/>
May 21 02:11:20.337634 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:11:20.337634 np0000001127 nova-compute[98206]:   <serial>bef1cca2-1e4a-42c7-99af-ce84d5bcad43</serial>
May 21 02:11:20.337634 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:11:20.337634 np0000001127 nova-compute[98206]: </disk>
May 21 02:11:20.337634 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:11:20.403273 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] [instance: 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2] Took 0.56 seconds to detach 1 volumes for instance.
May 21 02:11:20.439956 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:20.554762 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:11:20.554987 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:11:20.661542 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching for a device in session 161 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:11:20.661721 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2f8c00b3-1afb-4240-993e-fddb4a8e3903', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:11:20.785960 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: eb1c328c-f707-4f0d-90b5-ab5b268bf05a] Took 0.55 seconds to detach 1 volumes for instance.
May 21 02:11:20.794101 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779329480.7936358, 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e => ua-bef1cca2-1e4a-42c7-99af-ce84d5bcad43> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 02:11:20.795113 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 for instance 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 02:11:20.797717 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Successfully detached device vdb from instance 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e from the live domain config.
May 21 02:11:20.798859 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:11:20.799190 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43', 'iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bef1cca2-1e4a-42c7-99af-ce84d5bcad43', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-13'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:11:20.799369 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:11:20.908898 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:21.057631 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:11:21.294329 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:21.506908 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Found WWN 3300000007e883e52 for multipath device dm-1 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:11:21.507327 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:11:21.507387 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] <== connect_volume: return (57026ms) {'type': 'block', 'scsi_wwn': '3300000007e883e52', 'path': '/dev/dm-1', 'multipath_id': '3300000007e883e52'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:11:21.507519 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007e883e52', 'path': '/dev/dm-1', 'multipath_id': '3300000007e883e52'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:11:21.507898 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 21.332s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:11:21.508181 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f', 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '25afd690-442e-4fa0-ac9b-3d9a82c6403f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:11:21.521935 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:11:21.522410 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:11:21.522599 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:11:21.523202 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:11:21.524364 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:11:21.524596 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:11:21.534693 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:11:21.534693 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:21.539189 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:11:21.539189 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:21.545820 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f] added
May 21 02:11:21.545820 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:11:21.545820 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:11:21.545820 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:11:21.545820 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:11:21.545820 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:11:21.545820 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:21.546093 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:11:21.546093 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0235(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:11:21.546219 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:11:21.550040 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f] added
May 21 02:11:21.550040 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:11:21.550040 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:11:21.550040 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:11:21.550040 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:11:21.550040 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:11:21.550040 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:21.550319 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:11:21.550424 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0258(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:11:21.550607 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:11:21.565099 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.648s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:21.566328 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.657s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:21.616460 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Deleted allocations for instance 10c50913-8b08-402c-8ece-87c7521ce785
May 21 02:11:22.015050 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:10:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-998070334',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-998070334',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpattern-image-snapshot-server-998070334',id=69,image_ref='00f5ee93-ecd7-4a41-a40a-795483f1a463',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+LiYJhD2PPZubwisgBublNX2jMwBe8pfuQoO+l7hu0VGDhIkDnSWcpuXsiBfUK3Q2U3u3zDPEIn/IETzlelxEdJlxrGWAQ24FSeeK2AXOFBt4ms/ND82nCkiuN/5a7tg==',key_name='tempest-keypair-367282469',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62ebdb16aee84e22a88dfc8960debd32',ramdisk_id='',reservation_id='r-1sc3dvh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1995806391',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1995806391-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1995806391',owner_user_name='tempest-TestVolumeBootPattern-1995806391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:10:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4878b5a5bf184852a9ce383caa1c67a4',uuid=840919c9-6bf6-47ac-bb9c-35ea24494c2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8a17868-6e90-432e-b126-c5af5a09ae6b", "address": "fa:16:3e:d1:2c:6c", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a17868-6e", "ovs_interfaceid": "a8a17868-6e90-432e-b126-c5af5a09ae6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:11:22.015478 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converting VIF {"id": "a8a17868-6e90-432e-b126-c5af5a09ae6b", "address": "fa:16:3e:d1:2c:6c", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a17868-6e", "ovs_interfaceid": "a8a17868-6e90-432e-b126-c5af5a09ae6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:11:22.016237 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:2c:6c,bridge_name='br-int',has_traffic_filtering=True,id=a8a17868-6e90-432e-b126-c5af5a09ae6b,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8a17868-6e') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:11:22.017029 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lazy-loading 'pci_devices' on Instance uuid 840919c9-6bf6-47ac-bb9c-35ea24494c2e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:11:22.141091 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:11:22.141334 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:11:22.519420 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] End _get_guest_xml xml=<domain type="qemu">
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:   <uuid>840919c9-6bf6-47ac-bb9c-35ea24494c2e</uuid>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:   <name>instance-00000045</name>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-998070334</nova:name>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:10:24</nova:creationTime>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:       <nova:image uuid="">
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:         <nova:diskFormat>raw</nova:diskFormat>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:           <nova:property name="hw_machine_type">pc</nova:property>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:           <nova:property name="hw_video_model">virtio</nova:property>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:           <nova:property name="img_bdm_v2">True</nova:property>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:           <nova:property name="img_root_device_name">/dev/vda</nova:property>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:         <nova:user uuid="4878b5a5bf184852a9ce383caa1c67a4">tempest-TestVolumeBootPattern-1995806391-project-member</nova:user>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:         <nova:project uuid="62ebdb16aee84e22a88dfc8960debd32">tempest-TestVolumeBootPattern-1995806391</nova:project>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid=""/>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:         <nova:port uuid="a8a17868-6e90-432e-b126-c5af5a09ae6b">
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:     <system>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:       <entry name="serial">840919c9-6bf6-47ac-bb9c-35ea24494c2e</entry>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:       <entry name="uuid">840919c9-6bf6-47ac-bb9c-35ea24494c2e</entry>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:     </system>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:   <os>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:   </os>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:   <features>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:   </features>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:   <devices>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/840919c9-6bf6-47ac-bb9c-35ea24494c2e/disk.config"/>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:     </disk>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:       <alias name="ua-2f8c00b3-1afb-4240-993e-fddb4a8e3903"/>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-1"/>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:       <serial>2f8c00b3-1afb-4240-993e-fddb4a8e3903</serial>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:     </disk>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:d1:2c:6c"/>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:       <target dev="tapa8a17868-6e"/>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:     </interface>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/840919c9-6bf6-47ac-bb9c-35ea24494c2e/console.log" append="off"/>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:     </serial>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:     <video>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:     </video>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:     </rng>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:   </devices>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]: </domain>
May 21 02:11:22.519420 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:11:22.523342 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Preparing to wait for external event network-vif-plugged-a8a17868-6e90-432e-b126-c5af5a09ae6b {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:11:22.523342 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "840919c9-6bf6-47ac-bb9c-35ea24494c2e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:22.523342 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "840919c9-6bf6-47ac-bb9c-35ea24494c2e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:22.523342 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "840919c9-6bf6-47ac-bb9c-35ea24494c2e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:22.523342 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:10:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-998070334',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-998070334',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpattern-image-snapshot-server-998070334',id=69,image_ref='00f5ee93-ecd7-4a41-a40a-795483f1a463',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+LiYJhD2PPZubwisgBublNX2jMwBe8pfuQoO+l7hu0VGDhIkDnSWcpuXsiBfUK3Q2U3u3zDPEIn/IETzlelxEdJlxrGWAQ24FSeeK2AXOFBt4ms/ND82nCkiuN/5a7tg==',key_name='tempest-keypair-367282469',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62ebdb16aee84e22a88dfc8960debd32',ramdisk_id='',reservation_id='r-1sc3dvh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1995806391',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1995806391-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1995806391',owner_user_name='tempest-TestVolumeBootPattern-1995806391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:10:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4878b5a5bf184852a9ce383caa1c67a4',uuid=840919c9-6bf6-47ac-bb9c-35ea24494c2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8a17868-6e90-432e-b126-c5af5a09ae6b", "address": "fa:16:3e:d1:2c:6c", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a17868-6e", "ovs_interfaceid": "a8a17868-6e90-432e-b126-c5af5a09ae6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:11:22.523342 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converting VIF {"id": "a8a17868-6e90-432e-b126-c5af5a09ae6b", "address": "fa:16:3e:d1:2c:6c", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a17868-6e", "ovs_interfaceid": "a8a17868-6e90-432e-b126-c5af5a09ae6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:11:22.523342 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:2c:6c,bridge_name='br-int',has_traffic_filtering=True,id=a8a17868-6e90-432e-b126-c5af5a09ae6b,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8a17868-6e') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:11:22.523342 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:2c:6c,bridge_name='br-int',has_traffic_filtering=True,id=a8a17868-6e90-432e-b126-c5af5a09ae6b,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8a17868-6e') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:11:22.523342 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:22.523342 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:11:22.523342 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:11:22.523342 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:22.523342 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7e743792-09a5-5e6f-bfa3-7139801e4f52', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:11:22.524046 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:22.524401 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:11:22.524966 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:22.526599 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:22.526746 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8a17868-6e, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:11:22.527094 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa8a17868-6e, col_values=(('qos', UUID('d163f2a0-0c8e-44fd-b2b4-06102527bcf0')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:11:22.527281 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa8a17868-6e, col_values=(('external_ids', {'iface-id': 'a8a17868-6e90-432e-b126-c5af5a09ae6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:2c:6c', 'vm-uuid': '840919c9-6bf6-47ac-bb9c-35ea24494c2e'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:11:22.528570 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:22.529793 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:11:22.534763 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:22.535712 np0000001127 nova-compute[98206]: INFO os_vif [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:2c:6c,bridge_name='br-int',has_traffic_filtering=True,id=a8a17868-6e90-432e-b126-c5af5a09ae6b,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8a17868-6e')
May 21 02:11:22.546576 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:11:22.550919 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:11:22.559490 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:11:22.559490 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:11:22.563938 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:11:22.563938 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:22.571354 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:22.576382 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:22.589309 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:22.589309 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:22.589309 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:22.589309 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:22.589309 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:22.589309 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:22.589309 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:22.589309 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:22.589309 np0000001127 nova-compute[98206]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:22.589309 np0000001127 nova-compute[98206]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:22.589309 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:22.589309 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:22.589309 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:11:22.589864 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsi session list stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:22.589864 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:22.589864 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:22.589864 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:22.589864 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:22.589864 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:22.589864 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:22.589864 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:22.589864 np0000001127 nova-compute[98206]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:22.589864 np0000001127 nova-compute[98206]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:22.589864 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:22.589864 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:22.589864 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:11:22.600313 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:22.600313 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:22.600313 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:22.600313 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:22.600313 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:22.600313 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:22.600313 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:22.600313 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:22.600313 np0000001127 nova-compute[98206]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:22.600313 np0000001127 nova-compute[98206]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:22.600313 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:22.600313 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:22.600313 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:11:22.600313 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsi session list stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:22.600313 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:22.600313 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:22.600313 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:22.600313 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:22.600313 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:22.600313 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:22.600313 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:22.600313 np0000001127 nova-compute[98206]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:22.600313 np0000001127 nova-compute[98206]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:22.600313 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:22.600313 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:22.600313 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:11:22.624384 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d95e8a6f-b800-434e-86e0-da99e0cfdec9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "10c50913-8b08-402c-8ece-87c7521ce785" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 67.053s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:22.639765 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f, portal: 192.168.40.100,3260]
May 21 02:11:22.639765 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f, portal: 192.168.40.100,3260] successful.
May 21 02:11:22.639765 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:22.643859 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:11:22.649948 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f, portal: 192.168.50.100,3260]
May 21 02:11:22.649948 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f, portal: 192.168.50.100,3260] successful.
May 21 02:11:22.649948 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:22.655252 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:22.664713 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:22.676812 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:22.676812 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:22.676812 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:22.676812 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:22.676812 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:22.676812 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:22.676812 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:22.676812 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:22.676812 np0000001127 nova-compute[98206]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:22.676812 np0000001127 nova-compute[98206]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:22.676812 np0000001127 nova-compute[98206]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:22.676812 np0000001127 nova-compute[98206]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:22.676812 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:22.676812 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:22.676812 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:11:22.677208 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsi session list stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:22.677208 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:22.677208 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:22.677208 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:22.677208 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:22.677208 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:22.677208 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:22.677208 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:22.677208 np0000001127 nova-compute[98206]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:22.677208 np0000001127 nova-compute[98206]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:22.677208 np0000001127 nova-compute[98206]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:22.677208 np0000001127 nova-compute[98206]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:22.677208 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:22.677208 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:22.677208 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:11:22.677459 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:11:22.677459 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:11:22.678685 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] HCTL ('11', '-', '-', 0) found on session 162 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:11:22.678780 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:11:22.685213 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:22.685213 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:22.685213 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:22.685213 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:22.685213 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:22.685213 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:22.685213 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:22.685213 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:22.685213 np0000001127 nova-compute[98206]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:22.685213 np0000001127 nova-compute[98206]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:22.685213 np0000001127 nova-compute[98206]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:22.685213 np0000001127 nova-compute[98206]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:22.685213 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:22.685213 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:22.685213 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:11:22.685674 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsi session list stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:22.685674 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:22.685674 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:22.685674 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:22.685674 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:22.685674 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:22.685674 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:22.685674 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:22.685674 np0000001127 nova-compute[98206]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:22.685674 np0000001127 nova-compute[98206]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:22.685674 np0000001127 nova-compute[98206]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:22.685674 np0000001127 nova-compute[98206]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:22.685674 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:22.685674 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:22.685674 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:11:22.685674 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.161s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:11:22.686093 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:11:22.687219 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] HCTL ('12', '-', '-', 0) found on session 163 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:11:22.687219 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:11:22.694514 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Searching for a device in session 162 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:11:22.694629 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '25afd690-442e-4fa0-ac9b-3d9a82c6403f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:11:22.701054 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Searching for a device in session 163 and hctl ['12', '*', '*', 0] yield: None {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:11:22.927788 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-931c1f1e-7150-46dc-95ed-ba6ffc511acf tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:22.927912 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-931c1f1e-7150-46dc-95ed-ba6ffc511acf tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:23.151253 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.586s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:23.152676 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.857s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:23.213799 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Deleted allocations for instance 3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2
May 21 02:11:23.431761 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-931c1f1e-7150-46dc-95ed-ba6ffc511acf tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Detaching volume f5dc8530-4090-49a6-897f-ad627f9d7515
May 21 02:11:23.466206 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-931c1f1e-7150-46dc-95ed-ba6ffc511acf tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Attempting to driver detach volume f5dc8530-4090-49a6-897f-ad627f9d7515 from mountpoint /dev/vdd
May 21 02:11:23.473400 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-931c1f1e-7150-46dc-95ed-ba6ffc511acf tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Found disk vdd by alias ua-f5dc8530-4090-49a6-897f-ad627f9d7515 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:11:23.474480 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-931c1f1e-7150-46dc-95ed-ba6ffc511acf tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Found disk vdd by alias ua-f5dc8530-4090-49a6-897f-ad627f9d7515 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:11:23.474585 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-931c1f1e-7150-46dc-95ed-ba6ffc511acf tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Attempting to detach device vdd from instance 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 02:11:23.474781 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-931c1f1e-7150-46dc-95ed-ba6ffc511acf tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:11:23.474781 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:11:23.474781 np0000001127 nova-compute[98206]:   <alias name="ua-f5dc8530-4090-49a6-897f-ad627f9d7515"/>
May 21 02:11:23.474781 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-12"/>
May 21 02:11:23.474781 np0000001127 nova-compute[98206]:   <target dev="vdd" bus="virtio"/>
May 21 02:11:23.474781 np0000001127 nova-compute[98206]:   <serial>f5dc8530-4090-49a6-897f-ad627f9d7515</serial>
May 21 02:11:23.474781 np0000001127 nova-compute[98206]:   <shareable/>
May 21 02:11:23.474781 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x09" function="0x0"/>
May 21 02:11:23.474781 np0000001127 nova-compute[98206]: </disk>
May 21 02:11:23.474781 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:11:23.486819 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-931c1f1e-7150-46dc-95ed-ba6ffc511acf tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Successfully detached device vdd from instance 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed from the persistent domain config.
May 21 02:11:23.487010 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-931c1f1e-7150-46dc-95ed-ba6ffc511acf tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] (1/8): Attempting to detach device vdd with device alias ua-f5dc8530-4090-49a6-897f-ad627f9d7515 from instance 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 02:11:23.487311 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-931c1f1e-7150-46dc-95ed-ba6ffc511acf tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:11:23.487311 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:11:23.487311 np0000001127 nova-compute[98206]:   <alias name="ua-f5dc8530-4090-49a6-897f-ad627f9d7515"/>
May 21 02:11:23.487311 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-12"/>
May 21 02:11:23.487311 np0000001127 nova-compute[98206]:   <target dev="vdd" bus="virtio"/>
May 21 02:11:23.487311 np0000001127 nova-compute[98206]:   <serial>f5dc8530-4090-49a6-897f-ad627f9d7515</serial>
May 21 02:11:23.487311 np0000001127 nova-compute[98206]:   <shareable/>
May 21 02:11:23.487311 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x09" function="0x0"/>
May 21 02:11:23.487311 np0000001127 nova-compute[98206]: </disk>
May 21 02:11:23.487311 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:11:23.673009 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:11:23.673552 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:11:23.701262 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Searching for a device in session 163 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:11:23.701377 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '25afd690-442e-4fa0-ac9b-3d9a82c6403f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:11:23.957306 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779329483.9568388, 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed => ua-f5dc8530-4090-49a6-897f-ad627f9d7515> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 02:11:23.959011 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-931c1f1e-7150-46dc-95ed-ba6ffc511acf tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Start waiting for the detach event from libvirt for device vdd with device alias ua-f5dc8530-4090-49a6-897f-ad627f9d7515 for instance 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 02:11:23.961099 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-931c1f1e-7150-46dc-95ed-ba6ffc511acf tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Successfully detached device vdd from instance 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed from the live domain config.
May 21 02:11:23.986015 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-931c1f1e-7150-46dc-95ed-ba6ffc511acf tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:11:23.986263 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-931c1f1e-7150-46dc-95ed-ba6ffc511acf tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515', 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5dc8530-4090-49a6-897f-ad627f9d7515', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:11:23.986390 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-931c1f1e-7150-46dc-95ed-ba6ffc511acf tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:11:24.053600 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:11:24.053758 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:11:24.053836 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] No VIF found with MAC fa:16:3e:d1:2c:6c, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:11:24.054477 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Using config drive
May 21 02:11:24.175925 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:11:24.221455 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9562ee4b-8fd0-4a81-8b3c-ed13dfe704de tempest-TestVolumeBackupRestore-233752250 tempest-TestVolumeBackupRestore-233752250-project-member] Lock "3aa8ecf3-2ba5-4d3b-bd7d-d4eee0d528e2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 64.226s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:24.541703 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Found WWN 3300000007ae6c6c9 for multipath device dm-10 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:11:24.541940 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:11:24.542102 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] <== connect_volume: return (24366ms) {'type': 'block', 'scsi_wwn': '3300000007ae6c6c9', 'path': '/dev/dm-10', 'multipath_id': '3300000007ae6c6c9'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:11:24.542226 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007ae6c6c9', 'path': '/dev/dm-10', 'multipath_id': '3300000007ae6c6c9'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:11:24.543002 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 17.443s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:11:24.543002 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687', 'iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f33552f3-023a-4c38-89b4-db5ba0c2c687', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:11:24.545169 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lazy-loading 'flavor' on Instance uuid 3767becb-caf4-47ee-904f-112069ee8dba {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:11:24.555119 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:11:24.555571 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:11:24.555748 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:11:24.556216 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:11:24.560365 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:11:24.562089 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:11:24.562277 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:11:24.567731 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:11:24.567731 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:24.577363 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:11:24.577363 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:24.581871 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687] added
May 21 02:11:24.581871 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:11:24.581871 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:11:24.581871 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:11:24.581871 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:11:24.581871 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:11:24.581871 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:24.582099 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:11:24.582234 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0264(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:11:24.582289 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:11:24.587563 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687] added
May 21 02:11:24.587563 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:11:24.587563 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:11:24.587563 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:11:24.587563 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:11:24.587563 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:11:24.587563 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:24.587842 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:11:24.588044 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0256(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:11:24.588139 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:11:24.684384 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.532s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:24.702410 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Creating config drive at /opt/stack/data/nova/instances/840919c9-6bf6-47ac-bb9c-35ea24494c2e/disk.config
May 21 02:11:24.714209 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/840919c9-6bf6-47ac-bb9c-35ea24494c2e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp76_7a138 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:11:24.740044 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Deleted allocations for instance eb1c328c-f707-4f0d-90b5-ab5b268bf05a
May 21 02:11:24.779209 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/840919c9-6bf6-47ac-bb9c-35ea24494c2e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp76_7a138" returned: 0 in 0.065s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:11:25.049153 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Attempting to attach volume 25afd690-442e-4fa0-ac9b-3d9a82c6403f with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 02:11:25.063216 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] attach device xml: <disk type="block" device="disk">
May 21 02:11:25.063216 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:11:25.063216 np0000001127 nova-compute[98206]:   <alias name="ua-25afd690-442e-4fa0-ac9b-3d9a82c6403f"/>
May 21 02:11:25.063216 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-10"/>
May 21 02:11:25.063216 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:11:25.063216 np0000001127 nova-compute[98206]:   <serial>25afd690-442e-4fa0-ac9b-3d9a82c6403f</serial>
May 21 02:11:25.063216 np0000001127 nova-compute[98206]: </disk>
May 21 02:11:25.063216 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 02:11:25.337255 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:25.363630 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:25.366133 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:25.462736 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:25.503634 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:25.512062 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:25.533611 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bb7c8e36-01b8-489f-bab2-c689afd5e0f7 req-2c97e73b-0223-4e94-bc63-096ebb404976 service nova] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Received event network-vif-plugged-a8a17868-6e90-432e-b126-c5af5a09ae6b {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:11:25.534083 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bb7c8e36-01b8-489f-bab2-c689afd5e0f7 req-2c97e73b-0223-4e94-bc63-096ebb404976 service nova] Acquiring lock "840919c9-6bf6-47ac-bb9c-35ea24494c2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:25.534260 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bb7c8e36-01b8-489f-bab2-c689afd5e0f7 req-2c97e73b-0223-4e94-bc63-096ebb404976 service nova] Lock "840919c9-6bf6-47ac-bb9c-35ea24494c2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:25.536553 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bb7c8e36-01b8-489f-bab2-c689afd5e0f7 req-2c97e73b-0223-4e94-bc63-096ebb404976 service nova] Lock "840919c9-6bf6-47ac-bb9c-35ea24494c2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:25.536706 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bb7c8e36-01b8-489f-bab2-c689afd5e0f7 req-2c97e73b-0223-4e94-bc63-096ebb404976 service nova] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Processing event network-vif-plugged-a8a17868-6e90-432e-b126-c5af5a09ae6b {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:11:25.583723 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:11:25.589981 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:11:25.599532 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:11:25.599532 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:11:25.605175 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:11:25.605175 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:25.612810 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:25.621771 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:25.633324 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:25.633324 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:25.633324 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:25.633324 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:25.633324 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:25.633324 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:25.633324 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:25.633324 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:25.633324 np0000001127 nova-compute[98206]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:25.633324 np0000001127 nova-compute[98206]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:25.633324 np0000001127 nova-compute[98206]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:25.633324 np0000001127 nova-compute[98206]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:25.633324 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:25.633324 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:25.633324 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:11:25.633808 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsi session list stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:25.633808 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:25.633808 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:25.633808 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:25.633808 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:25.633808 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:25.633808 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:25.633808 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:25.633808 np0000001127 nova-compute[98206]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:25.633808 np0000001127 nova-compute[98206]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:25.633808 np0000001127 nova-compute[98206]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:25.633808 np0000001127 nova-compute[98206]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:25.633808 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:25.633808 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:25.633808 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:11:25.644142 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:25.644142 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:25.644142 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:25.644142 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:25.644142 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:25.644142 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:25.644142 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:25.644142 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:25.644142 np0000001127 nova-compute[98206]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:25.644142 np0000001127 nova-compute[98206]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:25.644142 np0000001127 nova-compute[98206]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:25.644142 np0000001127 nova-compute[98206]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:25.644142 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:25.644142 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:25.644142 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:11:25.644676 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsi session list stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:25.644676 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:25.644676 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:25.644676 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:25.644676 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:25.644676 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:25.644676 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:25.644676 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:25.644676 np0000001127 nova-compute[98206]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:25.644676 np0000001127 nova-compute[98206]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:25.644676 np0000001127 nova-compute[98206]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:25.644676 np0000001127 nova-compute[98206]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:25.644676 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:25.644676 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:25.644676 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:11:25.697878 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687, portal: 192.168.40.100,3260]
May 21 02:11:25.697878 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687, portal: 192.168.40.100,3260] successful.
May 21 02:11:25.697878 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:25.712206 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:25.713132 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687, portal: 192.168.50.100,3260]
May 21 02:11:25.713132 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687, portal: 192.168.50.100,3260] successful.
May 21 02:11:25.713132 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:25.738247 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:25.738872 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:25.738872 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:25.738872 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:25.738872 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:25.738872 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:25.738872 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:25.738872 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:25.738872 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:25.738872 np0000001127 nova-compute[98206]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:25.738872 np0000001127 nova-compute[98206]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:25.738872 np0000001127 nova-compute[98206]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:25.738872 np0000001127 nova-compute[98206]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:25.738872 np0000001127 nova-compute[98206]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:11:25.738872 np0000001127 nova-compute[98206]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:11:25.738872 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:25.738872 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:25.738872 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:11:25.739439 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsi session list stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:25.739439 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:25.739439 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:25.739439 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:25.739439 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:25.739439 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:25.739439 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:25.739439 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:25.739439 np0000001127 nova-compute[98206]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:25.739439 np0000001127 nova-compute[98206]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:25.739439 np0000001127 nova-compute[98206]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:25.739439 np0000001127 nova-compute[98206]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:25.739439 np0000001127 nova-compute[98206]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:11:25.739439 np0000001127 nova-compute[98206]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:11:25.739439 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:25.739439 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:25.739439 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:11:25.740642 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.184s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:11:25.740642 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:11:25.741631 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] HCTL ('17', '-', '-', 0) found on session 164 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:11:25.741631 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:11:25.752586 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7dc700c1-30a8-41fc-b01b-7adc675e7852 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "eb1c328c-f707-4f0d-90b5-ab5b268bf05a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 65.149s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:25.761238 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Searching for a device in session 164 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:11:25.761238 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f33552f3-023a-4c38-89b4-db5ba0c2c687', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:11:25.763538 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:25.763538 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:25.763538 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:25.763538 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:25.763538 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:25.763538 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:25.763538 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:25.763538 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:25.763538 np0000001127 nova-compute[98206]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:25.763538 np0000001127 nova-compute[98206]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:25.763538 np0000001127 nova-compute[98206]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:25.763538 np0000001127 nova-compute[98206]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:25.763538 np0000001127 nova-compute[98206]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:11:25.763538 np0000001127 nova-compute[98206]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:11:25.763538 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:25.763538 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:25.763538 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:11:25.763836 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsi session list stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:25.763836 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:25.763836 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:25.763836 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:25.763836 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:25.763836 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:25.763836 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:25.763836 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:25.763836 np0000001127 nova-compute[98206]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:25.763836 np0000001127 nova-compute[98206]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:25.763836 np0000001127 nova-compute[98206]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:25.763836 np0000001127 nova-compute[98206]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:25.763836 np0000001127 nova-compute[98206]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:11:25.763836 np0000001127 nova-compute[98206]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:11:25.763836 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:25.763836 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:25.763836 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:11:25.764120 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.203s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:11:25.764165 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:11:25.765696 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] HCTL ('21', '-', '-', 0) found on session 165 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:11:25.765797 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Scanning host 21 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:11:25.780879 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Searching for a device in session 165 and hctl ['21', '*', '*', 0] yield: None {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:11:26.175912 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329486.1752312, 840919c9-6bf6-47ac-bb9c-35ea24494c2e => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:11:26.176252 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:11:26.176549 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] VM Started (Lifecycle Event)
May 21 02:11:26.178674 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:11:26.181995 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Instance spawned successfully.
May 21 02:11:26.182312 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:11:26.185294 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:11:26.185359 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:11:26.678924 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:11:26.685915 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:11:26.690424 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Took 62.25 seconds to spawn the instance on the hypervisor.
May 21 02:11:26.690636 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:11:26.780636 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Searching for a device in session 165 and hctl ['21', '*', '*', 0] yield: sdp {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:11:26.781039 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f33552f3-023a-4c38-89b4-db5ba0c2c687', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:11:26.793805 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:11:26.794037 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:11:26.794037 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:11:26.794148 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] No VIF found with MAC fa:16:3e:0b:89:15, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:11:26.968264 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:27.188283 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:11:27.188572 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329487.188372, 840919c9-6bf6-47ac-bb9c-35ea24494c2e => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:11:27.188718 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] VM Paused (Lifecycle Event)
May 21 02:11:27.204195 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Took 74.08 seconds to build instance.
May 21 02:11:27.436856 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:27.528827 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:27.577408 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Found WWN 33000000009ae5545 for multipath device dm-14 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:11:27.577693 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:11:27.578999 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] <== connect_volume: return (20479ms) {'type': 'block', 'scsi_wwn': '33000000009ae5545', 'path': '/dev/disk/by-id/os-brick+dev+dm-14', 'multipath_id': '33000000009ae5545'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:11:27.579148 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000009ae5545', 'path': '/dev/disk/by-id/os-brick+dev+dm-14', 'multipath_id': '33000000009ae5545'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:11:27.579578 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 6.780s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:11:27.579995 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43', 'iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bef1cca2-1e4a-42c7-99af-ce84d5bcad43', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-13'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:11:27.580158 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:11:27.581599 np0000001127 nova-compute[98206]: WARNING stevedore.named [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 21 02:11:27.581859 np0000001127 nova-compute[98206]: WARNING castellan.key_manager [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 21 02:11:27.582053 np0000001127 nova-compute[98206]: WARNING nova.keymgr.conf_key_mgr [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 21 02:11:27.605915 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Secret XML: <secret ephemeral="no" private="no">
May 21 02:11:27.605915 np0000001127 nova-compute[98206]:   <usage type="volume">
May 21 02:11:27.605915 np0000001127 nova-compute[98206]:     <volume>f33552f3-023a-4c38-89b4-db5ba0c2c687</volume>
May 21 02:11:27.605915 np0000001127 nova-compute[98206]:   </usage>
May 21 02:11:27.605915 np0000001127 nova-compute[98206]: </secret>
May 21 02:11:27.605915 np0000001127 nova-compute[98206]:  {{(pid=98206) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 21 02:11:27.614562 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lazy-loading 'flavor' on Instance uuid 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:11:27.616269 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:27.616269 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:27.616269 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:27.616269 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:27.616269 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:27.616269 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:27.616269 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:27.616269 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:27.616269 np0000001127 nova-compute[98206]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:27.616269 np0000001127 nova-compute[98206]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:27.616269 np0000001127 nova-compute[98206]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:27.616269 np0000001127 nova-compute[98206]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:27.616269 np0000001127 nova-compute[98206]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:11:27.616269 np0000001127 nova-compute[98206]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:11:27.616269 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:27.616269 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:27.616269 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:11:27.616763 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsi session list stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:27.616763 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:27.616763 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:27.616763 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:27.616763 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:27.616763 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:27.616763 np0000001127 nova-compute[98206]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:27.616763 np0000001127 nova-compute[98206]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43 (non-flash)
May 21 02:11:27.616763 np0000001127 nova-compute[98206]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:27.616763 np0000001127 nova-compute[98206]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:27.616763 np0000001127 nova-compute[98206]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:27.616763 np0000001127 nova-compute[98206]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:27.616763 np0000001127 nova-compute[98206]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:11:27.616763 np0000001127 nova-compute[98206]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:11:27.616763 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:27.616763 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:27.616763 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:11:27.616763 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', '132'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', '133'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', '134'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', '135'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', '144'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', '145'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43', '154'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43', '155'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903', '160'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903', '161'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f', '162'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f', '163'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687', '164'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687', '165'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '95')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:11:27.616763 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43', '154')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:11:27.618088 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43', '155')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:11:27.619127 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c0587f20c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43'): ({'sdo'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43'): ({'sdr'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:11:27.620690 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Removing multipathed devices sdo, sdr {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:11:27.620690 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Flush multipath device 33000000057fa8ba9 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:11:27.625204 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-4e965456-e9ff-4199-a54b-646ab1968755 req-35a49570-0d26-4aad-a756-942f551a3327 service nova] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Received event network-vif-plugged-a8a17868-6e90-432e-b126-c5af5a09ae6b {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:11:27.625204 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4e965456-e9ff-4199-a54b-646ab1968755 req-35a49570-0d26-4aad-a756-942f551a3327 service nova] Acquiring lock "840919c9-6bf6-47ac-bb9c-35ea24494c2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:27.625204 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4e965456-e9ff-4199-a54b-646ab1968755 req-35a49570-0d26-4aad-a756-942f551a3327 service nova] Lock "840919c9-6bf6-47ac-bb9c-35ea24494c2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:27.625204 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4e965456-e9ff-4199-a54b-646ab1968755 req-35a49570-0d26-4aad-a756-942f551a3327 service nova] Lock "840919c9-6bf6-47ac-bb9c-35ea24494c2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:27.625204 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-4e965456-e9ff-4199-a54b-646ab1968755 req-35a49570-0d26-4aad-a756-942f551a3327 service nova] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] No waiting events found dispatching network-vif-plugged-a8a17868-6e90-432e-b126-c5af5a09ae6b {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:11:27.625204 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-4e965456-e9ff-4199-a54b-646ab1968755 req-35a49570-0d26-4aad-a756-942f551a3327 service nova] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Received unexpected event network-vif-plugged-a8a17868-6e90-432e-b126-c5af5a09ae6b for instance with vm_state active and task_state None.
May 21 02:11:27.657813 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:11:27.691264 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:11:27.698601 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329487.6982265, 840919c9-6bf6-47ac-bb9c-35ea24494c2e => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:11:27.698878 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] VM Resumed (Lifecycle Event)
May 21 02:11:27.706033 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "840919c9-6bf6-47ac-bb9c-35ea24494c2e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 75.598s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:27.721053 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Remove SCSI device /dev/sdr with /sys/block/sdr/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:11:27.772883 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Checking to see if SCSI volumes sdo, sdr have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:11:27.774192 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] SCSI volumes sdo, sdr have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:11:27.774573 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Checking to see if device paths {'sdo', 'sdr'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:11:27.791826 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Device paths {'sdo', 'sdr'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:11:27.791826 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:11:27.809204 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:27.855646 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 154, target: iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43, portal: 192.168.40.100,3260]
May 21 02:11:27.855646 np0000001127 nova-compute[98206]: Logout of [sid: 154, target: iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43, portal: 192.168.40.100,3260] successful.
May 21 02:11:27.855646 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:27.894772 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:27.910825 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:27.959775 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 155, target: iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43, portal: 192.168.50.100,3260]
May 21 02:11:27.959775 np0000001127 nova-compute[98206]: Logout of [sid: 155, target: iqn.2023-03.storpool.com:os--volume-bef1cca2-1e4a-42c7-99af-ce84d5bcad43, portal: 192.168.50.100,3260] successful.
May 21 02:11:27.959775 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:27.991288 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:27.991490 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.412s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:11:27.991637 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] <== disconnect_volume: return (7191ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:11:27.991752 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:11:27.994440 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-931c1f1e-7150-46dc-95ed-ba6ffc511acf tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 4.007s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:11:27.994810 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-931c1f1e-7150-46dc-95ed-ba6ffc511acf tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515', 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5dc8530-4090-49a6-897f-ad627f9d7515', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:11:27.995091 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-931c1f1e-7150-46dc-95ed-ba6ffc511acf tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:11:28.031691 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-931c1f1e-7150-46dc-95ed-ba6ffc511acf tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:28.031691 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:28.031691 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:28.031691 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:28.031691 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:28.031691 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:28.031691 np0000001127 nova-compute[98206]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:28.031691 np0000001127 nova-compute[98206]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:28.031691 np0000001127 nova-compute[98206]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:28.031691 np0000001127 nova-compute[98206]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:28.031691 np0000001127 nova-compute[98206]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:11:28.031691 np0000001127 nova-compute[98206]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:11:28.031691 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:28.031691 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:28.031691 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:11:28.032227 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-931c1f1e-7150-46dc-95ed-ba6ffc511acf tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsi session list stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:28.032227 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:28.032227 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:28.032227 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:28.032227 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:28.032227 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:28.032227 np0000001127 nova-compute[98206]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:28.032227 np0000001127 nova-compute[98206]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:28.032227 np0000001127 nova-compute[98206]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:28.032227 np0000001127 nova-compute[98206]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:28.032227 np0000001127 nova-compute[98206]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:11:28.032227 np0000001127 nova-compute[98206]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:11:28.032227 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:28.032227 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:28.032227 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:11:28.032227 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-931c1f1e-7150-46dc-95ed-ba6ffc511acf tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', '132'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', '133'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', '134'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', '135'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', '144'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', '145'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903', '160'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903', '161'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f', '162'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f', '163'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687', '164'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687', '165'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '95')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:11:28.032768 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-931c1f1e-7150-46dc-95ed-ba6ffc511acf tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515, 0): [] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:11:28.032768 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-931c1f1e-7150-46dc-95ed-ba6ffc511acf tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515') {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 21 02:11:28.032768 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-931c1f1e-7150-46dc-95ed-ba6ffc511acf tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515, 0): [] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:11:28.032768 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-931c1f1e-7150-46dc-95ed-ba6ffc511acf tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5dc8530-4090-49a6-897f-ad627f9d7515') {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 21 02:11:28.032987 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-931c1f1e-7150-46dc-95ed-ba6ffc511acf tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c545440>, {}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:11:28.032987 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-931c1f1e-7150-46dc-95ed-ba6ffc511acf tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Disconnecting from: [] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:11:28.033165 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-931c1f1e-7150-46dc-95ed-ba6ffc511acf tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.039s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:11:28.033311 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-931c1f1e-7150-46dc-95ed-ba6ffc511acf tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] <== disconnect_volume: return (4046ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:11:28.033436 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-931c1f1e-7150-46dc-95ed-ba6ffc511acf tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:11:28.117512 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Attempting to attach volume f33552f3-023a-4c38-89b4-db5ba0c2c687 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 02:11:28.119396 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] attach device xml: <disk type="block" device="disk">
May 21 02:11:28.119396 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:11:28.119396 np0000001127 nova-compute[98206]:   <alias name="ua-f33552f3-023a-4c38-89b4-db5ba0c2c687"/>
May 21 02:11:28.119396 np0000001127 nova-compute[98206]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-14"/>
May 21 02:11:28.119396 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:11:28.119396 np0000001127 nova-compute[98206]:   <serial>f33552f3-023a-4c38-89b4-db5ba0c2c687</serial>
May 21 02:11:28.119396 np0000001127 nova-compute[98206]:   <encryption format="luks">
May 21 02:11:28.119396 np0000001127 nova-compute[98206]:     <secret type="passphrase" uuid="0943d518-8f70-4de8-9ebb-9502a320d651"/>
May 21 02:11:28.119396 np0000001127 nova-compute[98206]:   </encryption>
May 21 02:11:28.119396 np0000001127 nova-compute[98206]: </disk>
May 21 02:11:28.119396 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 02:11:28.202492 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:11:28.204679 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:11:28.368600 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8f609ba6-8747-402b-a6de-077d9b10a676 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "3767becb-caf4-47ee-904f-112069ee8dba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.881s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:28.541594 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lazy-loading 'flavor' on Instance uuid 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:11:28.595343 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-931c1f1e-7150-46dc-95ed-ba6ffc511acf tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lazy-loading 'flavor' on Instance uuid 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:11:28.743084 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-63b13390-84ad-4e53-8469-b9c54374c427 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:28.743084 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-63b13390-84ad-4e53-8469-b9c54374c427 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:28.743084 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-63b13390-84ad-4e53-8469-b9c54374c427 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:28.743084 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-63b13390-84ad-4e53-8469-b9c54374c427 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:28.743084 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-63b13390-84ad-4e53-8469-b9c54374c427 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:28.743869 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-63b13390-84ad-4e53-8469-b9c54374c427 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Terminating instance
May 21 02:11:29.249601 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-63b13390-84ad-4e53-8469-b9c54374c427 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:11:29.273435 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:29.296097 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:29.361947 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:29.454913 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:29.499446 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:29.502494 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:29.550796 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-eab811a5-fa0f-4e33-8256-6b32753b5051 tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 9.774s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:29.573277 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Instance destroyed successfully.
May 21 02:11:29.574957 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-63b13390-84ad-4e53-8469-b9c54374c427 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lazy-loading 'resources' on Instance uuid c76064e6-3702-4e67-9d4f-ef67cd4b7b22 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:11:29.576414 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.99778845999981 future=<Future at 0x71c07c538680 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:11:29.578753 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.99543217099972 future=<Future at 0x71c07c538680 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:11:29.578958 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.995226869999897 future=<Future at 0x71c07c538680 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:11:29.601371 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-931c1f1e-7150-46dc-95ed-ba6ffc511acf tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.673s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:29.602381 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.240s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:29.729179 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-24318ed9-ebfd-4943-8543-51fcfe83a0ef req-58a70f86-1680-4cae-b323-6c967552400f service nova] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Received event network-changed-a8a17868-6e90-432e-b126-c5af5a09ae6b {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:11:29.729961 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-24318ed9-ebfd-4943-8543-51fcfe83a0ef req-58a70f86-1680-4cae-b323-6c967552400f service nova] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Refreshing instance network info cache due to event network-changed-a8a17868-6e90-432e-b126-c5af5a09ae6b. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:11:29.730295 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-24318ed9-ebfd-4943-8543-51fcfe83a0ef req-58a70f86-1680-4cae-b323-6c967552400f service nova] Acquiring lock "refresh_cache-840919c9-6bf6-47ac-bb9c-35ea24494c2e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:11:29.730774 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-24318ed9-ebfd-4943-8543-51fcfe83a0ef req-58a70f86-1680-4cae-b323-6c967552400f service nova] Acquired lock "refresh_cache-840919c9-6bf6-47ac-bb9c-35ea24494c2e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:11:29.731013 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-24318ed9-ebfd-4943-8543-51fcfe83a0ef req-58a70f86-1680-4cae-b323-6c967552400f service nova] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Refreshing network info cache for port a8a17868-6e90-432e-b126-c5af5a09ae6b {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:11:30.080956 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-63b13390-84ad-4e53-8469-b9c54374c427 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:07:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001127',hostname='multiattach-server-1',id=56,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzu+v5yloohnjet+lpl7Cb5m5YuZdtxheBkBGOMBLLe2AJEatmv/W6U1humbPofoJpKHaVTa0sSri4Ktoz/rRBuEiIFUUGVMQjgWmfd958Eyx52s4Fg6gJyB/ru0BJ+zA==',key_name='tempest-keypair-1890511814',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:09:16Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='848912b0c0e94d2795bb2332daf1730e',ramdisk_id='',reservation_id='r-5rppg77m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-289054175',owner_user_name='tempest-AttachVolumeMultiAttachTest-289054175-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:09:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='049d6c8cccfa4ae38d78a88ef5be0f1b',uuid=c76064e6-3702-4e67-9d4f-ef67cd4b7b22,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "address": "fa:16:3e:20:ae:96", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1def3b-46", "ovs_interfaceid": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:11:30.081176 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-63b13390-84ad-4e53-8469-b9c54374c427 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converting VIF {"id": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "address": "fa:16:3e:20:ae:96", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1def3b-46", "ovs_interfaceid": "ad1def3b-4657-4632-bd3a-910cdca9a1a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:11:30.081964 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-63b13390-84ad-4e53-8469-b9c54374c427 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:ae:96,bridge_name='br-int',has_traffic_filtering=True,id=ad1def3b-4657-4632-bd3a-910cdca9a1a4,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad1def3b-46') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:11:30.083355 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-63b13390-84ad-4e53-8469-b9c54374c427 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:ae:96,bridge_name='br-int',has_traffic_filtering=True,id=ad1def3b-4657-4632-bd3a-910cdca9a1a4,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad1def3b-46') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:11:30.084005 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:30.084281 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad1def3b-46, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:11:30.085277 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:30.085988 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:11:30.086418 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:30.087655 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:30.087802 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fb988ddf-e578-4f00-a8e8-dd60c70f8584) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:11:30.088224 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:30.088665 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:11:30.089034 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:30.092134 np0000001127 nova-compute[98206]: INFO os_vif [None req-63b13390-84ad-4e53-8469-b9c54374c427 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:ae:96,bridge_name='br-int',has_traffic_filtering=True,id=ad1def3b-4657-4632-bd3a-910cdca9a1a4,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad1def3b-46')
May 21 02:11:30.092542 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-63b13390-84ad-4e53-8469-b9c54374c427 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Deleting instance files /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22_del
May 21 02:11:30.103583 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-63b13390-84ad-4e53-8469-b9c54374c427 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Deletion of /opt/stack/data/nova/instances/c76064e6-3702-4e67-9d4f-ef67cd4b7b22_del complete
May 21 02:11:30.107153 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Detaching volume cb424a76-1c22-49d9-a6a1-638c98c702b7
May 21 02:11:30.151833 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Attempting to driver detach volume cb424a76-1c22-49d9-a6a1-638c98c702b7 from mountpoint /dev/vdc
May 21 02:11:30.185953 np0000001127 nova-compute[98206]: DEBUG os_brick.encryptors [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cb424a76-1c22-49d9-a6a1-638c98c702b7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-7'}, 'status': 'reserved', 'instance': '6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed', 'attached_at': '', 'detached_at': '', 'volume_id': 'cb424a76-1c22-49d9-a6a1-638c98c702b7', 'serial': 'cb424a76-1c22-49d9-a6a1-638c98c702b7'} {{(pid=98206) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 21 02:11:30.189657 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Found disk vdc by alias ua-cb424a76-1c22-49d9-a6a1-638c98c702b7 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:11:30.191091 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Found disk vdc by alias ua-cb424a76-1c22-49d9-a6a1-638c98c702b7 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:11:30.191091 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Attempting to detach device vdc from instance 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 02:11:30.191323 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:11:30.191323 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:11:30.191323 np0000001127 nova-compute[98206]:   <alias name="ua-cb424a76-1c22-49d9-a6a1-638c98c702b7"/>
May 21 02:11:30.191323 np0000001127 nova-compute[98206]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-7"/>
May 21 02:11:30.191323 np0000001127 nova-compute[98206]:   <target dev="vdc" bus="virtio"/>
May 21 02:11:30.191323 np0000001127 nova-compute[98206]:   <serial>cb424a76-1c22-49d9-a6a1-638c98c702b7</serial>
May 21 02:11:30.191323 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 21 02:11:30.191323 np0000001127 nova-compute[98206]:   <encryption format="luks">
May 21 02:11:30.191323 np0000001127 nova-compute[98206]:     <secret type="passphrase" uuid="cb3781d6-4a8e-4e46-a5da-a1d44d155255"/>
May 21 02:11:30.191323 np0000001127 nova-compute[98206]:   </encryption>
May 21 02:11:30.191323 np0000001127 nova-compute[98206]: </disk>
May 21 02:11:30.191323 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:11:30.196561 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Successfully detached device vdc from instance 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed from the persistent domain config.
May 21 02:11:30.196806 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] (1/8): Attempting to detach device vdc with device alias ua-cb424a76-1c22-49d9-a6a1-638c98c702b7 from instance 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 02:11:30.197082 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:11:30.197082 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:11:30.197082 np0000001127 nova-compute[98206]:   <alias name="ua-cb424a76-1c22-49d9-a6a1-638c98c702b7"/>
May 21 02:11:30.197082 np0000001127 nova-compute[98206]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-7"/>
May 21 02:11:30.197082 np0000001127 nova-compute[98206]:   <target dev="vdc" bus="virtio"/>
May 21 02:11:30.197082 np0000001127 nova-compute[98206]:   <serial>cb424a76-1c22-49d9-a6a1-638c98c702b7</serial>
May 21 02:11:30.197082 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 21 02:11:30.197082 np0000001127 nova-compute[98206]:   <encryption format="luks">
May 21 02:11:30.197082 np0000001127 nova-compute[98206]:     <secret type="passphrase" uuid="cb3781d6-4a8e-4e46-a5da-a1d44d155255"/>
May 21 02:11:30.197082 np0000001127 nova-compute[98206]:   </encryption>
May 21 02:11:30.197082 np0000001127 nova-compute[98206]: </disk>
May 21 02:11:30.197082 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:11:30.233686 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-24318ed9-ebfd-4943-8543-51fcfe83a0ef req-58a70f86-1680-4cae-b323-6c967552400f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:11:30.365868 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-803aa6bc-68a4-4e38-97d8-6ba91ec06bad tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Acquiring lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:30.366211 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-803aa6bc-68a4-4e38-97d8-6ba91ec06bad tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:30.366211 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-803aa6bc-68a4-4e38-97d8-6ba91ec06bad tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Acquiring lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:30.366289 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-803aa6bc-68a4-4e38-97d8-6ba91ec06bad tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:30.366497 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-803aa6bc-68a4-4e38-97d8-6ba91ec06bad tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:30.368255 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-803aa6bc-68a4-4e38-97d8-6ba91ec06bad tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Terminating instance
May 21 02:11:30.583045 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-24318ed9-ebfd-4943-8543-51fcfe83a0ef req-58a70f86-1680-4cae-b323-6c967552400f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:11:30.612869 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-63b13390-84ad-4e53-8469-b9c54374c427 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Took 1.36 seconds to destroy the instance on the hypervisor.
May 21 02:11:30.613462 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-63b13390-84ad-4e53-8469-b9c54374c427 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:11:30.613704 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:11:30.614107 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:11:30.614330 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:11:30.691288 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:11:30.746564 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779329490.7461503, 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed => ua-cb424a76-1c22-49d9-a6a1-638c98c702b7> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 02:11:30.748051 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-cb424a76-1c22-49d9-a6a1-638c98c702b7 for instance 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 02:11:30.750289 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Successfully detached device vdc from instance 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed from the live domain config.
May 21 02:11:30.753647 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:11:30.754034 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cb424a76-1c22-49d9-a6a1-638c98c702b7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-7'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:11:30.754423 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:11:30.771804 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-24318ed9-ebfd-4943-8543-51fcfe83a0ef req-58a70f86-1680-4cae-b323-6c967552400f service nova] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Updated VIF entry in instance network info cache for port a8a17868-6e90-432e-b126-c5af5a09ae6b. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:11:30.772197 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-24318ed9-ebfd-4943-8543-51fcfe83a0ef req-58a70f86-1680-4cae-b323-6c967552400f service nova] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Updating instance_info_cache with network_info: [{"id": "a8a17868-6e90-432e-b126-c5af5a09ae6b", "address": "fa:16:3e:d1:2c:6c", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a17868-6e", "ovs_interfaceid": "a8a17868-6e90-432e-b126-c5af5a09ae6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:11:30.779683 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:11:30.779854 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:11:30.779854 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:11:30.780007 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] No VIF found with MAC fa:16:3e:a1:86:24, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:11:30.873330 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-803aa6bc-68a4-4e38-97d8-6ba91ec06bad tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:11:30.898700 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:30.907040 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:30.925903 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:30.930005 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:30.955159 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:30.955995 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:31.208713 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:31.221210 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:31.241175 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999709291000272 future=<Future at 0x71c0586aaed0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:11:31.242600 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Instance destroyed successfully.
May 21 02:11:31.243069 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-803aa6bc-68a4-4e38-97d8-6ba91ec06bad tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lazy-loading 'resources' on Instance uuid 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:11:31.276052 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-24318ed9-ebfd-4943-8543-51fcfe83a0ef req-58a70f86-1680-4cae-b323-6c967552400f service nova] Releasing lock "refresh_cache-840919c9-6bf6-47ac-bb9c-35ea24494c2e" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:11:31.276236 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-24318ed9-ebfd-4943-8543-51fcfe83a0ef req-58a70f86-1680-4cae-b323-6c967552400f service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Received event network-vif-unplugged-ad1def3b-4657-4632-bd3a-910cdca9a1a4 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:11:31.276391 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-24318ed9-ebfd-4943-8543-51fcfe83a0ef req-58a70f86-1680-4cae-b323-6c967552400f service nova] Acquiring lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:31.276559 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-24318ed9-ebfd-4943-8543-51fcfe83a0ef req-58a70f86-1680-4cae-b323-6c967552400f service nova] Lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:31.276658 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-24318ed9-ebfd-4943-8543-51fcfe83a0ef req-58a70f86-1680-4cae-b323-6c967552400f service nova] Lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:31.276768 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-24318ed9-ebfd-4943-8543-51fcfe83a0ef req-58a70f86-1680-4cae-b323-6c967552400f service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] No waiting events found dispatching network-vif-unplugged-ad1def3b-4657-4632-bd3a-910cdca9a1a4 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:11:31.276874 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-24318ed9-ebfd-4943-8543-51fcfe83a0ef req-58a70f86-1680-4cae-b323-6c967552400f service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Received event network-vif-unplugged-ad1def3b-4657-4632-bd3a-910cdca9a1a4 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:11:31.746110 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-803aa6bc-68a4-4e38-97d8-6ba91ec06bad tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:09:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-903781839',display_name='tempest-TestServerVolumeAttachmentScenario-server-903781839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testservervolumeattachmentscenario-server-903781839',id=63,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQ13y+fEQre9dN8ccQIUYUkIACQC1d81+JDt1eBi/8pm7CUlFyus848PraEdW1zLrSXtgtmDdCNFkekZUupOjk3//3gMviOfdglWKSEo11V+1CnvS8WWMpfl3T+LTP5PA==',key_name='tempest-keypair-1330436068',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:09:16Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c062763c08b4e5190a5351babe96c84',ramdisk_id='',reservation_id='r-k4edly4i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-514659065',owner_user_name='tempest-TestServerVolumeAttachmentScenario-514659065-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:09:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f41e316b794454ba2d5e899e35fc154',uuid=0c15c9f3-e0d2-4d6d-9144-b9760c55be0e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a096ac2-9c5b-4618-87c1-f2400619040e", "address": "fa:16:3e:5c:a9:0d", "network": {"id": "b49de03c-44bf-47f0-a925-60ba84dd5b07", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-970460078-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c062763c08b4e5190a5351babe96c84", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a096ac2-9c", "ovs_interfaceid": "7a096ac2-9c5b-4618-87c1-f2400619040e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:11:31.746780 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-803aa6bc-68a4-4e38-97d8-6ba91ec06bad tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Converting VIF {"id": "7a096ac2-9c5b-4618-87c1-f2400619040e", "address": "fa:16:3e:5c:a9:0d", "network": {"id": "b49de03c-44bf-47f0-a925-60ba84dd5b07", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-970460078-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c062763c08b4e5190a5351babe96c84", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a096ac2-9c", "ovs_interfaceid": "7a096ac2-9c5b-4618-87c1-f2400619040e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:11:31.746903 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-803aa6bc-68a4-4e38-97d8-6ba91ec06bad tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:a9:0d,bridge_name='br-int',has_traffic_filtering=True,id=7a096ac2-9c5b-4618-87c1-f2400619040e,network=Network(b49de03c-44bf-47f0-a925-60ba84dd5b07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a096ac2-9c') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:11:31.747134 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-803aa6bc-68a4-4e38-97d8-6ba91ec06bad tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:a9:0d,bridge_name='br-int',has_traffic_filtering=True,id=7a096ac2-9c5b-4618-87c1-f2400619040e,network=Network(b49de03c-44bf-47f0-a925-60ba84dd5b07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a096ac2-9c') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:11:31.747898 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:31.749288 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a096ac2-9c, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:11:31.750588 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:31.753278 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:11:31.754008 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:31.754181 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5cf74066-59ce-40c0-acd6-059cbe5fedf6) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:11:31.755715 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:31.756394 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:11:31.758602 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:31.760881 np0000001127 nova-compute[98206]: INFO os_vif [None req-803aa6bc-68a4-4e38-97d8-6ba91ec06bad tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:a9:0d,bridge_name='br-int',has_traffic_filtering=True,id=7a096ac2-9c5b-4618-87c1-f2400619040e,network=Network(b49de03c-44bf-47f0-a925-60ba84dd5b07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a096ac2-9c')
May 21 02:11:31.761219 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-803aa6bc-68a4-4e38-97d8-6ba91ec06bad tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Deleting instance files /opt/stack/data/nova/instances/0c15c9f3-e0d2-4d6d-9144-b9760c55be0e_del
May 21 02:11:31.762075 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-803aa6bc-68a4-4e38-97d8-6ba91ec06bad tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Deletion of /opt/stack/data/nova/instances/0c15c9f3-e0d2-4d6d-9144-b9760c55be0e_del complete
May 21 02:11:31.816568 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0fa34b38-c0aa-45fe-bf52-731a428d5675 req-1cfa5e94-8e41-4fc7-947d-81e1ca01ce8e service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Received event network-vif-unplugged-ad1def3b-4657-4632-bd3a-910cdca9a1a4 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:11:31.816632 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0fa34b38-c0aa-45fe-bf52-731a428d5675 req-1cfa5e94-8e41-4fc7-947d-81e1ca01ce8e service nova] Acquiring lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:31.816772 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0fa34b38-c0aa-45fe-bf52-731a428d5675 req-1cfa5e94-8e41-4fc7-947d-81e1ca01ce8e service nova] Lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:31.816880 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0fa34b38-c0aa-45fe-bf52-731a428d5675 req-1cfa5e94-8e41-4fc7-947d-81e1ca01ce8e service nova] Lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:31.817010 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0fa34b38-c0aa-45fe-bf52-731a428d5675 req-1cfa5e94-8e41-4fc7-947d-81e1ca01ce8e service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] No waiting events found dispatching network-vif-unplugged-ad1def3b-4657-4632-bd3a-910cdca9a1a4 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:11:31.817119 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0fa34b38-c0aa-45fe-bf52-731a428d5675 req-1cfa5e94-8e41-4fc7-947d-81e1ca01ce8e service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Received event network-vif-unplugged-ad1def3b-4657-4632-bd3a-910cdca9a1a4 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:11:31.817222 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0fa34b38-c0aa-45fe-bf52-731a428d5675 req-1cfa5e94-8e41-4fc7-947d-81e1ca01ce8e service nova] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Received event network-vif-unplugged-7a096ac2-9c5b-4618-87c1-f2400619040e {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:11:31.817340 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0fa34b38-c0aa-45fe-bf52-731a428d5675 req-1cfa5e94-8e41-4fc7-947d-81e1ca01ce8e service nova] Acquiring lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:31.819061 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0fa34b38-c0aa-45fe-bf52-731a428d5675 req-1cfa5e94-8e41-4fc7-947d-81e1ca01ce8e service nova] Lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:31.820078 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0fa34b38-c0aa-45fe-bf52-731a428d5675 req-1cfa5e94-8e41-4fc7-947d-81e1ca01ce8e service nova] Lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:31.820671 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0fa34b38-c0aa-45fe-bf52-731a428d5675 req-1cfa5e94-8e41-4fc7-947d-81e1ca01ce8e service nova] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] No waiting events found dispatching network-vif-unplugged-7a096ac2-9c5b-4618-87c1-f2400619040e {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:11:31.820805 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0fa34b38-c0aa-45fe-bf52-731a428d5675 req-1cfa5e94-8e41-4fc7-947d-81e1ca01ce8e service nova] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Received event network-vif-unplugged-7a096ac2-9c5b-4618-87c1-f2400619040e for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:11:31.820944 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0fa34b38-c0aa-45fe-bf52-731a428d5675 req-1cfa5e94-8e41-4fc7-947d-81e1ca01ce8e service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Received event network-vif-deleted-ad1def3b-4657-4632-bd3a-910cdca9a1a4 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:11:31.821097 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-0fa34b38-c0aa-45fe-bf52-731a428d5675 req-1cfa5e94-8e41-4fc7-947d-81e1ca01ce8e service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Neutron deleted interface ad1def3b-4657-4632-bd3a-910cdca9a1a4; detaching it from the instance and deleting it from the info cache
May 21 02:11:31.821206 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-0fa34b38-c0aa-45fe-bf52-731a428d5675 req-1cfa5e94-8e41-4fc7-947d-81e1ca01ce8e service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:11:31.865833 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:11:31.971289 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:32.270298 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-803aa6bc-68a4-4e38-97d8-6ba91ec06bad tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Took 1.40 seconds to destroy the instance on the hypervisor.
May 21 02:11:32.273874 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-803aa6bc-68a4-4e38-97d8-6ba91ec06bad tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:11:32.273874 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:11:32.273874 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:11:32.273874 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:11:32.330261 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0fa34b38-c0aa-45fe-bf52-731a428d5675 req-1cfa5e94-8e41-4fc7-947d-81e1ca01ce8e service nova] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Detach interface failed, port_id=ad1def3b-4657-4632-bd3a-910cdca9a1a4, reason: Instance c76064e6-3702-4e67-9d4f-ef67cd4b7b22 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:11:32.330427 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0fa34b38-c0aa-45fe-bf52-731a428d5675 req-1cfa5e94-8e41-4fc7-947d-81e1ca01ce8e service nova] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Received event network-vif-unplugged-7a096ac2-9c5b-4618-87c1-f2400619040e {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:11:32.330629 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0fa34b38-c0aa-45fe-bf52-731a428d5675 req-1cfa5e94-8e41-4fc7-947d-81e1ca01ce8e service nova] Acquiring lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:32.330798 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0fa34b38-c0aa-45fe-bf52-731a428d5675 req-1cfa5e94-8e41-4fc7-947d-81e1ca01ce8e service nova] Lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:32.330990 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0fa34b38-c0aa-45fe-bf52-731a428d5675 req-1cfa5e94-8e41-4fc7-947d-81e1ca01ce8e service nova] Lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:32.331152 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0fa34b38-c0aa-45fe-bf52-731a428d5675 req-1cfa5e94-8e41-4fc7-947d-81e1ca01ce8e service nova] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] No waiting events found dispatching network-vif-unplugged-7a096ac2-9c5b-4618-87c1-f2400619040e {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:11:32.331296 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0fa34b38-c0aa-45fe-bf52-731a428d5675 req-1cfa5e94-8e41-4fc7-947d-81e1ca01ce8e service nova] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Received event network-vif-unplugged-7a096ac2-9c5b-4618-87c1-f2400619040e for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:11:32.360603 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-cf4eb143-313b-4812-933e-e5f4fab2ecff tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "02fd9da8-f514-4e1b-8bd5-bfc8ae21753c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.966s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:32.368893 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Took 1.75 seconds to deallocate network for instance.
May 21 02:11:32.430819 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:11:32.613423 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.859s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:11:32.613823 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cb424a76-1c22-49d9-a6a1-638c98c702b7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:11:32.613956 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:11:32.657200 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:32.657200 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:32.657200 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:32.657200 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:32.657200 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:32.657200 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:32.657200 np0000001127 nova-compute[98206]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:32.657200 np0000001127 nova-compute[98206]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:32.657200 np0000001127 nova-compute[98206]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:32.657200 np0000001127 nova-compute[98206]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:32.657200 np0000001127 nova-compute[98206]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:11:32.657200 np0000001127 nova-compute[98206]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:11:32.657200 np0000001127 nova-compute[98206]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b15ce1b8-b6f7-4859-846b-6f87825697f8 (non-flash)
May 21 02:11:32.657200 np0000001127 nova-compute[98206]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb6eb6b2-914d-42f1-a0b1-1f1aec07de3e (non-flash)
May 21 02:11:32.657200 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:32.657200 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:32.657200 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:11:32.658028 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsi session list stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:32.658028 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:32.658028 np0000001127 nova-compute[98206]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:32.658028 np0000001127 nova-compute[98206]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7 (non-flash)
May 21 02:11:32.658028 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:32.658028 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:32.658028 np0000001127 nova-compute[98206]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:32.658028 np0000001127 nova-compute[98206]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:32.658028 np0000001127 nova-compute[98206]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:32.658028 np0000001127 nova-compute[98206]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:32.658028 np0000001127 nova-compute[98206]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:11:32.658028 np0000001127 nova-compute[98206]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:11:32.658028 np0000001127 nova-compute[98206]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b15ce1b8-b6f7-4859-846b-6f87825697f8 (non-flash)
May 21 02:11:32.658028 np0000001127 nova-compute[98206]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb6eb6b2-914d-42f1-a0b1-1f1aec07de3e (non-flash)
May 21 02:11:32.658028 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:32.658028 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:32.658028 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:11:32.658028 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', '132'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', '133'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', '134'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', '135'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', '144'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', '145'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903', '160'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903', '161'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f', '162'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f', '163'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687', '164'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687', '165'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b15ce1b8-b6f7-4859-846b-6f87825697f8', '166'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eb6eb6b2-914d-42f1-a0b1-1f1aec07de3e', '167'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '95')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:11:32.658028 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', '135')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:11:32.659002 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7', '134')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:11:32.660151 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c73e520>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7'): ({'sdi'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:11:32.660941 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Removing multipathed devices sdi, sdh {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:11:32.661233 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Flush multipath device 3300000004d8c0e31 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:11:32.706693 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:11:32.762816 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:11:32.805911 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:11:32.806320 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:11:32.808012 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:11:32.820224 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:11:32.820459 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:11:32.833398 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:32.877580 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-63b13390-84ad-4e53-8469-b9c54374c427 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:32.879118 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-63b13390-84ad-4e53-8469-b9c54374c427 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:32.883877 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 135, target: iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7, portal: 192.168.40.100,3260]
May 21 02:11:32.883877 np0000001127 nova-compute[98206]: Logout of [sid: 135, target: iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7, portal: 192.168.40.100,3260] successful.
May 21 02:11:32.883877 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:32.926966 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:32.952281 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:32.963773 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "02fd9da8-f514-4e1b-8bd5-bfc8ae21753c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:32.964092 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "02fd9da8-f514-4e1b-8bd5-bfc8ae21753c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:32.995729 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 134, target: iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7, portal: 192.168.50.100,3260]
May 21 02:11:32.995729 np0000001127 nova-compute[98206]: Logout of [sid: 134, target: iqn.2023-03.storpool.com:os--volume-cb424a76-1c22-49d9-a6a1-638c98c702b7, portal: 192.168.50.100,3260] successful.
May 21 02:11:32.995729 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:33.033583 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:33.036575 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.423s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:11:33.036740 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] <== disconnect_volume: return (2283ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:11:33.036907 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:11:33.469361 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Detaching volume f33552f3-023a-4c38-89b4-db5ba0c2c687
May 21 02:11:33.480351 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:11:33.523819 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Attempting to driver detach volume f33552f3-023a-4c38-89b4-db5ba0c2c687 from mountpoint /dev/vdb
May 21 02:11:33.540064 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-63b13390-84ad-4e53-8469-b9c54374c427 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:11:33.540371 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-63b13390-84ad-4e53-8469-b9c54374c427 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:11:33.561909 np0000001127 nova-compute[98206]: DEBUG os_brick.encryptors [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687', 'iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f33552f3-023a-4c38-89b4-db5ba0c2c687', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-14'}, 'status': 'reserved', 'instance': '02fd9da8-f514-4e1b-8bd5-bfc8ae21753c', 'attached_at': '', 'detached_at': '', 'volume_id': 'f33552f3-023a-4c38-89b4-db5ba0c2c687', 'serial': 'f33552f3-023a-4c38-89b4-db5ba0c2c687'} {{(pid=98206) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 21 02:11:33.567623 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Found disk vdb by alias ua-f33552f3-023a-4c38-89b4-db5ba0c2c687 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:11:33.573953 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Found disk vdb by alias ua-f33552f3-023a-4c38-89b4-db5ba0c2c687 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:11:33.573953 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Attempting to detach device vdb from instance 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 02:11:33.573953 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:11:33.573953 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:11:33.573953 np0000001127 nova-compute[98206]:   <alias name="ua-f33552f3-023a-4c38-89b4-db5ba0c2c687"/>
May 21 02:11:33.573953 np0000001127 nova-compute[98206]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-14"/>
May 21 02:11:33.573953 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:11:33.573953 np0000001127 nova-compute[98206]:   <serial>f33552f3-023a-4c38-89b4-db5ba0c2c687</serial>
May 21 02:11:33.573953 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:11:33.573953 np0000001127 nova-compute[98206]:   <encryption format="luks">
May 21 02:11:33.573953 np0000001127 nova-compute[98206]:     <secret type="passphrase" uuid="0943d518-8f70-4de8-9ebb-9502a320d651"/>
May 21 02:11:33.573953 np0000001127 nova-compute[98206]:   </encryption>
May 21 02:11:33.573953 np0000001127 nova-compute[98206]: </disk>
May 21 02:11:33.573953 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:11:33.585154 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Successfully detached device vdb from instance 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c from the persistent domain config.
May 21 02:11:33.586089 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] (1/8): Attempting to detach device vdb with device alias ua-f33552f3-023a-4c38-89b4-db5ba0c2c687 from instance 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 02:11:33.586814 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:11:33.586814 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:11:33.586814 np0000001127 nova-compute[98206]:   <alias name="ua-f33552f3-023a-4c38-89b4-db5ba0c2c687"/>
May 21 02:11:33.586814 np0000001127 nova-compute[98206]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-14"/>
May 21 02:11:33.586814 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:11:33.586814 np0000001127 nova-compute[98206]:   <serial>f33552f3-023a-4c38-89b4-db5ba0c2c687</serial>
May 21 02:11:33.586814 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:11:33.586814 np0000001127 nova-compute[98206]:   <encryption format="luks">
May 21 02:11:33.586814 np0000001127 nova-compute[98206]:     <secret type="passphrase" uuid="0943d518-8f70-4de8-9ebb-9502a320d651"/>
May 21 02:11:33.586814 np0000001127 nova-compute[98206]:   </encryption>
May 21 02:11:33.586814 np0000001127 nova-compute[98206]: </disk>
May 21 02:11:33.586814 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:11:33.597778 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lazy-loading 'flavor' on Instance uuid 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:11:33.902499 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-4a52ef48-5377-45a8-beb7-75a54dd33dbe req-43c42796-8915-4ca1-b2f4-c1e3caf1fe75 service nova] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Received event network-vif-deleted-7a096ac2-9c5b-4618-87c1-f2400619040e {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:11:33.982442 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Took 1.71 seconds to deallocate network for instance.
May 21 02:11:34.043349 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-63b13390-84ad-4e53-8469-b9c54374c427 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:11:34.173132 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779329494.1726973, 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c => ua-f33552f3-023a-4c38-89b4-db5ba0c2c687> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 02:11:34.181251 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-f33552f3-023a-4c38-89b4-db5ba0c2c687 for instance 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 02:11:34.184592 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Successfully detached device vdb from instance 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c from the live domain config.
May 21 02:11:34.187429 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:11:34.189119 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687', 'iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f33552f3-023a-4c38-89b4-db5ba0c2c687', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-14'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:11:34.189119 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:11:34.189119 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:11:34.189119 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687', 'iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f33552f3-023a-4c38-89b4-db5ba0c2c687', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:11:34.189119 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:11:34.234620 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:34.234620 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:34.234620 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:34.234620 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:34.234620 np0000001127 nova-compute[98206]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:34.234620 np0000001127 nova-compute[98206]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:34.234620 np0000001127 nova-compute[98206]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:34.234620 np0000001127 nova-compute[98206]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:34.234620 np0000001127 nova-compute[98206]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:11:34.234620 np0000001127 nova-compute[98206]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:11:34.234620 np0000001127 nova-compute[98206]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b15ce1b8-b6f7-4859-846b-6f87825697f8 (non-flash)
May 21 02:11:34.234620 np0000001127 nova-compute[98206]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb6eb6b2-914d-42f1-a0b1-1f1aec07de3e (non-flash)
May 21 02:11:34.234620 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:34.234620 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:34.234620 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:11:34.234620 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsi session list stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:34.234620 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:34.234620 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:34.234620 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:34.234620 np0000001127 nova-compute[98206]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:34.234620 np0000001127 nova-compute[98206]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:34.234620 np0000001127 nova-compute[98206]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:34.234620 np0000001127 nova-compute[98206]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:34.234620 np0000001127 nova-compute[98206]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:11:34.234620 np0000001127 nova-compute[98206]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687 (non-flash)
May 21 02:11:34.234620 np0000001127 nova-compute[98206]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b15ce1b8-b6f7-4859-846b-6f87825697f8 (non-flash)
May 21 02:11:34.234620 np0000001127 nova-compute[98206]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb6eb6b2-914d-42f1-a0b1-1f1aec07de3e (non-flash)
May 21 02:11:34.234620 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:34.234620 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:34.234620 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:11:34.234620 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', '132'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', '133'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', '144'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', '145'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903', '160'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903', '161'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f', '162'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f', '163'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687', '164'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687', '165'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b15ce1b8-b6f7-4859-846b-6f87825697f8', '166'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eb6eb6b2-914d-42f1-a0b1-1f1aec07de3e', '167'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '95')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:11:34.234620 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687', '164')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:11:34.234620 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687', '165')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:11:34.239754 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c73eb60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687'): ({'sdp'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:11:34.239754 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Removing multipathed devices sdl, sdp {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:11:34.239754 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Flush multipath device 33000000009ae5545 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:11:34.287294 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:11:34.342090 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Remove SCSI device /dev/sdp with /sys/block/sdp/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:11:34.405373 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Checking to see if SCSI volumes sdl, sdp have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:11:34.405373 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] SCSI volumes sdl, sdp have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:11:34.406513 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Checking to see if device paths {'sdl', 'sdp'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:11:34.422555 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Device paths {'sdl', 'sdp'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:11:34.422555 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:11:34.441042 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:34.489481 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-803aa6bc-68a4-4e38-97d8-6ba91ec06bad tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:34.496718 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 164, target: iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687, portal: 192.168.40.100,3260]
May 21 02:11:34.496718 np0000001127 nova-compute[98206]: Logout of [sid: 164, target: iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687, portal: 192.168.40.100,3260] successful.
May 21 02:11:34.496718 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:34.524097 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:34.538958 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:34.549555 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-63b13390-84ad-4e53-8469-b9c54374c427 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.670s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:34.552050 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-803aa6bc-68a4-4e38-97d8-6ba91ec06bad tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.063s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:34.593070 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 165, target: iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687, portal: 192.168.50.100,3260]
May 21 02:11:34.593070 np0000001127 nova-compute[98206]: Logout of [sid: 165, target: iqn.2023-03.storpool.com:os--volume-f33552f3-023a-4c38-89b4-db5ba0c2c687, portal: 192.168.50.100,3260] successful.
May 21 02:11:34.593070 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:34.605031 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d1f7603a-db72-4222-a2fb-de3e0380072a tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:34.628362 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:34.629495 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.441s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:11:34.629725 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] <== disconnect_volume: return (441ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:11:34.630303 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:11:34.652789 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-63b13390-84ad-4e53-8469-b9c54374c427 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Deleted allocations for instance c76064e6-3702-4e67-9d4f-ef67cd4b7b22
May 21 02:11:34.896224 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:34.896672 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:35.150131 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-803aa6bc-68a4-4e38-97d8-6ba91ec06bad tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:11:35.150625 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-803aa6bc-68a4-4e38-97d8-6ba91ec06bad tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:11:35.198290 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lazy-loading 'flavor' on Instance uuid 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:11:35.400718 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Detaching volume ad21d805-0f07-40f2-8238-8fa00d1142e0
May 21 02:11:35.441371 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Attempting to driver detach volume ad21d805-0f07-40f2-8238-8fa00d1142e0 from mountpoint /dev/vdb
May 21 02:11:35.447318 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Found disk vdb by alias ua-ad21d805-0f07-40f2-8238-8fa00d1142e0 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:11:35.449207 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Found disk vdb by alias ua-ad21d805-0f07-40f2-8238-8fa00d1142e0 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:11:35.449207 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Attempting to detach device vdb from instance 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 02:11:35.449489 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:11:35.449489 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:11:35.449489 np0000001127 nova-compute[98206]:   <alias name="ua-ad21d805-0f07-40f2-8238-8fa00d1142e0"/>
May 21 02:11:35.449489 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-11"/>
May 21 02:11:35.449489 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:11:35.449489 np0000001127 nova-compute[98206]:   <serial>ad21d805-0f07-40f2-8238-8fa00d1142e0</serial>
May 21 02:11:35.449489 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:11:35.449489 np0000001127 nova-compute[98206]: </disk>
May 21 02:11:35.449489 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:11:35.458480 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Successfully detached device vdb from instance 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed from the persistent domain config.
May 21 02:11:35.458614 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] (1/8): Attempting to detach device vdb with device alias ua-ad21d805-0f07-40f2-8238-8fa00d1142e0 from instance 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 02:11:35.458815 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:11:35.458815 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:11:35.458815 np0000001127 nova-compute[98206]:   <alias name="ua-ad21d805-0f07-40f2-8238-8fa00d1142e0"/>
May 21 02:11:35.458815 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-11"/>
May 21 02:11:35.458815 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:11:35.458815 np0000001127 nova-compute[98206]:   <serial>ad21d805-0f07-40f2-8238-8fa00d1142e0</serial>
May 21 02:11:35.458815 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:11:35.458815 np0000001127 nova-compute[98206]: </disk>
May 21 02:11:35.458815 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:11:35.655351 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-803aa6bc-68a4-4e38-97d8-6ba91ec06bad tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:11:35.676162 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-63b13390-84ad-4e53-8469-b9c54374c427 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "c76064e6-3702-4e67-9d4f-ef67cd4b7b22" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.935s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:36.088007 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779329496.0875957, 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed => ua-ad21d805-0f07-40f2-8238-8fa00d1142e0> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 02:11:36.089432 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-ad21d805-0f07-40f2-8238-8fa00d1142e0 for instance 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 02:11:36.094092 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0e4e5032-34dc-483a-90b3-2109541e91f2 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:36.094092 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0e4e5032-34dc-483a-90b3-2109541e91f2 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:36.094092 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0e4e5032-34dc-483a-90b3-2109541e91f2 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:36.094092 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0e4e5032-34dc-483a-90b3-2109541e91f2 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:36.094369 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0e4e5032-34dc-483a-90b3-2109541e91f2 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:36.096517 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Successfully detached device vdb from instance 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed from the live domain config.
May 21 02:11:36.096970 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-0e4e5032-34dc-483a-90b3-2109541e91f2 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Terminating instance
May 21 02:11:36.099338 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:11:36.099817 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ad21d805-0f07-40f2-8238-8fa00d1142e0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:11:36.100075 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:11:36.100907 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:11:36.101231 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ad21d805-0f07-40f2-8238-8fa00d1142e0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:11:36.101531 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:11:36.133133 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:36.133133 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:36.133133 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:36.133133 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:36.133133 np0000001127 nova-compute[98206]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:36.133133 np0000001127 nova-compute[98206]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:36.133133 np0000001127 nova-compute[98206]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:36.133133 np0000001127 nova-compute[98206]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:36.133133 np0000001127 nova-compute[98206]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b15ce1b8-b6f7-4859-846b-6f87825697f8 (non-flash)
May 21 02:11:36.133133 np0000001127 nova-compute[98206]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb6eb6b2-914d-42f1-a0b1-1f1aec07de3e (non-flash)
May 21 02:11:36.133133 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:36.133133 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:36.133133 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:11:36.133604 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsi session list stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:36.133604 np0000001127 nova-compute[98206]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0 (non-flash)
May 21 02:11:36.133604 np0000001127 nova-compute[98206]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:36.133604 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:11:36.133604 np0000001127 nova-compute[98206]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:36.133604 np0000001127 nova-compute[98206]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:11:36.133604 np0000001127 nova-compute[98206]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:36.133604 np0000001127 nova-compute[98206]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:11:36.133604 np0000001127 nova-compute[98206]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b15ce1b8-b6f7-4859-846b-6f87825697f8 (non-flash)
May 21 02:11:36.133604 np0000001127 nova-compute[98206]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb6eb6b2-914d-42f1-a0b1-1f1aec07de3e (non-flash)
May 21 02:11:36.133604 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:36.133604 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:11:36.133604 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:11:36.133604 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', '132'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', '133'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', '144'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', '145'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903', '160'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903', '161'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f', '162'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f', '163'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b15ce1b8-b6f7-4859-846b-6f87825697f8', '166'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eb6eb6b2-914d-42f1-a0b1-1f1aec07de3e', '167'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '95')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:11:36.133936 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', '132')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:11:36.135022 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0', '133')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:11:36.138998 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c058467560>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0'): ({'sdm'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0'): ({'sdn'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:11:36.139233 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Removing multipathed devices sdm, sdn {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:11:36.139477 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Flush multipath device 3300000006bd64122 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:11:36.165014 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-803aa6bc-68a4-4e38-97d8-6ba91ec06bad tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.611s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:36.175973 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:11:36.211711 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-00bf7b6e-fbb3-4bf9-bc33-9495f372790b tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "02fd9da8-f514-4e1b-8bd5-bfc8ae21753c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.248s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:36.231326 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:11:36.241243 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-803aa6bc-68a4-4e38-97d8-6ba91ec06bad tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Deleted allocations for instance 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e
May 21 02:11:36.274204 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Checking to see if SCSI volumes sdm, sdn have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:11:36.274379 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] SCSI volumes sdm, sdn have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:11:36.275969 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Checking to see if device paths {'sdm', 'sdn'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:11:36.291634 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Device paths {'sdm', 'sdn'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:11:36.291772 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:11:36.306937 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:36.342057 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 132, target: iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0, portal: 192.168.40.100,3260]
May 21 02:11:36.342057 np0000001127 nova-compute[98206]: Logout of [sid: 132, target: iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0, portal: 192.168.40.100,3260] successful.
May 21 02:11:36.342057 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:36.369189 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:36.380672 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:36.430137 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 133, target: iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0, portal: 192.168.50.100,3260]
May 21 02:11:36.430137 np0000001127 nova-compute[98206]: Logout of [sid: 133, target: iqn.2023-03.storpool.com:os--volume-ad21d805-0f07-40f2-8238-8fa00d1142e0, portal: 192.168.50.100,3260] successful.
May 21 02:11:36.430137 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:36.451616 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:11:36.451838 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:11:36.451977 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] <== disconnect_volume: return (352ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:11:36.452062 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:11:36.601213 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-0e4e5032-34dc-483a-90b3-2109541e91f2 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:11:36.628047 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:36.655916 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:36.758540 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:36.828823 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:36.837508 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:36.939811 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e6847045-25cd-4121-a98e-51496603e8bd req-2d618979-7bb6-41c7-a145-eb30fcadae44 service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Received event network-vif-unplugged-2b286fbf-a6fe-4dcc-af12-2521cf154dbb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:11:36.942449 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e6847045-25cd-4121-a98e-51496603e8bd req-2d618979-7bb6-41c7-a145-eb30fcadae44 service nova] Acquiring lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:36.942449 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e6847045-25cd-4121-a98e-51496603e8bd req-2d618979-7bb6-41c7-a145-eb30fcadae44 service nova] Lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:36.942665 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e6847045-25cd-4121-a98e-51496603e8bd req-2d618979-7bb6-41c7-a145-eb30fcadae44 service nova] Lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:36.942803 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e6847045-25cd-4121-a98e-51496603e8bd req-2d618979-7bb6-41c7-a145-eb30fcadae44 service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] No waiting events found dispatching network-vif-unplugged-2b286fbf-a6fe-4dcc-af12-2521cf154dbb {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:11:36.942916 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e6847045-25cd-4121-a98e-51496603e8bd req-2d618979-7bb6-41c7-a145-eb30fcadae44 service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Received event network-vif-unplugged-2b286fbf-a6fe-4dcc-af12-2521cf154dbb for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:11:36.943224 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:36.951773 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:36.973540 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:36.978396 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999716153999998 future=<Future at 0x71c0584c0470 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:11:36.983966 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Instance destroyed successfully.
May 21 02:11:36.986634 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-0e4e5032-34dc-483a-90b3-2109541e91f2 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lazy-loading 'resources' on Instance uuid aa3f5a78-fb82-4e21-8ebf-90bf48a122be {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:11:37.024156 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lazy-loading 'flavor' on Instance uuid 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:11:37.256342 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-803aa6bc-68a4-4e38-97d8-6ba91ec06bad tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Lock "0c15c9f3-e0d2-4d6d-9144-b9760c55be0e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.890s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:37.438353 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-768b9bca-b4be-4224-a182-21868a14eeab tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "02fd9da8-f514-4e1b-8bd5-bfc8ae21753c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:37.438535 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-768b9bca-b4be-4224-a182-21868a14eeab tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "02fd9da8-f514-4e1b-8bd5-bfc8ae21753c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:37.438713 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-768b9bca-b4be-4224-a182-21868a14eeab tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "02fd9da8-f514-4e1b-8bd5-bfc8ae21753c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:37.438853 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-768b9bca-b4be-4224-a182-21868a14eeab tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "02fd9da8-f514-4e1b-8bd5-bfc8ae21753c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:37.438983 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-768b9bca-b4be-4224-a182-21868a14eeab tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "02fd9da8-f514-4e1b-8bd5-bfc8ae21753c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:37.440981 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-768b9bca-b4be-4224-a182-21868a14eeab tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Terminating instance
May 21 02:11:37.504090 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-0e4e5032-34dc-483a-90b3-2109541e91f2 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:06:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001127',hostname='multiattach-server-0',id=54,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzu+v5yloohnjet+lpl7Cb5m5YuZdtxheBkBGOMBLLe2AJEatmv/W6U1humbPofoJpKHaVTa0sSri4Ktoz/rRBuEiIFUUGVMQjgWmfd958Eyx52s4Fg6gJyB/ru0BJ+zA==',key_name='tempest-keypair-1890511814',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:08:21Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='848912b0c0e94d2795bb2332daf1730e',ramdisk_id='',reservation_id='r-riou1f0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-289054175',owner_user_name='tempest-AttachVolumeMultiAttachTest-289054175-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:08:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='049d6c8cccfa4ae38d78a88ef5be0f1b',uuid=aa3f5a78-fb82-4e21-8ebf-90bf48a122be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "address": "fa:16:3e:db:08:dd", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b286fbf-a6", "ovs_interfaceid": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:11:37.504090 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-0e4e5032-34dc-483a-90b3-2109541e91f2 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converting VIF {"id": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "address": "fa:16:3e:db:08:dd", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b286fbf-a6", "ovs_interfaceid": "2b286fbf-a6fe-4dcc-af12-2521cf154dbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:11:37.504417 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-0e4e5032-34dc-483a-90b3-2109541e91f2 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:08:dd,bridge_name='br-int',has_traffic_filtering=True,id=2b286fbf-a6fe-4dcc-af12-2521cf154dbb,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b286fbf-a6') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:11:37.504639 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-0e4e5032-34dc-483a-90b3-2109541e91f2 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:08:dd,bridge_name='br-int',has_traffic_filtering=True,id=2b286fbf-a6fe-4dcc-af12-2521cf154dbb,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b286fbf-a6') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:11:37.505658 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:37.505980 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b286fbf-a6, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:11:37.513914 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:37.514926 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:11:37.515122 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:37.518560 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:37.518726 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0251aa81-6430-4766-90a2-a08c48c804e0) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:11:37.519237 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:37.520445 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:11:37.520445 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:37.523285 np0000001127 nova-compute[98206]: INFO os_vif [None req-0e4e5032-34dc-483a-90b3-2109541e91f2 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:08:dd,bridge_name='br-int',has_traffic_filtering=True,id=2b286fbf-a6fe-4dcc-af12-2521cf154dbb,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b286fbf-a6')
May 21 02:11:37.523640 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-0e4e5032-34dc-483a-90b3-2109541e91f2 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Deleting instance files /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be_del
May 21 02:11:37.532984 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-0e4e5032-34dc-483a-90b3-2109541e91f2 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Deletion of /opt/stack/data/nova/instances/aa3f5a78-fb82-4e21-8ebf-90bf48a122be_del complete
May 21 02:11:37.943740 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-768b9bca-b4be-4224-a182-21868a14eeab tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:11:37.966640 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:37.975116 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:37.990512 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:37.995619 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:38.013841 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:38.019444 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:38.035728 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-132d1ca7-a53f-490b-b841-5cceb925f83d tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.139s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:38.043547 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-0e4e5032-34dc-483a-90b3-2109541e91f2 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Took 1.44 seconds to destroy the instance on the hypervisor.
May 21 02:11:38.044190 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-0e4e5032-34dc-483a-90b3-2109541e91f2 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:11:38.044567 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:11:38.044693 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:11:38.045564 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:11:38.112778 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:11:38.128902 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-64d69a72-bf8b-48ea-a8e1-fbae1e2ed506 req-022b0a92-f605-47c1-a5f2-1aef4a5cb959 service nova] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Received event network-vif-unplugged-73cedad7-cb27-466f-9b50-2f39f6ce0275 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:11:38.129039 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-64d69a72-bf8b-48ea-a8e1-fbae1e2ed506 req-022b0a92-f605-47c1-a5f2-1aef4a5cb959 service nova] Acquiring lock "02fd9da8-f514-4e1b-8bd5-bfc8ae21753c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:38.129260 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-64d69a72-bf8b-48ea-a8e1-fbae1e2ed506 req-022b0a92-f605-47c1-a5f2-1aef4a5cb959 service nova] Lock "02fd9da8-f514-4e1b-8bd5-bfc8ae21753c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:38.129367 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-64d69a72-bf8b-48ea-a8e1-fbae1e2ed506 req-022b0a92-f605-47c1-a5f2-1aef4a5cb959 service nova] Lock "02fd9da8-f514-4e1b-8bd5-bfc8ae21753c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:38.129511 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-64d69a72-bf8b-48ea-a8e1-fbae1e2ed506 req-022b0a92-f605-47c1-a5f2-1aef4a5cb959 service nova] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] No waiting events found dispatching network-vif-unplugged-73cedad7-cb27-466f-9b50-2f39f6ce0275 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:11:38.129652 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-64d69a72-bf8b-48ea-a8e1-fbae1e2ed506 req-022b0a92-f605-47c1-a5f2-1aef4a5cb959 service nova] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Received event network-vif-unplugged-73cedad7-cb27-466f-9b50-2f39f6ce0275 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:11:38.256283 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:38.265881 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:38.293692 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999708490000103 future=<Future at 0x71c058649550 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:11:38.297232 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Instance destroyed successfully.
May 21 02:11:38.297933 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-768b9bca-b4be-4224-a182-21868a14eeab tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lazy-loading 'resources' on Instance uuid 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:11:38.805502 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-768b9bca-b4be-4224-a182-21868a14eeab tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:10:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1392099481',display_name='tempest-TestEncryptedCinderVolumes-server-1392099481',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testencryptedcindervolumes-server-1392099481',id=68,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPFkX7UV4mHln3a/uGQfatBLK2clN7H3IAr1QF0u5i0PnEYyD30XeDLj3teHetQ+AOB/iBr3O0cLCWJ5gSP5gTSRchXH+aPm6uprrkUllgoTrfowfNBxxi/gw9shRScx5A==',key_name='tempest-keypair-741803298',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:10:25Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='517a45856efe44aa92f802f146b17616',ramdisk_id='',reservation_id='r-atvvjlqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-1523380334',owner_user_name='tempest-TestEncryptedCinderVolumes-1523380334-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:10:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68fd64fea5a84a0bbb1d09de7d76709c',uuid=02fd9da8-f514-4e1b-8bd5-bfc8ae21753c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73cedad7-cb27-466f-9b50-2f39f6ce0275", "address": "fa:16:3e:a1:86:24", "network": {"id": "68132179-7a2d-4b6f-bc7a-da8f937a9fb2", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1224285668-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "517a45856efe44aa92f802f146b17616", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73cedad7-cb", "ovs_interfaceid": "73cedad7-cb27-466f-9b50-2f39f6ce0275", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:11:38.805658 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-768b9bca-b4be-4224-a182-21868a14eeab tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Converting VIF {"id": "73cedad7-cb27-466f-9b50-2f39f6ce0275", "address": "fa:16:3e:a1:86:24", "network": {"id": "68132179-7a2d-4b6f-bc7a-da8f937a9fb2", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1224285668-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "517a45856efe44aa92f802f146b17616", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73cedad7-cb", "ovs_interfaceid": "73cedad7-cb27-466f-9b50-2f39f6ce0275", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:11:38.806267 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-768b9bca-b4be-4224-a182-21868a14eeab tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:86:24,bridge_name='br-int',has_traffic_filtering=True,id=73cedad7-cb27-466f-9b50-2f39f6ce0275,network=Network(68132179-7a2d-4b6f-bc7a-da8f937a9fb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73cedad7-cb') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:11:38.806520 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-768b9bca-b4be-4224-a182-21868a14eeab tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:86:24,bridge_name='br-int',has_traffic_filtering=True,id=73cedad7-cb27-466f-9b50-2f39f6ce0275,network=Network(68132179-7a2d-4b6f-bc7a-da8f937a9fb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73cedad7-cb') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:11:38.809384 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:38.809384 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73cedad7-cb, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:11:38.810756 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:38.812182 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:38.813418 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:38.813607 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=729a7b2f-bb79-4b8b-9911-6c0ae31c0f1a) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:11:38.814912 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:38.815198 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:11:38.816622 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:38.818391 np0000001127 nova-compute[98206]: INFO os_vif [None req-768b9bca-b4be-4224-a182-21868a14eeab tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:86:24,bridge_name='br-int',has_traffic_filtering=True,id=73cedad7-cb27-466f-9b50-2f39f6ce0275,network=Network(68132179-7a2d-4b6f-bc7a-da8f937a9fb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73cedad7-cb')
May 21 02:11:38.818681 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-768b9bca-b4be-4224-a182-21868a14eeab tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Deleting instance files /opt/stack/data/nova/instances/02fd9da8-f514-4e1b-8bd5-bfc8ae21753c_del
May 21 02:11:38.819486 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-768b9bca-b4be-4224-a182-21868a14eeab tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Deletion of /opt/stack/data/nova/instances/02fd9da8-f514-4e1b-8bd5-bfc8ae21753c_del complete
May 21 02:11:38.999332 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:11:39.048066 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e7a473f8-75fa-4616-a3c7-b4bf55826f33 req-bfc47886-8988-4e2f-b814-76fd1ad7699b service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Received event network-vif-unplugged-2b286fbf-a6fe-4dcc-af12-2521cf154dbb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:11:39.049979 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e7a473f8-75fa-4616-a3c7-b4bf55826f33 req-bfc47886-8988-4e2f-b814-76fd1ad7699b service nova] Acquiring lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:39.050262 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e7a473f8-75fa-4616-a3c7-b4bf55826f33 req-bfc47886-8988-4e2f-b814-76fd1ad7699b service nova] Lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:39.050491 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e7a473f8-75fa-4616-a3c7-b4bf55826f33 req-bfc47886-8988-4e2f-b814-76fd1ad7699b service nova] Lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:39.050658 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e7a473f8-75fa-4616-a3c7-b4bf55826f33 req-bfc47886-8988-4e2f-b814-76fd1ad7699b service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] No waiting events found dispatching network-vif-unplugged-2b286fbf-a6fe-4dcc-af12-2521cf154dbb {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:11:39.051009 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e7a473f8-75fa-4616-a3c7-b4bf55826f33 req-bfc47886-8988-4e2f-b814-76fd1ad7699b service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Received event network-vif-unplugged-2b286fbf-a6fe-4dcc-af12-2521cf154dbb for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:11:39.325875 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-768b9bca-b4be-4224-a182-21868a14eeab tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Took 1.38 seconds to destroy the instance on the hypervisor.
May 21 02:11:39.326567 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-768b9bca-b4be-4224-a182-21868a14eeab tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:11:39.326943 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:11:39.327028 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:11:39.327234 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:11:39.417313 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:11:39.506381 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Took 1.46 seconds to deallocate network for instance.
May 21 02:11:40.032823 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0e4e5032-34dc-483a-90b3-2109541e91f2 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:40.034147 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0e4e5032-34dc-483a-90b3-2109541e91f2 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:40.196525 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1a282c4e-03d9-4121-b627-25e1b81d3998 req-736373fa-e36d-4557-9fc1-c4845132fa32 service nova] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Received event network-vif-unplugged-73cedad7-cb27-466f-9b50-2f39f6ce0275 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:11:40.197006 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1a282c4e-03d9-4121-b627-25e1b81d3998 req-736373fa-e36d-4557-9fc1-c4845132fa32 service nova] Acquiring lock "02fd9da8-f514-4e1b-8bd5-bfc8ae21753c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:40.198277 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1a282c4e-03d9-4121-b627-25e1b81d3998 req-736373fa-e36d-4557-9fc1-c4845132fa32 service nova] Lock "02fd9da8-f514-4e1b-8bd5-bfc8ae21753c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:40.198277 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1a282c4e-03d9-4121-b627-25e1b81d3998 req-736373fa-e36d-4557-9fc1-c4845132fa32 service nova] Lock "02fd9da8-f514-4e1b-8bd5-bfc8ae21753c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:40.198277 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1a282c4e-03d9-4121-b627-25e1b81d3998 req-736373fa-e36d-4557-9fc1-c4845132fa32 service nova] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] No waiting events found dispatching network-vif-unplugged-73cedad7-cb27-466f-9b50-2f39f6ce0275 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:11:40.198277 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1a282c4e-03d9-4121-b627-25e1b81d3998 req-736373fa-e36d-4557-9fc1-c4845132fa32 service nova] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Received event network-vif-unplugged-73cedad7-cb27-466f-9b50-2f39f6ce0275 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:11:40.198277 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1a282c4e-03d9-4121-b627-25e1b81d3998 req-736373fa-e36d-4557-9fc1-c4845132fa32 service nova] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Received event network-vif-deleted-2b286fbf-a6fe-4dcc-af12-2521cf154dbb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:11:40.198277 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1a282c4e-03d9-4121-b627-25e1b81d3998 req-736373fa-e36d-4557-9fc1-c4845132fa32 service nova] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Received event network-vif-deleted-73cedad7-cb27-466f-9b50-2f39f6ce0275 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:11:40.198277 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-1a282c4e-03d9-4121-b627-25e1b81d3998 req-736373fa-e36d-4557-9fc1-c4845132fa32 service nova] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Neutron deleted interface 73cedad7-cb27-466f-9b50-2f39f6ce0275; detaching it from the instance and deleting it from the info cache
May 21 02:11:40.198277 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-1a282c4e-03d9-4121-b627-25e1b81d3998 req-736373fa-e36d-4557-9fc1-c4845132fa32 service nova] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:11:40.390112 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:11:40.563177 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0e4e5032-34dc-483a-90b3-2109541e91f2 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:11:40.563364 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-0e4e5032-34dc-483a-90b3-2109541e91f2 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:11:40.706225 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1a282c4e-03d9-4121-b627-25e1b81d3998 req-736373fa-e36d-4557-9fc1-c4845132fa32 service nova] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Detach interface failed, port_id=73cedad7-cb27-466f-9b50-2f39f6ce0275, reason: Instance 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:11:40.892708 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Took 1.57 seconds to deallocate network for instance.
May 21 02:11:41.066019 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-0e4e5032-34dc-483a-90b3-2109541e91f2 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:11:41.402657 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-768b9bca-b4be-4224-a182-21868a14eeab tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:41.573778 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0e4e5032-34dc-483a-90b3-2109541e91f2 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.540s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:41.575669 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-768b9bca-b4be-4224-a182-21868a14eeab tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.173s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:41.665262 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-0e4e5032-34dc-483a-90b3-2109541e91f2 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Deleted allocations for instance aa3f5a78-fb82-4e21-8ebf-90bf48a122be
May 21 02:11:41.692215 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8fc31838-b4bb-46bd-b142-616d2398ced0 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:41.700979 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8fc31838-b4bb-46bd-b142-616d2398ced0 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.009s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:41.701757 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8fc31838-b4bb-46bd-b142-616d2398ced0 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:41.704211 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8fc31838-b4bb-46bd-b142-616d2398ced0 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:41.704435 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8fc31838-b4bb-46bd-b142-616d2398ced0 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:41.709391 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-8fc31838-b4bb-46bd-b142-616d2398ced0 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Terminating instance
May 21 02:11:41.976881 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:42.095132 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:42.098192 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-768b9bca-b4be-4224-a182-21868a14eeab tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:11:42.098369 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-768b9bca-b4be-4224-a182-21868a14eeab tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:11:42.213129 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-8fc31838-b4bb-46bd-b142-616d2398ced0 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:11:42.249714 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:42.254045 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:42.276747 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:42.279170 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:42.310372 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:42.463509 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-4c51cca4-a724-424d-bcaa-241c6ec63f93 req-1b52a184-808e-4408-a0b6-d5b7647ec9fb service nova] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Received event network-vif-unplugged-a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:11:42.463509 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4c51cca4-a724-424d-bcaa-241c6ec63f93 req-1b52a184-808e-4408-a0b6-d5b7647ec9fb service nova] Acquiring lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:42.464033 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4c51cca4-a724-424d-bcaa-241c6ec63f93 req-1b52a184-808e-4408-a0b6-d5b7647ec9fb service nova] Lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:42.464033 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4c51cca4-a724-424d-bcaa-241c6ec63f93 req-1b52a184-808e-4408-a0b6-d5b7647ec9fb service nova] Lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:42.464033 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-4c51cca4-a724-424d-bcaa-241c6ec63f93 req-1b52a184-808e-4408-a0b6-d5b7647ec9fb service nova] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] No waiting events found dispatching network-vif-unplugged-a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:11:42.464033 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-4c51cca4-a724-424d-bcaa-241c6ec63f93 req-1b52a184-808e-4408-a0b6-d5b7647ec9fb service nova] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Received event network-vif-unplugged-a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:11:42.568359 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999683213000026 future=<Future at 0x71c05822c3b0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:11:42.573621 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Instance destroyed successfully.
May 21 02:11:42.574172 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-8fc31838-b4bb-46bd-b142-616d2398ced0 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lazy-loading 'resources' on Instance uuid 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:11:42.600952 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-768b9bca-b4be-4224-a182-21868a14eeab tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:11:42.676188 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0e4e5032-34dc-483a-90b3-2109541e91f2 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "aa3f5a78-fb82-4e21-8ebf-90bf48a122be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.583s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:43.078030 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-8fc31838-b4bb-46bd-b142-616d2398ced0 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:07:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1044373802',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumemultiattachtests-server-1044373802',id=57,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG49/r2Ab7Qm1KfDPUwJai4qjLSCzazkse8keaGMf9RDSFnwzlyAfx0W/eKq+/pIZ6H88F7NAAW2g3zgnzAemSR+PHn4ESPDrxs+tFUrSTfyQy6BP7J2Yru23PLQSySpLA==',key_name='tempest-keypair-1913749436',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:07:40Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ae2ef74a1614eb09e4f71f709f64126',ramdisk_id='',reservation_id='r-xw26snxy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-1039130224',owner_user_name='tempest-VolumeMultiattachTests-1039130224-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:07:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01cc41344ae640f6aa9c6142252838b2',uuid=6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01", "address": "fa:16:3e:b8:d1:01", "network": {"id": "dec0dbdb-dfbe-4a3d-9d29-6add07c9003f", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-775185877-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ae2ef74a1614eb09e4f71f709f64126", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3938f5f-e8", "ovs_interfaceid": "a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:11:43.078590 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-8fc31838-b4bb-46bd-b142-616d2398ced0 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Converting VIF {"id": "a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01", "address": "fa:16:3e:b8:d1:01", "network": {"id": "dec0dbdb-dfbe-4a3d-9d29-6add07c9003f", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-775185877-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ae2ef74a1614eb09e4f71f709f64126", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3938f5f-e8", "ovs_interfaceid": "a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:11:43.078802 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-8fc31838-b4bb-46bd-b142-616d2398ced0 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:d1:01,bridge_name='br-int',has_traffic_filtering=True,id=a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01,network=Network(dec0dbdb-dfbe-4a3d-9d29-6add07c9003f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3938f5f-e8') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:11:43.079006 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-8fc31838-b4bb-46bd-b142-616d2398ced0 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:d1:01,bridge_name='br-int',has_traffic_filtering=True,id=a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01,network=Network(dec0dbdb-dfbe-4a3d-9d29-6add07c9003f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3938f5f-e8') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:11:43.080006 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:43.080326 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3938f5f-e8, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:11:43.081505 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:43.082593 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:11:43.084542 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:43.088082 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:43.088227 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aec07053-648d-4525-83af-84ac58637dee) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:11:43.093436 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:43.094437 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:11:43.098019 np0000001127 nova-compute[98206]: INFO os_vif [None req-8fc31838-b4bb-46bd-b142-616d2398ced0 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:d1:01,bridge_name='br-int',has_traffic_filtering=True,id=a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01,network=Network(dec0dbdb-dfbe-4a3d-9d29-6add07c9003f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3938f5f-e8')
May 21 02:11:43.098185 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-8fc31838-b4bb-46bd-b142-616d2398ced0 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Deleting instance files /opt/stack/data/nova/instances/6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed_del
May 21 02:11:43.098785 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-8fc31838-b4bb-46bd-b142-616d2398ced0 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Deletion of /opt/stack/data/nova/instances/6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed_del complete
May 21 02:11:43.110586 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-768b9bca-b4be-4224-a182-21868a14eeab tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.535s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:43.177639 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-768b9bca-b4be-4224-a182-21868a14eeab tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Deleted allocations for instance 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c
May 21 02:11:43.609209 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-8fc31838-b4bb-46bd-b142-616d2398ced0 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Took 1.40 seconds to destroy the instance on the hypervisor.
May 21 02:11:43.610060 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-8fc31838-b4bb-46bd-b142-616d2398ced0 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:11:43.610441 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:11:43.610579 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:11:43.611086 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:11:43.685759 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:11:44.100481 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-422dde93-a7c6-49ba-a888-f789902a0c80 req-82d9e150-d895-43cb-80d8-e9d0384ba231 service nova] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Received event network-vif-deleted-a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:11:44.100698 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-422dde93-a7c6-49ba-a888-f789902a0c80 req-82d9e150-d895-43cb-80d8-e9d0384ba231 service nova] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Neutron deleted interface a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01; detaching it from the instance and deleting it from the info cache
May 21 02:11:44.100866 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-422dde93-a7c6-49ba-a888-f789902a0c80 req-82d9e150-d895-43cb-80d8-e9d0384ba231 service nova] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:11:44.190406 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-768b9bca-b4be-4224-a182-21868a14eeab tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "02fd9da8-f514-4e1b-8bd5-bfc8ae21753c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.752s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:44.207131 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:44.526048 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:11:44.574817 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0003339210002195614 future=<Future at 0x71c07c538680 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:11:44.574971 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Emitting event <LifecycleEvent: 1779329489.5740633, c76064e6-3702-4e67-9d4f-ef67cd4b7b22 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:11:44.575098 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:11:44.575256 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] VM Stopped (Lifecycle Event)
May 21 02:11:44.576292 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=1.664356665000014 future=<Future at 0x71c0586aaed0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:11:44.576384 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=1.6642485460001808 future=<Future at 0x71c0586aaed0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:11:44.583429 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-08cd167d-a477-4456-8681-11e8a9bd2710 req-b779b200-abd2-4195-aeb5-70bc91ae5c6f service nova] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Received event network-vif-unplugged-a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:11:44.583429 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-08cd167d-a477-4456-8681-11e8a9bd2710 req-b779b200-abd2-4195-aeb5-70bc91ae5c6f service nova] Acquiring lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:44.583831 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-08cd167d-a477-4456-8681-11e8a9bd2710 req-b779b200-abd2-4195-aeb5-70bc91ae5c6f service nova] Lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:44.583831 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-08cd167d-a477-4456-8681-11e8a9bd2710 req-b779b200-abd2-4195-aeb5-70bc91ae5c6f service nova] Lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:44.584098 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-08cd167d-a477-4456-8681-11e8a9bd2710 req-b779b200-abd2-4195-aeb5-70bc91ae5c6f service nova] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] No waiting events found dispatching network-vif-unplugged-a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:11:44.584242 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-08cd167d-a477-4456-8681-11e8a9bd2710 req-b779b200-abd2-4195-aeb5-70bc91ae5c6f service nova] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Received event network-vif-unplugged-a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:11:44.606991 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-422dde93-a7c6-49ba-a888-f789902a0c80 req-82d9e150-d895-43cb-80d8-e9d0384ba231 service nova] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Detach interface failed, port_id=a3938f5f-e8c8-4ee3-8492-dcd0d9c75d01, reason: Instance 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:11:44.901766 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-839d2adc-383f-49bb-83b3-7f60e30312e6 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "b6df4554-8490-4d5a-9d4d-acfd46419cb3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:44.902262 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-839d2adc-383f-49bb-83b3-7f60e30312e6 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "b6df4554-8490-4d5a-9d4d-acfd46419cb3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:44.902262 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-839d2adc-383f-49bb-83b3-7f60e30312e6 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "b6df4554-8490-4d5a-9d4d-acfd46419cb3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:44.902262 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-839d2adc-383f-49bb-83b3-7f60e30312e6 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "b6df4554-8490-4d5a-9d4d-acfd46419cb3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:44.902402 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-839d2adc-383f-49bb-83b3-7f60e30312e6 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "b6df4554-8490-4d5a-9d4d-acfd46419cb3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:44.907926 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-839d2adc-383f-49bb-83b3-7f60e30312e6 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Terminating instance
May 21 02:11:45.027808 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Took 1.42 seconds to deallocate network for instance.
May 21 02:11:45.078480 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e373548b-ca61-43f3-9641-38167ec13673 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: c76064e6-3702-4e67-9d4f-ef67cd4b7b22] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:11:45.413953 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-839d2adc-383f-49bb-83b3-7f60e30312e6 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:11:45.433288 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:45.440656 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:45.459209 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:45.533756 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8fc31838-b4bb-46bd-b142-616d2398ced0 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:45.533938 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8fc31838-b4bb-46bd-b142-616d2398ced0 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:45.625217 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:45.631025 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:45.642827 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-606b61d0-4963-4c77-a260-6340fb8e2495 req-56b22695-bc35-47b9-8db3-3b3dffd1353d service nova] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Received event network-vif-unplugged-2df7e0cb-dcdb-4934-82e5-97157bb2e5a5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:11:45.643807 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-606b61d0-4963-4c77-a260-6340fb8e2495 req-56b22695-bc35-47b9-8db3-3b3dffd1353d service nova] Acquiring lock "b6df4554-8490-4d5a-9d4d-acfd46419cb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:45.644304 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-606b61d0-4963-4c77-a260-6340fb8e2495 req-56b22695-bc35-47b9-8db3-3b3dffd1353d service nova] Lock "b6df4554-8490-4d5a-9d4d-acfd46419cb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:45.644304 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-606b61d0-4963-4c77-a260-6340fb8e2495 req-56b22695-bc35-47b9-8db3-3b3dffd1353d service nova] Lock "b6df4554-8490-4d5a-9d4d-acfd46419cb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:45.644619 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-606b61d0-4963-4c77-a260-6340fb8e2495 req-56b22695-bc35-47b9-8db3-3b3dffd1353d service nova] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] No waiting events found dispatching network-vif-unplugged-2df7e0cb-dcdb-4934-82e5-97157bb2e5a5 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:11:45.644902 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-606b61d0-4963-4c77-a260-6340fb8e2495 req-56b22695-bc35-47b9-8db3-3b3dffd1353d service nova] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Received event network-vif-unplugged-2df7e0cb-dcdb-4934-82e5-97157bb2e5a5 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:11:45.763833 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999702837999848 future=<Future at 0x71c07c737f20 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:11:45.765665 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Instance destroyed successfully.
May 21 02:11:45.766710 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-839d2adc-383f-49bb-83b3-7f60e30312e6 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lazy-loading 'resources' on Instance uuid b6df4554-8490-4d5a-9d4d-acfd46419cb3 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:11:45.971451 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8fc31838-b4bb-46bd-b142-616d2398ced0 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:11:45.971789 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-8fc31838-b4bb-46bd-b142-616d2398ced0 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:11:46.240990 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0003214190001017414 future=<Future at 0x71c0586aaed0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:11:46.241395 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] Emitting event <LifecycleEvent: 1779329491.240587, 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:11:46.242189 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:11:46.242189 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] VM Stopped (Lifecycle Event)
May 21 02:11:46.242819 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=5.735158934000083 future=<Future at 0x71c0584c0470 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:11:46.242990 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=5.734953101999963 future=<Future at 0x71c0584c0470 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:11:46.272942 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-839d2adc-383f-49bb-83b3-7f60e30312e6 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:05:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='multiattach-server-1',id=49,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzu+v5yloohnjet+lpl7Cb5m5YuZdtxheBkBGOMBLLe2AJEatmv/W6U1humbPofoJpKHaVTa0sSri4Ktoz/rRBuEiIFUUGVMQjgWmfd958Eyx52s4Fg6gJyB/ru0BJ+zA==',key_name='tempest-keypair-1890511814',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:06:14Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='848912b0c0e94d2795bb2332daf1730e',ramdisk_id='',reservation_id='r-enzzniws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-289054175',owner_user_name='tempest-AttachVolumeMultiAttachTest-289054175-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:06:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='049d6c8cccfa4ae38d78a88ef5be0f1b',uuid=b6df4554-8490-4d5a-9d4d-acfd46419cb3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2df7e0cb-dcdb-4934-82e5-97157bb2e5a5", "address": "fa:16:3e:65:65:57", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df7e0cb-dc", "ovs_interfaceid": "2df7e0cb-dcdb-4934-82e5-97157bb2e5a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:11:46.273393 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-839d2adc-383f-49bb-83b3-7f60e30312e6 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converting VIF {"id": "2df7e0cb-dcdb-4934-82e5-97157bb2e5a5", "address": "fa:16:3e:65:65:57", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df7e0cb-dc", "ovs_interfaceid": "2df7e0cb-dcdb-4934-82e5-97157bb2e5a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:11:46.274271 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-839d2adc-383f-49bb-83b3-7f60e30312e6 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:65:57,bridge_name='br-int',has_traffic_filtering=True,id=2df7e0cb-dcdb-4934-82e5-97157bb2e5a5,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df7e0cb-dc') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:11:46.275032 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-839d2adc-383f-49bb-83b3-7f60e30312e6 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:65:57,bridge_name='br-int',has_traffic_filtering=True,id=2df7e0cb-dcdb-4934-82e5-97157bb2e5a5,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df7e0cb-dc') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:11:46.276816 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:46.277841 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2df7e0cb-dc, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:11:46.279927 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:11:46.283276 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:46.284483 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:46.285571 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6b22ef58-bafb-4d6c-943f-fa5e2b6a1e32) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:11:46.286883 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:46.286883 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:11:46.288006 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:46.295723 np0000001127 nova-compute[98206]: INFO os_vif [None req-839d2adc-383f-49bb-83b3-7f60e30312e6 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:65:57,bridge_name='br-int',has_traffic_filtering=True,id=2df7e0cb-dcdb-4934-82e5-97157bb2e5a5,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df7e0cb-dc')
May 21 02:11:46.296318 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-839d2adc-383f-49bb-83b3-7f60e30312e6 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Deleting instance files /opt/stack/data/nova/instances/b6df4554-8490-4d5a-9d4d-acfd46419cb3_del
May 21 02:11:46.297591 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-839d2adc-383f-49bb-83b3-7f60e30312e6 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Deletion of /opt/stack/data/nova/instances/b6df4554-8490-4d5a-9d4d-acfd46419cb3_del complete
May 21 02:11:46.474208 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-8fc31838-b4bb-46bd-b142-616d2398ced0 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:11:46.744798 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-29ec502f-9116-44de-9fe8-6a164a143645 tempest-VolumesActionsTest-1094570120 tempest-VolumesActionsTest-1094570120-project-member] [instance: 0c15c9f3-e0d2-4d6d-9144-b9760c55be0e] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:11:46.806839 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-839d2adc-383f-49bb-83b3-7f60e30312e6 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Took 1.39 seconds to destroy the instance on the hypervisor.
May 21 02:11:46.807381 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-839d2adc-383f-49bb-83b3-7f60e30312e6 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:11:46.807590 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:11:46.807685 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:11:46.808484 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:11:46.889692 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:11:46.986347 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8fc31838-b4bb-46bd-b142-616d2398ced0 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.448s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:46.987536 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:47.052844 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-8fc31838-b4bb-46bd-b142-616d2398ced0 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Deleted allocations for instance 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed
May 21 02:11:47.205854 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-ba610112-fdef-4cbd-98f8-1cae1bacca48 req-e4fb71cf-2a0a-425b-adf8-2f238a39c404 service nova] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Received event network-vif-deleted-2df7e0cb-dcdb-4934-82e5-97157bb2e5a5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:11:47.206560 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-ba610112-fdef-4cbd-98f8-1cae1bacca48 req-e4fb71cf-2a0a-425b-adf8-2f238a39c404 service nova] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Neutron deleted interface 2df7e0cb-dcdb-4934-82e5-97157bb2e5a5; detaching it from the instance and deleting it from the info cache
May 21 02:11:47.206675 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-ba610112-fdef-4cbd-98f8-1cae1bacca48 req-e4fb71cf-2a0a-425b-adf8-2f238a39c404 service nova] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:11:47.660525 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:11:47.698439 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a8f833e8-e5c1-44de-ae7c-6da2523b030e req-090e69ad-0263-4b21-9871-72f40586911f service nova] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Received event network-vif-unplugged-2df7e0cb-dcdb-4934-82e5-97157bb2e5a5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:11:47.698648 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a8f833e8-e5c1-44de-ae7c-6da2523b030e req-090e69ad-0263-4b21-9871-72f40586911f service nova] Acquiring lock "b6df4554-8490-4d5a-9d4d-acfd46419cb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:47.698798 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a8f833e8-e5c1-44de-ae7c-6da2523b030e req-090e69ad-0263-4b21-9871-72f40586911f service nova] Lock "b6df4554-8490-4d5a-9d4d-acfd46419cb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:47.698947 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a8f833e8-e5c1-44de-ae7c-6da2523b030e req-090e69ad-0263-4b21-9871-72f40586911f service nova] Lock "b6df4554-8490-4d5a-9d4d-acfd46419cb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:47.699070 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a8f833e8-e5c1-44de-ae7c-6da2523b030e req-090e69ad-0263-4b21-9871-72f40586911f service nova] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] No waiting events found dispatching network-vif-unplugged-2df7e0cb-dcdb-4934-82e5-97157bb2e5a5 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:11:47.699366 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a8f833e8-e5c1-44de-ae7c-6da2523b030e req-090e69ad-0263-4b21-9871-72f40586911f service nova] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Received event network-vif-unplugged-2df7e0cb-dcdb-4934-82e5-97157bb2e5a5 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:11:47.710863 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-ba610112-fdef-4cbd-98f8-1cae1bacca48 req-e4fb71cf-2a0a-425b-adf8-2f238a39c404 service nova] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Detach interface failed, port_id=2df7e0cb-dcdb-4934-82e5-97157bb2e5a5, reason: Instance b6df4554-8490-4d5a-9d4d-acfd46419cb3 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:11:48.062007 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8fc31838-b4bb-46bd-b142-616d2398ced0 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.361s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:48.164379 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Took 1.36 seconds to deallocate network for instance.
May 21 02:11:48.669855 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-839d2adc-383f-49bb-83b3-7f60e30312e6 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:48.670115 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-839d2adc-383f-49bb-83b3-7f60e30312e6 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:49.033107 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-839d2adc-383f-49bb-83b3-7f60e30312e6 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:11:49.033107 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-839d2adc-383f-49bb-83b3-7f60e30312e6 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:11:49.535918 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-839d2adc-383f-49bb-83b3-7f60e30312e6 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:11:50.045180 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-839d2adc-383f-49bb-83b3-7f60e30312e6 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.375s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:50.101113 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-839d2adc-383f-49bb-83b3-7f60e30312e6 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Deleted allocations for instance b6df4554-8490-4d5a-9d4d-acfd46419cb3
May 21 02:11:51.111506 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-839d2adc-383f-49bb-83b3-7f60e30312e6 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "b6df4554-8490-4d5a-9d4d-acfd46419cb3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.209s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:51.286128 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:51.978357 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.00037090000023454195 future=<Future at 0x71c0584c0470 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:11:51.979239 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Emitting event <LifecycleEvent: 1779329496.977885, aa3f5a78-fb82-4e21-8ebf-90bf48a122be => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:11:51.979370 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:11:51.979506 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=1.3138714829997298 future=<Future at 0x71c058649550 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:11:51.980453 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] VM Stopped (Lifecycle Event)
May 21 02:11:51.980556 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=1.3129036390000692 future=<Future at 0x71c058649550 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:11:51.989117 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:52.282283 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d14594c7-0ac6-45e0-9a6d-97d0ea4ffb84 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "16a0cc8d-c65b-4166-ad1a-5318b18ed00e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:52.282707 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d14594c7-0ac6-45e0-9a6d-97d0ea4ffb84 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "16a0cc8d-c65b-4166-ad1a-5318b18ed00e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:52.282707 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d14594c7-0ac6-45e0-9a6d-97d0ea4ffb84 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "16a0cc8d-c65b-4166-ad1a-5318b18ed00e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:52.282707 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d14594c7-0ac6-45e0-9a6d-97d0ea4ffb84 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "16a0cc8d-c65b-4166-ad1a-5318b18ed00e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:52.282806 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d14594c7-0ac6-45e0-9a6d-97d0ea4ffb84 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "16a0cc8d-c65b-4166-ad1a-5318b18ed00e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:52.285374 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-d14594c7-0ac6-45e0-9a6d-97d0ea4ffb84 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Terminating instance
May 21 02:11:52.482061 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: aa3f5a78-fb82-4e21-8ebf-90bf48a122be] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:11:52.676069 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:11:52.676236 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 21 02:11:52.676664 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:11:52.743156 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "6faea440-6481-41ab-886c-ca97308ab493" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:52.743318 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "6faea440-6481-41ab-886c-ca97308ab493" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:52.787949 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d14594c7-0ac6-45e0-9a6d-97d0ea4ffb84 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:11:52.804592 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:52.807564 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:52.828602 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:52.956575 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:52.961546 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:52.983608 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-41967f57-1394-4e84-9b40-b50fd6babf94 req-8c9c4aea-ae7c-4ba3-bdad-6b54a1c2a258 service nova] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Received event network-vif-unplugged-ef5fecf8-83a1-4153-927b-7f8b543f83f3 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:11:52.984037 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-41967f57-1394-4e84-9b40-b50fd6babf94 req-8c9c4aea-ae7c-4ba3-bdad-6b54a1c2a258 service nova] Acquiring lock "16a0cc8d-c65b-4166-ad1a-5318b18ed00e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:52.984186 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-41967f57-1394-4e84-9b40-b50fd6babf94 req-8c9c4aea-ae7c-4ba3-bdad-6b54a1c2a258 service nova] Lock "16a0cc8d-c65b-4166-ad1a-5318b18ed00e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:52.984294 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-41967f57-1394-4e84-9b40-b50fd6babf94 req-8c9c4aea-ae7c-4ba3-bdad-6b54a1c2a258 service nova] Lock "16a0cc8d-c65b-4166-ad1a-5318b18ed00e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:52.984418 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-41967f57-1394-4e84-9b40-b50fd6babf94 req-8c9c4aea-ae7c-4ba3-bdad-6b54a1c2a258 service nova] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] No waiting events found dispatching network-vif-unplugged-ef5fecf8-83a1-4153-927b-7f8b543f83f3 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:11:52.984544 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-41967f57-1394-4e84-9b40-b50fd6babf94 req-8c9c4aea-ae7c-4ba3-bdad-6b54a1c2a258 service nova] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Received event network-vif-unplugged-ef5fecf8-83a1-4153-927b-7f8b543f83f3 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:11:53.104918 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999700853999911 future=<Future at 0x71c05864a270 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:11:53.108611 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Instance destroyed successfully.
May 21 02:11:53.109111 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-d14594c7-0ac6-45e0-9a6d-97d0ea4ffb84 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lazy-loading 'resources' on Instance uuid 16a0cc8d-c65b-4166-ad1a-5318b18ed00e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:11:53.245059 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:11:53.293899 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0004919440002595366 future=<Future at 0x71c058649550 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:11:53.294344 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:11:53.294344 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=4.273877496000296 future=<Future at 0x71c05822c3b0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:11:53.294344 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=4.273789864000264 future=<Future at 0x71c05822c3b0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:11:53.295440 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Emitting event <LifecycleEvent: 1779329498.2933137, 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:11:53.296512 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] VM Stopped (Lifecycle Event)
May 21 02:11:53.612122 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-d14594c7-0ac6-45e0-9a6d-97d0ea4ffb84 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:05:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='multiattach-server-0',id=48,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzu+v5yloohnjet+lpl7Cb5m5YuZdtxheBkBGOMBLLe2AJEatmv/W6U1humbPofoJpKHaVTa0sSri4Ktoz/rRBuEiIFUUGVMQjgWmfd958Eyx52s4Fg6gJyB/ru0BJ+zA==',key_name='tempest-keypair-1890511814',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:05:56Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='848912b0c0e94d2795bb2332daf1730e',ramdisk_id='',reservation_id='r-nz73xe70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-289054175',owner_user_name='tempest-AttachVolumeMultiAttachTest-289054175-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:05:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='049d6c8cccfa4ae38d78a88ef5be0f1b',uuid=16a0cc8d-c65b-4166-ad1a-5318b18ed00e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef5fecf8-83a1-4153-927b-7f8b543f83f3", "address": "fa:16:3e:fb:4d:96", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef5fecf8-83", "ovs_interfaceid": "ef5fecf8-83a1-4153-927b-7f8b543f83f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:11:53.612348 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-d14594c7-0ac6-45e0-9a6d-97d0ea4ffb84 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converting VIF {"id": "ef5fecf8-83a1-4153-927b-7f8b543f83f3", "address": "fa:16:3e:fb:4d:96", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef5fecf8-83", "ovs_interfaceid": "ef5fecf8-83a1-4153-927b-7f8b543f83f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:11:53.612991 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-d14594c7-0ac6-45e0-9a6d-97d0ea4ffb84 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:4d:96,bridge_name='br-int',has_traffic_filtering=True,id=ef5fecf8-83a1-4153-927b-7f8b543f83f3,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef5fecf8-83') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:11:53.613262 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-d14594c7-0ac6-45e0-9a6d-97d0ea4ffb84 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:4d:96,bridge_name='br-int',has_traffic_filtering=True,id=ef5fecf8-83a1-4153-927b-7f8b543f83f3,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef5fecf8-83') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:11:53.614793 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:53.615033 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef5fecf8-83, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:11:53.616235 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:53.617176 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:11:53.618030 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:53.618828 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:53.618999 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=32995c08-c83a-4428-acd9-df3885130fd0) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:11:53.619550 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:53.620116 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:11:53.621105 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:53.622842 np0000001127 nova-compute[98206]: INFO os_vif [None req-d14594c7-0ac6-45e0-9a6d-97d0ea4ffb84 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:4d:96,bridge_name='br-int',has_traffic_filtering=True,id=ef5fecf8-83a1-4153-927b-7f8b543f83f3,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef5fecf8-83')
May 21 02:11:53.623131 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-d14594c7-0ac6-45e0-9a6d-97d0ea4ffb84 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Deleting instance files /opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e_del
May 21 02:11:53.623880 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-d14594c7-0ac6-45e0-9a6d-97d0ea4ffb84 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Deletion of /opt/stack/data/nova/instances/16a0cc8d-c65b-4166-ad1a-5318b18ed00e_del complete
May 21 02:11:53.676431 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:11:53.676776 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:11:53.799300 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 02fd9da8-f514-4e1b-8bd5-bfc8ae21753c] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:11:53.801928 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:53.802068 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:53.807149 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:11:53.807300 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Claim successful on node np0000001127
May 21 02:11:54.129606 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-d14594c7-0ac6-45e0-9a6d-97d0ea4ffb84 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Took 1.34 seconds to destroy the instance on the hypervisor.
May 21 02:11:54.131607 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-d14594c7-0ac6-45e0-9a6d-97d0ea4ffb84 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:11:54.132008 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:11:54.132155 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:11:54.132416 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:11:54.200509 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:11:54.598398 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e958242c-01e2-4372-917c-4612843a360d req-6be6b76e-32a7-48f6-a05f-2677a4e2db02 service nova] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Received event network-vif-deleted-ef5fecf8-83a1-4153-927b-7f8b543f83f3 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:11:54.600614 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-e958242c-01e2-4372-917c-4612843a360d req-6be6b76e-32a7-48f6-a05f-2677a4e2db02 service nova] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Neutron deleted interface ef5fecf8-83a1-4153-927b-7f8b543f83f3; detaching it from the instance and deleting it from the info cache
May 21 02:11:54.600845 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-e958242c-01e2-4372-917c-4612843a360d req-6be6b76e-32a7-48f6-a05f-2677a4e2db02 service nova] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:11:55.027338 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:11:55.060043 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b98f2d7a-4dec-4f15-9c4d-83af9a9f0e5a req-88a1a867-fda4-43aa-a942-54a8cd6a0d62 service nova] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Received event network-vif-unplugged-ef5fecf8-83a1-4153-927b-7f8b543f83f3 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:11:55.060104 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b98f2d7a-4dec-4f15-9c4d-83af9a9f0e5a req-88a1a867-fda4-43aa-a942-54a8cd6a0d62 service nova] Acquiring lock "16a0cc8d-c65b-4166-ad1a-5318b18ed00e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:55.060306 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b98f2d7a-4dec-4f15-9c4d-83af9a9f0e5a req-88a1a867-fda4-43aa-a942-54a8cd6a0d62 service nova] Lock "16a0cc8d-c65b-4166-ad1a-5318b18ed00e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:55.060460 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-b98f2d7a-4dec-4f15-9c4d-83af9a9f0e5a req-88a1a867-fda4-43aa-a942-54a8cd6a0d62 service nova] Lock "16a0cc8d-c65b-4166-ad1a-5318b18ed00e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:55.060651 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b98f2d7a-4dec-4f15-9c4d-83af9a9f0e5a req-88a1a867-fda4-43aa-a942-54a8cd6a0d62 service nova] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] No waiting events found dispatching network-vif-unplugged-ef5fecf8-83a1-4153-927b-7f8b543f83f3 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:11:55.060893 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-b98f2d7a-4dec-4f15-9c4d-83af9a9f0e5a req-88a1a867-fda4-43aa-a942-54a8cd6a0d62 service nova] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Received event network-vif-unplugged-ef5fecf8-83a1-4153-927b-7f8b543f83f3 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:11:55.107428 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e958242c-01e2-4372-917c-4612843a360d req-6be6b76e-32a7-48f6-a05f-2677a4e2db02 service nova] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Detach interface failed, port_id=ef5fecf8-83a1-4153-927b-7f8b543f83f3, reason: Instance 16a0cc8d-c65b-4166-ad1a-5318b18ed00e could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:11:55.200631 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:11:55.200851 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:11:55.529413 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Took 1.40 seconds to deallocate network for instance.
May 21 02:11:55.676216 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:11:55.707297 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:11:56.045943 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d14594c7-0ac6-45e0-9a6d-97d0ea4ffb84 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:56.182877 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:56.215680 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.413s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:56.216225 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:11:56.219128 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d14594c7-0ac6-45e0-9a6d-97d0ea4ffb84 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.174s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:56.724005 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:11:56.724346 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:11:56.724637 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:11:56.724937 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:11:56.832484 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '01cc41344ae640f6aa9c6142252838b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae2ef74a1614eb09e4f71f709f64126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:11:56.935511 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d14594c7-0ac6-45e0-9a6d-97d0ea4ffb84 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:11:56.935785 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-d14594c7-0ac6-45e0-9a6d-97d0ea4ffb84 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:11:56.998813 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:57.228388 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:11:57.441871 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-d14594c7-0ac6-45e0-9a6d-97d0ea4ffb84 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:11:57.474902 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Successfully created port: 63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:11:57.569490 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.00090300700003354 future=<Future at 0x71c05822c3b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:11:57.569490 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:11:57.569661 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=3.193874842999776 future=<Future at 0x71c07c737f20 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:11:57.569757 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=3.1937342219998754 future=<Future at 0x71c07c737f20 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:11:57.570311 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Emitting event <LifecycleEvent: 1779329502.5679128, 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:11:57.570674 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] VM Stopped (Lifecycle Event)
May 21 02:11:57.733331 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:11:57.951935 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d14594c7-0ac6-45e0-9a6d-97d0ea4ffb84 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.733s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:57.954132 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.771s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:57.954347 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:57.954832 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Auditing locally available compute resources for np0000001127 (node: np0000001127) {{(pid=98206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 21 02:11:58.023090 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-d14594c7-0ac6-45e0-9a6d-97d0ea4ffb84 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Deleted allocations for instance 16a0cc8d-c65b-4166-ad1a-5318b18ed00e
May 21 02:11:58.073552 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-553a08e3-1aac-4286-b3cf-51e5b923546b tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 6971c9a1-5a8b-44f1-a4a1-a8ab6b5e78ed] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:11:58.168834 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Successfully updated port: 63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:11:58.227416 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a6112d75-1360-4c13-9bed-a48d7cb7d643 req-e7e3eb37-97bb-4df8-9098-681322e4eb4a service nova] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Received event network-changed-63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:11:58.227416 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a6112d75-1360-4c13-9bed-a48d7cb7d643 req-e7e3eb37-97bb-4df8-9098-681322e4eb4a service nova] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Refreshing instance network info cache due to event network-changed-63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:11:58.227416 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a6112d75-1360-4c13-9bed-a48d7cb7d643 req-e7e3eb37-97bb-4df8-9098-681322e4eb4a service nova] Acquiring lock "refresh_cache-6faea440-6481-41ab-886c-ca97308ab493" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:11:58.227416 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a6112d75-1360-4c13-9bed-a48d7cb7d643 req-e7e3eb37-97bb-4df8-9098-681322e4eb4a service nova] Acquired lock "refresh_cache-6faea440-6481-41ab-886c-ca97308ab493" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:11:58.227416 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-a6112d75-1360-4c13-9bed-a48d7cb7d643 req-e7e3eb37-97bb-4df8-9098-681322e4eb4a service nova] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Refreshing network info cache for port 63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:11:58.619852 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:11:58.673002 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "refresh_cache-6faea440-6481-41ab-886c-ca97308ab493" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:11:58.732490 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-a6112d75-1360-4c13-9bed-a48d7cb7d643 req-e7e3eb37-97bb-4df8-9098-681322e4eb4a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:11:58.742735 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:11:58.744315 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:11:58.744584 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Creating image(s)
May 21 02:11:58.745213 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "/opt/stack/data/nova/instances/6faea440-6481-41ab-886c-ca97308ab493/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:58.745400 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "/opt/stack/data/nova/instances/6faea440-6481-41ab-886c-ca97308ab493/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:58.746101 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "/opt/stack/data/nova/instances/6faea440-6481-41ab-886c-ca97308ab493/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:58.746764 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:11:58.750706 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:11:58.751714 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:11:58.812065 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-a6112d75-1360-4c13-9bed-a48d7cb7d643 req-e7e3eb37-97bb-4df8-9098-681322e4eb4a service nova] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:11:58.852794 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.101s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:11:58.853347 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:58.853970 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:58.854443 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:11:58.858360 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:11:58.861129 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:11:58.968329 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.107s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:11:58.969097 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/6faea440-6481-41ab-886c-ca97308ab493/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:11:59.010854 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-a6112d75-1360-4c13-9bed-a48d7cb7d643 req-e7e3eb37-97bb-4df8-9098-681322e4eb4a service nova] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:11:59.016652 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:11:59.021620 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:11:59.023241 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:11:59.025812 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3767becb-caf4-47ee-904f-112069ee8dba/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:11:59.050148 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d14594c7-0ac6-45e0-9a6d-97d0ea4ffb84 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "16a0cc8d-c65b-4166-ad1a-5318b18ed00e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.766s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:59.051595 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/6faea440-6481-41ab-886c-ca97308ab493/disk 1073741824" returned: 0 in 0.082s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:11:59.052167 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:59.053040 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:11:59.157460 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.104s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:11:59.157909 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6faea440-6481-41ab-886c-ca97308ab493/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:11:59.158758 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6faea440-6481-41ab-886c-ca97308ab493/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:11:59.173168 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3767becb-caf4-47ee-904f-112069ee8dba/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:11:59.173968 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3767becb-caf4-47ee-904f-112069ee8dba/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:11:59.273093 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6faea440-6481-41ab-886c-ca97308ab493/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:11:59.273441 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Cannot resize image /opt/stack/data/nova/instances/6faea440-6481-41ab-886c-ca97308ab493/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:11:59.273961 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:11:59.274095 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Ensure instance console log exists: /opt/stack/data/nova/instances/6faea440-6481-41ab-886c-ca97308ab493/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:11:59.274346 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:59.274569 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:59.274872 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:11:59.311776 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3767becb-caf4-47ee-904f-112069ee8dba/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:11:59.312060 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-10 (vdb) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:11:59.318342 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:11:59.319255 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:11:59.370551 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "env LANG=C uptime" returned: 0 in 0.051s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:11:59.371106 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Hypervisor/Node resource view: name=np0000001127 free_ram=12283MB free_disk=72.8968505859375GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 21 02:11:59.371266 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:11:59.371540 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:11:59.517366 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a6112d75-1360-4c13-9bed-a48d7cb7d643 req-e7e3eb37-97bb-4df8-9098-681322e4eb4a service nova] Releasing lock "refresh_cache-6faea440-6481-41ab-886c-ca97308ab493" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:11:59.518171 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquired lock "refresh_cache-6faea440-6481-41ab-886c-ca97308ab493" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:11:59.518273 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:12:00.012884 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "6ccaedfe-bec9-4591-b845-acf0cc81d026" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:00.013338 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "6ccaedfe-bec9-4591-b845-acf0cc81d026" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:00.013338 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "6ccaedfe-bec9-4591-b845-acf0cc81d026-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:00.013338 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "6ccaedfe-bec9-4591-b845-acf0cc81d026-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:00.013507 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "6ccaedfe-bec9-4591-b845-acf0cc81d026-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:00.018137 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Terminating instance
May 21 02:12:00.094820 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:12:00.275433 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:12:00.432571 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Updating instance_info_cache with network_info: [{"id": "63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c", "address": "fa:16:3e:88:c9:bf", "network": {"id": "dec0dbdb-dfbe-4a3d-9d29-6add07c9003f", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-775185877-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ae2ef74a1614eb09e4f71f709f64126", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63bdd924-29", "ovs_interfaceid": "63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:12:00.455059 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 6ccaedfe-bec9-4591-b845-acf0cc81d026 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:12:00.455232 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance cec9e114-b934-4de6-b0f0-586cd34a59bd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:12:00.455368 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 840919c9-6bf6-47ac-bb9c-35ea24494c2e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:12:00.455769 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 3767becb-caf4-47ee-904f-112069ee8dba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:12:00.455993 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 6faea440-6481-41ab-886c-ca97308ab493 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:12:00.456416 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 21 02:12:00.456724 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Final resource view: name=np0000001127 phys_ram=24030MB used_ram=1472MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:11:59 up 42 min,  2 users,  load average: 4.51, 7.48, 6.06\n', 'num_instances': '5', 'num_vm_active': '4', 'num_task_None': '4', 'num_os_type_None': '5', 'num_proj_848912b0c0e94d2795bb2332daf1730e': '1', 'io_workload': '1', 'num_proj_62ebdb16aee84e22a88dfc8960debd32': '2', 'num_proj_549d365926ce49efa4c4bf50c7bbbbaa': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_4ae2ef74a1614eb09e4f71f709f64126': '1'} {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 21 02:12:00.521305 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:12:00.541548 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:00.542857 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:00.563580 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:00.566042 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:00.586350 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:00.591162 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:00.712705 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c39d1a4f-d82f-4154-a148-61121bab079b req-b2ffb780-cfe2-459d-a896-158fca0ed94a service nova] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Received event network-vif-unplugged-595ed872-c1da-4406-aeb4-a249c8ebbe07 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:12:00.714369 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c39d1a4f-d82f-4154-a148-61121bab079b req-b2ffb780-cfe2-459d-a896-158fca0ed94a service nova] Acquiring lock "6ccaedfe-bec9-4591-b845-acf0cc81d026-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:00.716505 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c39d1a4f-d82f-4154-a148-61121bab079b req-b2ffb780-cfe2-459d-a896-158fca0ed94a service nova] Lock "6ccaedfe-bec9-4591-b845-acf0cc81d026-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:00.716505 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c39d1a4f-d82f-4154-a148-61121bab079b req-b2ffb780-cfe2-459d-a896-158fca0ed94a service nova] Lock "6ccaedfe-bec9-4591-b845-acf0cc81d026-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:00.716505 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c39d1a4f-d82f-4154-a148-61121bab079b req-b2ffb780-cfe2-459d-a896-158fca0ed94a service nova] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] No waiting events found dispatching network-vif-unplugged-595ed872-c1da-4406-aeb4-a249c8ebbe07 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:12:00.716505 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c39d1a4f-d82f-4154-a148-61121bab079b req-b2ffb780-cfe2-459d-a896-158fca0ed94a service nova] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Received event network-vif-unplugged-595ed872-c1da-4406-aeb4-a249c8ebbe07 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:12:00.764866 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0013277650000418362 future=<Future at 0x71c07c737f20 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:12:00.765016 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:12:00.765206 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=7.3384838189999755 future=<Future at 0x71c05864a270 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:12:00.765340 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=7.338343037999948 future=<Future at 0x71c05864a270 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:12:00.767507 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Emitting event <LifecycleEvent: 1779329505.7634418, b6df4554-8490-4d5a-9d4d-acfd46419cb3 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:12:00.767507 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] VM Stopped (Lifecycle Event)
May 21 02:12:00.780048 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:12:00.780048 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:12:00.865078 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999627879999935 future=<Future at 0x71c09848b560 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:12:00.867082 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Instance destroyed successfully.
May 21 02:12:00.867830 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lazy-loading 'resources' on Instance uuid 6ccaedfe-bec9-4591-b845-acf0cc81d026 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:12:00.936052 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Releasing lock "refresh_cache-6faea440-6481-41ab-886c-ca97308ab493" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:12:00.936052 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Instance network_info: |[{"id": "63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c", "address": "fa:16:3e:88:c9:bf", "network": {"id": "dec0dbdb-dfbe-4a3d-9d29-6add07c9003f", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-775185877-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ae2ef74a1614eb09e4f71f709f64126", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63bdd924-29", "ovs_interfaceid": "63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:12:00.941795 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Start _get_guest_xml network_info=[{"id": "63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c", "address": "fa:16:3e:88:c9:bf", "network": {"id": "dec0dbdb-dfbe-4a3d-9d29-6add07c9003f", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-775185877-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ae2ef74a1614eb09e4f71f709f64126", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63bdd924-29", "ovs_interfaceid": "63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:12:00.947042 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:12:00.948301 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-1056771543', uuid='6faea440-6481-41ab-886c-ca97308ab493'), owner=OwnerMeta(userid='01cc41344ae640f6aa9c6142252838b2', username='tempest-VolumeMultiattachTests-1039130224-project-member', projectid='4ae2ef74a1614eb09e4f71f709f64126', projectname='tempest-VolumeMultiattachTests-1039130224'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c", "address": "fa:16:3e:88:c9:bf", "network": {"id": "dec0dbdb-dfbe-4a3d-9d29-6add07c9003f", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-775185877-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ae2ef74a1614eb09e4f71f709f64126", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63bdd924-29", "ovs_interfaceid": "63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329520.9479623) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:12:00.949920 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:12:00.950195 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:12:00.952437 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:12:00.952437 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:12:00.952437 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:12:00.952654 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:12:00.952654 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:12:00.952763 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:12:00.952861 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:12:00.952921 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:12:00.952974 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:12:00.953099 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:12:00.953187 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:12:00.953290 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:12:00.953383 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:12:00.953504 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:12:00.969567 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:11:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1056771543',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumemultiattachtests-server-1056771543',id=71,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFAHlOECXB1M6kLu8x5TN9wOuIBl3ef5ENa2h/uqRSfwjtQM17svq1GZslZFXuDLhFpfPv+TJvNt4XZ1d1K/RnUCKH1dJFE1gCh5yLPXhdXnteimmZnkH2xqBvbvxdKCg==',key_name='tempest-keypair-124929912',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ae2ef74a1614eb09e4f71f709f64126',ramdisk_id='',reservation_id='r-81aw9glg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1039130224',owner_user_name='tempest-VolumeMultiattachTests-1039130224-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:11:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01cc41344ae640f6aa9c6142252838b2',uuid=6faea440-6481-41ab-886c-ca97308ab493,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c", "address": "fa:16:3e:88:c9:bf", "network": {"id": "dec0dbdb-dfbe-4a3d-9d29-6add07c9003f", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-775185877-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ae2ef74a1614eb09e4f71f709f64126", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63bdd924-29", "ovs_interfaceid": "63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:12:00.972784 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Converting VIF {"id": "63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c", "address": "fa:16:3e:88:c9:bf", "network": {"id": "dec0dbdb-dfbe-4a3d-9d29-6add07c9003f", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-775185877-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ae2ef74a1614eb09e4f71f709f64126", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63bdd924-29", "ovs_interfaceid": "63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:12:00.973053 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:c9:bf,bridge_name='br-int',has_traffic_filtering=True,id=63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c,network=Network(dec0dbdb-dfbe-4a3d-9d29-6add07c9003f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63bdd924-29') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:12:00.974006 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lazy-loading 'pci_devices' on Instance uuid 6faea440-6481-41ab-886c-ca97308ab493 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:12:01.270507 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: b6df4554-8490-4d5a-9d4d-acfd46419cb3] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:12:01.282652 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:12:01.375008 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:05:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1624830305',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-attachvolumemultiattachtest-server-1624830305',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:05:35Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='848912b0c0e94d2795bb2332daf1730e',ramdisk_id='',reservation_id='r-1ov2krjm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-289054175',owner_user_name='tempest-AttachVolumeMultiAttachTest-289054175-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:05:35Z,user_data=None,user_id='049d6c8cccfa4ae38d78a88ef5be0f1b',uuid=6ccaedfe-bec9-4591-b845-acf0cc81d026,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "595ed872-c1da-4406-aeb4-a249c8ebbe07", "address": "fa:16:3e:0f:28:a1", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap595ed872-c1", "ovs_interfaceid": "595ed872-c1da-4406-aeb4-a249c8ebbe07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:12:01.375227 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converting VIF {"id": "595ed872-c1da-4406-aeb4-a249c8ebbe07", "address": "fa:16:3e:0f:28:a1", "network": {"id": "3f043eb0-4b94-417d-be4d-b5ee60f65b83", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1714846967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "848912b0c0e94d2795bb2332daf1730e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap595ed872-c1", "ovs_interfaceid": "595ed872-c1da-4406-aeb4-a249c8ebbe07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:12:01.375791 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:28:a1,bridge_name='br-int',has_traffic_filtering=True,id=595ed872-c1da-4406-aeb4-a249c8ebbe07,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap595ed872-c1') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:12:01.376061 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:28:a1,bridge_name='br-int',has_traffic_filtering=True,id=595ed872-c1da-4406-aeb4-a249c8ebbe07,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap595ed872-c1') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:12:01.377342 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:01.377564 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap595ed872-c1, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:12:01.379020 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:01.379818 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:12:01.380708 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:01.380708 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=79b670ca-aa2a-4980-81b6-ecdd51bb8592) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:12:01.380941 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:01.381825 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:12:01.383551 np0000001127 nova-compute[98206]: INFO os_vif [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:28:a1,bridge_name='br-int',has_traffic_filtering=True,id=595ed872-c1da-4406-aeb4-a249c8ebbe07,network=Network(3f043eb0-4b94-417d-be4d-b5ee60f65b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap595ed872-c1')
May 21 02:12:01.418850 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:12:01.419264 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e8306ca8-501b-4d1b-bf8c-aa9548725dee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:12:01.419458 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:12:01.476538 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] End _get_guest_xml xml=<domain type="qemu">
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:   <uuid>6faea440-6481-41ab-886c-ca97308ab493</uuid>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:   <name>instance-00000047</name>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:       <nova:name>tempest-VolumeMultiattachTests-server-1056771543</nova:name>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:12:00</nova:creationTime>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:         <nova:user uuid="01cc41344ae640f6aa9c6142252838b2">tempest-VolumeMultiattachTests-1039130224-project-member</nova:user>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:         <nova:project uuid="4ae2ef74a1614eb09e4f71f709f64126">tempest-VolumeMultiattachTests-1039130224</nova:project>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:         <nova:port uuid="63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c">
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:     <system>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:       <entry name="serial">6faea440-6481-41ab-886c-ca97308ab493</entry>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:       <entry name="uuid">6faea440-6481-41ab-886c-ca97308ab493</entry>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:     </system>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:   <os>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:   </os>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:   <features>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:   </features>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:   <devices>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/6faea440-6481-41ab-886c-ca97308ab493/disk"/>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:     </disk>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/6faea440-6481-41ab-886c-ca97308ab493/disk.config"/>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:     </disk>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:88:c9:bf"/>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:       <target dev="tap63bdd924-29"/>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:     </interface>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/6faea440-6481-41ab-886c-ca97308ab493/console.log" append="off"/>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:     </serial>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:     <video>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:     </video>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:     </rng>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:   </devices>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]: </domain>
May 21 02:12:01.476538 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:12:01.478252 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Preparing to wait for external event network-vif-plugged-63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:12:01.478252 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "6faea440-6481-41ab-886c-ca97308ab493-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:01.478252 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "6faea440-6481-41ab-886c-ca97308ab493-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:01.478252 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "6faea440-6481-41ab-886c-ca97308ab493-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:01.478252 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:11:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1056771543',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumemultiattachtests-server-1056771543',id=71,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFAHlOECXB1M6kLu8x5TN9wOuIBl3ef5ENa2h/uqRSfwjtQM17svq1GZslZFXuDLhFpfPv+TJvNt4XZ1d1K/RnUCKH1dJFE1gCh5yLPXhdXnteimmZnkH2xqBvbvxdKCg==',key_name='tempest-keypair-124929912',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ae2ef74a1614eb09e4f71f709f64126',ramdisk_id='',reservation_id='r-81aw9glg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1039130224',owner_user_name='tempest-VolumeMultiattachTests-1039130224-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:11:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01cc41344ae640f6aa9c6142252838b2',uuid=6faea440-6481-41ab-886c-ca97308ab493,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c", "address": "fa:16:3e:88:c9:bf", "network": {"id": "dec0dbdb-dfbe-4a3d-9d29-6add07c9003f", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-775185877-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ae2ef74a1614eb09e4f71f709f64126", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63bdd924-29", "ovs_interfaceid": "63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:12:01.478252 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Converting VIF {"id": "63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c", "address": "fa:16:3e:88:c9:bf", "network": {"id": "dec0dbdb-dfbe-4a3d-9d29-6add07c9003f", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-775185877-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ae2ef74a1614eb09e4f71f709f64126", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63bdd924-29", "ovs_interfaceid": "63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:12:01.479636 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:c9:bf,bridge_name='br-int',has_traffic_filtering=True,id=63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c,network=Network(dec0dbdb-dfbe-4a3d-9d29-6add07c9003f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63bdd924-29') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:12:01.479636 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:c9:bf,bridge_name='br-int',has_traffic_filtering=True,id=63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c,network=Network(dec0dbdb-dfbe-4a3d-9d29-6add07c9003f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63bdd924-29') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:12:01.479636 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:01.479636 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:12:01.479636 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:12:01.480491 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:01.480491 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '94e44937-bedb-5e1e-99a5-ea6b6e881b24', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:12:01.481476 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:01.482287 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:12:01.482860 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:01.484763 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:01.485853 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63bdd924-29, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:12:01.485853 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap63bdd924-29, col_values=(('qos', UUID('50ecc03a-eae7-4146-a66c-0f50e4013a71')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:12:01.485853 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap63bdd924-29, col_values=(('external_ids', {'iface-id': '63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:c9:bf', 'vm-uuid': '6faea440-6481-41ab-886c-ca97308ab493'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:12:01.486735 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:01.489260 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:12:01.494152 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:01.495204 np0000001127 nova-compute[98206]: INFO os_vif [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:c9:bf,bridge_name='br-int',has_traffic_filtering=True,id=63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c,network=Network(dec0dbdb-dfbe-4a3d-9d29-6add07c9003f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63bdd924-29')
May 21 02:12:01.790724 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Compute_service record updated for np0000001127:np0000001127 {{(pid=98206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 21 02:12:01.790903 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.419s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:01.791297 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:12:02.008525 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:02.475690 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.056s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:12:02.476149 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e8306ca8-501b-4d1b-bf8c-aa9548725dee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:12:02.476327 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:12:02.508999 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:12:02.508999 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:12:02.508999 np0000001127 nova-compute[98206]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:12:02.508999 np0000001127 nova-compute[98206]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:12:02.508999 np0000001127 nova-compute[98206]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:12:02.508999 np0000001127 nova-compute[98206]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:12:02.508999 np0000001127 nova-compute[98206]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d2bdae-39ec-418a-ba5c-e7c2e25efce8 (non-flash)
May 21 02:12:02.508999 np0000001127 nova-compute[98206]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:02.508999 np0000001127 nova-compute[98206]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:02.508999 np0000001127 nova-compute[98206]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb3bc5b7-7f4d-4fc0-aca8-7cabb9a6f31e (non-flash)
May 21 02:12:02.508999 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:12:02.508999 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:12:02.508999 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:12:02.509521 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsi session list stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:12:02.509521 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:12:02.509521 np0000001127 nova-compute[98206]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:12:02.509521 np0000001127 nova-compute[98206]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:12:02.509521 np0000001127 nova-compute[98206]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:12:02.509521 np0000001127 nova-compute[98206]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:12:02.509521 np0000001127 nova-compute[98206]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d2bdae-39ec-418a-ba5c-e7c2e25efce8 (non-flash)
May 21 02:12:02.509521 np0000001127 nova-compute[98206]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:02.509521 np0000001127 nova-compute[98206]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:02.509521 np0000001127 nova-compute[98206]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb3bc5b7-7f4d-4fc0-aca8-7cabb9a6f31e (non-flash)
May 21 02:12:02.509521 np0000001127 nova-compute[98206]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:12:02.509521 np0000001127 nova-compute[98206]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee (non-flash)
May 21 02:12:02.509521 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:12:02.509521 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', '144'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', '145'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903', '160'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903', '161'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f', '162'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f', '163'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67d2bdae-39ec-418a-ba5c-e7c2e25efce8', '170'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13', '174'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13', '175'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb3bc5b7-7f4d-4fc0-aca8-7cabb9a6f31e', '176'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '95')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:12:02.509521 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '94')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:12:02.510762 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee', '95')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:12:02.511884 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c058464b80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee'): ({'sdc'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:12:02.512131 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Removing multipathed devices sdc, sdb {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:12:02.513374 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Flush multipath device 3300000009584f153 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:12:02.573089 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:12:02.637619 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:12:02.694598 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:12:02.694598 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:12:02.694598 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:12:02.709756 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:12:02.709756 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:12:02.725067 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:02.774029 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 94, target: iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee, portal: 192.168.40.100,3260]
May 21 02:12:02.774029 np0000001127 nova-compute[98206]: Logout of [sid: 94, target: iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee, portal: 192.168.40.100,3260] successful.
May 21 02:12:02.774029 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:02.780459 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bd2f7bf4-6276-4ea8-b13b-7c18662e4f4d req-86a8a78d-c06b-42ea-9cc8-682a06b02d4a service nova] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Received event network-vif-unplugged-595ed872-c1da-4406-aeb4-a249c8ebbe07 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:12:02.780693 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bd2f7bf4-6276-4ea8-b13b-7c18662e4f4d req-86a8a78d-c06b-42ea-9cc8-682a06b02d4a service nova] Acquiring lock "6ccaedfe-bec9-4591-b845-acf0cc81d026-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:02.780926 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bd2f7bf4-6276-4ea8-b13b-7c18662e4f4d req-86a8a78d-c06b-42ea-9cc8-682a06b02d4a service nova] Lock "6ccaedfe-bec9-4591-b845-acf0cc81d026-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:02.786181 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bd2f7bf4-6276-4ea8-b13b-7c18662e4f4d req-86a8a78d-c06b-42ea-9cc8-682a06b02d4a service nova] Lock "6ccaedfe-bec9-4591-b845-acf0cc81d026-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:02.786739 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bd2f7bf4-6276-4ea8-b13b-7c18662e4f4d req-86a8a78d-c06b-42ea-9cc8-682a06b02d4a service nova] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] No waiting events found dispatching network-vif-unplugged-595ed872-c1da-4406-aeb4-a249c8ebbe07 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:12:02.786862 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bd2f7bf4-6276-4ea8-b13b-7c18662e4f4d req-86a8a78d-c06b-42ea-9cc8-682a06b02d4a service nova] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Received event network-vif-unplugged-595ed872-c1da-4406-aeb4-a249c8ebbe07 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:12:02.791343 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:12:02.792539 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:12:02.792813 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:12:02.793040 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:12:02.793364 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:12:02.793606 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 51.88 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:12:02.794790 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:02.811215 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:02.846920 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 95, target: iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee, portal: 192.168.50.100,3260]
May 21 02:12:02.846920 np0000001127 nova-compute[98206]: Logout of [sid: 95, target: iqn.2023-03.storpool.com:os--volume-e8306ca8-501b-4d1b-bf8c-aa9548725dee, portal: 192.168.50.100,3260] successful.
May 21 02:12:02.846920 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:02.871495 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:02.871495 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:12:02.871495 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] <== disconnect_volume: return (1449ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:12:02.871495 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:12:02.871495 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Deleting instance files /opt/stack/data/nova/instances/6ccaedfe-bec9-4591-b845-acf0cc81d026_del
May 21 02:12:02.871495 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Deletion of /opt/stack/data/nova/instances/6ccaedfe-bec9-4591-b845-acf0cc81d026_del complete
May 21 02:12:03.018492 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:12:03.018492 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:12:03.018492 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] No VIF found with MAC fa:16:3e:88:c9:bf, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:12:03.018816 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Using config drive
May 21 02:12:03.385741 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Took 2.86 seconds to destroy the instance on the hypervisor.
May 21 02:12:03.385741 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:12:03.385741 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:12:03.385741 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:12:03.386074 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:12:03.463948 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:12:03.525132 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:12:03.698426 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Creating config drive at /opt/stack/data/nova/instances/6faea440-6481-41ab-886c-ca97308ab493/disk.config
May 21 02:12:03.706376 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6faea440-6481-41ab-886c-ca97308ab493/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqtbbb2c5 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:12:03.778384 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6faea440-6481-41ab-886c-ca97308ab493/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqtbbb2c5" returned: 0 in 0.072s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:12:03.781905 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-32226ca0-99a7-4c43-b2b2-98917be3e970 req-a5eca148-bd59-46d3-b100-865685f113b6 service nova] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Received event network-vif-deleted-595ed872-c1da-4406-aeb4-a249c8ebbe07 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:12:03.782566 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-32226ca0-99a7-4c43-b2b2-98917be3e970 req-a5eca148-bd59-46d3-b100-865685f113b6 service nova] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Neutron deleted interface 595ed872-c1da-4406-aeb4-a249c8ebbe07; detaching it from the instance and deleting it from the info cache
May 21 02:12:03.782566 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-32226ca0-99a7-4c43-b2b2-98917be3e970 req-a5eca148-bd59-46d3-b100-865685f113b6 service nova] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:12:04.240908 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:12:04.285219 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:04.295665 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-32226ca0-99a7-4c43-b2b2-98917be3e970 req-a5eca148-bd59-46d3-b100-865685f113b6 service nova] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Detach interface failed, port_id=595ed872-c1da-4406-aeb4-a249c8ebbe07, reason: Instance 6ccaedfe-bec9-4591-b845-acf0cc81d026 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:12:04.311344 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:04.315288 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:04.429838 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:04.575740 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-04130364-7f37-496c-b034-f0983a889d14 req-599ba6a7-06d5-4be4-ad7d-141295b8b66b service nova] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Received event network-vif-plugged-63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:12:04.576272 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-04130364-7f37-496c-b034-f0983a889d14 req-599ba6a7-06d5-4be4-ad7d-141295b8b66b service nova] Acquiring lock "6faea440-6481-41ab-886c-ca97308ab493-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:04.576334 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-04130364-7f37-496c-b034-f0983a889d14 req-599ba6a7-06d5-4be4-ad7d-141295b8b66b service nova] Lock "6faea440-6481-41ab-886c-ca97308ab493-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:04.576556 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-04130364-7f37-496c-b034-f0983a889d14 req-599ba6a7-06d5-4be4-ad7d-141295b8b66b service nova] Lock "6faea440-6481-41ab-886c-ca97308ab493-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:04.576760 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-04130364-7f37-496c-b034-f0983a889d14 req-599ba6a7-06d5-4be4-ad7d-141295b8b66b service nova] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Processing event network-vif-plugged-63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:12:04.737342 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:04.741430 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:04.743433 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:04.744668 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Took 1.36 seconds to deallocate network for instance.
May 21 02:12:04.745454 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:04.768845 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:05.334967 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Took 0.59 seconds to detach 1 volumes for instance.
May 21 02:12:05.403549 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329525.4030764, 6faea440-6481-41ab-886c-ca97308ab493 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:12:05.403935 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:12:05.404084 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6faea440-6481-41ab-886c-ca97308ab493] VM Started (Lifecycle Event)
May 21 02:12:05.406400 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:12:05.409795 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Instance spawned successfully.
May 21 02:12:05.410126 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:12:05.534812 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "840919c9-6bf6-47ac-bb9c-35ea24494c2e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:05.534998 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "840919c9-6bf6-47ac-bb9c-35ea24494c2e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:05.535191 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "840919c9-6bf6-47ac-bb9c-35ea24494c2e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:05.536024 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "840919c9-6bf6-47ac-bb9c-35ea24494c2e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:05.536024 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "840919c9-6bf6-47ac-bb9c-35ea24494c2e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:05.537687 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Terminating instance
May 21 02:12:05.843780 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:05.844227 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:05.910301 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:12:05.921004 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:12:05.929969 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:12:05.930070 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:12:05.931129 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:12:05.931129 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:12:05.931679 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:12:05.931933 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:12:06.043134 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:12:06.064756 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:06.075177 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:06.094157 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:06.240530 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:12:06.240813 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:12:06.286494 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f9a181ac-d8e8-44be-9244-ee58e08c218f req-1bd4c577-d096-4337-9b09-5ef2afc8412b service nova] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Received event network-vif-unplugged-a8a17868-6e90-432e-b126-c5af5a09ae6b {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:12:06.292174 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f9a181ac-d8e8-44be-9244-ee58e08c218f req-1bd4c577-d096-4337-9b09-5ef2afc8412b service nova] Acquiring lock "840919c9-6bf6-47ac-bb9c-35ea24494c2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:06.292174 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f9a181ac-d8e8-44be-9244-ee58e08c218f req-1bd4c577-d096-4337-9b09-5ef2afc8412b service nova] Lock "840919c9-6bf6-47ac-bb9c-35ea24494c2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:06.292174 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f9a181ac-d8e8-44be-9244-ee58e08c218f req-1bd4c577-d096-4337-9b09-5ef2afc8412b service nova] Lock "840919c9-6bf6-47ac-bb9c-35ea24494c2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:06.292322 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f9a181ac-d8e8-44be-9244-ee58e08c218f req-1bd4c577-d096-4337-9b09-5ef2afc8412b service nova] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] No waiting events found dispatching network-vif-unplugged-a8a17868-6e90-432e-b126-c5af5a09ae6b {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:12:06.293489 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f9a181ac-d8e8-44be-9244-ee58e08c218f req-1bd4c577-d096-4337-9b09-5ef2afc8412b service nova] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Received event network-vif-unplugged-a8a17868-6e90-432e-b126-c5af5a09ae6b for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:12:06.293489 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:06.298833 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:06.411655 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Instance destroyed successfully.
May 21 02:12:06.412337 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lazy-loading 'resources' on Instance uuid 840919c9-6bf6-47ac-bb9c-35ea24494c2e {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:12:06.423912 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6faea440-6481-41ab-886c-ca97308ab493] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:12:06.424035 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329526.423768, 6faea440-6481-41ab-886c-ca97308ab493 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:12:06.424168 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6faea440-6481-41ab-886c-ca97308ab493] VM Paused (Lifecycle Event)
May 21 02:12:06.440387 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Took 7.70 seconds to spawn the instance on the hypervisor.
May 21 02:12:06.441071 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:12:06.488010 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:06.670924 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-301c8c99-4568-4ebf-91b6-459d901a7400 req-def8e019-2a4c-45d9-ac80-04dbbef8a2e2 service nova] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Received event network-vif-plugged-63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:12:06.671103 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-301c8c99-4568-4ebf-91b6-459d901a7400 req-def8e019-2a4c-45d9-ac80-04dbbef8a2e2 service nova] Acquiring lock "6faea440-6481-41ab-886c-ca97308ab493-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:06.671283 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-301c8c99-4568-4ebf-91b6-459d901a7400 req-def8e019-2a4c-45d9-ac80-04dbbef8a2e2 service nova] Lock "6faea440-6481-41ab-886c-ca97308ab493-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:06.671397 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-301c8c99-4568-4ebf-91b6-459d901a7400 req-def8e019-2a4c-45d9-ac80-04dbbef8a2e2 service nova] Lock "6faea440-6481-41ab-886c-ca97308ab493-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:06.671544 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-301c8c99-4568-4ebf-91b6-459d901a7400 req-def8e019-2a4c-45d9-ac80-04dbbef8a2e2 service nova] [instance: 6faea440-6481-41ab-886c-ca97308ab493] No waiting events found dispatching network-vif-plugged-63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:12:06.671678 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-301c8c99-4568-4ebf-91b6-459d901a7400 req-def8e019-2a4c-45d9-ac80-04dbbef8a2e2 service nova] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Received unexpected event network-vif-plugged-63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c for instance with vm_state active and task_state None.
May 21 02:12:06.748660 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:12:06.917757 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:10:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-998070334',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-998070334',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpattern-image-snapshot-server-998070334',id=69,image_ref='00f5ee93-ecd7-4a41-a40a-795483f1a463',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+LiYJhD2PPZubwisgBublNX2jMwBe8pfuQoO+l7hu0VGDhIkDnSWcpuXsiBfUK3Q2U3u3zDPEIn/IETzlelxEdJlxrGWAQ24FSeeK2AXOFBt4ms/ND82nCkiuN/5a7tg==',key_name='tempest-keypair-367282469',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:11:26Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62ebdb16aee84e22a88dfc8960debd32',ramdisk_id='',reservation_id='r-1sc3dvh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1995806391',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1995806391-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1995806391',owner_user_name='tempest-TestVolumeBootPattern-1995806391-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:11:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4878b5a5bf184852a9ce383caa1c67a4',uuid=840919c9-6bf6-47ac-bb9c-35ea24494c2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8a17868-6e90-432e-b126-c5af5a09ae6b", "address": "fa:16:3e:d1:2c:6c", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a17868-6e", "ovs_interfaceid": "a8a17868-6e90-432e-b126-c5af5a09ae6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:12:06.918214 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converting VIF {"id": "a8a17868-6e90-432e-b126-c5af5a09ae6b", "address": "fa:16:3e:d1:2c:6c", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a17868-6e", "ovs_interfaceid": "a8a17868-6e90-432e-b126-c5af5a09ae6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:12:06.918808 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:2c:6c,bridge_name='br-int',has_traffic_filtering=True,id=a8a17868-6e90-432e-b126-c5af5a09ae6b,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8a17868-6e') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:12:06.919086 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:2c:6c,bridge_name='br-int',has_traffic_filtering=True,id=a8a17868-6e90-432e-b126-c5af5a09ae6b,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8a17868-6e') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:12:06.920980 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:06.921207 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8a17868-6e, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:12:06.934302 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:12:06.934302 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:06.935431 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:12:06.935822 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:06.936089 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d163f2a0-0c8e-44fd-b2b4-06102527bcf0) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:12:06.937880 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:12:06.939310 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329526.9380784, 6faea440-6481-41ab-886c-ca97308ab493 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:12:06.939310 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6faea440-6481-41ab-886c-ca97308ab493] VM Resumed (Lifecycle Event)
May 21 02:12:06.943172 np0000001127 nova-compute[98206]: INFO os_vif [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:2c:6c,bridge_name='br-int',has_traffic_filtering=True,id=a8a17868-6e90-432e-b126-c5af5a09ae6b,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8a17868-6e')
May 21 02:12:06.944750 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:12:06.945025 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903', 'iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f8c00b3-1afb-4240-993e-fddb4a8e3903', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:12:06.945150 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:12:06.953538 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Took 13.20 seconds to build instance.
May 21 02:12:07.008702 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:07.255713 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.411s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:07.313660 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Deleted allocations for instance 6ccaedfe-bec9-4591-b845-acf0cc81d026
May 21 02:12:07.445287 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:12:07.449513 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:12:07.455805 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7849748a-3d7c-4127-8096-bb4a32ef76c9 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "6faea440-6481-41ab-886c-ca97308ab493" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.712s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:07.950801 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999643628000285 future=<Future at 0x71c0983bdeb0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:12:08.104619 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0005031460000282095 future=<Future at 0x71c05864a270 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:12:08.104619 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:12:08.104619 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=7.760098648000167 future=<Future at 0x71c09848b560 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:12:08.104741 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=7.75992013799987 future=<Future at 0x71c09848b560 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:12:08.105219 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Emitting event <LifecycleEvent: 1779329513.1036222, 16a0cc8d-c65b-4166-ad1a-5318b18ed00e => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:12:08.105403 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] VM Stopped (Lifecycle Event)
May 21 02:12:08.322220 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-dc6f802d-f2fb-4851-a9a0-171bc3edbbf5 tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Lock "6ccaedfe-bec9-4591-b845-acf0cc81d026" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.309s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:08.375526 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-81b4e8c0-8044-4465-8093-dcef100d52f5 req-9d11711b-28bd-4ec5-b0b3-f9df329f2c0d service nova] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Received event network-vif-unplugged-a8a17868-6e90-432e-b126-c5af5a09ae6b {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:12:08.376021 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-81b4e8c0-8044-4465-8093-dcef100d52f5 req-9d11711b-28bd-4ec5-b0b3-f9df329f2c0d service nova] Acquiring lock "840919c9-6bf6-47ac-bb9c-35ea24494c2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:08.376458 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-81b4e8c0-8044-4465-8093-dcef100d52f5 req-9d11711b-28bd-4ec5-b0b3-f9df329f2c0d service nova] Lock "840919c9-6bf6-47ac-bb9c-35ea24494c2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:08.376458 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-81b4e8c0-8044-4465-8093-dcef100d52f5 req-9d11711b-28bd-4ec5-b0b3-f9df329f2c0d service nova] Lock "840919c9-6bf6-47ac-bb9c-35ea24494c2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:08.376458 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-81b4e8c0-8044-4465-8093-dcef100d52f5 req-9d11711b-28bd-4ec5-b0b3-f9df329f2c0d service nova] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] No waiting events found dispatching network-vif-unplugged-a8a17868-6e90-432e-b126-c5af5a09ae6b {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:12:08.376714 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-81b4e8c0-8044-4465-8093-dcef100d52f5 req-9d11711b-28bd-4ec5-b0b3-f9df329f2c0d service nova] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Received event network-vif-unplugged-a8a17868-6e90-432e-b126-c5af5a09ae6b for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:12:08.609423 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-80e3f74d-05b6-47d5-ba30-b6dedce962a9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 16a0cc8d-c65b-4166-ad1a-5318b18ed00e] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:12:10.464158 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-056e7a63-dd53-459f-8db2-e1c2cf33ba44 req-02b9f9b1-2bb4-4791-9fde-19b51737a3f3 service nova] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Received event network-changed-63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:12:10.464158 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-056e7a63-dd53-459f-8db2-e1c2cf33ba44 req-02b9f9b1-2bb4-4791-9fde-19b51737a3f3 service nova] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Refreshing instance network info cache due to event network-changed-63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:12:10.464158 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-056e7a63-dd53-459f-8db2-e1c2cf33ba44 req-02b9f9b1-2bb4-4791-9fde-19b51737a3f3 service nova] Acquiring lock "refresh_cache-6faea440-6481-41ab-886c-ca97308ab493" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:12:10.464158 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-056e7a63-dd53-459f-8db2-e1c2cf33ba44 req-02b9f9b1-2bb4-4791-9fde-19b51737a3f3 service nova] Acquired lock "refresh_cache-6faea440-6481-41ab-886c-ca97308ab493" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:12:10.464158 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-056e7a63-dd53-459f-8db2-e1c2cf33ba44 req-02b9f9b1-2bb4-4791-9fde-19b51737a3f3 service nova] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Refreshing network info cache for port 63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:12:10.967002 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-056e7a63-dd53-459f-8db2-e1c2cf33ba44 req-02b9f9b1-2bb4-4791-9fde-19b51737a3f3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:12:11.271126 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:11.316433 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-056e7a63-dd53-459f-8db2-e1c2cf33ba44 req-02b9f9b1-2bb4-4791-9fde-19b51737a3f3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:12:11.533625 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-056e7a63-dd53-459f-8db2-e1c2cf33ba44 req-02b9f9b1-2bb4-4791-9fde-19b51737a3f3 service nova] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Updated VIF entry in instance network info cache for port 63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:12:11.533952 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-056e7a63-dd53-459f-8db2-e1c2cf33ba44 req-02b9f9b1-2bb4-4791-9fde-19b51737a3f3 service nova] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Updating instance_info_cache with network_info: [{"id": "63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c", "address": "fa:16:3e:88:c9:bf", "network": {"id": "dec0dbdb-dfbe-4a3d-9d29-6add07c9003f", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-775185877-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ae2ef74a1614eb09e4f71f709f64126", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63bdd924-29", "ovs_interfaceid": "63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:12:11.946440 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:12.012012 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:12.035737 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-056e7a63-dd53-459f-8db2-e1c2cf33ba44 req-02b9f9b1-2bb4-4791-9fde-19b51737a3f3 service nova] Releasing lock "refresh_cache-6faea440-6481-41ab-886c-ca97308ab493" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:12:12.823632 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 5.878s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:12:12.824339 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903', 'iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f8c00b3-1afb-4240-993e-fddb4a8e3903', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:12:12.824339 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:12:12.860293 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:12:12.860293 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:12:12.860293 np0000001127 nova-compute[98206]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:12:12.860293 np0000001127 nova-compute[98206]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:12:12.860293 np0000001127 nova-compute[98206]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:12:12.860293 np0000001127 nova-compute[98206]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:12:12.860293 np0000001127 nova-compute[98206]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f52a01c2-3ebd-4615-80ae-9a735dbf3c2d (non-flash)
May 21 02:12:12.860293 np0000001127 nova-compute[98206]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-33d200d9-5981-4462-a761-e2648c105d3c (non-flash)
May 21 02:12:12.860293 np0000001127 nova-compute[98206]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-33d200d9-5981-4462-a761-e2648c105d3c (non-flash)
May 21 02:12:12.860293 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:12:12.860650 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:12:12.860650 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:12:12.860650 np0000001127 nova-compute[98206]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:12:12.860650 np0000001127 nova-compute[98206]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903 (non-flash)
May 21 02:12:12.860650 np0000001127 nova-compute[98206]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:12:12.860650 np0000001127 nova-compute[98206]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:12:12.860650 np0000001127 nova-compute[98206]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f52a01c2-3ebd-4615-80ae-9a735dbf3c2d (non-flash)
May 21 02:12:12.860650 np0000001127 nova-compute[98206]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-33d200d9-5981-4462-a761-e2648c105d3c (non-flash)
May 21 02:12:12.860650 np0000001127 nova-compute[98206]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-33d200d9-5981-4462-a761-e2648c105d3c (non-flash)
May 21 02:12:12.860650 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:12:12.860941 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', '144'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', '145'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903', '160'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903', '161'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f', '162'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f', '163'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f52a01c2-3ebd-4615-80ae-9a735dbf3c2d', '177'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-33d200d9-5981-4462-a761-e2648c105d3c', '178'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-33d200d9-5981-4462-a761-e2648c105d3c', '179')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:12:12.860941 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903', '160')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:12:12.861913 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903', '161')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:12:12.862764 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c7472e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903'): ({'sde'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:12:12.862886 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Removing multipathed devices sdd, sde {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:12:12.863090 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Flush multipath device 3300000007e883e52 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:12:12.935763 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:12:12.979678 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:12:13.037391 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:12:13.037656 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:12:13.039266 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:12:13.053414 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:12:13.053547 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:12:13.084638 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:13.123673 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 160, target: iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903, portal: 192.168.40.100,3260]
May 21 02:12:13.123673 np0000001127 nova-compute[98206]: Logout of [sid: 160, target: iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903, portal: 192.168.40.100,3260] successful.
May 21 02:12:13.123673 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:13.142857 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:13.158445 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:13.192777 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 161, target: iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903, portal: 192.168.50.100,3260]
May 21 02:12:13.192777 np0000001127 nova-compute[98206]: Logout of [sid: 161, target: iqn.2023-03.storpool.com:os--volume-2f8c00b3-1afb-4240-993e-fddb4a8e3903, portal: 192.168.50.100,3260] successful.
May 21 02:12:13.192777 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:13.212993 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:13.213226 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:12:13.213380 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] <== disconnect_volume: return (6267ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:12:13.213542 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:12:13.213837 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Deleting instance files /opt/stack/data/nova/instances/840919c9-6bf6-47ac-bb9c-35ea24494c2e_del
May 21 02:12:13.214484 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Deletion of /opt/stack/data/nova/instances/840919c9-6bf6-47ac-bb9c-35ea24494c2e_del complete
May 21 02:12:13.724579 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Took 7.68 seconds to destroy the instance on the hypervisor.
May 21 02:12:13.726629 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:12:13.727329 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:12:13.727502 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:12:13.728170 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:12:13.876946 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:12:14.500988 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "80a69a0b-c6a1-4dfd-932e-826068764081" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:14.501694 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "80a69a0b-c6a1-4dfd-932e-826068764081" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:14.534566 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7074fecc-1ad0-4eec-af59-918392252a1e req-20482178-3355-4052-ae34-1955fbdf4e89 service nova] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Received event network-vif-deleted-a8a17868-6e90-432e-b126-c5af5a09ae6b {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:12:14.535232 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-7074fecc-1ad0-4eec-af59-918392252a1e req-20482178-3355-4052-ae34-1955fbdf4e89 service nova] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Neutron deleted interface a8a17868-6e90-432e-b126-c5af5a09ae6b; detaching it from the instance and deleting it from the info cache
May 21 02:12:14.535404 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-7074fecc-1ad0-4eec-af59-918392252a1e req-20482178-3355-4052-ae34-1955fbdf4e89 service nova] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:12:14.972057 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:12:15.007282 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:12:15.041536 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7074fecc-1ad0-4eec-af59-918392252a1e req-20482178-3355-4052-ae34-1955fbdf4e89 service nova] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Detach interface failed, port_id=a8a17868-6e90-432e-b126-c5af5a09ae6b, reason: Instance 840919c9-6bf6-47ac-bb9c-35ea24494c2e could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:12:15.474634 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Took 1.75 seconds to deallocate network for instance.
May 21 02:12:15.561330 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:15.562004 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:15.565375 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:12:15.565539 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Claim successful on node np0000001127
May 21 02:12:15.865615 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0009032170000864426 future=<Future at 0x71c09848b560 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:12:15.869652 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Emitting event <LifecycleEvent: 1779329520.8645878, 6ccaedfe-bec9-4591-b845-acf0cc81d026 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:12:15.869856 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:12:15.870040 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] VM Stopped (Lifecycle Event)
May 21 02:12:15.871062 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=7.0793703070003176 future=<Future at 0x71c0983bdeb0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:12:15.871201 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=7.079189000000042 future=<Future at 0x71c0983bdeb0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:12:16.039333 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Took 0.56 seconds to detach 1 volumes for instance.
May 21 02:12:16.041342 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Deleting volume: 2f8c00b3-1afb-4240-993e-fddb4a8e3903 {{(pid=98206) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 21 02:12:16.372604 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-d3b0752d-bab8-4da0-a729-5d04a87be187 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 6ccaedfe-bec9-4591-b845-acf0cc81d026] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:12:16.601212 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:16.815491 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:12:16.815720 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:12:16.949021 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:17.012831 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:17.318815 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:12:17.827021 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.265s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:17.827452 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:12:17.829921 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.229s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:18.121275 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:12:18.121603 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:12:18.334340 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:12:18.334873 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:12:18.334873 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:12:18.335153 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:12:18.433960 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '68fd64fea5a84a0bbb1d09de7d76709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a45856efe44aa92f802f146b17616', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:12:18.624476 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:12:18.838353 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:12:18.995267 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Successfully created port: 7197f4a8-0c77-4200-b65b-e3f7122e17be {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:12:19.130959 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.301s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:19.194399 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Deleted allocations for instance 840919c9-6bf6-47ac-bb9c-35ea24494c2e
May 21 02:12:19.341389 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:12:19.538036 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Successfully updated port: 7197f4a8-0c77-4200-b65b-e3f7122e17be {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:12:19.597369 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-95bbeda0-74b3-4f76-8abd-2f24a1720488 req-465e12c0-6056-4680-a34d-5ea1238419c5 service nova] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Received event network-changed-7197f4a8-0c77-4200-b65b-e3f7122e17be {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:12:19.597535 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-95bbeda0-74b3-4f76-8abd-2f24a1720488 req-465e12c0-6056-4680-a34d-5ea1238419c5 service nova] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Refreshing instance network info cache due to event network-changed-7197f4a8-0c77-4200-b65b-e3f7122e17be. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:12:19.597699 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-95bbeda0-74b3-4f76-8abd-2f24a1720488 req-465e12c0-6056-4680-a34d-5ea1238419c5 service nova] Acquiring lock "refresh_cache-80a69a0b-c6a1-4dfd-932e-826068764081" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:12:19.599060 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-95bbeda0-74b3-4f76-8abd-2f24a1720488 req-465e12c0-6056-4680-a34d-5ea1238419c5 service nova] Acquired lock "refresh_cache-80a69a0b-c6a1-4dfd-932e-826068764081" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:12:19.599445 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-95bbeda0-74b3-4f76-8abd-2f24a1720488 req-465e12c0-6056-4680-a34d-5ea1238419c5 service nova] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Refreshing network info cache for port 7197f4a8-0c77-4200-b65b-e3f7122e17be {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:12:19.845710 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Booting with volume b1a825b3-a763-479f-8c2f-42fbf9fa9c13 at /dev/vda
May 21 02:12:19.892577 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:12:19.905357 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:12:19.924076 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:12:19.967368 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:12:19.967688 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:12:19.977129 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:12:19.978456 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe30:164f', 'fe80::c44d:25ff:fe10:25cb', 'fe80::fc16:3eff:fe0b:8915', 'fe80::7ca5:4ff:fee7:fb0a', 'fe80::fc16:3eff:fe88:c9bf', 'fe80::7045:30ff:fe1a:b99f'] 
May 21 02:12:19.978671 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:12:19.978785 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:12:19.979026 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:12:19.979241 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Updating existing volume attachment record: 16234613-c71b-4f3f-b7c7-b17a93f56961 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:12:20.040122 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "refresh_cache-80a69a0b-c6a1-4dfd-932e-826068764081" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:12:20.102125 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-95bbeda0-74b3-4f76-8abd-2f24a1720488 req-465e12c0-6056-4680-a34d-5ea1238419c5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:12:20.118938 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Acquiring lock "3767becb-caf4-47ee-904f-112069ee8dba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:20.118938 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "3767becb-caf4-47ee-904f-112069ee8dba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:20.171075 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-95bbeda0-74b3-4f76-8abd-2f24a1720488 req-465e12c0-6056-4680-a34d-5ea1238419c5 service nova] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:12:20.208507 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ecc226f4-366a-4ca7-a9d0-fcb675e5ff22 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "840919c9-6bf6-47ac-bb9c-35ea24494c2e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.673s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:20.331829 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-95bbeda0-74b3-4f76-8abd-2f24a1720488 req-465e12c0-6056-4680-a34d-5ea1238419c5 service nova] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:12:20.628159 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Detaching volume 25afd690-442e-4fa0-ac9b-3d9a82c6403f
May 21 02:12:20.686344 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Attempting to driver detach volume 25afd690-442e-4fa0-ac9b-3d9a82c6403f from mountpoint /dev/vdb
May 21 02:12:20.694444 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Found disk vdb by alias ua-25afd690-442e-4fa0-ac9b-3d9a82c6403f {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:12:20.697069 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Found disk vdb by alias ua-25afd690-442e-4fa0-ac9b-3d9a82c6403f {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:12:20.697218 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Attempting to detach device vdb from instance 3767becb-caf4-47ee-904f-112069ee8dba from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 02:12:20.697619 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:12:20.697619 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:12:20.697619 np0000001127 nova-compute[98206]:   <alias name="ua-25afd690-442e-4fa0-ac9b-3d9a82c6403f"/>
May 21 02:12:20.697619 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-10"/>
May 21 02:12:20.697619 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:12:20.697619 np0000001127 nova-compute[98206]:   <serial>25afd690-442e-4fa0-ac9b-3d9a82c6403f</serial>
May 21 02:12:20.697619 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:12:20.697619 np0000001127 nova-compute[98206]: </disk>
May 21 02:12:20.697619 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:12:20.712591 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Successfully detached device vdb from instance 3767becb-caf4-47ee-904f-112069ee8dba from the persistent domain config.
May 21 02:12:20.712738 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] (1/8): Attempting to detach device vdb with device alias ua-25afd690-442e-4fa0-ac9b-3d9a82c6403f from instance 3767becb-caf4-47ee-904f-112069ee8dba from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 02:12:20.713041 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:12:20.713041 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:12:20.713041 np0000001127 nova-compute[98206]:   <alias name="ua-25afd690-442e-4fa0-ac9b-3d9a82c6403f"/>
May 21 02:12:20.713041 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-10"/>
May 21 02:12:20.713041 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:12:20.713041 np0000001127 nova-compute[98206]:   <serial>25afd690-442e-4fa0-ac9b-3d9a82c6403f</serial>
May 21 02:12:20.713041 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:12:20.713041 np0000001127 nova-compute[98206]: </disk>
May 21 02:12:20.713041 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:12:20.833767 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-95bbeda0-74b3-4f76-8abd-2f24a1720488 req-465e12c0-6056-4680-a34d-5ea1238419c5 service nova] Releasing lock "refresh_cache-80a69a0b-c6a1-4dfd-932e-826068764081" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:12:20.834168 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquired lock "refresh_cache-80a69a0b-c6a1-4dfd-932e-826068764081" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:12:20.834364 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:12:21.217777 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779329541.2167675, 3767becb-caf4-47ee-904f-112069ee8dba => ua-25afd690-442e-4fa0-ac9b-3d9a82c6403f> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 02:12:21.219440 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-25afd690-442e-4fa0-ac9b-3d9a82c6403f for instance 3767becb-caf4-47ee-904f-112069ee8dba {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 02:12:21.224266 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Successfully detached device vdb from instance 3767becb-caf4-47ee-904f-112069ee8dba from the live domain config.
May 21 02:12:21.225945 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:12:21.226722 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f', 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '25afd690-442e-4fa0-ac9b-3d9a82c6403f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:12:21.226902 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:12:21.428352 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:12:21.573870 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:12:21.680701 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.454s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:12:21.681117 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f', 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '25afd690-442e-4fa0-ac9b-3d9a82c6403f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:12:21.681314 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:12:21.715009 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:12:21.715009 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:12:21.715009 np0000001127 nova-compute[98206]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:12:21.715009 np0000001127 nova-compute[98206]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:12:21.715009 np0000001127 nova-compute[98206]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee37e714-b275-473f-8fa9-4914409bbcd6 (non-flash)
May 21 02:12:21.715009 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:12:21.715009 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsi session list stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:12:21.715009 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:12:21.715009 np0000001127 nova-compute[98206]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:12:21.715009 np0000001127 nova-compute[98206]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f (non-flash)
May 21 02:12:21.715009 np0000001127 nova-compute[98206]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee37e714-b275-473f-8fa9-4914409bbcd6 (non-flash)
May 21 02:12:21.715009 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:12:21.715009 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', '144'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', '145'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f', '162'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f', '163'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ee37e714-b275-473f-8fa9-4914409bbcd6', '180')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:12:21.715009 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f', '162')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:12:21.718487 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f', '163')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:12:21.718487 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c5153a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f'): ({'sdg'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:12:21.718487 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Removing multipathed devices sdg, sdf {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:12:21.718487 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Flush multipath device 3300000007ae6c6c9 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:12:21.722149 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Updating instance_info_cache with network_info: [{"id": "7197f4a8-0c77-4200-b65b-e3f7122e17be", "address": "fa:16:3e:bc:af:64", "network": {"id": "68132179-7a2d-4b6f-bc7a-da8f937a9fb2", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1224285668-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "517a45856efe44aa92f802f146b17616", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7197f4a8-0c", "ovs_interfaceid": "7197f4a8-0c77-4200-b65b-e3f7122e17be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:12:21.746841 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:12:21.797122 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:12:21.841843 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:12:21.842050 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:12:21.843590 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:12:21.856784 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:12:21.859713 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:12:21.873614 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:21.916642 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 162, target: iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f, portal: 192.168.40.100,3260]
May 21 02:12:21.916642 np0000001127 nova-compute[98206]: Logout of [sid: 162, target: iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f, portal: 192.168.40.100,3260] successful.
May 21 02:12:21.916642 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:21.935432 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:21.946753 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:21.971234 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:21.997141 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 163, target: iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f, portal: 192.168.50.100,3260]
May 21 02:12:21.997141 np0000001127 nova-compute[98206]: Logout of [sid: 163, target: iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f, portal: 192.168.50.100,3260] successful.
May 21 02:12:21.997141 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:22.017796 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:22.022667 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:22.022936 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:12:22.023079 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] <== disconnect_volume: return (796ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:12:22.023298 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:12:22.092278 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:12:22.093940 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:12:22.094196 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Creating image(s)
May 21 02:12:22.095763 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Did not create local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 21 02:12:22.095763 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Ensure instance console log exists: /opt/stack/data/nova/instances/80a69a0b-c6a1-4dfd-932e-826068764081/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:12:22.095763 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:22.095763 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:22.095763 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:22.224233 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Releasing lock "refresh_cache-80a69a0b-c6a1-4dfd-932e-826068764081" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:12:22.224578 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Instance network_info: |[{"id": "7197f4a8-0c77-4200-b65b-e3f7122e17be", "address": "fa:16:3e:bc:af:64", "network": {"id": "68132179-7a2d-4b6f-bc7a-da8f937a9fb2", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1224285668-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "517a45856efe44aa92f802f146b17616", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7197f4a8-0c", "ovs_interfaceid": "7197f4a8-0c77-4200-b65b-e3f7122e17be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:12:22.225184 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Start _get_guest_xml network_info=[{"id": "7197f4a8-0c77-4200-b65b-e3f7122e17be", "address": "fa:16:3e:bc:af:64", "network": {"id": "68132179-7a2d-4b6f-bc7a-da8f937a9fb2", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1224285668-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "517a45856efe44aa92f802f146b17616", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7197f4a8-0c", "ovs_interfaceid": "7197f4a8-0c77-4200-b65b-e3f7122e17be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13', 'iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b1a825b3-a763-479f-8c2f-42fbf9fa9c13', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '80a69a0b-c6a1-4dfd-932e-826068764081', 'attached_at': '', 'detached_at': '', 'volume_id': 'b1a825b3-a763-479f-8c2f-42fbf9fa9c13', 'serial': 'b1a825b3-a763-479f-8c2f-42fbf9fa9c13'}, 'delete_on_termination': False, 'attachment_id': '16234613-c71b-4f3f-b7c7-b17a93f56961', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:12:22.232698 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:12:22.236493 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-126509525', uuid='80a69a0b-c6a1-4dfd-932e-826068764081'), owner=OwnerMeta(userid='68fd64fea5a84a0bbb1d09de7d76709c', username='tempest-TestEncryptedCinderVolumes-1523380334-project-member', projectid='517a45856efe44aa92f802f146b17616', projectname='tempest-TestEncryptedCinderVolumes-1523380334'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7197f4a8-0c77-4200-b65b-e3f7122e17be", "address": "fa:16:3e:bc:af:64", "network": {"id": "68132179-7a2d-4b6f-bc7a-da8f937a9fb2", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1224285668-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "517a45856efe44aa92f802f146b17616", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7197f4a8-0c", "ovs_interfaceid": "7197f4a8-0c77-4200-b65b-e3f7122e17be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329542.2334967) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:12:22.236493 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:12:22.237106 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:12:22.238393 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:12:22.238601 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:12:22.239454 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:12:22.239745 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:12:22.239895 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:12:22.239983 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:12:22.240090 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:12:22.240184 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:12:22.240274 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:12:22.240431 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:12:22.240571 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:12:22.240690 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:12:22.240812 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:12:22.240927 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:12:22.251324 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:12:22.251598 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13', 'iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b1a825b3-a763-479f-8c2f-42fbf9fa9c13', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:12:22.251716 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:12:22.251983 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:12:22.252151 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13', 'iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b1a825b3-a763-479f-8c2f-42fbf9fa9c13', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:12:22.265179 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:12:22.266527 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:12:22.266802 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:12:22.267021 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:12:22.267628 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:12:22.267790 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:12:22.281623 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:12:22.281623 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:22.288103 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:12:22.288103 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:22.297192 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13] added
May 21 02:12:22.297192 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:12:22.297192 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:12:22.297192 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:12:22.297192 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:12:22.297192 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:12:22.297192 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:22.297490 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:12:22.297554 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0305(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:12:22.297705 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:12:22.306983 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13] added
May 21 02:12:22.306983 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:12:22.306983 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:12:22.306983 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:12:22.306983 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:12:22.306983 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:12:22.306983 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:22.307261 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:12:22.307364 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0395(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:12:22.307645 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:12:22.550350 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "cec9e114-b934-4de6-b0f0-586cd34a59bd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:22.550350 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "cec9e114-b934-4de6-b0f0-586cd34a59bd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:22.550461 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "cec9e114-b934-4de6-b0f0-586cd34a59bd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:22.550670 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "cec9e114-b934-4de6-b0f0-586cd34a59bd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:22.550832 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "cec9e114-b934-4de6-b0f0-586cd34a59bd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:22.554645 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Terminating instance
May 21 02:12:22.599491 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lazy-loading 'flavor' on Instance uuid 3767becb-caf4-47ee-904f-112069ee8dba {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:12:22.950888 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0004600659999596246 future=<Future at 0x71c0983bdeb0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:12:22.951221 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:12:22.951373 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Emitting event <LifecycleEvent: 1779329527.9503343, 840919c9-6bf6-47ac-bb9c-35ea24494c2e => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:12:22.951748 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] VM Stopped (Lifecycle Event)
May 21 02:12:23.061049 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:12:23.083160 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:23.086340 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:23.110503 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:23.119445 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:23.138697 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:23.143830 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:23.246728 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a324cced-660c-4e5e-b024-532d2724cd7d req-b1c108b2-ead7-4a41-bfb9-1a2ba1d69a0d service nova] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Received event network-vif-unplugged-5142d614-fe12-4ae6-a0ed-8c5658b5505b {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:12:23.246728 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a324cced-660c-4e5e-b024-532d2724cd7d req-b1c108b2-ead7-4a41-bfb9-1a2ba1d69a0d service nova] Acquiring lock "cec9e114-b934-4de6-b0f0-586cd34a59bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:23.246728 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a324cced-660c-4e5e-b024-532d2724cd7d req-b1c108b2-ead7-4a41-bfb9-1a2ba1d69a0d service nova] Lock "cec9e114-b934-4de6-b0f0-586cd34a59bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:23.246728 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a324cced-660c-4e5e-b024-532d2724cd7d req-b1c108b2-ead7-4a41-bfb9-1a2ba1d69a0d service nova] Lock "cec9e114-b934-4de6-b0f0-586cd34a59bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:23.246728 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a324cced-660c-4e5e-b024-532d2724cd7d req-b1c108b2-ead7-4a41-bfb9-1a2ba1d69a0d service nova] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] No waiting events found dispatching network-vif-unplugged-5142d614-fe12-4ae6-a0ed-8c5658b5505b {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:12:23.246728 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a324cced-660c-4e5e-b024-532d2724cd7d req-b1c108b2-ead7-4a41-bfb9-1a2ba1d69a0d service nova] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Received event network-vif-unplugged-5142d614-fe12-4ae6-a0ed-8c5658b5505b for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:12:23.298691 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:12:23.307820 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:12:23.318742 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:12:23.318742 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:23.336273 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:12:23.345631 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:12:23.345631 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:23.362778 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:23.368630 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:23.377722 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Acquiring lock "3767becb-caf4-47ee-904f-112069ee8dba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:23.387829 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:12:23.387829 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:12:23.387829 np0000001127 nova-compute[98206]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee37e714-b275-473f-8fa9-4914409bbcd6 (non-flash)
May 21 02:12:23.387829 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:12:23.387993 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsi session list stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:12:23.387993 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:12:23.387993 np0000001127 nova-compute[98206]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee37e714-b275-473f-8fa9-4914409bbcd6 (non-flash)
May 21 02:12:23.387993 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:12:23.407659 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:12:23.407659 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:12:23.407659 np0000001127 nova-compute[98206]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee37e714-b275-473f-8fa9-4914409bbcd6 (non-flash)
May 21 02:12:23.407659 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:12:23.407881 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsi session list stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:12:23.407881 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:12:23.407881 np0000001127 nova-compute[98206]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee37e714-b275-473f-8fa9-4914409bbcd6 (non-flash)
May 21 02:12:23.407881 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:12:23.424629 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999643187999936 future=<Future at 0x71c0585b8d40 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:12:23.425021 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.9992544669999 future=<Future at 0x71c0585b8d40 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:12:23.425134 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999099649999607 future=<Future at 0x71c0585b8d40 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:12:23.428214 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Instance destroyed successfully.
May 21 02:12:23.429298 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lazy-loading 'resources' on Instance uuid cec9e114-b934-4de6-b0f0-586cd34a59bd {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:12:23.430758 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13, portal: 192.168.40.100,3260]
May 21 02:12:23.430758 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13, portal: 192.168.40.100,3260] successful.
May 21 02:12:23.430758 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:23.448294 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13, portal: 192.168.50.100,3260]
May 21 02:12:23.448294 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13, portal: 192.168.50.100,3260] successful.
May 21 02:12:23.448294 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:23.448506 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:23.455169 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: 840919c9-6bf6-47ac-bb9c-35ea24494c2e] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:12:23.467721 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:23.468815 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:12:23.468815 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:12:23.468815 np0000001127 nova-compute[98206]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee37e714-b275-473f-8fa9-4914409bbcd6 (non-flash)
May 21 02:12:23.468815 np0000001127 nova-compute[98206]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:23.468815 np0000001127 nova-compute[98206]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:23.468815 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:12:23.468815 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsi session list stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:12:23.468815 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:12:23.468815 np0000001127 nova-compute[98206]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee37e714-b275-473f-8fa9-4914409bbcd6 (non-flash)
May 21 02:12:23.468815 np0000001127 nova-compute[98206]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:23.468815 np0000001127 nova-compute[98206]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:23.468815 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:12:23.468815 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.202s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:12:23.468815 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:12:23.469544 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] HCTL ('8', '-', '-', 0) found on session 181 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:12:23.469592 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:12:23.486086 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:12:23.486086 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:12:23.486086 np0000001127 nova-compute[98206]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee37e714-b275-473f-8fa9-4914409bbcd6 (non-flash)
May 21 02:12:23.486086 np0000001127 nova-compute[98206]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:23.486086 np0000001127 nova-compute[98206]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:23.486086 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:12:23.486416 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsi session list stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:12:23.486416 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:12:23.486416 np0000001127 nova-compute[98206]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee37e714-b275-473f-8fa9-4914409bbcd6 (non-flash)
May 21 02:12:23.486416 np0000001127 nova-compute[98206]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:23.486416 np0000001127 nova-compute[98206]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:23.486416 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:12:23.491296 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.219s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:12:23.491296 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:12:23.491296 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] HCTL ('9', '-', '-', 0) found on session 182 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:12:23.491296 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:12:23.491296 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Searching for a device in session 181 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:12:23.491296 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b1a825b3-a763-479f-8c2f-42fbf9fa9c13', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:12:23.508349 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Searching for a device in session 182 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:12:23.508349 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b1a825b3-a763-479f-8c2f-42fbf9fa9c13', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:12:23.610338 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7fcb69cf-5095-455c-a7d2-83849ff6d4ec tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "3767becb-caf4-47ee-904f-112069ee8dba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.492s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:23.610667 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "3767becb-caf4-47ee-904f-112069ee8dba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.233s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:23.610996 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Acquiring lock "3767becb-caf4-47ee-904f-112069ee8dba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:23.611247 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "3767becb-caf4-47ee-904f-112069ee8dba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:23.613688 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "3767becb-caf4-47ee-904f-112069ee8dba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:23.616623 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Terminating instance
May 21 02:12:23.934251 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:09:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-613838180',display_name='tempest-TestVolumeBootPattern-volume-backed-server-613838180',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpattern-volume-backed-server-613838180',id=65,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOh+EZ2+GqsugxvV48SXUFbhnnqWDhW4QWVbmtidsehsHFgubQolVOqcHhu9DZ5RbLUZKULuJ6XaLkn3xM/E2q+WSWqLkPn0fo2YUhxbA/iavkEae7ZiB+lt00S1b4tMyQ==',key_name='tempest-keypair-1504145938',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:09:29Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62ebdb16aee84e22a88dfc8960debd32',ramdisk_id='',reservation_id='r-bxtqzzv5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1995806391',owner_user_name='tempest-TestVolumeBootPattern-1995806391-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:09:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4878b5a5bf184852a9ce383caa1c67a4',uuid=cec9e114-b934-4de6-b0f0-586cd34a59bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5142d614-fe12-4ae6-a0ed-8c5658b5505b", "address": "fa:16:3e:30:16:4f", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5142d614-fe", "ovs_interfaceid": "5142d614-fe12-4ae6-a0ed-8c5658b5505b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:12:23.934679 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converting VIF {"id": "5142d614-fe12-4ae6-a0ed-8c5658b5505b", "address": "fa:16:3e:30:16:4f", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5142d614-fe", "ovs_interfaceid": "5142d614-fe12-4ae6-a0ed-8c5658b5505b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:12:23.935557 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:16:4f,bridge_name='br-int',has_traffic_filtering=True,id=5142d614-fe12-4ae6-a0ed-8c5658b5505b,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5142d614-fe') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:12:23.935792 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:16:4f,bridge_name='br-int',has_traffic_filtering=True,id=5142d614-fe12-4ae6-a0ed-8c5658b5505b,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5142d614-fe') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:12:23.937337 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:23.937409 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5142d614-fe, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:12:23.938556 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:23.939530 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:12:23.940073 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:23.940830 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:23.941113 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ee0b2260-18cf-4729-b83e-73772ef407f1) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:12:23.941969 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:23.942539 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:12:23.942597 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:23.944328 np0000001127 nova-compute[98206]: INFO os_vif [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:16:4f,bridge_name='br-int',has_traffic_filtering=True,id=5142d614-fe12-4ae6-a0ed-8c5658b5505b,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5142d614-fe')
May 21 02:12:23.946201 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:12:23.946583 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7ea6075d-0c38-4100-9259-e68a64fa39fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:12:23.946762 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:12:24.121003 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:12:24.139540 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:24.143927 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:24.165605 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:24.176740 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:24.195834 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:24.201162 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:24.268344 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:12:24.340766 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-beeb79b1-c64a-490f-8a29-8c8e0b84898c req-5aaa9ec1-c113-4194-ac56-b917763b6423 service nova] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Received event network-vif-unplugged-ad59f56d-4c95-4f01-8318-98360ae0fe9a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:12:24.340943 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-beeb79b1-c64a-490f-8a29-8c8e0b84898c req-5aaa9ec1-c113-4194-ac56-b917763b6423 service nova] Acquiring lock "3767becb-caf4-47ee-904f-112069ee8dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:24.341090 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-beeb79b1-c64a-490f-8a29-8c8e0b84898c req-5aaa9ec1-c113-4194-ac56-b917763b6423 service nova] Lock "3767becb-caf4-47ee-904f-112069ee8dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:24.341205 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-beeb79b1-c64a-490f-8a29-8c8e0b84898c req-5aaa9ec1-c113-4194-ac56-b917763b6423 service nova] Lock "3767becb-caf4-47ee-904f-112069ee8dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:24.341307 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-beeb79b1-c64a-490f-8a29-8c8e0b84898c req-5aaa9ec1-c113-4194-ac56-b917763b6423 service nova] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] No waiting events found dispatching network-vif-unplugged-ad59f56d-4c95-4f01-8318-98360ae0fe9a {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:12:24.341410 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-beeb79b1-c64a-490f-8a29-8c8e0b84898c req-5aaa9ec1-c113-4194-ac56-b917763b6423 service nova] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Received event network-vif-unplugged-ad59f56d-4c95-4f01-8318-98360ae0fe9a for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:12:24.438856 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999747181999737 future=<Future at 0x71c0983bdfd0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:12:24.441860 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Instance destroyed successfully.
May 21 02:12:24.442458 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lazy-loading 'resources' on Instance uuid 3767becb-caf4-47ee-904f-112069ee8dba {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:12:24.944693 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:10:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-603958284',display_name='tempest-VolumesBackupsTest-instance-603958284',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumesbackupstest-instance-603958284',id=70,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcMaSezxAnMN9aofKRkvyGEx7twQaGovCL/qkU9m3Mh/orSqA5mCm20sOvFR1OnAZ9lhJSfg6gTjaWGvxoU4NdN1BvCeaj/fAatr/pvLSc/cZbhud9JkvhZU1k1c+to7w==',key_name='tempest-keypair-758588982',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:10:29Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='549d365926ce49efa4c4bf50c7bbbbaa',ramdisk_id='',reservation_id='r-zq044hm3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-958095449',owner_user_name='tempest-VolumesBackupsTest-958095449-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:10:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09298d250fae40f1adea3cae800dd569',uuid=3767becb-caf4-47ee-904f-112069ee8dba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad59f56d-4c95-4f01-8318-98360ae0fe9a", "address": "fa:16:3e:0b:89:15", "network": {"id": "b32cfb32-7b1e-4cc7-b35b-a86447f00a8a", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-397130825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "549d365926ce49efa4c4bf50c7bbbbaa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad59f56d-4c", "ovs_interfaceid": "ad59f56d-4c95-4f01-8318-98360ae0fe9a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:12:24.944863 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Converting VIF {"id": "ad59f56d-4c95-4f01-8318-98360ae0fe9a", "address": "fa:16:3e:0b:89:15", "network": {"id": "b32cfb32-7b1e-4cc7-b35b-a86447f00a8a", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-397130825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "549d365926ce49efa4c4bf50c7bbbbaa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad59f56d-4c", "ovs_interfaceid": "ad59f56d-4c95-4f01-8318-98360ae0fe9a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:12:24.945376 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:89:15,bridge_name='br-int',has_traffic_filtering=True,id=ad59f56d-4c95-4f01-8318-98360ae0fe9a,network=Network(b32cfb32-7b1e-4cc7-b35b-a86447f00a8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad59f56d-4c') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:12:24.945615 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:89:15,bridge_name='br-int',has_traffic_filtering=True,id=ad59f56d-4c95-4f01-8318-98360ae0fe9a,network=Network(b32cfb32-7b1e-4cc7-b35b-a86447f00a8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad59f56d-4c') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:12:24.946326 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:24.946535 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad59f56d-4c, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:12:24.947389 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:24.948142 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:12:24.948849 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:24.949548 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:24.949695 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=869de088-9bf1-4c13-9f88-6c2c51c08887) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:12:24.950085 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:24.950612 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:12:24.951052 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:24.953153 np0000001127 nova-compute[98206]: INFO os_vif [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:89:15,bridge_name='br-int',has_traffic_filtering=True,id=ad59f56d-4c95-4f01-8318-98360ae0fe9a,network=Network(b32cfb32-7b1e-4cc7-b35b-a86447f00a8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad59f56d-4c')
May 21 02:12:24.954647 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:12:24.954923 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f', 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '25afd690-442e-4fa0-ac9b-3d9a82c6403f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:12:24.955083 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:12:25.287709 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Found WWN 330000000f0b00697 for multipath device dm-0 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:12:25.288164 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:12:25.288367 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.342s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:12:25.288732 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7ea6075d-0c38-4100-9259-e68a64fa39fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:12:25.288844 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:12:25.295643 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] <== connect_volume: return (3043ms) {'type': 'block', 'scsi_wwn': '330000000f0b00697', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000f0b00697'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:12:25.295793 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f0b00697', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000f0b00697'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:12:25.312112 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a526d5db-9fbe-482f-b9d2-c38dc571bdff req-40916c09-0a52-4f51-bda9-2f976b0376b2 service nova] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Received event network-vif-unplugged-5142d614-fe12-4ae6-a0ed-8c5658b5505b {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:12:25.312302 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a526d5db-9fbe-482f-b9d2-c38dc571bdff req-40916c09-0a52-4f51-bda9-2f976b0376b2 service nova] Acquiring lock "cec9e114-b934-4de6-b0f0-586cd34a59bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:25.312642 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a526d5db-9fbe-482f-b9d2-c38dc571bdff req-40916c09-0a52-4f51-bda9-2f976b0376b2 service nova] Lock "cec9e114-b934-4de6-b0f0-586cd34a59bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:25.312758 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a526d5db-9fbe-482f-b9d2-c38dc571bdff req-40916c09-0a52-4f51-bda9-2f976b0376b2 service nova] Lock "cec9e114-b934-4de6-b0f0-586cd34a59bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:25.312915 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a526d5db-9fbe-482f-b9d2-c38dc571bdff req-40916c09-0a52-4f51-bda9-2f976b0376b2 service nova] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] No waiting events found dispatching network-vif-unplugged-5142d614-fe12-4ae6-a0ed-8c5658b5505b {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:12:25.313040 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a526d5db-9fbe-482f-b9d2-c38dc571bdff req-40916c09-0a52-4f51-bda9-2f976b0376b2 service nova] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Received event network-vif-unplugged-5142d614-fe12-4ae6-a0ed-8c5658b5505b for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:12:25.314745 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:12:25.314745 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:12:25.314745 np0000001127 nova-compute[98206]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee37e714-b275-473f-8fa9-4914409bbcd6 (non-flash)
May 21 02:12:25.314745 np0000001127 nova-compute[98206]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:25.314745 np0000001127 nova-compute[98206]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:25.314745 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:12:25.314745 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:12:25.314745 np0000001127 nova-compute[98206]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe (non-flash)
May 21 02:12:25.314745 np0000001127 nova-compute[98206]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee37e714-b275-473f-8fa9-4914409bbcd6 (non-flash)
May 21 02:12:25.314745 np0000001127 nova-compute[98206]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:25.314745 np0000001127 nova-compute[98206]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:25.314745 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:12:25.314980 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', '144'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', '145'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ee37e714-b275-473f-8fa9-4914409bbcd6', '180'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13', '181'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13', '182')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:12:25.314980 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', '144')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:12:25.315899 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe', '145')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:12:25.316622 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c7af4c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe'): ({'sdk'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:12:25.316984 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Removing multipathed devices sdk, sdj {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:12:25.316984 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Flush multipath device 330000000305eda9d {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:12:25.343903 np0000001127 nova-compute[98206]: DEBUG os_brick.encryptors [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13', 'iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b1a825b3-a763-479f-8c2f-42fbf9fa9c13', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '80a69a0b-c6a1-4dfd-932e-826068764081', 'attached_at': '', 'detached_at': '', 'volume_id': 'b1a825b3-a763-479f-8c2f-42fbf9fa9c13', 'serial': 'b1a825b3-a763-479f-8c2f-42fbf9fa9c13'} {{(pid=98206) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 21 02:12:25.344771 np0000001127 nova-compute[98206]: WARNING stevedore.named [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 21 02:12:25.344993 np0000001127 nova-compute[98206]: WARNING castellan.key_manager [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 21 02:12:25.345178 np0000001127 nova-compute[98206]: WARNING nova.keymgr.conf_key_mgr [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 21 02:12:25.362161 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Secret XML: <secret ephemeral="no" private="no">
May 21 02:12:25.362161 np0000001127 nova-compute[98206]:   <usage type="volume">
May 21 02:12:25.362161 np0000001127 nova-compute[98206]:     <volume>b1a825b3-a763-479f-8c2f-42fbf9fa9c13</volume>
May 21 02:12:25.362161 np0000001127 nova-compute[98206]:   </usage>
May 21 02:12:25.362161 np0000001127 nova-compute[98206]: </secret>
May 21 02:12:25.362161 np0000001127 nova-compute[98206]:  {{(pid=98206) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 21 02:12:25.390653 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:12:25.438933 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:12:25.489718 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:12:25.489906 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:12:25.491006 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:12:25.501835 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:12:25.502042 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:12:25.513427 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:25.544523 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 144, target: iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe, portal: 192.168.40.100,3260]
May 21 02:12:25.544523 np0000001127 nova-compute[98206]: Logout of [sid: 144, target: iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe, portal: 192.168.40.100,3260] successful.
May 21 02:12:25.544523 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:25.561510 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:25.572327 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:25.611447 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 145, target: iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe, portal: 192.168.50.100,3260]
May 21 02:12:25.611447 np0000001127 nova-compute[98206]: Logout of [sid: 145, target: iqn.2023-03.storpool.com:os--volume-7ea6075d-0c38-4100-9259-e68a64fa39fe, portal: 192.168.50.100,3260] successful.
May 21 02:12:25.611447 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:25.623621 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:25.623835 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:12:25.623964 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] <== disconnect_volume: return (1677ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:12:25.624139 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:12:25.624696 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.670s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:12:25.625121 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Deleting instance files /opt/stack/data/nova/instances/cec9e114-b934-4de6-b0f0-586cd34a59bd_del
May 21 02:12:25.625296 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f', 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '25afd690-442e-4fa0-ac9b-3d9a82c6403f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:12:25.625455 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:12:25.626022 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Deletion of /opt/stack/data/nova/instances/cec9e114-b934-4de6-b0f0-586cd34a59bd_del complete
May 21 02:12:25.649406 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee37e714-b275-473f-8fa9-4914409bbcd6 (non-flash)
May 21 02:12:25.649406 np0000001127 nova-compute[98206]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:25.649406 np0000001127 nova-compute[98206]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:25.649406 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:12:25.649737 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] iscsi session list stdout=tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee37e714-b275-473f-8fa9-4914409bbcd6 (non-flash)
May 21 02:12:25.649737 np0000001127 nova-compute[98206]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:25.649737 np0000001127 nova-compute[98206]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:25.649737 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:12:25.649937 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ee37e714-b275-473f-8fa9-4914409bbcd6', '180'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13', '181'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13', '182')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:12:25.650091 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f, 0): [] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:12:25.650193 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f') {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 21 02:12:25.650314 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f, 0): [] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:12:25.650425 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-25afd690-442e-4fa0-ac9b-3d9a82c6403f') {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 21 02:12:25.650573 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c0587f2b60>, {}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:12:25.650705 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Disconnecting from: [] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:12:25.650901 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.026s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:12:25.651042 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] <== disconnect_volume: return (696ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:12:25.651154 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:12:25.651369 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Deleting instance files /opt/stack/data/nova/instances/3767becb-caf4-47ee-904f-112069ee8dba_del
May 21 02:12:25.652185 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Deletion of /opt/stack/data/nova/instances/3767becb-caf4-47ee-904f-112069ee8dba_del complete
May 21 02:12:25.872937 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:12:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-126509525',display_name='tempest-TestEncryptedCinderVolumes-server-126509525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testencryptedcindervolumes-server-126509525',id=72,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAhkQbp5kMwPyRYbKzXvFue4B05DSWlMs4KXDTXsTygnB2TWy+kt4GBTiDM8LiCQTVRBWYkE1itG7K2+H6oL5C/hvlsCCr+Z7SvxCHUYwFWVcZ1ePW8nLfDe4MI4Yf/Uw==',key_name='tempest-TestEncryptedCinderVolumes-618034694',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='517a45856efe44aa92f802f146b17616',ramdisk_id='',reservation_id='r-9bfnignm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1523380334',owner_user_name='tempest-TestEncryptedCinderVolumes-1523380334-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:12:19Z,user_data=None,user_id='68fd64fea5a84a0bbb1d09de7d76709c',uuid=80a69a0b-c6a1-4dfd-932e-826068764081,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7197f4a8-0c77-4200-b65b-e3f7122e17be", "address": "fa:16:3e:bc:af:64", "network": {"id": "68132179-7a2d-4b6f-bc7a-da8f937a9fb2", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1224285668-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "517a45856efe44aa92f802f146b17616", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7197f4a8-0c", "ovs_interfaceid": "7197f4a8-0c77-4200-b65b-e3f7122e17be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:12:25.873173 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Converting VIF {"id": "7197f4a8-0c77-4200-b65b-e3f7122e17be", "address": "fa:16:3e:bc:af:64", "network": {"id": "68132179-7a2d-4b6f-bc7a-da8f937a9fb2", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1224285668-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "517a45856efe44aa92f802f146b17616", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7197f4a8-0c", "ovs_interfaceid": "7197f4a8-0c77-4200-b65b-e3f7122e17be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:12:25.873508 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:af:64,bridge_name='br-int',has_traffic_filtering=True,id=7197f4a8-0c77-4200-b65b-e3f7122e17be,network=Network(68132179-7a2d-4b6f-bc7a-da8f937a9fb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7197f4a8-0c') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:12:25.874250 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lazy-loading 'pci_devices' on Instance uuid 80a69a0b-c6a1-4dfd-932e-826068764081 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:12:26.133998 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Took 3.07 seconds to destroy the instance on the hypervisor.
May 21 02:12:26.134568 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:12:26.135041 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:12:26.135041 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:12:26.135801 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:12:26.157783 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Took 2.04 seconds to destroy the instance on the hypervisor.
May 21 02:12:26.158978 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:12:26.159626 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:12:26.159626 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:12:26.159715 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:12:26.234798 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:12:26.241954 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:12:26.376674 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] End _get_guest_xml xml=<domain type="qemu">
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:   <uuid>80a69a0b-c6a1-4dfd-932e-826068764081</uuid>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:   <name>instance-00000048</name>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-126509525</nova:name>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:12:22</nova:creationTime>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:       <nova:image uuid="">
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:         <nova:user uuid="68fd64fea5a84a0bbb1d09de7d76709c">tempest-TestEncryptedCinderVolumes-1523380334-project-member</nova:user>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:         <nova:project uuid="517a45856efe44aa92f802f146b17616">tempest-TestEncryptedCinderVolumes-1523380334</nova:project>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:       <nova:root type="volume" uuid=""/>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:         <nova:port uuid="7197f4a8-0c77-4200-b65b-e3f7122e17be">
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:     <system>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:       <entry name="serial">80a69a0b-c6a1-4dfd-932e-826068764081</entry>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:       <entry name="uuid">80a69a0b-c6a1-4dfd-932e-826068764081</entry>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:     </system>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:   <os>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:   </os>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:   <features>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:   </features>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:   <devices>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/80a69a0b-c6a1-4dfd-932e-826068764081/disk.config"/>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:     </disk>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:       <alias name="ua-b1a825b3-a763-479f-8c2f-42fbf9fa9c13"/>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:       <serial>b1a825b3-a763-479f-8c2f-42fbf9fa9c13</serial>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:       <encryption format="luks">
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:         <secret type="passphrase" uuid="34a8873e-eb46-4616-b51c-6c056f239328"/>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:       </encryption>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:     </disk>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:bc:af:64"/>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:       <target dev="tap7197f4a8-0c"/>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:     </interface>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/80a69a0b-c6a1-4dfd-932e-826068764081/console.log" append="off"/>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:     </serial>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:     <video>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:     </video>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:     </rng>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:   </devices>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]: </domain>
May 21 02:12:26.376674 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:12:26.378948 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Preparing to wait for external event network-vif-plugged-7197f4a8-0c77-4200-b65b-e3f7122e17be {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:12:26.378948 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "80a69a0b-c6a1-4dfd-932e-826068764081-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:26.378948 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "80a69a0b-c6a1-4dfd-932e-826068764081-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:26.378948 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "80a69a0b-c6a1-4dfd-932e-826068764081-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:26.378948 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:12:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-126509525',display_name='tempest-TestEncryptedCinderVolumes-server-126509525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testencryptedcindervolumes-server-126509525',id=72,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAhkQbp5kMwPyRYbKzXvFue4B05DSWlMs4KXDTXsTygnB2TWy+kt4GBTiDM8LiCQTVRBWYkE1itG7K2+H6oL5C/hvlsCCr+Z7SvxCHUYwFWVcZ1ePW8nLfDe4MI4Yf/Uw==',key_name='tempest-TestEncryptedCinderVolumes-618034694',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='517a45856efe44aa92f802f146b17616',ramdisk_id='',reservation_id='r-9bfnignm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1523380334',owner_user_name='tempest-TestEncryptedCinderVolumes-1523380334-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:12:19Z,user_data=None,user_id='68fd64fea5a84a0bbb1d09de7d76709c',uuid=80a69a0b-c6a1-4dfd-932e-826068764081,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7197f4a8-0c77-4200-b65b-e3f7122e17be", "address": "fa:16:3e:bc:af:64", "network": {"id": "68132179-7a2d-4b6f-bc7a-da8f937a9fb2", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1224285668-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "517a45856efe44aa92f802f146b17616", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7197f4a8-0c", "ovs_interfaceid": "7197f4a8-0c77-4200-b65b-e3f7122e17be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:12:26.378948 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Converting VIF {"id": "7197f4a8-0c77-4200-b65b-e3f7122e17be", "address": "fa:16:3e:bc:af:64", "network": {"id": "68132179-7a2d-4b6f-bc7a-da8f937a9fb2", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1224285668-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "517a45856efe44aa92f802f146b17616", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7197f4a8-0c", "ovs_interfaceid": "7197f4a8-0c77-4200-b65b-e3f7122e17be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:12:26.378948 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:af:64,bridge_name='br-int',has_traffic_filtering=True,id=7197f4a8-0c77-4200-b65b-e3f7122e17be,network=Network(68132179-7a2d-4b6f-bc7a-da8f937a9fb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7197f4a8-0c') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:12:26.378948 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:af:64,bridge_name='br-int',has_traffic_filtering=True,id=7197f4a8-0c77-4200-b65b-e3f7122e17be,network=Network(68132179-7a2d-4b6f-bc7a-da8f937a9fb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7197f4a8-0c') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:12:26.380106 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:26.380106 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:12:26.380106 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:12:26.383599 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:26.383743 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b4156227-d57b-5ede-8883-8647108ac84e', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:12:26.385180 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:26.385287 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:12:26.385682 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:26.387427 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:26.387600 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7197f4a8-0c, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:12:26.387883 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7197f4a8-0c, col_values=(('qos', UUID('06fc7ad0-76f1-472a-95db-719abb510988')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:12:26.388039 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7197f4a8-0c, col_values=(('external_ids', {'iface-id': '7197f4a8-0c77-4200-b65b-e3f7122e17be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:af:64', 'vm-uuid': '80a69a0b-c6a1-4dfd-932e-826068764081'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:12:26.389879 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:12:26.393992 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:26.394846 np0000001127 nova-compute[98206]: INFO os_vif [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:af:64,bridge_name='br-int',has_traffic_filtering=True,id=7197f4a8-0c77-4200-b65b-e3f7122e17be,network=Network(68132179-7a2d-4b6f-bc7a-da8f937a9fb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7197f4a8-0c')
May 21 02:12:26.419578 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-884b9c36-9851-45ef-a6a5-42356350b526 req-b621b2f9-50ee-4a08-a515-329f1af2b19c service nova] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Received event network-vif-unplugged-ad59f56d-4c95-4f01-8318-98360ae0fe9a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:12:26.420650 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-884b9c36-9851-45ef-a6a5-42356350b526 req-b621b2f9-50ee-4a08-a515-329f1af2b19c service nova] Acquiring lock "3767becb-caf4-47ee-904f-112069ee8dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:26.420650 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-884b9c36-9851-45ef-a6a5-42356350b526 req-b621b2f9-50ee-4a08-a515-329f1af2b19c service nova] Lock "3767becb-caf4-47ee-904f-112069ee8dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:26.420650 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-884b9c36-9851-45ef-a6a5-42356350b526 req-b621b2f9-50ee-4a08-a515-329f1af2b19c service nova] Lock "3767becb-caf4-47ee-904f-112069ee8dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:26.420650 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-884b9c36-9851-45ef-a6a5-42356350b526 req-b621b2f9-50ee-4a08-a515-329f1af2b19c service nova] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] No waiting events found dispatching network-vif-unplugged-ad59f56d-4c95-4f01-8318-98360ae0fe9a {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:12:26.420650 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-884b9c36-9851-45ef-a6a5-42356350b526 req-b621b2f9-50ee-4a08-a515-329f1af2b19c service nova] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Received event network-vif-unplugged-ad59f56d-4c95-4f01-8318-98360ae0fe9a for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:12:26.695536 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-97234314-f451-45ab-8c1d-536fb79ec274 req-10cf5fb5-7185-46c5-a43b-7b309b3e6bc3 service nova] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Received event network-vif-deleted-5142d614-fe12-4ae6-a0ed-8c5658b5505b {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:12:26.696094 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-97234314-f451-45ab-8c1d-536fb79ec274 req-10cf5fb5-7185-46c5-a43b-7b309b3e6bc3 service nova] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Neutron deleted interface 5142d614-fe12-4ae6-a0ed-8c5658b5505b; detaching it from the instance and deleting it from the info cache
May 21 02:12:26.696255 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-97234314-f451-45ab-8c1d-536fb79ec274 req-10cf5fb5-7185-46c5-a43b-7b309b3e6bc3 service nova] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:12:27.023639 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:27.090085 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:12:27.119721 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:12:27.200334 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-97234314-f451-45ab-8c1d-536fb79ec274 req-10cf5fb5-7185-46c5-a43b-7b309b3e6bc3 service nova] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Detach interface failed, port_id=5142d614-fe12-4ae6-a0ed-8c5658b5505b, reason: Instance cec9e114-b934-4de6-b0f0-586cd34a59bd could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:12:27.593247 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Took 1.43 seconds to deallocate network for instance.
May 21 02:12:27.611114 np0000001127 nova-compute[98206]: WARNING nova.volume.cinder [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Attachment 206d869f-c2f0-4384-b1fb-dbc0a74f2eb5 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 206d869f-c2f0-4384-b1fb-dbc0a74f2eb5. (HTTP 404) (Request-ID: req-35977447-943b-45dd-a3ce-885bc608f9ef)
May 21 02:12:27.611306 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Took 0.02 seconds to detach 1 volumes for instance.
May 21 02:12:27.622648 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Took 1.49 seconds to deallocate network for instance.
May 21 02:12:27.913093 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:12:27.913214 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:12:27.913214 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] No VIF found with MAC fa:16:3e:bc:af:64, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:12:27.913628 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Using config drive
May 21 02:12:28.120329 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:28.120329 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:28.174991 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Took 0.55 seconds to detach 1 volumes for instance.
May 21 02:12:28.177786 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Deleting volume: 7ea6075d-0c38-4100-9259-e68a64fa39fe {{(pid=98206) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 21 02:12:28.337778 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:12:28.337982 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:12:28.419371 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:12:28.469399 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-800ac481-effb-4ca5-b5e1-062c121f225b req-b81ed07a-1151-4d16-bb27-55f3f424cb5d service nova] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Received event network-vif-deleted-ad59f56d-4c95-4f01-8318-98360ae0fe9a {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:12:28.539596 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Creating config drive at /opt/stack/data/nova/instances/80a69a0b-c6a1-4dfd-932e-826068764081/disk.config
May 21 02:12:28.542647 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/80a69a0b-c6a1-4dfd-932e-826068764081/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2kz4hx_e {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:12:28.595591 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/80a69a0b-c6a1-4dfd-932e-826068764081/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2kz4hx_e" returned: 0 in 0.052s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:12:28.759445 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:28.842356 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:12:28.989295 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:29.011960 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:29.013871 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:29.101451 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:29.187050 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f41b18bd-292b-4e58-83a8-db67bb23393c req-be4e196a-18ed-4aed-9faf-b8a8595078fb service nova] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Received event network-vif-plugged-7197f4a8-0c77-4200-b65b-e3f7122e17be {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:12:29.187667 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f41b18bd-292b-4e58-83a8-db67bb23393c req-be4e196a-18ed-4aed-9faf-b8a8595078fb service nova] Acquiring lock "80a69a0b-c6a1-4dfd-932e-826068764081-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:29.188368 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f41b18bd-292b-4e58-83a8-db67bb23393c req-be4e196a-18ed-4aed-9faf-b8a8595078fb service nova] Lock "80a69a0b-c6a1-4dfd-932e-826068764081-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:29.188368 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f41b18bd-292b-4e58-83a8-db67bb23393c req-be4e196a-18ed-4aed-9faf-b8a8595078fb service nova] Lock "80a69a0b-c6a1-4dfd-932e-826068764081-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:29.188368 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f41b18bd-292b-4e58-83a8-db67bb23393c req-be4e196a-18ed-4aed-9faf-b8a8595078fb service nova] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Processing event network-vif-plugged-7197f4a8-0c77-4200-b65b-e3f7122e17be {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:12:29.352564 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.232s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:29.353106 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.593s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:29.359280 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:29.360927 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:29.364310 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:29.365087 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:29.386668 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:29.406127 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Deleted allocations for instance 3767becb-caf4-47ee-904f-112069ee8dba
May 21 02:12:29.553496 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:12:29.553778 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:12:30.056325 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:12:30.420031 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8b1d7142-8b0c-4341-9b1c-a129f131f092 tempest-VolumesBackupsTest-958095449 tempest-VolumesBackupsTest-958095449-project-member] Lock "3767becb-caf4-47ee-904f-112069ee8dba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.810s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:30.564496 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.210s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:30.622025 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Deleted allocations for instance cec9e114-b934-4de6-b0f0-586cd34a59bd
May 21 02:12:30.833992 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329550.833583, 80a69a0b-c6a1-4dfd-932e-826068764081 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:12:30.834364 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:12:30.834530 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] VM Started (Lifecycle Event)
May 21 02:12:30.836662 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:12:30.839769 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Instance spawned successfully.
May 21 02:12:30.841271 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:12:31.261329 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d9c1f46e-1cae-4774-b816-e55e3af867de req-3fc880e8-5be8-4025-9499-ca42438c2d32 service nova] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Received event network-vif-plugged-7197f4a8-0c77-4200-b65b-e3f7122e17be {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:12:31.264836 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d9c1f46e-1cae-4774-b816-e55e3af867de req-3fc880e8-5be8-4025-9499-ca42438c2d32 service nova] Acquiring lock "80a69a0b-c6a1-4dfd-932e-826068764081-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:31.264836 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d9c1f46e-1cae-4774-b816-e55e3af867de req-3fc880e8-5be8-4025-9499-ca42438c2d32 service nova] Lock "80a69a0b-c6a1-4dfd-932e-826068764081-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:31.264836 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d9c1f46e-1cae-4774-b816-e55e3af867de req-3fc880e8-5be8-4025-9499-ca42438c2d32 service nova] Lock "80a69a0b-c6a1-4dfd-932e-826068764081-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:31.264836 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d9c1f46e-1cae-4774-b816-e55e3af867de req-3fc880e8-5be8-4025-9499-ca42438c2d32 service nova] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] No waiting events found dispatching network-vif-plugged-7197f4a8-0c77-4200-b65b-e3f7122e17be {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:12:31.264836 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-d9c1f46e-1cae-4774-b816-e55e3af867de req-3fc880e8-5be8-4025-9499-ca42438c2d32 service nova] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Received unexpected event network-vif-plugged-7197f4a8-0c77-4200-b65b-e3f7122e17be for instance with vm_state building and task_state spawning.
May 21 02:12:31.339908 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:12:31.342240 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:12:31.351672 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:12:31.351822 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:12:31.352119 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:12:31.352364 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:12:31.352694 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:12:31.352973 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:12:31.389556 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:31.631528 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-056d549b-5e87-4d4f-92b1-ea5fe7b4607a tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "cec9e114-b934-4de6-b0f0-586cd34a59bd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.081s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:31.845490 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:12:31.845732 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329551.845575, 80a69a0b-c6a1-4dfd-932e-826068764081 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:12:31.845844 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] VM Paused (Lifecycle Event)
May 21 02:12:31.858798 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Took 9.77 seconds to spawn the instance on the hypervisor.
May 21 02:12:31.859018 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:12:32.024766 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:32.349139 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:12:32.353092 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329552.3528285, 80a69a0b-c6a1-4dfd-932e-826068764081 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:12:32.353248 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] VM Resumed (Lifecycle Event)
May 21 02:12:32.380509 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Took 16.87 seconds to build instance.
May 21 02:12:32.857311 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:12:32.860655 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:12:32.883075 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-79bcc4d5-d081-4f08-a925-2aa69ae73934 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "80a69a0b-c6a1-4dfd-932e-826068764081" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.381s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:33.171108 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Acquiring lock "8162299e-7f25-48d8-99c0-9e0792985f1f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:33.171270 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Lock "8162299e-7f25-48d8-99c0-9e0792985f1f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:33.423640 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:33.676164 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:12:34.251452 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:34.251452 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:34.256752 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:12:34.257991 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Claim successful on node np0000001127
May 21 02:12:34.891199 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-147b7db1-58b4-4b7d-abef-e5a5ce82c98b req-e468dd70-16a8-4892-b9d2-48668d2c0ff0 service nova] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Received event network-changed-7197f4a8-0c77-4200-b65b-e3f7122e17be {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:12:34.891724 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-147b7db1-58b4-4b7d-abef-e5a5ce82c98b req-e468dd70-16a8-4892-b9d2-48668d2c0ff0 service nova] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Refreshing instance network info cache due to event network-changed-7197f4a8-0c77-4200-b65b-e3f7122e17be. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:12:34.891724 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-147b7db1-58b4-4b7d-abef-e5a5ce82c98b req-e468dd70-16a8-4892-b9d2-48668d2c0ff0 service nova] Acquiring lock "refresh_cache-80a69a0b-c6a1-4dfd-932e-826068764081" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:12:34.891724 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-147b7db1-58b4-4b7d-abef-e5a5ce82c98b req-e468dd70-16a8-4892-b9d2-48668d2c0ff0 service nova] Acquired lock "refresh_cache-80a69a0b-c6a1-4dfd-932e-826068764081" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:12:34.891958 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-147b7db1-58b4-4b7d-abef-e5a5ce82c98b req-e468dd70-16a8-4892-b9d2-48668d2c0ff0 service nova] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Refreshing network info cache for port 7197f4a8-0c77-4200-b65b-e3f7122e17be {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:12:35.398287 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-147b7db1-58b4-4b7d-abef-e5a5ce82c98b req-e468dd70-16a8-4892-b9d2-48668d2c0ff0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:12:35.498250 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:12:35.498542 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:12:35.709596 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-147b7db1-58b4-4b7d-abef-e5a5ce82c98b req-e468dd70-16a8-4892-b9d2-48668d2c0ff0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:12:35.841390 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-147b7db1-58b4-4b7d-abef-e5a5ce82c98b req-e468dd70-16a8-4892-b9d2-48668d2c0ff0 service nova] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Updated VIF entry in instance network info cache for port 7197f4a8-0c77-4200-b65b-e3f7122e17be. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:12:35.841682 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-147b7db1-58b4-4b7d-abef-e5a5ce82c98b req-e468dd70-16a8-4892-b9d2-48668d2c0ff0 service nova] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Updating instance_info_cache with network_info: [{"id": "7197f4a8-0c77-4200-b65b-e3f7122e17be", "address": "fa:16:3e:bc:af:64", "network": {"id": "68132179-7a2d-4b6f-bc7a-da8f937a9fb2", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1224285668-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "517a45856efe44aa92f802f146b17616", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7197f4a8-0c", "ovs_interfaceid": "7197f4a8-0c77-4200-b65b-e3f7122e17be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:12:36.001221 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:12:36.343840 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-147b7db1-58b4-4b7d-abef-e5a5ce82c98b req-e468dd70-16a8-4892-b9d2-48668d2c0ff0 service nova] Releasing lock "refresh_cache-80a69a0b-c6a1-4dfd-932e-826068764081" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:12:36.390931 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:36.509500 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.258s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:36.509813 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:12:37.015755 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:12:37.016371 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:12:37.016371 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:12:37.016371 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:12:37.027081 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:37.131232 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '58f52d6fb2984c23be0213672d12f1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89aa427034d946f780168e69639fd01d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:12:37.261687 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "a9044351-f5a8-4e38-976c-24db83b046d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:37.262061 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "a9044351-f5a8-4e38-976c-24db83b046d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:37.518418 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:12:37.726165 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Successfully created port: 36aa31ec-aa4a-454f-b369-c6f1ff41ec83 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:12:37.763798 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:12:38.023360 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:12:38.280045 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Successfully updated port: 36aa31ec-aa4a-454f-b369-c6f1ff41ec83 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:12:38.327577 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1465ee7c-dae7-44c9-af52-2e69f2d714fa req-2b06197f-a1ad-4d42-b1aa-579e21bb9d78 service nova] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Received event network-changed-36aa31ec-aa4a-454f-b369-c6f1ff41ec83 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:12:38.327676 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1465ee7c-dae7-44c9-af52-2e69f2d714fa req-2b06197f-a1ad-4d42-b1aa-579e21bb9d78 service nova] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Refreshing instance network info cache due to event network-changed-36aa31ec-aa4a-454f-b369-c6f1ff41ec83. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:12:38.327828 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1465ee7c-dae7-44c9-af52-2e69f2d714fa req-2b06197f-a1ad-4d42-b1aa-579e21bb9d78 service nova] Acquiring lock "refresh_cache-8162299e-7f25-48d8-99c0-9e0792985f1f" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:12:38.328580 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1465ee7c-dae7-44c9-af52-2e69f2d714fa req-2b06197f-a1ad-4d42-b1aa-579e21bb9d78 service nova] Acquired lock "refresh_cache-8162299e-7f25-48d8-99c0-9e0792985f1f" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:12:38.328769 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-1465ee7c-dae7-44c9-af52-2e69f2d714fa req-2b06197f-a1ad-4d42-b1aa-579e21bb9d78 service nova] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Refreshing network info cache for port 36aa31ec-aa4a-454f-b369-c6f1ff41ec83 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:12:38.346525 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:38.346728 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:38.352759 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:12:38.352759 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Claim successful on node np0000001127
May 21 02:12:38.424689 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.00041703500028233975 future=<Future at 0x71c0585b8d40 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:12:38.424823 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:12:38.425306 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] Emitting event <LifecycleEvent: 1779329543.4241712, cec9e114-b934-4de6-b0f0-586cd34a59bd => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:12:38.425660 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=1.0130279709997012 future=<Future at 0x71c0983bdfd0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:12:38.425772 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=1.0127995869997903 future=<Future at 0x71c0983bdfd0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:12:38.425925 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] VM Stopped (Lifecycle Event)
May 21 02:12:38.531290 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Booting with volume 88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 at /dev/vda
May 21 02:12:38.569300 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:12:38.590667 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:12:38.611998 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:12:38.672661 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:12:38.673189 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:12:38.686497 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:12:38.689285 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe88:c9bf', 'fe80::7045:30ff:fe1a:b99f', 'fe80::fc16:3eff:febc:af64', 'fe80::582b:67ff:fe35:1299'] 
May 21 02:12:38.689534 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:12:38.689711 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:12:38.690052 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:12:38.690342 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Updating existing volume attachment record: 3d41711a-a166-4c1b-b8ef-04d2caf3dfb4 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:12:38.782913 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Acquiring lock "refresh_cache-8162299e-7f25-48d8-99c0-9e0792985f1f" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:12:38.831627 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-1465ee7c-dae7-44c9-af52-2e69f2d714fa req-2b06197f-a1ad-4d42-b1aa-579e21bb9d78 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:12:38.914099 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-1465ee7c-dae7-44c9-af52-2e69f2d714fa req-2b06197f-a1ad-4d42-b1aa-579e21bb9d78 service nova] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:12:38.928357 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7446368f-a057-4754-b3d9-5dc49d66a2f3 tempest-TestVolumeBootPatternV346-1354384974 tempest-TestVolumeBootPatternV346-1354384974-project-member] [instance: cec9e114-b934-4de6-b0f0-586cd34a59bd] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:12:39.021908 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-1465ee7c-dae7-44c9-af52-2e69f2d714fa req-2b06197f-a1ad-4d42-b1aa-579e21bb9d78 service nova] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:12:39.439947 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.001280406000205403 future=<Future at 0x71c0983bdfd0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:12:39.440886 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Emitting event <LifecycleEvent: 1779329544.438521, 3767becb-caf4-47ee-904f-112069ee8dba => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:12:39.441057 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] VM Stopped (Lifecycle Event)
May 21 02:12:39.442558 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:12:39.525576 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1465ee7c-dae7-44c9-af52-2e69f2d714fa req-2b06197f-a1ad-4d42-b1aa-579e21bb9d78 service nova] Releasing lock "refresh_cache-8162299e-7f25-48d8-99c0-9e0792985f1f" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:12:39.525981 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Acquired lock "refresh_cache-8162299e-7f25-48d8-99c0-9e0792985f1f" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:12:39.526114 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:12:39.607231 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:12:39.607443 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:12:39.946100 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-11bc109f-7265-479a-bc08-fafed755a34c tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 3767becb-caf4-47ee-904f-112069ee8dba] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:12:40.110988 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:12:40.118163 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:12:40.295436 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:12:40.450019 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Updating instance_info_cache with network_info: [{"id": "36aa31ec-aa4a-454f-b369-c6f1ff41ec83", "address": "fa:16:3e:57:be:e4", "network": {"id": "80d2c5e9-dd42-4109-9563-9e1bc30c577a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e0576bdbcbdb4371809bfe8bd6fe7bb5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap36aa31ec-aa", "ovs_interfaceid": "36aa31ec-aa4a-454f-b369-c6f1ff41ec83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:12:40.623969 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.277s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:40.624289 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:12:40.801873 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:12:40.802846 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:12:40.803060 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Creating image(s)
May 21 02:12:40.803382 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Did not create local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 21 02:12:40.803678 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Ensure instance console log exists: /opt/stack/data/nova/instances/8162299e-7f25-48d8-99c0-9e0792985f1f/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:12:40.803783 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:40.803888 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:40.804010 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:40.952829 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Releasing lock "refresh_cache-8162299e-7f25-48d8-99c0-9e0792985f1f" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:12:40.953162 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Instance network_info: |[{"id": "36aa31ec-aa4a-454f-b369-c6f1ff41ec83", "address": "fa:16:3e:57:be:e4", "network": {"id": "80d2c5e9-dd42-4109-9563-9e1bc30c577a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e0576bdbcbdb4371809bfe8bd6fe7bb5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap36aa31ec-aa", "ovs_interfaceid": "36aa31ec-aa4a-454f-b369-c6f1ff41ec83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:12:40.953959 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Start _get_guest_xml network_info=[{"id": "36aa31ec-aa4a-454f-b369-c6f1ff41ec83", "address": "fa:16:3e:57:be:e4", "network": {"id": "80d2c5e9-dd42-4109-9563-9e1bc30c577a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e0576bdbcbdb4371809bfe8bd6fe7bb5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap36aa31ec-aa", "ovs_interfaceid": "36aa31ec-aa4a-454f-b369-c6f1ff41ec83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4', 'iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '8162299e-7f25-48d8-99c0-9e0792985f1f', 'attached_at': '', 'detached_at': '', 'volume_id': '88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4', 'serial': '88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4'}, 'delete_on_termination': True, 'attachment_id': '3d41711a-a166-4c1b-b8ef-04d2caf3dfb4', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:12:40.957691 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:12:40.959292 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='instance-depend-image', uuid='8162299e-7f25-48d8-99c0-9e0792985f1f'), owner=OwnerMeta(userid='58f52d6fb2984c23be0213672d12f1d9', username='tempest-ImageDependencyTests-638471085-project-member', projectid='89aa427034d946f780168e69639fd01d', projectname='tempest-ImageDependencyTests-638471085'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "36aa31ec-aa4a-454f-b369-c6f1ff41ec83", "address": "fa:16:3e:57:be:e4", "network": {"id": "80d2c5e9-dd42-4109-9563-9e1bc30c577a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e0576bdbcbdb4371809bfe8bd6fe7bb5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap36aa31ec-aa", "ovs_interfaceid": "36aa31ec-aa4a-454f-b369-c6f1ff41ec83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329560.9584465) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:12:40.960936 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:12:40.960936 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:12:40.962190 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:12:40.962826 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:12:40.963879 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:12:40.964269 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:12:40.964908 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:12:40.964908 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:12:40.964908 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:12:40.964908 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:12:40.965116 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:12:40.965267 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:12:40.965478 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:12:40.966091 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:12:40.966158 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:12:40.966309 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:12:40.979028 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:12:40.979423 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4', 'iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:12:40.979702 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:12:40.980102 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:12:40.980334 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4', 'iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:12:40.991918 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:12:40.992874 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:12:40.994192 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:12:40.994409 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:12:40.994826 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:12:40.995073 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:12:41.005959 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:12:41.005959 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:41.015141 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:12:41.015141 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:41.021650 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4] added
May 21 02:12:41.021650 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:12:41.021650 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:12:41.021650 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:12:41.021650 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:12:41.021650 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:12:41.021650 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:41.021899 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:12:41.021926 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0275(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:12:41.022055 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:12:41.027975 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4] added
May 21 02:12:41.027975 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:12:41.027975 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:12:41.027975 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:12:41.027975 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:12:41.027975 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:12:41.027975 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:41.027975 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:12:41.028264 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0331(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:12:41.028368 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:12:41.129424 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:12:41.129632 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:12:41.130017 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:12:41.130211 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:12:41.204502 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4878b5a5bf184852a9ce383caa1c67a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ebdb16aee84e22a88dfc8960debd32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:12:41.392127 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:41.432807 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:41.630869 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:12:41.714238 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Successfully created port: 50f6c60f-bd4a-41bb-a5a2-610e067047fb {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:12:42.022483 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:12:42.028714 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:42.030593 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:12:42.035638 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:12:42.035638 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:12:42.055018 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:12:42.055018 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:42.060579 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:42.069301 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:42.075885 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:42.075885 np0000001127 nova-compute[98206]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:42.075885 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:12:42.076073 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:42.076073 np0000001127 nova-compute[98206]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:42.076073 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:12:42.086505 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:42.086505 np0000001127 nova-compute[98206]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:42.086505 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:12:42.086505 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:42.086505 np0000001127 nova-compute[98206]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:42.086505 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:12:42.113862 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4, portal: 192.168.40.100,3260]
May 21 02:12:42.113862 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4, portal: 192.168.40.100,3260] successful.
May 21 02:12:42.113862 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:42.129539 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:42.136306 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:12:42.139091 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4, portal: 192.168.50.100,3260]
May 21 02:12:42.139091 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4, portal: 192.168.50.100,3260] successful.
May 21 02:12:42.139091 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:42.146796 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:42.146796 np0000001127 nova-compute[98206]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:42.146796 np0000001127 nova-compute[98206]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:42.146796 np0000001127 nova-compute[98206]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:42.146796 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:12:42.147079 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:42.147079 np0000001127 nova-compute[98206]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:42.147079 np0000001127 nova-compute[98206]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:42.147079 np0000001127 nova-compute[98206]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:42.147079 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:12:42.147332 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.153s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:12:42.147621 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:12:42.148617 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] HCTL ('7', '-', '-', 0) found on session 185 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:12:42.148617 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:12:42.155459 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:42.168936 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Searching for a device in session 185 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:12:42.169346 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:12:42.172874 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:42.172874 np0000001127 nova-compute[98206]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:42.172874 np0000001127 nova-compute[98206]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:42.172874 np0000001127 nova-compute[98206]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:42.172874 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:12:42.173311 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:42.173311 np0000001127 nova-compute[98206]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:42.173311 np0000001127 nova-compute[98206]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:42.173311 np0000001127 nova-compute[98206]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:42.173311 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:12:42.174004 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.179s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:12:42.174175 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:12:42.174948 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] HCTL ('10', '-', '-', 0) found on session 186 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:12:42.175109 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:12:42.191411 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Searching for a device in session 186 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:12:42.191411 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:12:42.646693 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Booting with volume 9d5afcec-79b5-422e-ab0c-5c33fa118ca1 at /dev/vda
May 21 02:12:42.702974 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:12:42.716782 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:12:42.729216 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Successfully updated port: 50f6c60f-bd4a-41bb-a5a2-610e067047fb {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:12:42.745493 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:12:42.799052 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c50003ea-9f4f-4453-862e-84e4e4f1fab9 req-8fd651fa-9241-4b2f-b2da-0bb7d214f574 service nova] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Received event network-changed-50f6c60f-bd4a-41bb-a5a2-610e067047fb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:12:42.800509 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c50003ea-9f4f-4453-862e-84e4e4f1fab9 req-8fd651fa-9241-4b2f-b2da-0bb7d214f574 service nova] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Refreshing instance network info cache due to event network-changed-50f6c60f-bd4a-41bb-a5a2-610e067047fb. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:12:42.801031 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c50003ea-9f4f-4453-862e-84e4e4f1fab9 req-8fd651fa-9241-4b2f-b2da-0bb7d214f574 service nova] Acquiring lock "refresh_cache-a9044351-f5a8-4e38-976c-24db83b046d1" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:12:42.802491 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c50003ea-9f4f-4453-862e-84e4e4f1fab9 req-8fd651fa-9241-4b2f-b2da-0bb7d214f574 service nova] Acquired lock "refresh_cache-a9044351-f5a8-4e38-976c-24db83b046d1" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:12:42.802681 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-c50003ea-9f4f-4453-862e-84e4e4f1fab9 req-8fd651fa-9241-4b2f-b2da-0bb7d214f574 service nova] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Refreshing network info cache for port 50f6c60f-bd4a-41bb-a5a2-610e067047fb {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:12:42.813638 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:12:42.814548 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:12:42.823318 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:12:42.826492 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe88:c9bf', 'fe80::7045:30ff:fe1a:b99f', 'fe80::fc16:3eff:febc:af64', 'fe80::582b:67ff:fe35:1299'] 
May 21 02:12:42.826492 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:12:42.826492 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:12:42.826492 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:12:42.826492 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Updating existing volume attachment record: 61b9b6a1-fb2b-462d-98e8-bfb07555745a {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:12:42.994348 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:12:43.096709 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:43.231661 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "refresh_cache-a9044351-f5a8-4e38-976c-24db83b046d1" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:12:43.306312 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-c50003ea-9f4f-4453-862e-84e4e4f1fab9 req-8fd651fa-9241-4b2f-b2da-0bb7d214f574 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:12:43.374039 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-c50003ea-9f4f-4453-862e-84e4e4f1fab9 req-8fd651fa-9241-4b2f-b2da-0bb7d214f574 service nova] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:12:43.499728 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-c50003ea-9f4f-4453-862e-84e4e4f1fab9 req-8fd651fa-9241-4b2f-b2da-0bb7d214f574 service nova] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:12:44.001828 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c50003ea-9f4f-4453-862e-84e4e4f1fab9 req-8fd651fa-9241-4b2f-b2da-0bb7d214f574 service nova] Releasing lock "refresh_cache-a9044351-f5a8-4e38-976c-24db83b046d1" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:12:44.002630 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquired lock "refresh_cache-a9044351-f5a8-4e38-976c-24db83b046d1" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:12:44.002747 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:12:44.014600 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Found WWN 330000000fc234add for multipath device dm-1 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:12:44.015013 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:12:44.015477 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '330000000fc234add', 'path': '/dev/dm-1', 'multipath_id': '330000000fc234add'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:12:44.015612 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000fc234add', 'path': '/dev/dm-1', 'multipath_id': '330000000fc234add'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:12:44.524387 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:12:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='instance-depend-image',id=73,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89aa427034d946f780168e69639fd01d',ramdisk_id='',reservation_id='r-b10mqz49',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ImageDependencyTests-638471085',owner_user_name='tempest-ImageDependencyTests-638471085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:12:38Z,user_data=None,user_id='58f52d6fb2984c23be0213672d12f1d9',uuid=8162299e-7f25-48d8-99c0-9e0792985f1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36aa31ec-aa4a-454f-b369-c6f1ff41ec83", "address": "fa:16:3e:57:be:e4", "network": {"id": "80d2c5e9-dd42-4109-9563-9e1bc30c577a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e0576bdbcbdb4371809bfe8bd6fe7bb5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap36aa31ec-aa", "ovs_interfaceid": "36aa31ec-aa4a-454f-b369-c6f1ff41ec83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:12:44.524692 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Converting VIF {"id": "36aa31ec-aa4a-454f-b369-c6f1ff41ec83", "address": "fa:16:3e:57:be:e4", "network": {"id": "80d2c5e9-dd42-4109-9563-9e1bc30c577a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e0576bdbcbdb4371809bfe8bd6fe7bb5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap36aa31ec-aa", "ovs_interfaceid": "36aa31ec-aa4a-454f-b369-c6f1ff41ec83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:12:44.525215 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:be:e4,bridge_name='br-int',has_traffic_filtering=True,id=36aa31ec-aa4a-454f-b369-c6f1ff41ec83,network=Network(80d2c5e9-dd42-4109-9563-9e1bc30c577a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36aa31ec-aa') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:12:44.526108 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Lazy-loading 'pci_devices' on Instance uuid 8162299e-7f25-48d8-99c0-9e0792985f1f {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:12:44.569097 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:12:44.733267 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:12:44.864323 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-77127f48-ede4-46a2-9c61-8e7c467fbea4 req-1bc46d14-e0c6-43a2-80a4-cac2010fa2b3 service nova] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Received event network-vif-unplugged-50f6c60f-bd4a-41bb-a5a2-610e067047fb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:12:44.864581 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-77127f48-ede4-46a2-9c61-8e7c467fbea4 req-1bc46d14-e0c6-43a2-80a4-cac2010fa2b3 service nova] Acquiring lock "a9044351-f5a8-4e38-976c-24db83b046d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:44.867893 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-77127f48-ede4-46a2-9c61-8e7c467fbea4 req-1bc46d14-e0c6-43a2-80a4-cac2010fa2b3 service nova] Lock "a9044351-f5a8-4e38-976c-24db83b046d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:44.867893 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-77127f48-ede4-46a2-9c61-8e7c467fbea4 req-1bc46d14-e0c6-43a2-80a4-cac2010fa2b3 service nova] Lock "a9044351-f5a8-4e38-976c-24db83b046d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:44.867893 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-77127f48-ede4-46a2-9c61-8e7c467fbea4 req-1bc46d14-e0c6-43a2-80a4-cac2010fa2b3 service nova] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] No waiting events found dispatching network-vif-unplugged-50f6c60f-bd4a-41bb-a5a2-610e067047fb {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:12:44.867893 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-77127f48-ede4-46a2-9c61-8e7c467fbea4 req-1bc46d14-e0c6-43a2-80a4-cac2010fa2b3 service nova] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Received unexpected event network-vif-unplugged-50f6c60f-bd4a-41bb-a5a2-610e067047fb for instance with vm_state building and task_state spawning.
May 21 02:12:44.890188 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Updating instance_info_cache with network_info: [{"id": "50f6c60f-bd4a-41bb-a5a2-610e067047fb", "address": "fa:16:3e:2f:77:a0", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f6c60f-bd", "ovs_interfaceid": "50f6c60f-bd4a-41bb-a5a2-610e067047fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:12:44.956863 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:12:44.958251 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:12:44.958429 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Creating image(s)
May 21 02:12:44.959022 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Did not create local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 21 02:12:44.959231 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Ensure instance console log exists: /opt/stack/data/nova/instances/a9044351-f5a8-4e38-976c-24db83b046d1/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:12:44.959453 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:44.959616 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:44.959765 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:45.029680 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] End _get_guest_xml xml=<domain type="qemu">
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:   <uuid>8162299e-7f25-48d8-99c0-9e0792985f1f</uuid>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:   <name>instance-00000049</name>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:       <nova:name>instance-depend-image</nova:name>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:12:40</nova:creationTime>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:       <nova:image uuid="">
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:         <nova:properties/>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:         <nova:user uuid="58f52d6fb2984c23be0213672d12f1d9">tempest-ImageDependencyTests-638471085-project-member</nova:user>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:         <nova:project uuid="89aa427034d946f780168e69639fd01d">tempest-ImageDependencyTests-638471085</nova:project>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:       <nova:root type="volume" uuid=""/>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:         <nova:port uuid="36aa31ec-aa4a-454f-b369-c6f1ff41ec83">
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="192.168.233.27" ipVersion="4"/>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:     <system>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:       <entry name="serial">8162299e-7f25-48d8-99c0-9e0792985f1f</entry>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:       <entry name="uuid">8162299e-7f25-48d8-99c0-9e0792985f1f</entry>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:     </system>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:   <os>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:   </os>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:   <features>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:   </features>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:   <devices>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/8162299e-7f25-48d8-99c0-9e0792985f1f/disk.config"/>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:     </disk>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:       <alias name="ua-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4"/>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-1"/>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:       <serial>88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4</serial>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:     </disk>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:57:be:e4"/>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:       <target dev="tap36aa31ec-aa"/>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:     </interface>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/8162299e-7f25-48d8-99c0-9e0792985f1f/console.log" append="off"/>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:     </serial>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:     <video>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:     </video>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:     </rng>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:   </devices>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]: </domain>
May 21 02:12:45.029680 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:12:45.032046 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Preparing to wait for external event network-vif-plugged-36aa31ec-aa4a-454f-b369-c6f1ff41ec83 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:12:45.032046 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Acquiring lock "8162299e-7f25-48d8-99c0-9e0792985f1f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:45.034008 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Lock "8162299e-7f25-48d8-99c0-9e0792985f1f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:45.034289 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Lock "8162299e-7f25-48d8-99c0-9e0792985f1f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.003s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:45.035451 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:12:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='instance-depend-image',id=73,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89aa427034d946f780168e69639fd01d',ramdisk_id='',reservation_id='r-b10mqz49',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ImageDependencyTests-638471085',owner_user_name='tempest-ImageDependencyTests-638471085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:12:38Z,user_data=None,user_id='58f52d6fb2984c23be0213672d12f1d9',uuid=8162299e-7f25-48d8-99c0-9e0792985f1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36aa31ec-aa4a-454f-b369-c6f1ff41ec83", "address": "fa:16:3e:57:be:e4", "network": {"id": "80d2c5e9-dd42-4109-9563-9e1bc30c577a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e0576bdbcbdb4371809bfe8bd6fe7bb5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap36aa31ec-aa", "ovs_interfaceid": "36aa31ec-aa4a-454f-b369-c6f1ff41ec83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:12:45.036146 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Converting VIF {"id": "36aa31ec-aa4a-454f-b369-c6f1ff41ec83", "address": "fa:16:3e:57:be:e4", "network": {"id": "80d2c5e9-dd42-4109-9563-9e1bc30c577a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e0576bdbcbdb4371809bfe8bd6fe7bb5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap36aa31ec-aa", "ovs_interfaceid": "36aa31ec-aa4a-454f-b369-c6f1ff41ec83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:12:45.037412 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:be:e4,bridge_name='br-int',has_traffic_filtering=True,id=36aa31ec-aa4a-454f-b369-c6f1ff41ec83,network=Network(80d2c5e9-dd42-4109-9563-9e1bc30c577a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36aa31ec-aa') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:12:45.038066 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:be:e4,bridge_name='br-int',has_traffic_filtering=True,id=36aa31ec-aa4a-454f-b369-c6f1ff41ec83,network=Network(80d2c5e9-dd42-4109-9563-9e1bc30c577a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36aa31ec-aa') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:12:45.038440 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:45.038828 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:12:45.039269 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:12:45.039962 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:45.040118 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aea8099b-cfb8-5c00-a528-73adc2b1beb5', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:12:45.041182 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:45.042255 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:12:45.043994 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:45.044182 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36aa31ec-aa, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:12:45.044722 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap36aa31ec-aa, col_values=(('qos', UUID('737d10de-7fc8-49fb-b391-b71803dbf1d7')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:12:45.045107 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap36aa31ec-aa, col_values=(('external_ids', {'iface-id': '36aa31ec-aa4a-454f-b369-c6f1ff41ec83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:be:e4', 'vm-uuid': '8162299e-7f25-48d8-99c0-9e0792985f1f'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:12:45.047484 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:12:45.052108 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:45.053293 np0000001127 nova-compute[98206]: INFO os_vif [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:be:e4,bridge_name='br-int',has_traffic_filtering=True,id=36aa31ec-aa4a-454f-b369-c6f1ff41ec83,network=Network(80d2c5e9-dd42-4109-9563-9e1bc30c577a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36aa31ec-aa')
May 21 02:12:45.393314 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Releasing lock "refresh_cache-a9044351-f5a8-4e38-976c-24db83b046d1" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:12:45.393595 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Instance network_info: |[{"id": "50f6c60f-bd4a-41bb-a5a2-610e067047fb", "address": "fa:16:3e:2f:77:a0", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f6c60f-bd", "ovs_interfaceid": "50f6c60f-bd4a-41bb-a5a2-610e067047fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:12:45.394293 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Start _get_guest_xml network_info=[{"id": "50f6c60f-bd4a-41bb-a5a2-610e067047fb", "address": "fa:16:3e:2f:77:a0", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f6c60f-bd", "ovs_interfaceid": "50f6c60f-bd4a-41bb-a5a2-610e067047fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'a9044351-f5a8-4e38-976c-24db83b046d1', 'attached_at': '', 'detached_at': '', 'volume_id': '9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 'serial': '9d5afcec-79b5-422e-ab0c-5c33fa118ca1'}, 'delete_on_termination': False, 'attachment_id': '61b9b6a1-fb2b-462d-98e8-bfb07555745a', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:12:45.397919 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:12:45.399561 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1083662101', uuid='a9044351-f5a8-4e38-976c-24db83b046d1'), owner=OwnerMeta(userid='4878b5a5bf184852a9ce383caa1c67a4', username='tempest-TestVolumeBootPattern-1995806391-project-member', projectid='62ebdb16aee84e22a88dfc8960debd32', projectname='tempest-TestVolumeBootPattern-1995806391'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "50f6c60f-bd4a-41bb-a5a2-610e067047fb", "address": "fa:16:3e:2f:77:a0", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f6c60f-bd", "ovs_interfaceid": "50f6c60f-bd4a-41bb-a5a2-610e067047fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329565.3991668) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:12:45.401362 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:12:45.401751 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:12:45.404718 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:12:45.405056 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:12:45.406275 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:12:45.406608 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:12:45.406764 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:12:45.406855 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:12:45.406967 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:12:45.407043 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:12:45.407133 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:12:45.407265 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:12:45.407370 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:12:45.407490 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:12:45.407602 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:12:45.407709 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:12:45.426357 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:12:45.426968 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:12:45.427153 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:12:45.427669 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:12:45.427928 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:12:45.439867 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:12:45.440294 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:12:45.440502 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:12:45.440882 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:12:45.441409 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:12:45.441636 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:12:45.455825 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:12:45.455825 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:45.463612 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:12:45.463612 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:45.474138 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1] added
May 21 02:12:45.474138 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:12:45.474138 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:12:45.474138 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:12:45.474138 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:12:45.474138 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:12:45.474138 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:45.474407 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:12:45.474684 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.033(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:12:45.474893 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:12:45.479544 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1] added
May 21 02:12:45.479544 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:12:45.479544 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:12:45.479544 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:12:45.479544 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:12:45.479544 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:12:45.479544 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:45.479544 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:12:45.479544 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0381(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:12:45.479544 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:12:45.764246 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:46.477589 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:12:46.479327 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:12:46.490482 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:12:46.490482 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:12:46.494233 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:12:46.494233 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:46.506363 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:46.519822 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:46.520202 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:46.520202 np0000001127 nova-compute[98206]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:46.520202 np0000001127 nova-compute[98206]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:46.520202 np0000001127 nova-compute[98206]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:46.520202 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:12:46.520374 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:46.520374 np0000001127 nova-compute[98206]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:46.520374 np0000001127 nova-compute[98206]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:46.520374 np0000001127 nova-compute[98206]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:46.520374 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:12:46.534868 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:46.534868 np0000001127 nova-compute[98206]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:46.534868 np0000001127 nova-compute[98206]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:46.534868 np0000001127 nova-compute[98206]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:46.534868 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:12:46.535159 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:46.535159 np0000001127 nova-compute[98206]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:46.535159 np0000001127 nova-compute[98206]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:46.535159 np0000001127 nova-compute[98206]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:46.535159 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:12:46.573116 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1, portal: 192.168.50.100,3260]
May 21 02:12:46.573116 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1, portal: 192.168.50.100,3260] successful.
May 21 02:12:46.573116 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:46.579605 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:12:46.580228 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1, portal: 192.168.40.100,3260]
May 21 02:12:46.580228 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1, portal: 192.168.40.100,3260] successful.
May 21 02:12:46.580228 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:46.580491 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:12:46.580692 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] No VIF found with MAC fa:16:3e:57:be:e4, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:12:46.581731 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Using config drive
May 21 02:12:46.587423 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:46.594789 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:46.605368 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:46.605368 np0000001127 nova-compute[98206]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:46.605368 np0000001127 nova-compute[98206]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:46.605368 np0000001127 nova-compute[98206]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:46.605368 np0000001127 nova-compute[98206]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:12:46.605368 np0000001127 nova-compute[98206]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:12:46.605368 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:12:46.605764 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:46.605764 np0000001127 nova-compute[98206]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:46.605764 np0000001127 nova-compute[98206]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:46.605764 np0000001127 nova-compute[98206]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:46.605764 np0000001127 nova-compute[98206]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:12:46.605764 np0000001127 nova-compute[98206]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:12:46.605764 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:12:46.605965 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.165s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:12:46.606078 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:12:46.607047 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] HCTL ('11', '-', '-', 0) found on session 187 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:12:46.607183 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:12:46.616265 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:46.616265 np0000001127 nova-compute[98206]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:46.616265 np0000001127 nova-compute[98206]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:46.616265 np0000001127 nova-compute[98206]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:46.616265 np0000001127 nova-compute[98206]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:12:46.616265 np0000001127 nova-compute[98206]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:12:46.616265 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:12:46.616512 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:46.616512 np0000001127 nova-compute[98206]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:46.616512 np0000001127 nova-compute[98206]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:46.616512 np0000001127 nova-compute[98206]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:46.616512 np0000001127 nova-compute[98206]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:12:46.616512 np0000001127 nova-compute[98206]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:12:46.616512 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:12:46.616705 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.176s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:12:46.616812 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:12:46.617566 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] HCTL ('12', '-', '-', 0) found on session 188 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:12:46.617705 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:12:46.627733 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching for a device in session 187 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:12:46.627872 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:12:46.636993 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching for a device in session 188 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:12:46.636993 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:12:46.667038 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "6faea440-6481-41ab-886c-ca97308ab493" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:46.667501 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "6faea440-6481-41ab-886c-ca97308ab493" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:47.029377 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:47.087833 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:12:47.171605 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lazy-loading 'flavor' on Instance uuid 6faea440-6481-41ab-886c-ca97308ab493 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:12:47.196870 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Creating config drive at /opt/stack/data/nova/instances/8162299e-7f25-48d8-99c0-9e0792985f1f/disk.config
May 21 02:12:47.200259 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8162299e-7f25-48d8-99c0-9e0792985f1f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp75c9ioao {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:12:47.260164 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8162299e-7f25-48d8-99c0-9e0792985f1f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp75c9ioao" returned: 0 in 0.060s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:12:47.442125 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:12:47.448783 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:47.659361 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:47.730116 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:47.778664 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:47.902062 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-681e5de1-bc99-465f-b892-75823e39e580 req-fed6bd8f-bd76-4f94-a9bf-de323e0e8e95 service nova] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Received event network-vif-plugged-36aa31ec-aa4a-454f-b369-c6f1ff41ec83 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:12:47.902493 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-681e5de1-bc99-465f-b892-75823e39e580 req-fed6bd8f-bd76-4f94-a9bf-de323e0e8e95 service nova] Acquiring lock "8162299e-7f25-48d8-99c0-9e0792985f1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:47.903183 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-681e5de1-bc99-465f-b892-75823e39e580 req-fed6bd8f-bd76-4f94-a9bf-de323e0e8e95 service nova] Lock "8162299e-7f25-48d8-99c0-9e0792985f1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:47.903404 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-681e5de1-bc99-465f-b892-75823e39e580 req-fed6bd8f-bd76-4f94-a9bf-de323e0e8e95 service nova] Lock "8162299e-7f25-48d8-99c0-9e0792985f1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:47.905121 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-681e5de1-bc99-465f-b892-75823e39e580 req-fed6bd8f-bd76-4f94-a9bf-de323e0e8e95 service nova] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Processing event network-vif-plugged-36aa31ec-aa4a-454f-b369-c6f1ff41ec83 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:12:48.044169 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:48.063115 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:48.068940 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:48.069390 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:48.185967 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "6faea440-6481-41ab-886c-ca97308ab493" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.518s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:48.458312 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Found WWN 330000000fac56fe1 for multipath device dm-2 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:12:48.458944 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:12:48.458944 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '330000000fac56fe1', 'path': '/dev/dm-2', 'multipath_id': '330000000fac56fe1'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:12:48.458944 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000fac56fe1', 'path': '/dev/dm-2', 'multipath_id': '330000000fac56fe1'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:12:48.533295 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329568.5318587, 8162299e-7f25-48d8-99c0-9e0792985f1f => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:12:48.533295 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] VM Started (Lifecycle Event)
May 21 02:12:48.533295 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:12:48.536417 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:12:48.538662 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Instance spawned successfully.
May 21 02:12:48.539002 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:12:48.968817 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:12:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1083662101',display_name='tempest-TestVolumeBootPattern-server-1083662101',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpattern-server-1083662101',id=74,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz/RBMCwKlZOoLdoqf7XbPge9tLmyY1xo5VJlB0SNDPLDIqYhv6bRKRrq1AOl4f0antvHh+zaNlybPqLYJXPC6E7cTtqubsCy3OHGbekTwncuW9Nfz1O6qOo+1iMsXADw==',key_name='tempest-TestVolumeBootPattern-2024297378',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62ebdb16aee84e22a88dfc8960debd32',ramdisk_id='',reservation_id='r-y004jrbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1995806391',owner_user_name='tempest-TestVolumeBootPattern-1995806391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:12:42Z,user_data=None,user_id='4878b5a5bf184852a9ce383caa1c67a4',uuid=a9044351-f5a8-4e38-976c-24db83b046d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50f6c60f-bd4a-41bb-a5a2-610e067047fb", "address": "fa:16:3e:2f:77:a0", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f6c60f-bd", "ovs_interfaceid": "50f6c60f-bd4a-41bb-a5a2-610e067047fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:12:48.969274 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converting VIF {"id": "50f6c60f-bd4a-41bb-a5a2-610e067047fb", "address": "fa:16:3e:2f:77:a0", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f6c60f-bd", "ovs_interfaceid": "50f6c60f-bd4a-41bb-a5a2-610e067047fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:12:48.969939 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:77:a0,bridge_name='br-int',has_traffic_filtering=True,id=50f6c60f-bd4a-41bb-a5a2-610e067047fb,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f6c60f-bd') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:12:48.970960 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lazy-loading 'pci_devices' on Instance uuid a9044351-f5a8-4e38-976c-24db83b046d1 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:12:49.051671 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:12:49.061012 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:12:49.061391 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:12:49.063219 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:12:49.064481 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:12:49.064876 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:12:49.065201 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:12:49.065523 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:12:49.361920 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "6faea440-6481-41ab-886c-ca97308ab493" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:49.362181 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "6faea440-6481-41ab-886c-ca97308ab493" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:49.362429 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Attaching volume aebdff0e-8f8f-4e3f-9e81-6040157b5b5b to /dev/vdb
May 21 02:12:49.400120 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:12:49.411198 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:12:49.433507 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:12:49.477746 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] End _get_guest_xml xml=<domain type="qemu">
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:   <uuid>a9044351-f5a8-4e38-976c-24db83b046d1</uuid>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:   <name>instance-0000004a</name>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:       <nova:name>tempest-TestVolumeBootPattern-server-1083662101</nova:name>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:12:45</nova:creationTime>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:       <nova:image uuid="">
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:         <nova:user uuid="4878b5a5bf184852a9ce383caa1c67a4">tempest-TestVolumeBootPattern-1995806391-project-member</nova:user>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:         <nova:project uuid="62ebdb16aee84e22a88dfc8960debd32">tempest-TestVolumeBootPattern-1995806391</nova:project>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:       <nova:root type="volume" uuid=""/>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:         <nova:port uuid="50f6c60f-bd4a-41bb-a5a2-610e067047fb">
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:     <system>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:       <entry name="serial">a9044351-f5a8-4e38-976c-24db83b046d1</entry>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:       <entry name="uuid">a9044351-f5a8-4e38-976c-24db83b046d1</entry>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:     </system>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:   <os>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:   </os>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:   <features>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:   </features>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:   <devices>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/a9044351-f5a8-4e38-976c-24db83b046d1/disk.config"/>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:     </disk>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:       <alias name="ua-9d5afcec-79b5-422e-ab0c-5c33fa118ca1"/>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-2"/>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:       <serial>9d5afcec-79b5-422e-ab0c-5c33fa118ca1</serial>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:     </disk>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:2f:77:a0"/>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:       <target dev="tap50f6c60f-bd"/>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:     </interface>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/a9044351-f5a8-4e38-976c-24db83b046d1/console.log" append="off"/>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:     </serial>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:     <video>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:     </video>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:     </rng>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:   </devices>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]: </domain>
May 21 02:12:49.477746 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:12:49.480413 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Preparing to wait for external event network-vif-plugged-50f6c60f-bd4a-41bb-a5a2-610e067047fb {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:12:49.480413 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "a9044351-f5a8-4e38-976c-24db83b046d1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:49.480413 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "a9044351-f5a8-4e38-976c-24db83b046d1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:49.480413 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "a9044351-f5a8-4e38-976c-24db83b046d1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:49.480413 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:12:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1083662101',display_name='tempest-TestVolumeBootPattern-server-1083662101',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpattern-server-1083662101',id=74,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz/RBMCwKlZOoLdoqf7XbPge9tLmyY1xo5VJlB0SNDPLDIqYhv6bRKRrq1AOl4f0antvHh+zaNlybPqLYJXPC6E7cTtqubsCy3OHGbekTwncuW9Nfz1O6qOo+1iMsXADw==',key_name='tempest-TestVolumeBootPattern-2024297378',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62ebdb16aee84e22a88dfc8960debd32',ramdisk_id='',reservation_id='r-y004jrbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1995806391',owner_user_name='tempest-TestVolumeBootPattern-1995806391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:12:42Z,user_data=None,user_id='4878b5a5bf184852a9ce383caa1c67a4',uuid=a9044351-f5a8-4e38-976c-24db83b046d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50f6c60f-bd4a-41bb-a5a2-610e067047fb", "address": "fa:16:3e:2f:77:a0", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f6c60f-bd", "ovs_interfaceid": "50f6c60f-bd4a-41bb-a5a2-610e067047fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:12:49.480413 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converting VIF {"id": "50f6c60f-bd4a-41bb-a5a2-610e067047fb", "address": "fa:16:3e:2f:77:a0", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f6c60f-bd", "ovs_interfaceid": "50f6c60f-bd4a-41bb-a5a2-610e067047fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:12:49.480980 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:77:a0,bridge_name='br-int',has_traffic_filtering=True,id=50f6c60f-bd4a-41bb-a5a2-610e067047fb,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f6c60f-bd') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:12:49.481301 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:77:a0,bridge_name='br-int',has_traffic_filtering=True,id=50f6c60f-bd4a-41bb-a5a2-610e067047fb,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f6c60f-bd') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:12:49.481828 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:12:49.482070 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:12:49.482516 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:49.483038 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:12:49.483420 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:12:49.484400 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:49.484596 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '73601dfa-2056-5939-ab9e-88142e7ab0b5', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:12:49.485326 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:49.486287 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:12:49.486770 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:49.488328 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:49.488328 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50f6c60f-bd, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:12:49.490768 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap50f6c60f-bd, col_values=(('qos', UUID('be8730ee-9967-496f-8d88-143837093c5a')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:12:49.490768 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap50f6c60f-bd, col_values=(('external_ids', {'iface-id': '50f6c60f-bd4a-41bb-a5a2-610e067047fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:77:a0', 'vm-uuid': 'a9044351-f5a8-4e38-976c-24db83b046d1'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:12:49.490963 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:49.492356 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:12:49.493345 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:12:49.494155 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe88:c9bf', 'fe80::7045:30ff:fe1a:b99f', 'fe80::fc16:3eff:febc:af64', 'fe80::582b:67ff:fe35:1299', 'fe80::fc16:3eff:fe57:bee4', 'fe80::61:5bff:fe7c:aa8'] 
May 21 02:12:49.494346 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:12:49.494487 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:12:49.494738 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] <== get_connector_properties: return (94ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:12:49.494959 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Updating existing volume attachment record: 665b5ebd-a533-424d-b924-9e40de6612a5 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:12:49.497818 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:49.499241 np0000001127 nova-compute[98206]: INFO os_vif [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:77:a0,bridge_name='br-int',has_traffic_filtering=True,id=50f6c60f-bd4a-41bb-a5a2-610e067047fb,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f6c60f-bd')
May 21 02:12:49.571801 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Took 8.77 seconds to spawn the instance on the hypervisor.
May 21 02:12:49.572320 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:12:49.572320 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:12:49.572665 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329569.5724494, 8162299e-7f25-48d8-99c0-9e0792985f1f => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:12:49.572774 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] VM Paused (Lifecycle Event)
May 21 02:12:49.952078 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-847086e9-89d6-42db-9b1d-8e902a4d2945 req-0fbdc459-1b33-45d2-8808-02dacbec5db5 service nova] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Received event network-vif-plugged-36aa31ec-aa4a-454f-b369-c6f1ff41ec83 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:12:49.952713 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-847086e9-89d6-42db-9b1d-8e902a4d2945 req-0fbdc459-1b33-45d2-8808-02dacbec5db5 service nova] Acquiring lock "8162299e-7f25-48d8-99c0-9e0792985f1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:49.952843 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-847086e9-89d6-42db-9b1d-8e902a4d2945 req-0fbdc459-1b33-45d2-8808-02dacbec5db5 service nova] Lock "8162299e-7f25-48d8-99c0-9e0792985f1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:49.952987 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-847086e9-89d6-42db-9b1d-8e902a4d2945 req-0fbdc459-1b33-45d2-8808-02dacbec5db5 service nova] Lock "8162299e-7f25-48d8-99c0-9e0792985f1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:49.953148 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-847086e9-89d6-42db-9b1d-8e902a4d2945 req-0fbdc459-1b33-45d2-8808-02dacbec5db5 service nova] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] No waiting events found dispatching network-vif-plugged-36aa31ec-aa4a-454f-b369-c6f1ff41ec83 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:12:49.953214 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-847086e9-89d6-42db-9b1d-8e902a4d2945 req-0fbdc459-1b33-45d2-8808-02dacbec5db5 service nova] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Received unexpected event network-vif-plugged-36aa31ec-aa4a-454f-b369-c6f1ff41ec83 for instance with vm_state active and task_state None.
May 21 02:12:50.046741 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:12:50.047130 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b', 'iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aebdff0e-8f8f-4e3f-9e81-6040157b5b5b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:12:50.047289 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:12:50.047701 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:12:50.048200 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b', 'iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aebdff0e-8f8f-4e3f-9e81-6040157b5b5b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:12:50.059962 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:12:50.060663 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:12:50.061029 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:12:50.061669 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:12:50.062232 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:12:50.062601 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:12:50.072279 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:12:50.072279 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:50.075844 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:12:50.076809 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:12:50.076809 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:50.078651 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329570.0783548, 8162299e-7f25-48d8-99c0-9e0792985f1f => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:12:50.078901 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] VM Resumed (Lifecycle Event)
May 21 02:12:50.085552 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Took 15.91 seconds to build instance.
May 21 02:12:50.086674 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b] added
May 21 02:12:50.086674 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:12:50.086674 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:12:50.086674 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:12:50.086674 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:12:50.086674 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:12:50.086674 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:50.086965 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b] added
May 21 02:12:50.086965 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:12:50.086965 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:12:50.086965 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:12:50.086965 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:12:50.086965 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:12:50.086965 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:50.087124 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:12:50.087513 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:12:50.087713 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0248(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:12:50.087899 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0264(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:12:50.088072 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:12:50.088183 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:12:50.586518 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:12:50.588633 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:12:50.590408 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-06efd915-1a3b-4eaf-a75f-5f870a2c8cfd tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Lock "8162299e-7f25-48d8-99c0-9e0792985f1f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.419s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:51.020620 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:12:51.020767 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:12:51.020767 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] No VIF found with MAC fa:16:3e:2f:77:a0, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:12:51.021057 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Using config drive
May 21 02:12:51.088573 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:12:51.088994 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:12:51.101881 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:12:51.101881 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:12:51.108132 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:12:51.108132 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:51.116159 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:51.122232 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:51.132395 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:51.132395 np0000001127 nova-compute[98206]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:51.132395 np0000001127 nova-compute[98206]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:51.132395 np0000001127 nova-compute[98206]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:51.132395 np0000001127 nova-compute[98206]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:12:51.132395 np0000001127 nova-compute[98206]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:12:51.132395 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:12:51.132696 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:51.132696 np0000001127 nova-compute[98206]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:51.132696 np0000001127 nova-compute[98206]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:51.132696 np0000001127 nova-compute[98206]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:51.132696 np0000001127 nova-compute[98206]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:12:51.132696 np0000001127 nova-compute[98206]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:12:51.132696 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:12:51.138658 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Acquiring lock "c0628f73-e084-479c-8ecd-721fc26c39fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:51.139060 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:51.139060 np0000001127 nova-compute[98206]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:51.139060 np0000001127 nova-compute[98206]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:51.139060 np0000001127 nova-compute[98206]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:51.139060 np0000001127 nova-compute[98206]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:12:51.139060 np0000001127 nova-compute[98206]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:12:51.139060 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:12:51.139262 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Lock "c0628f73-e084-479c-8ecd-721fc26c39fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:51.140816 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:51.140816 np0000001127 nova-compute[98206]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:51.140816 np0000001127 nova-compute[98206]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:51.140816 np0000001127 nova-compute[98206]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:51.140816 np0000001127 nova-compute[98206]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:12:51.140816 np0000001127 nova-compute[98206]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:12:51.140816 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:12:51.177710 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b, portal: 192.168.50.100,3260]
May 21 02:12:51.177710 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b, portal: 192.168.50.100,3260] successful.
May 21 02:12:51.177710 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:51.191451 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:51.192109 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b, portal: 192.168.40.100,3260]
May 21 02:12:51.192109 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b, portal: 192.168.40.100,3260] successful.
May 21 02:12:51.192109 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:51.205960 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:51.205960 np0000001127 nova-compute[98206]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:51.205960 np0000001127 nova-compute[98206]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:51.205960 np0000001127 nova-compute[98206]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:51.205960 np0000001127 nova-compute[98206]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:12:51.205960 np0000001127 nova-compute[98206]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:12:51.205960 np0000001127 nova-compute[98206]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b (non-flash)
May 21 02:12:51.205960 np0000001127 nova-compute[98206]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b (non-flash)
May 21 02:12:51.205960 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:12:51.206288 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:51.206288 np0000001127 nova-compute[98206]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:51.206288 np0000001127 nova-compute[98206]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:51.206288 np0000001127 nova-compute[98206]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:51.206288 np0000001127 nova-compute[98206]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:12:51.206288 np0000001127 nova-compute[98206]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:12:51.206288 np0000001127 nova-compute[98206]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b (non-flash)
May 21 02:12:51.206288 np0000001127 nova-compute[98206]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b (non-flash)
May 21 02:12:51.206288 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:12:51.206526 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.144s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:12:51.206526 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:12:51.207358 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] HCTL ('13', '-', '-', 0) found on session 189 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:12:51.207518 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:12:51.212194 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:51.221654 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Searching for a device in session 189 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:12:51.221863 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'aebdff0e-8f8f-4e3f-9e81-6040157b5b5b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:12:51.228450 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:51.228450 np0000001127 nova-compute[98206]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:51.228450 np0000001127 nova-compute[98206]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:51.228450 np0000001127 nova-compute[98206]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:51.228450 np0000001127 nova-compute[98206]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:12:51.228450 np0000001127 nova-compute[98206]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:12:51.228450 np0000001127 nova-compute[98206]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b (non-flash)
May 21 02:12:51.228450 np0000001127 nova-compute[98206]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b (non-flash)
May 21 02:12:51.228450 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:12:51.229218 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:51.229218 np0000001127 nova-compute[98206]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:51.229218 np0000001127 nova-compute[98206]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:51.229218 np0000001127 nova-compute[98206]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:51.229218 np0000001127 nova-compute[98206]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:12:51.229218 np0000001127 nova-compute[98206]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:12:51.229218 np0000001127 nova-compute[98206]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b (non-flash)
May 21 02:12:51.229218 np0000001127 nova-compute[98206]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b (non-flash)
May 21 02:12:51.229218 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:12:51.229218 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:12:51.229218 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:12:51.229638 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] HCTL ('14', '-', '-', 0) found on session 190 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:12:51.229735 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:12:51.243286 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Searching for a device in session 190 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:12:51.243286 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aebdff0e-8f8f-4e3f-9e81-6040157b5b5b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:12:51.526806 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:12:51.636009 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Creating config drive at /opt/stack/data/nova/instances/a9044351-f5a8-4e38-976c-24db83b046d1/disk.config
May 21 02:12:51.639247 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a9044351-f5a8-4e38-976c-24db83b046d1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcmoryahs {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:12:51.651931 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:12:51.693520 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a9044351-f5a8-4e38-976c-24db83b046d1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcmoryahs" returned: 0 in 0.054s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:12:52.031060 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:52.063552 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:12:52.077510 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:52.100452 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:52.103628 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:52.186451 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:52.207030 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:52.207030 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:52.211281 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:12:52.211281 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Claim successful on node np0000001127
May 21 02:12:52.262460 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-586ab0ff-d9cd-4381-ac82-157f1b80d1be req-1cd8e2db-c0e5-44d2-8d52-42cd445b5489 service nova] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Received event network-vif-plugged-50f6c60f-bd4a-41bb-a5a2-610e067047fb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:12:52.262832 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-586ab0ff-d9cd-4381-ac82-157f1b80d1be req-1cd8e2db-c0e5-44d2-8d52-42cd445b5489 service nova] Acquiring lock "a9044351-f5a8-4e38-976c-24db83b046d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:52.263330 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-586ab0ff-d9cd-4381-ac82-157f1b80d1be req-1cd8e2db-c0e5-44d2-8d52-42cd445b5489 service nova] Lock "a9044351-f5a8-4e38-976c-24db83b046d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:52.263330 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-586ab0ff-d9cd-4381-ac82-157f1b80d1be req-1cd8e2db-c0e5-44d2-8d52-42cd445b5489 service nova] Lock "a9044351-f5a8-4e38-976c-24db83b046d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:52.263330 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-586ab0ff-d9cd-4381-ac82-157f1b80d1be req-1cd8e2db-c0e5-44d2-8d52-42cd445b5489 service nova] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Processing event network-vif-plugged-50f6c60f-bd4a-41bb-a5a2-610e067047fb {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:12:52.389946 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:52.392001 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:52.394403 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:52.418066 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:52.840028 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329572.8396587, a9044351-f5a8-4e38-976c-24db83b046d1 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:12:52.840161 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] VM Started (Lifecycle Event)
May 21 02:12:52.841399 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:12:52.843922 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:12:52.846984 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Instance spawned successfully.
May 21 02:12:52.847324 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:12:53.084231 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Found WWN 3300000008edda79a for multipath device dm-5 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:12:53.084504 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:12:53.084674 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '3300000008edda79a', 'path': '/dev/dm-5', 'multipath_id': '3300000008edda79a'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:12:53.084797 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008edda79a', 'path': '/dev/dm-5', 'multipath_id': '3300000008edda79a'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:12:53.087985 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lazy-loading 'flavor' on Instance uuid 6faea440-6481-41ab-886c-ca97308ab493 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:12:53.344372 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:12:53.346459 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:12:53.356184 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:12:53.356309 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:12:53.356622 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:12:53.356927 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:12:53.357159 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:12:53.357393 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:12:53.471639 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:12:53.471894 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:12:53.591003 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Attempting to attach volume aebdff0e-8f8f-4e3f-9e81-6040157b5b5b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 02:12:53.592807 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] attach device xml: <disk type="block" device="disk">
May 21 02:12:53.592807 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:12:53.592807 np0000001127 nova-compute[98206]:   <alias name="ua-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b"/>
May 21 02:12:53.592807 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-5"/>
May 21 02:12:53.592807 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:12:53.592807 np0000001127 nova-compute[98206]:   <serial>aebdff0e-8f8f-4e3f-9e81-6040157b5b5b</serial>
May 21 02:12:53.592807 np0000001127 nova-compute[98206]:   <shareable/>
May 21 02:12:53.592807 np0000001127 nova-compute[98206]: </disk>
May 21 02:12:53.592807 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 02:12:53.850082 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:12:53.850082 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329573.8487701, a9044351-f5a8-4e38-976c-24db83b046d1 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:12:53.850082 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] VM Paused (Lifecycle Event)
May 21 02:12:53.865308 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Took 8.91 seconds to spawn the instance on the hypervisor.
May 21 02:12:53.865881 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:12:53.974448 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:12:54.322486 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-eb5d14aa-369c-4ecf-802c-6c4a83c376f2 req-90fbc34b-e01c-41f1-8c1a-84601153da45 service nova] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Received event network-vif-plugged-50f6c60f-bd4a-41bb-a5a2-610e067047fb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:12:54.322978 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-eb5d14aa-369c-4ecf-802c-6c4a83c376f2 req-90fbc34b-e01c-41f1-8c1a-84601153da45 service nova] Acquiring lock "a9044351-f5a8-4e38-976c-24db83b046d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:54.323223 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-eb5d14aa-369c-4ecf-802c-6c4a83c376f2 req-90fbc34b-e01c-41f1-8c1a-84601153da45 service nova] Lock "a9044351-f5a8-4e38-976c-24db83b046d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:54.323699 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-eb5d14aa-369c-4ecf-802c-6c4a83c376f2 req-90fbc34b-e01c-41f1-8c1a-84601153da45 service nova] Lock "a9044351-f5a8-4e38-976c-24db83b046d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:54.323699 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-eb5d14aa-369c-4ecf-802c-6c4a83c376f2 req-90fbc34b-e01c-41f1-8c1a-84601153da45 service nova] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] No waiting events found dispatching network-vif-plugged-50f6c60f-bd4a-41bb-a5a2-610e067047fb {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:12:54.323699 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-eb5d14aa-369c-4ecf-802c-6c4a83c376f2 req-90fbc34b-e01c-41f1-8c1a-84601153da45 service nova] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Received unexpected event network-vif-plugged-50f6c60f-bd4a-41bb-a5a2-610e067047fb for instance with vm_state active and task_state None.
May 21 02:12:54.352286 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:12:54.355286 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329574.3541048, a9044351-f5a8-4e38-976c-24db83b046d1 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:12:54.355286 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] VM Resumed (Lifecycle Event)
May 21 02:12:54.375916 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Took 16.10 seconds to build instance.
May 21 02:12:54.481225 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.274s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:54.481685 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:12:54.498113 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:54.676260 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:12:54.677408 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:12:54.677619 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 21 02:12:54.679125 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:12:54.857160 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:12:54.858385 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:12:54.878435 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "a9044351-f5a8-4e38-976c-24db83b046d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.616s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:54.987322 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:12:54.987568 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:12:54.987844 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:12:54.988181 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:12:55.053815 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2b23c69336bc4dc88d63a626aed385ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8230f894ed6240d58351e82fcb41d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:12:55.143878 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Acquiring lock "8162299e-7f25-48d8-99c0-9e0792985f1f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:55.144117 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Lock "8162299e-7f25-48d8-99c0-9e0792985f1f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:55.144373 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Acquiring lock "8162299e-7f25-48d8-99c0-9e0792985f1f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:55.144647 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Lock "8162299e-7f25-48d8-99c0-9e0792985f1f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:55.144811 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Lock "8162299e-7f25-48d8-99c0-9e0792985f1f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:55.147135 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Terminating instance
May 21 02:12:55.265603 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:12:55.265737 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:12:55.265844 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:12:55.265972 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] No VIF found with MAC fa:16:3e:88:c9:bf, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:12:55.491069 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:12:55.543998 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Successfully created port: e2e50f9d-813b-4414-bf68-0a2b7f8136a7 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:12:55.653084 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:12:55.683444 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:55.709043 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:55.709476 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:55.740170 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:55.970665 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cb378a4e-f655-4de3-92d1-6b4ea0d0452b req-de24ac90-80d5-48de-9e18-63457fa4e820 service nova] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Received event network-vif-unplugged-36aa31ec-aa4a-454f-b369-c6f1ff41ec83 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:12:55.970823 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cb378a4e-f655-4de3-92d1-6b4ea0d0452b req-de24ac90-80d5-48de-9e18-63457fa4e820 service nova] Acquiring lock "8162299e-7f25-48d8-99c0-9e0792985f1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:55.971026 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cb378a4e-f655-4de3-92d1-6b4ea0d0452b req-de24ac90-80d5-48de-9e18-63457fa4e820 service nova] Lock "8162299e-7f25-48d8-99c0-9e0792985f1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:55.971242 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cb378a4e-f655-4de3-92d1-6b4ea0d0452b req-de24ac90-80d5-48de-9e18-63457fa4e820 service nova] Lock "8162299e-7f25-48d8-99c0-9e0792985f1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:55.971419 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cb378a4e-f655-4de3-92d1-6b4ea0d0452b req-de24ac90-80d5-48de-9e18-63457fa4e820 service nova] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] No waiting events found dispatching network-vif-unplugged-36aa31ec-aa4a-454f-b369-c6f1ff41ec83 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:12:55.972966 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cb378a4e-f655-4de3-92d1-6b4ea0d0452b req-de24ac90-80d5-48de-9e18-63457fa4e820 service nova] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Received event network-vif-unplugged-36aa31ec-aa4a-454f-b369-c6f1ff41ec83 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:12:55.976651 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999658698000076 future=<Future at 0x71c05848ad50 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:12:55.978123 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.998187641000186 future=<Future at 0x71c05848ad50 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:12:55.978885 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.997952124000221 future=<Future at 0x71c05848ad50 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:12:55.980390 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Instance destroyed successfully.
May 21 02:12:55.981077 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Lazy-loading 'resources' on Instance uuid 8162299e-7f25-48d8-99c0-9e0792985f1f {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:12:55.994010 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:12:56.130623 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Successfully updated port: e2e50f9d-813b-4414-bf68-0a2b7f8136a7 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:12:56.178101 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8b097522-e6f5-41e7-9e87-4e210d13bb39 req-6aa063bb-b3ca-4a00-928d-3f08ac6a98f3 service nova] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Received event network-changed-e2e50f9d-813b-4414-bf68-0a2b7f8136a7 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:12:56.178278 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-8b097522-e6f5-41e7-9e87-4e210d13bb39 req-6aa063bb-b3ca-4a00-928d-3f08ac6a98f3 service nova] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Refreshing instance network info cache due to event network-changed-e2e50f9d-813b-4414-bf68-0a2b7f8136a7. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:12:56.178425 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8b097522-e6f5-41e7-9e87-4e210d13bb39 req-6aa063bb-b3ca-4a00-928d-3f08ac6a98f3 service nova] Acquiring lock "refresh_cache-c0628f73-e084-479c-8ecd-721fc26c39fb" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:12:56.178567 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8b097522-e6f5-41e7-9e87-4e210d13bb39 req-6aa063bb-b3ca-4a00-928d-3f08ac6a98f3 service nova] Acquired lock "refresh_cache-c0628f73-e084-479c-8ecd-721fc26c39fb" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:12:56.178659 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-8b097522-e6f5-41e7-9e87-4e210d13bb39 req-6aa063bb-b3ca-4a00-928d-3f08ac6a98f3 service nova] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Refreshing network info cache for port e2e50f9d-813b-4414-bf68-0a2b7f8136a7 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:12:56.483711 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:12:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='instance-depend-image',id=73,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:12:49Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89aa427034d946f780168e69639fd01d',ramdisk_id='',reservation_id='r-b10mqz49',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_signature_verified='False',owner_project_name='tempest-ImageDependencyTests-638471085',owner_user_name='tempest-ImageDependencyTests-638471085-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:12:50Z,user_data=None,user_id='58f52d6fb2984c23be0213672d12f1d9',uuid=8162299e-7f25-48d8-99c0-9e0792985f1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36aa31ec-aa4a-454f-b369-c6f1ff41ec83", "address": "fa:16:3e:57:be:e4", "network": {"id": "80d2c5e9-dd42-4109-9563-9e1bc30c577a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e0576bdbcbdb4371809bfe8bd6fe7bb5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap36aa31ec-aa", "ovs_interfaceid": "36aa31ec-aa4a-454f-b369-c6f1ff41ec83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:12:56.483916 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Converting VIF {"id": "36aa31ec-aa4a-454f-b369-c6f1ff41ec83", "address": "fa:16:3e:57:be:e4", "network": {"id": "80d2c5e9-dd42-4109-9563-9e1bc30c577a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e0576bdbcbdb4371809bfe8bd6fe7bb5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap36aa31ec-aa", "ovs_interfaceid": "36aa31ec-aa4a-454f-b369-c6f1ff41ec83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:12:56.484535 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:be:e4,bridge_name='br-int',has_traffic_filtering=True,id=36aa31ec-aa4a-454f-b369-c6f1ff41ec83,network=Network(80d2c5e9-dd42-4109-9563-9e1bc30c577a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36aa31ec-aa') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:12:56.484822 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:be:e4,bridge_name='br-int',has_traffic_filtering=True,id=36aa31ec-aa4a-454f-b369-c6f1ff41ec83,network=Network(80d2c5e9-dd42-4109-9563-9e1bc30c577a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36aa31ec-aa') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:12:56.485930 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:56.486135 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36aa31ec-aa, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:12:56.487170 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:56.488090 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:12:56.488776 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:56.489519 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:56.489718 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=737d10de-7fc8-49fb-b391-b71803dbf1d7) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:12:56.490082 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:56.490637 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:12:56.490922 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:56.492673 np0000001127 nova-compute[98206]: INFO os_vif [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:be:e4,bridge_name='br-int',has_traffic_filtering=True,id=36aa31ec-aa4a-454f-b369-c6f1ff41ec83,network=Network(80d2c5e9-dd42-4109-9563-9e1bc30c577a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36aa31ec-aa')
May 21 02:12:56.495097 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:12:56.495522 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4', 'iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:12:56.495701 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:12:56.496166 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:12:56.496527 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4', 'iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:12:56.496695 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:12:56.523290 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:56.523290 np0000001127 nova-compute[98206]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:56.523290 np0000001127 nova-compute[98206]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:56.523290 np0000001127 nova-compute[98206]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:56.523290 np0000001127 nova-compute[98206]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:12:56.523290 np0000001127 nova-compute[98206]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:12:56.523290 np0000001127 nova-compute[98206]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b (non-flash)
May 21 02:12:56.523290 np0000001127 nova-compute[98206]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b (non-flash)
May 21 02:12:56.523290 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:12:56.523628 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:56.523628 np0000001127 nova-compute[98206]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:56.523628 np0000001127 nova-compute[98206]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:56.523628 np0000001127 nova-compute[98206]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 (non-flash)
May 21 02:12:56.523628 np0000001127 nova-compute[98206]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:12:56.523628 np0000001127 nova-compute[98206]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:12:56.523628 np0000001127 nova-compute[98206]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b (non-flash)
May 21 02:12:56.523628 np0000001127 nova-compute[98206]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b (non-flash)
May 21 02:12:56.523628 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:12:56.523628 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13', '181'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13', '182'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4', '185'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4', '186'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', '187'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', '188'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b', '189'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b', '190')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:12:56.524082 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4', '185')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:12:56.524479 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4', '186')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:12:56.525173 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c7479c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4'): ({'sde'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:12:56.525408 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Removing multipathed devices sde, sdb {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:12:56.525579 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Flush multipath device 330000000fc234add {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:12:56.561810 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:12:56.603660 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:12:56.632957 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Acquiring lock "refresh_cache-c0628f73-e084-479c-8ecd-721fc26c39fb" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:12:56.645997 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Checking to see if SCSI volumes sde, sdb have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:12:56.646222 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] SCSI volumes sde, sdb have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:12:56.647282 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Checking to see if device paths {'sde', 'sdb'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:12:56.662301 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Device paths {'sde', 'sdb'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:12:56.662370 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:12:56.677111 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:56.679012 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:12:56.679445 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:12:56.681151 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-8b097522-e6f5-41e7-9e87-4e210d13bb39 req-6aa063bb-b3ca-4a00-928d-3f08ac6a98f3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:12:56.720116 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 185, target: iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4, portal: 192.168.40.100,3260]
May 21 02:12:56.720116 np0000001127 nova-compute[98206]: Logout of [sid: 185, target: iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4, portal: 192.168.40.100,3260] successful.
May 21 02:12:56.720116 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:56.737499 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:56.746557 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-8b097522-e6f5-41e7-9e87-4e210d13bb39 req-6aa063bb-b3ca-4a00-928d-3f08ac6a98f3 service nova] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:12:56.753884 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:56.794774 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 186, target: iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4, portal: 192.168.50.100,3260]
May 21 02:12:56.794774 np0000001127 nova-compute[98206]: Logout of [sid: 186, target: iqn.2023-03.storpool.com:os--volume-88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4, portal: 192.168.50.100,3260] successful.
May 21 02:12:56.794774 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:56.819415 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:56.819703 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:12:56.822656 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] <== disconnect_volume: return (326ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:12:56.822775 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:12:56.823233 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Deleting instance files /opt/stack/data/nova/instances/8162299e-7f25-48d8-99c0-9e0792985f1f_del
May 21 02:12:56.823843 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-bba6daf2-84d1-42e8-938b-497a1dfc3d25 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "6faea440-6481-41ab-886c-ca97308ab493" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.461s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:56.824506 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Deletion of /opt/stack/data/nova/instances/8162299e-7f25-48d8-99c0-9e0792985f1f_del complete
May 21 02:12:56.882727 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-8b097522-e6f5-41e7-9e87-4e210d13bb39 req-6aa063bb-b3ca-4a00-928d-3f08ac6a98f3 service nova] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:12:57.003766 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:12:57.004380 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:12:57.005042 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Creating image(s)
May 21 02:12:57.005108 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Acquiring lock "/opt/stack/data/nova/instances/c0628f73-e084-479c-8ecd-721fc26c39fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:57.005264 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Lock "/opt/stack/data/nova/instances/c0628f73-e084-479c-8ecd-721fc26c39fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:57.005711 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Lock "/opt/stack/data/nova/instances/c0628f73-e084-479c-8ecd-721fc26c39fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:57.006386 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:12:57.008878 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:12:57.009828 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:12:57.034997 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:57.119759 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.110s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:12:57.120283 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:57.120806 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:57.121233 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:12:57.123933 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:12:57.124286 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:12:57.205201 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "6faea440-6481-41ab-886c-ca97308ab493" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:57.205201 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "6faea440-6481-41ab-886c-ca97308ab493" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:57.214817 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.090s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:12:57.215514 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/c0628f73-e084-479c-8ecd-721fc26c39fb/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:12:57.275378 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/c0628f73-e084-479c-8ecd-721fc26c39fb/disk 1073741824" returned: 0 in 0.059s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:12:57.275539 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.155s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:57.275843 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:12:57.336169 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Took 1.68 seconds to destroy the instance on the hypervisor.
May 21 02:12:57.337244 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:12:57.340493 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:12:57.340493 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:12:57.340493 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:12:57.374610 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.099s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:12:57.375540 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c0628f73-e084-479c-8ecd-721fc26c39fb/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:12:57.376603 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628f73-e084-479c-8ecd-721fc26c39fb/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:12:57.403702 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-8b097522-e6f5-41e7-9e87-4e210d13bb39 req-6aa063bb-b3ca-4a00-928d-3f08ac6a98f3 service nova] Releasing lock "refresh_cache-c0628f73-e084-479c-8ecd-721fc26c39fb" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:12:57.405394 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Acquired lock "refresh_cache-c0628f73-e084-479c-8ecd-721fc26c39fb" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:12:57.405941 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:12:57.434406 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:12:57.477973 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628f73-e084-479c-8ecd-721fc26c39fb/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:12:57.478360 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Cannot resize image /opt/stack/data/nova/instances/c0628f73-e084-479c-8ecd-721fc26c39fb/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:12:57.478741 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:12:57.478934 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Ensure instance console log exists: /opt/stack/data/nova/instances/c0628f73-e084-479c-8ecd-721fc26c39fb/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:12:57.479230 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:57.479501 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:57.479705 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:57.676091 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:12:57.708193 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Detaching volume aebdff0e-8f8f-4e3f-9e81-6040157b5b5b
May 21 02:12:57.749701 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Attempting to driver detach volume aebdff0e-8f8f-4e3f-9e81-6040157b5b5b from mountpoint /dev/vdb
May 21 02:12:57.755941 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Found disk vdb by alias ua-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:12:57.758424 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Found disk vdb by alias ua-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:12:57.758621 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Attempting to detach device vdb from instance 6faea440-6481-41ab-886c-ca97308ab493 from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 02:12:57.758951 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:12:57.758951 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:12:57.758951 np0000001127 nova-compute[98206]:   <alias name="ua-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b"/>
May 21 02:12:57.758951 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-5"/>
May 21 02:12:57.758951 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:12:57.758951 np0000001127 nova-compute[98206]:   <serial>aebdff0e-8f8f-4e3f-9e81-6040157b5b5b</serial>
May 21 02:12:57.758951 np0000001127 nova-compute[98206]:   <shareable/>
May 21 02:12:57.758951 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:12:57.758951 np0000001127 nova-compute[98206]: </disk>
May 21 02:12:57.758951 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:12:57.765902 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Successfully detached device vdb from instance 6faea440-6481-41ab-886c-ca97308ab493 from the persistent domain config.
May 21 02:12:57.767976 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] (1/8): Attempting to detach device vdb with device alias ua-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b from instance 6faea440-6481-41ab-886c-ca97308ab493 from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 02:12:57.768592 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:12:57.768592 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:12:57.768592 np0000001127 nova-compute[98206]:   <alias name="ua-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b"/>
May 21 02:12:57.768592 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-5"/>
May 21 02:12:57.768592 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:12:57.768592 np0000001127 nova-compute[98206]:   <serial>aebdff0e-8f8f-4e3f-9e81-6040157b5b5b</serial>
May 21 02:12:57.768592 np0000001127 nova-compute[98206]:   <shareable/>
May 21 02:12:57.768592 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:12:57.768592 np0000001127 nova-compute[98206]: </disk>
May 21 02:12:57.768592 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:12:57.980626 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:12:58.064132 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2469c6ad-5d65-4b6d-b45c-0f8a27f0ee97 req-628c5baa-68a9-4eb2-b86f-ffacc3be71fb service nova] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Received event network-changed-50f6c60f-bd4a-41bb-a5a2-610e067047fb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:12:58.064428 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2469c6ad-5d65-4b6d-b45c-0f8a27f0ee97 req-628c5baa-68a9-4eb2-b86f-ffacc3be71fb service nova] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Refreshing instance network info cache due to event network-changed-50f6c60f-bd4a-41bb-a5a2-610e067047fb. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:12:58.064589 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2469c6ad-5d65-4b6d-b45c-0f8a27f0ee97 req-628c5baa-68a9-4eb2-b86f-ffacc3be71fb service nova] Acquiring lock "refresh_cache-a9044351-f5a8-4e38-976c-24db83b046d1" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:12:58.064753 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2469c6ad-5d65-4b6d-b45c-0f8a27f0ee97 req-628c5baa-68a9-4eb2-b86f-ffacc3be71fb service nova] Acquired lock "refresh_cache-a9044351-f5a8-4e38-976c-24db83b046d1" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:12:58.064909 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-2469c6ad-5d65-4b6d-b45c-0f8a27f0ee97 req-628c5baa-68a9-4eb2-b86f-ffacc3be71fb service nova] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Refreshing network info cache for port 50f6c60f-bd4a-41bb-a5a2-610e067047fb {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:12:58.167598 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:12:58.173334 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:12:58.183200 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:58.183664 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:58.183740 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:58.183868 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Auditing locally available compute resources for np0000001127 (node: np0000001127) {{(pid=98206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 21 02:12:58.244259 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c1984842-49e0-4d83-819c-889088c1fc2d req-65dfdf66-8be4-471e-8a65-f10aaa63919b service nova] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Received event network-vif-deleted-36aa31ec-aa4a-454f-b369-c6f1ff41ec83 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:12:58.298181 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779329578.297779, 6faea440-6481-41ab-886c-ca97308ab493 => ua-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 02:12:58.298508 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b for instance 6faea440-6481-41ab-886c-ca97308ab493 {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 02:12:58.308021 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Successfully detached device vdb from instance 6faea440-6481-41ab-886c-ca97308ab493 from the live domain config.
May 21 02:12:58.333378 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Updating instance_info_cache with network_info: [{"id": "e2e50f9d-813b-4414-bf68-0a2b7f8136a7", "address": "fa:16:3e:90:5a:e3", "network": {"id": "6e44729f-4d54-4c10-8a9d-0221e926a5a1", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-481465007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8230f894ed6240d58351e82fcb41d8d9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e50f9d-81", "ovs_interfaceid": "e2e50f9d-813b-4414-bf68-0a2b7f8136a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:12:58.353351 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:12:58.353738 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b', 'iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aebdff0e-8f8f-4e3f-9e81-6040157b5b5b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:12:58.353877 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:12:58.354255 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:12:58.354556 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b', 'iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aebdff0e-8f8f-4e3f-9e81-6040157b5b5b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:12:58.354696 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:12:58.379864 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:58.379864 np0000001127 nova-compute[98206]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:58.379864 np0000001127 nova-compute[98206]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:12:58.379864 np0000001127 nova-compute[98206]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:12:58.379864 np0000001127 nova-compute[98206]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b (non-flash)
May 21 02:12:58.379864 np0000001127 nova-compute[98206]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b (non-flash)
May 21 02:12:58.379864 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:12:58.380115 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:58.380115 np0000001127 nova-compute[98206]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:12:58.380115 np0000001127 nova-compute[98206]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:12:58.380115 np0000001127 nova-compute[98206]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:12:58.380115 np0000001127 nova-compute[98206]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b (non-flash)
May 21 02:12:58.380115 np0000001127 nova-compute[98206]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b (non-flash)
May 21 02:12:58.380115 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:12:58.380328 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13', '181'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13', '182'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', '187'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', '188'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b', '189'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b', '190')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:12:58.380328 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b', '190')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:12:58.381112 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b', '189')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:12:58.382163 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c0584645e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b'): ({'sdh'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:12:58.382425 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Removing multipathed devices sdi, sdh {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:12:58.382688 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Flush multipath device 3300000008edda79a {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:12:58.414252 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:12:58.461981 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:12:58.512115 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:12:58.512311 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:12:58.513228 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:12:58.525311 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:12:58.525483 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:12:58.537333 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:58.570370 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-2469c6ad-5d65-4b6d-b45c-0f8a27f0ee97 req-628c5baa-68a9-4eb2-b86f-ffacc3be71fb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:12:58.572215 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 190, target: iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b, portal: 192.168.40.100,3260]
May 21 02:12:58.572215 np0000001127 nova-compute[98206]: Logout of [sid: 190, target: iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b, portal: 192.168.40.100,3260] successful.
May 21 02:12:58.572215 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:58.587546 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:58.599760 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:58.626852 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 189, target: iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b, portal: 192.168.50.100,3260]
May 21 02:12:58.626852 np0000001127 nova-compute[98206]: Logout of [sid: 189, target: iqn.2023-03.storpool.com:os--volume-aebdff0e-8f8f-4e3f-9e81-6040157b5b5b, portal: 192.168.50.100,3260] successful.
May 21 02:12:58.626852 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:58.640620 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:12:58.640923 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:12:58.641052 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] <== disconnect_volume: return (287ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:12:58.641259 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:12:58.677149 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Took 1.34 seconds to deallocate network for instance.
May 21 02:12:58.835708 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Releasing lock "refresh_cache-c0628f73-e084-479c-8ecd-721fc26c39fb" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:12:58.836061 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Instance network_info: |[{"id": "e2e50f9d-813b-4414-bf68-0a2b7f8136a7", "address": "fa:16:3e:90:5a:e3", "network": {"id": "6e44729f-4d54-4c10-8a9d-0221e926a5a1", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-481465007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8230f894ed6240d58351e82fcb41d8d9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e50f9d-81", "ovs_interfaceid": "e2e50f9d-813b-4414-bf68-0a2b7f8136a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:12:58.837707 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Start _get_guest_xml network_info=[{"id": "e2e50f9d-813b-4414-bf68-0a2b7f8136a7", "address": "fa:16:3e:90:5a:e3", "network": {"id": "6e44729f-4d54-4c10-8a9d-0221e926a5a1", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-481465007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8230f894ed6240d58351e82fcb41d8d9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e50f9d-81", "ovs_interfaceid": "e2e50f9d-813b-4414-bf68-0a2b7f8136a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:12:58.840465 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:12:58.841654 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-VolumesExtendAttachedTest-instance-370050969', uuid='c0628f73-e084-479c-8ecd-721fc26c39fb'), owner=OwnerMeta(userid='2b23c69336bc4dc88d63a626aed385ec', username='tempest-VolumesExtendAttachedTest-2003688561-project-member', projectid='8230f894ed6240d58351e82fcb41d8d9', projectname='tempest-VolumesExtendAttachedTest-2003688561'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e2e50f9d-813b-4414-bf68-0a2b7f8136a7", "address": "fa:16:3e:90:5a:e3", "network": {"id": "6e44729f-4d54-4c10-8a9d-0221e926a5a1", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-481465007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8230f894ed6240d58351e82fcb41d8d9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e50f9d-81", "ovs_interfaceid": "e2e50f9d-813b-4414-bf68-0a2b7f8136a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329578.841293) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:12:58.842866 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:12:58.843183 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:12:58.844162 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:12:58.844333 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:12:58.845106 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:12:58.845758 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:12:58.845758 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:12:58.845758 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:12:58.845758 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:12:58.845936 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:12:58.845936 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:12:58.846297 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:12:58.846725 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:12:58.846725 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:12:58.846725 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:12:58.846725 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:12:58.856642 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-370050969',display_name='tempest-VolumesExtendAttachedTest-instance-370050969',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumesextendattachedtest-instance-370050969',id=75,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsadKJ1GyEoij9V53/OnHo1o3XXZHqmStRlkoFdxOoKfp+QEV/qddbkXfG0R3vyAgRsU7rCHf26+aUjhPFiyQ5gHdBzTUOuUMs63DbqQxLpDwqCyTkwcn6rSrlDEIQCaQ==',key_name='tempest-keypair-1531757847',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8230f894ed6240d58351e82fcb41d8d9',ramdisk_id='',reservation_id='r-knotdtqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesExtendAttachedTest-2003688561',owner_user_name='tempest-VolumesExtendAttachedTest-2003688561-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:12:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b23c69336bc4dc88d63a626aed385ec',uuid=c0628f73-e084-479c-8ecd-721fc26c39fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2e50f9d-813b-4414-bf68-0a2b7f8136a7", "address": "fa:16:3e:90:5a:e3", "network": {"id": "6e44729f-4d54-4c10-8a9d-0221e926a5a1", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-481465007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8230f894ed6240d58351e82fcb41d8d9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e50f9d-81", "ovs_interfaceid": "e2e50f9d-813b-4414-bf68-0a2b7f8136a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:12:58.856924 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Converting VIF {"id": "e2e50f9d-813b-4414-bf68-0a2b7f8136a7", "address": "fa:16:3e:90:5a:e3", "network": {"id": "6e44729f-4d54-4c10-8a9d-0221e926a5a1", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-481465007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8230f894ed6240d58351e82fcb41d8d9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e50f9d-81", "ovs_interfaceid": "e2e50f9d-813b-4414-bf68-0a2b7f8136a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:12:58.857522 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:5a:e3,bridge_name='br-int',has_traffic_filtering=True,id=e2e50f9d-813b-4414-bf68-0a2b7f8136a7,network=Network(6e44729f-4d54-4c10-8a9d-0221e926a5a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e50f9d-81') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:12:58.858080 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Lazy-loading 'pci_devices' on Instance uuid c0628f73-e084-479c-8ecd-721fc26c39fb {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:12:58.876567 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-2469c6ad-5d65-4b6d-b45c-0f8a27f0ee97 req-628c5baa-68a9-4eb2-b86f-ffacc3be71fb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:12:58.994066 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-2469c6ad-5d65-4b6d-b45c-0f8a27f0ee97 req-628c5baa-68a9-4eb2-b86f-ffacc3be71fb service nova] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Updated VIF entry in instance network info cache for port 50f6c60f-bd4a-41bb-a5a2-610e067047fb. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:12:58.994641 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-2469c6ad-5d65-4b6d-b45c-0f8a27f0ee97 req-628c5baa-68a9-4eb2-b86f-ffacc3be71fb service nova] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Updating instance_info_cache with network_info: [{"id": "50f6c60f-bd4a-41bb-a5a2-610e067047fb", "address": "fa:16:3e:2f:77:a0", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f6c60f-bd", "ovs_interfaceid": "50f6c60f-bd4a-41bb-a5a2-610e067047fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:12:59.190383 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lazy-loading 'flavor' on Instance uuid 6faea440-6481-41ab-886c-ca97308ab493 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:12:59.220689 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Took 0.54 seconds to detach 1 volumes for instance.
May 21 02:12:59.222522 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Deleting volume: 88ebfc7a-404d-4c2d-bc71-ca0a8c49a6b4 {{(pid=98206) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 21 02:12:59.327966 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6faea440-6481-41ab-886c-ca97308ab493/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:12:59.363784 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] End _get_guest_xml xml=<domain type="qemu">
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:   <uuid>c0628f73-e084-479c-8ecd-721fc26c39fb</uuid>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:   <name>instance-0000004b</name>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:       <nova:name>tempest-VolumesExtendAttachedTest-instance-370050969</nova:name>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:12:58</nova:creationTime>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:         <nova:user uuid="2b23c69336bc4dc88d63a626aed385ec">tempest-VolumesExtendAttachedTest-2003688561-project-member</nova:user>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:         <nova:project uuid="8230f894ed6240d58351e82fcb41d8d9">tempest-VolumesExtendAttachedTest-2003688561</nova:project>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:         <nova:port uuid="e2e50f9d-813b-4414-bf68-0a2b7f8136a7">
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:     <system>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:       <entry name="serial">c0628f73-e084-479c-8ecd-721fc26c39fb</entry>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:       <entry name="uuid">c0628f73-e084-479c-8ecd-721fc26c39fb</entry>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:     </system>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:   <os>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:   </os>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:   <features>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:   </features>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:   <devices>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/c0628f73-e084-479c-8ecd-721fc26c39fb/disk"/>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:     </disk>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/c0628f73-e084-479c-8ecd-721fc26c39fb/disk.config"/>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:     </disk>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:90:5a:e3"/>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:       <target dev="tape2e50f9d-81"/>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:     </interface>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/c0628f73-e084-479c-8ecd-721fc26c39fb/console.log" append="off"/>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:     </serial>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:     <video>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:     </video>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:     </rng>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:   </devices>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]: </domain>
May 21 02:12:59.363784 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:12:59.365772 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Preparing to wait for external event network-vif-plugged-e2e50f9d-813b-4414-bf68-0a2b7f8136a7 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:12:59.365772 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Acquiring lock "c0628f73-e084-479c-8ecd-721fc26c39fb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:59.365772 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Lock "c0628f73-e084-479c-8ecd-721fc26c39fb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:59.365772 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Lock "c0628f73-e084-479c-8ecd-721fc26c39fb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:59.366176 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-370050969',display_name='tempest-VolumesExtendAttachedTest-instance-370050969',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumesextendattachedtest-instance-370050969',id=75,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsadKJ1GyEoij9V53/OnHo1o3XXZHqmStRlkoFdxOoKfp+QEV/qddbkXfG0R3vyAgRsU7rCHf26+aUjhPFiyQ5gHdBzTUOuUMs63DbqQxLpDwqCyTkwcn6rSrlDEIQCaQ==',key_name='tempest-keypair-1531757847',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8230f894ed6240d58351e82fcb41d8d9',ramdisk_id='',reservation_id='r-knotdtqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesExtendAttachedTest-2003688561',owner_user_name='tempest-VolumesExtendAttachedTest-2003688561-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:12:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b23c69336bc4dc88d63a626aed385ec',uuid=c0628f73-e084-479c-8ecd-721fc26c39fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2e50f9d-813b-4414-bf68-0a2b7f8136a7", "address": "fa:16:3e:90:5a:e3", "network": {"id": "6e44729f-4d54-4c10-8a9d-0221e926a5a1", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-481465007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8230f894ed6240d58351e82fcb41d8d9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e50f9d-81", "ovs_interfaceid": "e2e50f9d-813b-4414-bf68-0a2b7f8136a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:12:59.366351 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Converting VIF {"id": "e2e50f9d-813b-4414-bf68-0a2b7f8136a7", "address": "fa:16:3e:90:5a:e3", "network": {"id": "6e44729f-4d54-4c10-8a9d-0221e926a5a1", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-481465007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8230f894ed6240d58351e82fcb41d8d9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e50f9d-81", "ovs_interfaceid": "e2e50f9d-813b-4414-bf68-0a2b7f8136a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:12:59.368131 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:5a:e3,bridge_name='br-int',has_traffic_filtering=True,id=e2e50f9d-813b-4414-bf68-0a2b7f8136a7,network=Network(6e44729f-4d54-4c10-8a9d-0221e926a5a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e50f9d-81') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:12:59.368503 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:5a:e3,bridge_name='br-int',has_traffic_filtering=True,id=e2e50f9d-813b-4414-bf68-0a2b7f8136a7,network=Network(6e44729f-4d54-4c10-8a9d-0221e926a5a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e50f9d-81') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:12:59.368920 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:59.369348 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:12:59.369654 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:12:59.370444 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:59.370629 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cc77468c-55e7-5b8e-8dc0-fb95c385d8e9', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:12:59.371427 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:59.372416 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:12:59.373890 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:59.376102 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:59.376225 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2e50f9d-81, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:12:59.376564 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape2e50f9d-81, col_values=(('qos', UUID('7721c9ca-a755-4a2c-bdf3-cc3eb3db1ba2')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:12:59.376726 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape2e50f9d-81, col_values=(('external_ids', {'iface-id': 'e2e50f9d-813b-4414-bf68-0a2b7f8136a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:5a:e3', 'vm-uuid': 'c0628f73-e084-479c-8ecd-721fc26c39fb'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:12:59.377521 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:59.379096 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:12:59.384072 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:12:59.385169 np0000001127 nova-compute[98206]: INFO os_vif [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:5a:e3,bridge_name='br-int',has_traffic_filtering=True,id=e2e50f9d-813b-4414-bf68-0a2b7f8136a7,network=Network(6e44729f-4d54-4c10-8a9d-0221e926a5a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e50f9d-81')
May 21 02:12:59.422441 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6faea440-6481-41ab-886c-ca97308ab493/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:12:59.422737 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6faea440-6481-41ab-886c-ca97308ab493/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:12:59.498329 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2469c6ad-5d65-4b6d-b45c-0f8a27f0ee97 req-628c5baa-68a9-4eb2-b86f-ffacc3be71fb service nova] Releasing lock "refresh_cache-a9044351-f5a8-4e38-976c-24db83b046d1" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:12:59.498726 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2469c6ad-5d65-4b6d-b45c-0f8a27f0ee97 req-628c5baa-68a9-4eb2-b86f-ffacc3be71fb service nova] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Received event network-vif-unplugged-36aa31ec-aa4a-454f-b369-c6f1ff41ec83 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:12:59.499052 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2469c6ad-5d65-4b6d-b45c-0f8a27f0ee97 req-628c5baa-68a9-4eb2-b86f-ffacc3be71fb service nova] Acquiring lock "8162299e-7f25-48d8-99c0-9e0792985f1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:59.499313 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2469c6ad-5d65-4b6d-b45c-0f8a27f0ee97 req-628c5baa-68a9-4eb2-b86f-ffacc3be71fb service nova] Lock "8162299e-7f25-48d8-99c0-9e0792985f1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:59.499633 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2469c6ad-5d65-4b6d-b45c-0f8a27f0ee97 req-628c5baa-68a9-4eb2-b86f-ffacc3be71fb service nova] Lock "8162299e-7f25-48d8-99c0-9e0792985f1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:12:59.499825 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2469c6ad-5d65-4b6d-b45c-0f8a27f0ee97 req-628c5baa-68a9-4eb2-b86f-ffacc3be71fb service nova] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] No waiting events found dispatching network-vif-unplugged-36aa31ec-aa4a-454f-b369-c6f1ff41ec83 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:12:59.499997 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2469c6ad-5d65-4b6d-b45c-0f8a27f0ee97 req-628c5baa-68a9-4eb2-b86f-ffacc3be71fb service nova] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Received event network-vif-unplugged-36aa31ec-aa4a-454f-b369-c6f1ff41ec83 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:12:59.516750 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6faea440-6481-41ab-886c-ca97308ab493/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:12:59.521451 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-0 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:12:59.522965 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:12:59.525345 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:12:59.526241 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:12:59.572414 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "env LANG=C uptime" returned: 0 in 0.046s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:12:59.572830 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Hypervisor/Node resource view: name=np0000001127 free_ram=13392MB free_disk=72.87972640991211GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 21 02:12:59.572993 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:12:59.573228 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:12:59.760902 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:13:00.200633 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-274b6e1c-bd2d-44df-ab8a-67ad70d16497 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "6faea440-6481-41ab-886c-ca97308ab493" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.997s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:13:00.632313 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 6faea440-6481-41ab-886c-ca97308ab493 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:13:00.632487 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 80a69a0b-c6a1-4dfd-932e-826068764081 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:13:00.632810 np0000001127 nova-compute[98206]: WARNING nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 8162299e-7f25-48d8-99c0-9e0792985f1f is not being actively managed by this compute host but has allocations referencing this compute host: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. Skipping heal of allocation because we do not know what to do.
May 21 02:13:00.632976 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance a9044351-f5a8-4e38-976c-24db83b046d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:13:00.633128 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance c0628f73-e084-479c-8ecd-721fc26c39fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:13:00.633334 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 21 02:13:00.633459 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Final resource view: name=np0000001127 phys_ram=24030MB used_ram=1280MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:12:59 up 43 min,  2 users,  load average: 5.71, 7.36, 6.11\n', 'num_instances': '4', 'num_vm_active': '3', 'num_task_None': '3', 'num_os_type_None': '4', 'num_proj_4ae2ef74a1614eb09e4f71f709f64126': '1', 'io_workload': '1', 'num_proj_517a45856efe44aa92f802f146b17616': '1', 'num_proj_62ebdb16aee84e22a88dfc8960debd32': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_8230f894ed6240d58351e82fcb41d8d9': '1'} {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 21 02:13:00.899817 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:13:00.900193 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:13:00.905366 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:13:00.905522 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:13:00.905642 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] No VIF found with MAC fa:16:3e:90:5a:e3, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:13:00.906193 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Using config drive
May 21 02:13:01.404037 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:13:01.411811 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:13:01.540817 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Creating config drive at /opt/stack/data/nova/instances/c0628f73-e084-479c-8ecd-721fc26c39fb/disk.config
May 21 02:13:01.545289 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c0628f73-e084-479c-8ecd-721fc26c39fb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpe37f85yx {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:13:01.599205 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c0628f73-e084-479c-8ecd-721fc26c39fb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpe37f85yx" returned: 0 in 0.054s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:13:01.632162 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f812b1f5-c1df-4aac-828b-9ff7467887b8 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "6faea440-6481-41ab-886c-ca97308ab493" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:13:01.632376 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f812b1f5-c1df-4aac-828b-9ff7467887b8 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "6faea440-6481-41ab-886c-ca97308ab493" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:13:01.632608 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f812b1f5-c1df-4aac-828b-9ff7467887b8 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "6faea440-6481-41ab-886c-ca97308ab493-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:13:01.632731 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f812b1f5-c1df-4aac-828b-9ff7467887b8 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "6faea440-6481-41ab-886c-ca97308ab493-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:13:01.633042 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f812b1f5-c1df-4aac-828b-9ff7467887b8 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "6faea440-6481-41ab-886c-ca97308ab493-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:13:01.636998 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-f812b1f5-c1df-4aac-828b-9ff7467887b8 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Terminating instance
May 21 02:13:01.917330 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Compute_service record updated for np0000001127:np0000001127 {{(pid=98206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 21 02:13:01.917826 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.344s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:13:01.917826 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.76 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:13:01.918158 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.157s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:13:01.922342 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.004s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:13:01.972020 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Deleted allocations for instance 8162299e-7f25-48d8-99c0-9e0792985f1f
May 21 02:13:02.026009 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:02.052835 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:02.129824 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:02.139994 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-f812b1f5-c1df-4aac-828b-9ff7467887b8 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:13:02.163642 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:02.167654 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:02.191172 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:02.233885 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c72ff9ed-b0d8-41d2-8423-c746cca9d16a req-fcb8f4d9-6276-4c93-adf6-64964d4ab8e3 service nova] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Received event network-vif-plugged-e2e50f9d-813b-4414-bf68-0a2b7f8136a7 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:13:02.233885 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c72ff9ed-b0d8-41d2-8423-c746cca9d16a req-fcb8f4d9-6276-4c93-adf6-64964d4ab8e3 service nova] Acquiring lock "c0628f73-e084-479c-8ecd-721fc26c39fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:13:02.233885 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c72ff9ed-b0d8-41d2-8423-c746cca9d16a req-fcb8f4d9-6276-4c93-adf6-64964d4ab8e3 service nova] Lock "c0628f73-e084-479c-8ecd-721fc26c39fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:13:02.233885 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c72ff9ed-b0d8-41d2-8423-c746cca9d16a req-fcb8f4d9-6276-4c93-adf6-64964d4ab8e3 service nova] Lock "c0628f73-e084-479c-8ecd-721fc26c39fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:13:02.233885 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c72ff9ed-b0d8-41d2-8423-c746cca9d16a req-fcb8f4d9-6276-4c93-adf6-64964d4ab8e3 service nova] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Processing event network-vif-plugged-e2e50f9d-813b-4414-bf68-0a2b7f8136a7 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:13:02.406482 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:02.414773 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:02.444455 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:02.451444 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:02.464356 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999673194000025 future=<Future at 0x71c05853ea80 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:13:02.468429 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Instance destroyed successfully.
May 21 02:13:02.468964 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-f812b1f5-c1df-4aac-828b-9ff7467887b8 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lazy-loading 'resources' on Instance uuid 6faea440-6481-41ab-886c-ca97308ab493 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:13:02.565020 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:02.597077 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:02.676262 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:13:02.676422 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:13:02.676805 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:13:02.677020 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:13:02.677159 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98206) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12121}}
May 21 02:13:02.862801 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329582.8623905, c0628f73-e084-479c-8ecd-721fc26c39fb => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:13:02.863512 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:13:02.863758 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] VM Started (Lifecycle Event)
May 21 02:13:02.866482 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:13:02.869437 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Instance spawned successfully.
May 21 02:13:02.869805 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:13:02.973501 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-f812b1f5-c1df-4aac-828b-9ff7467887b8 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:11:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1056771543',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumemultiattachtests-server-1056771543',id=71,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFAHlOECXB1M6kLu8x5TN9wOuIBl3ef5ENa2h/uqRSfwjtQM17svq1GZslZFXuDLhFpfPv+TJvNt4XZ1d1K/RnUCKH1dJFE1gCh5yLPXhdXnteimmZnkH2xqBvbvxdKCg==',key_name='tempest-keypair-124929912',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:12:06Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ae2ef74a1614eb09e4f71f709f64126',ramdisk_id='',reservation_id='r-81aw9glg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-1039130224',owner_user_name='tempest-VolumeMultiattachTests-1039130224-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:12:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01cc41344ae640f6aa9c6142252838b2',uuid=6faea440-6481-41ab-886c-ca97308ab493,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c", "address": "fa:16:3e:88:c9:bf", "network": {"id": "dec0dbdb-dfbe-4a3d-9d29-6add07c9003f", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-775185877-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ae2ef74a1614eb09e4f71f709f64126", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63bdd924-29", "ovs_interfaceid": "63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:13:02.973501 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-f812b1f5-c1df-4aac-828b-9ff7467887b8 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Converting VIF {"id": "63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c", "address": "fa:16:3e:88:c9:bf", "network": {"id": "dec0dbdb-dfbe-4a3d-9d29-6add07c9003f", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-775185877-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ae2ef74a1614eb09e4f71f709f64126", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63bdd924-29", "ovs_interfaceid": "63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:13:02.973501 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-f812b1f5-c1df-4aac-828b-9ff7467887b8 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:c9:bf,bridge_name='br-int',has_traffic_filtering=True,id=63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c,network=Network(dec0dbdb-dfbe-4a3d-9d29-6add07c9003f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63bdd924-29') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:13:02.973501 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-f812b1f5-c1df-4aac-828b-9ff7467887b8 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:c9:bf,bridge_name='br-int',has_traffic_filtering=True,id=63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c,network=Network(dec0dbdb-dfbe-4a3d-9d29-6add07c9003f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63bdd924-29') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:13:02.976279 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:02.976604 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63bdd924-29, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:13:02.992109 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:02.993142 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:13:02.993927 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:02.994518 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-abe4ffca-3c4c-489b-8903-b48aafd6a388 tempest-ImageDependencyTests-638471085 tempest-ImageDependencyTests-638471085-project-member] Lock "8162299e-7f25-48d8-99c0-9e0792985f1f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.850s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:13:02.995171 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=50ecc03a-eae7-4146-a66c-0f50e4013a71) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:13:02.996446 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:02.997030 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:13:03.002488 np0000001127 nova-compute[98206]: INFO os_vif [None req-f812b1f5-c1df-4aac-828b-9ff7467887b8 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:c9:bf,bridge_name='br-int',has_traffic_filtering=True,id=63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c,network=Network(dec0dbdb-dfbe-4a3d-9d29-6add07c9003f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63bdd924-29')
May 21 02:13:03.002488 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-f812b1f5-c1df-4aac-828b-9ff7467887b8 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Deleting instance files /opt/stack/data/nova/instances/6faea440-6481-41ab-886c-ca97308ab493_del
May 21 02:13:03.002488 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-f812b1f5-c1df-4aac-828b-9ff7467887b8 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Deletion of /opt/stack/data/nova/instances/6faea440-6481-41ab-886c-ca97308ab493_del complete
May 21 02:13:03.179060 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:13:03.366826 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:13:03.368970 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:13:03.375372 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:13:03.375551 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:13:03.375918 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:13:03.376241 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:13:03.376567 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:13:03.376981 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:13:03.511275 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-f812b1f5-c1df-4aac-828b-9ff7467887b8 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Took 1.37 seconds to destroy the instance on the hypervisor.
May 21 02:13:03.511640 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-f812b1f5-c1df-4aac-828b-9ff7467887b8 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:13:03.512008 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:13:03.512163 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 6faea440-6481-41ab-886c-ca97308ab493] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:13:03.512423 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:13:03.627290 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:13:03.681509 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.87 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:13:03.871261 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:13:03.871624 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329583.871358, c0628f73-e084-479c-8ecd-721fc26c39fb => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:13:03.871817 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] VM Paused (Lifecycle Event)
May 21 02:13:03.882706 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Took 6.88 seconds to spawn the instance on the hypervisor.
May 21 02:13:03.882923 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:13:04.304689 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-efa7b70d-fa74-4907-b4f0-e09ca36666b3 req-0ce3676b-9ed5-4d34-8c5b-1b4c1de88469 service nova] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Received event network-vif-plugged-e2e50f9d-813b-4414-bf68-0a2b7f8136a7 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:13:04.305148 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-efa7b70d-fa74-4907-b4f0-e09ca36666b3 req-0ce3676b-9ed5-4d34-8c5b-1b4c1de88469 service nova] Acquiring lock "c0628f73-e084-479c-8ecd-721fc26c39fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:13:04.306190 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-efa7b70d-fa74-4907-b4f0-e09ca36666b3 req-0ce3676b-9ed5-4d34-8c5b-1b4c1de88469 service nova] Lock "c0628f73-e084-479c-8ecd-721fc26c39fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:13:04.306267 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-efa7b70d-fa74-4907-b4f0-e09ca36666b3 req-0ce3676b-9ed5-4d34-8c5b-1b4c1de88469 service nova] Lock "c0628f73-e084-479c-8ecd-721fc26c39fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:13:04.306574 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-efa7b70d-fa74-4907-b4f0-e09ca36666b3 req-0ce3676b-9ed5-4d34-8c5b-1b4c1de88469 service nova] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] No waiting events found dispatching network-vif-plugged-e2e50f9d-813b-4414-bf68-0a2b7f8136a7 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:13:04.307366 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-efa7b70d-fa74-4907-b4f0-e09ca36666b3 req-0ce3676b-9ed5-4d34-8c5b-1b4c1de88469 service nova] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Received unexpected event network-vif-plugged-e2e50f9d-813b-4414-bf68-0a2b7f8136a7 for instance with vm_state active and task_state None.
May 21 02:13:04.307366 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-efa7b70d-fa74-4907-b4f0-e09ca36666b3 req-0ce3676b-9ed5-4d34-8c5b-1b4c1de88469 service nova] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Received event network-vif-unplugged-63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:13:04.307366 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-efa7b70d-fa74-4907-b4f0-e09ca36666b3 req-0ce3676b-9ed5-4d34-8c5b-1b4c1de88469 service nova] Acquiring lock "6faea440-6481-41ab-886c-ca97308ab493-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:13:04.307366 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-efa7b70d-fa74-4907-b4f0-e09ca36666b3 req-0ce3676b-9ed5-4d34-8c5b-1b4c1de88469 service nova] Lock "6faea440-6481-41ab-886c-ca97308ab493-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:13:04.307366 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-efa7b70d-fa74-4907-b4f0-e09ca36666b3 req-0ce3676b-9ed5-4d34-8c5b-1b4c1de88469 service nova] Lock "6faea440-6481-41ab-886c-ca97308ab493-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:13:04.308217 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-efa7b70d-fa74-4907-b4f0-e09ca36666b3 req-0ce3676b-9ed5-4d34-8c5b-1b4c1de88469 service nova] [instance: 6faea440-6481-41ab-886c-ca97308ab493] No waiting events found dispatching network-vif-unplugged-63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:13:04.308217 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-efa7b70d-fa74-4907-b4f0-e09ca36666b3 req-0ce3676b-9ed5-4d34-8c5b-1b4c1de88469 service nova] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Received event network-vif-unplugged-63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:13:04.308217 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-efa7b70d-fa74-4907-b4f0-e09ca36666b3 req-0ce3676b-9ed5-4d34-8c5b-1b4c1de88469 service nova] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Received event network-vif-unplugged-63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:13:04.308349 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-efa7b70d-fa74-4907-b4f0-e09ca36666b3 req-0ce3676b-9ed5-4d34-8c5b-1b4c1de88469 service nova] Acquiring lock "6faea440-6481-41ab-886c-ca97308ab493-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:13:04.308647 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-efa7b70d-fa74-4907-b4f0-e09ca36666b3 req-0ce3676b-9ed5-4d34-8c5b-1b4c1de88469 service nova] Lock "6faea440-6481-41ab-886c-ca97308ab493-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:13:04.308647 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-efa7b70d-fa74-4907-b4f0-e09ca36666b3 req-0ce3676b-9ed5-4d34-8c5b-1b4c1de88469 service nova] Lock "6faea440-6481-41ab-886c-ca97308ab493-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:13:04.308747 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-efa7b70d-fa74-4907-b4f0-e09ca36666b3 req-0ce3676b-9ed5-4d34-8c5b-1b4c1de88469 service nova] [instance: 6faea440-6481-41ab-886c-ca97308ab493] No waiting events found dispatching network-vif-unplugged-63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:13:04.309104 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-efa7b70d-fa74-4907-b4f0-e09ca36666b3 req-0ce3676b-9ed5-4d34-8c5b-1b4c1de88469 service nova] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Received event network-vif-unplugged-63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:13:04.309104 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-efa7b70d-fa74-4907-b4f0-e09ca36666b3 req-0ce3676b-9ed5-4d34-8c5b-1b4c1de88469 service nova] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Received event network-vif-deleted-63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:13:04.309104 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-efa7b70d-fa74-4907-b4f0-e09ca36666b3 req-0ce3676b-9ed5-4d34-8c5b-1b4c1de88469 service nova] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Neutron deleted interface 63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c; detaching it from the instance and deleting it from the info cache
May 21 02:13:04.309395 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-efa7b70d-fa74-4907-b4f0-e09ca36666b3 req-0ce3676b-9ed5-4d34-8c5b-1b4c1de88469 service nova] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:13:04.374638 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:13:04.377137 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329584.3768497, c0628f73-e084-479c-8ecd-721fc26c39fb => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:13:04.377381 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] VM Resumed (Lifecycle Event)
May 21 02:13:04.393328 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Took 12.23 seconds to build instance.
May 21 02:13:04.555977 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:13:04.556292 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:13:04.556630 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.12 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:13:04.589935 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:13:04.815859 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-efa7b70d-fa74-4907-b4f0-e09ca36666b3 req-0ce3676b-9ed5-4d34-8c5b-1b4c1de88469 service nova] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Detach interface failed, port_id=63bdd924-29fd-4a9a-ae22-fdbc3a82bf3c, reason: Instance 6faea440-6481-41ab-886c-ca97308ab493 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:13:04.880488 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:13:04.884057 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:13:04.894594 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-32c99852-6b62-4855-8498-67b50d75df8b tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Lock "c0628f73-e084-479c-8ecd-721fc26c39fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.755s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:13:05.091791 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Took 1.58 seconds to deallocate network for instance.
May 21 02:13:05.182751 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:13:05.495545 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0df6c7a8-c05e-4402-8422-1d4e829fc65f req-d8ac7a65-bc8b-4902-b8c3-857f7f266a84 service nova] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Received event network-changed-e2e50f9d-813b-4414-bf68-0a2b7f8136a7 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:13:05.495961 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-0df6c7a8-c05e-4402-8422-1d4e829fc65f req-d8ac7a65-bc8b-4902-b8c3-857f7f266a84 service nova] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Refreshing instance network info cache due to event network-changed-e2e50f9d-813b-4414-bf68-0a2b7f8136a7. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:13:05.495961 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0df6c7a8-c05e-4402-8422-1d4e829fc65f req-d8ac7a65-bc8b-4902-b8c3-857f7f266a84 service nova] Acquiring lock "refresh_cache-c0628f73-e084-479c-8ecd-721fc26c39fb" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:13:05.495961 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0df6c7a8-c05e-4402-8422-1d4e829fc65f req-d8ac7a65-bc8b-4902-b8c3-857f7f266a84 service nova] Acquired lock "refresh_cache-c0628f73-e084-479c-8ecd-721fc26c39fb" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:13:05.495961 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-0df6c7a8-c05e-4402-8422-1d4e829fc65f req-d8ac7a65-bc8b-4902-b8c3-857f7f266a84 service nova] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Refreshing network info cache for port e2e50f9d-813b-4414-bf68-0a2b7f8136a7 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:13:05.598111 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f812b1f5-c1df-4aac-828b-9ff7467887b8 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:13:05.599210 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f812b1f5-c1df-4aac-828b-9ff7467887b8 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:13:05.676326 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:13:05.676497 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Cleaning up deleted instances {{(pid=98206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}
May 21 02:13:05.828734 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f812b1f5-c1df-4aac-828b-9ff7467887b8 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:13:05.829009 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-f812b1f5-c1df-4aac-828b-9ff7467887b8 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:13:05.997793 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-0df6c7a8-c05e-4402-8422-1d4e829fc65f req-d8ac7a65-bc8b-4902-b8c3-857f7f266a84 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:13:06.181549 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] There are 0 instances to clean {{(pid=98206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12092}}
May 21 02:13:06.182263 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:13:06.331953 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-f812b1f5-c1df-4aac-828b-9ff7467887b8 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:13:06.355746 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-0df6c7a8-c05e-4402-8422-1d4e829fc65f req-d8ac7a65-bc8b-4902-b8c3-857f7f266a84 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:13:06.481335 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-0df6c7a8-c05e-4402-8422-1d4e829fc65f req-d8ac7a65-bc8b-4902-b8c3-857f7f266a84 service nova] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Updated VIF entry in instance network info cache for port e2e50f9d-813b-4414-bf68-0a2b7f8136a7. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:13:06.481919 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-0df6c7a8-c05e-4402-8422-1d4e829fc65f req-d8ac7a65-bc8b-4902-b8c3-857f7f266a84 service nova] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Updating instance_info_cache with network_info: [{"id": "e2e50f9d-813b-4414-bf68-0a2b7f8136a7", "address": "fa:16:3e:90:5a:e3", "network": {"id": "6e44729f-4d54-4c10-8a9d-0221e926a5a1", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-481465007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8230f894ed6240d58351e82fcb41d8d9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e50f9d-81", "ovs_interfaceid": "e2e50f9d-813b-4414-bf68-0a2b7f8136a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:13:06.841296 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f812b1f5-c1df-4aac-828b-9ff7467887b8 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.243s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:13:06.899881 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-f812b1f5-c1df-4aac-828b-9ff7467887b8 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Deleted allocations for instance 6faea440-6481-41ab-886c-ca97308ab493
May 21 02:13:06.984236 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-0df6c7a8-c05e-4402-8422-1d4e829fc65f req-d8ac7a65-bc8b-4902-b8c3-857f7f266a84 service nova] Releasing lock "refresh_cache-c0628f73-e084-479c-8ecd-721fc26c39fb" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:13:07.054689 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:07.911586 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f812b1f5-c1df-4aac-828b-9ff7467887b8 tempest-VolumeMultiattachTests-1039130224 tempest-VolumeMultiattachTests-1039130224-project-member] Lock "6faea440-6481-41ab-886c-ca97308ab493" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.279s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:13:07.997656 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:10.711349 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:10.978733 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0005634859999190667 future=<Future at 0x71c05848ad50 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:13:10.978733 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:13:10.978733 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=6.486156543999641 future=<Future at 0x71c05853ea80 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:13:10.978733 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=6.486059834999651 future=<Future at 0x71c05853ea80 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:13:10.978733 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Emitting event <LifecycleEvent: 1779329575.9762113, 8162299e-7f25-48d8-99c0-9e0792985f1f => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:13:10.978733 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] VM Stopped (Lifecycle Event)
May 21 02:13:11.486486 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 8162299e-7f25-48d8-99c0-9e0792985f1f] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:13:12.056176 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:12.249726 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "80a69a0b-c6a1-4dfd-932e-826068764081" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:13:12.249896 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "80a69a0b-c6a1-4dfd-932e-826068764081" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:13:12.250021 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "80a69a0b-c6a1-4dfd-932e-826068764081-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:13:12.250142 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "80a69a0b-c6a1-4dfd-932e-826068764081-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:13:12.250247 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "80a69a0b-c6a1-4dfd-932e-826068764081-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:13:12.252403 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Terminating instance
May 21 02:13:12.657448 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:12.754950 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:13:12.774857 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:12.803711 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:12.805646 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:12.832483 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:12.837072 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:12.935858 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7a1047d1-0d01-4eb2-ad39-bbd1da43d05d req-13b16cba-dc60-4a09-958f-3c1341be2571 service nova] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Received event network-vif-unplugged-7197f4a8-0c77-4200-b65b-e3f7122e17be {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:13:12.937118 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7a1047d1-0d01-4eb2-ad39-bbd1da43d05d req-13b16cba-dc60-4a09-958f-3c1341be2571 service nova] Acquiring lock "80a69a0b-c6a1-4dfd-932e-826068764081-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:13:12.937118 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7a1047d1-0d01-4eb2-ad39-bbd1da43d05d req-13b16cba-dc60-4a09-958f-3c1341be2571 service nova] Lock "80a69a0b-c6a1-4dfd-932e-826068764081-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:13:12.937118 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7a1047d1-0d01-4eb2-ad39-bbd1da43d05d req-13b16cba-dc60-4a09-958f-3c1341be2571 service nova] Lock "80a69a0b-c6a1-4dfd-932e-826068764081-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:13:12.937118 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7a1047d1-0d01-4eb2-ad39-bbd1da43d05d req-13b16cba-dc60-4a09-958f-3c1341be2571 service nova] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] No waiting events found dispatching network-vif-unplugged-7197f4a8-0c77-4200-b65b-e3f7122e17be {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:13:12.937118 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7a1047d1-0d01-4eb2-ad39-bbd1da43d05d req-13b16cba-dc60-4a09-958f-3c1341be2571 service nova] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Received event network-vif-unplugged-7197f4a8-0c77-4200-b65b-e3f7122e17be for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:13:12.997867 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:13.060585 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:13.067409 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:13.085783 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999689785999635 future=<Future at 0x71c07c538fb0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:13:13.088911 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Instance destroyed successfully.
May 21 02:13:13.089586 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lazy-loading 'resources' on Instance uuid 80a69a0b-c6a1-4dfd-932e-826068764081 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:13:13.598166 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:12:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-126509525',display_name='tempest-TestEncryptedCinderVolumes-server-126509525',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testencryptedcindervolumes-server-126509525',id=72,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAhkQbp5kMwPyRYbKzXvFue4B05DSWlMs4KXDTXsTygnB2TWy+kt4GBTiDM8LiCQTVRBWYkE1itG7K2+H6oL5C/hvlsCCr+Z7SvxCHUYwFWVcZ1ePW8nLfDe4MI4Yf/Uw==',key_name='tempest-TestEncryptedCinderVolumes-618034694',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:12:31Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='517a45856efe44aa92f802f146b17616',ramdisk_id='',reservation_id='r-9bfnignm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestEncryptedCinderVolumes-1523380334',owner_user_name='tempest-TestEncryptedCinderVolumes-1523380334-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:12:32Z,user_data=None,user_id='68fd64fea5a84a0bbb1d09de7d76709c',uuid=80a69a0b-c6a1-4dfd-932e-826068764081,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7197f4a8-0c77-4200-b65b-e3f7122e17be", "address": "fa:16:3e:bc:af:64", "network": {"id": "68132179-7a2d-4b6f-bc7a-da8f937a9fb2", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1224285668-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "517a45856efe44aa92f802f146b17616", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7197f4a8-0c", "ovs_interfaceid": "7197f4a8-0c77-4200-b65b-e3f7122e17be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:13:13.599262 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Converting VIF {"id": "7197f4a8-0c77-4200-b65b-e3f7122e17be", "address": "fa:16:3e:bc:af:64", "network": {"id": "68132179-7a2d-4b6f-bc7a-da8f937a9fb2", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1224285668-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "517a45856efe44aa92f802f146b17616", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7197f4a8-0c", "ovs_interfaceid": "7197f4a8-0c77-4200-b65b-e3f7122e17be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:13:13.599262 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:af:64,bridge_name='br-int',has_traffic_filtering=True,id=7197f4a8-0c77-4200-b65b-e3f7122e17be,network=Network(68132179-7a2d-4b6f-bc7a-da8f937a9fb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7197f4a8-0c') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:13:13.599575 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:af:64,bridge_name='br-int',has_traffic_filtering=True,id=7197f4a8-0c77-4200-b65b-e3f7122e17be,network=Network(68132179-7a2d-4b6f-bc7a-da8f937a9fb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7197f4a8-0c') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:13:13.602069 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:13.602264 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7197f4a8-0c, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:13:13.619852 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:13.621368 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:13:13.622419 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:13.622652 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=06fc7ad0-76f1-472a-95db-719abb510988) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:13:13.623167 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:13.623968 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:13:13.623968 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:13.625755 np0000001127 nova-compute[98206]: INFO os_vif [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:af:64,bridge_name='br-int',has_traffic_filtering=True,id=7197f4a8-0c77-4200-b65b-e3f7122e17be,network=Network(68132179-7a2d-4b6f-bc7a-da8f937a9fb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7197f4a8-0c')
May 21 02:13:13.629110 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:13:13.629540 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13', 'iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b1a825b3-a763-479f-8c2f-42fbf9fa9c13', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:13:13.629685 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:13:13.630035 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:13:13.630336 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13', 'iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b1a825b3-a763-479f-8c2f-42fbf9fa9c13', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:13:13.630591 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:13:13.656815 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:13:13.656815 np0000001127 nova-compute[98206]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:13:13.656815 np0000001127 nova-compute[98206]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:13:13.656815 np0000001127 nova-compute[98206]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:13:13.656815 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:13:13.656815 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:13:13.656815 np0000001127 nova-compute[98206]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13 (non-flash)
May 21 02:13:13.656815 np0000001127 nova-compute[98206]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:13:13.656815 np0000001127 nova-compute[98206]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:13:13.656815 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:13:13.657314 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13', '181'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13', '182'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', '187'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', '188')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:13:13.657314 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13', '181')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:13:13.658183 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13', '182')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:13:13.659733 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c5172e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13'): ({'sdd'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:13:13.659733 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Removing multipathed devices sdc, sdd {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:13:13.659733 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Flush multipath device 330000000f0b00697 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:13:13.693845 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:13:13.738274 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:13:13.791760 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Checking to see if SCSI volumes sdc, sdd have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:13:13.791901 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] SCSI volumes sdc, sdd have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:13:13.792710 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Checking to see if device paths {'sdc', 'sdd'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:13:13.804379 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Device paths {'sdc', 'sdd'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:13:13.804574 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:13:13.815714 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:13.850439 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 181, target: iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13, portal: 192.168.40.100,3260]
May 21 02:13:13.850439 np0000001127 nova-compute[98206]: Logout of [sid: 181, target: iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13, portal: 192.168.40.100,3260] successful.
May 21 02:13:13.850439 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:13.866253 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:13.877109 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:13.907218 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 182, target: iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13, portal: 192.168.50.100,3260]
May 21 02:13:13.907218 np0000001127 nova-compute[98206]: Logout of [sid: 182, target: iqn.2023-03.storpool.com:os--volume-b1a825b3-a763-479f-8c2f-42fbf9fa9c13, portal: 192.168.50.100,3260] successful.
May 21 02:13:13.907218 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:13.917906 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:13.918719 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:13:13.918866 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] <== disconnect_volume: return (289ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:13:13.919008 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:13:13.919284 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Deleting instance files /opt/stack/data/nova/instances/80a69a0b-c6a1-4dfd-932e-826068764081_del
May 21 02:13:13.919830 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Deletion of /opt/stack/data/nova/instances/80a69a0b-c6a1-4dfd-932e-826068764081_del complete
May 21 02:13:14.425911 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Took 1.67 seconds to destroy the instance on the hypervisor.
May 21 02:13:14.426489 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:13:14.426708 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:13:14.426794 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:13:14.427021 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:13:14.482279 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:13:14.999460 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f572ad3c-f7b7-43f7-a41f-6b215af59cfc req-fa0d5e03-16b9-4c8e-9fdd-2f90506c926e service nova] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Received event network-vif-unplugged-7197f4a8-0c77-4200-b65b-e3f7122e17be {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:13:15.000054 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f572ad3c-f7b7-43f7-a41f-6b215af59cfc req-fa0d5e03-16b9-4c8e-9fdd-2f90506c926e service nova] Acquiring lock "80a69a0b-c6a1-4dfd-932e-826068764081-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:13:15.000170 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f572ad3c-f7b7-43f7-a41f-6b215af59cfc req-fa0d5e03-16b9-4c8e-9fdd-2f90506c926e service nova] Lock "80a69a0b-c6a1-4dfd-932e-826068764081-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:13:15.000679 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f572ad3c-f7b7-43f7-a41f-6b215af59cfc req-fa0d5e03-16b9-4c8e-9fdd-2f90506c926e service nova] Lock "80a69a0b-c6a1-4dfd-932e-826068764081-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:13:15.000679 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f572ad3c-f7b7-43f7-a41f-6b215af59cfc req-fa0d5e03-16b9-4c8e-9fdd-2f90506c926e service nova] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] No waiting events found dispatching network-vif-unplugged-7197f4a8-0c77-4200-b65b-e3f7122e17be {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:13:15.000679 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f572ad3c-f7b7-43f7-a41f-6b215af59cfc req-fa0d5e03-16b9-4c8e-9fdd-2f90506c926e service nova] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Received event network-vif-unplugged-7197f4a8-0c77-4200-b65b-e3f7122e17be for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:13:15.000824 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f572ad3c-f7b7-43f7-a41f-6b215af59cfc req-fa0d5e03-16b9-4c8e-9fdd-2f90506c926e service nova] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Received event network-vif-deleted-7197f4a8-0c77-4200-b65b-e3f7122e17be {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:13:15.000824 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-f572ad3c-f7b7-43f7-a41f-6b215af59cfc req-fa0d5e03-16b9-4c8e-9fdd-2f90506c926e service nova] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Neutron deleted interface 7197f4a8-0c77-4200-b65b-e3f7122e17be; detaching it from the instance and deleting it from the info cache
May 21 02:13:15.000906 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-f572ad3c-f7b7-43f7-a41f-6b215af59cfc req-fa0d5e03-16b9-4c8e-9fdd-2f90506c926e service nova] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:13:15.377711 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:13:15.503872 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f572ad3c-f7b7-43f7-a41f-6b215af59cfc req-fa0d5e03-16b9-4c8e-9fdd-2f90506c926e service nova] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Detach interface failed, port_id=7197f4a8-0c77-4200-b65b-e3f7122e17be, reason: Instance 80a69a0b-c6a1-4dfd-932e-826068764081 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:13:15.879438 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Took 1.45 seconds to deallocate network for instance.
May 21 02:13:16.424413 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Took 0.54 seconds to detach 1 volumes for instance.
May 21 02:13:16.929411 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:13:16.929864 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:13:17.057832 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:17.252115 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:13:17.252515 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:13:17.464260 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0004117050002605538 future=<Future at 0x71c05853ea80 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:13:17.464774 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] Emitting event <LifecycleEvent: 1779329582.4637122, 6faea440-6481-41ab-886c-ca97308ab493 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:13:17.464967 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:13:17.465229 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] VM Stopped (Lifecycle Event)
May 21 02:13:17.466222 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=10.619229189999714 future=<Future at 0x71c07c538fb0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:13:17.466399 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=10.619043515999692 future=<Future at 0x71c07c538fb0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:13:17.757907 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:13:17.967551 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-3e8c79aa-81d2-44a5-bd14-2de5f16d704a tempest-TestServerVolumeAttachmentScenario-514659065 tempest-TestServerVolumeAttachmentScenario-514659065-project-member] [instance: 6faea440-6481-41ab-886c-ca97308ab493] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:13:18.263583 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.334s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:13:18.325334 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Deleted allocations for instance 80a69a0b-c6a1-4dfd-932e-826068764081
May 21 02:13:18.623432 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:19.335381 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-1ef60c86-6ff4-463f-b5b3-b4c4c19e8686 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "80a69a0b-c6a1-4dfd-932e-826068764081" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.085s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:13:22.059724 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:22.855995 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:23.606605 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:23.624716 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:24.278979 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:27.060656 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:27.925870 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Acquiring lock "c0628f73-e084-479c-8ecd-721fc26c39fb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:13:27.926073 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Lock "c0628f73-e084-479c-8ecd-721fc26c39fb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:13:28.085785 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0003286109999862674 future=<Future at 0x71c07c538fb0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:13:28.086298 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] Emitting event <LifecycleEvent: 1779329593.0853622, 80a69a0b-c6a1-4dfd-932e-826068764081 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:13:28.086449 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:13:28.086604 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] VM Stopped (Lifecycle Event)
May 21 02:13:28.429305 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Lazy-loading 'flavor' on Instance uuid c0628f73-e084-479c-8ecd-721fc26c39fb {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:13:28.589217 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-e257402d-5f4e-4298-85bd-cc79c0466cdc tempest-AttachVolumeMultiAttachTest-289054175 tempest-AttachVolumeMultiAttachTest-289054175-project-member] [instance: 80a69a0b-c6a1-4dfd-932e-826068764081] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:13:28.625441 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:28.931786 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Ignoring supplied device name: /dev/vdb
May 21 02:13:29.434398 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Lock "c0628f73-e084-479c-8ecd-721fc26c39fb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:13:30.606195 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Acquiring lock "c0628f73-e084-479c-8ecd-721fc26c39fb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:13:30.606664 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Lock "c0628f73-e084-479c-8ecd-721fc26c39fb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:13:30.606664 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Attaching volume 538288de-4062-460c-bee9-9651324d1ff3 to /dev/vdb
May 21 02:13:30.640770 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:13:30.654724 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:13:30.674078 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:13:30.718375 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:13:30.718933 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:13:30.728327 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:13:30.729589 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe2f:77a0', 'fe80::c44d:25ff:fe10:25cb', 'fe80::fc16:3eff:fe90:5ae3', 'fe80::b82e:42ff:fec9:b33a'] 
May 21 02:13:30.729814 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:13:30.730035 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:13:30.730302 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] <== get_connector_properties: return (89ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:13:30.730615 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Updating existing volume attachment record: ac78785b-81cf-4427-a6b7-4e48d29c003f {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:13:31.279073 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:13:31.279509 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3', 'iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '538288de-4062-460c-bee9-9651324d1ff3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:13:31.279724 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:13:31.280210 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:13:31.280446 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3', 'iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '538288de-4062-460c-bee9-9651324d1ff3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:13:31.292236 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:13:31.292587 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:13:31.292746 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:13:31.298251 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:13:31.298680 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:13:31.298854 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:13:31.306594 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:13:31.306594 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:31.312482 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:13:31.312482 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:31.319196 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3] added
May 21 02:13:31.319196 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:13:31.319196 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:13:31.319196 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:13:31.319196 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:13:31.319196 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:13:31.319196 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:31.319565 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:13:31.319565 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0267(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:13:31.319723 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:13:31.327337 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3] added
May 21 02:13:31.327337 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:13:31.327337 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:13:31.327337 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:13:31.327337 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:13:31.327337 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:13:31.327337 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:31.327590 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:13:31.327733 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0288(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:13:31.327912 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:13:32.062053 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:32.320293 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:13:32.328332 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:13:32.334211 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:13:32.334211 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:13:32.342763 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:13:32.342763 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:32.348451 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:32.355132 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:32.363122 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:13:32.363122 np0000001127 nova-compute[98206]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:13:32.363122 np0000001127 nova-compute[98206]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:13:32.363122 np0000001127 nova-compute[98206]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:13:32.363122 np0000001127 nova-compute[98206]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5de6f5b1-5f12-4c57-be8b-307dee81160a (non-flash)
May 21 02:13:32.363122 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:13:32.363365 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] iscsi session list stdout=tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:13:32.363365 np0000001127 nova-compute[98206]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:13:32.363365 np0000001127 nova-compute[98206]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:13:32.363365 np0000001127 nova-compute[98206]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:13:32.363365 np0000001127 nova-compute[98206]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5de6f5b1-5f12-4c57-be8b-307dee81160a (non-flash)
May 21 02:13:32.363365 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:13:32.370396 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:13:32.370396 np0000001127 nova-compute[98206]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:13:32.370396 np0000001127 nova-compute[98206]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:13:32.370396 np0000001127 nova-compute[98206]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:13:32.370396 np0000001127 nova-compute[98206]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5de6f5b1-5f12-4c57-be8b-307dee81160a (non-flash)
May 21 02:13:32.370396 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:13:32.370396 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] iscsi session list stdout=tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:13:32.370396 np0000001127 nova-compute[98206]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:13:32.370396 np0000001127 nova-compute[98206]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:13:32.370396 np0000001127 nova-compute[98206]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:13:32.370396 np0000001127 nova-compute[98206]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5de6f5b1-5f12-4c57-be8b-307dee81160a (non-flash)
May 21 02:13:32.370396 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:13:32.403275 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3, portal: 192.168.40.100,3260]
May 21 02:13:32.403275 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3, portal: 192.168.40.100,3260] successful.
May 21 02:13:32.403275 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:32.414230 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:32.424054 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3, portal: 192.168.50.100,3260]
May 21 02:13:32.424054 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3, portal: 192.168.50.100,3260] successful.
May 21 02:13:32.424054 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:32.431181 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:13:32.431181 np0000001127 nova-compute[98206]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:13:32.431181 np0000001127 nova-compute[98206]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:13:32.431181 np0000001127 nova-compute[98206]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:13:32.431181 np0000001127 nova-compute[98206]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5de6f5b1-5f12-4c57-be8b-307dee81160a (non-flash)
May 21 02:13:32.431181 np0000001127 nova-compute[98206]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3 (non-flash)
May 21 02:13:32.431181 np0000001127 nova-compute[98206]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3 (non-flash)
May 21 02:13:32.431181 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:13:32.431409 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] iscsi session list stdout=tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:13:32.431409 np0000001127 nova-compute[98206]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:13:32.431409 np0000001127 nova-compute[98206]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:13:32.431409 np0000001127 nova-compute[98206]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:13:32.431409 np0000001127 nova-compute[98206]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5de6f5b1-5f12-4c57-be8b-307dee81160a (non-flash)
May 21 02:13:32.431409 np0000001127 nova-compute[98206]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3 (non-flash)
May 21 02:13:32.431409 np0000001127 nova-compute[98206]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3 (non-flash)
May 21 02:13:32.431409 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:13:32.431573 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.139s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:13:32.431704 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:13:32.432523 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] HCTL ('10', '-', '-', 0) found on session 194 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:13:32.432610 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:13:32.437226 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:32.447246 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Searching for a device in session 194 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:13:32.447246 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '538288de-4062-460c-bee9-9651324d1ff3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:13:32.455251 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:13:32.455251 np0000001127 nova-compute[98206]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:13:32.455251 np0000001127 nova-compute[98206]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:13:32.455251 np0000001127 nova-compute[98206]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:13:32.455251 np0000001127 nova-compute[98206]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5de6f5b1-5f12-4c57-be8b-307dee81160a (non-flash)
May 21 02:13:32.455251 np0000001127 nova-compute[98206]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3 (non-flash)
May 21 02:13:32.455251 np0000001127 nova-compute[98206]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3 (non-flash)
May 21 02:13:32.455251 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:13:32.455251 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] iscsi session list stdout=tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:13:32.455251 np0000001127 nova-compute[98206]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:13:32.455251 np0000001127 nova-compute[98206]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:13:32.455251 np0000001127 nova-compute[98206]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:13:32.455251 np0000001127 nova-compute[98206]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5de6f5b1-5f12-4c57-be8b-307dee81160a (non-flash)
May 21 02:13:32.455251 np0000001127 nova-compute[98206]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3 (non-flash)
May 21 02:13:32.455251 np0000001127 nova-compute[98206]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3 (non-flash)
May 21 02:13:32.455251 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:13:32.455251 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.156s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:13:32.455251 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:13:32.455251 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] HCTL ('13', '-', '-', 0) found on session 195 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:13:32.455251 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:13:32.472392 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Searching for a device in session 195 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:13:32.472392 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '538288de-4062-460c-bee9-9651324d1ff3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:13:33.299286 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:13:33.355888 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "a9044351-f5a8-4e38-976c-24db83b046d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:13:33.356107 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "a9044351-f5a8-4e38-976c-24db83b046d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:13:33.356220 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "a9044351-f5a8-4e38-976c-24db83b046d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:13:33.356338 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "a9044351-f5a8-4e38-976c-24db83b046d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:13:33.356440 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "a9044351-f5a8-4e38-976c-24db83b046d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:13:33.360028 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Terminating instance
May 21 02:13:33.637260 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:33.864138 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:13:33.895529 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:33.897063 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:33.913945 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:33.916850 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:33.936007 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:33.940973 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:34.008717 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-5fa724bd-5b20-4ef5-bee3-a680e4d1adaf req-3441320c-de9f-4f51-b7a0-34863b0e5f80 service nova] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Received event network-vif-unplugged-50f6c60f-bd4a-41bb-a5a2-610e067047fb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:13:34.009210 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5fa724bd-5b20-4ef5-bee3-a680e4d1adaf req-3441320c-de9f-4f51-b7a0-34863b0e5f80 service nova] Acquiring lock "a9044351-f5a8-4e38-976c-24db83b046d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:13:34.009366 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5fa724bd-5b20-4ef5-bee3-a680e4d1adaf req-3441320c-de9f-4f51-b7a0-34863b0e5f80 service nova] Lock "a9044351-f5a8-4e38-976c-24db83b046d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:13:34.009520 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5fa724bd-5b20-4ef5-bee3-a680e4d1adaf req-3441320c-de9f-4f51-b7a0-34863b0e5f80 service nova] Lock "a9044351-f5a8-4e38-976c-24db83b046d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:13:34.009606 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-5fa724bd-5b20-4ef5-bee3-a680e4d1adaf req-3441320c-de9f-4f51-b7a0-34863b0e5f80 service nova] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] No waiting events found dispatching network-vif-unplugged-50f6c60f-bd4a-41bb-a5a2-610e067047fb {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:13:34.009708 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-5fa724bd-5b20-4ef5-bee3-a680e4d1adaf req-3441320c-de9f-4f51-b7a0-34863b0e5f80 service nova] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Received event network-vif-unplugged-50f6c60f-bd4a-41bb-a5a2-610e067047fb for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:13:34.150197 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:34.159449 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:34.177606 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999666159999833 future=<Future at 0x71c0586b9070 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:13:34.177606 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.99917236400006 future=<Future at 0x71c0586b9070 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:13:34.177760 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999025231999894 future=<Future at 0x71c0586b9070 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:13:34.180390 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Instance destroyed successfully.
May 21 02:13:34.181358 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lazy-loading 'resources' on Instance uuid a9044351-f5a8-4e38-976c-24db83b046d1 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:13:34.315913 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Found WWN 3300000002f8826a4 for multipath device dm-1 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:13:34.316424 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:13:34.316590 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '3300000002f8826a4', 'path': '/dev/dm-1', 'multipath_id': '3300000002f8826a4'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:13:34.316843 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002f8826a4', 'path': '/dev/dm-1', 'multipath_id': '3300000002f8826a4'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:13:34.320342 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Lazy-loading 'flavor' on Instance uuid c0628f73-e084-479c-8ecd-721fc26c39fb {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:13:34.685372 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:12:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1083662101',display_name='tempest-TestVolumeBootPattern-server-1083662101',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpattern-server-1083662101',id=74,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz/RBMCwKlZOoLdoqf7XbPge9tLmyY1xo5VJlB0SNDPLDIqYhv6bRKRrq1AOl4f0antvHh+zaNlybPqLYJXPC6E7cTtqubsCy3OHGbekTwncuW9Nfz1O6qOo+1iMsXADw==',key_name='tempest-TestVolumeBootPattern-2024297378',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:12:53Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62ebdb16aee84e22a88dfc8960debd32',ramdisk_id='',reservation_id='r-y004jrbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1995806391',owner_user_name='tempest-TestVolumeBootPattern-1995806391-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:12:54Z,user_data=None,user_id='4878b5a5bf184852a9ce383caa1c67a4',uuid=a9044351-f5a8-4e38-976c-24db83b046d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50f6c60f-bd4a-41bb-a5a2-610e067047fb", "address": "fa:16:3e:2f:77:a0", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f6c60f-bd", "ovs_interfaceid": "50f6c60f-bd4a-41bb-a5a2-610e067047fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:13:34.685372 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converting VIF {"id": "50f6c60f-bd4a-41bb-a5a2-610e067047fb", "address": "fa:16:3e:2f:77:a0", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f6c60f-bd", "ovs_interfaceid": "50f6c60f-bd4a-41bb-a5a2-610e067047fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:13:34.685372 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:77:a0,bridge_name='br-int',has_traffic_filtering=True,id=50f6c60f-bd4a-41bb-a5a2-610e067047fb,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f6c60f-bd') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:13:34.685372 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:77:a0,bridge_name='br-int',has_traffic_filtering=True,id=50f6c60f-bd4a-41bb-a5a2-610e067047fb,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f6c60f-bd') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:13:34.685705 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:34.685766 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50f6c60f-bd, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:13:34.696712 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:34.697549 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:13:34.698436 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:34.699190 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:34.699372 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=be8730ee-9967-496f-8d88-143837093c5a) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:13:34.699767 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:34.700186 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:13:34.702901 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:34.705463 np0000001127 nova-compute[98206]: INFO os_vif [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:77:a0,bridge_name='br-int',has_traffic_filtering=True,id=50f6c60f-bd4a-41bb-a5a2-610e067047fb,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f6c60f-bd')
May 21 02:13:34.706599 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:13:34.706952 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:13:34.707189 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:13:34.707567 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:13:34.707941 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:13:34.708437 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:13:34.733285 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:13:34.733285 np0000001127 nova-compute[98206]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:13:34.733285 np0000001127 nova-compute[98206]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5de6f5b1-5f12-4c57-be8b-307dee81160a (non-flash)
May 21 02:13:34.733285 np0000001127 nova-compute[98206]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3 (non-flash)
May 21 02:13:34.733285 np0000001127 nova-compute[98206]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3 (non-flash)
May 21 02:13:34.733285 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:13:34.733416 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:13:34.733416 np0000001127 nova-compute[98206]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:13:34.733416 np0000001127 nova-compute[98206]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5de6f5b1-5f12-4c57-be8b-307dee81160a (non-flash)
May 21 02:13:34.733416 np0000001127 nova-compute[98206]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3 (non-flash)
May 21 02:13:34.733416 np0000001127 nova-compute[98206]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3 (non-flash)
May 21 02:13:34.733416 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:13:34.733561 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', '187'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', '188'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5de6f5b1-5f12-4c57-be8b-307dee81160a', '193'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3', '194'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3', '195')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:13:34.733667 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', '188')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:13:34.734768 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', '187')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:13:34.735618 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c058467b00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1'): ({'sdf'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:13:34.735836 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Removing multipathed devices sdg, sdf {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:13:34.736097 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Flush multipath device 330000000fac56fe1 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:13:34.793813 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:13:34.824907 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Attempting to attach volume 538288de-4062-460c-bee9-9651324d1ff3 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 02:13:34.826602 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] attach device xml: <disk type="block" device="disk">
May 21 02:13:34.826602 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:13:34.826602 np0000001127 nova-compute[98206]:   <alias name="ua-538288de-4062-460c-bee9-9651324d1ff3"/>
May 21 02:13:34.826602 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-1"/>
May 21 02:13:34.826602 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:13:34.826602 np0000001127 nova-compute[98206]:   <serial>538288de-4062-460c-bee9-9651324d1ff3</serial>
May 21 02:13:34.826602 np0000001127 nova-compute[98206]: </disk>
May 21 02:13:34.826602 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 02:13:34.852849 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:13:34.907769 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:13:34.907936 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:13:34.908690 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:13:34.922298 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:13:34.922428 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:13:34.934175 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:34.969839 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 188, target: iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1, portal: 192.168.40.100,3260]
May 21 02:13:34.969839 np0000001127 nova-compute[98206]: Logout of [sid: 188, target: iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1, portal: 192.168.40.100,3260] successful.
May 21 02:13:34.969839 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:34.984668 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:34.996735 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:35.028832 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 187, target: iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1, portal: 192.168.50.100,3260]
May 21 02:13:35.028832 np0000001127 nova-compute[98206]: Logout of [sid: 187, target: iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1, portal: 192.168.50.100,3260] successful.
May 21 02:13:35.028832 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:35.042335 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:35.042533 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:13:35.042650 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] <== disconnect_volume: return (335ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:13:35.042762 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:13:35.043028 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Deleting instance files /opt/stack/data/nova/instances/a9044351-f5a8-4e38-976c-24db83b046d1_del
May 21 02:13:35.043480 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Deletion of /opt/stack/data/nova/instances/a9044351-f5a8-4e38-976c-24db83b046d1_del complete
May 21 02:13:35.549232 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Took 1.68 seconds to destroy the instance on the hypervisor.
May 21 02:13:35.549925 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:13:35.550283 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:13:35.550403 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:13:35.550735 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:13:35.605892 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:13:36.021365 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7ad4c949-a22a-4382-a74b-c614face3c71 req-e72bd3ec-e1e9-4346-a136-29bb8343bca6 service nova] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Received event network-vif-deleted-50f6c60f-bd4a-41bb-a5a2-610e067047fb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:13:36.022505 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-7ad4c949-a22a-4382-a74b-c614face3c71 req-e72bd3ec-e1e9-4346-a136-29bb8343bca6 service nova] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Neutron deleted interface 50f6c60f-bd4a-41bb-a5a2-610e067047fb; detaching it from the instance and deleting it from the info cache
May 21 02:13:36.022794 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-7ad4c949-a22a-4382-a74b-c614face3c71 req-e72bd3ec-e1e9-4346-a136-29bb8343bca6 service nova] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:13:36.079355 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a2b85a61-b9c5-47d4-8d00-bc19891f0725 req-2c4c2a64-179b-4f99-9729-37e13e7674b6 service nova] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Received event network-vif-unplugged-50f6c60f-bd4a-41bb-a5a2-610e067047fb {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:13:36.079866 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a2b85a61-b9c5-47d4-8d00-bc19891f0725 req-2c4c2a64-179b-4f99-9729-37e13e7674b6 service nova] Acquiring lock "a9044351-f5a8-4e38-976c-24db83b046d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:13:36.079866 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a2b85a61-b9c5-47d4-8d00-bc19891f0725 req-2c4c2a64-179b-4f99-9729-37e13e7674b6 service nova] Lock "a9044351-f5a8-4e38-976c-24db83b046d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:13:36.079997 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a2b85a61-b9c5-47d4-8d00-bc19891f0725 req-2c4c2a64-179b-4f99-9729-37e13e7674b6 service nova] Lock "a9044351-f5a8-4e38-976c-24db83b046d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:13:36.080146 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a2b85a61-b9c5-47d4-8d00-bc19891f0725 req-2c4c2a64-179b-4f99-9729-37e13e7674b6 service nova] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] No waiting events found dispatching network-vif-unplugged-50f6c60f-bd4a-41bb-a5a2-610e067047fb {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:13:36.080489 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a2b85a61-b9c5-47d4-8d00-bc19891f0725 req-2c4c2a64-179b-4f99-9729-37e13e7674b6 service nova] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Received event network-vif-unplugged-50f6c60f-bd4a-41bb-a5a2-610e067047fb for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:13:36.473272 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:13:36.491738 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:13:36.491898 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:13:36.492016 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:13:36.492340 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] No VIF found with MAC fa:16:3e:90:5a:e3, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:13:36.526374 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7ad4c949-a22a-4382-a74b-c614face3c71 req-e72bd3ec-e1e9-4346-a136-29bb8343bca6 service nova] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Detach interface failed, port_id=50f6c60f-bd4a-41bb-a5a2-610e067047fb, reason: Instance a9044351-f5a8-4e38-976c-24db83b046d1 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:13:36.969561 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:13:36.970194 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:13:36.975842 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Took 1.43 seconds to deallocate network for instance.
May 21 02:13:37.069631 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:37.472448 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:13:37.536256 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Took 0.56 seconds to detach 1 volumes for instance.
May 21 02:13:37.991483 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c42a4e80-4628-431b-adb9-1b0839e96eb4 req-6fe4ba00-f602-46cc-b75c-77304ec4fe5a service nova] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Received event volume-extended-538288de-4062-460c-bee9-9651324d1ff3 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:13:38.023383 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:13:38.023771 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:13:38.027277 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:13:38.027404 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Claim successful on node np0000001127
May 21 02:13:38.055056 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:13:38.055597 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-033539f0-5da3-478d-93e2-06dc5c28bfb1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Lock "c0628f73-e084-479c-8ecd-721fc26c39fb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.449s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:13:38.493289 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c42a4e80-4628-431b-adb9-1b0839e96eb4 req-6fe4ba00-f602-46cc-b75c-77304ec4fe5a service nova] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Handling volume-extended event for volume 538288de-4062-460c-bee9-9651324d1ff3 {{(pid=98206) extend_volume /opt/stack/nova/nova/compute/manager.py:11834}}
May 21 02:13:38.995893 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-c42a4e80-4628-431b-adb9-1b0839e96eb4 req-6fe4ba00-f602-46cc-b75c-77304ec4fe5a service nova] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Cinder extended volume 538288de-4062-460c-bee9-9651324d1ff3; extending it to detect new size
May 21 02:13:39.085160 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Refreshing inventories for resource provider a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 21 02:13:39.129068 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Updating ProviderTree inventory for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 21 02:13:39.129272 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Updating inventory in ProviderTree for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 21 02:13:39.171861 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Refreshing aggregate associations for resource provider a0b7bd56-5a70-4557-8cfd-9f933f412754, aggregates: None {{(pid=98206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 21 02:13:39.213161 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Refreshing trait associations for resource provider a0b7bd56-5a70-4557-8cfd-9f933f412754, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_ARCH_X86_64,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ARCH_PPC64LE,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,HW_ARCH_X86_64,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ARCH_S390X,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOUND_MODEL_USB,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_SOUND_MODEL_SB16,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_ARCH_RISCV64,COMPUTE_ARCH_MIPSEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ARCH_AARCH64,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_SOUND_MODEL_AC97,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX {{(pid=98206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 21 02:13:39.362226 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:13:39.362407 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:13:39.526124 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [req-c42a4e80-4628-431b-adb9-1b0839e96eb4 req-6fe4ba00-f602-46cc-b75c-77304ec4fe5a service nova] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] calling os-brick to extend iSCSI Volume {{(pid=98206) extend_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:88}}
May 21 02:13:39.526455 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [req-c42a4e80-4628-431b-adb9-1b0839e96eb4 req-6fe4ba00-f602-46cc-b75c-77304ec4fe5a service nova] ==> extend_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3', 'iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '538288de-4062-460c-bee9-9651324d1ff3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}), 'kwargs': {}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:13:39.526635 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [req-c42a4e80-4628-431b-adb9-1b0839e96eb4 req-6fe4ba00-f602-46cc-b75c-77304ec4fe5a service nova] Acquiring lock "extend_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:13:39.527068 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [req-c42a4e80-4628-431b-adb9-1b0839e96eb4 req-6fe4ba00-f602-46cc-b75c-77304ec4fe5a service nova] Lock "extend_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:13:39.527367 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [req-c42a4e80-4628-431b-adb9-1b0839e96eb4 req-6fe4ba00-f602-46cc-b75c-77304ec4fe5a service nova] Extend volume for {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3', 'iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '538288de-4062-460c-bee9-9651324d1ff3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}
May 21 02:13:39.527510 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [req-c42a4e80-4628-431b-adb9-1b0839e96eb4 req-6fe4ba00-f602-46cc-b75c-77304ec4fe5a service nova] Multipath discovery for iSCSI enabled
May 21 02:13:39.527713 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [req-c42a4e80-4628-431b-adb9-1b0839e96eb4 req-6fe4ba00-f602-46cc-b75c-77304ec4fe5a service nova] Found paths for volume ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3-lun-0']
May 21 02:13:39.527861 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [req-c42a4e80-4628-431b-adb9-1b0839e96eb4 req-6fe4ba00-f602-46cc-b75c-77304ec4fe5a service nova] Checking paths are valid ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3-lun-0'] {{(pid=98206) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:711}}
May 21 02:13:39.545020 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [req-c42a4e80-4628-431b-adb9-1b0839e96eb4 req-6fe4ba00-f602-46cc-b75c-77304ec4fe5a service nova] extend volume ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3-lun-0'] {{(pid=98206) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:718}}
May 21 02:13:39.545222 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [req-c42a4e80-4628-431b-adb9-1b0839e96eb4 req-6fe4ba00-f602-46cc-b75c-77304ec4fe5a service nova] Running cmd (subprocess): lsscsi {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:13:39.590843 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [req-c42a4e80-4628-431b-adb9-1b0839e96eb4 req-6fe4ba00-f602-46cc-b75c-77304ec4fe5a service nova] CMD "lsscsi" returned: 0 in 0.045s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:13:39.591321 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [req-c42a4e80-4628-431b-adb9-1b0839e96eb4 req-6fe4ba00-f602-46cc-b75c-77304ec4fe5a service nova] dev_info={'device': '/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3-lun-0', 'host': '10', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98206) get_device_info /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:201}}
May 21 02:13:39.591453 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [req-c42a4e80-4628-431b-adb9-1b0839e96eb4 req-6fe4ba00-f602-46cc-b75c-77304ec4fe5a service nova] Volume device info = {'device': '/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3-lun-0', 'host': '10', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98206) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:722}}
May 21 02:13:39.599266 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [req-c42a4e80-4628-431b-adb9-1b0839e96eb4 req-6fe4ba00-f602-46cc-b75c-77304ec4fe5a service nova] Starting size: 1073741824 {{(pid=98206) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:733}}
May 21 02:13:39.647042 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [req-c42a4e80-4628-431b-adb9-1b0839e96eb4 req-6fe4ba00-f602-46cc-b75c-77304ec4fe5a service nova] volume size after scsi device rescan 2147483648 {{(pid=98206) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:739}}
May 21 02:13:39.647455 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [req-c42a4e80-4628-431b-adb9-1b0839e96eb4 req-6fe4ba00-f602-46cc-b75c-77304ec4fe5a service nova] Running cmd (subprocess): lsscsi {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:13:39.696773 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [req-c42a4e80-4628-431b-adb9-1b0839e96eb4 req-6fe4ba00-f602-46cc-b75c-77304ec4fe5a service nova] CMD "lsscsi" returned: 0 in 0.049s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:13:39.697198 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [req-c42a4e80-4628-431b-adb9-1b0839e96eb4 req-6fe4ba00-f602-46cc-b75c-77304ec4fe5a service nova] dev_info={'device': '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3-lun-0', 'host': '13', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98206) get_device_info /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:201}}
May 21 02:13:39.697368 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [req-c42a4e80-4628-431b-adb9-1b0839e96eb4 req-6fe4ba00-f602-46cc-b75c-77304ec4fe5a service nova] Volume device info = {'device': '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3-lun-0', 'host': '13', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98206) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:722}}
May 21 02:13:39.701664 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:39.705103 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [req-c42a4e80-4628-431b-adb9-1b0839e96eb4 req-6fe4ba00-f602-46cc-b75c-77304ec4fe5a service nova] Starting size: 1073741824 {{(pid=98206) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:733}}
May 21 02:13:39.728762 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [req-c42a4e80-4628-431b-adb9-1b0839e96eb4 req-6fe4ba00-f602-46cc-b75c-77304ec4fe5a service nova] volume size after scsi device rescan 2147483648 {{(pid=98206) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:739}}
May 21 02:13:39.739812 np0000001127 nova-compute[98206]: INFO os_brick.initiator.linuxscsi [req-c42a4e80-4628-431b-adb9-1b0839e96eb4 req-6fe4ba00-f602-46cc-b75c-77304ec4fe5a service nova] Find Multipath device file for volume WWN 3300000002f8826a4
May 21 02:13:39.740232 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [req-c42a4e80-4628-431b-adb9-1b0839e96eb4 req-6fe4ba00-f602-46cc-b75c-77304ec4fe5a service nova] Checking to see if /dev/disk/by-id/dm-uuid-mpath-3300000002f8826a4 exists yet. {{(pid=98206) wait_for_path /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:482}}
May 21 02:13:39.740393 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [req-c42a4e80-4628-431b-adb9-1b0839e96eb4 req-6fe4ba00-f602-46cc-b75c-77304ec4fe5a service nova] /dev/disk/by-id/dm-uuid-mpath-3300000002f8826a4 has shown up. {{(pid=98206) wait_for_path /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:489}}
May 21 02:13:39.766874 np0000001127 nova-compute[98206]: INFO os_brick.initiator.linuxscsi [req-c42a4e80-4628-431b-adb9-1b0839e96eb4 req-6fe4ba00-f602-46cc-b75c-77304ec4fe5a service nova] mpath(/dev/disk/by-id/dm-uuid-mpath-3300000002f8826a4) current size 1073741824
May 21 02:13:39.811227 np0000001127 nova-compute[98206]: INFO os_brick.initiator.linuxscsi [req-c42a4e80-4628-431b-adb9-1b0839e96eb4 req-6fe4ba00-f602-46cc-b75c-77304ec4fe5a service nova] mpath(/dev/disk/by-id/dm-uuid-mpath-3300000002f8826a4) new size 2147483648
May 21 02:13:39.811627 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [req-c42a4e80-4628-431b-adb9-1b0839e96eb4 req-6fe4ba00-f602-46cc-b75c-77304ec4fe5a service nova] Lock "extend_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" :: held 0.284s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:13:39.811969 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [req-c42a4e80-4628-431b-adb9-1b0839e96eb4 req-6fe4ba00-f602-46cc-b75c-77304ec4fe5a service nova] <== extend_volume: return (285ms) 2147483648 {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:13:39.811969 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [req-c42a4e80-4628-431b-adb9-1b0839e96eb4 req-6fe4ba00-f602-46cc-b75c-77304ec4fe5a service nova] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Extend iSCSI Volume: new_size=2147483648 {{(pid=98206) extend_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:90}}
May 21 02:13:39.815708 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [req-c42a4e80-4628-431b-adb9-1b0839e96eb4 req-6fe4ba00-f602-46cc-b75c-77304ec4fe5a service nova] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Resizing target device /dev/dm-1 to 2147483648 {{(pid=98206) _resize_attached_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2945}}
May 21 02:13:39.865194 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:13:40.371855 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.348s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:13:40.372344 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.317s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:13:40.372537 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:13:40.549830 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:13:40.550087 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:13:40.656421 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Acquiring lock "c0628f73-e084-479c-8ecd-721fc26c39fb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:13:40.656631 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Lock "c0628f73-e084-479c-8ecd-721fc26c39fb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:13:40.878280 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:13:40.878459 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:13:40.878866 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:13:40.879217 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:13:40.949123 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '68fd64fea5a84a0bbb1d09de7d76709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a45856efe44aa92f802f146b17616', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:13:41.052387 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:13:41.158821 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Detaching volume 538288de-4062-460c-bee9-9651324d1ff3
May 21 02:13:41.194145 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Attempting to driver detach volume 538288de-4062-460c-bee9-9651324d1ff3 from mountpoint /dev/vdb
May 21 02:13:41.199601 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Found disk vdb by alias ua-538288de-4062-460c-bee9-9651324d1ff3 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:13:41.201274 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Found disk vdb by alias ua-538288de-4062-460c-bee9-9651324d1ff3 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:13:41.201421 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Attempting to detach device vdb from instance c0628f73-e084-479c-8ecd-721fc26c39fb from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 02:13:41.201763 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:13:41.201763 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:13:41.201763 np0000001127 nova-compute[98206]:   <alias name="ua-538288de-4062-460c-bee9-9651324d1ff3"/>
May 21 02:13:41.201763 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-1"/>
May 21 02:13:41.201763 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:13:41.201763 np0000001127 nova-compute[98206]:   <serial>538288de-4062-460c-bee9-9651324d1ff3</serial>
May 21 02:13:41.201763 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:13:41.201763 np0000001127 nova-compute[98206]: </disk>
May 21 02:13:41.201763 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:13:41.210232 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Successfully detached device vdb from instance c0628f73-e084-479c-8ecd-721fc26c39fb from the persistent domain config.
May 21 02:13:41.210424 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] (1/8): Attempting to detach device vdb with device alias ua-538288de-4062-460c-bee9-9651324d1ff3 from instance c0628f73-e084-479c-8ecd-721fc26c39fb from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 02:13:41.210713 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:13:41.210713 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:13:41.210713 np0000001127 nova-compute[98206]:   <alias name="ua-538288de-4062-460c-bee9-9651324d1ff3"/>
May 21 02:13:41.210713 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-1"/>
May 21 02:13:41.210713 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:13:41.210713 np0000001127 nova-compute[98206]:   <serial>538288de-4062-460c-bee9-9651324d1ff3</serial>
May 21 02:13:41.210713 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:13:41.210713 np0000001127 nova-compute[98206]: </disk>
May 21 02:13:41.210713 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:13:41.340458 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Successfully created port: 21c89916-bd00-43b3-bfc9-b1ec22cc08bf {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:13:41.381445 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:13:41.558872 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.187s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:13:41.605679 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Deleted allocations for instance a9044351-f5a8-4e38-976c-24db83b046d1
May 21 02:13:41.675658 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779329621.6752589, c0628f73-e084-479c-8ecd-721fc26c39fb => ua-538288de-4062-460c-bee9-9651324d1ff3> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 02:13:41.676591 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-538288de-4062-460c-bee9-9651324d1ff3 for instance c0628f73-e084-479c-8ecd-721fc26c39fb {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 02:13:41.678428 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Successfully detached device vdb from instance c0628f73-e084-479c-8ecd-721fc26c39fb from the live domain config.
May 21 02:13:41.679507 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:13:41.679770 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3', 'iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '538288de-4062-460c-bee9-9651324d1ff3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:13:41.679876 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:13:41.680234 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:13:41.680518 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3', 'iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '538288de-4062-460c-bee9-9651324d1ff3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:13:41.680657 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:13:41.700551 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3 (non-flash)
May 21 02:13:41.700551 np0000001127 nova-compute[98206]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3 (non-flash)
May 21 02:13:41.700551 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:13:41.700711 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] iscsi session list stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3 (non-flash)
May 21 02:13:41.700711 np0000001127 nova-compute[98206]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3 (non-flash)
May 21 02:13:41.700711 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:13:41.700792 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3', '194'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3', '195')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:13:41.700863 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3', '194')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:13:41.701590 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3', '195')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:13:41.702179 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c73d620>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3'): ({'sdh'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:13:41.702361 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Removing multipathed devices sde, sdh {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:13:41.702587 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Flush multipath device 3300000002f8826a4 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:13:41.744168 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:13:41.775436 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Successfully updated port: 21c89916-bd00-43b3-bfc9-b1ec22cc08bf {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:13:41.794886 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:13:41.819679 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f2df8585-2ca6-4141-8fc8-396d42737fc2 req-d957617f-bcf1-4c20-a247-c89b5390037e service nova] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Received event network-changed-21c89916-bd00-43b3-bfc9-b1ec22cc08bf {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:13:41.819790 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f2df8585-2ca6-4141-8fc8-396d42737fc2 req-d957617f-bcf1-4c20-a247-c89b5390037e service nova] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Refreshing instance network info cache due to event network-changed-21c89916-bd00-43b3-bfc9-b1ec22cc08bf. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:13:41.819967 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f2df8585-2ca6-4141-8fc8-396d42737fc2 req-d957617f-bcf1-4c20-a247-c89b5390037e service nova] Acquiring lock "refresh_cache-8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:13:41.820071 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f2df8585-2ca6-4141-8fc8-396d42737fc2 req-d957617f-bcf1-4c20-a247-c89b5390037e service nova] Acquired lock "refresh_cache-8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:13:41.820210 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-f2df8585-2ca6-4141-8fc8-396d42737fc2 req-d957617f-bcf1-4c20-a247-c89b5390037e service nova] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Refreshing network info cache for port 21c89916-bd00-43b3-bfc9-b1ec22cc08bf {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:13:41.833653 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Checking to see if SCSI volumes sde, sdh have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:13:41.833811 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] SCSI volumes sde, sdh have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:13:41.834379 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Checking to see if device paths {'sde', 'sdh'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:13:41.845043 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Device paths {'sde', 'sdh'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:13:41.845221 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:13:41.854818 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:41.883006 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 194, target: iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3, portal: 192.168.40.100,3260]
May 21 02:13:41.883006 np0000001127 nova-compute[98206]: Logout of [sid: 194, target: iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3, portal: 192.168.40.100,3260] successful.
May 21 02:13:41.883006 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:41.884938 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:13:41.894171 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:41.903983 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:41.939272 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 195, target: iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3, portal: 192.168.50.100,3260]
May 21 02:13:41.939272 np0000001127 nova-compute[98206]: Logout of [sid: 195, target: iqn.2023-03.storpool.com:os--volume-538288de-4062-460c-bee9-9651324d1ff3, portal: 192.168.50.100,3260] successful.
May 21 02:13:41.939272 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:41.949604 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:41.949801 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:13:41.949911 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] <== disconnect_volume: return (270ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:13:41.950139 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:13:42.076674 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:42.277217 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "refresh_cache-8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:13:42.322136 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-f2df8585-2ca6-4141-8fc8-396d42737fc2 req-d957617f-bcf1-4c20-a247-c89b5390037e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:13:42.383954 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-f2df8585-2ca6-4141-8fc8-396d42737fc2 req-d957617f-bcf1-4c20-a247-c89b5390037e service nova] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:13:42.389050 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Booting with volume 2853aa4f-6782-4643-acd0-fbaa302aca4c at /dev/vda
May 21 02:13:42.420588 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:13:42.432608 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:13:42.452555 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:13:42.495271 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Lazy-loading 'flavor' on Instance uuid c0628f73-e084-479c-8ecd-721fc26c39fb {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:13:42.497353 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:13:42.497992 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:13:42.505851 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:13:42.506751 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe90:5ae3', 'fe80::b82e:42ff:fec9:b33a'] 
May 21 02:13:42.506888 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:13:42.507025 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:13:42.507229 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:13:42.507560 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Updating existing volume attachment record: e65d88b8-b93e-4479-ae85-e1da79a613f5 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:13:42.533118 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-f2df8585-2ca6-4141-8fc8-396d42737fc2 req-d957617f-bcf1-4c20-a247-c89b5390037e service nova] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:13:42.615662 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a66d6a18-a18b-4e1b-afa8-6794d22734d6 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "a9044351-f5a8-4e38-976c-24db83b046d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.259s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:13:43.035073 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f2df8585-2ca6-4141-8fc8-396d42737fc2 req-d957617f-bcf1-4c20-a247-c89b5390037e service nova] Releasing lock "refresh_cache-8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:13:43.035528 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquired lock "refresh_cache-8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:13:43.035663 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:13:43.501682 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d60d8fc3-2c4f-40ff-9203-1c286f287159 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Lock "c0628f73-e084-479c-8ecd-721fc26c39fb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.845s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:13:43.590871 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:13:43.719964 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:13:43.830138 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Updating instance_info_cache with network_info: [{"id": "21c89916-bd00-43b3-bfc9-b1ec22cc08bf", "address": "fa:16:3e:86:bf:a0", "network": {"id": "68132179-7a2d-4b6f-bc7a-da8f937a9fb2", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1224285668-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "517a45856efe44aa92f802f146b17616", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c89916-bd", "ovs_interfaceid": "21c89916-bd00-43b3-bfc9-b1ec22cc08bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:13:43.864463 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0e112255-e064-41b5-b7ea-0b24fa3124b1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Acquiring lock "c0628f73-e084-479c-8ecd-721fc26c39fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:13:43.864661 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0e112255-e064-41b5-b7ea-0b24fa3124b1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Lock "c0628f73-e084-479c-8ecd-721fc26c39fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:13:43.864818 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0e112255-e064-41b5-b7ea-0b24fa3124b1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Acquiring lock "c0628f73-e084-479c-8ecd-721fc26c39fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:13:43.864957 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0e112255-e064-41b5-b7ea-0b24fa3124b1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Lock "c0628f73-e084-479c-8ecd-721fc26c39fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:13:43.865058 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0e112255-e064-41b5-b7ea-0b24fa3124b1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Lock "c0628f73-e084-479c-8ecd-721fc26c39fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:13:43.866949 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-0e112255-e064-41b5-b7ea-0b24fa3124b1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Terminating instance
May 21 02:13:44.331863 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Releasing lock "refresh_cache-8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:13:44.332254 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Instance network_info: |[{"id": "21c89916-bd00-43b3-bfc9-b1ec22cc08bf", "address": "fa:16:3e:86:bf:a0", "network": {"id": "68132179-7a2d-4b6f-bc7a-da8f937a9fb2", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1224285668-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "517a45856efe44aa92f802f146b17616", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c89916-bd", "ovs_interfaceid": "21c89916-bd00-43b3-bfc9-b1ec22cc08bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:13:44.370182 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-0e112255-e064-41b5-b7ea-0b24fa3124b1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:13:44.385416 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:44.386924 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:44.402335 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:44.412000 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:44.433482 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "fc403327-070b-4e21-b046-40c4160ee52b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:13:44.433786 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "fc403327-070b-4e21-b046-40c4160ee52b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:13:44.436332 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:44.442285 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:44.531781 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a4764ef7-8d63-4a8f-ae22-4c86fe6ea59e req-d7a2ec5c-4148-4aff-a495-efbe7fa41dfb service nova] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Received event network-vif-unplugged-e2e50f9d-813b-4414-bf68-0a2b7f8136a7 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:13:44.532311 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a4764ef7-8d63-4a8f-ae22-4c86fe6ea59e req-d7a2ec5c-4148-4aff-a495-efbe7fa41dfb service nova] Acquiring lock "c0628f73-e084-479c-8ecd-721fc26c39fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:13:44.532493 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a4764ef7-8d63-4a8f-ae22-4c86fe6ea59e req-d7a2ec5c-4148-4aff-a495-efbe7fa41dfb service nova] Lock "c0628f73-e084-479c-8ecd-721fc26c39fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:13:44.532633 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a4764ef7-8d63-4a8f-ae22-4c86fe6ea59e req-d7a2ec5c-4148-4aff-a495-efbe7fa41dfb service nova] Lock "c0628f73-e084-479c-8ecd-721fc26c39fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:13:44.532734 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a4764ef7-8d63-4a8f-ae22-4c86fe6ea59e req-d7a2ec5c-4148-4aff-a495-efbe7fa41dfb service nova] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] No waiting events found dispatching network-vif-unplugged-e2e50f9d-813b-4414-bf68-0a2b7f8136a7 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:13:44.532848 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a4764ef7-8d63-4a8f-ae22-4c86fe6ea59e req-d7a2ec5c-4148-4aff-a495-efbe7fa41dfb service nova] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Received event network-vif-unplugged-e2e50f9d-813b-4414-bf68-0a2b7f8136a7 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:13:44.606082 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:13:44.607169 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:13:44.607343 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Creating image(s)
May 21 02:13:44.607622 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Did not create local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 21 02:13:44.607738 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Ensure instance console log exists: /opt/stack/data/nova/instances/8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:13:44.608055 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:13:44.608115 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:13:44.608229 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:13:44.608619 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Start _get_guest_xml network_info=[{"id": "21c89916-bd00-43b3-bfc9-b1ec22cc08bf", "address": "fa:16:3e:86:bf:a0", "network": {"id": "68132179-7a2d-4b6f-bc7a-da8f937a9fb2", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1224285668-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "517a45856efe44aa92f802f146b17616", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c89916-bd", "ovs_interfaceid": "21c89916-bd00-43b3-bfc9-b1ec22cc08bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c', 'iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2853aa4f-6782-4643-acd0-fbaa302aca4c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc', 'attached_at': '', 'detached_at': '', 'volume_id': '2853aa4f-6782-4643-acd0-fbaa302aca4c', 'serial': '2853aa4f-6782-4643-acd0-fbaa302aca4c'}, 'delete_on_termination': False, 'attachment_id': 'e65d88b8-b93e-4479-ae85-e1da79a613f5', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:13:44.611946 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:13:44.612829 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-773217921', uuid='8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc'), owner=OwnerMeta(userid='68fd64fea5a84a0bbb1d09de7d76709c', username='tempest-TestEncryptedCinderVolumes-1523380334-project-member', projectid='517a45856efe44aa92f802f146b17616', projectname='tempest-TestEncryptedCinderVolumes-1523380334'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "21c89916-bd00-43b3-bfc9-b1ec22cc08bf", "address": "fa:16:3e:86:bf:a0", "network": {"id": "68132179-7a2d-4b6f-bc7a-da8f937a9fb2", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1224285668-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "517a45856efe44aa92f802f146b17616", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c89916-bd", "ovs_interfaceid": "21c89916-bd00-43b3-bfc9-b1ec22cc08bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329624.612532) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:13:44.614306 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:13:44.614607 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:13:44.615915 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:13:44.616088 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:13:44.616889 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:13:44.617138 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:13:44.617328 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:13:44.617419 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:13:44.617515 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:13:44.617603 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:13:44.617727 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:13:44.617904 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:13:44.618067 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:13:44.618155 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:13:44.618351 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:13:44.618463 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:13:44.628032 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:13:44.628310 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c', 'iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2853aa4f-6782-4643-acd0-fbaa302aca4c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:13:44.628429 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:13:44.673779 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:44.679141 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:44.699982 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999056078999729 future=<Future at 0x71c05858de80 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:13:44.701545 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Instance destroyed successfully.
May 21 02:13:44.701958 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-0e112255-e064-41b5-b7ea-0b24fa3124b1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Lazy-loading 'resources' on Instance uuid c0628f73-e084-479c-8ecd-721fc26c39fb {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:13:44.702844 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:44.938166 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:13:45.204295 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-0e112255-e064-41b5-b7ea-0b24fa3124b1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-370050969',display_name='tempest-VolumesExtendAttachedTest-instance-370050969',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-volumesextendattachedtest-instance-370050969',id=75,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsadKJ1GyEoij9V53/OnHo1o3XXZHqmStRlkoFdxOoKfp+QEV/qddbkXfG0R3vyAgRsU7rCHf26+aUjhPFiyQ5gHdBzTUOuUMs63DbqQxLpDwqCyTkwcn6rSrlDEIQCaQ==',key_name='tempest-keypair-1531757847',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:13:03Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8230f894ed6240d58351e82fcb41d8d9',ramdisk_id='',reservation_id='r-knotdtqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesExtendAttachedTest-2003688561',owner_user_name='tempest-VolumesExtendAttachedTest-2003688561-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:13:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b23c69336bc4dc88d63a626aed385ec',uuid=c0628f73-e084-479c-8ecd-721fc26c39fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2e50f9d-813b-4414-bf68-0a2b7f8136a7", "address": "fa:16:3e:90:5a:e3", "network": {"id": "6e44729f-4d54-4c10-8a9d-0221e926a5a1", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-481465007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8230f894ed6240d58351e82fcb41d8d9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e50f9d-81", "ovs_interfaceid": "e2e50f9d-813b-4414-bf68-0a2b7f8136a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:13:45.204482 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-0e112255-e064-41b5-b7ea-0b24fa3124b1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Converting VIF {"id": "e2e50f9d-813b-4414-bf68-0a2b7f8136a7", "address": "fa:16:3e:90:5a:e3", "network": {"id": "6e44729f-4d54-4c10-8a9d-0221e926a5a1", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-481465007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8230f894ed6240d58351e82fcb41d8d9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e50f9d-81", "ovs_interfaceid": "e2e50f9d-813b-4414-bf68-0a2b7f8136a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:13:45.205069 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-0e112255-e064-41b5-b7ea-0b24fa3124b1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:5a:e3,bridge_name='br-int',has_traffic_filtering=True,id=e2e50f9d-813b-4414-bf68-0a2b7f8136a7,network=Network(6e44729f-4d54-4c10-8a9d-0221e926a5a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e50f9d-81') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:13:45.205322 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-0e112255-e064-41b5-b7ea-0b24fa3124b1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:5a:e3,bridge_name='br-int',has_traffic_filtering=True,id=e2e50f9d-813b-4414-bf68-0a2b7f8136a7,network=Network(6e44729f-4d54-4c10-8a9d-0221e926a5a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e50f9d-81') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:13:45.206598 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:45.206800 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2e50f9d-81, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:13:45.208701 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:13:45.209157 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:45.209283 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7721c9ca-a755-4a2c-bdf3-cc3eb3db1ba2) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:13:45.209702 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:45.210102 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:13:45.210195 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:45.211910 np0000001127 nova-compute[98206]: INFO os_vif [None req-0e112255-e064-41b5-b7ea-0b24fa3124b1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:5a:e3,bridge_name='br-int',has_traffic_filtering=True,id=e2e50f9d-813b-4414-bf68-0a2b7f8136a7,network=Network(6e44729f-4d54-4c10-8a9d-0221e926a5a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e50f9d-81')
May 21 02:13:45.212181 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-0e112255-e064-41b5-b7ea-0b24fa3124b1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Deleting instance files /opt/stack/data/nova/instances/c0628f73-e084-479c-8ecd-721fc26c39fb_del
May 21 02:13:45.213578 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-0e112255-e064-41b5-b7ea-0b24fa3124b1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Deletion of /opt/stack/data/nova/instances/c0628f73-e084-479c-8ecd-721fc26c39fb_del complete
May 21 02:13:45.380548 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.752s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:13:45.380793 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c', 'iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2853aa4f-6782-4643-acd0-fbaa302aca4c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:13:45.391704 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:13:45.392345 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:13:45.392727 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:13:45.392899 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:13:45.393345 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:13:45.393615 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:13:45.404557 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:13:45.404557 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:45.408893 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:13:45.408893 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:45.415822 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c] added
May 21 02:13:45.415822 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:13:45.415822 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:13:45.415822 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:13:45.415822 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:13:45.415822 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:13:45.415822 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:45.416064 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:13:45.416116 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0232(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:13:45.416250 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:13:45.420155 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c] added
May 21 02:13:45.420155 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:13:45.420155 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:13:45.420155 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:13:45.420155 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:13:45.420155 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:13:45.420155 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:45.420344 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:13:45.420498 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0269(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:13:45.420678 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:13:45.482831 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:13:45.484484 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:13:45.486190 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:13:45.486309 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Claim successful on node np0000001127
May 21 02:13:45.720699 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-0e112255-e064-41b5-b7ea-0b24fa3124b1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Took 1.35 seconds to destroy the instance on the hypervisor.
May 21 02:13:45.721273 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-0e112255-e064-41b5-b7ea-0b24fa3124b1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:13:45.721561 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:13:45.721658 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:13:45.721870 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:13:45.824158 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:13:46.187205 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-98b1fa26-a455-4a4f-a7ae-e62b6eb00cb2 req-c4df8293-0962-47df-96b2-cd622aca335f service nova] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Received event network-vif-deleted-e2e50f9d-813b-4414-bf68-0a2b7f8136a7 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:13:46.187693 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-98b1fa26-a455-4a4f-a7ae-e62b6eb00cb2 req-c4df8293-0962-47df-96b2-cd622aca335f service nova] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Neutron deleted interface e2e50f9d-813b-4414-bf68-0a2b7f8136a7; detaching it from the instance and deleting it from the info cache
May 21 02:13:46.187830 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-98b1fa26-a455-4a4f-a7ae-e62b6eb00cb2 req-c4df8293-0962-47df-96b2-cd622aca335f service nova] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:13:46.416910 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:13:46.421016 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:13:46.429244 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:13:46.429244 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:13:46.434293 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:13:46.434293 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:46.441154 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:46.448592 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:46.453555 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5de6f5b1-5f12-4c57-be8b-307dee81160a (non-flash)
May 21 02:13:46.453555 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:13:46.453731 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5de6f5b1-5f12-4c57-be8b-307dee81160a (non-flash)
May 21 02:13:46.453731 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:13:46.461511 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5de6f5b1-5f12-4c57-be8b-307dee81160a (non-flash)
May 21 02:13:46.461511 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:13:46.461511 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5de6f5b1-5f12-4c57-be8b-307dee81160a (non-flash)
May 21 02:13:46.461511 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:13:46.496933 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c, portal: 192.168.50.100,3260]
May 21 02:13:46.496933 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c, portal: 192.168.50.100,3260] successful.
May 21 02:13:46.496933 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:46.509946 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:46.515362 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c, portal: 192.168.40.100,3260]
May 21 02:13:46.515362 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c, portal: 192.168.40.100,3260] successful.
May 21 02:13:46.515362 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:46.526755 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:46.527715 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5de6f5b1-5f12-4c57-be8b-307dee81160a (non-flash)
May 21 02:13:46.527715 np0000001127 nova-compute[98206]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:13:46.527715 np0000001127 nova-compute[98206]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:13:46.527715 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:13:46.527715 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5de6f5b1-5f12-4c57-be8b-307dee81160a (non-flash)
May 21 02:13:46.527715 np0000001127 nova-compute[98206]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:13:46.527715 np0000001127 nova-compute[98206]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:13:46.527715 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:13:46.527715 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.135s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:13:46.528073 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:13:46.528538 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] HCTL ('8', '-', '-', 0) found on session 197 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:13:46.528722 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:13:46.546488 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5de6f5b1-5f12-4c57-be8b-307dee81160a (non-flash)
May 21 02:13:46.546488 np0000001127 nova-compute[98206]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:13:46.546488 np0000001127 nova-compute[98206]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:13:46.546488 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:13:46.546776 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5de6f5b1-5f12-4c57-be8b-307dee81160a (non-flash)
May 21 02:13:46.546776 np0000001127 nova-compute[98206]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:13:46.546776 np0000001127 nova-compute[98206]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:13:46.546776 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:13:46.547017 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.154s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:13:46.547125 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:13:46.547791 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Searching for a device in session 197 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:13:46.548023 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2853aa4f-6782-4643-acd0-fbaa302aca4c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:13:46.548734 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] HCTL ('9', '-', '-', 0) found on session 198 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:13:46.548734 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:13:46.561955 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Searching for a device in session 198 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:13:46.562258 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2853aa4f-6782-4643-acd0-fbaa302aca4c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:13:46.602803 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-baa7df49-9b58-47e9-b354-83a61b0c4897 req-f31aed49-7615-42c0-82a4-13c9308e5006 service nova] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Received event network-vif-unplugged-e2e50f9d-813b-4414-bf68-0a2b7f8136a7 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:13:46.604522 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-baa7df49-9b58-47e9-b354-83a61b0c4897 req-f31aed49-7615-42c0-82a4-13c9308e5006 service nova] Acquiring lock "c0628f73-e084-479c-8ecd-721fc26c39fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:13:46.604522 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-baa7df49-9b58-47e9-b354-83a61b0c4897 req-f31aed49-7615-42c0-82a4-13c9308e5006 service nova] Lock "c0628f73-e084-479c-8ecd-721fc26c39fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:13:46.604709 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-baa7df49-9b58-47e9-b354-83a61b0c4897 req-f31aed49-7615-42c0-82a4-13c9308e5006 service nova] Lock "c0628f73-e084-479c-8ecd-721fc26c39fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:13:46.604780 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-baa7df49-9b58-47e9-b354-83a61b0c4897 req-f31aed49-7615-42c0-82a4-13c9308e5006 service nova] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] No waiting events found dispatching network-vif-unplugged-e2e50f9d-813b-4414-bf68-0a2b7f8136a7 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:13:46.604938 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-baa7df49-9b58-47e9-b354-83a61b0c4897 req-f31aed49-7615-42c0-82a4-13c9308e5006 service nova] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Received event network-vif-unplugged-e2e50f9d-813b-4414-bf68-0a2b7f8136a7 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:13:46.645501 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:13:46.667999 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:13:46.668174 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:13:46.694442 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-98b1fa26-a455-4a4f-a7ae-e62b6eb00cb2 req-c4df8293-0962-47df-96b2-cd622aca335f service nova] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Detach interface failed, port_id=e2e50f9d-813b-4414-bf68-0a2b7f8136a7, reason: Instance c0628f73-e084-479c-8ecd-721fc26c39fb could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:13:47.146577 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Took 1.42 seconds to deallocate network for instance.
May 21 02:13:47.171206 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:13:47.394003 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:13:47.651820 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0e112255-e064-41b5-b7ea-0b24fa3124b1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:13:47.677999 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.195s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:13:47.678489 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0e112255-e064-41b5-b7ea-0b24fa3124b1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.027s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:13:47.678646 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:13:47.846736 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-0e112255-e064-41b5-b7ea-0b24fa3124b1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:13:47.846943 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-0e112255-e064-41b5-b7ea-0b24fa3124b1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:13:48.186878 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:13:48.187174 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:13:48.187398 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:13:48.187633 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:13:48.250447 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4878b5a5bf184852a9ce383caa1c67a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ebdb16aee84e22a88dfc8960debd32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:13:48.349530 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-0e112255-e064-41b5-b7ea-0b24fa3124b1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:13:48.410902 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Found WWN 330000000e6cb27eb for multipath device dm-0 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:13:48.411134 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:13:48.412036 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] <== connect_volume: return (3783ms) {'type': 'block', 'scsi_wwn': '330000000e6cb27eb', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000e6cb27eb'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:13:48.412181 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e6cb27eb', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000e6cb27eb'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:13:48.442889 np0000001127 nova-compute[98206]: DEBUG os_brick.encryptors [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c', 'iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2853aa4f-6782-4643-acd0-fbaa302aca4c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc', 'attached_at': '', 'detached_at': '', 'volume_id': '2853aa4f-6782-4643-acd0-fbaa302aca4c', 'serial': '2853aa4f-6782-4643-acd0-fbaa302aca4c'} {{(pid=98206) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 21 02:13:48.442889 np0000001127 nova-compute[98206]: WARNING stevedore.named [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 21 02:13:48.442889 np0000001127 nova-compute[98206]: WARNING castellan.key_manager [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 21 02:13:48.443085 np0000001127 nova-compute[98206]: WARNING nova.keymgr.conf_key_mgr [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 21 02:13:48.490983 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Secret XML: <secret ephemeral="no" private="no">
May 21 02:13:48.490983 np0000001127 nova-compute[98206]:   <usage type="volume">
May 21 02:13:48.490983 np0000001127 nova-compute[98206]:     <volume>2853aa4f-6782-4643-acd0-fbaa302aca4c</volume>
May 21 02:13:48.490983 np0000001127 nova-compute[98206]:   </usage>
May 21 02:13:48.490983 np0000001127 nova-compute[98206]: </secret>
May 21 02:13:48.490983 np0000001127 nova-compute[98206]:  {{(pid=98206) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 21 02:13:48.638127 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Successfully created port: 4177dd83-8ee3-4a16-8fa6-55e0b202f779 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:13:48.689709 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:13:48.860355 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0e112255-e064-41b5-b7ea-0b24fa3124b1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.182s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:13:48.905253 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-0e112255-e064-41b5-b7ea-0b24fa3124b1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Deleted allocations for instance c0628f73-e084-479c-8ecd-721fc26c39fb
May 21 02:13:49.001602 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:13:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-773217921',display_name='tempest-TestEncryptedCinderVolumes-server-773217921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testencryptedcindervolumes-server-773217921',id=76,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAhkQbp5kMwPyRYbKzXvFue4B05DSWlMs4KXDTXsTygnB2TWy+kt4GBTiDM8LiCQTVRBWYkE1itG7K2+H6oL5C/hvlsCCr+Z7SvxCHUYwFWVcZ1ePW8nLfDe4MI4Yf/Uw==',key_name='tempest-TestEncryptedCinderVolumes-618034694',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='517a45856efe44aa92f802f146b17616',ramdisk_id='',reservation_id='r-8biivubf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1523380334',owner_user_name='tempest-TestEncryptedCinderVolumes-1523380334-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:13:42Z,user_data=None,user_id='68fd64fea5a84a0bbb1d09de7d76709c',uuid=8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21c89916-bd00-43b3-bfc9-b1ec22cc08bf", "address": "fa:16:3e:86:bf:a0", "network": {"id": "68132179-7a2d-4b6f-bc7a-da8f937a9fb2", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1224285668-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "517a45856efe44aa92f802f146b17616", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c89916-bd", "ovs_interfaceid": "21c89916-bd00-43b3-bfc9-b1ec22cc08bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:13:49.001602 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Converting VIF {"id": "21c89916-bd00-43b3-bfc9-b1ec22cc08bf", "address": "fa:16:3e:86:bf:a0", "network": {"id": "68132179-7a2d-4b6f-bc7a-da8f937a9fb2", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1224285668-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "517a45856efe44aa92f802f146b17616", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c89916-bd", "ovs_interfaceid": "21c89916-bd00-43b3-bfc9-b1ec22cc08bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:13:49.001602 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:bf:a0,bridge_name='br-int',has_traffic_filtering=True,id=21c89916-bd00-43b3-bfc9-b1ec22cc08bf,network=Network(68132179-7a2d-4b6f-bc7a-da8f937a9fb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21c89916-bd') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:13:49.001602 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lazy-loading 'pci_devices' on Instance uuid 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:13:49.075741 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Successfully updated port: 4177dd83-8ee3-4a16-8fa6-55e0b202f779 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:13:49.120131 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bf6f0099-1ff3-49bd-9308-aceb5c3e615a req-72bab362-0ea7-4682-8d73-4f6804e6d3b9 service nova] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Received event network-changed-4177dd83-8ee3-4a16-8fa6-55e0b202f779 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:13:49.120552 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-bf6f0099-1ff3-49bd-9308-aceb5c3e615a req-72bab362-0ea7-4682-8d73-4f6804e6d3b9 service nova] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Refreshing instance network info cache due to event network-changed-4177dd83-8ee3-4a16-8fa6-55e0b202f779. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:13:49.120723 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bf6f0099-1ff3-49bd-9308-aceb5c3e615a req-72bab362-0ea7-4682-8d73-4f6804e6d3b9 service nova] Acquiring lock "refresh_cache-fc403327-070b-4e21-b046-40c4160ee52b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:13:49.120855 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bf6f0099-1ff3-49bd-9308-aceb5c3e615a req-72bab362-0ea7-4682-8d73-4f6804e6d3b9 service nova] Acquired lock "refresh_cache-fc403327-070b-4e21-b046-40c4160ee52b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:13:49.120939 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-bf6f0099-1ff3-49bd-9308-aceb5c3e615a req-72bab362-0ea7-4682-8d73-4f6804e6d3b9 service nova] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Refreshing network info cache for port 4177dd83-8ee3-4a16-8fa6-55e0b202f779 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:13:49.177419 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0006208140002854634 future=<Future at 0x71c0586b9070 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:13:49.177572 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:13:49.177629 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=10.521270875000027 future=<Future at 0x71c05858de80 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:13:49.177730 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=10.521178613999837 future=<Future at 0x71c05858de80 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:13:49.178191 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Emitting event <LifecycleEvent: 1779329614.1766465, a9044351-f5a8-4e38-976c-24db83b046d1 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:13:49.178404 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] VM Stopped (Lifecycle Event)
May 21 02:13:49.196189 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:13:49.503602 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] End _get_guest_xml xml=<domain type="qemu">
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:   <uuid>8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc</uuid>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:   <name>instance-0000004c</name>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-773217921</nova:name>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:13:44</nova:creationTime>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:       <nova:image uuid="">
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:         <nova:user uuid="68fd64fea5a84a0bbb1d09de7d76709c">tempest-TestEncryptedCinderVolumes-1523380334-project-member</nova:user>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:         <nova:project uuid="517a45856efe44aa92f802f146b17616">tempest-TestEncryptedCinderVolumes-1523380334</nova:project>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:       <nova:root type="volume" uuid=""/>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:         <nova:port uuid="21c89916-bd00-43b3-bfc9-b1ec22cc08bf">
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:     <system>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:       <entry name="serial">8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc</entry>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:       <entry name="uuid">8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc</entry>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:     </system>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:   <os>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:   </os>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:   <features>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:   </features>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:   <devices>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc/disk.config"/>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:     </disk>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:       <alias name="ua-2853aa4f-6782-4643-acd0-fbaa302aca4c"/>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:       <serial>2853aa4f-6782-4643-acd0-fbaa302aca4c</serial>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:       <encryption format="luks">
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:         <secret type="passphrase" uuid="c14b97eb-42f8-4641-96ad-aa15ba28c27c"/>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:       </encryption>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:     </disk>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:86:bf:a0"/>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:       <target dev="tap21c89916-bd"/>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:     </interface>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc/console.log" append="off"/>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:     </serial>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:     <video>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:     </video>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:     </rng>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:   </devices>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]: </domain>
May 21 02:13:49.503602 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:13:49.505569 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Preparing to wait for external event network-vif-plugged-21c89916-bd00-43b3-bfc9-b1ec22cc08bf {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:13:49.505569 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:13:49.505569 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:13:49.505569 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:13:49.505569 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:13:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-773217921',display_name='tempest-TestEncryptedCinderVolumes-server-773217921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testencryptedcindervolumes-server-773217921',id=76,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAhkQbp5kMwPyRYbKzXvFue4B05DSWlMs4KXDTXsTygnB2TWy+kt4GBTiDM8LiCQTVRBWYkE1itG7K2+H6oL5C/hvlsCCr+Z7SvxCHUYwFWVcZ1ePW8nLfDe4MI4Yf/Uw==',key_name='tempest-TestEncryptedCinderVolumes-618034694',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='517a45856efe44aa92f802f146b17616',ramdisk_id='',reservation_id='r-8biivubf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1523380334',owner_user_name='tempest-TestEncryptedCinderVolumes-1523380334-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:13:42Z,user_data=None,user_id='68fd64fea5a84a0bbb1d09de7d76709c',uuid=8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21c89916-bd00-43b3-bfc9-b1ec22cc08bf", "address": "fa:16:3e:86:bf:a0", "network": {"id": "68132179-7a2d-4b6f-bc7a-da8f937a9fb2", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1224285668-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "517a45856efe44aa92f802f146b17616", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c89916-bd", "ovs_interfaceid": "21c89916-bd00-43b3-bfc9-b1ec22cc08bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:13:49.505569 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Converting VIF {"id": "21c89916-bd00-43b3-bfc9-b1ec22cc08bf", "address": "fa:16:3e:86:bf:a0", "network": {"id": "68132179-7a2d-4b6f-bc7a-da8f937a9fb2", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1224285668-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "517a45856efe44aa92f802f146b17616", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c89916-bd", "ovs_interfaceid": "21c89916-bd00-43b3-bfc9-b1ec22cc08bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:13:49.505882 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:bf:a0,bridge_name='br-int',has_traffic_filtering=True,id=21c89916-bd00-43b3-bfc9-b1ec22cc08bf,network=Network(68132179-7a2d-4b6f-bc7a-da8f937a9fb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21c89916-bd') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:13:49.506110 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:bf:a0,bridge_name='br-int',has_traffic_filtering=True,id=21c89916-bd00-43b3-bfc9-b1ec22cc08bf,network=Network(68132179-7a2d-4b6f-bc7a-da8f937a9fb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21c89916-bd') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:13:49.506776 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:49.506933 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:13:49.507086 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:13:49.507583 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:49.507785 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dedc107a-b408-5b29-a566-92d1a64d4e16', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:13:49.508453 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:49.509326 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:13:49.509625 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:49.511886 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:49.511886 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21c89916-bd, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:13:49.511886 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap21c89916-bd, col_values=(('qos', UUID('d460b09a-05a2-4dd2-84ff-96894f96b0d1')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:13:49.511886 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap21c89916-bd, col_values=(('external_ids', {'iface-id': '21c89916-bd00-43b3-bfc9-b1ec22cc08bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:bf:a0', 'vm-uuid': '8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:13:49.529320 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:49.531477 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:13:49.534838 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:49.535910 np0000001127 nova-compute[98206]: INFO os_vif [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:bf:a0,bridge_name='br-int',has_traffic_filtering=True,id=21c89916-bd00-43b3-bfc9-b1ec22cc08bf,network=Network(68132179-7a2d-4b6f-bc7a-da8f937a9fb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21c89916-bd')
May 21 02:13:49.577676 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "refresh_cache-fc403327-070b-4e21-b046-40c4160ee52b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:13:49.622959 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-bf6f0099-1ff3-49bd-9308-aceb5c3e615a req-72bab362-0ea7-4682-8d73-4f6804e6d3b9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:13:49.681202 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-bf6f0099-1ff3-49bd-9308-aceb5c3e615a req-72bab362-0ea7-4682-8d73-4f6804e6d3b9 service nova] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:13:49.683576 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: a9044351-f5a8-4e38-976c-24db83b046d1] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:13:49.704303 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Booting with volume 9d5afcec-79b5-422e-ab0c-5c33fa118ca1 at /dev/vda
May 21 02:13:49.742924 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:13:49.754136 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:13:49.778435 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:13:49.808048 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-bf6f0099-1ff3-49bd-9308-aceb5c3e615a req-72bab362-0ea7-4682-8d73-4f6804e6d3b9 service nova] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:13:49.833479 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:13:49.833685 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:13:49.843961 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:13:49.844762 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c'] 
May 21 02:13:49.844898 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:13:49.844998 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:13:49.845204 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] <== get_connector_properties: return (102ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:13:49.845380 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Updating existing volume attachment record: fa139dc7-085a-4fba-be12-c8510d622bd6 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:13:49.914987 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-0e112255-e064-41b5-b7ea-0b24fa3124b1 tempest-VolumesExtendAttachedTest-2003688561 tempest-VolumesExtendAttachedTest-2003688561-project-member] Lock "c0628f73-e084-479c-8ecd-721fc26c39fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.050s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:13:50.312213 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-bf6f0099-1ff3-49bd-9308-aceb5c3e615a req-72bab362-0ea7-4682-8d73-4f6804e6d3b9 service nova] Releasing lock "refresh_cache-fc403327-070b-4e21-b046-40c4160ee52b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:13:50.312680 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquired lock "refresh_cache-fc403327-070b-4e21-b046-40c4160ee52b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:13:50.312757 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:13:50.870432 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:13:51.012914 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:13:51.055718 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:13:51.055897 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:13:51.056088 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] No VIF found with MAC fa:16:3e:86:bf:a0, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:13:51.056733 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Using config drive
May 21 02:13:51.146814 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Updating instance_info_cache with network_info: [{"id": "4177dd83-8ee3-4a16-8fa6-55e0b202f779", "address": "fa:16:3e:0e:cf:bf", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4177dd83-8e", "ovs_interfaceid": "4177dd83-8ee3-4a16-8fa6-55e0b202f779", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:13:51.564951 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:13:51.652156 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Releasing lock "refresh_cache-fc403327-070b-4e21-b046-40c4160ee52b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:13:51.652448 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Instance network_info: |[{"id": "4177dd83-8ee3-4a16-8fa6-55e0b202f779", "address": "fa:16:3e:0e:cf:bf", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4177dd83-8e", "ovs_interfaceid": "4177dd83-8ee3-4a16-8fa6-55e0b202f779", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:13:51.682511 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Creating config drive at /opt/stack/data/nova/instances/8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc/disk.config
May 21 02:13:51.685412 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpq7er93bw {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:13:51.739803 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpq7er93bw" returned: 0 in 0.054s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:13:51.948775 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:13:51.949958 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:13:51.950165 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Creating image(s)
May 21 02:13:51.950618 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Did not create local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 21 02:13:51.950744 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Ensure instance console log exists: /opt/stack/data/nova/instances/fc403327-070b-4e21-b046-40c4160ee52b/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:13:51.950993 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:13:51.951202 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:13:51.951331 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:13:51.951835 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Start _get_guest_xml network_info=[{"id": "4177dd83-8ee3-4a16-8fa6-55e0b202f779", "address": "fa:16:3e:0e:cf:bf", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4177dd83-8e", "ovs_interfaceid": "4177dd83-8ee3-4a16-8fa6-55e0b202f779", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'fc403327-070b-4e21-b046-40c4160ee52b', 'attached_at': '', 'detached_at': '', 'volume_id': '9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 'serial': '9d5afcec-79b5-422e-ab0c-5c33fa118ca1'}, 'delete_on_termination': False, 'attachment_id': 'fa139dc7-085a-4fba-be12-c8510d622bd6', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:13:51.955634 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:13:51.957084 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1007147888', uuid='fc403327-070b-4e21-b046-40c4160ee52b'), owner=OwnerMeta(userid='4878b5a5bf184852a9ce383caa1c67a4', username='tempest-TestVolumeBootPattern-1995806391-project-member', projectid='62ebdb16aee84e22a88dfc8960debd32', projectname='tempest-TestVolumeBootPattern-1995806391'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4177dd83-8ee3-4a16-8fa6-55e0b202f779", "address": "fa:16:3e:0e:cf:bf", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4177dd83-8e", "ovs_interfaceid": "4177dd83-8ee3-4a16-8fa6-55e0b202f779", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329631.9566817) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:13:51.958369 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:13:51.958695 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:13:51.963021 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:13:51.963798 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:13:51.964570 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:13:51.965001 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:13:51.965198 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:13:51.965339 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:13:51.965538 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:13:51.965677 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:13:51.968810 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:13:51.969056 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:13:51.969276 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:13:51.969404 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:13:51.969519 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:13:51.969637 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:13:51.979487 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:13:51.979821 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:13:51.980033 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:13:51.980389 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:13:51.980579 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:13:51.995186 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:13:51.995662 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:13:51.996236 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:13:51.996480 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:13:51.996746 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:13:51.996910 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:13:52.012490 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:13:52.012490 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:52.015102 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:13:52.015102 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:52.022132 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1] added
May 21 02:13:52.022132 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:13:52.022132 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:13:52.022132 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:13:52.022132 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:13:52.022132 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:13:52.022132 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:52.022377 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:13:52.022516 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.026(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:13:52.022668 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:13:52.028062 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1] added
May 21 02:13:52.028062 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:13:52.028062 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:13:52.028062 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:13:52.028062 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:13:52.028062 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:13:52.028062 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:52.028227 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:13:52.028344 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0314(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:13:52.028515 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:13:52.143783 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:52.167651 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:52.269767 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:52.274226 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:52.351902 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-ac84f32a-079f-44ae-940c-d88e35ab554d req-78989444-b02d-4390-8c9b-16f02bd230f1 service nova] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Received event network-vif-plugged-21c89916-bd00-43b3-bfc9-b1ec22cc08bf {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:13:52.352179 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ac84f32a-079f-44ae-940c-d88e35ab554d req-78989444-b02d-4390-8c9b-16f02bd230f1 service nova] Acquiring lock "8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:13:52.352363 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ac84f32a-079f-44ae-940c-d88e35ab554d req-78989444-b02d-4390-8c9b-16f02bd230f1 service nova] Lock "8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:13:52.352532 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ac84f32a-079f-44ae-940c-d88e35ab554d req-78989444-b02d-4390-8c9b-16f02bd230f1 service nova] Lock "8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:13:52.352726 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-ac84f32a-079f-44ae-940c-d88e35ab554d req-78989444-b02d-4390-8c9b-16f02bd230f1 service nova] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Processing event network-vif-plugged-21c89916-bd00-43b3-bfc9-b1ec22cc08bf {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:13:52.491187 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:52.499904 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:52.501615 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:52.503819 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:52.525623 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:53.023076 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:13:53.028924 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:13:53.036303 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:13:53.036303 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:13:53.042271 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:13:53.042271 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:53.050534 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:53.059458 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:53.068351 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5de6f5b1-5f12-4c57-be8b-307dee81160a (non-flash)
May 21 02:13:53.068351 np0000001127 nova-compute[98206]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:13:53.068351 np0000001127 nova-compute[98206]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:13:53.068351 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:13:53.068614 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5de6f5b1-5f12-4c57-be8b-307dee81160a (non-flash)
May 21 02:13:53.068614 np0000001127 nova-compute[98206]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:13:53.068614 np0000001127 nova-compute[98206]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:13:53.068614 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:13:53.077821 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5de6f5b1-5f12-4c57-be8b-307dee81160a (non-flash)
May 21 02:13:53.077821 np0000001127 nova-compute[98206]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:13:53.077821 np0000001127 nova-compute[98206]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:13:53.077821 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:13:53.078040 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5de6f5b1-5f12-4c57-be8b-307dee81160a (non-flash)
May 21 02:13:53.078040 np0000001127 nova-compute[98206]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:13:53.078040 np0000001127 nova-compute[98206]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:13:53.078040 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:13:53.103712 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1, portal: 192.168.50.100,3260]
May 21 02:13:53.103712 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1, portal: 192.168.50.100,3260] successful.
May 21 02:13:53.103712 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:53.117341 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:53.124374 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1, portal: 192.168.40.100,3260]
May 21 02:13:53.124374 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1, portal: 192.168.40.100,3260] successful.
May 21 02:13:53.124374 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:53.134007 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5de6f5b1-5f12-4c57-be8b-307dee81160a (non-flash)
May 21 02:13:53.134007 np0000001127 nova-compute[98206]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:13:53.134007 np0000001127 nova-compute[98206]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:13:53.134007 np0000001127 nova-compute[98206]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:13:53.134007 np0000001127 nova-compute[98206]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:13:53.134007 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:13:53.134222 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5de6f5b1-5f12-4c57-be8b-307dee81160a (non-flash)
May 21 02:13:53.134222 np0000001127 nova-compute[98206]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:13:53.134222 np0000001127 nova-compute[98206]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:13:53.134222 np0000001127 nova-compute[98206]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:13:53.134222 np0000001127 nova-compute[98206]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:13:53.134222 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:13:53.134382 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.138s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:13:53.134527 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:13:53.135280 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] HCTL ('10', '-', '-', 0) found on session 199 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:13:53.135383 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:13:53.140282 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:13:53.155564 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching for a device in session 199 and hctl ['10', '*', '*', 0] yield: None {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:13:53.159303 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5de6f5b1-5f12-4c57-be8b-307dee81160a (non-flash)
May 21 02:13:53.159303 np0000001127 nova-compute[98206]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:13:53.159303 np0000001127 nova-compute[98206]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:13:53.159303 np0000001127 nova-compute[98206]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:13:53.159303 np0000001127 nova-compute[98206]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:13:53.159303 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:13:53.159545 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5de6f5b1-5f12-4c57-be8b-307dee81160a (non-flash)
May 21 02:13:53.159545 np0000001127 nova-compute[98206]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:13:53.159545 np0000001127 nova-compute[98206]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:13:53.159545 np0000001127 nova-compute[98206]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:13:53.159545 np0000001127 nova-compute[98206]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:13:53.159545 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:13:53.159843 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:13:53.160017 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:13:53.160942 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] HCTL ('11', '-', '-', 0) found on session 200 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:13:53.161081 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:13:53.180736 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching for a device in session 200 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:13:53.180917 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:13:53.946767 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329633.9462981, 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:13:53.947365 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:13:53.947628 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] VM Started (Lifecycle Event)
May 21 02:13:53.949644 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:13:53.955092 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Instance spawned successfully.
May 21 02:13:53.955917 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:13:54.156366 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching for a device in session 199 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:13:54.156366 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:13:54.437580 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7aa7bf24-0eee-4b59-a0cc-3f57ae9bc93f req-70f9bdcd-82b8-4a8d-a4dc-713aabb640e8 service nova] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Received event network-vif-plugged-21c89916-bd00-43b3-bfc9-b1ec22cc08bf {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:13:54.437802 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7aa7bf24-0eee-4b59-a0cc-3f57ae9bc93f req-70f9bdcd-82b8-4a8d-a4dc-713aabb640e8 service nova] Acquiring lock "8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:13:54.437958 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7aa7bf24-0eee-4b59-a0cc-3f57ae9bc93f req-70f9bdcd-82b8-4a8d-a4dc-713aabb640e8 service nova] Lock "8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:13:54.438067 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-7aa7bf24-0eee-4b59-a0cc-3f57ae9bc93f req-70f9bdcd-82b8-4a8d-a4dc-713aabb640e8 service nova] Lock "8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:13:54.438211 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-7aa7bf24-0eee-4b59-a0cc-3f57ae9bc93f req-70f9bdcd-82b8-4a8d-a4dc-713aabb640e8 service nova] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] No waiting events found dispatching network-vif-plugged-21c89916-bd00-43b3-bfc9-b1ec22cc08bf {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:13:54.438344 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-7aa7bf24-0eee-4b59-a0cc-3f57ae9bc93f req-70f9bdcd-82b8-4a8d-a4dc-713aabb640e8 service nova] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Received unexpected event network-vif-plugged-21c89916-bd00-43b3-bfc9-b1ec22cc08bf for instance with vm_state building and task_state spawning.
May 21 02:13:54.450814 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:13:54.453454 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:13:54.461096 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:13:54.461218 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:13:54.461481 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:13:54.461698 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:13:54.462047 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:13:54.462376 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:13:54.505663 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:54.529000 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:54.955392 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:13:54.955876 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329634.955625, 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:13:54.956017 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] VM Paused (Lifecycle Event)
May 21 02:13:54.968654 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Took 10.36 seconds to spawn the instance on the hypervisor.
May 21 02:13:54.969279 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:13:55.015943 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Found WWN 330000000fac56fe1 for multipath device dm-1 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:13:55.016214 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:13:55.016372 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '330000000fac56fe1', 'path': '/dev/dm-1', 'multipath_id': '330000000fac56fe1'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:13:55.016509 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000fac56fe1', 'path': '/dev/dm-1', 'multipath_id': '330000000fac56fe1'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:13:55.182015 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:13:55.182527 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.49 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:13:55.458377 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:13:55.461230 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329635.460777, 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:13:55.461230 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] VM Resumed (Lifecycle Event)
May 21 02:13:55.483481 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Took 17.51 seconds to build instance.
May 21 02:13:55.522081 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:13:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1007147888',display_name='tempest-TestVolumeBootPattern-server-1007147888',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpattern-server-1007147888',id=77,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz/RBMCwKlZOoLdoqf7XbPge9tLmyY1xo5VJlB0SNDPLDIqYhv6bRKRrq1AOl4f0antvHh+zaNlybPqLYJXPC6E7cTtqubsCy3OHGbekTwncuW9Nfz1O6qOo+1iMsXADw==',key_name='tempest-TestVolumeBootPattern-2024297378',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62ebdb16aee84e22a88dfc8960debd32',ramdisk_id='',reservation_id='r-ut2txkgj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1995806391',owner_user_name='tempest-TestVolumeBootPattern-1995806391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:13:49Z,user_data=None,user_id='4878b5a5bf184852a9ce383caa1c67a4',uuid=fc403327-070b-4e21-b046-40c4160ee52b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4177dd83-8ee3-4a16-8fa6-55e0b202f779", "address": "fa:16:3e:0e:cf:bf", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4177dd83-8e", "ovs_interfaceid": "4177dd83-8ee3-4a16-8fa6-55e0b202f779", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:13:55.522305 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converting VIF {"id": "4177dd83-8ee3-4a16-8fa6-55e0b202f779", "address": "fa:16:3e:0e:cf:bf", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4177dd83-8e", "ovs_interfaceid": "4177dd83-8ee3-4a16-8fa6-55e0b202f779", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:13:55.523142 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:cf:bf,bridge_name='br-int',has_traffic_filtering=True,id=4177dd83-8ee3-4a16-8fa6-55e0b202f779,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4177dd83-8e') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:13:55.523936 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lazy-loading 'pci_devices' on Instance uuid fc403327-070b-4e21-b046-40c4160ee52b {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:13:55.964259 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:13:55.966063 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:13:55.984874 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-caa8e3da-cba9-4535-a587-97cd72e50eb9 tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.015s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:13:56.026435 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] End _get_guest_xml xml=<domain type="qemu">
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:   <uuid>fc403327-070b-4e21-b046-40c4160ee52b</uuid>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:   <name>instance-0000004d</name>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:       <nova:name>tempest-TestVolumeBootPattern-server-1007147888</nova:name>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:13:51</nova:creationTime>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:       <nova:image uuid="">
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:         <nova:user uuid="4878b5a5bf184852a9ce383caa1c67a4">tempest-TestVolumeBootPattern-1995806391-project-member</nova:user>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:         <nova:project uuid="62ebdb16aee84e22a88dfc8960debd32">tempest-TestVolumeBootPattern-1995806391</nova:project>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:       <nova:root type="volume" uuid=""/>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:         <nova:port uuid="4177dd83-8ee3-4a16-8fa6-55e0b202f779">
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:     <system>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:       <entry name="serial">fc403327-070b-4e21-b046-40c4160ee52b</entry>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:       <entry name="uuid">fc403327-070b-4e21-b046-40c4160ee52b</entry>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:     </system>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:   <os>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:   </os>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:   <features>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:   </features>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:   <devices>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/fc403327-070b-4e21-b046-40c4160ee52b/disk.config"/>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:     </disk>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:       <alias name="ua-9d5afcec-79b5-422e-ab0c-5c33fa118ca1"/>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-1"/>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:       <serial>9d5afcec-79b5-422e-ab0c-5c33fa118ca1</serial>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:     </disk>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:0e:cf:bf"/>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:       <target dev="tap4177dd83-8e"/>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:     </interface>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/fc403327-070b-4e21-b046-40c4160ee52b/console.log" append="off"/>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:     </serial>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:     <video>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:     </video>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:     </rng>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:   </devices>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]: </domain>
May 21 02:13:56.026435 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:13:56.028309 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Preparing to wait for external event network-vif-plugged-4177dd83-8ee3-4a16-8fa6-55e0b202f779 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:13:56.028309 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "fc403327-070b-4e21-b046-40c4160ee52b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:13:56.028309 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "fc403327-070b-4e21-b046-40c4160ee52b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:13:56.028309 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "fc403327-070b-4e21-b046-40c4160ee52b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:13:56.028309 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:13:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1007147888',display_name='tempest-TestVolumeBootPattern-server-1007147888',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpattern-server-1007147888',id=77,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz/RBMCwKlZOoLdoqf7XbPge9tLmyY1xo5VJlB0SNDPLDIqYhv6bRKRrq1AOl4f0antvHh+zaNlybPqLYJXPC6E7cTtqubsCy3OHGbekTwncuW9Nfz1O6qOo+1iMsXADw==',key_name='tempest-TestVolumeBootPattern-2024297378',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62ebdb16aee84e22a88dfc8960debd32',ramdisk_id='',reservation_id='r-ut2txkgj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1995806391',owner_user_name='tempest-TestVolumeBootPattern-1995806391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:13:49Z,user_data=None,user_id='4878b5a5bf184852a9ce383caa1c67a4',uuid=fc403327-070b-4e21-b046-40c4160ee52b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4177dd83-8ee3-4a16-8fa6-55e0b202f779", "address": "fa:16:3e:0e:cf:bf", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4177dd83-8e", "ovs_interfaceid": "4177dd83-8ee3-4a16-8fa6-55e0b202f779", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:13:56.028309 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converting VIF {"id": "4177dd83-8ee3-4a16-8fa6-55e0b202f779", "address": "fa:16:3e:0e:cf:bf", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4177dd83-8e", "ovs_interfaceid": "4177dd83-8ee3-4a16-8fa6-55e0b202f779", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:13:56.028309 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:cf:bf,bridge_name='br-int',has_traffic_filtering=True,id=4177dd83-8ee3-4a16-8fa6-55e0b202f779,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4177dd83-8e') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:13:56.028717 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:cf:bf,bridge_name='br-int',has_traffic_filtering=True,id=4177dd83-8ee3-4a16-8fa6-55e0b202f779,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4177dd83-8e') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:13:56.029136 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:56.029413 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:13:56.029663 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:13:56.030242 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:56.030442 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ca6a2b7a-d154-5523-8967-07d4edee2899', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:13:56.032150 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:56.033016 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:13:56.034559 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:56.035562 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4177dd83-8e, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:13:56.035894 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4177dd83-8e, col_values=(('qos', UUID('babd0b34-9404-4db2-81db-b083ec786305')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:13:56.036070 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4177dd83-8e, col_values=(('external_ids', {'iface-id': '4177dd83-8ee3-4a16-8fa6-55e0b202f779', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:cf:bf', 'vm-uuid': 'fc403327-070b-4e21-b046-40c4160ee52b'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:13:56.037806 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:56.038891 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:13:56.042217 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:56.043076 np0000001127 nova-compute[98206]: INFO os_vif [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:cf:bf,bridge_name='br-int',has_traffic_filtering=True,id=4177dd83-8ee3-4a16-8fa6-55e0b202f779,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4177dd83-8e')
May 21 02:13:56.676346 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:13:56.676792 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:13:56.676792 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 21 02:13:56.677967 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:13:57.079206 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:57.558451 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:13:57.559003 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:13:57.559966 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] No VIF found with MAC fa:16:3e:0e:cf:bf, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:13:57.559966 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Using config drive
May 21 02:13:57.633529 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-9968d5b6-a5a5-4a18-be72-33c4987b52da req-8713419a-d8c9-46ec-a2cb-75d34ab55b8d service nova] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Received event network-changed-21c89916-bd00-43b3-bfc9-b1ec22cc08bf {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:13:57.633657 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-9968d5b6-a5a5-4a18-be72-33c4987b52da req-8713419a-d8c9-46ec-a2cb-75d34ab55b8d service nova] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Refreshing instance network info cache due to event network-changed-21c89916-bd00-43b3-bfc9-b1ec22cc08bf. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:13:57.633971 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-9968d5b6-a5a5-4a18-be72-33c4987b52da req-8713419a-d8c9-46ec-a2cb-75d34ab55b8d service nova] Acquiring lock "refresh_cache-8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:13:57.633971 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-9968d5b6-a5a5-4a18-be72-33c4987b52da req-8713419a-d8c9-46ec-a2cb-75d34ab55b8d service nova] Acquired lock "refresh_cache-8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:13:57.634081 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-9968d5b6-a5a5-4a18-be72-33c4987b52da req-8713419a-d8c9-46ec-a2cb-75d34ab55b8d service nova] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Refreshing network info cache for port 21c89916-bd00-43b3-bfc9-b1ec22cc08bf {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:13:58.064773 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:13:58.135948 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-9968d5b6-a5a5-4a18-be72-33c4987b52da req-8713419a-d8c9-46ec-a2cb-75d34ab55b8d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:13:58.186786 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:58.193020 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Creating config drive at /opt/stack/data/nova/instances/fc403327-070b-4e21-b046-40c4160ee52b/disk.config
May 21 02:13:58.197414 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fc403327-070b-4e21-b046-40c4160ee52b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxlx4zej6 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:13:58.271266 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fc403327-070b-4e21-b046-40c4160ee52b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxlx4zej6" returned: 0 in 0.074s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:13:58.503719 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-9968d5b6-a5a5-4a18-be72-33c4987b52da req-8713419a-d8c9-46ec-a2cb-75d34ab55b8d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:13:58.661454 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-9968d5b6-a5a5-4a18-be72-33c4987b52da req-8713419a-d8c9-46ec-a2cb-75d34ab55b8d service nova] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Updated VIF entry in instance network info cache for port 21c89916-bd00-43b3-bfc9-b1ec22cc08bf. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:13:58.661895 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-9968d5b6-a5a5-4a18-be72-33c4987b52da req-8713419a-d8c9-46ec-a2cb-75d34ab55b8d service nova] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Updating instance_info_cache with network_info: [{"id": "21c89916-bd00-43b3-bfc9-b1ec22cc08bf", "address": "fa:16:3e:86:bf:a0", "network": {"id": "68132179-7a2d-4b6f-bc7a-da8f937a9fb2", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1224285668-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "517a45856efe44aa92f802f146b17616", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c89916-bd", "ovs_interfaceid": "21c89916-bd00-43b3-bfc9-b1ec22cc08bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:13:58.673667 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:58.676076 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:13:58.704615 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:58.796184 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:59.049170 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:59.051665 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:59.059178 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:59.087702 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:13:59.164831 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-9968d5b6-a5a5-4a18-be72-33c4987b52da req-8713419a-d8c9-46ec-a2cb-75d34ab55b8d service nova] Releasing lock "refresh_cache-8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:13:59.191734 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:13:59.191982 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:13:59.192187 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:13:59.192344 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Auditing locally available compute resources for np0000001127 (node: np0000001127) {{(pid=98206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 21 02:13:59.534398 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329639.5338664, fc403327-070b-4e21-b046-40c4160ee52b => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:13:59.534398 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: fc403327-070b-4e21-b046-40c4160ee52b] VM Started (Lifecycle Event)
May 21 02:13:59.699382 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0004142709999541694 future=<Future at 0x71c05858de80 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:13:59.699664 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:13:59.699979 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Emitting event <LifecycleEvent: 1779329624.6988258, c0628f73-e084-479c-8ecd-721fc26c39fb => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:13:59.700114 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] VM Stopped (Lifecycle Event)
May 21 02:13:59.792937 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:00.036758 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:14:00.039949 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329640.0387502, fc403327-070b-4e21-b046-40c4160ee52b => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:14:00.039949 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: fc403327-070b-4e21-b046-40c4160ee52b] VM Paused (Lifecycle Event)
May 21 02:14:00.203932 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: c0628f73-e084-479c-8ecd-721fc26c39fb] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:14:00.227109 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:14:00.229074 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-0 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:14:00.230660 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:14:00.231463 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:14:00.283949 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "env LANG=C uptime" returned: 0 in 0.052s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:14:00.284340 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Hypervisor/Node resource view: name=np0000001127 free_ram=13906MB free_disk=72.88692855834961GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 21 02:14:00.284544 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:14:00.285056 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:14:00.541435 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:14:00.543522 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:14:01.036688 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:01.045449 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: fc403327-070b-4e21-b046-40c4160ee52b] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:14:01.155956 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-5d636971-71ec-4a44-a175-a3b16b54155c req-ec120b80-c5b4-4c90-9dfa-5cc86b40828d service nova] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Received event network-vif-plugged-4177dd83-8ee3-4a16-8fa6-55e0b202f779 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:14:01.156157 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5d636971-71ec-4a44-a175-a3b16b54155c req-ec120b80-c5b4-4c90-9dfa-5cc86b40828d service nova] Acquiring lock "fc403327-070b-4e21-b046-40c4160ee52b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:14:01.156313 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5d636971-71ec-4a44-a175-a3b16b54155c req-ec120b80-c5b4-4c90-9dfa-5cc86b40828d service nova] Lock "fc403327-070b-4e21-b046-40c4160ee52b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:14:01.156444 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5d636971-71ec-4a44-a175-a3b16b54155c req-ec120b80-c5b4-4c90-9dfa-5cc86b40828d service nova] Lock "fc403327-070b-4e21-b046-40c4160ee52b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:14:01.156602 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-5d636971-71ec-4a44-a175-a3b16b54155c req-ec120b80-c5b4-4c90-9dfa-5cc86b40828d service nova] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Processing event network-vif-plugged-4177dd83-8ee3-4a16-8fa6-55e0b202f779 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:14:01.157524 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:14:01.160238 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329641.159959, fc403327-070b-4e21-b046-40c4160ee52b => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:14:01.160431 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: fc403327-070b-4e21-b046-40c4160ee52b] VM Resumed (Lifecycle Event)
May 21 02:14:01.161231 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:14:01.166098 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Instance spawned successfully.
May 21 02:14:01.166660 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:14:01.356290 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:14:01.356709 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance fc403327-070b-4e21-b046-40c4160ee52b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:14:01.356993 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 21 02:14:01.357147 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Final resource view: name=np0000001127 phys_ram=24030MB used_ram=896MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:14:00 up 44 min,  2 users,  load average: 4.23, 6.67, 5.96\n', 'num_instances': '2', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '2', 'num_proj_517a45856efe44aa92f802f146b17616': '1', 'io_workload': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_62ebdb16aee84e22a88dfc8960debd32': '1'} {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 21 02:14:01.516060 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:14:01.516351 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:14:01.664116 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:14:01.667917 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:14:01.677902 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:14:01.678101 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:14:01.678376 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:14:01.678645 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:14:01.678903 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:14:01.679105 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:14:02.020434 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:14:02.092016 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:02.172935 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: fc403327-070b-4e21-b046-40c4160ee52b] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:14:02.184829 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Took 10.23 seconds to spawn the instance on the hypervisor.
May 21 02:14:02.184829 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:14:02.528835 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Compute_service record updated for np0000001127:np0000001127 {{(pid=98206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 21 02:14:02.529299 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.244s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:14:02.529344 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:14:02.633826 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:02.694753 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Took 17.25 seconds to build instance.
May 21 02:14:03.196353 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "fc403327-070b-4e21-b046-40c4160ee52b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.762s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:14:03.266390 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d33f8f1d-d7fa-4ce5-b8a5-76acfd2a040d req-9341bbbe-fa5e-472a-934f-7ff880cd329c service nova] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Received event network-vif-plugged-4177dd83-8ee3-4a16-8fa6-55e0b202f779 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:14:03.267928 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d33f8f1d-d7fa-4ce5-b8a5-76acfd2a040d req-9341bbbe-fa5e-472a-934f-7ff880cd329c service nova] Acquiring lock "fc403327-070b-4e21-b046-40c4160ee52b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:14:03.267928 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d33f8f1d-d7fa-4ce5-b8a5-76acfd2a040d req-9341bbbe-fa5e-472a-934f-7ff880cd329c service nova] Lock "fc403327-070b-4e21-b046-40c4160ee52b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:14:03.267928 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d33f8f1d-d7fa-4ce5-b8a5-76acfd2a040d req-9341bbbe-fa5e-472a-934f-7ff880cd329c service nova] Lock "fc403327-070b-4e21-b046-40c4160ee52b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:14:03.267928 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d33f8f1d-d7fa-4ce5-b8a5-76acfd2a040d req-9341bbbe-fa5e-472a-934f-7ff880cd329c service nova] [instance: fc403327-070b-4e21-b046-40c4160ee52b] No waiting events found dispatching network-vif-plugged-4177dd83-8ee3-4a16-8fa6-55e0b202f779 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:14:03.267928 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-d33f8f1d-d7fa-4ce5-b8a5-76acfd2a040d req-9341bbbe-fa5e-472a-934f-7ff880cd329c service nova] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Received unexpected event network-vif-plugged-4177dd83-8ee3-4a16-8fa6-55e0b202f779 for instance with vm_state active and task_state None.
May 21 02:14:03.529962 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:14:03.530634 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:14:03.533087 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.02 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:14:03.553954 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:14:03.554327 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.12 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:14:04.333030 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-9aad028e-7bf2-49bd-96e4-77b67a3260ef req-0ae70fa3-5c43-4c1d-888d-e77765cddbaf service nova] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Received event network-changed-4177dd83-8ee3-4a16-8fa6-55e0b202f779 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:14:04.333483 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-9aad028e-7bf2-49bd-96e4-77b67a3260ef req-0ae70fa3-5c43-4c1d-888d-e77765cddbaf service nova] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Refreshing instance network info cache due to event network-changed-4177dd83-8ee3-4a16-8fa6-55e0b202f779. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:14:04.333671 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-9aad028e-7bf2-49bd-96e4-77b67a3260ef req-0ae70fa3-5c43-4c1d-888d-e77765cddbaf service nova] Acquiring lock "refresh_cache-fc403327-070b-4e21-b046-40c4160ee52b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:14:04.333854 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-9aad028e-7bf2-49bd-96e4-77b67a3260ef req-0ae70fa3-5c43-4c1d-888d-e77765cddbaf service nova] Acquired lock "refresh_cache-fc403327-070b-4e21-b046-40c4160ee52b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:14:04.333925 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-9aad028e-7bf2-49bd-96e4-77b67a3260ef req-0ae70fa3-5c43-4c1d-888d-e77765cddbaf service nova] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Refreshing network info cache for port 4177dd83-8ee3-4a16-8fa6-55e0b202f779 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:14:04.835668 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-9aad028e-7bf2-49bd-96e4-77b67a3260ef req-0ae70fa3-5c43-4c1d-888d-e77765cddbaf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:14:04.950373 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:05.234393 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-9aad028e-7bf2-49bd-96e4-77b67a3260ef req-0ae70fa3-5c43-4c1d-888d-e77765cddbaf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:14:05.414476 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-9aad028e-7bf2-49bd-96e4-77b67a3260ef req-0ae70fa3-5c43-4c1d-888d-e77765cddbaf service nova] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Updated VIF entry in instance network info cache for port 4177dd83-8ee3-4a16-8fa6-55e0b202f779. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:14:05.414785 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-9aad028e-7bf2-49bd-96e4-77b67a3260ef req-0ae70fa3-5c43-4c1d-888d-e77765cddbaf service nova] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Updating instance_info_cache with network_info: [{"id": "4177dd83-8ee3-4a16-8fa6-55e0b202f779", "address": "fa:16:3e:0e:cf:bf", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4177dd83-8e", "ovs_interfaceid": "4177dd83-8ee3-4a16-8fa6-55e0b202f779", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:14:05.677242 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:14:05.677242 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 6.98 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:14:05.916626 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-9aad028e-7bf2-49bd-96e4-77b67a3260ef req-0ae70fa3-5c43-4c1d-888d-e77765cddbaf service nova] Releasing lock "refresh_cache-fc403327-070b-4e21-b046-40c4160ee52b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:14:06.038567 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:07.094360 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:07.942804 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Acquiring lock "8d34fd8e-f675-4985-a7fd-6585f64fb564" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:14:07.942994 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Lock "8d34fd8e-f675-4985-a7fd-6585f64fb564" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:14:08.445967 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:14:09.006935 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:14:09.007070 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:14:09.012221 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:14:09.012385 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Claim successful on node np0000001127
May 21 02:14:10.197637 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:14:10.198087 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:14:10.704085 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:14:11.039492 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:11.212576 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.205s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:14:11.213072 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:14:11.718320 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:14:11.718596 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:14:11.718968 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:14:11.719249 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:14:11.780182 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2a8b2e6269a94a5e9239d4e81a8c1572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7059ada48244a12980a5c4d8e94065d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:14:12.110322 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:12.198203 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Successfully created port: a2f43a39-47c9-41b3-b086-2850004b4ef1 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:14:12.223993 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:14:12.659511 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:14:12.665851 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Successfully updated port: a2f43a39-47c9-41b3-b086-2850004b4ef1 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:14:12.709762 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f4041610-ab06-4269-8891-15d25893aedf req-c120d363-9b4a-4514-878a-64d8d4b0c2c3 service nova] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Received event network-changed-a2f43a39-47c9-41b3-b086-2850004b4ef1 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:14:12.709762 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f4041610-ab06-4269-8891-15d25893aedf req-c120d363-9b4a-4514-878a-64d8d4b0c2c3 service nova] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Refreshing instance network info cache due to event network-changed-a2f43a39-47c9-41b3-b086-2850004b4ef1. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:14:12.709762 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f4041610-ab06-4269-8891-15d25893aedf req-c120d363-9b4a-4514-878a-64d8d4b0c2c3 service nova] Acquiring lock "refresh_cache-8d34fd8e-f675-4985-a7fd-6585f64fb564" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:14:12.709890 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f4041610-ab06-4269-8891-15d25893aedf req-c120d363-9b4a-4514-878a-64d8d4b0c2c3 service nova] Acquired lock "refresh_cache-8d34fd8e-f675-4985-a7fd-6585f64fb564" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:14:12.710092 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-f4041610-ab06-4269-8891-15d25893aedf req-c120d363-9b4a-4514-878a-64d8d4b0c2c3 service nova] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Refreshing network info cache for port a2f43a39-47c9-41b3-b086-2850004b4ef1 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:14:12.728015 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:14:13.165041 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] While synchronizing instance power states, found 3 instances in the database and 2 instances on the hypervisor.
May 21 02:14:13.165041 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Triggering sync for uuid 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc {{(pid=98206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 21 02:14:13.165041 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Triggering sync for uuid fc403327-070b-4e21-b046-40c4160ee52b {{(pid=98206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 21 02:14:13.165041 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Triggering sync for uuid 8d34fd8e-f675-4985-a7fd-6585f64fb564 {{(pid=98206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 21 02:14:13.165312 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:14:13.165519 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:14:13.166995 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "fc403327-070b-4e21-b046-40c4160ee52b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:14:13.167771 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "8d34fd8e-f675-4985-a7fd-6585f64fb564" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:14:13.167998 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 44.02 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:14:13.168360 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Acquiring lock "refresh_cache-8d34fd8e-f675-4985-a7fd-6585f64fb564" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:14:13.168360 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "fc403327-070b-4e21-b046-40c4160ee52b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:14:13.216021 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-f4041610-ab06-4269-8891-15d25893aedf req-c120d363-9b4a-4514-878a-64d8d4b0c2c3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:14:13.285097 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-f4041610-ab06-4269-8891-15d25893aedf req-c120d363-9b4a-4514-878a-64d8d4b0c2c3 service nova] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:14:13.439825 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-f4041610-ab06-4269-8891-15d25893aedf req-c120d363-9b4a-4514-878a-64d8d4b0c2c3 service nova] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:14:13.676859 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.511s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:14:13.677480 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "fc403327-070b-4e21-b046-40c4160ee52b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.510s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:14:13.735517 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:14:13.736248 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:14:13.736477 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Creating image(s)
May 21 02:14:13.736899 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d34fd8e-f675-4985-a7fd-6585f64fb564/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:14:13.737040 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Lock "/opt/stack/data/nova/instances/8d34fd8e-f675-4985-a7fd-6585f64fb564/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:14:13.737482 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Lock "/opt/stack/data/nova/instances/8d34fd8e-f675-4985-a7fd-6585f64fb564/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:14:13.738171 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:14:13.740690 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:14:13.742153 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:14:13.839052 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.096s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:14:13.839537 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:14:13.840058 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:14:13.840556 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:14:13.843597 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:14:13.844056 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:14:13.942282 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f4041610-ab06-4269-8891-15d25893aedf req-c120d363-9b4a-4514-878a-64d8d4b0c2c3 service nova] Releasing lock "refresh_cache-8d34fd8e-f675-4985-a7fd-6585f64fb564" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:14:13.942813 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Acquired lock "refresh_cache-8d34fd8e-f675-4985-a7fd-6585f64fb564" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:14:13.943029 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:14:13.960008 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.116s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:14:13.960513 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/8d34fd8e-f675-4985-a7fd-6585f64fb564/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:14:14.017241 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/8d34fd8e-f675-4985-a7fd-6585f64fb564/disk 1073741824" returned: 0 in 0.056s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:14:14.017934 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.178s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:14:14.018410 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:14:14.110933 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.092s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:14:14.111447 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8d34fd8e-f675-4985-a7fd-6585f64fb564/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:14:14.111923 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d34fd8e-f675-4985-a7fd-6585f64fb564/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:14:14.200431 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d34fd8e-f675-4985-a7fd-6585f64fb564/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:14:14.200840 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Cannot resize image /opt/stack/data/nova/instances/8d34fd8e-f675-4985-a7fd-6585f64fb564/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:14:14.201222 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:14:14.201499 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Ensure instance console log exists: /opt/stack/data/nova/instances/8d34fd8e-f675-4985-a7fd-6585f64fb564/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:14:14.201844 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:14:14.202163 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:14:14.202344 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:14:14.500589 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:14:14.637902 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:14:14.755957 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Updating instance_info_cache with network_info: [{"id": "a2f43a39-47c9-41b3-b086-2850004b4ef1", "address": "fa:16:3e:71:c6:f9", "network": {"id": "53e9bcc4-7bd1-473a-8c01-77a5f489cbbd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1923048437-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7059ada48244a12980a5c4d8e94065d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2f43a39-47", "ovs_interfaceid": "a2f43a39-47c9-41b3-b086-2850004b4ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:14:15.258168 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Releasing lock "refresh_cache-8d34fd8e-f675-4985-a7fd-6585f64fb564" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:14:15.258464 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Instance network_info: |[{"id": "a2f43a39-47c9-41b3-b086-2850004b4ef1", "address": "fa:16:3e:71:c6:f9", "network": {"id": "53e9bcc4-7bd1-473a-8c01-77a5f489cbbd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1923048437-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7059ada48244a12980a5c4d8e94065d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2f43a39-47", "ovs_interfaceid": "a2f43a39-47c9-41b3-b086-2850004b4ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:14:15.260080 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Start _get_guest_xml network_info=[{"id": "a2f43a39-47c9-41b3-b086-2850004b4ef1", "address": "fa:16:3e:71:c6:f9", "network": {"id": "53e9bcc4-7bd1-473a-8c01-77a5f489cbbd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1923048437-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7059ada48244a12980a5c4d8e94065d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2f43a39-47", "ovs_interfaceid": "a2f43a39-47c9-41b3-b086-2850004b4ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:14:15.264577 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:14:15.265915 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-TestServerVolumeAttachScenarioOldVersion-server-296391358', uuid='8d34fd8e-f675-4985-a7fd-6585f64fb564'), owner=OwnerMeta(userid='2a8b2e6269a94a5e9239d4e81a8c1572', username='tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member', projectid='f7059ada48244a12980a5c4d8e94065d', projectname='tempest-TestServerVolumeAttachScenarioOldVersion-1477779907'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a2f43a39-47c9-41b3-b086-2850004b4ef1", "address": "fa:16:3e:71:c6:f9", "network": {"id": "53e9bcc4-7bd1-473a-8c01-77a5f489cbbd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1923048437-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7059ada48244a12980a5c4d8e94065d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2f43a39-47", "ovs_interfaceid": "a2f43a39-47c9-41b3-b086-2850004b4ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329655.265509) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:14:15.267196 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:14:15.267555 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:14:15.268581 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:14:15.268797 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:14:15.269805 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:14:15.270150 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:14:15.270344 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:14:15.270498 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:14:15.270727 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:14:15.270862 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:14:15.270997 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:14:15.271203 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:14:15.271363 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:14:15.271525 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:14:15.271673 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:14:15.271839 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:14:15.284092 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:14:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-296391358',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-296391358',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testservervolumeattachscenariooldversion-server-2963913',id=78,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGdEA1dTCPAXD5f2EpzETT/wqRD3nC+82m8+/StMOB3h3K4q3amu1RHwgLr4Zxb86RXIRT2bCPE/f+c/fyaAw8L/h68AZOMj9nfThhx8BOWeVfpr2fCUG2LpOTrDQzYwA==',key_name='tempest-keypair-1694102721',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7059ada48244a12980a5c4d8e94065d',ramdisk_id='',reservation_id='r-te52i2kj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1477779907',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:14:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a8b2e6269a94a5e9239d4e81a8c1572',uuid=8d34fd8e-f675-4985-a7fd-6585f64fb564,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2f43a39-47c9-41b3-b086-2850004b4ef1", "address": "fa:16:3e:71:c6:f9", "network": {"id": "53e9bcc4-7bd1-473a-8c01-77a5f489cbbd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1923048437-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7059ada48244a12980a5c4d8e94065d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2f43a39-47", "ovs_interfaceid": "a2f43a39-47c9-41b3-b086-2850004b4ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:14:15.284306 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Converting VIF {"id": "a2f43a39-47c9-41b3-b086-2850004b4ef1", "address": "fa:16:3e:71:c6:f9", "network": {"id": "53e9bcc4-7bd1-473a-8c01-77a5f489cbbd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1923048437-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7059ada48244a12980a5c4d8e94065d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2f43a39-47", "ovs_interfaceid": "a2f43a39-47c9-41b3-b086-2850004b4ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:14:15.284792 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:c6:f9,bridge_name='br-int',has_traffic_filtering=True,id=a2f43a39-47c9-41b3-b086-2850004b4ef1,network=Network(53e9bcc4-7bd1-473a-8c01-77a5f489cbbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2f43a39-47') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:14:15.285268 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d34fd8e-f675-4985-a7fd-6585f64fb564 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:14:15.787662 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] End _get_guest_xml xml=<domain type="qemu">
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:   <uuid>8d34fd8e-f675-4985-a7fd-6585f64fb564</uuid>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:   <name>instance-0000004e</name>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-296391358</nova:name>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:14:15</nova:creationTime>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:         <nova:user uuid="2a8b2e6269a94a5e9239d4e81a8c1572">tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member</nova:user>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:         <nova:project uuid="f7059ada48244a12980a5c4d8e94065d">tempest-TestServerVolumeAttachScenarioOldVersion-1477779907</nova:project>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:         <nova:port uuid="a2f43a39-47c9-41b3-b086-2850004b4ef1">
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:     <system>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:       <entry name="serial">8d34fd8e-f675-4985-a7fd-6585f64fb564</entry>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:       <entry name="uuid">8d34fd8e-f675-4985-a7fd-6585f64fb564</entry>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:     </system>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:   <os>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:   </os>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:   <features>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:   </features>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:   <devices>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/8d34fd8e-f675-4985-a7fd-6585f64fb564/disk"/>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:     </disk>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/8d34fd8e-f675-4985-a7fd-6585f64fb564/disk.config"/>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:     </disk>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:71:c6:f9"/>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:       <target dev="tapa2f43a39-47"/>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:     </interface>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/8d34fd8e-f675-4985-a7fd-6585f64fb564/console.log" append="off"/>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:     </serial>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:     <video>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:     </video>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:     </rng>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:   </devices>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]: </domain>
May 21 02:14:15.787662 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:14:15.790191 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Preparing to wait for external event network-vif-plugged-a2f43a39-47c9-41b3-b086-2850004b4ef1 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:14:15.790191 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Acquiring lock "8d34fd8e-f675-4985-a7fd-6585f64fb564-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:14:15.790191 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Lock "8d34fd8e-f675-4985-a7fd-6585f64fb564-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:14:15.790191 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Lock "8d34fd8e-f675-4985-a7fd-6585f64fb564-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:14:15.790191 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:14:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-296391358',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-296391358',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testservervolumeattachscenariooldversion-server-2963913',id=78,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGdEA1dTCPAXD5f2EpzETT/wqRD3nC+82m8+/StMOB3h3K4q3amu1RHwgLr4Zxb86RXIRT2bCPE/f+c/fyaAw8L/h68AZOMj9nfThhx8BOWeVfpr2fCUG2LpOTrDQzYwA==',key_name='tempest-keypair-1694102721',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7059ada48244a12980a5c4d8e94065d',ramdisk_id='',reservation_id='r-te52i2kj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1477779907',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:14:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a8b2e6269a94a5e9239d4e81a8c1572',uuid=8d34fd8e-f675-4985-a7fd-6585f64fb564,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2f43a39-47c9-41b3-b086-2850004b4ef1", "address": "fa:16:3e:71:c6:f9", "network": {"id": "53e9bcc4-7bd1-473a-8c01-77a5f489cbbd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1923048437-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7059ada48244a12980a5c4d8e94065d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2f43a39-47", "ovs_interfaceid": "a2f43a39-47c9-41b3-b086-2850004b4ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:14:15.790191 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Converting VIF {"id": "a2f43a39-47c9-41b3-b086-2850004b4ef1", "address": "fa:16:3e:71:c6:f9", "network": {"id": "53e9bcc4-7bd1-473a-8c01-77a5f489cbbd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1923048437-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7059ada48244a12980a5c4d8e94065d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2f43a39-47", "ovs_interfaceid": "a2f43a39-47c9-41b3-b086-2850004b4ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:14:15.790191 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:c6:f9,bridge_name='br-int',has_traffic_filtering=True,id=a2f43a39-47c9-41b3-b086-2850004b4ef1,network=Network(53e9bcc4-7bd1-473a-8c01-77a5f489cbbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2f43a39-47') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:14:15.790646 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:c6:f9,bridge_name='br-int',has_traffic_filtering=True,id=a2f43a39-47c9-41b3-b086-2850004b4ef1,network=Network(53e9bcc4-7bd1-473a-8c01-77a5f489cbbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2f43a39-47') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:14:15.790763 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:15.791099 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:14:15.791422 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:14:15.792004 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:15.792163 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '61453cfc-46f7-5d0e-b16c-f5bf17c1da2d', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:14:15.793011 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:15.793740 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:14:15.794385 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:15.796029 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:15.796158 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2f43a39-47, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:14:15.796520 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa2f43a39-47, col_values=(('qos', UUID('a896976e-7c4c-4a79-abcc-c061d8263e34')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:14:15.796706 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa2f43a39-47, col_values=(('external_ids', {'iface-id': 'a2f43a39-47c9-41b3-b086-2850004b4ef1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:c6:f9', 'vm-uuid': '8d34fd8e-f675-4985-a7fd-6585f64fb564'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:14:15.798318 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:15.799063 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:14:15.803083 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:15.803793 np0000001127 nova-compute[98206]: INFO os_vif [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:c6:f9,bridge_name='br-int',has_traffic_filtering=True,id=a2f43a39-47c9-41b3-b086-2850004b4ef1,network=Network(53e9bcc4-7bd1-473a-8c01-77a5f489cbbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2f43a39-47')
May 21 02:14:17.111601 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:17.321816 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:14:17.321952 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:14:17.322004 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] No VIF found with MAC fa:16:3e:71:c6:f9, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:14:17.322451 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Using config drive
May 21 02:14:17.829603 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:14:17.971080 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Creating config drive at /opt/stack/data/nova/instances/8d34fd8e-f675-4985-a7fd-6585f64fb564/disk.config
May 21 02:14:17.976005 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8d34fd8e-f675-4985-a7fd-6585f64fb564/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpipqq7h_n {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:14:18.035160 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8d34fd8e-f675-4985-a7fd-6585f64fb564/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpipqq7h_n" returned: 0 in 0.059s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:14:18.436452 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:18.464708 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:18.467336 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:18.561103 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:18.611548 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c8d4f8ed-77c9-42d9-be4b-4b8e26dc7100 req-78ac889c-4a27-4ae6-a04d-f1d14f56f74e service nova] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Received event network-vif-plugged-a2f43a39-47c9-41b3-b086-2850004b4ef1 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:14:18.611797 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c8d4f8ed-77c9-42d9-be4b-4b8e26dc7100 req-78ac889c-4a27-4ae6-a04d-f1d14f56f74e service nova] Acquiring lock "8d34fd8e-f675-4985-a7fd-6585f64fb564-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:14:18.611981 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c8d4f8ed-77c9-42d9-be4b-4b8e26dc7100 req-78ac889c-4a27-4ae6-a04d-f1d14f56f74e service nova] Lock "8d34fd8e-f675-4985-a7fd-6585f64fb564-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:14:18.612129 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-c8d4f8ed-77c9-42d9-be4b-4b8e26dc7100 req-78ac889c-4a27-4ae6-a04d-f1d14f56f74e service nova] Lock "8d34fd8e-f675-4985-a7fd-6585f64fb564-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:14:18.612246 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-c8d4f8ed-77c9-42d9-be4b-4b8e26dc7100 req-78ac889c-4a27-4ae6-a04d-f1d14f56f74e service nova] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Processing event network-vif-plugged-a2f43a39-47c9-41b3-b086-2850004b4ef1 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:14:18.756010 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:18.757600 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:18.759268 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:18.778801 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:19.194387 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:14:19.195287 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329659.1945162, 8d34fd8e-f675-4985-a7fd-6585f64fb564 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:14:19.195977 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] VM Started (Lifecycle Event)
May 21 02:14:19.199448 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:14:19.201987 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Instance spawned successfully.
May 21 02:14:19.202637 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:14:19.702710 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:14:19.705195 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:14:19.711588 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:14:19.711807 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:14:19.712229 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:14:19.712581 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:14:19.712886 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:14:19.713155 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:14:20.210663 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:14:20.211181 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329660.2107284, 8d34fd8e-f675-4985-a7fd-6585f64fb564 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:14:20.211365 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] VM Paused (Lifecycle Event)
May 21 02:14:20.217835 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Took 6.48 seconds to spawn the instance on the hypervisor.
May 21 02:14:20.217961 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:14:20.672188 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-53e7f0a5-4def-4f48-b724-e95fd27583df req-b7c1d335-3960-4096-b742-e4c1279dce9c service nova] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Received event network-vif-plugged-a2f43a39-47c9-41b3-b086-2850004b4ef1 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:14:20.675832 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-53e7f0a5-4def-4f48-b724-e95fd27583df req-b7c1d335-3960-4096-b742-e4c1279dce9c service nova] Acquiring lock "8d34fd8e-f675-4985-a7fd-6585f64fb564-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:14:20.676170 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-53e7f0a5-4def-4f48-b724-e95fd27583df req-b7c1d335-3960-4096-b742-e4c1279dce9c service nova] Lock "8d34fd8e-f675-4985-a7fd-6585f64fb564-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:14:20.676553 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-53e7f0a5-4def-4f48-b724-e95fd27583df req-b7c1d335-3960-4096-b742-e4c1279dce9c service nova] Lock "8d34fd8e-f675-4985-a7fd-6585f64fb564-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:14:20.676700 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-53e7f0a5-4def-4f48-b724-e95fd27583df req-b7c1d335-3960-4096-b742-e4c1279dce9c service nova] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] No waiting events found dispatching network-vif-plugged-a2f43a39-47c9-41b3-b086-2850004b4ef1 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:14:20.677335 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-53e7f0a5-4def-4f48-b724-e95fd27583df req-b7c1d335-3960-4096-b742-e4c1279dce9c service nova] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Received unexpected event network-vif-plugged-a2f43a39-47c9-41b3-b086-2850004b4ef1 for instance with vm_state active and task_state None.
May 21 02:14:20.713831 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:14:20.716058 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329660.7158344, 8d34fd8e-f675-4985-a7fd-6585f64fb564 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:14:20.716259 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] VM Resumed (Lifecycle Event)
May 21 02:14:20.729281 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Took 11.78 seconds to build instance.
May 21 02:14:20.808568 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:21.219026 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:14:21.221441 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:14:21.231007 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-387b12b5-0e0b-4c56-9f05-f62dd47b4c04 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Lock "8d34fd8e-f675-4985-a7fd-6585f64fb564" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.288s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:14:21.231661 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "8d34fd8e-f675-4985-a7fd-6585f64fb564" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 8.064s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:14:21.233018 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] During sync_power_state the instance has a pending task (networking). Skip.
May 21 02:14:21.233165 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "8d34fd8e-f675-4985-a7fd-6585f64fb564" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:14:22.118284 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:22.432780 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d0583448-87a0-4e3f-80b0-28ab9d5583f8 req-be8cf79b-873c-458b-bbdb-eca48851f760 service nova] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Received event network-changed-a2f43a39-47c9-41b3-b086-2850004b4ef1 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:14:22.433092 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d0583448-87a0-4e3f-80b0-28ab9d5583f8 req-be8cf79b-873c-458b-bbdb-eca48851f760 service nova] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Refreshing instance network info cache due to event network-changed-a2f43a39-47c9-41b3-b086-2850004b4ef1. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:14:22.433186 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d0583448-87a0-4e3f-80b0-28ab9d5583f8 req-be8cf79b-873c-458b-bbdb-eca48851f760 service nova] Acquiring lock "refresh_cache-8d34fd8e-f675-4985-a7fd-6585f64fb564" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:14:22.433341 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d0583448-87a0-4e3f-80b0-28ab9d5583f8 req-be8cf79b-873c-458b-bbdb-eca48851f760 service nova] Acquired lock "refresh_cache-8d34fd8e-f675-4985-a7fd-6585f64fb564" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:14:22.433521 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-d0583448-87a0-4e3f-80b0-28ab9d5583f8 req-be8cf79b-873c-458b-bbdb-eca48851f760 service nova] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Refreshing network info cache for port a2f43a39-47c9-41b3-b086-2850004b4ef1 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:14:22.936407 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-d0583448-87a0-4e3f-80b0-28ab9d5583f8 req-be8cf79b-873c-458b-bbdb-eca48851f760 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:14:23.195288 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-d0583448-87a0-4e3f-80b0-28ab9d5583f8 req-be8cf79b-873c-458b-bbdb-eca48851f760 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:14:23.318056 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-d0583448-87a0-4e3f-80b0-28ab9d5583f8 req-be8cf79b-873c-458b-bbdb-eca48851f760 service nova] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Updated VIF entry in instance network info cache for port a2f43a39-47c9-41b3-b086-2850004b4ef1. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:14:23.318285 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-d0583448-87a0-4e3f-80b0-28ab9d5583f8 req-be8cf79b-873c-458b-bbdb-eca48851f760 service nova] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Updating instance_info_cache with network_info: [{"id": "a2f43a39-47c9-41b3-b086-2850004b4ef1", "address": "fa:16:3e:71:c6:f9", "network": {"id": "53e9bcc4-7bd1-473a-8c01-77a5f489cbbd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1923048437-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7059ada48244a12980a5c4d8e94065d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2f43a39-47", "ovs_interfaceid": "a2f43a39-47c9-41b3-b086-2850004b4ef1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:14:23.820181 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d0583448-87a0-4e3f-80b0-28ab9d5583f8 req-be8cf79b-873c-458b-bbdb-eca48851f760 service nova] Releasing lock "refresh_cache-8d34fd8e-f675-4985-a7fd-6585f64fb564" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:14:25.811400 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:27.117270 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:30.814034 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:32.124624 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:34.417674 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:14:34.418118 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:14:34.418118 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:14:34.418220 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:14:34.418320 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:14:34.420847 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Terminating instance
May 21 02:14:34.925370 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:14:34.938849 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:34.942848 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:34.961685 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:34.974579 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:35.005315 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:35.127509 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1dcf66f7-d831-4e72-86b5-58b2b48da905 req-3906adc5-a339-41bb-9e37-cfe10bc32c55 service nova] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Received event network-vif-unplugged-21c89916-bd00-43b3-bfc9-b1ec22cc08bf {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:14:35.127509 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1dcf66f7-d831-4e72-86b5-58b2b48da905 req-3906adc5-a339-41bb-9e37-cfe10bc32c55 service nova] Acquiring lock "8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:14:35.127509 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1dcf66f7-d831-4e72-86b5-58b2b48da905 req-3906adc5-a339-41bb-9e37-cfe10bc32c55 service nova] Lock "8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:14:35.127509 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-1dcf66f7-d831-4e72-86b5-58b2b48da905 req-3906adc5-a339-41bb-9e37-cfe10bc32c55 service nova] Lock "8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:14:35.127509 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1dcf66f7-d831-4e72-86b5-58b2b48da905 req-3906adc5-a339-41bb-9e37-cfe10bc32c55 service nova] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] No waiting events found dispatching network-vif-unplugged-21c89916-bd00-43b3-bfc9-b1ec22cc08bf {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:14:35.127509 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-1dcf66f7-d831-4e72-86b5-58b2b48da905 req-3906adc5-a339-41bb-9e37-cfe10bc32c55 service nova] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Received event network-vif-unplugged-21c89916-bd00-43b3-bfc9-b1ec22cc08bf for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:14:35.239875 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:35.248293 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:35.266336 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999663374999727 future=<Future at 0x71c05864df70 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:14:35.266791 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999183355999776 future=<Future at 0x71c05864df70 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:14:35.266925 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999054927999623 future=<Future at 0x71c05864df70 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:14:35.268781 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Instance destroyed successfully.
May 21 02:14:35.269208 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lazy-loading 'resources' on Instance uuid 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:14:35.771657 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:13:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-773217921',display_name='tempest-TestEncryptedCinderVolumes-server-773217921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testencryptedcindervolumes-server-773217921',id=76,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAhkQbp5kMwPyRYbKzXvFue4B05DSWlMs4KXDTXsTygnB2TWy+kt4GBTiDM8LiCQTVRBWYkE1itG7K2+H6oL5C/hvlsCCr+Z7SvxCHUYwFWVcZ1ePW8nLfDe4MI4Yf/Uw==',key_name='tempest-TestEncryptedCinderVolumes-618034694',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:13:54Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='517a45856efe44aa92f802f146b17616',ramdisk_id='',reservation_id='r-8biivubf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestEncryptedCinderVolumes-1523380334',owner_user_name='tempest-TestEncryptedCinderVolumes-1523380334-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:13:55Z,user_data=None,user_id='68fd64fea5a84a0bbb1d09de7d76709c',uuid=8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21c89916-bd00-43b3-bfc9-b1ec22cc08bf", "address": "fa:16:3e:86:bf:a0", "network": {"id": "68132179-7a2d-4b6f-bc7a-da8f937a9fb2", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1224285668-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "517a45856efe44aa92f802f146b17616", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c89916-bd", "ovs_interfaceid": "21c89916-bd00-43b3-bfc9-b1ec22cc08bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:14:35.772123 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Converting VIF {"id": "21c89916-bd00-43b3-bfc9-b1ec22cc08bf", "address": "fa:16:3e:86:bf:a0", "network": {"id": "68132179-7a2d-4b6f-bc7a-da8f937a9fb2", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1224285668-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "517a45856efe44aa92f802f146b17616", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c89916-bd", "ovs_interfaceid": "21c89916-bd00-43b3-bfc9-b1ec22cc08bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:14:35.772609 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:bf:a0,bridge_name='br-int',has_traffic_filtering=True,id=21c89916-bd00-43b3-bfc9-b1ec22cc08bf,network=Network(68132179-7a2d-4b6f-bc7a-da8f937a9fb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21c89916-bd') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:14:35.772866 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:bf:a0,bridge_name='br-int',has_traffic_filtering=True,id=21c89916-bd00-43b3-bfc9-b1ec22cc08bf,network=Network(68132179-7a2d-4b6f-bc7a-da8f937a9fb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21c89916-bd') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:14:35.774301 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:35.774598 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21c89916-bd, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:14:35.775482 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:35.776772 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:14:35.777349 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:35.777554 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d460b09a-05a2-4dd2-84ff-96894f96b0d1) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:14:35.779008 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:35.779084 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:14:35.780930 np0000001127 nova-compute[98206]: INFO os_vif [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:bf:a0,bridge_name='br-int',has_traffic_filtering=True,id=21c89916-bd00-43b3-bfc9-b1ec22cc08bf,network=Network(68132179-7a2d-4b6f-bc7a-da8f937a9fb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21c89916-bd')
May 21 02:14:35.784214 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:14:35.784677 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c', 'iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2853aa4f-6782-4643-acd0-fbaa302aca4c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:14:35.784813 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:14:35.785262 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:14:35.785672 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c', 'iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2853aa4f-6782-4643-acd0-fbaa302aca4c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:14:35.785861 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:14:35.811180 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:14:35.811180 np0000001127 nova-compute[98206]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:14:35.811180 np0000001127 nova-compute[98206]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:14:35.811180 np0000001127 nova-compute[98206]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:14:35.811180 np0000001127 nova-compute[98206]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449f7393-695e-4423-88f7-eefb97881752 (non-flash)
May 21 02:14:35.811180 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:14:35.811574 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsi session list stdout=tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:14:35.811574 np0000001127 nova-compute[98206]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c (non-flash)
May 21 02:14:35.811574 np0000001127 nova-compute[98206]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:14:35.811574 np0000001127 nova-compute[98206]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:14:35.811574 np0000001127 nova-compute[98206]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449f7393-695e-4423-88f7-eefb97881752 (non-flash)
May 21 02:14:35.811574 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:14:35.811574 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c', '197'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c', '198'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', '199'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', '200'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-449f7393-695e-4423-88f7-eefb97881752', '203')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:14:35.811831 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c', '198')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:14:35.812564 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c', '197')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:14:35.813320 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c0585668e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c'): ({'sdc'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:14:35.813567 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Removing multipathed devices sdd, sdc {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:14:35.813822 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Flush multipath device 330000000e6cb27eb {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:14:35.849870 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:14:35.904056 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:14:35.944112 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Checking to see if SCSI volumes sdd, sdc have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:14:35.944310 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] SCSI volumes sdd, sdc have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:14:35.945602 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Checking to see if device paths {'sdd', 'sdc'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:14:35.957338 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Device paths {'sdd', 'sdc'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:14:35.957569 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:14:35.972687 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:14:36.006409 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 198, target: iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c, portal: 192.168.40.100,3260]
May 21 02:14:36.006409 np0000001127 nova-compute[98206]: Logout of [sid: 198, target: iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c, portal: 192.168.40.100,3260] successful.
May 21 02:14:36.006409 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:14:36.020880 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:14:36.031859 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:14:36.058658 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 197, target: iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c, portal: 192.168.50.100,3260]
May 21 02:14:36.058658 np0000001127 nova-compute[98206]: Logout of [sid: 197, target: iqn.2023-03.storpool.com:os--volume-2853aa4f-6782-4643-acd0-fbaa302aca4c, portal: 192.168.50.100,3260] successful.
May 21 02:14:36.058658 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:14:36.073069 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:14:36.074121 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:14:36.074202 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] <== disconnect_volume: return (289ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:14:36.074292 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:14:36.074590 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Deleting instance files /opt/stack/data/nova/instances/8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc_del
May 21 02:14:36.075023 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Deletion of /opt/stack/data/nova/instances/8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc_del complete
May 21 02:14:36.580983 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Took 1.66 seconds to destroy the instance on the hypervisor.
May 21 02:14:36.581690 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:14:36.581920 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:14:36.582039 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:14:36.582264 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:14:36.642140 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:14:37.043429 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cc3dfa4c-7c9d-4a69-b01a-40d064f882d6 req-6a72aa01-4411-43c0-a22e-ea0d9cb998da service nova] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Received event network-vif-deleted-21c89916-bd00-43b3-bfc9-b1ec22cc08bf {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:14:37.045046 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-cc3dfa4c-7c9d-4a69-b01a-40d064f882d6 req-6a72aa01-4411-43c0-a22e-ea0d9cb998da service nova] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Neutron deleted interface 21c89916-bd00-43b3-bfc9-b1ec22cc08bf; detaching it from the instance and deleting it from the info cache
May 21 02:14:37.045046 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-cc3dfa4c-7c9d-4a69-b01a-40d064f882d6 req-6a72aa01-4411-43c0-a22e-ea0d9cb998da service nova] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:14:37.134356 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:37.183731 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-948471af-a0b7-4d3d-8803-cd1af8c8d9f4 req-47b5d171-5184-4a48-8e6a-b6bd01cf1904 service nova] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Received event network-vif-unplugged-21c89916-bd00-43b3-bfc9-b1ec22cc08bf {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:14:37.183800 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-948471af-a0b7-4d3d-8803-cd1af8c8d9f4 req-47b5d171-5184-4a48-8e6a-b6bd01cf1904 service nova] Acquiring lock "8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:14:37.183916 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-948471af-a0b7-4d3d-8803-cd1af8c8d9f4 req-47b5d171-5184-4a48-8e6a-b6bd01cf1904 service nova] Lock "8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:14:37.184023 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-948471af-a0b7-4d3d-8803-cd1af8c8d9f4 req-47b5d171-5184-4a48-8e6a-b6bd01cf1904 service nova] Lock "8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:14:37.184123 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-948471af-a0b7-4d3d-8803-cd1af8c8d9f4 req-47b5d171-5184-4a48-8e6a-b6bd01cf1904 service nova] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] No waiting events found dispatching network-vif-unplugged-21c89916-bd00-43b3-bfc9-b1ec22cc08bf {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:14:37.184228 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-948471af-a0b7-4d3d-8803-cd1af8c8d9f4 req-47b5d171-5184-4a48-8e6a-b6bd01cf1904 service nova] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Received event network-vif-unplugged-21c89916-bd00-43b3-bfc9-b1ec22cc08bf for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:14:37.481377 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:14:37.548095 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cc3dfa4c-7c9d-4a69-b01a-40d064f882d6 req-6a72aa01-4411-43c0-a22e-ea0d9cb998da service nova] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Detach interface failed, port_id=21c89916-bd00-43b3-bfc9-b1ec22cc08bf, reason: Instance 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:14:37.983641 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Took 1.40 seconds to deallocate network for instance.
May 21 02:14:38.534056 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Took 0.55 seconds to detach 1 volumes for instance.
May 21 02:14:39.039322 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:14:39.039569 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:14:39.195356 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:14:39.195580 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:14:39.698278 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:14:40.204530 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.165s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:14:40.249554 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Deleted allocations for instance 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc
May 21 02:14:40.795039 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:41.120244 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:41.256732 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ed906423-745e-4f8d-b4e1-3150eb702c1f tempest-TestEncryptedCinderVolumes-1523380334 tempest-TestEncryptedCinderVolumes-1523380334-project-member] Lock "8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.839s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:14:42.136080 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:44.693015 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "e10da81d-1cfd-4008-8031-bf4e8b65bf78" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:14:44.693482 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "e10da81d-1cfd-4008-8031-bf4e8b65bf78" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:14:45.195689 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:14:45.263198 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:45.775771 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:14:45.776176 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:14:45.780338 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:14:45.781401 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Claim successful on node np0000001127
May 21 02:14:45.796201 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:46.980255 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:14:46.980756 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:14:47.110519 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:47.137574 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:47.483083 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:14:47.990665 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.215s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:14:47.991035 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:14:48.498717 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:14:48.498962 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:14:48.499234 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:14:48.499548 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:14:48.595842 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4878b5a5bf184852a9ce383caa1c67a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ebdb16aee84e22a88dfc8960debd32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:14:49.001697 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:14:49.138942 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Successfully created port: b22c43dc-84ca-4d63-a27f-7df2c63232b5 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:14:49.506399 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:14:49.595600 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Successfully updated port: b22c43dc-84ca-4d63-a27f-7df2c63232b5 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:14:49.641619 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-24f96005-f553-44a9-b982-4cdba4244585 req-296e0f40-5e05-4277-ae3e-d7732e3ef8b6 service nova] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Received event network-changed-b22c43dc-84ca-4d63-a27f-7df2c63232b5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:14:49.641619 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-24f96005-f553-44a9-b982-4cdba4244585 req-296e0f40-5e05-4277-ae3e-d7732e3ef8b6 service nova] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Refreshing instance network info cache due to event network-changed-b22c43dc-84ca-4d63-a27f-7df2c63232b5. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:14:49.641799 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-24f96005-f553-44a9-b982-4cdba4244585 req-296e0f40-5e05-4277-ae3e-d7732e3ef8b6 service nova] Acquiring lock "refresh_cache-e10da81d-1cfd-4008-8031-bf4e8b65bf78" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:14:49.642020 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-24f96005-f553-44a9-b982-4cdba4244585 req-296e0f40-5e05-4277-ae3e-d7732e3ef8b6 service nova] Acquired lock "refresh_cache-e10da81d-1cfd-4008-8031-bf4e8b65bf78" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:14:49.642131 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-24f96005-f553-44a9-b982-4cdba4244585 req-296e0f40-5e05-4277-ae3e-d7732e3ef8b6 service nova] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Refreshing network info cache for port b22c43dc-84ca-4d63-a27f-7df2c63232b5 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:14:49.892174 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Acquiring lock "8d34fd8e-f675-4985-a7fd-6585f64fb564" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:14:49.892620 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Lock "8d34fd8e-f675-4985-a7fd-6585f64fb564" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:14:50.010052 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Booting with volume 5b77d39d-277b-4ea5-8e32-ae5edf39af8e at /dev/vda
May 21 02:14:50.047577 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:14:50.060698 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:14:50.085111 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:14:50.103943 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "refresh_cache-e10da81d-1cfd-4008-8031-bf4e8b65bf78" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:14:50.135681 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:14:50.135923 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:14:50.143990 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:14:50.145896 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe0e:cfbf', 'fe80::c44d:25ff:fe10:25cb', 'fe80::fc16:3eff:fe71:c6f9', 'fe80::74ff:32ff:fe31:3700'] 
May 21 02:14:50.146011 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:14:50.146106 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:14:50.146326 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:14:50.146564 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Updating existing volume attachment record: 0fcc5956-8017-4ab5-b836-4b6edfa540d8 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:14:50.149710 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-24f96005-f553-44a9-b982-4cdba4244585 req-296e0f40-5e05-4277-ae3e-d7732e3ef8b6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:14:50.225343 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-24f96005-f553-44a9-b982-4cdba4244585 req-296e0f40-5e05-4277-ae3e-d7732e3ef8b6 service nova] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:14:50.266395 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.00040880999995351885 future=<Future at 0x71c05864df70 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:14:50.266558 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:14:50.267168 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Emitting event <LifecycleEvent: 1779329675.2658763, 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:14:50.267375 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] VM Stopped (Lifecycle Event)
May 21 02:14:50.345156 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-24f96005-f553-44a9-b982-4cdba4244585 req-296e0f40-5e05-4277-ae3e-d7732e3ef8b6 service nova] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:14:50.395930 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Lazy-loading 'flavor' on Instance uuid 8d34fd8e-f675-4985-a7fd-6585f64fb564 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:14:50.770395 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9a1ffe47-4d61-4da5-a6c1-5e2a60099b5e tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 8cbf3c4e-1ed0-4cd4-9e73-9e2774e4b8dc] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:14:50.798710 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:50.847006 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-24f96005-f553-44a9-b982-4cdba4244585 req-296e0f40-5e05-4277-ae3e-d7732e3ef8b6 service nova] Releasing lock "refresh_cache-e10da81d-1cfd-4008-8031-bf4e8b65bf78" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:14:50.847575 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquired lock "refresh_cache-e10da81d-1cfd-4008-8031-bf4e8b65bf78" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:14:50.847721 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:14:51.400318 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Lock "8d34fd8e-f675-4985-a7fd-6585f64fb564" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:14:51.407691 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:14:51.537548 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:14:51.649459 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Updating instance_info_cache with network_info: [{"id": "b22c43dc-84ca-4d63-a27f-7df2c63232b5", "address": "fa:16:3e:41:d7:06", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22c43dc-84", "ovs_interfaceid": "b22c43dc-84ca-4d63-a27f-7df2c63232b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:14:52.149215 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:52.151582 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Releasing lock "refresh_cache-e10da81d-1cfd-4008-8031-bf4e8b65bf78" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:14:52.151822 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Instance network_info: |[{"id": "b22c43dc-84ca-4d63-a27f-7df2c63232b5", "address": "fa:16:3e:41:d7:06", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22c43dc-84", "ovs_interfaceid": "b22c43dc-84ca-4d63-a27f-7df2c63232b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:14:52.281978 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:14:52.283227 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:14:52.283531 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Creating image(s)
May 21 02:14:52.283885 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Did not create local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 21 02:14:52.284107 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Ensure instance console log exists: /opt/stack/data/nova/instances/e10da81d-1cfd-4008-8031-bf4e8b65bf78/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:14:52.284365 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:14:52.284615 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:14:52.284784 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:14:52.285347 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Start _get_guest_xml network_info=[{"id": "b22c43dc-84ca-4d63-a27f-7df2c63232b5", "address": "fa:16:3e:41:d7:06", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22c43dc-84", "ovs_interfaceid": "b22c43dc-84ca-4d63-a27f-7df2c63232b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e', 'iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b77d39d-277b-4ea5-8e32-ae5edf39af8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'e10da81d-1cfd-4008-8031-bf4e8b65bf78', 'attached_at': '', 'detached_at': '', 'volume_id': '5b77d39d-277b-4ea5-8e32-ae5edf39af8e', 'serial': '5b77d39d-277b-4ea5-8e32-ae5edf39af8e'}, 'delete_on_termination': False, 'attachment_id': '0fcc5956-8017-4ab5-b836-4b6edfa540d8', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:14:52.289335 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:14:52.290937 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-2091479445', uuid='e10da81d-1cfd-4008-8031-bf4e8b65bf78'), owner=OwnerMeta(userid='4878b5a5bf184852a9ce383caa1c67a4', username='tempest-TestVolumeBootPattern-1995806391-project-member', projectid='62ebdb16aee84e22a88dfc8960debd32', projectname='tempest-TestVolumeBootPattern-1995806391'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b22c43dc-84ca-4d63-a27f-7df2c63232b5", "address": "fa:16:3e:41:d7:06", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22c43dc-84", "ovs_interfaceid": "b22c43dc-84ca-4d63-a27f-7df2c63232b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329692.2905302) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:14:52.292756 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:14:52.293140 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:14:52.294611 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:14:52.294828 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:14:52.295915 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:14:52.296291 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:14:52.296517 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:14:52.296650 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:14:52.296817 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:14:52.296955 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:14:52.297108 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:14:52.297327 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:14:52.297522 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:14:52.297669 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:14:52.297828 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:14:52.298093 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:14:52.313849 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:14:52.314204 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e', 'iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b77d39d-277b-4ea5-8e32-ae5edf39af8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:14:52.314379 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:14:52.314844 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:14:52.315099 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e', 'iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b77d39d-277b-4ea5-8e32-ae5edf39af8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:14:52.330870 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:14:52.331430 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:14:52.331988 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:14:52.332195 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:14:52.332738 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:14:52.333741 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:14:52.343685 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:14:52.343685 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:14:52.349400 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:14:52.349400 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:14:52.356088 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e] added
May 21 02:14:52.356088 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:14:52.356088 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:14:52.356088 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:14:52.356088 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:14:52.356088 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:14:52.356088 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:14:52.356486 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:14:52.356556 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0243(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:14:52.356706 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:14:52.359685 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e] added
May 21 02:14:52.359685 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:14:52.359685 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:14:52.359685 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:14:52.359685 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:14:52.359685 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:14:52.359685 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:14:52.359842 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:14:52.359964 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0263(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:14:52.360090 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:14:52.590058 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Acquiring lock "8d34fd8e-f675-4985-a7fd-6585f64fb564" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:14:52.590560 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Lock "8d34fd8e-f675-4985-a7fd-6585f64fb564" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:14:52.590560 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Attaching volume 3b97af37-9d8c-481d-a122-06e860faf7b7 to /dev/vdb
May 21 02:14:52.626265 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:14:52.638420 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:14:52.664052 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:14:52.719198 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:14:52.719518 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:14:52.729664 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:14:52.730772 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe0e:cfbf', 'fe80::c44d:25ff:fe10:25cb', 'fe80::fc16:3eff:fe71:c6f9', 'fe80::74ff:32ff:fe31:3700'] 
May 21 02:14:52.730772 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:14:52.730772 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:14:52.731020 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] <== get_connector_properties: return (104ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:14:52.731263 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Updating existing volume attachment record: 37e27e1d-cbae-4118-8447-50e65b6ba6af {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:14:53.321850 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:14:53.322339 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7', 'iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3b97af37-9d8c-481d-a122-06e860faf7b7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:14:53.322516 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:14:53.357361 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:14:53.360518 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:14:53.373173 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:14:53.373173 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:14:53.379594 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:14:53.379594 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:14:53.387926 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:14:53.393436 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:14:53.401782 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:14:53.401782 np0000001127 nova-compute[98206]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:14:53.401782 np0000001127 nova-compute[98206]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc (non-flash)
May 21 02:14:53.401782 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:14:53.401998 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:14:53.401998 np0000001127 nova-compute[98206]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:14:53.401998 np0000001127 nova-compute[98206]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc (non-flash)
May 21 02:14:53.401998 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:14:53.406988 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:14:53.406988 np0000001127 nova-compute[98206]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:14:53.406988 np0000001127 nova-compute[98206]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc (non-flash)
May 21 02:14:53.406988 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:14:53.407165 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:14:53.407165 np0000001127 nova-compute[98206]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:14:53.407165 np0000001127 nova-compute[98206]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc (non-flash)
May 21 02:14:53.407165 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:14:53.430703 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e, portal: 192.168.50.100,3260]
May 21 02:14:53.430703 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e, portal: 192.168.50.100,3260] successful.
May 21 02:14:53.430703 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:14:53.441243 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:14:53.446629 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e, portal: 192.168.40.100,3260]
May 21 02:14:53.446629 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e, portal: 192.168.40.100,3260] successful.
May 21 02:14:53.446629 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:14:53.456488 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:14:53.456488 np0000001127 nova-compute[98206]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:14:53.456488 np0000001127 nova-compute[98206]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc (non-flash)
May 21 02:14:53.456488 np0000001127 nova-compute[98206]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:14:53.456488 np0000001127 nova-compute[98206]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:14:53.456488 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:14:53.456810 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:14:53.456810 np0000001127 nova-compute[98206]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:14:53.456810 np0000001127 nova-compute[98206]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc (non-flash)
May 21 02:14:53.456810 np0000001127 nova-compute[98206]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:14:53.456810 np0000001127 nova-compute[98206]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:14:53.456810 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:14:53.457007 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.125s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:14:53.457169 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:14:53.458104 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] HCTL ('8', '-', '-', 0) found on session 205 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:14:53.458234 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:14:53.459693 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:14:53.473694 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching for a device in session 205 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:14:53.473694 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5b77d39d-277b-4ea5-8e32-ae5edf39af8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:14:53.477225 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:14:53.477225 np0000001127 nova-compute[98206]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:14:53.477225 np0000001127 nova-compute[98206]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc (non-flash)
May 21 02:14:53.477225 np0000001127 nova-compute[98206]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:14:53.477225 np0000001127 nova-compute[98206]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:14:53.477225 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:14:53.477556 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:14:53.477556 np0000001127 nova-compute[98206]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:14:53.477556 np0000001127 nova-compute[98206]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc (non-flash)
May 21 02:14:53.477556 np0000001127 nova-compute[98206]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:14:53.477556 np0000001127 nova-compute[98206]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:14:53.477556 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:14:53.477767 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.145s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:14:53.477982 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:14:53.479290 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] HCTL ('9', '-', '-', 0) found on session 206 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:14:53.479442 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:14:53.492570 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching for a device in session 206 and hctl ['9', '*', '*', 0] yield: None {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:14:54.492511 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Searching for a device in session 206 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:14:54.492852 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b77d39d-277b-4ea5-8e32-ae5edf39af8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:14:55.347246 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Found WWN 3300000007fe18a95 for multipath device dm-0 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:14:55.347424 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:14:55.347642 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '3300000007fe18a95', 'path': '/dev/dm-0', 'multipath_id': '3300000007fe18a95'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:14:55.347798 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007fe18a95', 'path': '/dev/dm-0', 'multipath_id': '3300000007fe18a95'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:14:55.348408 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.026s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:14:55.348520 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7', 'iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3b97af37-9d8c-481d-a122-06e860faf7b7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:14:55.363520 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:14:55.364438 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:14:55.365043 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:14:55.365256 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:14:55.365784 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:14:55.366075 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:14:55.378590 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:14:55.378590 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:14:55.379979 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:14:55.379979 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:14:55.390404 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7] added
May 21 02:14:55.390404 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:14:55.390404 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:14:55.390404 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:14:55.390404 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:14:55.390404 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:14:55.390404 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:14:55.390672 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:14:55.390757 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0255(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:14:55.390902 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:14:55.395994 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7] added
May 21 02:14:55.395994 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:14:55.395994 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:14:55.395994 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:14:55.395994 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:14:55.395994 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:14:55.395994 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:14:55.396240 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:14:55.396524 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0304(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:14:55.396738 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:14:55.800917 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:55.855193 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2091479445',display_name='tempest-TestVolumeBootPattern-server-2091479445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpattern-server-2091479445',id=79,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz/RBMCwKlZOoLdoqf7XbPge9tLmyY1xo5VJlB0SNDPLDIqYhv6bRKRrq1AOl4f0antvHh+zaNlybPqLYJXPC6E7cTtqubsCy3OHGbekTwncuW9Nfz1O6qOo+1iMsXADw==',key_name='tempest-TestVolumeBootPattern-2024297378',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62ebdb16aee84e22a88dfc8960debd32',ramdisk_id='',reservation_id='r-fmf3i79q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1995806391',owner_user_name='tempest-TestVolumeBootPattern-1995806391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:14:50Z,user_data=None,user_id='4878b5a5bf184852a9ce383caa1c67a4',uuid=e10da81d-1cfd-4008-8031-bf4e8b65bf78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b22c43dc-84ca-4d63-a27f-7df2c63232b5", "address": "fa:16:3e:41:d7:06", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22c43dc-84", "ovs_interfaceid": "b22c43dc-84ca-4d63-a27f-7df2c63232b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:14:55.855533 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converting VIF {"id": "b22c43dc-84ca-4d63-a27f-7df2c63232b5", "address": "fa:16:3e:41:d7:06", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22c43dc-84", "ovs_interfaceid": "b22c43dc-84ca-4d63-a27f-7df2c63232b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:14:55.856538 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:d7:06,bridge_name='br-int',has_traffic_filtering=True,id=b22c43dc-84ca-4d63-a27f-7df2c63232b5,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22c43dc-84') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:14:55.857499 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lazy-loading 'pci_devices' on Instance uuid e10da81d-1cfd-4008-8031-bf4e8b65bf78 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:14:56.361937 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] End _get_guest_xml xml=<domain type="qemu">
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:   <uuid>e10da81d-1cfd-4008-8031-bf4e8b65bf78</uuid>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:   <name>instance-0000004f</name>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:       <nova:name>tempest-TestVolumeBootPattern-server-2091479445</nova:name>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:14:52</nova:creationTime>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:       <nova:image uuid="">
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:         <nova:user uuid="4878b5a5bf184852a9ce383caa1c67a4">tempest-TestVolumeBootPattern-1995806391-project-member</nova:user>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:         <nova:project uuid="62ebdb16aee84e22a88dfc8960debd32">tempest-TestVolumeBootPattern-1995806391</nova:project>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:       <nova:root type="volume" uuid=""/>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:         <nova:port uuid="b22c43dc-84ca-4d63-a27f-7df2c63232b5">
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:     <system>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:       <entry name="serial">e10da81d-1cfd-4008-8031-bf4e8b65bf78</entry>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:       <entry name="uuid">e10da81d-1cfd-4008-8031-bf4e8b65bf78</entry>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:     </system>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:   <os>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:   </os>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:   <features>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:   </features>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:   <devices>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/e10da81d-1cfd-4008-8031-bf4e8b65bf78/disk.config"/>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:     </disk>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:       <alias name="ua-5b77d39d-277b-4ea5-8e32-ae5edf39af8e"/>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-0"/>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:       <serial>5b77d39d-277b-4ea5-8e32-ae5edf39af8e</serial>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:     </disk>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:41:d7:06"/>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:       <target dev="tapb22c43dc-84"/>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:     </interface>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/e10da81d-1cfd-4008-8031-bf4e8b65bf78/console.log" append="off"/>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:     </serial>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:     <video>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:     </video>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:     </rng>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:   </devices>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]: </domain>
May 21 02:14:56.361937 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:14:56.364027 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Preparing to wait for external event network-vif-plugged-b22c43dc-84ca-4d63-a27f-7df2c63232b5 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:14:56.364027 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "e10da81d-1cfd-4008-8031-bf4e8b65bf78-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:14:56.364027 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "e10da81d-1cfd-4008-8031-bf4e8b65bf78-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:14:56.364027 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "e10da81d-1cfd-4008-8031-bf4e8b65bf78-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:14:56.364027 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2091479445',display_name='tempest-TestVolumeBootPattern-server-2091479445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpattern-server-2091479445',id=79,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz/RBMCwKlZOoLdoqf7XbPge9tLmyY1xo5VJlB0SNDPLDIqYhv6bRKRrq1AOl4f0antvHh+zaNlybPqLYJXPC6E7cTtqubsCy3OHGbekTwncuW9Nfz1O6qOo+1iMsXADw==',key_name='tempest-TestVolumeBootPattern-2024297378',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62ebdb16aee84e22a88dfc8960debd32',ramdisk_id='',reservation_id='r-fmf3i79q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1995806391',owner_user_name='tempest-TestVolumeBootPattern-1995806391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:14:50Z,user_data=None,user_id='4878b5a5bf184852a9ce383caa1c67a4',uuid=e10da81d-1cfd-4008-8031-bf4e8b65bf78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b22c43dc-84ca-4d63-a27f-7df2c63232b5", "address": "fa:16:3e:41:d7:06", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22c43dc-84", "ovs_interfaceid": "b22c43dc-84ca-4d63-a27f-7df2c63232b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:14:56.364027 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converting VIF {"id": "b22c43dc-84ca-4d63-a27f-7df2c63232b5", "address": "fa:16:3e:41:d7:06", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22c43dc-84", "ovs_interfaceid": "b22c43dc-84ca-4d63-a27f-7df2c63232b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:14:56.364712 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:d7:06,bridge_name='br-int',has_traffic_filtering=True,id=b22c43dc-84ca-4d63-a27f-7df2c63232b5,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22c43dc-84') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:14:56.364712 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:d7:06,bridge_name='br-int',has_traffic_filtering=True,id=b22c43dc-84ca-4d63-a27f-7df2c63232b5,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22c43dc-84') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:14:56.364925 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:56.365203 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:14:56.365568 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:14:56.366207 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:56.366353 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '47fc71cf-f38e-5dae-9b43-1fcbd9a09136', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:14:56.384071 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:56.385254 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:14:56.387048 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:56.387200 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb22c43dc-84, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:14:56.387567 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb22c43dc-84, col_values=(('qos', UUID('209a2157-66f1-42ec-8d90-e7acf7758faf')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:14:56.387726 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb22c43dc-84, col_values=(('external_ids', {'iface-id': 'b22c43dc-84ca-4d63-a27f-7df2c63232b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:d7:06', 'vm-uuid': 'e10da81d-1cfd-4008-8031-bf4e8b65bf78'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:14:56.388415 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:56.389586 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:14:56.391528 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:14:56.394576 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:56.395407 np0000001127 nova-compute[98206]: INFO os_vif [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:d7:06,bridge_name='br-int',has_traffic_filtering=True,id=b22c43dc-84ca-4d63-a27f-7df2c63232b5,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22c43dc-84')
May 21 02:14:56.397106 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:14:56.406666 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:14:56.406666 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:14:56.413119 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:14:56.413119 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:14:56.421847 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:14:56.427078 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:14:56.436051 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:14:56.436051 np0000001127 nova-compute[98206]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:14:56.436051 np0000001127 nova-compute[98206]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc (non-flash)
May 21 02:14:56.436051 np0000001127 nova-compute[98206]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:14:56.436051 np0000001127 nova-compute[98206]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:14:56.436051 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:14:56.436269 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] iscsi session list stdout=tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:14:56.436269 np0000001127 nova-compute[98206]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:14:56.436269 np0000001127 nova-compute[98206]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc (non-flash)
May 21 02:14:56.436269 np0000001127 nova-compute[98206]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:14:56.436269 np0000001127 nova-compute[98206]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:14:56.436269 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:14:56.441144 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:14:56.441144 np0000001127 nova-compute[98206]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:14:56.441144 np0000001127 nova-compute[98206]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc (non-flash)
May 21 02:14:56.441144 np0000001127 nova-compute[98206]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:14:56.441144 np0000001127 nova-compute[98206]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:14:56.441144 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:14:56.441307 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] iscsi session list stdout=tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:14:56.441307 np0000001127 nova-compute[98206]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:14:56.441307 np0000001127 nova-compute[98206]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc (non-flash)
May 21 02:14:56.441307 np0000001127 nova-compute[98206]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:14:56.441307 np0000001127 nova-compute[98206]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:14:56.441307 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:14:56.499573 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7, portal: 192.168.50.100,3260]
May 21 02:14:56.499573 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7, portal: 192.168.50.100,3260] successful.
May 21 02:14:56.499573 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:14:56.512490 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7, portal: 192.168.40.100,3260]
May 21 02:14:56.512490 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7, portal: 192.168.40.100,3260] successful.
May 21 02:14:56.512490 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:14:56.518398 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:14:56.526883 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:14:56.539692 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:14:56.539692 np0000001127 nova-compute[98206]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:14:56.539692 np0000001127 nova-compute[98206]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc (non-flash)
May 21 02:14:56.539692 np0000001127 nova-compute[98206]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:14:56.539692 np0000001127 nova-compute[98206]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:14:56.539692 np0000001127 nova-compute[98206]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7 (non-flash)
May 21 02:14:56.539692 np0000001127 nova-compute[98206]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7 (non-flash)
May 21 02:14:56.539692 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:14:56.539991 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] iscsi session list stdout=tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:14:56.539991 np0000001127 nova-compute[98206]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:14:56.539991 np0000001127 nova-compute[98206]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc (non-flash)
May 21 02:14:56.539991 np0000001127 nova-compute[98206]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:14:56.539991 np0000001127 nova-compute[98206]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:14:56.539991 np0000001127 nova-compute[98206]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7 (non-flash)
May 21 02:14:56.539991 np0000001127 nova-compute[98206]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7 (non-flash)
May 21 02:14:56.539991 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:14:56.540437 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.175s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:14:56.540574 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:14:56.542095 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] HCTL ('12', '-', '-', 0) found on session 207 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:14:56.542297 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:14:56.562269 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Searching for a device in session 207 and hctl ['12', '*', '*', 0] yield: None {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:14:56.567141 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:14:56.567141 np0000001127 nova-compute[98206]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:14:56.567141 np0000001127 nova-compute[98206]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc (non-flash)
May 21 02:14:56.567141 np0000001127 nova-compute[98206]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:14:56.567141 np0000001127 nova-compute[98206]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:14:56.567141 np0000001127 nova-compute[98206]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7 (non-flash)
May 21 02:14:56.567141 np0000001127 nova-compute[98206]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7 (non-flash)
May 21 02:14:56.567141 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:14:56.567141 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] iscsi session list stdout=tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:14:56.567141 np0000001127 nova-compute[98206]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:14:56.567141 np0000001127 nova-compute[98206]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc (non-flash)
May 21 02:14:56.567141 np0000001127 nova-compute[98206]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:14:56.567141 np0000001127 nova-compute[98206]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:14:56.567141 np0000001127 nova-compute[98206]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7 (non-flash)
May 21 02:14:56.567141 np0000001127 nova-compute[98206]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7 (non-flash)
May 21 02:14:56.567141 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:14:56.567858 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.202s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:14:56.567858 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:14:56.568401 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] HCTL ('13', '-', '-', 0) found on session 208 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:14:56.568551 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:14:56.598801 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Searching for a device in session 208 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:14:56.598930 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3b97af37-9d8c-481d-a122-06e860faf7b7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:14:57.184497 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:14:57.184907 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:14:57.184907 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.49 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:14:57.562869 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Searching for a device in session 207 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:14:57.562993 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3b97af37-9d8c-481d-a122-06e860faf7b7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:14:57.675863 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:14:57.676044 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 21 02:14:57.676277 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:14:57.910935 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:14:57.911081 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:14:57.911233 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] No VIF found with MAC fa:16:3e:41:d7:06, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:14:57.911702 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Using config drive
May 21 02:14:58.384832 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Found WWN 3300000006436fe1d for multipath device dm-6 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:14:58.385379 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:14:58.385379 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] <== connect_volume: return (5062ms) {'type': 'block', 'scsi_wwn': '3300000006436fe1d', 'path': '/dev/dm-6', 'multipath_id': '3300000006436fe1d'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:14:58.385379 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006436fe1d', 'path': '/dev/dm-6', 'multipath_id': '3300000006436fe1d'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:14:58.388246 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Lazy-loading 'flavor' on Instance uuid 8d34fd8e-f675-4985-a7fd-6585f64fb564 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:14:58.417604 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:14:58.520951 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Creating config drive at /opt/stack/data/nova/instances/e10da81d-1cfd-4008-8031-bf4e8b65bf78/disk.config
May 21 02:14:58.523789 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e10da81d-1cfd-4008-8031-bf4e8b65bf78/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpryh2h5t2 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:14:58.577364 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e10da81d-1cfd-4008-8031-bf4e8b65bf78/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpryh2h5t2" returned: 0 in 0.053s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:14:58.676144 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:14:58.891894 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Attempting to attach volume 3b97af37-9d8c-481d-a122-06e860faf7b7 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 02:14:58.893853 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] attach device xml: <disk type="block" device="disk">
May 21 02:14:58.893853 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:14:58.893853 np0000001127 nova-compute[98206]:   <alias name="ua-3b97af37-9d8c-481d-a122-06e860faf7b7"/>
May 21 02:14:58.893853 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-6"/>
May 21 02:14:58.893853 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:14:58.893853 np0000001127 nova-compute[98206]:   <serial>3b97af37-9d8c-481d-a122-06e860faf7b7</serial>
May 21 02:14:58.893853 np0000001127 nova-compute[98206]: </disk>
May 21 02:14:58.893853 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 02:14:58.931069 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:58.950507 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:58.952013 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:59.050130 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:59.068544 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-4773b6d0-5c2e-4e6c-849c-c224d2d19af5 req-10a44479-e728-42a5-b329-7e880690516f service nova] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Received event network-vif-plugged-b22c43dc-84ca-4d63-a27f-7df2c63232b5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:14:59.069035 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4773b6d0-5c2e-4e6c-849c-c224d2d19af5 req-10a44479-e728-42a5-b329-7e880690516f service nova] Acquiring lock "e10da81d-1cfd-4008-8031-bf4e8b65bf78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:14:59.069252 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4773b6d0-5c2e-4e6c-849c-c224d2d19af5 req-10a44479-e728-42a5-b329-7e880690516f service nova] Lock "e10da81d-1cfd-4008-8031-bf4e8b65bf78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:14:59.069431 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-4773b6d0-5c2e-4e6c-849c-c224d2d19af5 req-10a44479-e728-42a5-b329-7e880690516f service nova] Lock "e10da81d-1cfd-4008-8031-bf4e8b65bf78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:14:59.069594 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-4773b6d0-5c2e-4e6c-849c-c224d2d19af5 req-10a44479-e728-42a5-b329-7e880690516f service nova] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Processing event network-vif-plugged-b22c43dc-84ca-4d63-a27f-7df2c63232b5 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:14:59.070508 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:59.071251 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:14:59.181205 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:14:59.181391 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:14:59.181540 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:14:59.181670 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Auditing locally available compute resources for np0000001127 (node: np0000001127) {{(pid=98206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 21 02:14:59.677019 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329699.676626, e10da81d-1cfd-4008-8031-bf4e8b65bf78 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:14:59.677540 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] VM Started (Lifecycle Event)
May 21 02:14:59.678480 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:14:59.680830 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:14:59.683651 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Instance spawned successfully.
May 21 02:14:59.684028 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:15:00.179531 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:15:00.182206 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:15:00.190635 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:15:00.190759 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:15:00.190962 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:15:00.191131 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:15:00.191346 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:15:00.191969 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:15:00.213647 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d34fd8e-f675-4985-a7fd-6585f64fb564/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:15:00.310381 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d34fd8e-f675-4985-a7fd-6585f64fb564/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:15:00.310931 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d34fd8e-f675-4985-a7fd-6585f64fb564/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:15:00.399804 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d34fd8e-f675-4985-a7fd-6585f64fb564/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:15:00.400308 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:15:00.405064 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:15:00.408138 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:15:00.410482 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:15:00.411632 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:15:00.458993 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "env LANG=C uptime" returned: 0 in 0.047s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:15:00.459382 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Hypervisor/Node resource view: name=np0000001127 free_ram=13630MB free_disk=72.83329010009766GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 21 02:15:00.459568 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:15:00.459851 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:15:00.671173 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:15:00.671300 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:15:00.671414 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:15:00.671553 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] No VIF found with MAC fa:16:3e:71:c6:f9, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:15:00.684014 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:15:00.684513 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329700.6842792, e10da81d-1cfd-4008-8031-bf4e8b65bf78 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:15:00.684641 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] VM Paused (Lifecycle Event)
May 21 02:15:00.696526 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Took 8.41 seconds to spawn the instance on the hypervisor.
May 21 02:15:00.696756 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:15:01.144555 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-990f9e81-d074-4e4e-bb2f-7f0bbf2584ac req-c8caab13-e0fe-468e-bb77-b3a83f5fb872 service nova] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Received event network-vif-plugged-b22c43dc-84ca-4d63-a27f-7df2c63232b5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:15:01.144960 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-990f9e81-d074-4e4e-bb2f-7f0bbf2584ac req-c8caab13-e0fe-468e-bb77-b3a83f5fb872 service nova] Acquiring lock "e10da81d-1cfd-4008-8031-bf4e8b65bf78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:15:01.145152 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-990f9e81-d074-4e4e-bb2f-7f0bbf2584ac req-c8caab13-e0fe-468e-bb77-b3a83f5fb872 service nova] Lock "e10da81d-1cfd-4008-8031-bf4e8b65bf78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:15:01.145279 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-990f9e81-d074-4e4e-bb2f-7f0bbf2584ac req-c8caab13-e0fe-468e-bb77-b3a83f5fb872 service nova] Lock "e10da81d-1cfd-4008-8031-bf4e8b65bf78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:15:01.145448 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-990f9e81-d074-4e4e-bb2f-7f0bbf2584ac req-c8caab13-e0fe-468e-bb77-b3a83f5fb872 service nova] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] No waiting events found dispatching network-vif-plugged-b22c43dc-84ca-4d63-a27f-7df2c63232b5 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:15:01.145657 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-990f9e81-d074-4e4e-bb2f-7f0bbf2584ac req-c8caab13-e0fe-468e-bb77-b3a83f5fb872 service nova] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Received unexpected event network-vif-plugged-b22c43dc-84ca-4d63-a27f-7df2c63232b5 for instance with vm_state active and task_state None.
May 21 02:15:01.186737 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:15:01.189260 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329701.188956, e10da81d-1cfd-4008-8031-bf4e8b65bf78 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:15:01.189457 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] VM Resumed (Lifecycle Event)
May 21 02:15:01.219006 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Took 15.51 seconds to build instance.
May 21 02:15:01.399561 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:01.535956 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance fc403327-070b-4e21-b046-40c4160ee52b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:15:01.536108 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 8d34fd8e-f675-4985-a7fd-6585f64fb564 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:15:01.536254 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance e10da81d-1cfd-4008-8031-bf4e8b65bf78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:15:01.536626 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 21 02:15:01.536817 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Final resource view: name=np0000001127 phys_ram=24030MB used_ram=1088MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:15:00 up 45 min,  2 users,  load average: 4.02, 6.14, 5.82\n', 'num_instances': '3', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '3', 'num_proj_62ebdb16aee84e22a88dfc8960debd32': '2', 'io_workload': '1', 'num_proj_f7059ada48244a12980a5c4d8e94065d': '1', 'num_vm_building': '1', 'num_task_spawning': '1'} {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 21 02:15:01.694144 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:15:01.696150 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:15:01.722056 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9ef5f689-9f54-470e-bcdb-afb66866a3ea tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "e10da81d-1cfd-4008-8031-bf4e8b65bf78" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.029s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:15:01.753058 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:15:01.753444 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:15:02.152139 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:02.223666 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-a533719f-da9f-41fb-926f-fea03aa18df6 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Lock "8d34fd8e-f675-4985-a7fd-6585f64fb564" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.633s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:15:02.244945 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Acquiring lock "dc6b3f2e-f675-4762-94e1-07a908ca0856" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:15:02.245161 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Lock "dc6b3f2e-f675-4762-94e1-07a908ca0856" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:15:02.256541 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:15:02.747213 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:15:02.762584 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Compute_service record updated for np0000001127:np0000001127 {{(pid=98206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 21 02:15:02.764056 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.303s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:15:02.764056 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:15:02.836763 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Acquiring lock "8d34fd8e-f675-4985-a7fd-6585f64fb564" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:15:02.837012 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Lock "8d34fd8e-f675-4985-a7fd-6585f64fb564" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:15:02.934546 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cfc21a03-362f-44f5-b832-fc043ab8a50c req-872bf11b-4ca9-4bbc-ae6f-26af74fd7102 service nova] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Received event network-changed-b22c43dc-84ca-4d63-a27f-7df2c63232b5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:15:02.934918 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-cfc21a03-362f-44f5-b832-fc043ab8a50c req-872bf11b-4ca9-4bbc-ae6f-26af74fd7102 service nova] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Refreshing instance network info cache due to event network-changed-b22c43dc-84ca-4d63-a27f-7df2c63232b5. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:15:02.935130 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cfc21a03-362f-44f5-b832-fc043ab8a50c req-872bf11b-4ca9-4bbc-ae6f-26af74fd7102 service nova] Acquiring lock "refresh_cache-e10da81d-1cfd-4008-8031-bf4e8b65bf78" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:15:02.935281 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cfc21a03-362f-44f5-b832-fc043ab8a50c req-872bf11b-4ca9-4bbc-ae6f-26af74fd7102 service nova] Acquired lock "refresh_cache-e10da81d-1cfd-4008-8031-bf4e8b65bf78" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:15:02.935514 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-cfc21a03-362f-44f5-b832-fc043ab8a50c req-872bf11b-4ca9-4bbc-ae6f-26af74fd7102 service nova] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Refreshing network info cache for port b22c43dc-84ca-4d63-a27f-7df2c63232b5 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:15:03.306595 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:15:03.306858 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:15:03.309870 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:15:03.310006 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Claim successful on node np0000001127
May 21 02:15:03.339642 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Detaching volume 3b97af37-9d8c-481d-a122-06e860faf7b7
May 21 02:15:03.385155 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Attempting to driver detach volume 3b97af37-9d8c-481d-a122-06e860faf7b7 from mountpoint /dev/vdb
May 21 02:15:03.389508 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Found disk vdb by alias ua-3b97af37-9d8c-481d-a122-06e860faf7b7 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:15:03.390651 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Found disk vdb by alias ua-3b97af37-9d8c-481d-a122-06e860faf7b7 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:15:03.390770 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Attempting to detach device vdb from instance 8d34fd8e-f675-4985-a7fd-6585f64fb564 from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 02:15:03.391054 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:15:03.391054 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:15:03.391054 np0000001127 nova-compute[98206]:   <alias name="ua-3b97af37-9d8c-481d-a122-06e860faf7b7"/>
May 21 02:15:03.391054 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-6"/>
May 21 02:15:03.391054 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:15:03.391054 np0000001127 nova-compute[98206]:   <serial>3b97af37-9d8c-481d-a122-06e860faf7b7</serial>
May 21 02:15:03.391054 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:15:03.391054 np0000001127 nova-compute[98206]: </disk>
May 21 02:15:03.391054 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:15:03.398817 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Successfully detached device vdb from instance 8d34fd8e-f675-4985-a7fd-6585f64fb564 from the persistent domain config.
May 21 02:15:03.398817 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] (1/8): Attempting to detach device vdb with device alias ua-3b97af37-9d8c-481d-a122-06e860faf7b7 from instance 8d34fd8e-f675-4985-a7fd-6585f64fb564 from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 02:15:03.398817 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:15:03.398817 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:15:03.398817 np0000001127 nova-compute[98206]:   <alias name="ua-3b97af37-9d8c-481d-a122-06e860faf7b7"/>
May 21 02:15:03.398817 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-6"/>
May 21 02:15:03.398817 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:15:03.398817 np0000001127 nova-compute[98206]:   <serial>3b97af37-9d8c-481d-a122-06e860faf7b7</serial>
May 21 02:15:03.398817 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:15:03.398817 np0000001127 nova-compute[98206]: </disk>
May 21 02:15:03.398817 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:15:03.437794 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-cfc21a03-362f-44f5-b832-fc043ab8a50c req-872bf11b-4ca9-4bbc-ae6f-26af74fd7102 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:15:03.710888 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-cfc21a03-362f-44f5-b832-fc043ab8a50c req-872bf11b-4ca9-4bbc-ae6f-26af74fd7102 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:15:03.827857 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-cfc21a03-362f-44f5-b832-fc043ab8a50c req-872bf11b-4ca9-4bbc-ae6f-26af74fd7102 service nova] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Updated VIF entry in instance network info cache for port b22c43dc-84ca-4d63-a27f-7df2c63232b5. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:15:03.828237 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-cfc21a03-362f-44f5-b832-fc043ab8a50c req-872bf11b-4ca9-4bbc-ae6f-26af74fd7102 service nova] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Updating instance_info_cache with network_info: [{"id": "b22c43dc-84ca-4d63-a27f-7df2c63232b5", "address": "fa:16:3e:41:d7:06", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22c43dc-84", "ovs_interfaceid": "b22c43dc-84ca-4d63-a27f-7df2c63232b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:15:03.875423 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779329703.875069, 8d34fd8e-f675-4985-a7fd-6585f64fb564 => ua-3b97af37-9d8c-481d-a122-06e860faf7b7> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 02:15:03.877840 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-3b97af37-9d8c-481d-a122-06e860faf7b7 for instance 8d34fd8e-f675-4985-a7fd-6585f64fb564 {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 02:15:03.880627 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Successfully detached device vdb from instance 8d34fd8e-f675-4985-a7fd-6585f64fb564 from the live domain config.
May 21 02:15:03.881808 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:15:03.882187 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7', 'iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3b97af37-9d8c-481d-a122-06e860faf7b7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:15:03.882422 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:15:03.882961 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:15:03.883382 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7', 'iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3b97af37-9d8c-481d-a122-06e860faf7b7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:15:03.883593 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:15:03.915193 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:15:03.915193 np0000001127 nova-compute[98206]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:15:03.915193 np0000001127 nova-compute[98206]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:15:03.915193 np0000001127 nova-compute[98206]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:15:03.915193 np0000001127 nova-compute[98206]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7 (non-flash)
May 21 02:15:03.915193 np0000001127 nova-compute[98206]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7 (non-flash)
May 21 02:15:03.915193 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:15:03.915496 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] iscsi session list stdout=tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:15:03.915496 np0000001127 nova-compute[98206]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:15:03.915496 np0000001127 nova-compute[98206]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:15:03.915496 np0000001127 nova-compute[98206]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:15:03.915496 np0000001127 nova-compute[98206]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7 (non-flash)
May 21 02:15:03.915496 np0000001127 nova-compute[98206]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7 (non-flash)
May 21 02:15:03.915496 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:15:03.915677 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', '199'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', '200'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e', '205'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e', '206'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7', '207'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7', '208')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:15:03.915803 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7', '208')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:15:03.916968 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7', '207')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:15:03.917923 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c0585777e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7'): ({'sdg'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:15:03.918202 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Removing multipathed devices sdh, sdg {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:15:03.918560 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Flush multipath device 3300000006436fe1d {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:15:03.972137 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:15:04.023263 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:15:04.063921 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Checking to see if SCSI volumes sdh, sdg have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:15:04.064110 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] SCSI volumes sdh, sdg have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:15:04.065212 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Checking to see if device paths {'sdh', 'sdg'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:15:04.077342 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Device paths {'sdh', 'sdg'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:15:04.077563 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:15:04.089446 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:15:04.121509 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 208, target: iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7, portal: 192.168.40.100,3260]
May 21 02:15:04.121509 np0000001127 nova-compute[98206]: Logout of [sid: 208, target: iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7, portal: 192.168.40.100,3260] successful.
May 21 02:15:04.121509 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:15:04.136349 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:15:04.147869 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:15:04.179066 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 207, target: iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7, portal: 192.168.50.100,3260]
May 21 02:15:04.179066 np0000001127 nova-compute[98206]: Logout of [sid: 207, target: iqn.2023-03.storpool.com:os--volume-3b97af37-9d8c-481d-a122-06e860faf7b7, portal: 192.168.50.100,3260] successful.
May 21 02:15:04.179066 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:15:04.197629 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:15:04.197918 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:15:04.198084 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] <== disconnect_volume: return (315ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:15:04.198258 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:15:04.330230 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-cfc21a03-362f-44f5-b832-fc043ab8a50c req-872bf11b-4ca9-4bbc-ae6f-26af74fd7102 service nova] Releasing lock "refresh_cache-e10da81d-1cfd-4008-8031-bf4e8b65bf78" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:15:04.535022 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:15:04.535344 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:15:04.754430 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Lazy-loading 'flavor' on Instance uuid 8d34fd8e-f675-4985-a7fd-6585f64fb564 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:15:05.039851 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:15:05.185355 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:15:05.549543 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.243s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:15:05.549919 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:15:05.759554 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-28ff399e-969b-4b4e-b220-4eb9d7190481 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Lock "8d34fd8e-f675-4985-a7fd-6585f64fb564" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.922s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:15:05.762951 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:15:05.763257 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:15:05.763498 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:15:05.763719 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:15:05.763919 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:15:05.764173 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.91 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:15:06.055852 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:15:06.056366 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:15:06.056436 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:15:06.056626 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:15:06.118432 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6f8b40fd3e214d9bbc80ace17793bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fed5824d3e4977ae92fea21fee8a62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:15:06.410106 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:06.487445 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Successfully created port: 7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:15:06.558847 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:15:06.914377 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Successfully updated port: 7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:15:06.955209 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e3eae074-81de-421c-a4ef-451294709413 req-b362af62-8279-4395-8cdd-5cde63dc7ad6 service nova] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Received event network-changed-7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:15:06.955754 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e3eae074-81de-421c-a4ef-451294709413 req-b362af62-8279-4395-8cdd-5cde63dc7ad6 service nova] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Refreshing instance network info cache due to event network-changed-7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:15:06.955895 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e3eae074-81de-421c-a4ef-451294709413 req-b362af62-8279-4395-8cdd-5cde63dc7ad6 service nova] Acquiring lock "refresh_cache-dc6b3f2e-f675-4762-94e1-07a908ca0856" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:15:06.955976 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e3eae074-81de-421c-a4ef-451294709413 req-b362af62-8279-4395-8cdd-5cde63dc7ad6 service nova] Acquired lock "refresh_cache-dc6b3f2e-f675-4762-94e1-07a908ca0856" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:15:06.956074 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-e3eae074-81de-421c-a4ef-451294709413 req-b362af62-8279-4395-8cdd-5cde63dc7ad6 service nova] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Refreshing network info cache for port 7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:15:07.152823 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:07.194705 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3cbd675b-4af9-40dd-8568-df7621644b76 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Acquiring lock "8d34fd8e-f675-4985-a7fd-6585f64fb564" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:15:07.194893 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3cbd675b-4af9-40dd-8568-df7621644b76 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Lock "8d34fd8e-f675-4985-a7fd-6585f64fb564" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:15:07.195034 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3cbd675b-4af9-40dd-8568-df7621644b76 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Acquiring lock "8d34fd8e-f675-4985-a7fd-6585f64fb564-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:15:07.195188 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3cbd675b-4af9-40dd-8568-df7621644b76 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Lock "8d34fd8e-f675-4985-a7fd-6585f64fb564-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:15:07.195347 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3cbd675b-4af9-40dd-8568-df7621644b76 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Lock "8d34fd8e-f675-4985-a7fd-6585f64fb564-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:15:07.200484 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-3cbd675b-4af9-40dd-8568-df7621644b76 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Terminating instance
May 21 02:15:07.416315 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Acquiring lock "refresh_cache-dc6b3f2e-f675-4762-94e1-07a908ca0856" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:15:07.457719 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-e3eae074-81de-421c-a4ef-451294709413 req-b362af62-8279-4395-8cdd-5cde63dc7ad6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:15:07.512845 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-e3eae074-81de-421c-a4ef-451294709413 req-b362af62-8279-4395-8cdd-5cde63dc7ad6 service nova] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:15:07.563544 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:15:07.655001 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-e3eae074-81de-421c-a4ef-451294709413 req-b362af62-8279-4395-8cdd-5cde63dc7ad6 service nova] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:15:07.703678 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-3cbd675b-4af9-40dd-8568-df7621644b76 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:15:07.726766 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:07.728369 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:07.741859 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:07.754938 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:07.771977 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:07.778531 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:07.988564 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:07.992914 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:08.015008 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999722454999755 future=<Future at 0x71c05865e690 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:15:08.015409 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999311322999802 future=<Future at 0x71c05865e690 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:15:08.015525 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999163729999964 future=<Future at 0x71c05865e690 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:15:08.016179 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Instance destroyed successfully.
May 21 02:15:08.016558 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-3cbd675b-4af9-40dd-8568-df7621644b76 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Lazy-loading 'resources' on Instance uuid 8d34fd8e-f675-4985-a7fd-6585f64fb564 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:15:08.067417 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Booting with volume 971ff068-b3ff-46f3-90d6-d84b741ceffc at /dev/vdb
May 21 02:15:08.098898 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:15:08.109300 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:15:08.126794 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:15:08.157908 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-e3eae074-81de-421c-a4ef-451294709413 req-b362af62-8279-4395-8cdd-5cde63dc7ad6 service nova] Releasing lock "refresh_cache-dc6b3f2e-f675-4762-94e1-07a908ca0856" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:15:08.158587 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Acquired lock "refresh_cache-dc6b3f2e-f675-4762-94e1-07a908ca0856" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:15:08.158816 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:15:08.172329 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:15:08.172542 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:15:08.180745 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:15:08.181545 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe0e:cfbf', 'fe80::c44d:25ff:fe10:25cb', 'fe80::fc16:3eff:fe41:d706'] 
May 21 02:15:08.181655 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:15:08.181802 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:15:08.182021 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] <== get_connector_properties: return (83ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:15:08.182194 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Updating existing volume attachment record: b6fca9e4-659e-4dd6-8386-81dbc118d718 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:15:08.518787 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-3cbd675b-4af9-40dd-8568-df7621644b76 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:14:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-296391358',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-296391358',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testservervolumeattachscenariooldversion-server-2963913',id=78,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGdEA1dTCPAXD5f2EpzETT/wqRD3nC+82m8+/StMOB3h3K4q3amu1RHwgLr4Zxb86RXIRT2bCPE/f+c/fyaAw8L/h68AZOMj9nfThhx8BOWeVfpr2fCUG2LpOTrDQzYwA==',key_name='tempest-keypair-1694102721',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:14:20Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7059ada48244a12980a5c4d8e94065d',ramdisk_id='',reservation_id='r-te52i2kj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1477779907',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:14:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a8b2e6269a94a5e9239d4e81a8c1572',uuid=8d34fd8e-f675-4985-a7fd-6585f64fb564,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2f43a39-47c9-41b3-b086-2850004b4ef1", "address": "fa:16:3e:71:c6:f9", "network": {"id": "53e9bcc4-7bd1-473a-8c01-77a5f489cbbd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1923048437-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7059ada48244a12980a5c4d8e94065d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2f43a39-47", "ovs_interfaceid": "a2f43a39-47c9-41b3-b086-2850004b4ef1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:15:08.519051 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-3cbd675b-4af9-40dd-8568-df7621644b76 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Converting VIF {"id": "a2f43a39-47c9-41b3-b086-2850004b4ef1", "address": "fa:16:3e:71:c6:f9", "network": {"id": "53e9bcc4-7bd1-473a-8c01-77a5f489cbbd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1923048437-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7059ada48244a12980a5c4d8e94065d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2f43a39-47", "ovs_interfaceid": "a2f43a39-47c9-41b3-b086-2850004b4ef1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:15:08.519732 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-3cbd675b-4af9-40dd-8568-df7621644b76 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:c6:f9,bridge_name='br-int',has_traffic_filtering=True,id=a2f43a39-47c9-41b3-b086-2850004b4ef1,network=Network(53e9bcc4-7bd1-473a-8c01-77a5f489cbbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2f43a39-47') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:15:08.519967 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-3cbd675b-4af9-40dd-8568-df7621644b76 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:c6:f9,bridge_name='br-int',has_traffic_filtering=True,id=a2f43a39-47c9-41b3-b086-2850004b4ef1,network=Network(53e9bcc4-7bd1-473a-8c01-77a5f489cbbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2f43a39-47') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:15:08.521378 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:08.521754 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2f43a39-47, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:15:08.522825 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:08.523600 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:15:08.523919 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:08.524487 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:08.524631 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a896976e-7c4c-4a79-abcc-c061d8263e34) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:15:08.524979 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:08.525399 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:15:08.525776 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:08.527284 np0000001127 nova-compute[98206]: INFO os_vif [None req-3cbd675b-4af9-40dd-8568-df7621644b76 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:c6:f9,bridge_name='br-int',has_traffic_filtering=True,id=a2f43a39-47c9-41b3-b086-2850004b4ef1,network=Network(53e9bcc4-7bd1-473a-8c01-77a5f489cbbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2f43a39-47')
May 21 02:15:08.527558 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-3cbd675b-4af9-40dd-8568-df7621644b76 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Deleting instance files /opt/stack/data/nova/instances/8d34fd8e-f675-4985-a7fd-6585f64fb564_del
May 21 02:15:08.528307 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-3cbd675b-4af9-40dd-8568-df7621644b76 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Deletion of /opt/stack/data/nova/instances/8d34fd8e-f675-4985-a7fd-6585f64fb564_del complete
May 21 02:15:08.714002 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:15:08.875545 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:15:08.990893 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Updating instance_info_cache with network_info: [{"id": "7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f", "address": "fa:16:3e:d9:5c:86", "network": {"id": "fbfc0ab2-7514-4590-ba01-9d5a9ceb8de0", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1081082163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20fed5824d3e4977ae92fea21fee8a62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7db0bdc2-be", "ovs_interfaceid": "7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:15:09.005986 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-957bb06d-7c3f-4e19-8e3b-06c1dcbeba7d req-a38d7f0e-6eee-4846-b74a-6637b49a427d service nova] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Received event network-vif-unplugged-a2f43a39-47c9-41b3-b086-2850004b4ef1 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:15:09.006741 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-957bb06d-7c3f-4e19-8e3b-06c1dcbeba7d req-a38d7f0e-6eee-4846-b74a-6637b49a427d service nova] Acquiring lock "8d34fd8e-f675-4985-a7fd-6585f64fb564-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:15:09.007623 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-957bb06d-7c3f-4e19-8e3b-06c1dcbeba7d req-a38d7f0e-6eee-4846-b74a-6637b49a427d service nova] Lock "8d34fd8e-f675-4985-a7fd-6585f64fb564-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:15:09.007977 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-957bb06d-7c3f-4e19-8e3b-06c1dcbeba7d req-a38d7f0e-6eee-4846-b74a-6637b49a427d service nova] Lock "8d34fd8e-f675-4985-a7fd-6585f64fb564-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:15:09.008136 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-957bb06d-7c3f-4e19-8e3b-06c1dcbeba7d req-a38d7f0e-6eee-4846-b74a-6637b49a427d service nova] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] No waiting events found dispatching network-vif-unplugged-a2f43a39-47c9-41b3-b086-2850004b4ef1 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:15:09.008201 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-957bb06d-7c3f-4e19-8e3b-06c1dcbeba7d req-a38d7f0e-6eee-4846-b74a-6637b49a427d service nova] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Received event network-vif-unplugged-a2f43a39-47c9-41b3-b086-2850004b4ef1 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:15:09.008311 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-957bb06d-7c3f-4e19-8e3b-06c1dcbeba7d req-a38d7f0e-6eee-4846-b74a-6637b49a427d service nova] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Received event network-vif-unplugged-a2f43a39-47c9-41b3-b086-2850004b4ef1 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:15:09.008434 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-957bb06d-7c3f-4e19-8e3b-06c1dcbeba7d req-a38d7f0e-6eee-4846-b74a-6637b49a427d service nova] Acquiring lock "8d34fd8e-f675-4985-a7fd-6585f64fb564-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:15:09.008602 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-957bb06d-7c3f-4e19-8e3b-06c1dcbeba7d req-a38d7f0e-6eee-4846-b74a-6637b49a427d service nova] Lock "8d34fd8e-f675-4985-a7fd-6585f64fb564-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:15:09.008744 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-957bb06d-7c3f-4e19-8e3b-06c1dcbeba7d req-a38d7f0e-6eee-4846-b74a-6637b49a427d service nova] Lock "8d34fd8e-f675-4985-a7fd-6585f64fb564-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:15:09.008793 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-957bb06d-7c3f-4e19-8e3b-06c1dcbeba7d req-a38d7f0e-6eee-4846-b74a-6637b49a427d service nova] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] No waiting events found dispatching network-vif-unplugged-a2f43a39-47c9-41b3-b086-2850004b4ef1 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:15:09.008887 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-957bb06d-7c3f-4e19-8e3b-06c1dcbeba7d req-a38d7f0e-6eee-4846-b74a-6637b49a427d service nova] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Received event network-vif-unplugged-a2f43a39-47c9-41b3-b086-2850004b4ef1 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:15:09.036044 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-3cbd675b-4af9-40dd-8568-df7621644b76 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Took 1.33 seconds to destroy the instance on the hypervisor.
May 21 02:15:09.036809 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-3cbd675b-4af9-40dd-8568-df7621644b76 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:15:09.037094 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:15:09.037207 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:15:09.037455 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:15:09.097711 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:15:09.492795 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Releasing lock "refresh_cache-dc6b3f2e-f675-4762-94e1-07a908ca0856" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:15:09.493205 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Instance network_info: |[{"id": "7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f", "address": "fa:16:3e:d9:5c:86", "network": {"id": "fbfc0ab2-7514-4590-ba01-9d5a9ceb8de0", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1081082163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20fed5824d3e4977ae92fea21fee8a62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7db0bdc2-be", "ovs_interfaceid": "7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:15:09.523063 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d84b3722-b189-42f4-9318-995e87ca6170 req-8164585f-4693-4e61-b1c8-0590563cbe18 service nova] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Received event network-vif-deleted-a2f43a39-47c9-41b3-b086-2850004b4ef1 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:15:09.523602 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-d84b3722-b189-42f4-9318-995e87ca6170 req-8164585f-4693-4e61-b1c8-0590563cbe18 service nova] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Neutron deleted interface a2f43a39-47c9-41b3-b086-2850004b4ef1; detaching it from the instance and deleting it from the info cache
May 21 02:15:09.523734 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-d84b3722-b189-42f4-9318-995e87ca6170 req-8164585f-4693-4e61-b1c8-0590563cbe18 service nova] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:15:09.985143 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:15:10.026855 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d84b3722-b189-42f4-9318-995e87ca6170 req-8164585f-4693-4e61-b1c8-0590563cbe18 service nova] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Detach interface failed, port_id=a2f43a39-47c9-41b3-b086-2850004b4ef1, reason: Instance 8d34fd8e-f675-4985-a7fd-6585f64fb564 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:15:10.278850 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:15:10.282334 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:15:10.282334 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Creating image(s)
May 21 02:15:10.282334 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Acquiring lock "/opt/stack/data/nova/instances/dc6b3f2e-f675-4762-94e1-07a908ca0856/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:15:10.282334 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Lock "/opt/stack/data/nova/instances/dc6b3f2e-f675-4762-94e1-07a908ca0856/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:15:10.283049 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Lock "/opt/stack/data/nova/instances/dc6b3f2e-f675-4762-94e1-07a908ca0856/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:15:10.283672 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:15:10.286204 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:15:10.287232 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:15:10.383925 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.096s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:15:10.387485 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:15:10.387485 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:15:10.387485 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:15:10.388446 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:15:10.388838 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:15:10.479376 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.090s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:15:10.479818 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/dc6b3f2e-f675-4762-94e1-07a908ca0856/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:15:10.493777 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Took 1.46 seconds to deallocate network for instance.
May 21 02:15:10.540953 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/dc6b3f2e-f675-4762-94e1-07a908ca0856/disk 1073741824" returned: 0 in 0.061s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:15:10.541377 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.156s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:15:10.541725 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:15:10.628457 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.086s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:15:10.628832 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dc6b3f2e-f675-4762-94e1-07a908ca0856/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:15:10.629060 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc6b3f2e-f675-4762-94e1-07a908ca0856/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:15:10.714191 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc6b3f2e-f675-4762-94e1-07a908ca0856/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:15:10.714636 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Cannot resize image /opt/stack/data/nova/instances/dc6b3f2e-f675-4762-94e1-07a908ca0856/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:15:10.715034 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:15:10.715208 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Ensure instance console log exists: /opt/stack/data/nova/instances/dc6b3f2e-f675-4762-94e1-07a908ca0856/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:15:10.715530 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:15:10.715766 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:15:10.715899 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:15:10.719090 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Start _get_guest_xml network_info=[{"id": "7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f", "address": "fa:16:3e:d9:5c:86", "network": {"id": "fbfc0ab2-7514-4590-ba01-9d5a9ceb8de0", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1081082163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20fed5824d3e4977ae92fea21fee8a62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7db0bdc2-be", "ovs_interfaceid": "7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': -1, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc', 'iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '971ff068-b3ff-46f3-90d6-d84b741ceffc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'dc6b3f2e-f675-4762-94e1-07a908ca0856', 'attached_at': '', 'detached_at': '', 'volume_id': '971ff068-b3ff-46f3-90d6-d84b741ceffc', 'serial': '971ff068-b3ff-46f3-90d6-d84b741ceffc'}, 'delete_on_termination': False, 'attachment_id': 'b6fca9e4-659e-4dd6-8386-81dbc118d718', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:15:10.723751 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:15:10.725325 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-instance-1494598512', uuid='dc6b3f2e-f675-4762-94e1-07a908ca0856'), owner=OwnerMeta(userid='6f8b40fd3e214d9bbc80ace17793bc0c', username='tempest-VolumesBackupsTest-1074905684-project-member', projectid='20fed5824d3e4977ae92fea21fee8a62', projectname='tempest-VolumesBackupsTest-1074905684'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f", "address": "fa:16:3e:d9:5c:86", "network": {"id": "fbfc0ab2-7514-4590-ba01-9d5a9ceb8de0", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1081082163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20fed5824d3e4977ae92fea21fee8a62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7db0bdc2-be", "ovs_interfaceid": "7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329710.7249115) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:15:10.726685 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:15:10.730536 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:15:10.730536 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:15:10.730536 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:15:10.730536 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:15:10.730536 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:15:10.730536 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:15:10.730536 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:15:10.730536 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:15:10.730536 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:15:10.730536 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:15:10.730536 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:15:10.730536 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:15:10.730975 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:15:10.730975 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:15:10.730975 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:15:10.742262 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:15:10.742670 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc', 'iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '971ff068-b3ff-46f3-90d6-d84b741ceffc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:15:10.742815 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:15:10.743237 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:15:10.743521 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc', 'iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '971ff068-b3ff-46f3-90d6-d84b741ceffc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:15:10.755316 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:15:10.755918 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:15:10.756398 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:15:10.756640 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:15:10.757143 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:15:10.757375 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:15:10.770834 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:15:10.770834 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:15:10.772904 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:15:10.772904 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:15:10.782966 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc] added
May 21 02:15:10.782966 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:15:10.782966 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:15:10.782966 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:15:10.782966 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:15:10.782966 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:15:10.782966 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:15:10.783550 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:15:10.783550 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0267(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:15:10.783708 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:15:10.786922 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc] added
May 21 02:15:10.786922 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:15:10.786922 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:15:10.786922 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:15:10.786922 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:15:10.786922 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:15:10.786922 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:15:10.787356 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:15:10.787356 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0299(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:15:10.787356 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:15:11.003450 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3cbd675b-4af9-40dd-8568-df7621644b76 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:15:11.003801 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3cbd675b-4af9-40dd-8568-df7621644b76 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:15:11.223150 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3cbd675b-4af9-40dd-8568-df7621644b76 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:15:11.223412 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-3cbd675b-4af9-40dd-8568-df7621644b76 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:15:11.726003 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-3cbd675b-4af9-40dd-8568-df7621644b76 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:15:11.784038 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:15:11.789848 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:15:11.798499 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:15:11.798499 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:15:11.804643 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:15:11.804643 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:15:11.813171 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:15:11.819887 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:15:11.827900 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:15:11.827900 np0000001127 nova-compute[98206]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:15:11.827900 np0000001127 nova-compute[98206]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:15:11.827900 np0000001127 nova-compute[98206]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:15:11.827900 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:15:11.828102 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] iscsi session list stdout=tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:15:11.828102 np0000001127 nova-compute[98206]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:15:11.828102 np0000001127 nova-compute[98206]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:15:11.828102 np0000001127 nova-compute[98206]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:15:11.828102 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:15:11.837357 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:15:11.837357 np0000001127 nova-compute[98206]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:15:11.837357 np0000001127 nova-compute[98206]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:15:11.837357 np0000001127 nova-compute[98206]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:15:11.837357 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:15:11.837618 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] iscsi session list stdout=tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:15:11.837618 np0000001127 nova-compute[98206]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:15:11.837618 np0000001127 nova-compute[98206]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:15:11.837618 np0000001127 nova-compute[98206]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:15:11.837618 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:15:11.856954 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc, portal: 192.168.40.100,3260]
May 21 02:15:11.856954 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc, portal: 192.168.40.100,3260] successful.
May 21 02:15:11.856954 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:15:11.869084 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:15:11.885814 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc, portal: 192.168.50.100,3260]
May 21 02:15:11.885814 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc, portal: 192.168.50.100,3260] successful.
May 21 02:15:11.885814 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:15:11.886485 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:15:11.886485 np0000001127 nova-compute[98206]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:15:11.886485 np0000001127 nova-compute[98206]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:15:11.886485 np0000001127 nova-compute[98206]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:15:11.886485 np0000001127 nova-compute[98206]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc (non-flash)
May 21 02:15:11.886485 np0000001127 nova-compute[98206]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc (non-flash)
May 21 02:15:11.886485 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:15:11.886773 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] iscsi session list stdout=tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:15:11.886773 np0000001127 nova-compute[98206]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:15:11.886773 np0000001127 nova-compute[98206]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:15:11.886773 np0000001127 nova-compute[98206]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:15:11.886773 np0000001127 nova-compute[98206]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc (non-flash)
May 21 02:15:11.886773 np0000001127 nova-compute[98206]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc (non-flash)
May 21 02:15:11.886773 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:15:11.887123 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.131s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:15:11.887249 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:15:11.888206 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] HCTL ('7', '-', '-', 0) found on session 209 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:15:11.888420 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:15:11.899484 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:15:11.911860 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Searching for a device in session 209 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:15:11.912064 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '971ff068-b3ff-46f3-90d6-d84b741ceffc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:15:11.917274 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:15:11.917274 np0000001127 nova-compute[98206]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:15:11.917274 np0000001127 nova-compute[98206]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:15:11.917274 np0000001127 nova-compute[98206]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:15:11.917274 np0000001127 nova-compute[98206]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc (non-flash)
May 21 02:15:11.917274 np0000001127 nova-compute[98206]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc (non-flash)
May 21 02:15:11.917274 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:15:11.917274 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] iscsi session list stdout=tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:15:11.917274 np0000001127 nova-compute[98206]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:15:11.917274 np0000001127 nova-compute[98206]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:15:11.917274 np0000001127 nova-compute[98206]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:15:11.917274 np0000001127 nova-compute[98206]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc (non-flash)
May 21 02:15:11.917274 np0000001127 nova-compute[98206]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc (non-flash)
May 21 02:15:11.917274 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:15:11.917274 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.159s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:15:11.917274 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:15:11.917274 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] HCTL ('12', '-', '-', 0) found on session 210 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:15:11.917274 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:15:11.932234 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Searching for a device in session 210 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:15:11.932349 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '971ff068-b3ff-46f3-90d6-d84b741ceffc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:15:12.153618 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:12.232710 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3cbd675b-4af9-40dd-8568-df7621644b76 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.229s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:15:12.275145 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-3cbd675b-4af9-40dd-8568-df7621644b76 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Deleted allocations for instance 8d34fd8e-f675-4985-a7fd-6585f64fb564
May 21 02:15:12.757856 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:15:13.282908 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3cbd675b-4af9-40dd-8568-df7621644b76 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907 tempest-TestServerVolumeAttachScenarioOldVersion-1477779907-project-member] Lock "8d34fd8e-f675-4985-a7fd-6585f64fb564" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.088s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:15:13.526203 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:13.774145 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Found WWN 330000000e93187e8 for multipath device dm-6 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:15:13.774873 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:15:13.774873 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '330000000e93187e8', 'path': '/dev/dm-6', 'multipath_id': '330000000e93187e8'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:15:13.774873 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e93187e8', 'path': '/dev/dm-6', 'multipath_id': '330000000e93187e8'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:15:14.280109 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:15:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-instance-1494598512',display_name='tempest-instance-1494598512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-instance-1494598512',id=80,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEelSjE5zck+oo1q8RJoBMScSVj8tl0etR0zGgVK3KZ2Vw6/QW/n0cSWdYYTcAFCrM0blNSscNvIh8faFmAhdSSoSsU/o0ATI3oSuLCcJQ0cumUDtrx1ffiymP9OZB3alw==',key_name='tempest-keypair-123803963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20fed5824d3e4977ae92fea21fee8a62',ramdisk_id='',reservation_id='r-w95febsa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-1074905684',owner_user_name='tempest-VolumesBackupsTest-1074905684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:15:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f8b40fd3e214d9bbc80ace17793bc0c',uuid=dc6b3f2e-f675-4762-94e1-07a908ca0856,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f", "address": "fa:16:3e:d9:5c:86", "network": {"id": "fbfc0ab2-7514-4590-ba01-9d5a9ceb8de0", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1081082163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20fed5824d3e4977ae92fea21fee8a62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7db0bdc2-be", "ovs_interfaceid": "7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:15:14.280399 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Converting VIF {"id": "7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f", "address": "fa:16:3e:d9:5c:86", "network": {"id": "fbfc0ab2-7514-4590-ba01-9d5a9ceb8de0", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1081082163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20fed5824d3e4977ae92fea21fee8a62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7db0bdc2-be", "ovs_interfaceid": "7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:15:14.281010 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:5c:86,bridge_name='br-int',has_traffic_filtering=True,id=7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f,network=Network(fbfc0ab2-7514-4590-ba01-9d5a9ceb8de0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7db0bdc2-be') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:15:14.281657 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Lazy-loading 'pci_devices' on Instance uuid dc6b3f2e-f675-4762-94e1-07a908ca0856 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:15:14.784560 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] End _get_guest_xml xml=<domain type="qemu">
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:   <uuid>dc6b3f2e-f675-4762-94e1-07a908ca0856</uuid>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:   <name>instance-00000050</name>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:       <nova:name>tempest-instance-1494598512</nova:name>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:15:10</nova:creationTime>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:         <nova:user uuid="6f8b40fd3e214d9bbc80ace17793bc0c">tempest-VolumesBackupsTest-1074905684-project-member</nova:user>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:         <nova:project uuid="20fed5824d3e4977ae92fea21fee8a62">tempest-VolumesBackupsTest-1074905684</nova:project>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:         <nova:port uuid="7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f">
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:     <system>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:       <entry name="serial">dc6b3f2e-f675-4762-94e1-07a908ca0856</entry>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:       <entry name="uuid">dc6b3f2e-f675-4762-94e1-07a908ca0856</entry>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:     </system>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:   <os>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:   </os>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:   <features>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:   </features>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:   <devices>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/dc6b3f2e-f675-4762-94e1-07a908ca0856/disk"/>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:     </disk>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/dc6b3f2e-f675-4762-94e1-07a908ca0856/disk.config"/>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:     </disk>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:     <disk type="block" device="disk">
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:       <alias name="ua-971ff068-b3ff-46f3-90d6-d84b741ceffc"/>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:       <source dev="/dev/dm-6"/>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:       <target dev="vdb" bus="virtio"/>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:       <serial>971ff068-b3ff-46f3-90d6-d84b741ceffc</serial>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:     </disk>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:d9:5c:86"/>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:       <target dev="tap7db0bdc2-be"/>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:     </interface>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/dc6b3f2e-f675-4762-94e1-07a908ca0856/console.log" append="off"/>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:     </serial>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:     <video>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:     </video>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:     </rng>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:   </devices>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]: </domain>
May 21 02:15:14.784560 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:15:14.787083 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Preparing to wait for external event network-vif-plugged-7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:15:14.787083 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Acquiring lock "dc6b3f2e-f675-4762-94e1-07a908ca0856-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:15:14.787083 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Lock "dc6b3f2e-f675-4762-94e1-07a908ca0856-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:15:14.787083 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Lock "dc6b3f2e-f675-4762-94e1-07a908ca0856-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:15:14.787083 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:15:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-instance-1494598512',display_name='tempest-instance-1494598512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-instance-1494598512',id=80,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEelSjE5zck+oo1q8RJoBMScSVj8tl0etR0zGgVK3KZ2Vw6/QW/n0cSWdYYTcAFCrM0blNSscNvIh8faFmAhdSSoSsU/o0ATI3oSuLCcJQ0cumUDtrx1ffiymP9OZB3alw==',key_name='tempest-keypair-123803963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20fed5824d3e4977ae92fea21fee8a62',ramdisk_id='',reservation_id='r-w95febsa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-1074905684',owner_user_name='tempest-VolumesBackupsTest-1074905684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:15:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f8b40fd3e214d9bbc80ace17793bc0c',uuid=dc6b3f2e-f675-4762-94e1-07a908ca0856,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f", "address": "fa:16:3e:d9:5c:86", "network": {"id": "fbfc0ab2-7514-4590-ba01-9d5a9ceb8de0", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1081082163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20fed5824d3e4977ae92fea21fee8a62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7db0bdc2-be", "ovs_interfaceid": "7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:15:14.787083 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Converting VIF {"id": "7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f", "address": "fa:16:3e:d9:5c:86", "network": {"id": "fbfc0ab2-7514-4590-ba01-9d5a9ceb8de0", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1081082163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20fed5824d3e4977ae92fea21fee8a62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7db0bdc2-be", "ovs_interfaceid": "7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:15:14.787083 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:5c:86,bridge_name='br-int',has_traffic_filtering=True,id=7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f,network=Network(fbfc0ab2-7514-4590-ba01-9d5a9ceb8de0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7db0bdc2-be') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:15:14.787083 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:5c:86,bridge_name='br-int',has_traffic_filtering=True,id=7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f,network=Network(fbfc0ab2-7514-4590-ba01-9d5a9ceb8de0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7db0bdc2-be') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:15:14.787452 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:14.788640 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:15:14.788640 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:15:14.788640 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:14.788640 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5c15574a-2665-5422-aadd-3e5a5e4cda92', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:15:14.807367 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:14.807367 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:15:14.809393 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:14.809603 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7db0bdc2-be, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:15:14.809902 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7db0bdc2-be, col_values=(('qos', UUID('a7c68396-8305-416b-9a34-4d1fffe5f5c9')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:15:14.810317 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7db0bdc2-be, col_values=(('external_ids', {'iface-id': '7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:5c:86', 'vm-uuid': 'dc6b3f2e-f675-4762-94e1-07a908ca0856'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:15:14.811987 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:14.812155 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:15:14.817859 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:14.818239 np0000001127 nova-compute[98206]: INFO os_vif [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:5c:86,bridge_name='br-int',has_traffic_filtering=True,id=7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f,network=Network(fbfc0ab2-7514-4590-ba01-9d5a9ceb8de0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7db0bdc2-be')
May 21 02:15:15.206430 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:16.333831 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:15:16.334279 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:15:16.334279 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:15:16.334279 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] No VIF found with MAC fa:16:3e:d9:5c:86, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:15:16.334458 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Using config drive
May 21 02:15:16.764456 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:16.839169 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:15:16.940490 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Creating config drive at /opt/stack/data/nova/instances/dc6b3f2e-f675-4762-94e1-07a908ca0856/disk.config
May 21 02:15:16.944941 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/dc6b3f2e-f675-4762-94e1-07a908ca0856/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0hoe258k {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:15:17.003276 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/dc6b3f2e-f675-4762-94e1-07a908ca0856/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0hoe258k" returned: 0 in 0.058s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:15:17.168242 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:17.414036 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:17.434155 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:17.436407 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:17.526746 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:17.581421 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-ccdfa981-517a-409e-9367-7679d37f946f req-abbe3224-2745-45ff-916d-7f368cd3b56f service nova] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Received event network-vif-plugged-7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:15:17.581809 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ccdfa981-517a-409e-9367-7679d37f946f req-abbe3224-2745-45ff-916d-7f368cd3b56f service nova] Acquiring lock "dc6b3f2e-f675-4762-94e1-07a908ca0856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:15:17.581944 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ccdfa981-517a-409e-9367-7679d37f946f req-abbe3224-2745-45ff-916d-7f368cd3b56f service nova] Lock "dc6b3f2e-f675-4762-94e1-07a908ca0856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:15:17.582097 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-ccdfa981-517a-409e-9367-7679d37f946f req-abbe3224-2745-45ff-916d-7f368cd3b56f service nova] Lock "dc6b3f2e-f675-4762-94e1-07a908ca0856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:15:17.582264 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-ccdfa981-517a-409e-9367-7679d37f946f req-abbe3224-2745-45ff-916d-7f368cd3b56f service nova] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Processing event network-vif-plugged-7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:15:17.715027 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:17.718342 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:17.734046 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:18.167715 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329718.167248, dc6b3f2e-f675-4762-94e1-07a908ca0856 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:15:18.167902 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] VM Started (Lifecycle Event)
May 21 02:15:18.170504 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:15:18.173012 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:15:18.176292 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Instance spawned successfully.
May 21 02:15:18.176730 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:15:18.672424 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:15:18.674370 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:15:18.686185 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:15:18.688375 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:15:18.688375 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:15:18.688375 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:15:18.688375 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:15:18.688375 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:15:19.176863 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:15:19.177323 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329719.1770868, dc6b3f2e-f675-4762-94e1-07a908ca0856 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:15:19.177497 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] VM Paused (Lifecycle Event)
May 21 02:15:19.192572 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Took 8.91 seconds to spawn the instance on the hypervisor.
May 21 02:15:19.193110 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:15:19.641616 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-27825f4e-ac87-46c6-999a-bb8a4fe18648 req-405a8198-f972-4a0b-affe-15c1ef677e8e service nova] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Received event network-vif-plugged-7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:15:19.641896 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-27825f4e-ac87-46c6-999a-bb8a4fe18648 req-405a8198-f972-4a0b-affe-15c1ef677e8e service nova] Acquiring lock "dc6b3f2e-f675-4762-94e1-07a908ca0856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:15:19.642039 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-27825f4e-ac87-46c6-999a-bb8a4fe18648 req-405a8198-f972-4a0b-affe-15c1ef677e8e service nova] Lock "dc6b3f2e-f675-4762-94e1-07a908ca0856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:15:19.642145 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-27825f4e-ac87-46c6-999a-bb8a4fe18648 req-405a8198-f972-4a0b-affe-15c1ef677e8e service nova] Lock "dc6b3f2e-f675-4762-94e1-07a908ca0856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:15:19.642280 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-27825f4e-ac87-46c6-999a-bb8a4fe18648 req-405a8198-f972-4a0b-affe-15c1ef677e8e service nova] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] No waiting events found dispatching network-vif-plugged-7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:15:19.642386 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-27825f4e-ac87-46c6-999a-bb8a4fe18648 req-405a8198-f972-4a0b-affe-15c1ef677e8e service nova] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Received unexpected event network-vif-plugged-7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f for instance with vm_state active and task_state None.
May 21 02:15:19.679786 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:15:19.682295 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329719.6820548, dc6b3f2e-f675-4762-94e1-07a908ca0856 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:15:19.682695 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] VM Resumed (Lifecycle Event)
May 21 02:15:19.701462 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Took 16.45 seconds to build instance.
May 21 02:15:19.811973 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:20.186268 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:15:20.188728 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:15:20.203029 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Lock "dc6b3f2e-f675-4762-94e1-07a908ca0856" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.958s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:15:20.357606 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:21.055076 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d7db0638-bf12-4249-984b-46978bacd40c req-80e497bf-0750-4a7f-9215-255622ae17b9 service nova] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Received event network-changed-7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:15:21.057321 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d7db0638-bf12-4249-984b-46978bacd40c req-80e497bf-0750-4a7f-9215-255622ae17b9 service nova] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Refreshing instance network info cache due to event network-changed-7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:15:21.057321 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d7db0638-bf12-4249-984b-46978bacd40c req-80e497bf-0750-4a7f-9215-255622ae17b9 service nova] Acquiring lock "refresh_cache-dc6b3f2e-f675-4762-94e1-07a908ca0856" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:15:21.057321 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d7db0638-bf12-4249-984b-46978bacd40c req-80e497bf-0750-4a7f-9215-255622ae17b9 service nova] Acquired lock "refresh_cache-dc6b3f2e-f675-4762-94e1-07a908ca0856" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:15:21.057321 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-d7db0638-bf12-4249-984b-46978bacd40c req-80e497bf-0750-4a7f-9215-255622ae17b9 service nova] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Refreshing network info cache for port 7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:15:21.558760 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-d7db0638-bf12-4249-984b-46978bacd40c req-80e497bf-0750-4a7f-9215-255622ae17b9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:15:21.872636 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-d7db0638-bf12-4249-984b-46978bacd40c req-80e497bf-0750-4a7f-9215-255622ae17b9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:15:22.000284 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-d7db0638-bf12-4249-984b-46978bacd40c req-80e497bf-0750-4a7f-9215-255622ae17b9 service nova] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Updated VIF entry in instance network info cache for port 7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:15:22.000865 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-d7db0638-bf12-4249-984b-46978bacd40c req-80e497bf-0750-4a7f-9215-255622ae17b9 service nova] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Updating instance_info_cache with network_info: [{"id": "7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f", "address": "fa:16:3e:d9:5c:86", "network": {"id": "fbfc0ab2-7514-4590-ba01-9d5a9ceb8de0", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1081082163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20fed5824d3e4977ae92fea21fee8a62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7db0bdc2-be", "ovs_interfaceid": "7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:15:22.170115 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:22.504529 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d7db0638-bf12-4249-984b-46978bacd40c req-80e497bf-0750-4a7f-9215-255622ae17b9 service nova] Releasing lock "refresh_cache-dc6b3f2e-f675-4762-94e1-07a908ca0856" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:15:22.614365 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:23.015216 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0003627440000855131 future=<Future at 0x71c05865e690 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:15:23.015376 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:15:23.016650 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Emitting event <LifecycleEvent: 1779329708.0146296, 8d34fd8e-f675-4985-a7fd-6585f64fb564 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:15:23.016650 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] VM Stopped (Lifecycle Event)
May 21 02:15:23.519687 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 8d34fd8e-f675-4985-a7fd-6585f64fb564] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:15:24.737700 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:24.812589 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:26.103005 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:27.172181 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:29.505367 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Acquiring lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:15:29.505931 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:15:29.819641 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:30.007311 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Starting instance... {{(pid=98206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 21 02:15:30.550390 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:15:30.550823 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:15:30.553881 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 21 02:15:30.553998 np0000001127 nova-compute[98206]: INFO nova.compute.claims [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Claim successful on node np0000001127
May 21 02:15:31.759210 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:15:31.759593 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:15:32.181017 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:32.262168 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:15:32.768934 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.218s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:15:32.769384 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Start building networks asynchronously for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 21 02:15:33.274053 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Allocating IP information in the background. {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 21 02:15:33.274327 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] allocate_for_instance() {{(pid=98206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 21 02:15:33.274612 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:15:33.274808 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:15:33.333207 np0000001127 nova-compute[98206]: DEBUG nova.policy [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b73df9b644c64739bfe58e29c47ebd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '191cc7783c9c44c680600dae6b9e9f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98206) authorize /opt/stack/nova/nova/policy.py:192}}
May 21 02:15:33.776551 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 21 02:15:33.783777 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Successfully created port: ae239959-51e8-47b7-830d-5d0a3889c4a6 {{(pid=98206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 21 02:15:34.168691 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Successfully updated port: ae239959-51e8-47b7-830d-5d0a3889c4a6 {{(pid=98206) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 21 02:15:34.216554 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f5ca7035-84bf-4c85-9a90-6d124f68c769 req-f93f4d03-2292-4e25-ba11-225f8550edbd service nova] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Received event network-changed-ae239959-51e8-47b7-830d-5d0a3889c4a6 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:15:34.216554 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-f5ca7035-84bf-4c85-9a90-6d124f68c769 req-f93f4d03-2292-4e25-ba11-225f8550edbd service nova] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Refreshing instance network info cache due to event network-changed-ae239959-51e8-47b7-830d-5d0a3889c4a6. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:15:34.216554 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f5ca7035-84bf-4c85-9a90-6d124f68c769 req-f93f4d03-2292-4e25-ba11-225f8550edbd service nova] Acquiring lock "refresh_cache-97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:15:34.216554 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f5ca7035-84bf-4c85-9a90-6d124f68c769 req-f93f4d03-2292-4e25-ba11-225f8550edbd service nova] Acquired lock "refresh_cache-97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:15:34.216554 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-f5ca7035-84bf-4c85-9a90-6d124f68c769 req-f93f4d03-2292-4e25-ba11-225f8550edbd service nova] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Refreshing network info cache for port ae239959-51e8-47b7-830d-5d0a3889c4a6 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:15:34.279599 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Start building block device mappings for instance. {{(pid=98206) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 21 02:15:34.670784 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Acquiring lock "refresh_cache-97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:15:34.718344 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-f5ca7035-84bf-4c85-9a90-6d124f68c769 req-f93f4d03-2292-4e25-ba11-225f8550edbd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:15:34.830723 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:35.208653 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-f5ca7035-84bf-4c85-9a90-6d124f68c769 req-f93f4d03-2292-4e25-ba11-225f8550edbd service nova] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:15:35.287586 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Start spawning the instance on the hypervisor. {{(pid=98206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 21 02:15:35.288486 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Creating instance directory {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 21 02:15:35.288740 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Creating image(s)
May 21 02:15:35.289204 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Acquiring lock "/opt/stack/data/nova/instances/97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:15:35.289368 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "/opt/stack/data/nova/instances/97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:15:35.289861 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "/opt/stack/data/nova/instances/97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:15:35.290450 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:15:35.294076 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:15:35.295175 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:15:35.339052 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-f5ca7035-84bf-4c85-9a90-6d124f68c769 req-f93f4d03-2292-4e25-ba11-225f8550edbd service nova] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:15:35.382172 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.087s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:15:35.382535 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Acquiring lock "59c30cdd91db839884e56e204130a8aace575e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:15:35.382912 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:15:35.383270 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:15:35.385555 np0000001127 nova-compute[98206]: DEBUG oslo_utils.imageutils.format_inspector [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98206) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 21 02:15:35.385823 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:15:35.472576 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.086s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:15:35.472991 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823/disk 1073741824 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:15:35.527027 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d,backing_fmt=raw /opt/stack/data/nova/instances/97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823/disk 1073741824" returned: 0 in 0.054s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:15:35.527458 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "59c30cdd91db839884e56e204130a8aace575e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.144s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:15:35.527823 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:15:35.612740 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c30cdd91db839884e56e204130a8aace575e2d --force-share --output=json" returned: 0 in 0.084s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:15:35.613676 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Checking if we can resize image /opt/stack/data/nova/instances/97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823/disk. size=1073741824 {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 21 02:15:35.613982 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:15:35.702605 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:15:35.703115 np0000001127 nova-compute[98206]: DEBUG nova.virt.disk.api [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Cannot resize image /opt/stack/data/nova/instances/97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823/disk to a smaller size. {{(pid=98206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 21 02:15:35.703529 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Created local disks {{(pid=98206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 21 02:15:35.703744 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Ensure instance console log exists: /opt/stack/data/nova/instances/97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823/console.log {{(pid=98206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 21 02:15:35.704049 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:15:35.704337 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:15:35.704544 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:15:35.841693 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-f5ca7035-84bf-4c85-9a90-6d124f68c769 req-f93f4d03-2292-4e25-ba11-225f8550edbd service nova] Releasing lock "refresh_cache-97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:15:35.842381 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Acquired lock "refresh_cache-97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:15:35.842601 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Building network info cache for instance {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 21 02:15:36.406316 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Instance cache missing network info. {{(pid=98206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 21 02:15:36.552644 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:15:36.676745 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Updating instance_info_cache with network_info: [{"id": "ae239959-51e8-47b7-830d-5d0a3889c4a6", "address": "fa:16:3e:06:92:4a", "network": {"id": "f372489c-3847-4543-a67f-895717459527", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-298685652-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "191cc7783c9c44c680600dae6b9e9f66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae239959-51", "ovs_interfaceid": "ae239959-51e8-47b7-830d-5d0a3889c4a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:15:37.178650 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Releasing lock "refresh_cache-97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:15:37.179100 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Instance network_info: |[{"id": "ae239959-51e8-47b7-830d-5d0a3889c4a6", "address": "fa:16:3e:06:92:4a", "network": {"id": "f372489c-3847-4543-a67f-895717459527", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-298685652-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "191cc7783c9c44c680600dae6b9e9f66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae239959-51", "ovs_interfaceid": "ae239959-51e8-47b7-830d-5d0a3889c4a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 21 02:15:37.181414 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Start _get_guest_xml network_info=[{"id": "ae239959-51e8-47b7-830d-5d0a3889c4a6", "address": "fa:16:3e:06:92:4a", "network": {"id": "f372489c-3847-4543-a67f-895717459527", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-298685652-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "191cc7783c9c44c680600dae6b9e9f66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae239959-51", "ovs_interfaceid": "ae239959-51e8-47b7-830d-5d0a3889c4a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '1545019a-a9af-4414-b299-e8f325be0886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 21 02:15:37.190038 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:37.194490 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:15:37.195784 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1545019a-a9af-4414-b299-e8f325be0886', instance_meta=NovaInstanceMeta(name='tempest-SnapshotDataIntegrityTests-server-1474726311', uuid='97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823'), owner=OwnerMeta(userid='b73df9b644c64739bfe58e29c47ebd7b', username='tempest-SnapshotDataIntegrityTests-1302442363-project-member', projectid='191cc7783c9c44c680600dae6b9e9f66', projectname='tempest-SnapshotDataIntegrityTests-1302442363'), image=ImageMeta(id='1545019a-a9af-4414-b299-e8f325be0886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ae239959-51e8-47b7-830d-5d0a3889c4a6", "address": "fa:16:3e:06:92:4a", "network": {"id": "f372489c-3847-4543-a67f-895717459527", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-298685652-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "191cc7783c9c44c680600dae6b9e9f66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae239959-51", "ovs_interfaceid": "ae239959-51e8-47b7-830d-5d0a3889c4a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779329737.195407) {{(pid=98206) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 21 02:15:37.196985 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V1... {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 21 02:15:37.197298 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] CPU controller missing on host. {{(pid=98206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 21 02:15:37.198438 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Searching host: 'np0000001127' for CPU controller through CGroups V2... {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 21 02:15:37.198703 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.host [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] CPU controller found on host. {{(pid=98206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 21 02:15:37.199716 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 21 02:15:37.200082 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-21T01:53:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-21T01:53:07Z,direct_url=<?>,disk_format='qcow2',id=1545019a-a9af-4414-b299-e8f325be0886,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e0576bdbcbdb4371809bfe8bd6fe7bb5',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-21T01:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 21 02:15:37.200255 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Flavor limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 21 02:15:37.200386 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Image limits 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 21 02:15:37.200574 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Flavor pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 21 02:15:37.200697 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Image pref 0:0:0 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 21 02:15:37.200851 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 21 02:15:37.201302 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 21 02:15:37.201438 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 21 02:15:37.201604 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Got 1 possible topologies {{(pid=98206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 21 02:15:37.201741 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 21 02:15:37.201891 np0000001127 nova-compute[98206]: DEBUG nova.virt.hardware [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 21 02:15:37.211747 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:15:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1474726311',display_name='tempest-SnapshotDataIntegrityTests-server-1474726311',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-snapshotdataintegritytests-server-1474726311',id=81,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANZXm6gMvj5XeRFamVC5EumsVH3ZBC+IDv/xlNxt4G/ow6iuVhXe3jHUGji1zS6D6fiAKlKpZB+V93Vc3VoSU9d8djcrpi+zEPpMxJH1ivjicM3J+eABSHJvcXIg3r9bg==',key_name='tempest-keypair-1204205143',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='191cc7783c9c44c680600dae6b9e9f66',ramdisk_id='',reservation_id='r-i0i9j004',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1302442363',owner_user_name='tempest-SnapshotDataIntegrityTests-1302442363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:15:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b73df9b644c64739bfe58e29c47ebd7b',uuid=97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae239959-51e8-47b7-830d-5d0a3889c4a6", "address": "fa:16:3e:06:92:4a", "network": {"id": "f372489c-3847-4543-a67f-895717459527", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-298685652-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "191cc7783c9c44c680600dae6b9e9f66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae239959-51", "ovs_interfaceid": "ae239959-51e8-47b7-830d-5d0a3889c4a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 21 02:15:37.211918 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Converting VIF {"id": "ae239959-51e8-47b7-830d-5d0a3889c4a6", "address": "fa:16:3e:06:92:4a", "network": {"id": "f372489c-3847-4543-a67f-895717459527", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-298685652-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "191cc7783c9c44c680600dae6b9e9f66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae239959-51", "ovs_interfaceid": "ae239959-51e8-47b7-830d-5d0a3889c4a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:15:37.212543 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:92:4a,bridge_name='br-int',has_traffic_filtering=True,id=ae239959-51e8-47b7-830d-5d0a3889c4a6,network=Network(f372489c-3847-4543-a67f-895717459527),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae239959-51') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:15:37.213069 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lazy-loading 'pci_devices' on Instance uuid 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:15:37.715757 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] End _get_guest_xml xml=<domain type="qemu">
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:   <uuid>97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823</uuid>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:   <name>instance-00000051</name>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:   <memory>196608</memory>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:   <vcpu>1</vcpu>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:   <metadata>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:       <nova:package version="33.1.0"/>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1474726311</nova:name>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:       <nova:creationTime>2026-05-21 02:15:37</nova:creationTime>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:       <nova:flavor name="m1.nano" id="42">
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:         <nova:memory>192</nova:memory>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:         <nova:disk>1</nova:disk>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:         <nova:swap>0</nova:swap>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:         <nova:ephemeral>0</nova:ephemeral>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:         <nova:vcpus>1</nova:vcpus>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:         <nova:extraSpecs>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:         </nova:extraSpecs>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:       </nova:flavor>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:       <nova:image uuid="1545019a-a9af-4414-b299-e8f325be0886">
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:         <nova:containerFormat>bare</nova:containerFormat>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:         <nova:minDisk>1</nova:minDisk>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:         <nova:minRam>0</nova:minRam>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:         <nova:properties>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:         </nova:properties>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:       </nova:image>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:       <nova:owner>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:         <nova:user uuid="b73df9b644c64739bfe58e29c47ebd7b">tempest-SnapshotDataIntegrityTests-1302442363-project-member</nova:user>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:         <nova:project uuid="191cc7783c9c44c680600dae6b9e9f66">tempest-SnapshotDataIntegrityTests-1302442363</nova:project>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:       </nova:owner>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:       <nova:root type="image" uuid="1545019a-a9af-4414-b299-e8f325be0886"/>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:       <nova:ports>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:         <nova:port uuid="ae239959-51e8-47b7-830d-5d0a3889c4a6">
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:         </nova:port>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:       </nova:ports>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:     </nova:instance>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:   </metadata>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:   <sysinfo type="smbios">
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:     <system>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:       <entry name="product">OpenStack Nova</entry>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:       <entry name="version">33.1.0</entry>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:       <entry name="serial">97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823</entry>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:       <entry name="uuid">97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823</entry>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:       <entry name="family">Virtual Machine</entry>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:     </system>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:   </sysinfo>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:   <os>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:     <type arch="x86_64" machine="pc">hvm</type>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:     <boot dev="hd"/>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:     <smbios mode="sysinfo"/>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:   </os>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:   <features>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:     <acpi/>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:     <tcg>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:       <tb-cache unit="MiB">128</tb-cache>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:     </tcg>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:     <vmcoreinfo/>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:   </features>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:   <iothreads>1</iothreads>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:   <clock offset="utc"/>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:   <cpu mode="custom" match="exact">
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:     <model>Nehalem</model>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:     <topology sockets="1" cores="1" threads="1"/>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:   </cpu>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:   <devices>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:     <disk type="file" device="disk">
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:       <driver name="qemu" type="qcow2" cache="none"/>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823/disk"/>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:       <target dev="vda" bus="virtio"/>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:     </disk>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:     <disk type="file" device="cdrom">
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:       <driver name="qemu" type="raw" cache="none"/>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:       <source file="/opt/stack/data/nova/instances/97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823/disk.config"/>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:       <target dev="hda" bus="ide"/>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:     </disk>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:     <interface type="ethernet">
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:       <mac address="fa:16:3e:06:92:4a"/>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:       <driver name="qemu"/>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:       <mtu size="1372"/>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:       <target dev="tapae239959-51"/>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:     </interface>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:     <serial type="pty">
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:       <log file="/opt/stack/data/nova/instances/97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823/console.log" append="off"/>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:     </serial>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:     <video>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:       <model type="virtio"/>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:     </video>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:     <rng model="virtio">
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:       <backend model="random">/dev/urandom</backend>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:     </rng>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:     <controller type="usb" index="0" model="none"/>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:       <stats period="10"/>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:     </memballoon>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:   </devices>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]: </domain>
May 21 02:15:37.715757 np0000001127 nova-compute[98206]:  {{(pid=98206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 21 02:15:37.717913 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Preparing to wait for external event network-vif-plugged-ae239959-51e8-47b7-830d-5d0a3889c4a6 {{(pid=98206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 21 02:15:37.717913 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Acquiring lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:15:37.717913 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:15:37.717913 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:15:37.717913 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-21T02:15:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1474726311',display_name='tempest-SnapshotDataIntegrityTests-server-1474726311',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-snapshotdataintegritytests-server-1474726311',id=81,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANZXm6gMvj5XeRFamVC5EumsVH3ZBC+IDv/xlNxt4G/ow6iuVhXe3jHUGji1zS6D6fiAKlKpZB+V93Vc3VoSU9d8djcrpi+zEPpMxJH1ivjicM3J+eABSHJvcXIg3r9bg==',key_name='tempest-keypair-1204205143',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='191cc7783c9c44c680600dae6b9e9f66',ramdisk_id='',reservation_id='r-i0i9j004',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1302442363',owner_user_name='tempest-SnapshotDataIntegrityTests-1302442363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-21T02:15:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b73df9b644c64739bfe58e29c47ebd7b',uuid=97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae239959-51e8-47b7-830d-5d0a3889c4a6", "address": "fa:16:3e:06:92:4a", "network": {"id": "f372489c-3847-4543-a67f-895717459527", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-298685652-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "191cc7783c9c44c680600dae6b9e9f66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae239959-51", "ovs_interfaceid": "ae239959-51e8-47b7-830d-5d0a3889c4a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 21 02:15:37.717913 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Converting VIF {"id": "ae239959-51e8-47b7-830d-5d0a3889c4a6", "address": "fa:16:3e:06:92:4a", "network": {"id": "f372489c-3847-4543-a67f-895717459527", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-298685652-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "191cc7783c9c44c680600dae6b9e9f66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae239959-51", "ovs_interfaceid": "ae239959-51e8-47b7-830d-5d0a3889c4a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:15:37.717913 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:92:4a,bridge_name='br-int',has_traffic_filtering=True,id=ae239959-51e8-47b7-830d-5d0a3889c4a6,network=Network(f372489c-3847-4543-a67f-895717459527),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae239959-51') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:15:37.717913 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:92:4a,bridge_name='br-int',has_traffic_filtering=True,id=ae239959-51e8-47b7-830d-5d0a3889c4a6,network=Network(f372489c-3847-4543-a67f-895717459527),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae239959-51') {{(pid=98206) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 21 02:15:37.718293 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:37.718333 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:15:37.718573 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 21 02:15:37.719167 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:37.719302 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dcb1f78e-1e00-5698-ace4-6f893ae68ac6', '_type': 'linux-noop'}}, row=False) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:15:37.720006 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:37.720863 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:15:37.721333 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:37.723121 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:37.723245 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae239959-51, may_exist=True, interface_attrs={}) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:15:37.723545 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapae239959-51, col_values=(('qos', UUID('a0ed8971-aa0c-4411-a04c-19e5647a600c')),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:15:37.723697 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapae239959-51, col_values=(('external_ids', {'iface-id': 'ae239959-51e8-47b7-830d-5d0a3889c4a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:92:4a', 'vm-uuid': '97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823'}),), if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:15:37.724331 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:37.725551 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:15:37.730148 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:37.730848 np0000001127 nova-compute[98206]: INFO os_vif [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:92:4a,bridge_name='br-int',has_traffic_filtering=True,id=ae239959-51e8-47b7-830d-5d0a3889c4a6,network=Network(f372489c-3847-4543-a67f-895717459527),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae239959-51')
May 21 02:15:39.248227 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:15:39.248701 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:15:39.248701 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] No VIF found with MAC fa:16:3e:06:92:4a, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:15:39.249051 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Using config drive
May 21 02:15:39.660451 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-5423bcd0-ecfd-4cd6-b07b-de520dd2f69e req-9ddd10ad-6e87-4617-b481-ea2fc2e99c46 service nova] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Received event network-changed-b22c43dc-84ca-4d63-a27f-7df2c63232b5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:15:39.660881 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-5423bcd0-ecfd-4cd6-b07b-de520dd2f69e req-9ddd10ad-6e87-4617-b481-ea2fc2e99c46 service nova] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Refreshing instance network info cache due to event network-changed-b22c43dc-84ca-4d63-a27f-7df2c63232b5. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:15:39.661072 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5423bcd0-ecfd-4cd6-b07b-de520dd2f69e req-9ddd10ad-6e87-4617-b481-ea2fc2e99c46 service nova] Acquiring lock "refresh_cache-e10da81d-1cfd-4008-8031-bf4e8b65bf78" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:15:39.661172 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5423bcd0-ecfd-4cd6-b07b-de520dd2f69e req-9ddd10ad-6e87-4617-b481-ea2fc2e99c46 service nova] Acquired lock "refresh_cache-e10da81d-1cfd-4008-8031-bf4e8b65bf78" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:15:39.661379 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-5423bcd0-ecfd-4cd6-b07b-de520dd2f69e req-9ddd10ad-6e87-4617-b481-ea2fc2e99c46 service nova] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Refreshing network info cache for port b22c43dc-84ca-4d63-a27f-7df2c63232b5 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:15:39.754126 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:15:39.856601 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Creating config drive at /opt/stack/data/nova/instances/97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823/disk.config
May 21 02:15:39.861436 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1cjq95r7 {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:15:39.914077 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1cjq95r7" returned: 0 in 0.053s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:15:40.164010 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-5423bcd0-ecfd-4cd6-b07b-de520dd2f69e req-9ddd10ad-6e87-4617-b481-ea2fc2e99c46 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:15:40.190273 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "e10da81d-1cfd-4008-8031-bf4e8b65bf78" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:15:40.190770 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "e10da81d-1cfd-4008-8031-bf4e8b65bf78" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:15:40.191068 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "e10da81d-1cfd-4008-8031-bf4e8b65bf78-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:15:40.191322 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "e10da81d-1cfd-4008-8031-bf4e8b65bf78-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:15:40.191476 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "e10da81d-1cfd-4008-8031-bf4e8b65bf78-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:15:40.194358 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Terminating instance
May 21 02:15:40.293963 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:40.313277 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:40.314047 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:40.406844 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:40.474876 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-5423bcd0-ecfd-4cd6-b07b-de520dd2f69e req-9ddd10ad-6e87-4617-b481-ea2fc2e99c46 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:15:40.493032 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-dd279a6c-9cd7-4fb5-9bdf-a98e0c2bcee1 req-4de7f2d4-2e9a-458f-ae70-1fadcdbc757b service nova] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Received event network-vif-plugged-ae239959-51e8-47b7-830d-5d0a3889c4a6 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:15:40.493233 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-dd279a6c-9cd7-4fb5-9bdf-a98e0c2bcee1 req-4de7f2d4-2e9a-458f-ae70-1fadcdbc757b service nova] Acquiring lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:15:40.493412 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-dd279a6c-9cd7-4fb5-9bdf-a98e0c2bcee1 req-4de7f2d4-2e9a-458f-ae70-1fadcdbc757b service nova] Lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:15:40.493974 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-dd279a6c-9cd7-4fb5-9bdf-a98e0c2bcee1 req-4de7f2d4-2e9a-458f-ae70-1fadcdbc757b service nova] Lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:15:40.494119 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-dd279a6c-9cd7-4fb5-9bdf-a98e0c2bcee1 req-4de7f2d4-2e9a-458f-ae70-1fadcdbc757b service nova] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Processing event network-vif-plugged-ae239959-51e8-47b7-830d-5d0a3889c4a6 {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 21 02:15:40.631542 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-5423bcd0-ecfd-4cd6-b07b-de520dd2f69e req-9ddd10ad-6e87-4617-b481-ea2fc2e99c46 service nova] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Updated VIF entry in instance network info cache for port b22c43dc-84ca-4d63-a27f-7df2c63232b5. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:15:40.631542 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-5423bcd0-ecfd-4cd6-b07b-de520dd2f69e req-9ddd10ad-6e87-4617-b481-ea2fc2e99c46 service nova] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Updating instance_info_cache with network_info: [{"id": "b22c43dc-84ca-4d63-a27f-7df2c63232b5", "address": "fa:16:3e:41:d7:06", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22c43dc-84", "ovs_interfaceid": "b22c43dc-84ca-4d63-a27f-7df2c63232b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:15:40.649749 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:40.651803 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:40.657053 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:40.658046 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:40.673757 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:40.698051 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:15:40.714521 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:40.717315 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:40.731695 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:40.894527 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:40.899610 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:40.994713 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:41.001872 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:41.020099 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999697278999975 future=<Future at 0x71c0585d3dd0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:15:41.021387 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.998406766000244 future=<Future at 0x71c0585d3dd0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:15:41.021503 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.998277235999922 future=<Future at 0x71c0585d3dd0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:15:41.024258 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Instance destroyed successfully.
May 21 02:15:41.024526 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lazy-loading 'resources' on Instance uuid e10da81d-1cfd-4008-8031-bf4e8b65bf78 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:15:41.134717 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-5423bcd0-ecfd-4cd6-b07b-de520dd2f69e req-9ddd10ad-6e87-4617-b481-ea2fc2e99c46 service nova] Releasing lock "refresh_cache-e10da81d-1cfd-4008-8031-bf4e8b65bf78" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:15:41.142354 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329741.1419625, 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 => Started> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:15:41.142859 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 21 02:15:41.143066 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] VM Started (Lifecycle Event)
May 21 02:15:41.145167 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Guest created on hypervisor {{(pid=98206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 21 02:15:41.147241 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Instance spawned successfully.
May 21 02:15:41.147523 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 21 02:15:41.526827 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2091479445',display_name='tempest-TestVolumeBootPattern-server-2091479445',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpattern-server-2091479445',id=79,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz/RBMCwKlZOoLdoqf7XbPge9tLmyY1xo5VJlB0SNDPLDIqYhv6bRKRrq1AOl4f0antvHh+zaNlybPqLYJXPC6E7cTtqubsCy3OHGbekTwncuW9Nfz1O6qOo+1iMsXADw==',key_name='tempest-TestVolumeBootPattern-2024297378',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:15:00Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62ebdb16aee84e22a88dfc8960debd32',ramdisk_id='',reservation_id='r-fmf3i79q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1995806391',owner_user_name='tempest-TestVolumeBootPattern-1995806391-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:15:01Z,user_data=None,user_id='4878b5a5bf184852a9ce383caa1c67a4',uuid=e10da81d-1cfd-4008-8031-bf4e8b65bf78,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b22c43dc-84ca-4d63-a27f-7df2c63232b5", "address": "fa:16:3e:41:d7:06", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22c43dc-84", "ovs_interfaceid": "b22c43dc-84ca-4d63-a27f-7df2c63232b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:15:41.527370 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converting VIF {"id": "b22c43dc-84ca-4d63-a27f-7df2c63232b5", "address": "fa:16:3e:41:d7:06", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22c43dc-84", "ovs_interfaceid": "b22c43dc-84ca-4d63-a27f-7df2c63232b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:15:41.527579 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:d7:06,bridge_name='br-int',has_traffic_filtering=True,id=b22c43dc-84ca-4d63-a27f-7df2c63232b5,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22c43dc-84') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:15:41.527818 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:d7:06,bridge_name='br-int',has_traffic_filtering=True,id=b22c43dc-84ca-4d63-a27f-7df2c63232b5,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22c43dc-84') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:15:41.528942 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:41.529155 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb22c43dc-84, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:15:41.531068 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:15:41.531458 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:41.532058 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:41.532173 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=209a2157-66f1-42ec-8d90-e7acf7758faf) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:15:41.533484 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:15:41.535111 np0000001127 nova-compute[98206]: INFO os_vif [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:d7:06,bridge_name='br-int',has_traffic_filtering=True,id=b22c43dc-84ca-4d63-a27f-7df2c63232b5,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22c43dc-84')
May 21 02:15:41.536599 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:15:41.536925 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e', 'iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b77d39d-277b-4ea5-8e32-ae5edf39af8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:15:41.537070 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:15:41.537391 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:15:41.537668 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e', 'iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b77d39d-277b-4ea5-8e32-ae5edf39af8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:15:41.537801 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:15:41.563572 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:15:41.563572 np0000001127 nova-compute[98206]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:15:41.563572 np0000001127 nova-compute[98206]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:15:41.563572 np0000001127 nova-compute[98206]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:15:41.563572 np0000001127 nova-compute[98206]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc (non-flash)
May 21 02:15:41.563572 np0000001127 nova-compute[98206]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc (non-flash)
May 21 02:15:41.563572 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:15:41.563838 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:15:41.563838 np0000001127 nova-compute[98206]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:15:41.563838 np0000001127 nova-compute[98206]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:15:41.563838 np0000001127 nova-compute[98206]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e (non-flash)
May 21 02:15:41.563838 np0000001127 nova-compute[98206]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc (non-flash)
May 21 02:15:41.563838 np0000001127 nova-compute[98206]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc (non-flash)
May 21 02:15:41.563838 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:15:41.563963 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', '199'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', '200'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e', '205'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e', '206'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc', '209'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc', '210')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:15:41.564122 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e', '206')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:15:41.565373 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e', '205')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:15:41.566502 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c0587f3ce0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e'): ({'sdc'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:15:41.566728 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Removing multipathed devices sdd, sdc {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:15:41.567027 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Flush multipath device 3300000007fe18a95 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:15:41.617920 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:15:41.645658 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:15:41.648095 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:15:41.653086 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Found default for hw_cdrom_bus of ide {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:15:41.653249 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Found default for hw_disk_bus of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:15:41.653579 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Found default for hw_input_bus of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:15:41.653866 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Found default for hw_pointer_model of None {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:15:41.654188 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Found default for hw_video_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:15:41.654482 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Found default for hw_vif_model of virtio {{(pid=98206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 21 02:15:41.674209 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:15:41.734074 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Checking to see if SCSI volumes sdd, sdc have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:15:41.734263 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] SCSI volumes sdd, sdc have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:15:41.735410 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Checking to see if device paths {'sdd', 'sdc'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:15:41.748178 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Device paths {'sdd', 'sdc'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:15:41.748365 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:15:41.762233 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:15:41.794109 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 206, target: iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e, portal: 192.168.40.100,3260]
May 21 02:15:41.794109 np0000001127 nova-compute[98206]: Logout of [sid: 206, target: iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e, portal: 192.168.40.100,3260] successful.
May 21 02:15:41.794109 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:15:41.809578 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:15:41.820079 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:15:41.849279 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 205, target: iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e, portal: 192.168.50.100,3260]
May 21 02:15:41.849279 np0000001127 nova-compute[98206]: Logout of [sid: 205, target: iqn.2023-03.storpool.com:os--volume-5b77d39d-277b-4ea5-8e32-ae5edf39af8e, portal: 192.168.50.100,3260] successful.
May 21 02:15:41.849279 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:15:41.862600 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:15:41.862829 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:15:41.862986 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] <== disconnect_volume: return (326ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:15:41.863157 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:15:41.863432 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Deleting instance files /opt/stack/data/nova/instances/e10da81d-1cfd-4008-8031-bf4e8b65bf78_del
May 21 02:15:41.863935 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Deletion of /opt/stack/data/nova/instances/e10da81d-1cfd-4008-8031-bf4e8b65bf78_del complete
May 21 02:15:42.151840 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] During sync_power_state the instance has a pending task (spawning). Skip.
May 21 02:15:42.152105 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329742.1519217, 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 => Paused> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:15:42.152225 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] VM Paused (Lifecycle Event)
May 21 02:15:42.159424 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Took 6.87 seconds to spawn the instance on the hypervisor.
May 21 02:15:42.159638 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:15:42.191264 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:42.369132 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Took 1.67 seconds to destroy the instance on the hypervisor.
May 21 02:15:42.369626 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:15:42.369948 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:15:42.370062 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:15:42.370267 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:15:42.422848 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:15:42.654646 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:15:42.656785 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Emitting event <LifecycleEvent: 1779329742.6566038, 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 => Resumed> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:15:42.656894 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] VM Resumed (Lifecycle Event)
May 21 02:15:42.671548 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Took 12.16 seconds to build instance.
May 21 02:15:43.059814 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d6308633-80b0-4a8e-937e-bf3377a6ee4d req-1842f0be-d44e-4fab-bac1-207c0d913b75 service nova] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Received event network-vif-plugged-ae239959-51e8-47b7-830d-5d0a3889c4a6 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:15:43.060098 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d6308633-80b0-4a8e-937e-bf3377a6ee4d req-1842f0be-d44e-4fab-bac1-207c0d913b75 service nova] Acquiring lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:15:43.060278 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d6308633-80b0-4a8e-937e-bf3377a6ee4d req-1842f0be-d44e-4fab-bac1-207c0d913b75 service nova] Lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:15:43.060314 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d6308633-80b0-4a8e-937e-bf3377a6ee4d req-1842f0be-d44e-4fab-bac1-207c0d913b75 service nova] Lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:15:43.060425 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d6308633-80b0-4a8e-937e-bf3377a6ee4d req-1842f0be-d44e-4fab-bac1-207c0d913b75 service nova] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] No waiting events found dispatching network-vif-plugged-ae239959-51e8-47b7-830d-5d0a3889c4a6 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:15:43.060547 np0000001127 nova-compute[98206]: WARNING nova.compute.manager [req-d6308633-80b0-4a8e-937e-bf3377a6ee4d req-1842f0be-d44e-4fab-bac1-207c0d913b75 service nova] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Received unexpected event network-vif-plugged-ae239959-51e8-47b7-830d-5d0a3889c4a6 for instance with vm_state active and task_state None.
May 21 02:15:43.060641 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d6308633-80b0-4a8e-937e-bf3377a6ee4d req-1842f0be-d44e-4fab-bac1-207c0d913b75 service nova] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Received event network-vif-unplugged-b22c43dc-84ca-4d63-a27f-7df2c63232b5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:15:43.060741 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d6308633-80b0-4a8e-937e-bf3377a6ee4d req-1842f0be-d44e-4fab-bac1-207c0d913b75 service nova] Acquiring lock "e10da81d-1cfd-4008-8031-bf4e8b65bf78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:15:43.060838 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d6308633-80b0-4a8e-937e-bf3377a6ee4d req-1842f0be-d44e-4fab-bac1-207c0d913b75 service nova] Lock "e10da81d-1cfd-4008-8031-bf4e8b65bf78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:15:43.060931 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d6308633-80b0-4a8e-937e-bf3377a6ee4d req-1842f0be-d44e-4fab-bac1-207c0d913b75 service nova] Lock "e10da81d-1cfd-4008-8031-bf4e8b65bf78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:15:43.061040 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d6308633-80b0-4a8e-937e-bf3377a6ee4d req-1842f0be-d44e-4fab-bac1-207c0d913b75 service nova] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] No waiting events found dispatching network-vif-unplugged-b22c43dc-84ca-4d63-a27f-7df2c63232b5 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:15:43.061150 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d6308633-80b0-4a8e-937e-bf3377a6ee4d req-1842f0be-d44e-4fab-bac1-207c0d913b75 service nova] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Received event network-vif-unplugged-b22c43dc-84ca-4d63-a27f-7df2c63232b5 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:15:43.061240 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d6308633-80b0-4a8e-937e-bf3377a6ee4d req-1842f0be-d44e-4fab-bac1-207c0d913b75 service nova] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Received event network-vif-unplugged-b22c43dc-84ca-4d63-a27f-7df2c63232b5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:15:43.061339 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d6308633-80b0-4a8e-937e-bf3377a6ee4d req-1842f0be-d44e-4fab-bac1-207c0d913b75 service nova] Acquiring lock "e10da81d-1cfd-4008-8031-bf4e8b65bf78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:15:43.061436 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d6308633-80b0-4a8e-937e-bf3377a6ee4d req-1842f0be-d44e-4fab-bac1-207c0d913b75 service nova] Lock "e10da81d-1cfd-4008-8031-bf4e8b65bf78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:15:43.061544 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-d6308633-80b0-4a8e-937e-bf3377a6ee4d req-1842f0be-d44e-4fab-bac1-207c0d913b75 service nova] Lock "e10da81d-1cfd-4008-8031-bf4e8b65bf78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:15:43.061684 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d6308633-80b0-4a8e-937e-bf3377a6ee4d req-1842f0be-d44e-4fab-bac1-207c0d913b75 service nova] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] No waiting events found dispatching network-vif-unplugged-b22c43dc-84ca-4d63-a27f-7df2c63232b5 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:15:43.061778 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-d6308633-80b0-4a8e-937e-bf3377a6ee4d req-1842f0be-d44e-4fab-bac1-207c0d913b75 service nova] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Received event network-vif-unplugged-b22c43dc-84ca-4d63-a27f-7df2c63232b5 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:15:43.098855 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:43.159227 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:15:43.164692 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 21 02:15:43.174372 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.667s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:15:43.555047 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a57bfe86-5444-4a96-b6f0-a19175a157cf req-f694558b-3a8f-4bc6-a04f-b1feb4248d06 service nova] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Received event network-changed-ae239959-51e8-47b7-830d-5d0a3889c4a6 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:15:43.555197 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-a57bfe86-5444-4a96-b6f0-a19175a157cf req-f694558b-3a8f-4bc6-a04f-b1feb4248d06 service nova] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Refreshing instance network info cache due to event network-changed-ae239959-51e8-47b7-830d-5d0a3889c4a6. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:15:43.555370 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a57bfe86-5444-4a96-b6f0-a19175a157cf req-f694558b-3a8f-4bc6-a04f-b1feb4248d06 service nova] Acquiring lock "refresh_cache-97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:15:43.555481 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a57bfe86-5444-4a96-b6f0-a19175a157cf req-f694558b-3a8f-4bc6-a04f-b1feb4248d06 service nova] Acquired lock "refresh_cache-97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:15:43.555616 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-a57bfe86-5444-4a96-b6f0-a19175a157cf req-f694558b-3a8f-4bc6-a04f-b1feb4248d06 service nova] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Refreshing network info cache for port ae239959-51e8-47b7-830d-5d0a3889c4a6 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:15:43.637392 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:15:44.058559 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-a57bfe86-5444-4a96-b6f0-a19175a157cf req-f694558b-3a8f-4bc6-a04f-b1feb4248d06 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:15:44.141493 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Took 1.77 seconds to deallocate network for instance.
May 21 02:15:44.359627 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-a57bfe86-5444-4a96-b6f0-a19175a157cf req-f694558b-3a8f-4bc6-a04f-b1feb4248d06 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:15:44.513633 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-a57bfe86-5444-4a96-b6f0-a19175a157cf req-f694558b-3a8f-4bc6-a04f-b1feb4248d06 service nova] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Updated VIF entry in instance network info cache for port ae239959-51e8-47b7-830d-5d0a3889c4a6. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:15:44.513895 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-a57bfe86-5444-4a96-b6f0-a19175a157cf req-f694558b-3a8f-4bc6-a04f-b1feb4248d06 service nova] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Updating instance_info_cache with network_info: [{"id": "ae239959-51e8-47b7-830d-5d0a3889c4a6", "address": "fa:16:3e:06:92:4a", "network": {"id": "f372489c-3847-4543-a67f-895717459527", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-298685652-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "191cc7783c9c44c680600dae6b9e9f66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae239959-51", "ovs_interfaceid": "ae239959-51e8-47b7-830d-5d0a3889c4a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:15:44.693594 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Took 0.55 seconds to detach 1 volumes for instance.
May 21 02:15:45.015840 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-a57bfe86-5444-4a96-b6f0-a19175a157cf req-f694558b-3a8f-4bc6-a04f-b1feb4248d06 service nova] Releasing lock "refresh_cache-97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:15:45.117885 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2af26c18-95e8-4812-8f53-ffa7fa72cacd req-78740219-9c92-4c1f-9614-942eceb8d6bc service nova] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Received event network-vif-deleted-b22c43dc-84ca-4d63-a27f-7df2c63232b5 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:15:45.199186 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:15:45.199361 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:15:45.397446 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:15:45.397643 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:15:45.900185 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:15:46.407178 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.208s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:15:46.470410 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Deleted allocations for instance e10da81d-1cfd-4008-8031-bf4e8b65bf78
May 21 02:15:46.533229 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:47.193299 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:47.477909 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f9711c33-4fde-4d77-8f2a-92ee4cb2b6c9 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "e10da81d-1cfd-4008-8031-bf4e8b65bf78" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.287s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:15:50.087399 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-3b75a000-494d-4085-acda-6aa79926d109 req-3984ddb2-cbae-4bd9-9d1e-c087ee6d62c0 service nova] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Received event network-changed-4177dd83-8ee3-4a16-8fa6-55e0b202f779 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:15:50.087989 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-3b75a000-494d-4085-acda-6aa79926d109 req-3984ddb2-cbae-4bd9-9d1e-c087ee6d62c0 service nova] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Refreshing instance network info cache due to event network-changed-4177dd83-8ee3-4a16-8fa6-55e0b202f779. {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 21 02:15:50.087989 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-3b75a000-494d-4085-acda-6aa79926d109 req-3984ddb2-cbae-4bd9-9d1e-c087ee6d62c0 service nova] Acquiring lock "refresh_cache-fc403327-070b-4e21-b046-40c4160ee52b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 21 02:15:50.088359 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-3b75a000-494d-4085-acda-6aa79926d109 req-3984ddb2-cbae-4bd9-9d1e-c087ee6d62c0 service nova] Acquired lock "refresh_cache-fc403327-070b-4e21-b046-40c4160ee52b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 21 02:15:50.088620 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-3b75a000-494d-4085-acda-6aa79926d109 req-3984ddb2-cbae-4bd9-9d1e-c087ee6d62c0 service nova] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Refreshing network info cache for port 4177dd83-8ee3-4a16-8fa6-55e0b202f779 {{(pid=98206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 21 02:15:50.590569 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-3b75a000-494d-4085-acda-6aa79926d109 req-3984ddb2-cbae-4bd9-9d1e-c087ee6d62c0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:15:50.615430 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "fc403327-070b-4e21-b046-40c4160ee52b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:15:50.615621 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "fc403327-070b-4e21-b046-40c4160ee52b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:15:50.615803 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "fc403327-070b-4e21-b046-40c4160ee52b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:15:50.615921 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "fc403327-070b-4e21-b046-40c4160ee52b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:15:50.616074 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "fc403327-070b-4e21-b046-40c4160ee52b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:15:50.618156 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Terminating instance
May 21 02:15:50.842851 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [req-3b75a000-494d-4085-acda-6aa79926d109 req-3984ddb2-cbae-4bd9-9d1e-c087ee6d62c0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:15:50.962333 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-3b75a000-494d-4085-acda-6aa79926d109 req-3984ddb2-cbae-4bd9-9d1e-c087ee6d62c0 service nova] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Updated VIF entry in instance network info cache for port 4177dd83-8ee3-4a16-8fa6-55e0b202f779. {{(pid=98206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 21 02:15:50.962604 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-3b75a000-494d-4085-acda-6aa79926d109 req-3984ddb2-cbae-4bd9-9d1e-c087ee6d62c0 service nova] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Updating instance_info_cache with network_info: [{"id": "4177dd83-8ee3-4a16-8fa6-55e0b202f779", "address": "fa:16:3e:0e:cf:bf", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4177dd83-8e", "ovs_interfaceid": "4177dd83-8ee3-4a16-8fa6-55e0b202f779", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:15:51.121798 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:15:51.137524 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:51.139831 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:51.158265 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:51.167018 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:51.185236 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:51.185672 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:51.296291 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-9c2af083-1b5d-4ab6-8108-22a006615e0e req-472e64e5-8e68-48ac-bb47-1c4bec8b0ec4 service nova] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Received event network-vif-unplugged-4177dd83-8ee3-4a16-8fa6-55e0b202f779 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:15:51.296651 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-9c2af083-1b5d-4ab6-8108-22a006615e0e req-472e64e5-8e68-48ac-bb47-1c4bec8b0ec4 service nova] Acquiring lock "fc403327-070b-4e21-b046-40c4160ee52b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:15:51.296813 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-9c2af083-1b5d-4ab6-8108-22a006615e0e req-472e64e5-8e68-48ac-bb47-1c4bec8b0ec4 service nova] Lock "fc403327-070b-4e21-b046-40c4160ee52b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:15:51.296965 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-9c2af083-1b5d-4ab6-8108-22a006615e0e req-472e64e5-8e68-48ac-bb47-1c4bec8b0ec4 service nova] Lock "fc403327-070b-4e21-b046-40c4160ee52b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:15:51.297114 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-9c2af083-1b5d-4ab6-8108-22a006615e0e req-472e64e5-8e68-48ac-bb47-1c4bec8b0ec4 service nova] [instance: fc403327-070b-4e21-b046-40c4160ee52b] No waiting events found dispatching network-vif-unplugged-4177dd83-8ee3-4a16-8fa6-55e0b202f779 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:15:51.297276 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-9c2af083-1b5d-4ab6-8108-22a006615e0e req-472e64e5-8e68-48ac-bb47-1c4bec8b0ec4 service nova] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Received event network-vif-unplugged-4177dd83-8ee3-4a16-8fa6-55e0b202f779 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:15:51.413914 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:51.420486 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:51.435824 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999768550000226 future=<Future at 0x71c07c7d4fb0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:15:51.437596 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Instance destroyed successfully.
May 21 02:15:51.438085 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lazy-loading 'resources' on Instance uuid fc403327-070b-4e21-b046-40c4160ee52b {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:15:51.464650 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-3b75a000-494d-4085-acda-6aa79926d109 req-3984ddb2-cbae-4bd9-9d1e-c087ee6d62c0 service nova] Releasing lock "refresh_cache-fc403327-070b-4e21-b046-40c4160ee52b" {{(pid=98206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 21 02:15:51.535037 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:51.941844 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:13:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1007147888',display_name='tempest-TestVolumeBootPattern-server-1007147888',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-testvolumebootpattern-server-1007147888',id=77,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz/RBMCwKlZOoLdoqf7XbPge9tLmyY1xo5VJlB0SNDPLDIqYhv6bRKRrq1AOl4f0antvHh+zaNlybPqLYJXPC6E7cTtqubsCy3OHGbekTwncuW9Nfz1O6qOo+1iMsXADw==',key_name='tempest-TestVolumeBootPattern-2024297378',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:14:02Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62ebdb16aee84e22a88dfc8960debd32',ramdisk_id='',reservation_id='r-ut2txkgj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1995806391',owner_user_name='tempest-TestVolumeBootPattern-1995806391-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:14:02Z,user_data=None,user_id='4878b5a5bf184852a9ce383caa1c67a4',uuid=fc403327-070b-4e21-b046-40c4160ee52b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4177dd83-8ee3-4a16-8fa6-55e0b202f779", "address": "fa:16:3e:0e:cf:bf", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4177dd83-8e", "ovs_interfaceid": "4177dd83-8ee3-4a16-8fa6-55e0b202f779", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:15:51.942122 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converting VIF {"id": "4177dd83-8ee3-4a16-8fa6-55e0b202f779", "address": "fa:16:3e:0e:cf:bf", "network": {"id": "c021452d-7e5d-430b-837c-947f79bd5215", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-466033640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62ebdb16aee84e22a88dfc8960debd32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4177dd83-8e", "ovs_interfaceid": "4177dd83-8ee3-4a16-8fa6-55e0b202f779", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:15:51.942552 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:cf:bf,bridge_name='br-int',has_traffic_filtering=True,id=4177dd83-8ee3-4a16-8fa6-55e0b202f779,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4177dd83-8e') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:15:51.942788 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:cf:bf,bridge_name='br-int',has_traffic_filtering=True,id=4177dd83-8ee3-4a16-8fa6-55e0b202f779,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4177dd83-8e') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:15:51.943829 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:51.944085 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4177dd83-8e, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:15:51.945566 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:51.947029 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:15:51.947616 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:51.947788 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=babd0b34-9404-4db2-81db-b083ec786305) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:15:51.949451 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:15:51.951018 np0000001127 nova-compute[98206]: INFO os_vif [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:cf:bf,bridge_name='br-int',has_traffic_filtering=True,id=4177dd83-8ee3-4a16-8fa6-55e0b202f779,network=Network(c021452d-7e5d-430b-837c-947f79bd5215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4177dd83-8e')
May 21 02:15:51.952567 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:15:51.952857 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:15:51.953000 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:15:51.953351 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:15:51.953667 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:15:51.953815 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:15:51.977168 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:15:51.977168 np0000001127 nova-compute[98206]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:15:51.977168 np0000001127 nova-compute[98206]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc (non-flash)
May 21 02:15:51.977168 np0000001127 nova-compute[98206]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc (non-flash)
May 21 02:15:51.977168 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:15:51.977365 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsi session list stdout=tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:15:51.977365 np0000001127 nova-compute[98206]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1 (non-flash)
May 21 02:15:51.977365 np0000001127 nova-compute[98206]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc (non-flash)
May 21 02:15:51.977365 np0000001127 nova-compute[98206]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc (non-flash)
May 21 02:15:51.977365 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:15:51.977451 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', '199'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', '200'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc', '209'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc', '210')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:15:51.977632 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', '200')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:15:51.978532 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1', '199')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:15:51.979317 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c2fc9a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1'): ({'sde'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:15:51.979572 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Removing multipathed devices sde, sdf {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:15:51.979799 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Flush multipath device 330000000fac56fe1 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:15:52.033669 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:15:52.084891 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:15:52.135198 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Checking to see if SCSI volumes sde, sdf have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:15:52.135597 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] SCSI volumes sde, sdf have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:15:52.136068 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Checking to see if device paths {'sde', 'sdf'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:15:52.148559 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Device paths {'sde', 'sdf'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:15:52.148738 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:15:52.159059 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:15:52.186431 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 200, target: iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1, portal: 192.168.40.100,3260]
May 21 02:15:52.186431 np0000001127 nova-compute[98206]: Logout of [sid: 200, target: iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1, portal: 192.168.40.100,3260] successful.
May 21 02:15:52.186431 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:15:52.194749 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:52.199187 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:15:52.209287 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:15:52.237394 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 199, target: iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1, portal: 192.168.50.100,3260]
May 21 02:15:52.237394 np0000001127 nova-compute[98206]: Logout of [sid: 199, target: iqn.2023-03.storpool.com:os--volume-9d5afcec-79b5-422e-ab0c-5c33fa118ca1, portal: 192.168.50.100,3260] successful.
May 21 02:15:52.237394 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:15:52.249710 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:15:52.249849 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:15:52.249974 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] <== disconnect_volume: return (297ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:15:52.250103 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:15:52.250342 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Deleting instance files /opt/stack/data/nova/instances/fc403327-070b-4e21-b046-40c4160ee52b_del
May 21 02:15:52.250823 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Deletion of /opt/stack/data/nova/instances/fc403327-070b-4e21-b046-40c4160ee52b_del complete
May 21 02:15:52.756215 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Took 1.63 seconds to destroy the instance on the hypervisor.
May 21 02:15:52.756760 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:15:52.757040 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:15:52.757125 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: fc403327-070b-4e21-b046-40c4160ee52b] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:15:52.757343 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:15:52.850824 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:15:53.078998 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2203e040-95a6-424b-8687-614e39615890 req-f0786176-f136-4323-9cb5-6c6c68cbe6e5 service nova] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Received event network-vif-deleted-4177dd83-8ee3-4a16-8fa6-55e0b202f779 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:15:53.079536 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-2203e040-95a6-424b-8687-614e39615890 req-f0786176-f136-4323-9cb5-6c6c68cbe6e5 service nova] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Neutron deleted interface 4177dd83-8ee3-4a16-8fa6-55e0b202f779; detaching it from the instance and deleting it from the info cache
May 21 02:15:53.080361 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-2203e040-95a6-424b-8687-614e39615890 req-f0786176-f136-4323-9cb5-6c6c68cbe6e5 service nova] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:15:53.347257 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-02d8c90a-43a8-49ed-9bfa-f43b1a9a4c1a req-8fdfd0c5-18af-4aeb-a6aa-e39bce7eabf7 service nova] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Received event network-vif-unplugged-4177dd83-8ee3-4a16-8fa6-55e0b202f779 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:15:53.347703 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-02d8c90a-43a8-49ed-9bfa-f43b1a9a4c1a req-8fdfd0c5-18af-4aeb-a6aa-e39bce7eabf7 service nova] Acquiring lock "fc403327-070b-4e21-b046-40c4160ee52b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:15:53.347703 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-02d8c90a-43a8-49ed-9bfa-f43b1a9a4c1a req-8fdfd0c5-18af-4aeb-a6aa-e39bce7eabf7 service nova] Lock "fc403327-070b-4e21-b046-40c4160ee52b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:15:53.347799 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-02d8c90a-43a8-49ed-9bfa-f43b1a9a4c1a req-8fdfd0c5-18af-4aeb-a6aa-e39bce7eabf7 service nova] Lock "fc403327-070b-4e21-b046-40c4160ee52b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:15:53.347844 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-02d8c90a-43a8-49ed-9bfa-f43b1a9a4c1a req-8fdfd0c5-18af-4aeb-a6aa-e39bce7eabf7 service nova] [instance: fc403327-070b-4e21-b046-40c4160ee52b] No waiting events found dispatching network-vif-unplugged-4177dd83-8ee3-4a16-8fa6-55e0b202f779 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:15:53.348376 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-02d8c90a-43a8-49ed-9bfa-f43b1a9a4c1a req-8fdfd0c5-18af-4aeb-a6aa-e39bce7eabf7 service nova] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Received event network-vif-unplugged-4177dd83-8ee3-4a16-8fa6-55e0b202f779 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:15:53.538432 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:15:53.582899 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2203e040-95a6-424b-8687-614e39615890 req-f0786176-f136-4323-9cb5-6c6c68cbe6e5 service nova] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Detach interface failed, port_id=4177dd83-8ee3-4a16-8fa6-55e0b202f779, reason: Instance fc403327-070b-4e21-b046-40c4160ee52b could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:15:54.040333 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Took 1.28 seconds to deallocate network for instance.
May 21 02:15:54.586676 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Took 0.55 seconds to detach 1 volumes for instance.
May 21 02:15:55.092516 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:15:55.092693 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:15:55.263921 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:15:55.264159 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:15:55.766900 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:15:56.020901 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.001026354999794421 future=<Future at 0x71c0585d3dd0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:15:56.021328 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Emitting event <LifecycleEvent: 1779329741.0196948, e10da81d-1cfd-4008-8031-bf4e8b65bf78 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:15:56.021995 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] VM Stopped (Lifecycle Event)
May 21 02:15:56.022780 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:15:56.023063 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=10.412510161000228 future=<Future at 0x71c07c7d4fb0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:15:56.023178 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=10.412383907000276 future=<Future at 0x71c07c7d4fb0 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:15:56.274764 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.182s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:15:56.321370 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Deleted allocations for instance fc403327-070b-4e21-b046-40c4160ee52b
May 21 02:15:56.524386 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: e10da81d-1cfd-4008-8031-bf4e8b65bf78] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:15:56.676635 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:15:56.676780 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:15:56.677065 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:15:56.949584 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:57.195996 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:57.329356 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f0b4fc9f-9e98-4dde-8254-afba18f43e29 tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Lock "fc403327-070b-4e21-b046-40c4160ee52b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.714s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:15:57.440424 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Acquiring lock "dc6b3f2e-f675-4762-94e1-07a908ca0856" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:15:57.440588 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Lock "dc6b3f2e-f675-4762-94e1-07a908ca0856" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:15:57.440730 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Acquiring lock "dc6b3f2e-f675-4762-94e1-07a908ca0856-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:15:57.440843 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Lock "dc6b3f2e-f675-4762-94e1-07a908ca0856-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:15:57.440951 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Lock "dc6b3f2e-f675-4762-94e1-07a908ca0856-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:15:57.442819 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Terminating instance
May 21 02:15:57.945443 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:15:57.968700 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:57.970374 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:57.984206 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:57.987307 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:58.005086 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:58.119497 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2f3be691-a578-4c35-a5fc-371fc9d4170b req-3cde1625-f4d7-4571-b03c-d89f8b473084 service nova] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Received event network-vif-unplugged-7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:15:58.119584 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2f3be691-a578-4c35-a5fc-371fc9d4170b req-3cde1625-f4d7-4571-b03c-d89f8b473084 service nova] Acquiring lock "dc6b3f2e-f675-4762-94e1-07a908ca0856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:15:58.120125 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2f3be691-a578-4c35-a5fc-371fc9d4170b req-3cde1625-f4d7-4571-b03c-d89f8b473084 service nova] Lock "dc6b3f2e-f675-4762-94e1-07a908ca0856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:15:58.120250 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-2f3be691-a578-4c35-a5fc-371fc9d4170b req-3cde1625-f4d7-4571-b03c-d89f8b473084 service nova] Lock "dc6b3f2e-f675-4762-94e1-07a908ca0856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:15:58.120368 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2f3be691-a578-4c35-a5fc-371fc9d4170b req-3cde1625-f4d7-4571-b03c-d89f8b473084 service nova] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] No waiting events found dispatching network-vif-unplugged-7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:15:58.120503 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-2f3be691-a578-4c35-a5fc-371fc9d4170b req-3cde1625-f4d7-4571-b03c-d89f8b473084 service nova] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Received event network-vif-unplugged-7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:15:58.267009 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.99970176700026 future=<Future at 0x71c07c796780 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:15:58.269047 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Instance destroyed successfully.
May 21 02:15:58.269805 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Lazy-loading 'resources' on Instance uuid dc6b3f2e-f675-4762-94e1-07a908ca0856 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:15:58.773189 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:15:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-instance-1494598512',display_name='tempest-instance-1494598512',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-instance-1494598512',id=80,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEelSjE5zck+oo1q8RJoBMScSVj8tl0etR0zGgVK3KZ2Vw6/QW/n0cSWdYYTcAFCrM0blNSscNvIh8faFmAhdSSoSsU/o0ATI3oSuLCcJQ0cumUDtrx1ffiymP9OZB3alw==',key_name='tempest-keypair-123803963',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:15:19Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='20fed5824d3e4977ae92fea21fee8a62',ramdisk_id='',reservation_id='r-w95febsa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-1074905684',owner_user_name='tempest-VolumesBackupsTest-1074905684-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:15:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f8b40fd3e214d9bbc80ace17793bc0c',uuid=dc6b3f2e-f675-4762-94e1-07a908ca0856,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f", "address": "fa:16:3e:d9:5c:86", "network": {"id": "fbfc0ab2-7514-4590-ba01-9d5a9ceb8de0", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1081082163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20fed5824d3e4977ae92fea21fee8a62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7db0bdc2-be", "ovs_interfaceid": "7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:15:58.773189 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Converting VIF {"id": "7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f", "address": "fa:16:3e:d9:5c:86", "network": {"id": "fbfc0ab2-7514-4590-ba01-9d5a9ceb8de0", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1081082163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20fed5824d3e4977ae92fea21fee8a62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7db0bdc2-be", "ovs_interfaceid": "7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:15:58.773189 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:5c:86,bridge_name='br-int',has_traffic_filtering=True,id=7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f,network=Network(fbfc0ab2-7514-4590-ba01-9d5a9ceb8de0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7db0bdc2-be') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:15:58.773189 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:5c:86,bridge_name='br-int',has_traffic_filtering=True,id=7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f,network=Network(fbfc0ab2-7514-4590-ba01-9d5a9ceb8de0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7db0bdc2-be') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:15:58.773569 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:58.773605 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7db0bdc2-be, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:15:58.774427 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:58.775237 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:15:58.775400 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:58.776105 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:58.776255 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a7c68396-8305-416b-9a34-4d1fffe5f5c9) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:15:58.776821 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:58.777257 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:15:58.777513 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:15:58.779034 np0000001127 nova-compute[98206]: INFO os_vif [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:5c:86,bridge_name='br-int',has_traffic_filtering=True,id=7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f,network=Network(fbfc0ab2-7514-4590-ba01-9d5a9ceb8de0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7db0bdc2-be')
May 21 02:15:58.780721 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:15:58.780988 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc', 'iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '971ff068-b3ff-46f3-90d6-d84b741ceffc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:15:58.781139 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:15:58.781476 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:15:58.781833 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc', 'iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '971ff068-b3ff-46f3-90d6-d84b741ceffc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:15:58.781972 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:15:58.803155 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc (non-flash)
May 21 02:15:58.803155 np0000001127 nova-compute[98206]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc (non-flash)
May 21 02:15:58.803155 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:15:58.803308 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] iscsi session list stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc (non-flash)
May 21 02:15:58.803308 np0000001127 nova-compute[98206]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc (non-flash)
May 21 02:15:58.803308 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:15:58.803454 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc', '209'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc', '210')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:15:58.803578 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc', '209')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:15:58.804260 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc', '210')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:15:58.804844 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c0587f2fc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc'): ({'sdg'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:15:58.805034 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Removing multipathed devices sdg, sdb {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:15:58.805219 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Flush multipath device 330000000e93187e8 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:15:58.853716 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:15:58.894926 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:15:58.952741 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Checking to see if SCSI volumes sdg, sdb have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:15:58.952939 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] SCSI volumes sdg, sdb have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:15:58.955476 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Checking to see if device paths {'sdg', 'sdb'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:15:58.967964 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Device paths {'sdg', 'sdb'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:15:58.968121 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:15:58.980669 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:15:59.007453 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 209, target: iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc, portal: 192.168.40.100,3260]
May 21 02:15:59.007453 np0000001127 nova-compute[98206]: Logout of [sid: 209, target: iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc, portal: 192.168.40.100,3260] successful.
May 21 02:15:59.007453 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:15:59.019552 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:15:59.032611 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:15:59.065390 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 210, target: iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc, portal: 192.168.50.100,3260]
May 21 02:15:59.065390 np0000001127 nova-compute[98206]: Logout of [sid: 210, target: iqn.2023-03.storpool.com:os--volume-971ff068-b3ff-46f3-90d6-d84b741ceffc, portal: 192.168.50.100,3260] successful.
May 21 02:15:59.065390 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:15:59.075528 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:15:59.075714 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:15:59.075819 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] <== disconnect_volume: return (295ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:15:59.075927 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:15:59.076137 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Deleting instance files /opt/stack/data/nova/instances/dc6b3f2e-f675-4762-94e1-07a908ca0856_del
May 21 02:15:59.076683 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Deletion of /opt/stack/data/nova/instances/dc6b3f2e-f675-4762-94e1-07a908ca0856_del complete
May 21 02:15:59.582156 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Took 1.64 seconds to destroy the instance on the hypervisor.
May 21 02:15:59.582777 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:15:59.583112 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:15:59.583186 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:15:59.583444 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:15:59.675865 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:15:59.676030 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 21 02:15:59.676287 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:15:59.697349 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:15:59.831242 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:16:00.115443 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-dc3f4f43-58e8-4235-97b6-9bf07d4eebaa req-1cadfcc0-6127-4406-932f-ee1885f07357 service nova] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Received event network-vif-deleted-7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:16:00.116421 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-dc3f4f43-58e8-4235-97b6-9bf07d4eebaa req-1cadfcc0-6127-4406-932f-ee1885f07357 service nova] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Neutron deleted interface 7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f; detaching it from the instance and deleting it from the info cache
May 21 02:16:00.116421 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-dc3f4f43-58e8-4235-97b6-9bf07d4eebaa req-1cadfcc0-6127-4406-932f-ee1885f07357 service nova] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:16:00.188004 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-9f68d6c6-41e9-4b01-be61-10020d711c5e req-baa41ff3-0da6-4b41-9f07-ff6601ef49da service nova] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Received event network-vif-unplugged-7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:16:00.188404 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-9f68d6c6-41e9-4b01-be61-10020d711c5e req-baa41ff3-0da6-4b41-9f07-ff6601ef49da service nova] Acquiring lock "dc6b3f2e-f675-4762-94e1-07a908ca0856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:16:00.188633 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-9f68d6c6-41e9-4b01-be61-10020d711c5e req-baa41ff3-0da6-4b41-9f07-ff6601ef49da service nova] Lock "dc6b3f2e-f675-4762-94e1-07a908ca0856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:16:00.188743 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-9f68d6c6-41e9-4b01-be61-10020d711c5e req-baa41ff3-0da6-4b41-9f07-ff6601ef49da service nova] Lock "dc6b3f2e-f675-4762-94e1-07a908ca0856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:16:00.188885 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-9f68d6c6-41e9-4b01-be61-10020d711c5e req-baa41ff3-0da6-4b41-9f07-ff6601ef49da service nova] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] No waiting events found dispatching network-vif-unplugged-7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:16:00.189041 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-9f68d6c6-41e9-4b01-be61-10020d711c5e req-baa41ff3-0da6-4b41-9f07-ff6601ef49da service nova] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Received event network-vif-unplugged-7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:16:00.570244 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:16:00.620296 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-dc3f4f43-58e8-4235-97b6-9bf07d4eebaa req-1cadfcc0-6127-4406-932f-ee1885f07357 service nova] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Detach interface failed, port_id=7db0bdc2-bee6-4a1d-a8fe-05252f3ff80f, reason: Instance dc6b3f2e-f675-4762-94e1-07a908ca0856 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:16:00.675965 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:16:01.071968 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Took 1.49 seconds to deallocate network for instance.
May 21 02:16:01.180284 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:16:01.180728 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:16:01.180728 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:16:01.180862 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Auditing locally available compute resources for np0000001127 (node: np0000001127) {{(pid=98206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 21 02:16:01.349108 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:16:01.621451 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Took 0.55 seconds to detach 1 volumes for instance.
May 21 02:16:02.126282 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:16:02.126433 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:16:02.198267 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:16:02.200921 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:16:02.278848 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:16:02.279130 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:16:02.292663 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:16:02.293214 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:16:02.404906 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:16:02.410280 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:16:02.411334 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:16:02.463966 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "env LANG=C uptime" returned: 0 in 0.052s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:16:02.464293 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Hypervisor/Node resource view: name=np0000001127 free_ram=14164MB free_disk=72.82543182373047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 21 02:16:02.464462 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:16:02.783086 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:16:03.289626 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.163s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:16:03.292170 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.825s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:16:03.368220 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Deleted allocations for instance dc6b3f2e-f675-4762-94e1-07a908ca0856
May 21 02:16:03.777374 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:16:04.378830 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-9d78b0a7-3679-49b9-b959-efec9bc86310 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Lock "dc6b3f2e-f675-4762-94e1-07a908ca0856" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.938s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:16:04.459684 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:16:04.459951 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 21 02:16:04.460104 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Final resource view: name=np0000001127 phys_ram=24030MB used_ram=704MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:16:02 up 46 min,  2 users,  load average: 3.64, 5.70, 5.69\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '1', 'num_proj_191cc7783c9c44c680600dae6b9e9f66': '1', 'io_workload': '0'} {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 21 02:16:04.567212 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:16:04.567536 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:16:05.070225 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:16:05.578677 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Compute_service record updated for np0000001127:np0000001127 {{(pid=98206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 21 02:16:05.579234 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.289s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:16:05.579234 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:16:06.435961 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.00037833399983355775 future=<Future at 0x71c07c7d4fb0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:16:06.436128 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:16:06.436186 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=6.830482526000196 future=<Future at 0x71c07c796780 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:16:06.436332 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=6.830378324000321 future=<Future at 0x71c07c796780 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:16:06.436624 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] Emitting event <LifecycleEvent: 1779329751.435504, fc403327-070b-4e21-b046-40c4160ee52b => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:16:06.436791 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] VM Stopped (Lifecycle Event)
May 21 02:16:06.579088 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:16:06.579624 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:16:06.579624 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:16:06.579794 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:16:06.580066 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.10 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:16:06.939003 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-3cd9f4d7-23ac-4c7d-98dc-66de9aba9ae3 tempest-VolumesBackupsTest-1074905684 tempest-VolumesBackupsTest-1074905684-project-member] [instance: fc403327-070b-4e21-b046-40c4160ee52b] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:16:07.204896 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:16:08.778475 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:16:12.221755 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:16:13.267113 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0003984599998148042 future=<Future at 0x71c07c796780 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:16:13.268155 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Emitting event <LifecycleEvent: 1779329758.266621, dc6b3f2e-f675-4762-94e1-07a908ca0856 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:16:13.268430 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:16:13.268630 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] VM Stopped (Lifecycle Event)
May 21 02:16:13.772560 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-2867fe9f-9816-4cb3-a389-ee5aa5a3483c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: dc6b3f2e-f675-4762-94e1-07a908ca0856] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:16:13.780048 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:16:18.780218 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:16:21.591631 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Acquiring lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:16:21.592042 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:16:22.094820 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lazy-loading 'flavor' on Instance uuid 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:16:22.237141 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:16:23.099120 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.507s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:16:23.782045 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:16:24.168744 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Acquiring lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:16:24.169199 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:16:24.169199 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Attaching volume b9689392-1895-406f-88f0-ea0835dc2c36 to /dev/vdb
May 21 02:16:24.207012 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:16:24.218747 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:16:24.238430 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:16:24.282235 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:16:24.283165 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:16:24.292363 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:16:24.293223 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe06:924a', 'fe80::2426:3ff:fef6:836e'] 
May 21 02:16:24.293346 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:16:24.293426 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:16:24.293705 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] <== get_connector_properties: return (85ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:16:24.293964 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Updating existing volume attachment record: 2c2373d8-1759-44f7-b6d8-aa8fccff0984 {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:16:24.848847 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:16:24.849268 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36', 'iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9689392-1895-406f-88f0-ea0835dc2c36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:16:24.849437 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:16:28.508083 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.658s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:16:28.508083 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36', 'iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9689392-1895-406f-88f0-ea0835dc2c36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:16:28.519551 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:16:28.519971 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:16:28.520138 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:16:28.520682 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:16:28.521110 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:16:28.521873 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:16:28.531484 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:16:28.531484 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:16:28.535888 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:16:28.535888 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:16:28.543070 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36] added
May 21 02:16:28.543070 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:16:28.543070 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:16:28.543070 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:16:28.543070 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:16:28.543070 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:16:28.543070 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:16:28.543357 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:16:28.543523 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0232(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:16:28.543734 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:16:28.546259 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36] added
May 21 02:16:28.546259 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:16:28.546259 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:16:28.546259 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:16:28.546259 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:16:28.546259 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:16:28.546259 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:16:28.546434 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:16:28.546641 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0253(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:16:28.546839 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:16:28.782887 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:16:29.544186 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:16:29.547273 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:16:29.555727 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:16:29.555727 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:16:29.561606 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:16:29.561606 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:16:29.581792 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:16:29.588721 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:16:29.596998 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2842e60a-3b4a-4c3d-a055-89d8786ac62d (non-flash)
May 21 02:16:29.596998 np0000001127 nova-compute[98206]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91a1c6cd-d345-42bf-9b58-8d162fcbaaf7 (non-flash)
May 21 02:16:29.596998 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:16:29.597148 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsi session list stdout=tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2842e60a-3b4a-4c3d-a055-89d8786ac62d (non-flash)
May 21 02:16:29.597148 np0000001127 nova-compute[98206]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91a1c6cd-d345-42bf-9b58-8d162fcbaaf7 (non-flash)
May 21 02:16:29.597148 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:16:29.603446 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2842e60a-3b4a-4c3d-a055-89d8786ac62d (non-flash)
May 21 02:16:29.603446 np0000001127 nova-compute[98206]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91a1c6cd-d345-42bf-9b58-8d162fcbaaf7 (non-flash)
May 21 02:16:29.603446 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:16:29.603446 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsi session list stdout=tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2842e60a-3b4a-4c3d-a055-89d8786ac62d (non-flash)
May 21 02:16:29.603446 np0000001127 nova-compute[98206]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91a1c6cd-d345-42bf-9b58-8d162fcbaaf7 (non-flash)
May 21 02:16:29.603446 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:16:29.632916 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36, portal: 192.168.40.100,3260]
May 21 02:16:29.632916 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36, portal: 192.168.40.100,3260] successful.
May 21 02:16:29.632916 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:16:29.645632 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:16:29.659351 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2842e60a-3b4a-4c3d-a055-89d8786ac62d (non-flash)
May 21 02:16:29.659351 np0000001127 nova-compute[98206]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91a1c6cd-d345-42bf-9b58-8d162fcbaaf7 (non-flash)
May 21 02:16:29.659351 np0000001127 nova-compute[98206]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36 (non-flash)
May 21 02:16:29.659351 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:16:29.659638 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsi session list stdout=tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2842e60a-3b4a-4c3d-a055-89d8786ac62d (non-flash)
May 21 02:16:29.659638 np0000001127 nova-compute[98206]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91a1c6cd-d345-42bf-9b58-8d162fcbaaf7 (non-flash)
May 21 02:16:29.659638 np0000001127 nova-compute[98206]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36 (non-flash)
May 21 02:16:29.659638 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:16:29.659861 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:16:29.660017 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:16:29.660624 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] HCTL ('9', '-', '-', 0) found on session 215 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:16:29.660741 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:16:29.684811 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Searching for a device in session 215 and hctl ['9', '*', '*', 0] yield: None {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:16:30.639422 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36, portal: 192.168.50.100,3260]
May 21 02:16:30.639422 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36, portal: 192.168.50.100,3260] successful.
May 21 02:16:30.639422 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:16:30.651095 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:16:30.665416 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2842e60a-3b4a-4c3d-a055-89d8786ac62d (non-flash)
May 21 02:16:30.665416 np0000001127 nova-compute[98206]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91a1c6cd-d345-42bf-9b58-8d162fcbaaf7 (non-flash)
May 21 02:16:30.665416 np0000001127 nova-compute[98206]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36 (non-flash)
May 21 02:16:30.665416 np0000001127 nova-compute[98206]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36 (non-flash)
May 21 02:16:30.665416 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:16:30.665679 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsi session list stdout=tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2842e60a-3b4a-4c3d-a055-89d8786ac62d (non-flash)
May 21 02:16:30.665679 np0000001127 nova-compute[98206]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91a1c6cd-d345-42bf-9b58-8d162fcbaaf7 (non-flash)
May 21 02:16:30.665679 np0000001127 nova-compute[98206]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36 (non-flash)
May 21 02:16:30.665679 np0000001127 nova-compute[98206]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36 (non-flash)
May 21 02:16:30.665679 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:16:30.665975 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.145s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:16:30.666386 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:16:30.666821 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] HCTL ('10', '-', '-', 0) found on session 216 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:16:30.666960 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:16:30.680410 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Searching for a device in session 216 and hctl ['10', '*', '*', 0] yield: None {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:16:30.685710 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Searching for a device in session 215 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:16:30.686103 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9689392-1895-406f-88f0-ea0835dc2c36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:16:31.681832 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Searching for a device in session 216 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:16:31.681832 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b9689392-1895-406f-88f0-ea0835dc2c36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:16:32.538059 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Found WWN 330000000adc1f756 for multipath device dm-0 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:16:32.538344 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.031s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:16:32.538539 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] <== connect_volume: return (7688ms) {'type': 'block', 'scsi_wwn': '330000000adc1f756', 'path': '/dev/dm-0', 'multipath_id': '330000000adc1f756'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:16:32.538704 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000adc1f756', 'path': '/dev/dm-0', 'multipath_id': '330000000adc1f756'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:16:32.542634 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lazy-loading 'flavor' on Instance uuid 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:16:33.047325 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Attempting to attach volume b9689392-1895-406f-88f0-ea0835dc2c36 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 02:16:33.048938 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] attach device xml: <disk type="block" device="disk">
May 21 02:16:33.048938 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:16:33.048938 np0000001127 nova-compute[98206]:   <alias name="ua-b9689392-1895-406f-88f0-ea0835dc2c36"/>
May 21 02:16:33.048938 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-0"/>
May 21 02:16:33.048938 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:16:33.048938 np0000001127 nova-compute[98206]:   <serial>b9689392-1895-406f-88f0-ea0835dc2c36</serial>
May 21 02:16:33.048938 np0000001127 nova-compute[98206]: </disk>
May 21 02:16:33.048938 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 02:16:33.784622 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:16:34.691584 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:16:34.693647 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:16:34.693647 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:16:34.693647 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] No VIF found with MAC fa:16:3e:06:92:4a, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:16:36.239955 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-5b0bcfe2-3c3e-43aa-bb45-6cb93148c02f tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.071s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:16:37.239166 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:16:38.785906 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:16:42.253100 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:16:43.786346 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:16:46.410694 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Acquiring lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:16:46.411157 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:16:46.913603 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Detaching volume b9689392-1895-406f-88f0-ea0835dc2c36
May 21 02:16:46.950109 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Attempting to driver detach volume b9689392-1895-406f-88f0-ea0835dc2c36 from mountpoint /dev/vdb
May 21 02:16:46.955488 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Found disk vdb by alias ua-b9689392-1895-406f-88f0-ea0835dc2c36 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:16:46.956934 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Found disk vdb by alias ua-b9689392-1895-406f-88f0-ea0835dc2c36 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:16:46.957097 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Attempting to detach device vdb from instance 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 02:16:46.957387 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:16:46.957387 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:16:46.957387 np0000001127 nova-compute[98206]:   <alias name="ua-b9689392-1895-406f-88f0-ea0835dc2c36"/>
May 21 02:16:46.957387 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-0"/>
May 21 02:16:46.957387 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:16:46.957387 np0000001127 nova-compute[98206]:   <serial>b9689392-1895-406f-88f0-ea0835dc2c36</serial>
May 21 02:16:46.957387 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:16:46.957387 np0000001127 nova-compute[98206]: </disk>
May 21 02:16:46.957387 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:16:46.966948 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Successfully detached device vdb from instance 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 from the persistent domain config.
May 21 02:16:46.967172 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] (1/8): Attempting to detach device vdb with device alias ua-b9689392-1895-406f-88f0-ea0835dc2c36 from instance 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 02:16:46.967523 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:16:46.967523 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:16:46.967523 np0000001127 nova-compute[98206]:   <alias name="ua-b9689392-1895-406f-88f0-ea0835dc2c36"/>
May 21 02:16:46.967523 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-0"/>
May 21 02:16:46.967523 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:16:46.967523 np0000001127 nova-compute[98206]:   <serial>b9689392-1895-406f-88f0-ea0835dc2c36</serial>
May 21 02:16:46.967523 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:16:46.967523 np0000001127 nova-compute[98206]: </disk>
May 21 02:16:46.967523 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:16:47.259492 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:16:47.452556 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779329807.4521632, 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 => ua-b9689392-1895-406f-88f0-ea0835dc2c36> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 02:16:47.453792 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-b9689392-1895-406f-88f0-ea0835dc2c36 for instance 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 02:16:47.456103 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Successfully detached device vdb from instance 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 from the live domain config.
May 21 02:16:47.457188 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:16:47.457434 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36', 'iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9689392-1895-406f-88f0-ea0835dc2c36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:16:47.457613 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:16:48.787824 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:16:48.910576 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.453s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:16:48.910808 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36', 'iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9689392-1895-406f-88f0-ea0835dc2c36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:16:48.910932 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:16:48.935560 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36 (non-flash)
May 21 02:16:48.935560 np0000001127 nova-compute[98206]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36 (non-flash)
May 21 02:16:48.935560 np0000001127 nova-compute[98206]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8646fc5-f794-47ab-979b-84f130136102 (non-flash)
May 21 02:16:48.935560 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:16:48.935776 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsi session list stdout=tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36 (non-flash)
May 21 02:16:48.935776 np0000001127 nova-compute[98206]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36 (non-flash)
May 21 02:16:48.935776 np0000001127 nova-compute[98206]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8646fc5-f794-47ab-979b-84f130136102 (non-flash)
May 21 02:16:48.935776 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:16:48.935902 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36', '215'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36', '216'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8646fc5-f794-47ab-979b-84f130136102', '217')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:16:48.935902 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36', '215')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:16:48.936616 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36', '216')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:16:48.937201 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c7eeac0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36'): ({'sde'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:16:48.937366 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Removing multipathed devices sdd, sde {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:16:48.937628 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Flush multipath device 330000000adc1f756 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:16:48.974837 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:16:49.035657 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:16:49.068805 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:16:49.069062 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:16:49.069782 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:16:49.080761 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:16:49.081011 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:16:49.092151 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:16:49.120426 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 215, target: iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36, portal: 192.168.40.100,3260]
May 21 02:16:49.120426 np0000001127 nova-compute[98206]: Logout of [sid: 215, target: iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36, portal: 192.168.40.100,3260] successful.
May 21 02:16:49.120426 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:16:49.132673 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:16:49.144144 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:16:49.181290 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 216, target: iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36, portal: 192.168.50.100,3260]
May 21 02:16:49.181290 np0000001127 nova-compute[98206]: Logout of [sid: 216, target: iqn.2023-03.storpool.com:os--volume-b9689392-1895-406f-88f0-ea0835dc2c36, portal: 192.168.50.100,3260] successful.
May 21 02:16:49.181290 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:16:49.192783 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:16:49.193024 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:16:49.193132 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] <== disconnect_volume: return (1735ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:16:49.193235 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:16:49.716477 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:16:49.779594 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lazy-loading 'flavor' on Instance uuid 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:16:49.838852 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:16:50.784700 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-d22d3601-9321-41ca-a9c3-8f736f546e15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.374s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:16:52.879592 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Acquiring lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:16:52.880500 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:16:53.383098 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lazy-loading 'flavor' on Instance uuid 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:16:53.789105 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:16:54.387803 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:16:55.449788 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Acquiring lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:16:55.451199 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:16:55.451199 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Attaching volume 5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9 to /dev/vdb
May 21 02:16:55.486573 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:16:55.495970 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:16:55.515569 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:16:55.560966 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:16:55.561310 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:16:55.570481 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:16:55.572408 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe06:924a', 'fe80::2426:3ff:fef6:836e'] 
May 21 02:16:55.572571 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:16:55.572681 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:16:55.572890 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:16:55.573173 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Updating existing volume attachment record: 5d61f4a6-627e-445f-8e89-5b56064492bc {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:16:56.123905 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:16:56.124207 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9', 'iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:16:56.124334 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:16:56.124764 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:16:56.124928 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9', 'iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:16:56.137341 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:16:56.137864 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:16:56.138230 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:16:56.138478 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:16:56.138828 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:16:56.138986 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:16:56.149437 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:16:56.149437 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:16:56.155059 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:16:56.155059 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:16:56.161101 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9] added
May 21 02:16:56.161101 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:16:56.161101 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:16:56.161101 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:16:56.161101 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:16:56.161101 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:16:56.161101 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:16:56.161101 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:16:56.161101 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0218(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:16:56.161101 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:16:56.166206 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9] added
May 21 02:16:56.166206 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:16:56.166206 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:16:56.166206 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:16:56.166206 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:16:56.166206 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:16:56.166206 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:16:56.166395 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:16:56.166527 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.028(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:16:56.166689 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:16:56.676660 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:16:56.677304 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:16:57.161667 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:16:57.167077 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:16:57.174428 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:16:57.174428 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:16:57.182131 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:16:57.182131 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:16:57.189172 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:16:57.195336 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:16:57.202905 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8646fc5-f794-47ab-979b-84f130136102 (non-flash)
May 21 02:16:57.202905 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:16:57.202905 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsi session list stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8646fc5-f794-47ab-979b-84f130136102 (non-flash)
May 21 02:16:57.202905 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:16:57.208871 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8646fc5-f794-47ab-979b-84f130136102 (non-flash)
May 21 02:16:57.208871 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:16:57.209081 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsi session list stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8646fc5-f794-47ab-979b-84f130136102 (non-flash)
May 21 02:16:57.209081 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:16:57.233980 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9, portal: 192.168.40.100,3260]
May 21 02:16:57.233980 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9, portal: 192.168.40.100,3260] successful.
May 21 02:16:57.233980 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:16:57.246342 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:16:57.258024 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9, portal: 192.168.50.100,3260]
May 21 02:16:57.258024 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9, portal: 192.168.50.100,3260] successful.
May 21 02:16:57.258024 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:16:57.261329 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:16:57.263604 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8646fc5-f794-47ab-979b-84f130136102 (non-flash)
May 21 02:16:57.263604 np0000001127 nova-compute[98206]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9 (non-flash)
May 21 02:16:57.263604 np0000001127 nova-compute[98206]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9 (non-flash)
May 21 02:16:57.263604 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:16:57.263742 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsi session list stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8646fc5-f794-47ab-979b-84f130136102 (non-flash)
May 21 02:16:57.263742 np0000001127 nova-compute[98206]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9 (non-flash)
May 21 02:16:57.263742 np0000001127 nova-compute[98206]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9 (non-flash)
May 21 02:16:57.263742 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:16:57.263968 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.126s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:16:57.264497 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:16:57.264675 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] HCTL ('8', '-', '-', 0) found on session 218 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:16:57.264742 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:16:57.271253 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:16:57.278726 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Searching for a device in session 218 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:16:57.278726 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:16:57.285155 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8646fc5-f794-47ab-979b-84f130136102 (non-flash)
May 21 02:16:57.285155 np0000001127 nova-compute[98206]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9 (non-flash)
May 21 02:16:57.285155 np0000001127 nova-compute[98206]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9 (non-flash)
May 21 02:16:57.285155 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:16:57.285294 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsi session list stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8646fc5-f794-47ab-979b-84f130136102 (non-flash)
May 21 02:16:57.285294 np0000001127 nova-compute[98206]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9 (non-flash)
May 21 02:16:57.285294 np0000001127 nova-compute[98206]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9 (non-flash)
May 21 02:16:57.285294 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:16:57.285598 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.147s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:16:57.285728 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:16:57.286302 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] HCTL ('9', '-', '-', 0) found on session 219 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:16:57.286598 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:16:57.300442 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Searching for a device in session 219 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:16:57.300442 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:16:58.138722 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:16:58.676636 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:16:58.676936 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:16:58.789793 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:16:59.154977 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Found WWN 3300000007cce4c9a for multipath device dm-0 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:16:59.155343 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:16:59.155461 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] <== connect_volume: return (3030ms) {'type': 'block', 'scsi_wwn': '3300000007cce4c9a', 'path': '/dev/dm-0', 'multipath_id': '3300000007cce4c9a'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:16:59.155607 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007cce4c9a', 'path': '/dev/dm-0', 'multipath_id': '3300000007cce4c9a'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:16:59.158737 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lazy-loading 'flavor' on Instance uuid 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:16:59.662116 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Attempting to attach volume 5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 02:16:59.667221 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] attach device xml: <disk type="block" device="disk">
May 21 02:16:59.667221 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:16:59.667221 np0000001127 nova-compute[98206]:   <alias name="ua-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9"/>
May 21 02:16:59.667221 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-0"/>
May 21 02:16:59.667221 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:16:59.667221 np0000001127 nova-compute[98206]:   <serial>5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9</serial>
May 21 02:16:59.667221 np0000001127 nova-compute[98206]: </disk>
May 21 02:16:59.667221 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 02:17:00.675871 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:17:01.180146 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:17:01.180379 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:17:01.180568 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:17:01.180716 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Auditing locally available compute resources for np0000001127 (node: np0000001127) {{(pid=98206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 21 02:17:01.303093 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:17:01.303249 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:17:01.303342 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:17:01.303450 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] No VIF found with MAC fa:16:3e:06:92:4a, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:17:02.200582 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:17:02.284629 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:17:02.285239 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823/disk --force-share --output=json {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:17:02.374835 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:17:02.375205 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 21 02:17:02.379145 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:17:02.380094 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:17:02.428569 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "env LANG=C uptime" returned: 0 in 0.048s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:17:02.428948 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Hypervisor/Node resource view: name=np0000001127 free_ram=13978MB free_disk=72.80130386352539GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 21 02:17:02.429116 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:17:02.429348 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:17:02.867192 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-4c99f579-64a2-4a79-979e-b6f237bf4d06 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.417s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:17:03.488145 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Instance 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 21 02:17:03.488455 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 21 02:17:03.488455 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Final resource view: name=np0000001127 phys_ram=24030MB used_ram=704MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:17:02 up 47 min,  2 users,  load average: 3.20, 5.21, 5.52\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '1', 'num_proj_191cc7783c9c44c680600dae6b9e9f66': '1', 'io_workload': '0'} {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 21 02:17:03.565784 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:17:03.565980 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:17:03.790587 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:17:04.068099 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:17:04.575570 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Compute_service record updated for np0000001127:np0000001127 {{(pid=98206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 21 02:17:04.576186 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.146s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:17:04.576186 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:17:05.187512 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:17:05.576634 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:17:05.576977 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:17:05.577127 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:17:05.577295 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 21 02:17:05.577560 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.97 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:17:06.367220 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Acquiring lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:17:06.367402 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:17:06.869566 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Detaching volume 5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9
May 21 02:17:06.910604 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Attempting to driver detach volume 5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9 from mountpoint /dev/vdb
May 21 02:17:06.914932 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Found disk vdb by alias ua-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:17:06.916054 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Found disk vdb by alias ua-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:17:06.916186 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Attempting to detach device vdb from instance 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 02:17:06.916498 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:17:06.916498 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:17:06.916498 np0000001127 nova-compute[98206]:   <alias name="ua-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9"/>
May 21 02:17:06.916498 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-0"/>
May 21 02:17:06.916498 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:17:06.916498 np0000001127 nova-compute[98206]:   <serial>5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9</serial>
May 21 02:17:06.916498 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:17:06.916498 np0000001127 nova-compute[98206]: </disk>
May 21 02:17:06.916498 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:17:06.924551 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Successfully detached device vdb from instance 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 from the persistent domain config.
May 21 02:17:06.924746 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] (1/8): Attempting to detach device vdb with device alias ua-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9 from instance 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 02:17:06.925047 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:17:06.925047 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:17:06.925047 np0000001127 nova-compute[98206]:   <alias name="ua-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9"/>
May 21 02:17:06.925047 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-0"/>
May 21 02:17:06.925047 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:17:06.925047 np0000001127 nova-compute[98206]:   <serial>5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9</serial>
May 21 02:17:06.925047 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:17:06.925047 np0000001127 nova-compute[98206]: </disk>
May 21 02:17:06.925047 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:17:07.262045 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:17:07.450531 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779329827.450172, 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 => ua-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 02:17:07.451494 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9 for instance 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 02:17:07.453586 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Successfully detached device vdb from instance 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 from the live domain config.
May 21 02:17:07.454505 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:17:07.454785 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9', 'iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:17:07.454930 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:17:07.455233 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:17:07.455507 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9', 'iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:17:07.455640 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:17:07.480648 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9 (non-flash)
May 21 02:17:07.480648 np0000001127 nova-compute[98206]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9 (non-flash)
May 21 02:17:07.480648 np0000001127 nova-compute[98206]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8646fc5-f794-47ab-979b-84f130136102 (non-flash)
May 21 02:17:07.480648 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:17:07.480899 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsi session list stdout=tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9 (non-flash)
May 21 02:17:07.480899 np0000001127 nova-compute[98206]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9 (non-flash)
May 21 02:17:07.480899 np0000001127 nova-compute[98206]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8646fc5-f794-47ab-979b-84f130136102 (non-flash)
May 21 02:17:07.480899 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:17:07.480899 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9', '218'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9', '219'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8646fc5-f794-47ab-979b-84f130136102', '220')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:17:07.481121 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9', '218')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:17:07.481747 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9', '219')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:17:07.482299 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c07c2fdda0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9'): ({'sdd'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:17:07.482496 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Removing multipathed devices sdc, sdd {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:17:07.482716 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Flush multipath device 3300000007cce4c9a {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:17:07.521052 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:17:07.551893 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:17:07.552203 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.12 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:17:07.569944 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:17:07.616917 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Checking to see if SCSI volumes sdc, sdd have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:17:07.617117 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] SCSI volumes sdc, sdd have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:17:07.617980 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Checking to see if device paths {'sdc', 'sdd'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:17:07.629180 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Device paths {'sdc', 'sdd'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:17:07.629342 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:17:07.641744 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:07.674303 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 218, target: iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9, portal: 192.168.40.100,3260]
May 21 02:17:07.674303 np0000001127 nova-compute[98206]: Logout of [sid: 218, target: iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9, portal: 192.168.40.100,3260] successful.
May 21 02:17:07.674303 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:07.675811 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:17:07.676044 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.87 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:17:07.689765 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:07.698252 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:07.721307 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 219, target: iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9, portal: 192.168.50.100,3260]
May 21 02:17:07.721307 np0000001127 nova-compute[98206]: Logout of [sid: 219, target: iqn.2023-03.storpool.com:os--volume-5fa76b9d-19c7-4e35-a451-bd1e3c6f8bd9, portal: 192.168.50.100,3260] successful.
May 21 02:17:07.721307 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:07.733110 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:07.733326 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:17:07.733480 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] <== disconnect_volume: return (278ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:17:07.733618 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:17:08.276698 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lazy-loading 'flavor' on Instance uuid 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:17:08.791747 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:17:09.281359 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-e9c83dc7-d370-4a98-9012-ed86876f864c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.914s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:17:09.551104 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:17:09.551389 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 48.12 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:17:10.761161 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Acquiring lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:17:10.761580 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:17:11.264573 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lazy-loading 'flavor' on Instance uuid 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:17:12.263694 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:17:12.269328 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:17:13.423387 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Acquiring lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:17:13.423899 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:17:13.423899 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Attaching volume 3e140962-c056-4ea4-bcf6-52bbb1a3a1e1 to /dev/vdb
May 21 02:17:13.475020 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:17:13.488103 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:17:13.510641 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:17:13.555603 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:17:13.555838 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:17:13.564381 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:17:13.565287 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe06:924a', 'fe80::2426:3ff:fef6:836e'] 
May 21 02:17:13.565489 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:17:13.565641 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:17:13.565832 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] <== get_connector_properties: return (90ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:17:13.566056 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Updating existing volume attachment record: a96e9055-8bdb-4c50-9276-3db0cf7ea60e {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:17:13.792411 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:17:14.141461 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:17:14.141777 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1', 'iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3e140962-c056-4ea4-bcf6-52bbb1a3a1e1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:17:14.141922 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:17:14.142313 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:17:14.142480 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1', 'iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3e140962-c056-4ea4-bcf6-52bbb1a3a1e1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:17:14.153774 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:17:14.155274 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:17:14.155785 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:17:14.156013 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:17:14.156322 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:17:14.156495 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:17:14.166226 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:17:14.166226 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:14.171925 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:17:14.171925 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:14.183550 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1] added
May 21 02:17:14.183550 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:17:14.183550 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:17:14.183550 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:17:14.183550 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:17:14.183550 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:17:14.183550 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:14.183819 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:17:14.183904 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0273(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:17:14.184046 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:17:14.196315 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1] added
May 21 02:17:14.196315 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:17:14.196315 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:17:14.196315 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:17:14.196315 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:17:14.196315 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:17:14.196315 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:14.196526 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:17:14.196645 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0406(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:17:14.196809 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:17:15.184485 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:17:15.195375 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:17:15.195375 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:15.197367 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:17:15.207020 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:15.220024 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8646fc5-f794-47ab-979b-84f130136102 (non-flash)
May 21 02:17:15.220024 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:17:15.220143 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsi session list stdout=tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8646fc5-f794-47ab-979b-84f130136102 (non-flash)
May 21 02:17:15.220143 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:17:15.228671 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:17:15.228671 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:15.242951 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:15.258283 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8646fc5-f794-47ab-979b-84f130136102 (non-flash)
May 21 02:17:15.258283 np0000001127 nova-compute[98206]: tcp: [221] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1 (non-flash)
May 21 02:17:15.258283 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:17:15.259066 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1, portal: 192.168.50.100,3260]
May 21 02:17:15.259066 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1, portal: 192.168.50.100,3260] successful.
May 21 02:17:15.259066 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:15.259587 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsi session list stdout=tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8646fc5-f794-47ab-979b-84f130136102 (non-flash)
May 21 02:17:15.259587 np0000001127 nova-compute[98206]: tcp: [221] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1 (non-flash)
May 21 02:17:15.259587 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:17:15.278521 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:15.311709 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1, portal: 192.168.40.100,3260]
May 21 02:17:15.311709 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1, portal: 192.168.40.100,3260] successful.
May 21 02:17:15.311709 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:15.312288 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8646fc5-f794-47ab-979b-84f130136102 (non-flash)
May 21 02:17:15.312288 np0000001127 nova-compute[98206]: tcp: [221] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1 (non-flash)
May 21 02:17:15.312288 np0000001127 nova-compute[98206]: tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1 (non-flash)
May 21 02:17:15.312288 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:17:15.312405 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsi session list stdout=tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8646fc5-f794-47ab-979b-84f130136102 (non-flash)
May 21 02:17:15.312405 np0000001127 nova-compute[98206]: tcp: [221] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1 (non-flash)
May 21 02:17:15.312405 np0000001127 nova-compute[98206]: tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1 (non-flash)
May 21 02:17:15.312405 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:17:15.312706 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.156s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:17:15.312864 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:17:15.313445 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] HCTL ('8', '-', '-', 0) found on session 221 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:17:15.313565 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:17:15.322937 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:15.330371 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Searching for a device in session 221 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:17:15.330520 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3e140962-c056-4ea4-bcf6-52bbb1a3a1e1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:17:15.335357 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8646fc5-f794-47ab-979b-84f130136102 (non-flash)
May 21 02:17:15.335357 np0000001127 nova-compute[98206]: tcp: [221] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1 (non-flash)
May 21 02:17:15.335357 np0000001127 nova-compute[98206]: tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1 (non-flash)
May 21 02:17:15.335357 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:17:15.335357 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsi session list stdout=tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8646fc5-f794-47ab-979b-84f130136102 (non-flash)
May 21 02:17:15.335357 np0000001127 nova-compute[98206]: tcp: [221] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1 (non-flash)
May 21 02:17:15.335357 np0000001127 nova-compute[98206]: tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1 (non-flash)
May 21 02:17:15.335357 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:17:15.335357 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.179s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:17:15.335357 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:17:15.335739 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] HCTL ('9', '-', '-', 0) found on session 222 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:17:15.335739 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:17:15.347398 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Searching for a device in session 222 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:17:15.347398 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3e140962-c056-4ea4-bcf6-52bbb1a3a1e1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:17:16.157132 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 21 02:17:17.171573 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Found WWN 330000000282462a5 for multipath device dm-0 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:17:17.171963 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:17:17.171963 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] <== connect_volume: return (3030ms) {'type': 'block', 'scsi_wwn': '330000000282462a5', 'path': '/dev/dm-0', 'multipath_id': '330000000282462a5'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:17:17.172079 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000282462a5', 'path': '/dev/dm-0', 'multipath_id': '330000000282462a5'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:17:17.174773 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lazy-loading 'flavor' on Instance uuid 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:17:17.678036 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Attempting to attach volume 3e140962-c056-4ea4-bcf6-52bbb1a3a1e1 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 02:17:17.679691 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] attach device xml: <disk type="block" device="disk">
May 21 02:17:17.679691 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:17:17.679691 np0000001127 nova-compute[98206]:   <alias name="ua-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1"/>
May 21 02:17:17.679691 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-0"/>
May 21 02:17:17.679691 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:17:17.679691 np0000001127 nova-compute[98206]:   <serial>3e140962-c056-4ea4-bcf6-52bbb1a3a1e1</serial>
May 21 02:17:17.679691 np0000001127 nova-compute[98206]: </disk>
May 21 02:17:17.679691 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 02:17:18.794012 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:17:19.317638 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:17:19.317810 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:17:19.317914 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:17:19.318013 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] No VIF found with MAC fa:16:3e:06:92:4a, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:17:20.875965 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-f8315b31-0f46-48ba-be76-f67a99907e0d tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.452s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:17:22.265770 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:17:23.795249 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:17:24.017910 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Acquiring lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:17:24.018037 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:17:24.520402 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Detaching volume 3e140962-c056-4ea4-bcf6-52bbb1a3a1e1
May 21 02:17:24.554692 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Attempting to driver detach volume 3e140962-c056-4ea4-bcf6-52bbb1a3a1e1 from mountpoint /dev/vdb
May 21 02:17:24.559273 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Found disk vdb by alias ua-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:17:24.560427 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Found disk vdb by alias ua-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:17:24.560549 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Attempting to detach device vdb from instance 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 02:17:24.560750 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:17:24.560750 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:17:24.560750 np0000001127 nova-compute[98206]:   <alias name="ua-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1"/>
May 21 02:17:24.560750 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-0"/>
May 21 02:17:24.560750 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:17:24.560750 np0000001127 nova-compute[98206]:   <serial>3e140962-c056-4ea4-bcf6-52bbb1a3a1e1</serial>
May 21 02:17:24.560750 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:17:24.560750 np0000001127 nova-compute[98206]: </disk>
May 21 02:17:24.560750 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:17:24.569300 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Successfully detached device vdb from instance 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 from the persistent domain config.
May 21 02:17:24.569455 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] (1/8): Attempting to detach device vdb with device alias ua-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1 from instance 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 02:17:24.569663 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:17:24.569663 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:17:24.569663 np0000001127 nova-compute[98206]:   <alias name="ua-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1"/>
May 21 02:17:24.569663 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-0"/>
May 21 02:17:24.569663 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:17:24.569663 np0000001127 nova-compute[98206]:   <serial>3e140962-c056-4ea4-bcf6-52bbb1a3a1e1</serial>
May 21 02:17:24.569663 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:17:24.569663 np0000001127 nova-compute[98206]: </disk>
May 21 02:17:24.569663 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:17:25.040087 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779329845.0396996, 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 => ua-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 02:17:25.040894 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1 for instance 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 02:17:25.043003 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Successfully detached device vdb from instance 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 from the live domain config.
May 21 02:17:25.044002 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:17:25.044241 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1', 'iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3e140962-c056-4ea4-bcf6-52bbb1a3a1e1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:17:25.044427 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:17:25.044736 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:17:25.045008 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1', 'iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3e140962-c056-4ea4-bcf6-52bbb1a3a1e1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:17:25.045125 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:17:25.069277 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [221] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1 (non-flash)
May 21 02:17:25.069277 np0000001127 nova-compute[98206]: tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1 (non-flash)
May 21 02:17:25.069277 np0000001127 nova-compute[98206]: tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8646fc5-f794-47ab-979b-84f130136102 (non-flash)
May 21 02:17:25.069277 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:17:25.069531 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsi session list stdout=tcp: [221] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1 (non-flash)
May 21 02:17:25.069531 np0000001127 nova-compute[98206]: tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1 (non-flash)
May 21 02:17:25.069531 np0000001127 nova-compute[98206]: tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8646fc5-f794-47ab-979b-84f130136102 (non-flash)
May 21 02:17:25.069531 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:17:25.069639 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1', '221'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1', '222'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8646fc5-f794-47ab-979b-84f130136102', '223')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:17:25.069639 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1', '222')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:17:25.070314 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1', '221')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:17:25.070933 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c09841ba60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1'): ({'sdc'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:17:25.071108 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Removing multipathed devices sdd, sdc {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:17:25.071315 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Flush multipath device 330000000282462a5 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:17:25.107954 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:17:25.173953 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:17:25.214990 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Checking to see if SCSI volumes sdd, sdc have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:17:25.215150 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] SCSI volumes sdd, sdc have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:17:25.215908 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Checking to see if device paths {'sdd', 'sdc'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:17:25.227370 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Device paths {'sdd', 'sdc'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:17:25.227559 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:17:25.240459 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:25.272565 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 222, target: iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1, portal: 192.168.40.100,3260]
May 21 02:17:25.272565 np0000001127 nova-compute[98206]: Logout of [sid: 222, target: iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1, portal: 192.168.40.100,3260] successful.
May 21 02:17:25.272565 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:25.304120 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:25.330616 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:25.362382 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 221, target: iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1, portal: 192.168.50.100,3260]
May 21 02:17:25.362382 np0000001127 nova-compute[98206]: Logout of [sid: 221, target: iqn.2023-03.storpool.com:os--volume-3e140962-c056-4ea4-bcf6-52bbb1a3a1e1, portal: 192.168.50.100,3260] successful.
May 21 02:17:25.362382 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:25.374072 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:25.374279 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:17:25.374390 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] <== disconnect_volume: return (329ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:17:25.374524 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:17:25.918848 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lazy-loading 'flavor' on Instance uuid 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:17:26.925234 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-ff2f80fe-684f-42d7-a06d-81b57b2a4fc1 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.907s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:17:27.266309 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:17:28.360178 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Acquiring lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:17:28.361796 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:17:28.795857 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:17:28.865204 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lazy-loading 'flavor' on Instance uuid 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:17:29.869713 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:17:30.929179 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Acquiring lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:17:30.929616 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:17:30.929616 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Attaching volume dbe62d6b-ce4f-48a1-9314-419140911c02 to /dev/vdb
May 21 02:17:30.968415 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.30', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001127', 'execute': None}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:17:30.978372 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.scaleio [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98206) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 21 02:17:30.997200 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Running cmd (subprocess): nvme version {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:17:31.041112 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] 'nvme version' failed. Not Retrying. {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 21 02:17:31.041411 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] nvme not present on system {{(pid=98206) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 21 02:17:31.049844 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98206) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 21 02:17:31.050782 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.lightos [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Current host hostNQN  and IP(s) are ['10.4.3.30', 'fe80::f816:3eff:fe34:4f67', '192.168.40.6', 'fe80::f816:3eff:fe61:ba98', '192.168.50.6', 'fe80::f816:3eff:fe7a:a9e2', '192.168.10.6', 'fe80::f816:3eff:fe4f:24cb', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::18f2:46ff:feb2:db4c', 'fe80::fc16:3eff:fe06:924a', 'fe80::2426:3ff:fef6:836e'] 
May 21 02:17:31.050906 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 21 02:17:31.051149 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.lightos [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] LIGHTOS: no hostnqn found. {{(pid=98206) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 21 02:17:31.051378 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] <== get_connector_properties: return (82ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.30', 'host': 'np0000001127', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d99c84efc270', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd5d06cba-b6e7-4050-84eb-2f6bf37e7716', 'nvme_native_multipath': False} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:17:31.051623 np0000001127 nova-compute[98206]: DEBUG nova.virt.block_device [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Updating existing volume attachment record: efa9d283-d71a-48f3-8040-cbc38a08065e {{(pid=98206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 21 02:17:31.596368 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Calling os-brick to attach iSCSI Volume {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 21 02:17:31.596702 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02', 'iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dbe62d6b-ce4f-48a1-9314-419140911c02', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:17:31.596834 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:17:31.597242 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:17:31.597412 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02', 'iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dbe62d6b-ce4f-48a1-9314-419140911c02', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 21 02:17:31.608247 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:17:31.609605 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:17:31.610127 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:17:31.610324 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:17:31.610695 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:17:31.610872 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:17:31.621869 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:17:31.621869 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:31.625990 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 21 02:17:31.625990 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:31.633280 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02] added
May 21 02:17:31.633280 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:17:31.633280 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:17:31.633280 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:17:31.633280 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:17:31.633280 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:17:31.633280 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:31.633280 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:17:31.633631 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0225(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:17:31.633668 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:17:31.637444 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02] added
May 21 02:17:31.637444 np0000001127 nova-compute[98206]:  stderr=iscsiadm: Config file line 363 does not have value
May 21 02:17:31.637444 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:17:31.637444 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:17:31.637444 np0000001127 nova-compute[98206]: iscsiadm: Config file line 363 does not have value
May 21 02:17:31.637444 np0000001127 nova-compute[98206]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 21 02:17:31.637444 np0000001127 nova-compute[98206]:  {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:31.637638 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98206) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 21 02:17:31.638237 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0275(s), this was the 1st time calling it. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 21 02:17:31.638396 np0000001127 nova-compute[98206]: DEBUG os_brick.utils [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98206) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 21 02:17:32.268211 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:17:32.634808 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 21 02:17:32.638795 np0000001127 nova-compute[98206]: INFO os_brick.initiator.connectors.iscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.50.100
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:17:32.645592 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:17:32.645592 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.name = iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.tpgt = -1
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.startup = manual
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.leading_login = No
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.iscsi_ifacename = default
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.net_ifacename = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.ipaddress = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.prefix_len = 0
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.hwaddress = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.transport_name = tcp
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.initiatorname = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.state = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.vlan_id = 0
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.vlan_priority = 0
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.vlan_state = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.iface_num = 0
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.mtu = 0
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.port = 0
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.bootproto = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.subnet_mask = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.gateway = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id_state = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.dhcp_alt_client_id = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.dhcp_dns = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.dhcp_learn_iqn = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.dhcp_req_vendor_id_state = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id_state = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.dhcp_vendor_id = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.dhcp_slp_da = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.fragmentation = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.gratuitous_arp = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.incoming_forwarding = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.tos_state = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.tos = 0
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.ttl = 0
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.delayed_ack = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.tcp_nagle = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.tcp_wsf_state = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.tcp_wsf = 0
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.tcp_timer_scale = 0
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.tcp_timestamp = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.redirect = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.def_task_mgmt_timeout = 0
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.header_digest = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.data_digest = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.immediate_data = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.initial_r2t = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.data_seq_inorder = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.data_pdu_inorder = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.erl = 0
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.max_receive_data_len = 0
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.first_burst_len = 0
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.max_outstanding_r2t = 0
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.max_burst_len = 0
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.chap_auth = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.bidi_chap = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.strict_login_compliance = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.discovery_auth = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: iface.discovery_logout = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.discovery_address = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.discovery_port = 0
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.discovery_type = fw
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.session.initial_cmdsn = 0
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.session.initial_login_retry_max = 8
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.session.xmit_thread_priority = 0
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.session.cmds_max = 128
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.session.queue_depth = 32
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.session.nr_sessions = 1
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.session.auth.authmethod = None
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.session.auth.username = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.session.auth.password = ***
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.session.auth.username_in = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.session.auth.password_in = <empty>
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.session.auth.chap_algs = SHA256
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.session.timeo.replacement_timeout = 120
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.session.err_timeo.abort_timeout = 15
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.session.err_timeo.lu_reset_timeout = 30
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.session.err_timeo.tgt_reset_timeout = 30
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.session.err_timeo.host_reset_timeout = 60
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.session.iscsi.FastAbort = Yes
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.session.iscsi.InitialR2T = No
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.session.iscsi.ImmediateData = Yes
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.session.iscsi.FirstBurstLength = 262144
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.session.iscsi.MaxBurstLength = 16776192
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Retain = 0
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.session.iscsi.DefaultTime2Wait = 2
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.session.iscsi.MaxConnections = 1
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.session.iscsi.MaxOutstandingR2T = 1
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.session.iscsi.ERL = 0
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.session.scan = auto
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.session.reopen_max = 0
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.conn[0].address = 192.168.40.100
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.conn[0].port = 3260
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.conn[0].startup = manual
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.conn[0].tcp.window_size = 524288
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.conn[0].tcp.type_of_service = 0
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.conn[0].timeo.logout_timeout = 15
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.conn[0].timeo.login_timeout = 15
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.conn[0].timeo.auth_timeout = 45
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_interval = 5
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.conn[0].timeo.noop_out_timeout = 5
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.conn[0].iscsi.HeaderDigest = None
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.conn[0].iscsi.DataDigest = None
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.conn[0].iscsi.IFMarker = No
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: node.conn[0].iscsi.OFMarker = No
May 21 02:17:32.650303 np0000001127 nova-compute[98206]: # END RECORD
May 21 02:17:32.650303 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:32.657944 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:32.662488 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:32.670355 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8646fc5-f794-47ab-979b-84f130136102 (non-flash)
May 21 02:17:32.670355 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:17:32.670514 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsi session list stdout=tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8646fc5-f794-47ab-979b-84f130136102 (non-flash)
May 21 02:17:32.670514 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:17:32.702480 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02, portal: 192.168.50.100,3260]
May 21 02:17:32.702480 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02, portal: 192.168.50.100,3260] successful.
May 21 02:17:32.702480 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:32.707779 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8646fc5-f794-47ab-979b-84f130136102 (non-flash)
May 21 02:17:32.707779 np0000001127 nova-compute[98206]: tcp: [225] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02 (non-flash)
May 21 02:17:32.707779 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:17:32.708681 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsi session list stdout=tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8646fc5-f794-47ab-979b-84f130136102 (non-flash)
May 21 02:17:32.708681 np0000001127 nova-compute[98206]: tcp: [225] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02 (non-flash)
May 21 02:17:32.708681 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:17:32.716795 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:32.745124 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02, portal: 192.168.40.100,3260]
May 21 02:17:32.745124 np0000001127 nova-compute[98206]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02, portal: 192.168.40.100,3260] successful.
May 21 02:17:32.745124 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:32.746527 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8646fc5-f794-47ab-979b-84f130136102 (non-flash)
May 21 02:17:32.746527 np0000001127 nova-compute[98206]: tcp: [225] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02 (non-flash)
May 21 02:17:32.746527 np0000001127 nova-compute[98206]: tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02 (non-flash)
May 21 02:17:32.746527 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:17:32.746691 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsi session list stdout=tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8646fc5-f794-47ab-979b-84f130136102 (non-flash)
May 21 02:17:32.746691 np0000001127 nova-compute[98206]: tcp: [225] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02 (non-flash)
May 21 02:17:32.746691 np0000001127 nova-compute[98206]: tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02 (non-flash)
May 21 02:17:32.746691 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:17:32.746968 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.136s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:17:32.747101 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Connected to 192.168.50.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:17:32.747927 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] HCTL ('8', '-', '-', 0) found on session 225 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:17:32.748055 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:17:32.757936 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:32.766848 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Searching for a device in session 225 and hctl ['8', '*', '*', 0] yield: None {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:17:32.792853 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8646fc5-f794-47ab-979b-84f130136102 (non-flash)
May 21 02:17:32.792853 np0000001127 nova-compute[98206]: tcp: [225] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02 (non-flash)
May 21 02:17:32.792853 np0000001127 nova-compute[98206]: tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02 (non-flash)
May 21 02:17:32.792853 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:17:32.793724 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsi session list stdout=tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8646fc5-f794-47ab-979b-84f130136102 (non-flash)
May 21 02:17:32.793724 np0000001127 nova-compute[98206]: tcp: [225] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02 (non-flash)
May 21 02:17:32.793724 np0000001127 nova-compute[98206]: tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02 (non-flash)
May 21 02:17:32.793724 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:17:32.793724 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.184s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:17:32.794272 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Connected to 192.168.40.100:3260 {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 21 02:17:32.795252 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] HCTL ('9', '-', '-', 0) found on session 226 with lun 0 {{(pid=98206) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 21 02:17:32.795827 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98206) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 21 02:17:32.811074 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Searching for a device in session 226 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:17:32.811261 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dbe62d6b-ce4f-48a1-9314-419140911c02', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:17:33.767451 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Searching for a device in session 225 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98206) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 21 02:17:33.767948 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'dbe62d6b-ce4f-48a1-9314-419140911c02', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98206) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 21 02:17:33.796500 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:17:34.629286 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Found WWN 330000000f2e490f7 for multipath device dm-0 {{(pid=98206) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 21 02:17:34.629515 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:17:34.629774 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '330000000f2e490f7', 'path': '/dev/dm-0', 'multipath_id': '330000000f2e490f7'} {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:17:34.629847 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f2e490f7', 'path': '/dev/dm-0', 'multipath_id': '330000000f2e490f7'} {{(pid=98206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 21 02:17:34.632970 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lazy-loading 'flavor' on Instance uuid 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:17:35.137420 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Attempting to attach volume dbe62d6b-ce4f-48a1-9314-419140911c02 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98206) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 21 02:17:35.138797 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] attach device xml: <disk type="block" device="disk">
May 21 02:17:35.138797 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:17:35.138797 np0000001127 nova-compute[98206]:   <alias name="ua-dbe62d6b-ce4f-48a1-9314-419140911c02"/>
May 21 02:17:35.138797 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-0"/>
May 21 02:17:35.138797 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:17:35.138797 np0000001127 nova-compute[98206]:   <serial>dbe62d6b-ce4f-48a1-9314-419140911c02</serial>
May 21 02:17:35.138797 np0000001127 nova-compute[98206]: </disk>
May 21 02:17:35.138797 np0000001127 nova-compute[98206]:  {{(pid=98206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 21 02:17:36.783730 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] No BDM found with device name vda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:17:36.784129 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:17:36.784129 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] No BDM found with device name hda, not building metadata. {{(pid=98206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 21 02:17:36.784129 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] No VIF found with MAC fa:16:3e:06:92:4a, not building metadata {{(pid=98206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 21 02:17:38.326614 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-2d3f29d4-cae4-4d5b-9b2b-b4a3d495ce87 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.397s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:17:38.797654 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:17:41.684284 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Acquiring lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:17:41.685517 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:17:42.187376 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Detaching volume dbe62d6b-ce4f-48a1-9314-419140911c02
May 21 02:17:42.217388 np0000001127 nova-compute[98206]: INFO nova.virt.block_device [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Attempting to driver detach volume dbe62d6b-ce4f-48a1-9314-419140911c02 from mountpoint /dev/vdb
May 21 02:17:42.221552 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Found disk vdb by alias ua-dbe62d6b-ce4f-48a1-9314-419140911c02 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:17:42.222630 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Found disk vdb by alias ua-dbe62d6b-ce4f-48a1-9314-419140911c02 {{(pid=98206) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 21 02:17:42.222734 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Attempting to detach device vdb from instance 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 from the persistent domain config. {{(pid=98206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 21 02:17:42.222968 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:17:42.222968 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:17:42.222968 np0000001127 nova-compute[98206]:   <alias name="ua-dbe62d6b-ce4f-48a1-9314-419140911c02"/>
May 21 02:17:42.222968 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-0"/>
May 21 02:17:42.222968 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:17:42.222968 np0000001127 nova-compute[98206]:   <serial>dbe62d6b-ce4f-48a1-9314-419140911c02</serial>
May 21 02:17:42.222968 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:17:42.222968 np0000001127 nova-compute[98206]: </disk>
May 21 02:17:42.222968 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:17:42.229426 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Successfully detached device vdb from instance 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 from the persistent domain config.
May 21 02:17:42.229578 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] (1/8): Attempting to detach device vdb with device alias ua-dbe62d6b-ce4f-48a1-9314-419140911c02 from instance 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 from the live domain config. {{(pid=98206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 21 02:17:42.229811 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.guest [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] detach device xml: <disk type="block" device="disk">
May 21 02:17:42.229811 np0000001127 nova-compute[98206]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 21 02:17:42.229811 np0000001127 nova-compute[98206]:   <alias name="ua-dbe62d6b-ce4f-48a1-9314-419140911c02"/>
May 21 02:17:42.229811 np0000001127 nova-compute[98206]:   <source dev="/dev/dm-0"/>
May 21 02:17:42.229811 np0000001127 nova-compute[98206]:   <target dev="vdb" bus="virtio"/>
May 21 02:17:42.229811 np0000001127 nova-compute[98206]:   <serial>dbe62d6b-ce4f-48a1-9314-419140911c02</serial>
May 21 02:17:42.229811 np0000001127 nova-compute[98206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 21 02:17:42.229811 np0000001127 nova-compute[98206]: </disk>
May 21 02:17:42.229811 np0000001127 nova-compute[98206]:  {{(pid=98206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 21 02:17:42.270546 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:17:42.686096 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Received event <DeviceRemovedEvent: 1779329862.6857018, 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 => ua-dbe62d6b-ce4f-48a1-9314-419140911c02> from libvirt while the driver is waiting for it; dispatched. {{(pid=98206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 21 02:17:42.686997 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-dbe62d6b-ce4f-48a1-9314-419140911c02 for instance 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 {{(pid=98206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 21 02:17:42.689663 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Successfully detached device vdb from instance 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 from the live domain config.
May 21 02:17:42.690786 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] calling os-brick to detach iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 21 02:17:42.691059 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71c07c567440>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02', 'iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dbe62d6b-ce4f-48a1-9314-419140911c02', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 21 02:17:42.691211 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 21 02:17:42.691558 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 21 02:17:42.691804 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02', 'iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dbe62d6b-ce4f-48a1-9314-419140911c02', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 21 02:17:42.691936 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02', 0)] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 21 02:17:42.715643 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02 (non-flash)
May 21 02:17:42.715643 np0000001127 nova-compute[98206]: tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02 (non-flash)
May 21 02:17:42.715643 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 21 02:17:42.715834 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsi session list stdout=tcp: [225] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02 (non-flash)
May 21 02:17:42.715834 np0000001127 nova-compute[98206]: tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02 (non-flash)
May 21 02:17:42.715834 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 21 02:17:42.716071 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02', '225'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02', '226')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 21 02:17:42.716229 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02', '226')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:17:42.716928 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02', '225')] {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 21 02:17:42.717603 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71c0585a11c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02'): ({'sdc'}, set())}) {{(pid=98206) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 21 02:17:42.717834 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Removing multipathed devices sdd, sdc {{(pid=98206) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 21 02:17:42.718091 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Flush multipath device 330000000f2e490f7 {{(pid=98206) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 21 02:17:42.763602 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:17:42.809823 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98206) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 21 02:17:42.848674 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Checking to see if SCSI volumes sdd, sdc have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 21 02:17:42.848833 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] SCSI volumes sdd, sdc have been removed. {{(pid=98206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 21 02:17:42.849372 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Checking to see if device paths {'sdd', 'sdc'} are still under multipathd monitoring {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 21 02:17:42.859477 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.linuxscsi [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Device paths {'sdd', 'sdc'} have been removed from multipathd monitoring. {{(pid=98206) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 21 02:17:42.859658 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02')] {{(pid=98206) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 21 02:17:42.870027 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:42.899052 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 226, target: iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02, portal: 192.168.40.100,3260]
May 21 02:17:42.899052 np0000001127 nova-compute[98206]: Logout of [sid: 226, target: iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02, portal: 192.168.40.100,3260] successful.
May 21 02:17:42.899052 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:42.909058 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:42.918717 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:42.944015 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 225, target: iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02, portal: 192.168.50.100,3260]
May 21 02:17:42.944015 np0000001127 nova-compute[98206]: Logout of [sid: 225, target: iqn.2023-03.storpool.com:os--volume-dbe62d6b-ce4f-48a1-9314-419140911c02, portal: 192.168.50.100,3260] successful.
May 21 02:17:42.944015 np0000001127 nova-compute[98206]:  stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:42.954028 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98206) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 21 02:17:42.954240 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.base [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 21 02:17:42.954378 np0000001127 nova-compute[98206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] <== disconnect_volume: return (262ms) None {{(pid=98206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 21 02:17:42.954540 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Disconnected iSCSI Volume {{(pid=98206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 21 02:17:43.495784 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lazy-loading 'flavor' on Instance uuid 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:17:43.798769 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:17:44.501147 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-8165e75a-fe24-4111-a143-d581e08a3c15 tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.815s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:17:45.364623 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:17:48.799222 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:17:52.619926 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-532ecb55-8a6f-458d-b36d-b27c93fc615c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Acquiring lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:17:52.620400 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-532ecb55-8a6f-458d-b36d-b27c93fc615c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:17:52.620400 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-532ecb55-8a6f-458d-b36d-b27c93fc615c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Acquiring lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:17:52.620400 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-532ecb55-8a6f-458d-b36d-b27c93fc615c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:17:52.620400 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-532ecb55-8a6f-458d-b36d-b27c93fc615c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:17:52.622229 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-532ecb55-8a6f-458d-b36d-b27c93fc615c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Terminating instance
May 21 02:17:53.124781 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-532ecb55-8a6f-458d-b36d-b27c93fc615c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Start destroying the instance on the hypervisor. {{(pid=98206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 21 02:17:53.147046 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:17:53.148736 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:17:53.162835 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:17:53.165818 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:17:53.181930 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:17:53.186817 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:17:53.350954 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-747b0259-b16c-41b9-a428-81e1b0982870 req-f28c34b2-b410-4436-8914-5c286988be3a service nova] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Received event network-vif-unplugged-ae239959-51e8-47b7-830d-5d0a3889c4a6 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:17:53.351408 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-747b0259-b16c-41b9-a428-81e1b0982870 req-f28c34b2-b410-4436-8914-5c286988be3a service nova] Acquiring lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:17:53.351530 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-747b0259-b16c-41b9-a428-81e1b0982870 req-f28c34b2-b410-4436-8914-5c286988be3a service nova] Lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:17:53.351651 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-747b0259-b16c-41b9-a428-81e1b0982870 req-f28c34b2-b410-4436-8914-5c286988be3a service nova] Lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:17:53.351753 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-747b0259-b16c-41b9-a428-81e1b0982870 req-f28c34b2-b410-4436-8914-5c286988be3a service nova] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] No waiting events found dispatching network-vif-unplugged-ae239959-51e8-47b7-830d-5d0a3889c4a6 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:17:53.351863 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-747b0259-b16c-41b9-a428-81e1b0982870 req-f28c34b2-b410-4436-8914-5c286988be3a service nova] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Received event network-vif-unplugged-ae239959-51e8-47b7-830d-5d0a3889c4a6 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:17:53.453234 np0000001127 nova-compute[98206]: DEBUG nova.utils [None req-9661a11a-b9d0-40a1-a6e5-36ac8fb82568 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.999708691999786 future=<Future at 0x71c07c31c230 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:17:53.453727 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.99920569699998 future=<Future at 0x71c07c31c230 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:17:53.453971 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=14.998982396999963 future=<Future at 0x71c07c31c230 state=pending>) {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:17:53.455461 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [-] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Instance destroyed successfully.
May 21 02:17:53.455997 np0000001127 nova-compute[98206]: DEBUG nova.objects.instance [None req-532ecb55-8a6f-458d-b36d-b27c93fc615c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lazy-loading 'resources' on Instance uuid 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 {{(pid=98206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 21 02:17:53.800175 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:17:53.958426 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.vif [None req-532ecb55-8a6f-458d-b36d-b27c93fc615c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-21T02:15:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1474726311',display_name='tempest-SnapshotDataIntegrityTests-server-1474726311',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001127',hostname='tempest-snapshotdataintegritytests-server-1474726311',id=81,image_ref='1545019a-a9af-4414-b299-e8f325be0886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANZXm6gMvj5XeRFamVC5EumsVH3ZBC+IDv/xlNxt4G/ow6iuVhXe3jHUGji1zS6D6fiAKlKpZB+V93Vc3VoSU9d8djcrpi+zEPpMxJH1ivjicM3J+eABSHJvcXIg3r9bg==',key_name='tempest-keypair-1204205143',keypairs=<?>,launch_index=0,launched_at=2026-05-21T02:15:42Z,launched_on='np0000001127',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001127',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='191cc7783c9c44c680600dae6b9e9f66',ramdisk_id='',reservation_id='r-i0i9j004',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1545019a-a9af-4414-b299-e8f325be0886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1302442363',owner_user_name='tempest-SnapshotDataIntegrityTests-1302442363-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-21T02:15:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b73df9b644c64739bfe58e29c47ebd7b',uuid=97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae239959-51e8-47b7-830d-5d0a3889c4a6", "address": "fa:16:3e:06:92:4a", "network": {"id": "f372489c-3847-4543-a67f-895717459527", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-298685652-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "191cc7783c9c44c680600dae6b9e9f66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae239959-51", "ovs_interfaceid": "ae239959-51e8-47b7-830d-5d0a3889c4a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 21 02:17:53.958711 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-532ecb55-8a6f-458d-b36d-b27c93fc615c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Converting VIF {"id": "ae239959-51e8-47b7-830d-5d0a3889c4a6", "address": "fa:16:3e:06:92:4a", "network": {"id": "f372489c-3847-4543-a67f-895717459527", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-298685652-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "191cc7783c9c44c680600dae6b9e9f66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae239959-51", "ovs_interfaceid": "ae239959-51e8-47b7-830d-5d0a3889c4a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 21 02:17:53.959338 np0000001127 nova-compute[98206]: DEBUG nova.network.os_vif_util [None req-532ecb55-8a6f-458d-b36d-b27c93fc615c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:92:4a,bridge_name='br-int',has_traffic_filtering=True,id=ae239959-51e8-47b7-830d-5d0a3889c4a6,network=Network(f372489c-3847-4543-a67f-895717459527),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae239959-51') {{(pid=98206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 21 02:17:53.959616 np0000001127 nova-compute[98206]: DEBUG os_vif [None req-532ecb55-8a6f-458d-b36d-b27c93fc615c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:92:4a,bridge_name='br-int',has_traffic_filtering=True,id=ae239959-51e8-47b7-830d-5d0a3889c4a6,network=Network(f372489c-3847-4543-a67f-895717459527),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae239959-51') {{(pid=98206) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 21 02:17:53.960736 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:17:53.960935 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae239959-51, bridge=br-int, if_exists=True) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:17:53.961906 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:17:53.962531 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:17:53.963069 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:17:53.963189 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a0ed8971-aa0c-4411-a04c-19e5647a600c) {{(pid=98206) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 21 02:17:53.963659 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:17:53.964120 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 21 02:17:53.964184 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:17:53.965953 np0000001127 nova-compute[98206]: INFO os_vif [None req-532ecb55-8a6f-458d-b36d-b27c93fc615c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:92:4a,bridge_name='br-int',has_traffic_filtering=True,id=ae239959-51e8-47b7-830d-5d0a3889c4a6,network=Network(f372489c-3847-4543-a67f-895717459527),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae239959-51')
May 21 02:17:53.966200 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-532ecb55-8a6f-458d-b36d-b27c93fc615c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Deleting instance files /opt/stack/data/nova/instances/97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823_del
May 21 02:17:53.967013 np0000001127 nova-compute[98206]: INFO nova.virt.libvirt.driver [None req-532ecb55-8a6f-458d-b36d-b27c93fc615c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Deletion of /opt/stack/data/nova/instances/97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823_del complete
May 21 02:17:54.475198 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-532ecb55-8a6f-458d-b36d-b27c93fc615c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Took 1.35 seconds to destroy the instance on the hypervisor.
May 21 02:17:54.475861 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._common.loopingcall [None req-532ecb55-8a6f-458d-b36d-b27c93fc615c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98206) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 21 02:17:54.476164 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [-] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Deallocating network for instance {{(pid=98206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 21 02:17:54.476303 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] deallocate_for_instance() {{(pid=98206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 21 02:17:54.476594 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:17:54.562510 np0000001127 nova-compute[98206]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 21 02:17:54.959936 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e8a99aeb-e30d-4b2c-bebe-0aa2db381dbe req-32cb00cb-124e-431f-9537-bae6f5695730 service nova] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Received event network-vif-deleted-ae239959-51e8-47b7-830d-5d0a3889c4a6 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:17:54.959936 np0000001127 nova-compute[98206]: INFO nova.compute.manager [req-e8a99aeb-e30d-4b2c-bebe-0aa2db381dbe req-32cb00cb-124e-431f-9537-bae6f5695730 service nova] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Neutron deleted interface ae239959-51e8-47b7-830d-5d0a3889c4a6; detaching it from the instance and deleting it from the info cache
May 21 02:17:54.959936 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [req-e8a99aeb-e30d-4b2c-bebe-0aa2db381dbe req-32cb00cb-124e-431f-9537-bae6f5695730 service nova] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:17:55.389428 np0000001127 nova-compute[98206]: DEBUG nova.network.neutron [-] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Updating instance_info_cache with network_info: [] {{(pid=98206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 21 02:17:55.406604 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-498d3e16-5915-413a-8cdd-b5a06ea4e137 req-3d12de67-1e33-4f2d-848d-17ff67747f32 service nova] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Received event network-vif-unplugged-ae239959-51e8-47b7-830d-5d0a3889c4a6 {{(pid=98206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 21 02:17:55.406838 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-498d3e16-5915-413a-8cdd-b5a06ea4e137 req-3d12de67-1e33-4f2d-848d-17ff67747f32 service nova] Acquiring lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:17:55.407142 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-498d3e16-5915-413a-8cdd-b5a06ea4e137 req-3d12de67-1e33-4f2d-848d-17ff67747f32 service nova] Lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:17:55.407566 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [req-498d3e16-5915-413a-8cdd-b5a06ea4e137 req-3d12de67-1e33-4f2d-848d-17ff67747f32 service nova] Lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:17:55.407566 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-498d3e16-5915-413a-8cdd-b5a06ea4e137 req-3d12de67-1e33-4f2d-848d-17ff67747f32 service nova] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] No waiting events found dispatching network-vif-unplugged-ae239959-51e8-47b7-830d-5d0a3889c4a6 {{(pid=98206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 21 02:17:55.407690 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-498d3e16-5915-413a-8cdd-b5a06ea4e137 req-3d12de67-1e33-4f2d-848d-17ff67747f32 service nova] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Received event network-vif-unplugged-ae239959-51e8-47b7-830d-5d0a3889c4a6 for instance with task_state deleting. {{(pid=98206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 21 02:17:55.463205 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [req-e8a99aeb-e30d-4b2c-bebe-0aa2db381dbe req-32cb00cb-124e-431f-9537-bae6f5695730 service nova] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Detach interface failed, port_id=ae239959-51e8-47b7-830d-5d0a3889c4a6, reason: Instance 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 could not be found. {{(pid=98206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 21 02:17:55.891871 np0000001127 nova-compute[98206]: INFO nova.compute.manager [-] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Took 1.42 seconds to deallocate network for instance.
May 21 02:17:56.397103 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-532ecb55-8a6f-458d-b36d-b27c93fc615c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:17:56.397544 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-532ecb55-8a6f-458d-b36d-b27c93fc615c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:17:56.476635 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-532ecb55-8a6f-458d-b36d-b27c93fc615c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:17:56.476833 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-532ecb55-8a6f-458d-b36d-b27c93fc615c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:17:56.979283 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-532ecb55-8a6f-458d-b36d-b27c93fc615c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:17:57.484653 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-532ecb55-8a6f-458d-b36d-b27c93fc615c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.087s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:17:57.530720 np0000001127 nova-compute[98206]: INFO nova.scheduler.client.report [None req-532ecb55-8a6f-458d-b36d-b27c93fc615c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Deleted allocations for instance 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823
May 21 02:17:57.675834 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:17:57.676099 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:17:58.537746 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-532ecb55-8a6f-458d-b36d-b27c93fc615c tempest-SnapshotDataIntegrityTests-1302442363 tempest-SnapshotDataIntegrityTests-1302442363-project-member] Lock "97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.918s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:17:58.963610 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:18:00.671730 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:18:00.675821 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:18:00.676052 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:18:01.180489 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:18:01.180809 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:18:01.180990 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:18:01.181179 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Auditing locally available compute resources for np0000001127 (node: np0000001127) {{(pid=98206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 21 02:18:01.197203 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:18:01.198498 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:18:01.249921 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "env LANG=C uptime" returned: 0 in 0.051s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:18:01.250350 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Hypervisor/Node resource view: name=np0000001127 free_ram=14524MB free_disk=72.81840896606445GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 21 02:18:01.250519 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:18:01.250777 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:18:02.159278 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:18:02.302994 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 21 02:18:02.303208 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Final resource view: name=np0000001127 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:18:01 up 48 min,  2 users,  load average: 2.56, 4.64, 5.31\n'} {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 21 02:18:02.346809 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:18:02.347004 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:18:02.849639 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:18:03.355462 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Compute_service record updated for np0000001127:np0000001127 {{(pid=98206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 21 02:18:03.355934 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.105s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:18:03.356053 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:18:03.964353 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:18:04.356349 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:18:04.356349 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 21 02:18:04.356855 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.32 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:18:04.676534 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:18:04.676825 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:18:04.677067 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.87 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:18:05.460312 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:18:06.869419 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:18:07.273658 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:18:07.551480 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:18:07.551918 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.12 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:18:08.453439 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71c09b930620>>, remaining_delay=-0.0004979529999218357 future=<Future at 0x71c07c31c230 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71c09c7e1ca0> {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:18:08.454739 np0000001127 nova-compute[98206]: DEBUG nova.virt.driver [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] Emitting event <LifecycleEvent: 1779329873.4528267, 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823 => Stopped> {{(pid=98206) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 21 02:18:08.454929 np0000001127 nova-compute[98206]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98206) _log /opt/stack/nova/nova/utils.py:1500}}
May 21 02:18:08.455101 np0000001127 nova-compute[98206]: INFO nova.compute.manager [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] VM Stopped (Lifecycle Event)
May 21 02:18:08.957564 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-c81916d7-dfcf-4e1a-aadd-d49779c7064d tempest-TestVolumeBootPattern-1995806391 tempest-TestVolumeBootPattern-1995806391-project-member] [instance: 97c46d4b-dcc7-4e9b-8a3d-bfabb9fe9823] Checking state {{(pid=98206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 21 02:18:08.965728 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:18:09.047163 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:18:09.675950 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:18:09.676303 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:18:10.825292 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:18:12.274629 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:18:12.676179 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:18:12.676458 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Cleaning up deleted instances {{(pid=98206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}
May 21 02:18:13.178225 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] There are 0 instances to clean {{(pid=98206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12092}}
May 21 02:18:13.178432 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:18:13.178570 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98206) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12121}}
May 21 02:18:13.680279 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:18:13.966367 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:18:14.182115 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 45.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:18:17.275771 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:18:18.968189 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:18:19.547039 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:18:21.058148 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:18:23.969138 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:18:28.969279 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:18:33.970750 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:18:38.971328 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:18:43.971986 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:18:48.973043 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:18:53.973242 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:18:58.974181 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:18:59.181952 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:18:59.182159 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.49 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:19:00.675937 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:19:00.676332 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:19:01.180279 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:19:01.180457 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:19:01.180633 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:19:01.180754 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Auditing locally available compute resources for np0000001127 (node: np0000001127) {{(pid=98206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 21 02:19:01.191813 np0000001127 nova-compute[98206]: WARNING nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 21 02:19:01.192481 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 21 02:19:01.239339 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.processutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CMD "env LANG=C uptime" returned: 0 in 0.047s {{(pid=98206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 21 02:19:01.239693 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Hypervisor/Node resource view: name=np0000001127 free_ram=14813MB free_disk=72.80685043334961GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 21 02:19:01.239849 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 21 02:19:01.240052 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 21 02:19:02.413477 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 21 02:19:02.413912 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Final resource view: name=np0000001127 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:19:01 up 49 min,  1 user,  load average: 1.11, 3.87, 5.00\n'} {{(pid=98206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 21 02:19:02.454960 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Refreshing inventories for resource provider a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 21 02:19:02.490647 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Updating ProviderTree inventory for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 21 02:19:02.490788 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Updating inventory in ProviderTree for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 21 02:19:02.524406 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Refreshing aggregate associations for resource provider a0b7bd56-5a70-4557-8cfd-9f933f412754, aggregates: None {{(pid=98206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 21 02:19:02.563826 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Refreshing trait associations for resource provider a0b7bd56-5a70-4557-8cfd-9f933f412754, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_ARCH_X86_64,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ARCH_PPC64LE,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,HW_ARCH_X86_64,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ARCH_S390X,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOUND_MODEL_USB,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_SOUND_MODEL_SB16,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_ARCH_RISCV64,COMPUTE_ARCH_MIPSEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ARCH_AARCH64,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_SOUND_MODEL_AC97,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX {{(pid=98206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 21 02:19:02.605292 np0000001127 nova-compute[98206]: DEBUG nova.virt.libvirt.driver [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98206) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 21 02:19:02.605483 np0000001127 nova-compute[98206]: DEBUG nova.compute.provider_tree [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed in ProviderTree for provider: a0b7bd56-5a70-4557-8cfd-9f933f412754 {{(pid=98206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 21 02:19:03.107816 np0000001127 nova-compute[98206]: DEBUG nova.scheduler.client.report [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Inventory has not changed for provider a0b7bd56-5a70-4557-8cfd-9f933f412754 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 21 02:19:03.614166 np0000001127 nova-compute[98206]: DEBUG nova.compute.resource_tracker [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Compute_service record updated for np0000001127:np0000001127 {{(pid=98206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 21 02:19:03.614662 np0000001127 nova-compute[98206]: DEBUG oslo_concurrency.lockutils [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.374s {{(pid=98206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 21 02:19:03.614852 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:19:03.974488 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:19:05.189843 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:19:05.614593 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:19:05.614791 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:19:05.614911 np0000001127 nova-compute[98206]: DEBUG nova.compute.manager [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 21 02:19:05.615117 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.06 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:19:05.676137 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:19:05.676423 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.87 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:19:07.551100 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:19:07.551519 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:19:08.975498 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:19:09.550961 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:19:09.551392 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.12 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:19:09.675894 np0000001127 nova-compute[98206]: DEBUG oslo_service.periodic_task [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 21 02:19:09.676314 np0000001127 nova-compute[98206]: DEBUG oslo.service.backend._threading.loopingcall [None req-7b7d7238-3822-489b-8d24-1023e9079fe8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.00 seconds {{(pid=98206) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 21 02:19:13.976429 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:19:18.977420 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:19:23.978498 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:19:28.980302 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:19:33.981543 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 21 02:19:38.982811 np0000001127 nova-compute[98206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98206) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}